- Overview
- Requirements
- Recommended: Deployment templates
- Manual: Preparing the installation
- Manual: Preparing the installation
- Step 1: Configuring the OCI-compliant registry for offline installations
- Step 2: Configuring the external objectstore
- Step 3: Configuring High Availability Add-on
- Step 4: Configuring Microsoft SQL Server
- Step 5: Configuring the load balancer
- Step 6: Configuring the DNS
- Step 7: Configuring the disks
- Step 8: Configuring kernel and OS level settings
- Step 9: Configuring the node ports
- Step 10: Applying miscellaneous settings
- Step 12: Validating and installing the required RPM packages
- Step 13: Generating cluster_config.json
- Cluster_config.json Sample
- General configuration
- Profile configuration
- Certificate configuration
- Database configuration
- External Objectstore configuration
- Pre-signed URL configuration
- ArgoCD configuration
- External OCI-compliant registry configuration
- Disaster recovery: Active/Passive and Active/Active configurations
- High Availability Add-on configuration
- Orchestrator-specific configuration
- Insights-specific configuration
- Process Mining-specific configuration
- Document Understanding-specific configuration
- Automation Suite Robots-specific configuration
- AI Center-specific configuration
- Monitoring configuration
- Optional: Configuring the proxy server
- Optional: Enabling resilience to zonal failures in a multi-node HA-ready production cluster
- Optional: Passing custom resolv.conf
- Optional: Increasing fault tolerance
- Adding a dedicated agent node with GPU support
- Adding a dedicated agent Node for Task Mining
- Connecting Task Mining application
- Adding a Dedicated Agent Node for Automation Suite Robots
- Step 15: Configuring the temporary Docker registry for offline installations
- Step 16: Validating the prerequisites for the installation
- Manual: Performing the installation
- Post-installation
- Cluster administration
- Managing products
- Getting Started with the Cluster Administration portal
- Migrating objectstore from persistent volume to raw disks
- Migrating from in-cluster to external High Availability Add-on
- Migrating data between objectstores
- Migrating in-cluster objectstore to external objectstore
- Migrating to an external OCI-compliant registry
- Switching to the secondary cluster manually in an Active/Passive setup
- Disaster Recovery: Performing post-installation operations
- Converting an existing installation to multi-site setup
- Guidelines on upgrading an Active/Passive or Active/Active deployment
- Guidelines on backing up and restoring an Active/Passive or Active/Active deployment
- Monitoring and alerting
- Migration and upgrade
- Migrating between Automation Suite clusters
- Upgrading Automation Suite
- Downloading the installation packages and getting all the files on the first server node
- Retrieving the latest applied configuration from the cluster
- Updating the cluster configuration
- Configuring the OCI-compliant registry for offline installations
- Executing the upgrade
- Performing post-upgrade operations
- Applying a patch
- Product-specific configuration
- Best practices and maintenance
- Troubleshooting
- How to troubleshoot services during installation
- How to uninstall the cluster
- How to clean up offline artifacts to improve disk space
- How to clear Redis data
- How to enable Istio logging
- How to manually clean up logs
- How to clean up old logs stored in the sf-logs bucket
- How to disable streaming logs for AI Center
- How to debug failed Automation Suite installations
- How to delete images from the old installer after upgrade
- How to disable TX checksum offloading
- How to manually set the ArgoCD log level to Info
- How to expand AI Center storage
- How to generate the encoded pull_secret_value for external registries
- How to address weak ciphers in TLS 1.2
- How to check the TLS version
- How to schedule Ceph backup and restore data
- Unable to run an offline installation on RHEL 8.4 OS
- Error in downloading the bundle
- Offline installation fails because of missing binary
- Certificate issue in offline installation
- SQL connection string validation error
- Prerequisite check for selinux iscsid module fails
- Azure disk not marked as SSD
- Failure after certificate update
- Antivirus causes installation issues
- Automation Suite not working after OS upgrade
- Automation Suite requires backlog_wait_time to be set to 0
- Volume unable to mount due to not being ready for workloads
- Support bundle log collection failure
- Data loss when reinstalling or upgrading Insights following Automation Suite upgrade
- Unable to access Automation Hub following upgrade to Automation Suite 2024.10.0
- Single-node upgrade fails at the fabric stage
- Upgrade fails due to unhealthy Ceph
- RKE2 not getting started due to space issue
- Volume unable to mount and remains in attach/detach loop state
- Upgrade fails due to classic objects in the Orchestrator database
- Ceph cluster found in a degraded state after side-by-side upgrade
- Unhealthy Insights component causes the migration to fail
- Service upgrade fails for Apps
- In-place upgrade timeouts
- Docker registry migration stuck in PVC deletion stage
- AI Center provisioning failure after upgrading to 2023.10 or later
- Upgrade fails in offline environments
- SQL validation fails during upgrade
- snapshot-controller-crds pod in CrashLoopBackOff state after upgrade
- Setting a timeout interval for the management portals
- Authentication not working after migration
- Kinit: Cannot find KDC for realm <AD Domain> while getting initial credentials
- Kinit: Keytab contains no suitable keys for *** while getting initial credentials
- GSSAPI operation failed due to invalid status code
- Alarm received for failed Kerberos-tgt-update job
- SSPI provider: Server not found in Kerberos database
- Login failed for AD user due to disabled account
- ArgoCD login failed
- Update the underlying directory connections
- Partial failure to restore backup in Automation Suite 2024.10.0
- Failure to get the sandbox image
- Pods not showing in ArgoCD UI
- Redis probe failure
- RKE2 server fails to start
- Secret not found in UiPath namespace
- ArgoCD goes into progressing state after first installation
- MongoDB pods in CrashLoopBackOff or pending PVC provisioning after deletion
- Pods stuck in Init:0/X
- Missing Ceph-rook metrics from monitoring dashboards
- Running High Availability with Process Mining
- Process Mining ingestion failed when logged in using Kerberos
- After Disaster Recovery Dapr is not working properly for Process Mining
- Unable to connect to AutomationSuite_ProcessMining_Warehouse database using a pyodbc format connection string
- Airflow installation fails with sqlalchemy.exc.ArgumentError: Could not parse rfc1738 URL from string ''
- How to add an IP table rule to use SQL Server port 1433
- Automation Suite certificate is not trusted from the server where CData Sync is running
- Task Mining troubleshooting
- Running the diagnostics tool
- Using the Automation Suite support bundle
- Exploring Logs
Automation Suite on Linux Installation Guide
Restoring the backup
Once a cluster is restored, the snapshot backup is not enabled. To enable it after restore, see Enabling the backup snapshot.
Restoring the cluster does not restore external data sources such as SQL Server, objectstore, or the OCI-compliant registry. Make sure to restore these datasource to the relevant snapshot.
To restore the cluster, take the following steps:
- Install the cluster infrastructure on all the server nodes. Details...Note:
The hardware you provide for the restore cluster must be similar to the backup cluster hardware. For details, see Hardware and software requirements.
- Configure the snapshot on the restored cluster. Details...
- Select the snapshot to restore. Details...
- Restore the data and settings. Details...
- Download the restore installer. You can find it inside the
as-installer.zip
package. For download instructions, see Downloading the installation packages. - In offline environments, you must provide an external OCI-compliant registry or a temporary registry. Note that the registry
configuration must remain the same as the one of the original cluster. To configure the registry, see the following instructions:
- Configuring the external OCI-compliant registry
- Configuring the temporary Docker registry. Choose this option only if you did not use an external OCI-compliant registry before the disaster occurred.
- Prepare the configuration file and make it available on all the cluster nodes. To prepare the configuration file, take one
of the following steps:
- Option A: Reuse the
cluster_config.json
file that you applied to the cluster before the disaster occurred; - Option B: Create a minimal
cluster_config.json
file with the required parameters, as shown in the following example:{ "fixed_rke_address": "fqdn", "fqdn": "fqdn", "rke_token": "guid", "profile": "cluster_profile", "external_object_storage": { "enabled": false }, "install_type": "offline or online", "snapshot": { "enabled": true, "nfs": { "server": "nfs_server_endpoint", "location": "nfs_server_mountpoint" } }, "proxy": { "enabled": false } }
{ "fixed_rke_address": "fqdn", "fqdn": "fqdn", "rke_token": "guid", "profile": "cluster_profile", "external_object_storage": { "enabled": false }, "install_type": "offline or online", "snapshot": { "enabled": true, "nfs": { "server": "nfs_server_endpoint", "location": "nfs_server_mountpoint" } }, "proxy": { "enabled": false } }
- Option A: Reuse the
cluster_config.json
file. Make sure to provide the same parameter values as the ones used in the orginal cluster. You can change the parameter
values post-restore.
cluster_config.json
parameters listed in the following table, you must also provide the external OCI-compliant registry configuration. For details,
see External OCI-compliant registry configuration.
Parameter |
Value |
---|---|
|
FQDN of the Automation Suite cluster. The value must be the same as the old FQDN. Providing a different FQDN value may cause the restoration to fail. |
|
The fixed address used to load balance node registration and Kube API requests. If the load balancer is configured as recommended, the value should be the same value as the one for
fqdn . Otherwise, use the fqdn value of the first server node. Refer to Configuring the load balancer for more details.
|
|
Use a newly generated GUID here. This is a pre-shared, cluster-specific secret. It is needed for all the nodes joining the cluster. |
|
Sets the profile of the installation. The available profiles are:
|
|
Indicates the type of installation you plan to perform. Your options are:
|
| The FQDN or the IP address of the snapshot storage location (such as mynfs.mycompany.com or 192.23.222.81 ).
|
| The location or path to the snapshot storage location. |
| The path to the custom directory used for pod logs. This is required if the cluster was configured with custom pod logs path. |
|
This parameter is mandatory only if the proxy is enabled. For details, see Optional: Configuring the proxy server. |
cluster_config.json
, see Manual: Advanced installation experience.
Installing the cluster infrastructure on the primary server node
To install the infrastructure on the primary restore cluster node, run the following commands:
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json --accept-license-agreement --restore
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json --accept-license-agreement --restore
cluster_config.json
from the primary server node to the remaining server/agents nodes. The infrastructure installation step on the primary server
node adds extra values that the remaining nodes need.
Installing the cluster infrastructure on secondary servers
To install the infrastructure on the secondary servers:
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j server --accept-license-agreement --restore
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j server --accept-license-agreement --restore
Installing the infrastructure on all the agent machines
To install the infrastructure on the agent nodes:
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j agent --accept-license-agreement --restore
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j agent --accept-license-agreement --restore
Hydrating the in-cluster registry for offline installations
This step is required only if you use an in-cluster registry for offline installations. You must hydrate the registry before you trigger the restore, by using the following command:
./bin/uipathctl rke2 registry hydrate-registry /opt/UiPathAutomationSuite/cluster_config.json
./bin/uipathctl rke2 registry hydrate-registry /opt/UiPathAutomationSuite/cluster_config.json
Installing the cluster infrastructure on service nodes
Installing the cluster infrastructure on Task Mining nodes
To install the cluster infrastructure on Task Mining nodes:
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j task-mining --accept-license-agreement --restore
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j task-mining --accept-license-agreement --restore
Installing the cluster infrastructure on Automation Suite Robots nodes
To install the cluster infrastructure on Automation Suite Robots nodes:
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j asrobots --accept-license-agreement --restore
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j asrobots --accept-license-agreement --restore
Installing the cluster infrastructure on GPU nodes
To install the cluster infrastructure on GPU nodes:
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j gpu --accept-license-agreement --restore
cd <installer directory>
./bin/uipathctl rke2 install -i ../../cluster_config.json -o output.json -j gpu --accept-license-agreement --restore
Once the infrastructure is installed, you need to prepare the cluster snapshot for restore. Based on your scenario, you must run the following commands:
-
If you use an external objectore:
./bin/uipathctl manifest apply /opt/UiPathAutomationSuite/cluster_config.json --only velero --versions versions/helm-charts.json
./bin/uipathctl manifest apply /opt/UiPathAutomationSuite/cluster_config.json --only velero --versions versions/helm-charts.json
-
If you use an in-cluster ceph-objectstore:
./bin/uipathctl manifest apply /opt/UiPathAutomationSuite/cluster_config.json --only base,rook-ceph-operator,rook-ceph-object-store,velero --versions versions/helm-charts.json
./bin/uipathctl manifest apply /opt/UiPathAutomationSuite/cluster_config.json --only base,rook-ceph-operator,rook-ceph-object-store,velero --versions versions/helm-charts.json
To configure the backup of the restored cluster, follow the steps in the Configure the cluster snapshot section.
After configuring the snapshot, list the existing snapshots and decide on the one you want to use as a restoring point.
--from-snapshot <snapshot-name>
flag.
./bin/uipathctl snapshot restore create <restore_name> --from-snapshot <snapshot_name>
./bin/uipathctl snapshot restore create <restore_name> --from-snapshot <snapshot_name>
--wait
option. To check the status of the restore process, run the following
command:./bin/uipathctl snapshot restore history
./bin/uipathctl snapshot restore history
If you do not specify the snapshot name, the cluster restores the latest successful snapshot. See the snapshot list for available snapshots.
cluster_config.json
file for future usage, such as adding new nodes to the cluster, upgrading, etc.
cluster_config.json
, take the following steps:
-
You need to find the last applied configuration, by running the following command:
The following sample is an example of the command output:./bin/uipathctl manifest list-revisions
./bin/uipathctl manifest list-revisionsVERSION UPDATED STATUS 1 2024-11-07 00:46:41 +0000 UTC successful 2 2024-11-07 01:14:20 +0000 UTC successful 3 2024-11-07 01:23:23 +0000 UTC successful
VERSION UPDATED STATUS 1 2024-11-07 00:46:41 +0000 UTC successful 2 2024-11-07 01:14:20 +0000 UTC successful 3 2024-11-07 01:23:23 +0000 UTC successful -
Select the correct VERSION number deployed before backup creation and run the following command to retrieve the
cluster_config.json
file:./bin/uipathctl manifest get-revision --version <VERSION>
./bin/uipathctl manifest get-revision --version <VERSION>The following sample is an example of the command output:
./bin/uipathctl manifest get-revision --version 1 > ./cluster_config.json
./bin/uipathctl manifest get-revision --version 1 > ./cluster_config.json
After restoring the cluster, make sure to add your CA certificates to the trust store of the restored VMs. For details, see:
After restoring an Automation Suite cluster, you need to retrieve the new monitoring password. For this, follow the steps from Accessing the monitoring tools.
After restoring an Automation Suite cluster with AI Center™ enabled, follow the steps from the Enabling AI Center on the Restored Cluster procedure.
- Step 1: Installing the cluster infrastructure
- Preparation
- Execution
- Step 2: Preparing the cluster for restore
- Step 3: Selecting the snapshot to restore
- Step 4: Restoring data and settings
- Restoring cluster_config.json
- Adding CA certificates to the trust store
- Retrieving new monitoring password
- Enabling AI Center on the Restored Cluster