- Overview
- Requirements
- Installation
- Q&A: Deployment templates
- Downloading the installation packages
- Install-uipath.sh Parameters
- Enabling Redis High Availability Add-On for the cluster
- Document Understanding configuration file
- Adding a dedicated agent node with GPU support
- Connecting Task Mining application
- Adding a dedicated agent Node for Task Mining
- Adding a Dedicated Agent Node for Automation Suite Robots
- Post-installation
- Cluster administration
- Monitoring and alerting
- Migration and upgrade
- Migration options
- Step 1: Moving the Identity organization data from standalone to Automation Suite
- Step 2: Restoring the standalone product database
- Step 3: Backing up the platform database in Automation Suite
- Step 4: Merging organizations in Automation Suite
- Step 5: Updating the migrated product connection strings
- Step 6: Migrating standalone Insights
- Step 7: Deleting the default tenant
- Performing a single tenant migration
- Product-specific configuration
- Best practices and maintenance
- Troubleshooting
- How to troubleshoot services during installation
- How to uninstall the cluster
- How to clean up offline artifacts to improve disk space
- How to clear Redis data
- How to enable Istio logging
- How to manually clean up logs
- How to clean up old logs stored in the sf-logs bucket
- How to disable streaming logs for AI Center
- How to debug failed Automation Suite installations
- How to delete images from the old installer after upgrade
- How to automatically clean up Longhorn snapshots
- How to disable TX checksum offloading
- How to address weak ciphers in TLS 1.2
- Unable to run an offline installation on RHEL 8.4 OS
- Error in Downloading the Bundle
- Offline installation fails because of missing binary
- Certificate issue in offline installation
- First installation fails during Longhorn setup
- SQL connection string validation error
- Prerequisite check for selinux iscsid module fails
- Azure disk not marked as SSD
- Failure after certificate update
- Antivirus causes installation issues
- Automation Suite not working after OS upgrade
- Automation Suite requires backlog_wait_time to be set to 0
- Volume unable to mount due to not being ready for workloads
- Unable to launch Automation Hub and Apps with proxy setup
- Failure to upload or download data in objectstore
- PVC resize does not heal Ceph
- Failure to resize PVC
- Failure to resize objectstore PVC
- Rook Ceph or Looker pod stuck in Init state
- StatefulSet volume attachment error
- Failure to create persistent volumes
- Storage reclamation patch
- Backup failed due to TooManySnapshots error
- All Longhorn replicas are faulted
- Setting a timeout interval for the management portals
- Update the underlying directory connections
- Authentication not working after migration
- Kinit: Cannot find KDC for realm <AD Domain> while getting initial credentials
- Kinit: Keytab contains no suitable keys for *** while getting initial credentials
- GSSAPI operation failed due to invalid status code
- Alarm received for failed Kerberos-tgt-update job
- SSPI provider: Server not found in Kerberos database
- Login failed for AD user due to disabled account
- ArgoCD login failed
- Failure to get the sandbox image
- Pods not showing in ArgoCD UI
- Redis probe failure
- RKE2 server fails to start
- Secret not found in UiPath namespace
- ArgoCD goes into progressing state after first installation
- Unexpected inconsistency; run fsck manually
- MongoDB pods in CrashLoopBackOff or pending PVC provisioning after deletion
- MongoDB Pod Fails to Upgrade From 4.4.4-ent to 5.0.7-ent
- Unhealthy services after cluster restore or rollback
- Pods stuck in Init:0/X
- Prometheus in CrashloopBackoff state with out-of-memory (OOM) error
- Missing Ceph-rook metrics from monitoring dashboards
- Pods cannot communicate with FQDN in a proxy environment
- Using the Automation Suite Diagnostics Tool
- Using the Automation Suite support bundle
- Exploring Logs
Preparation
Perform the following steps on the first server node and then on all the other nodes (both server and agent) in the cluster.
Make sure you have 10GiB of free space in the /opt/UiPathAutomationSuite folder on all the nodes. If you do not have enough space, you can either increase the capacity of this folder or remove all the previous installer files except for cluster_config.json. You can always download the previous installer again.
To verify available space, run the following command: df -h /opt/UiPathAutomationSuite.
To prepare for the upgrade, take the following steps:
-
Log into any server machine using SSH. In the case of single-node evaluation profile, where you have only one server node, log into that node.
-
Become root user:
sudo su -sudo su - -
Create an installation folder under the
/opt/UiPathAutomationSuitedirectory:# Please replace {version} with installer version mkdir -p /opt/UiPathAutomationSuite/{version}/installer# Please replace {version} with installer version mkdir -p /opt/UiPathAutomationSuite/{version}/installer -
Download
sf-installer.zipand copy it to/opt/UiPathAutomationSuite/{version}/installer. For download instructions, see sf-installer.zip.cp /path/to/sf-installer.zip /opt/UiPathAutomationSuite/{version}/installercp /path/to/sf-installer.zip /opt/UiPathAutomationSuite/{version}/installer -
Unzip
sf-installer.zip:cd /opt/UiPathAutomationSuite/{version}/installer unzip sf-installer.zip -d .cd /opt/UiPathAutomationSuite/{version}/installer unzip sf-installer.zip -d . -
Provide permission to the installer:
chmod 755 -R /opt/UiPathAutomationSuite/{version}/installerchmod 755 -R /opt/UiPathAutomationSuite/{version}/installer -
Generate the latest
cluster_config.jsonfile on the first server node and copy it to the rest of the nodes.Note:For details on how to configure the
cluster_config.jsonparameters, see Advanced installation experience.-
If you have the old
cluster_config.json, generate the configuration file from the cluster:cd /opt/UiPathAutomationSuite/{version}/installer ./configureUiPathAS.sh config get -i /path/to/old/cluster_config.json -o ./cluster_config.jsoncd /opt/UiPathAutomationSuite/{version}/installer ./configureUiPathAS.sh config get -i /path/to/old/cluster_config.json -o ./cluster_config.json -
If you do not have the old
cluster_config.jsonfile, generate any override of any default values, which you may have done at the time of previous version installation:cd /opt/UiPathAutomationSuite/{version}/installer ./configureUiPathAS.sh config get -o ./cluster_config.jsoncd /opt/UiPathAutomationSuite/{version}/installer ./configureUiPathAS.sh config get -o ./cluster_config.json -
If you are upgrading from a previous version of AI CenterTM standalone, and your 2022.10 version of AI Center needs to be connected to an external Orchestrator, copy the Orchestrator certificate to the virtual machine. After you copy the certificate, the following configuration details are needed in
cluster_config.json:"aicenter": { "enabled": true, "orchestrator_url": "https://orchestrator.example.com", //Specify the Orchestrator URL for AI Center "identity_server_url": "https://orchestrator.example.com/identity", //Specify the Identiy URL for AI Center "orchestrator_cert_file_path": "/opt/UiPathAutomationSuite/UiPath_Installer/orch.cer", //Specify the path to the Orchestrator certificate "identity_cert_file_path": "/opt/UiPathAutomationSuite/UiPath_Installer/orch.cer", //Specify the path to Identity certificate file "metering_api_key": "test" //Specify the metering API key }"aicenter": { "enabled": true, "orchestrator_url": "https://orchestrator.example.com", //Specify the Orchestrator URL for AI Center "identity_server_url": "https://orchestrator.example.com/identity", //Specify the Identiy URL for AI Center "orchestrator_cert_file_path": "/opt/UiPathAutomationSuite/UiPath_Installer/orch.cer", //Specify the path to the Orchestrator certificate "identity_cert_file_path": "/opt/UiPathAutomationSuite/UiPath_Installer/orch.cer", //Specify the path to Identity certificate file "metering_api_key": "test" //Specify the metering API key }Note:If AI Center requires an external Orchestrator, add
sql_connection_string_templateandsql_connection_string_template_odbcin thecluster_config.jsonfile.After upgrading to AI Center 2022.10 and moving to external storage, making a skill created in 2022.4 public will fail. To fix this, run the script from here.
-
If you are upgrading Automation Suite from a previous version and now enable Process Mining as well, you must update the
sql_connection_string_template_sqlalchemy_pyodbc. Below is an example."sql_connection_string_template_sqlalchemy_pyodbc": "mssql+pyodbc://testadmin@sfmfup20211043125452-8926d153-sql.database.windows.net:sgTQrg%40R%40dvoYddYBoKn045ncoC9WhWU@sfmfup20211043125452-8926d153-sql.database.windows.net:1433/DB_NAME_PLACEHOLDER?driver=ODBC+Driver+17+for+SQL+Server""sql_connection_string_template_sqlalchemy_pyodbc": "mssql+pyodbc://testadmin@sfmfup20211043125452-8926d153-sql.database.windows.net:sgTQrg%40R%40dvoYddYBoKn045ncoC9WhWU@sfmfup20211043125452-8926d153-sql.database.windows.net:1433/DB_NAME_PLACEHOLDER?driver=ODBC+Driver+17+for+SQL+Server"See also Manual: Advanced installation experience.
-
-
(Optional) If you still use a self-signed certificate generated by the installer, run the following command. This step is required on the first server node, where you will perform the upgrade of UiPath products.
### Please replace /path/to/cert with path to location where you want to store certificates. ./configureUiPathAS.sh tls-cert get --outpath /path/to/cert ### Now copy the ca.crt file generated in above location to trust store location sudo cp --remove-destination /part/to/cert/ca.crt /etc/pki/ca-trust/source/anchors/ ### Update the trust store sudo update-ca-trust### Please replace /path/to/cert with path to location where you want to store certificates. ./configureUiPathAS.sh tls-cert get --outpath /path/to/cert ### Now copy the ca.crt file generated in above location to trust store location sudo cp --remove-destination /part/to/cert/ca.crt /etc/pki/ca-trust/source/anchors/ ### Update the trust store sudo update-ca-trust
Execution
If any errors or issues occur during or following the upgrade, you can rollback to the previous version, provided that you previously configured a backup. For instructions, see Rollback on error.
Configuring the backup
To configure the backup, take the following steps:
-
Make sure you have enabled the backup on the cluster. You must create the backup using the same version of the installer as the one you used for the current deployment. For instructions, see the backup and restore documentation corresponding to the Automation Suite version from which you plan to upgrade. For instance, if you plan to upgrade from Automation Suite 2021.10, follow the instructions in the 2021.10 guide.
-
Connect to one of the server nodes via SSH.
-
To verify that all desired volumes have backups in the cluster, run:
/path/to/old-installer/configureUiPathAS.sh verify-volumes-backup/path/to/old-installer/configureUiPathAS.sh verify-volumes-backupNote:The backup might take some time, so wait for approximately 15-20 minutes, and then verify the volumes backup again.
Once the backup is created, continue with the following steps.
Putting the cluster in maintenance mode
Putting the cluster in maintenance mode will shut down the ingress controller and all the UiPath services, blocking all the incoming traffic to the Automation Suite cluster.
This operation will cause downtime, and your business automation will be suspended during the entire upgrade process.
-
To put the cluster in maintenance mode, run:
cd /opt/UiPathAutomationSuite/{version}/installer ./configureUiPathAS.sh enable-maintenance-modecd /opt/UiPathAutomationSuite/{version}/installer ./configureUiPathAS.sh enable-maintenance-mode -
To verify that the cluster is in maintenance mode, run:
./configureUiPathAS.sh is-maintenance-enabled./configureUiPathAS.sh is-maintenance-enabledImportant:Create a backup of your SQL Server after enabling maintenance mode so that no further transactions are recorded in your SQL database.
Updating Kubernetes and other infrastructure components
You must perform the infrastructure upgrade on all the nodes in the cluster.
You cannot perform this step on multiple nodes at the same time; you must wait for the upgrade to finish on each node before moving to another.
-
Log into each node where you want to perform the infrastructure upgrade.
-
Become root by running
sudo su -. -
Make sure
rke serviceis enabled on server and agent nodes.If the service is disabled, enable it by running the following command:
-
For a server node:
[[ $(systemctl is-enabled rke2-server.service) != "enabled" ]] && systemctl enable rke2-server.service[[ $(systemctl is-enabled rke2-server.service) != "enabled" ]] && systemctl enable rke2-server.service -
For an agent node:
[[ $(systemctl is-enabled rke2-agent.service) != "enabled" ]] && systemctl enable rke2-agent.service[[ $(systemctl is-enabled rke2-agent.service) != "enabled" ]] && systemctl enable rke2-agent.service
-
-
To start the upgrade, run the following command:
Important:Make sure you have updated
cluster_config.jsongenerated as described in the Preparation steps.# replace {version} with the version you are upgrading to cd /opt/UiPathAutomationSuite/{version}/installer ./install-uipath.sh --upgrade -k -i ./cluster_config.json -o ./output.json --accept-license-agreement# replace {version} with the version you are upgrading to cd /opt/UiPathAutomationSuite/{version}/installer ./install-uipath.sh --upgrade -k -i ./cluster_config.json -o ./output.json --accept-license-agreementImportant:If you get the following error, follow the instructions in Downgrading Ceph from 16.2.6 to 15.2.9.
Ceph cluster is running on version: 16.2.6 with known bug(https://docs.ceph.com/en/quincy/releases/pacific/#v16-2-6-pacific). Please provide temporary backup directory (via environment variable 'TMP_CEPH_BACKUP_PATH') to downgrade ceph
Updating Shared Components and UiPath Product Services
If you previously deployed your single-node installation using any Azure template version prior to 2022.10.3, and you now want to upgrade to a newer Automation Suite version, you must set the zone_resilience flag to false in the cluster_config.json file in /opt/UiPathAutomationSuite/Installer.
This step upgrades the fabric and service components running with the cluster. You must follow this steps only once from any of the server nodes.
-
Connect to any server node.
-
Become root by running
sudo su -. -
Run the following command:
# replace {version} with the version you are upgrading to cd /opt/UiPathAutomationSuite/{version}/installer ./install-uipath.sh --upgrade -f -s -i ./cluster_config.json --accept-license-agreement -o ./output.json# replace {version} with the version you are upgrading to cd /opt/UiPathAutomationSuite/{version}/installer ./install-uipath.sh --upgrade -f -s -i ./cluster_config.json --accept-license-agreement -o ./output.jsonImportant:Once the upgrade is done, maintenance mode will be disabled automatically.
After manually upgrading from Automation Suite 2021.10, you must also migrate to Cilium CNI. For instructions, see Migrating from Canal to Cilium CNI.
After performing the upgrade, you can take the following additional steps:
-
To verify if Automation Suite is healthy, run:
kubectl get applications -n argocdkubectl get applications -n argocd -
If you experience issues with image vulnerabilities or storage consumption after performing an upgrade, delete the images from the old installer. For details, see the Troubleshooting section.
Enabling the backup post-upgrade
You must resume the backup after upgrading and performing the cleanup and migration operations.
Make sure Automation Suite is up and running and your automation continues as expected before proceeding with the following steps.
To enable the backup, follow the instructions in described in the Backing up and restoring the cluster documentation.
Completing an upgrade with a deployment template
After performing an Automation Suite cluster upgrade, Azure and AWS template deployments require some changes to ensure a new node joins the cluster correctly through scale-out operations. To automate the changes, we recommend using the dedicated scripts. For instructions, see the Azure deployment template docs and the AWS deployment template docs.
Special considerations
When performing an upgrade for a cluster deployed with Azure templates, an error similar to the one shown in the following image might occur:
This is due to the way the Azure load balancer works. To fix the issue, modify the fixed_rke_address field in the cluster_config.json file. You must change the value of this field to the IP address of the first server instance prior to running the upgrade command. The cluster_config.json uploaded to the key vault should continue to have the IP address of the ILB since the node is not healthy, and traffic will not be balanced to it.
- Preparation
- Execution
- Configuring the backup
- Putting the cluster in maintenance mode
- Updating Kubernetes and other infrastructure components
- Updating Shared Components and UiPath Product Services
- Enabling the backup post-upgrade
- Completing an upgrade with a deployment template
- Special considerations