Como coletar dados de uso de DU com objectstore (Ceph) no cluster

Colete dados de uso do Document Understanding ao usar o objectstore (Ceph) no cluster no Automation Suite no EKS/AKS.

Esta seção explica como coletar dados de uso do Document Understanding (DU) ao usar o Objectstore no cluster (Ceph).

Siga as seguintes etapas:

1. Antes de executar o script do coletor de DU, certifique-se de atualizar os seguintes valores:
   • <REGISTRY>:
     • Use localhost:30071 para implantações offline.
     • Use registry.uipath.com para implantações online.
     • Use seu URL de registro externo para registros privados.
   • <TAG>: abra versions.json e localize a tag de imagem sf-k8-utils-rhel . Use essa tag para substituir <TAG> no script.
2. Execute o script do coletor de uso de DU após atualizar os valores, da seguinte forma:

   NAMESPACE="rook-ceph"
   POD_NAME="du-usage-collector"
   SECRET_NAME="ceph-object-store-secret"
   LOCAL_TAR="du-usage.tar.gz"
   MOUNTED_SECRET_PATH="/rook-secret"
   TARGET_PATH="aistorage/org-00000000-0000-0000-0000-000000000001/tenant-00000000-0000-0000-0000-000000000001"
   BUCKET_NAME="ai-storage"
   IMAGE="<REGISTRY>/uipath/sf-k8-utils-rhel:<TAG>"
   
   echo "[*] Removing pod $POD_NAME in namespace $NAMESPACE..."
   kubectl delete pod "$POD_NAME" -n "$NAMESPACE" --ignore-not-found=true
   
   echo "[*] Creating pod $POD_NAME in namespace $NAMESPACE..."
   kubectl apply -n "$NAMESPACE" -f - <<EOF
   apiVersion: v1
   kind: Pod
   metadata:
     name: $POD_NAME
     namespace: $NAMESPACE
   spec:
     restartPolicy: Never
     containers:
     - name: sleep
       image: $IMAGE
       command: ["bash", "-c", "echo 'Main container started, sleeping...'; sleep 3600"]
       volumeMounts:
       - name: output
         mountPath: /output
     initContainers:
     - name: du-usage-collector
       image: $IMAGE
       command: ["/bin/bash", "-c"]
       args:
         - |
           set -euo pipefail
           echo "[*] Extracting Ceph secret values..."
           ACCESS_KEY=\$(cat $MOUNTED_SECRET_PATH/OBJECT_STORAGE_ACCESSKEY)
           SECRET_KEY=\$(cat $MOUNTED_SECRET_PATH/OBJECT_STORAGE_SECRETKEY)
           HOST=\$(cat $MOUNTED_SECRET_PATH/OBJECT_STORAGE_INTERNAL_SERVICE)
           PORT=\$(cat $MOUNTED_SECRET_PATH/OBJECT_STORAGE_PORT)
           export AWS_ACCESS_KEY_ID=\$ACCESS_KEY
           export AWS_SECRET_ACCESS_KEY=\$SECRET_KEY
           echo "[*] Syncing from s3://$BUCKET_NAME/$TARGET_PATH ..."
           mkdir -p /tmp/download
           s3cmd sync s3://$BUCKET_NAME/$TARGET_PATH/ /tmp/download/ \
             --host=\$HOST:\$PORT --host-bucket= --no-ssl --no-check-certificate
           echo "[*] Creating archive..."
           mkdir -p /output
           tar -czf /output/du-usage.tar.gz -C /tmp/download .
           echo "[-] Archive ready at /output/du-usage.tar.gz"
       volumeMounts:
       - name: rook-secret
         mountPath: $MOUNTED_SECRET_PATH
         readOnly: true
       - name: output
         mountPath: /output
     volumes:
     - name: rook-secret
       secret:
         secretName: $SECRET_NAME
         optional: false
     - name: output
       emptyDir: {}
   EOF
   
   echo "[*] Waiting for pod to be Running..."
   for i in {1..30}; do
     phase=$(kubectl get pod "$POD_NAME" -n "$NAMESPACE" -o jsonpath="{.status.phase}")
     if [[ "$phase" == "Running" ]]; then
       echo "Pod is Running."
       break
     fi
     echo "[$i] Still waiting..."
     sleep 5
   done
   
   echo -e "\nArchive will be saved as: $LOCAL_TAR\n\n"
   echo "[*] Copying archive from pod to local..."
   kubectl cp "$NAMESPACE/$POD_NAME:/output/du-usage.tar.gz" "$LOCAL_TAR"
   

3. Depois de recuperar o arquivo, exclua o pod:

   kubectl delete pod "$POD_NAME" -n "$NAMESPACE"
   

O arquivo du-usage.tar.gz contém os dados de uso do DU.