À propos de l'ancrage dans le contexte

Context Grounding is a component of the UiPath AI Trust Layer which allows you to bring in your data to generate more accurate, reliable GenAI predictions. Context Grounding is designed to make your business data LLM-ready without the need for any additional subscription to embedding models, vector databases, or large language models (LLMs). You can create representative indexes and embeddings of business data that UiPath GenAI features can reference for contextual evidence at runtime.

Context Grounding is a tenant-scoped platform service designed to support UiPath GenAI experiences (such as GenAI Activities and Autopilot for everyone) by grounding your prompts with relevant information before they are executed by the LLM via retrieval augmented generation (RAG).

L'ajout de RAG en tant que service aux expériences UiPath GenAI permet de :

• Contourner les limitations de la fenêtre contextuelle LLM : pour les petits et les grands modèles, RAG permet d’améliorer la précision, la fiabilité, l’évolutivité et l’efficacité des modèles lorsqu’ils interagissent avec les bases de connaissances.
• Réduisez le risque d'abus grâce à des références aux magasins de données sur la vérité terrain.
• Accordez aux applications génératives l'accès à des sources de connaissances spécialisées et propriétaires.
• Accordez aux applications génératives l'accès aux sources d'informations actualisées.
• Activer les boucles de commentaires positifs entre les magasins de données et les requêtes des utilisateurs.

Core components

The terminology and core components of Context Grounding include:

Figure 1. Context Grounding component architecture

Ingestion et indexation : tenez vos données d'entreprise compatibles LLM

• Ingestion: Convert business data into representative embeddings using UiPath-managed embedding models.
• Embedding: A representation of business data than an LLM can understand and search through.
• Index: A folder in a vector database that organizes the embeddings.
• Vector DBs: UiPath-managed vector database that stores embeddings organized in indexes.

Retrieval

• Search through LLM-ready business data to find the most relevant information. Context Grounding uses a variety of extraction, chunking, retrieval, and re-ranking techniques that are optimized based on different data formats and queries.
• Interpréter l’invite en tant que requête pour effectuer une recherche dans les intégrations et générer les résultats les plus pertinents en fonction de la recherche de similarité cosine. Ces résultats de recherche constituent une étape intermédiaire et préliminaire au RAG, afin d’ajouter un contexte pertinent à partir des données d’entreprise.

Retrieval Augmented Generation

• Ancrez et mettez à jour les invites avec les informations les plus pertinentes à partir des résultats de la recherche de similitude sémantique, puis exécutez une génération via un LLM hébergé via la passerelle LLM de AI Trust Layer.

Fonctionnalités clés

Voici quelques-unes des principales fonctionnalités de l'ancrage en contexte :

• Multi-document support: PDF, JSON, CSV, XLS, DOCX, TXT files.
• Managed ingestion and indexing pipelines: UiPath optimizes the ingestion and indexing of data in UiPath-managed vector databases.
• Multiple surfaces: Context Grounding is currently available as part of the UiPath GenAI Activities, AI Trust Layer (with a dedicated UI), and Autopilot for everyone.
• Data retrieval: Query within documents or across datasets using a variety of techniques (e.g. query transformation, embedding, fine tuning, etc.) to ensure search results are highly relevant.
• Retrieval Augmented Generation: Ground prompts via just-in-time (JIT) in-memory or over a knowledge base.
• Proof of knowledge: Provides a citation of the reference source and text from the semantic similarity search.
• Streaming support: Streaming API support to show generation as it is being produced.
• Multilingual support: Ability to ingest and query from documents in all UTF-8 encoded languages.
• Support for multiple data sources:
  • UiPath Orchestrator bucket entities: You can ingest, index, and query data stored within shared folders in Orchestrator bucket entities.
  • Document storage systems: Through Integration Service connectors, such as Microsoft OneDrive & SharePoint and Google Drive: Context Grounding can access data directly stored in third-party applications.

Limitations and considerations

• Context Grounding currently supports specific file types: PDF, JSON, CSV, XLS, DOCX, TXT.
• There is a limit of ten indexes per tenant. We recommend you keep a 1-1 relationship with these and the folder path in the data source you want to use.
• Context Grounding respects folder permissions and authorization for shared folder entities. Users who do not have the appropriate permissions may not be able to see, update, delete, or use indexes that are affiliated with folders they do not have permissions to.
• To use Context Grounding through UiPath GenAI Activities, you must use Studio Web or Studio Desktop version 2024.4 or newer. For more information, see the Getting started section.