- Automation Cloud と Test Cloud
- Automation Cloud (専有型) および Test Cloud (専有型)
September 2026 release notes for Agents in Automation Cloud and Test Cloud.
September 7, 2026
Introducing the LLM as Judge guardrail [Preview]
A new built-in guardrail, LLM as Judge, is now available in preview. LLM as Judge uses an LLM to evaluate agent prompts, responses, or LLM calls against custom instructions that you write in plain natural language, closing the gap left by other out-of-the-box guardrails, which only detect a fixed, predefined category through a managed classification service.
Each check the guardrail performs makes a real LLM call, so the judge model consumes Agent Units or Platform Units on top of the agent's own usage, tracked separately. This applies wherever the guardrail runs, including agent evaluation runs with the guardrail enabled. For details, see Out-of-the-box guardrails and Licensing.