Summarizing nightly executions

Catch up on last night's regression run with the Summarize nightly execution routine in Delegate, without opening Test Manager.

The setup: you are a QA engineer whose team runs a test set called "Regression Suite – API" every night in project MYAPP. You arrive Tuesday morning and want to know how Monday night's run went, without opening Test Manager.

Prerequisites

Complete the one-time setup in Setting up and running your first test case.

How to

1. Select Summarize nightly execution in the Delegate Routines panel.
2. Enter the prompt: "Summarize last night's execution of Regression Suite – API in project MYAPP."

Result

Delegate works in the background: it finds the test set, finds the execution that finished overnight in your time zone, pulls pass/fail stats, fetches failing test case logs and their assertions, compares with the previous run to find new failures, and looks back 4–5 runs to spot flaky tests.

You get a summary with the pass rate, top failures, new failures, and flaky test cases, and Delegate asks what is next — for example, whether to email the summary or dig into any of the failing test cases. Total time with the routine: about 30 seconds instead of 10–15 minutes.

Note:

This use case is the worked example behind the "Summarize nightly execution" routine described on the Routines for testing page.