Analysis / Business automation and AI evaluation
Investigate AI input and output drift
Investigate AI workflow drift in Proforma. Distinguish changed inputs, model versions and measured errors, then propose monitoring with clear label limits.
AI operations lead
Bring this question into Chat
Your starting prompt.
Compare [recent AI workflow cases] with [baseline] using explicit windows and stable feature definitions. Separate input mix shifts, changed prompts or models and measured error changes on reviewed cases. Show missing labels and small samples as limitations. Propose monitoring measures and review thresholds, with an Action design only if recurring checks are requested. Do not equate distribution drift with proven quality deterioration or automatically retrain a model.
Copy this starting point, then replace the placeholders with your own inputs.
Method and review
Keep the assumptions visible.
Define inputs, outputs, permissions and failure conditions before implementing an Action. Evaluate AI against representative labeled examples and retain human approval for consequential steps.
For this task, check
The AI owner should confirm comparability and review new labels before treating a shift as performance deterioration.
This starting prompt has no published worked example yet. Begin with a small sample and check the calculations before relying on the result.
Before you begin
- Permitted baseline and recent workflow records
- Stable version references and reviewed labels where available
Work with permitted files or queryable data. Verify the result against the original records.
Take the next step
Make it your investigation.
Copy the prompt above, create or open your Workspace, and paste it into Chat. Add the inputs you have permission to use and adapt the assumptions with your agent.
Start exploringYour prompt is carried by copy and paste. Signing up does not submit it or start this work automatically.
Or start with your own agent
The setup prompt includes this public task. Your agent will help you connect when needed and use the access you approve.