Responsibilities
- Evaluator Discovery: Auto-discover evaluators via Python entry points
- Selector Evaluation: Extract data from payloads using selector paths
- Evaluator Execution: Run evaluators against selected data
- Caching: Cache evaluator instances for performance
Evaluator Discovery
The engine provides the public API for evaluator discovery:agent_control.evaluators entry point group. Discovery:
- Scans all installed packages for the entry point
- Loads each evaluator class
- Checks
is_available()to verify dependencies - Registers available evaluators
Key Functions
| Function | Description |
|---|---|
discover_evaluators() | Scan entry points and register evaluators |
list_evaluators() | Get all registered evaluators (triggers discovery) |
ensure_evaluators_discovered() | Ensure discovery has run |
get_evaluator_instance(config) | Get cached evaluator instance |
evaluate_control(control, payload) | Evaluate a single control |
Source Code
View the complete engine source code and implementation:Agent Control Engine