When Agent Autonomy Produces Activity Instead of Work
An audit of Aria's autonomous loop found hundreds of goals, almost no progress, and a completion system that rewarded plausible output.
notebook / tag
#evals
5 entries with this tag.
The Observer Changes the Agent
A self-observation feature for Aria showed why metrics should remain available without becoming permanent instructions.
The Bigger Model Lost the Bakeoff
What two rounds of testing Aria's language and image models taught me about speed, benchmarks, and knowing when a score is wrong.
The Fourth-Agent Test
A quick way to tell whether your agent setup is ready to grow or still held together by one-off fixes.
A Small Pattern Library for Tool-Calling Agents
Four simple work patterns for agents that use tools, make changes, test the result, and recover from interruptions.