I’m going to be posting once a week: one incident at a time from putting AI agents to work on real systems, and what the record actually showed afterward.
Spent most of this year letting AI agents do real work on my own systems, then going back to see what they actually did.
Fifteen years in regulated platforms leaves you with one habit: don’t trust the status, read the log. So I read the logs.
One run burned about forty percent of its budget re-deriving a defect that was already written down. My first instinct was to give it a bigger budget. The fix was one line.
Another run finished its job and lost it. The ledger said done. There was no pull request. Both were true.
That’s the work now. Not whether agents can do the job. Whether you can prove what they did afterward.
The write-ups live in Research, one incident at a time, receipts included.