Eval-Driven Development
AI systems don’t fail because they’re dumb, they fail because we never define “good.”
Jack Arenas
Search
All Posts
Open AI Founders Table Dinner, SF Edition
The topic was on evals, something that’s come up again and again in conversations with founders building AI products lately.
Adapting Foundation Models: From Prompts to Reinforcement Learning
The three levers for steering pre-trained models and the evals that guide them.
When Chat Replaces Search: The Economics of AI-Mediated Information
When answers replace clicks, publishers, brands, and platforms face a new incentive structure.
The Promptware Window
Every week I see pitches that follow a similar pattern: “X for Y, powered by AI.” I call this promptware.
The Rise of Reverse Acquihires
How Big Tech is gutting AI startups without actually buying them.