The argument is that the sweet deal we're getting now, which involves Anthropic practically giving away a product while they lose lots of money, might not be sustainable for them.
If LLMs were configured to be deterministic, instead of the current "small amount of randomness to provide the illusion of a thinking machine", they would be much more useful in exchange for being less exciting to laypeople.
I think their point was that the project is complex, with the implicit assumption that the complexity is to a large degree inherent.
Even if it's mostly accidental, and the code is overengineered slop (which it is), the system being able to decompose a problem and deliver something is impressive in terms of stability: it wasn't sucked into rewriting everything from scratch every time it would run into issues, it didn't have infinite subagent recursion with a one-agent-per-line type workflow, etc.
also, since when is CLI outdated?
reply