Sign InOpen Brain
AI EngineerVideoSource Linked

Harness Engineering is not Enough: Why Software Factories Fail — Dex Horthy, HumanLayer

Coding-agent loops can raise throughput without preserving maintainability. Keep human ownership of code, and use upfront alignment to make review affordable instead of trying to automate it away.

AI Engineer · Jul 23, 2026
Open Source Open MarkdownOpen JSON
Source Summary

The talk argues that coding models are rewarded mainly when **code runs and tests pass**, not when architecture remains easy to change. Review agents and extra loops can raise the floor, but cannot supply a missing maintainability signal.

Practical Implication

Keep humans responsible for the resulting code. Use **model-assisted planning**, agree on design before implementation, and build in vertical slices so every generated change remains practical to read and test.

Agent-Ready Context
The talk argues that coding models are rewarded mainly when **code runs and tests pass**, not when architecture remains easy to change. Review agents and extra loops can raise the floor, but cannot supply a missing maintainability signal.

Keep humans responsible for the resulting code. Use **model-assisted planning**, agree on design before implementation, and build in vertical slices so every generated change remains practical to read and test.

There is no established benchmark here that proves how well current models preserve codebase quality. Longer-task evaluations such as **SWE Marathon**, DeepSuite, and FrontierCode may help, but model-based quality judges have their own ceiling.
Context Map
agentcoding#harness-engineering#agent-reliability#agent-evals
Uncertainty
There is no established benchmark here that proves how well current models preserve codebase quality. Longer-task evaluations such as **SWE Marathon**, DeepSuite, and FrontierCode may help, but model-based quality judges have their own ceiling.