The Spatial Harness: Bringing Agents to the Canvas — Max Drake, tldraw
A spatial agent harness can make parallel work, dependencies, and ownership visible on a shared canvas. Bridging that canvas to coding tools lets its nodes perform real work beyond drawing.
tldraw’s experiments combine screenshots and canvas data so agents can interpret and modify 2D scenes. **Fairies** adds identifiable, collaborative agents, while the **tech tree app** represents dependent tasks as coding agents that can run and expose their pull requests.
For multi-agent workflows, consider a shared spatial view when task dependencies and concurrent activity are hard to track in chat. Keep agents visually distinguishable, make state inspectable, and connect canvas actions to existing coding tools rather than isolating work inside the board.
tldraw’s experiments combine screenshots and canvas data so agents can interpret and modify 2D scenes. **Fairies** adds identifiable, collaborative agents, while the **tech tree app** represents dependent tasks as coding agents that can run and expose their pull requests. For multi-agent workflows, consider a shared spatial view when task dependencies and concurrent activity are hard to track in chat. Keep agents visually distinguishable, make state inspectable, and connect canvas actions to existing coding tools rather than isolating work inside the board. The desktop bridge runs plain JavaScript against the editor and can reach external tools through a coding agent, but the examples are prototypes. The talk offers demonstrations, not measurements of reliability, coordination overhead, or safety when canvas scripts control desktop applications.
This adds a spatial coordination interface to prior multi-agent harness patterns: dependencies, concurrent work, agent identity, and resulting pull requests can be inspected on a shared canvas rather than reconstructed from separate chats. It complements existing isolation, evaluation, and context controls rather than replacing them. Because the examples are prototypes, the benefit to coordination and the safety of desktop-controlling scripts remain unmeasured.