AI EngineerVideoSource Linked
Local Agentic Theory For Mobile Games — Shafik Quoraishee & Joanne Song, The New York Times
Experimental on-device agents can play games and adapt interfaces without cloud calls, but real-time use must fit memory, frame-time, and battery budgets. Accessibility is promising, not production-ready.
AI Engineer · Jul 23, 2026
Source Summary
The prototypes run agents locally for Space Invaders and a mini crossword, with the latter using a constraint graph and backtracking. A proposed accessibility agent could detect interaction friction and adapt controls from live device context.
Practical Implication
Design local loops around three hard budgets: model and state size, **16 ms per frame at 60 Hz**, and battery use. For accessibility, ground adaptations in **WCAG 2.2** and test predicted layout changes before applying them.
Agent-Ready Context
The prototypes run agents locally for Space Invaders and a mini crossword, with the latter using a constraint graph and backtracking. A proposed accessibility agent could detect interaction friction and adapt controls from live device context. Design local loops around three hard budgets: model and state size, **16 ms per frame at 60 Hz**, and battery use. For accessibility, ground adaptations in **WCAG 2.2** and test predicted layout changes before applying them. This is experimental work and is not shipped in New York Times games. Faster planning, predictive models, long-term personal memory, a shared game-state language, better chips, and credible benchmarks are all still required.
Context Map
agentcodingimage#reasoning#computer-use#agent-reliabilityUncertainty
This is experimental work and is not shipped in New York Times games. Faster planning, predictive models, long-term personal memory, a shared game-state language, better chips, and credible benchmarks are all still required.