Cloud Agents

Agent-serving systems should optimize whole-task latency, preserving shared prefixes across tool calls and routing later steps toward the GPU that already holds their KV cache.

Serving many small specialist models needs pull-based queues, model packing, and per-model tuning; generic routers and managed endpoints can waste their throughput and cost advantage.

Agent requests often repeat most of their input, making KV-cache-aware routing a direct latency and cost lever for hosted coding-agent workloads.

Large agent workloads turn inference into an orchestration problem: scheduling must account for workflow state, KV cache, hardware, retries, and cost per completed task.

Vercel CLI can return a live URL in under a second for small static artifacts, making agent-generated reports and prototypes easier to share without a build step.

Long-running agents need durable state, retries, cancellation, and human approval that survive deploys. Restate demonstrates these as infrastructure concerns rather than prompt logic.

A three-engineer team consolidated model routing, long-running agent jobs, and deployment on Vercel while serving 100,000+ users. The case study shows where managed abstractions can remove operational work.

Cursor Projects gives a coordinator persistent context, cloud and local subagents, and event-driven work for features, migrations, and maintenance that outlive one chat.

The Agents API exposes a managed Codex-based harness for orchestration, long-running sessions, and tool use, reducing the agent runtime a builder must operate directly.

Vercel pairs OpenAI-managed agent sessions with isolated, persistent Sandboxes, using signed webhooks and queues for reconnection and scaling workers to zero.

ACP lets editors, terminals, and custom apps control compatible agent harnesses through one protocol, including remote sessions, tool updates, and permission requests.

Cursor Cloud Agents can execute inside per-request Vercel microVMs, giving teams control over isolation, credentials, retries, and worker lifecycle without operating persistent VMs.

Two Sigma runs remote agents under each employee’s real identity, adding trace propagation and controlled web access to preserve attribution and limit egress risk.

Zo packages a persistent Linux server, coding agents, files, integrations, and hosting into one personal cloud. The useful idea is collapsing build and deploy context into the agent’s workspace.

Cursor cloud agents can now execute tools on machines and elastic pools inside your network while Cursor retains planning and inference. This unlocks internal access and custom hardware, not full self-hosting.

Real-world agent adoption depends on workflow redesign, operational traces, and hands-on enablement. Code-agent patterns help, but service work has messier exceptions and triggers.

Agentic inference makes KV-cache locality and prefill pressure first-class scheduling concerns. Red Hat's case study improved latency and capacity, but P/D separation needs suitable traffic and fast networking.

Warp’s cloud-agent design separates runtime, harness, artifacts, and orchestration so teams can swap tools without fragmenting workflows or removing human review.

Vercel Agent can now investigate incidents, edit code, and review PRs inside shared Slack code channels, with approval gates and an audit trail for every action.

Cursor is bringing Firetiger’s production-monitoring agents in-house, aiming to connect code generation with rollout checks and incident investigation. Change Monitors are the first named upcoming feature.

Cursor Cloud Agents can start from continuously prepared environment snapshots instead of reinstalling each session. Internal time to first token improved 3x, with failed builds falling back to the last good state.

Always-on production agents can turn releases and operational events into tailored monitoring tasks. The useful pattern is persistent context plus scoped triggers, checks, and escalation.

GitHub Next’s prototypes move coding agents from personal chat into governed background workflows and shared cloud workspaces that can act on team conversation.

Herdr can place each terminal coding agent in a separate Vercel Sandbox, then return its work as an opt-in Git patch instead of letting remote edits touch the local checkout.

The generally available v0 API gives agents headless app generation with stateful chats, sandboxed execution, streamed traces, live previews, and one-call Vercel deployment.

Factory runs API routes, middleware, and webhooks in one Next.js backend at one billion daily requests and 350ms p95. Its agents also deploy internal tools through Vercel APIs under review guardrails.

Factory runs its full cloud backend in one Next.js app while agents deploy internal tools through Vercel APIs. The case study is useful evidence for keeping agent-operated infrastructure programmable and guarded.

Cursor’s cloud-agent adoption grew after it treated the dev environment as agent infrastructure: Linux parity, one discoverable CLI, end-to-end testing, and automated repair.

Gemini Managed Agents now add model selection, sandbox hooks, token caps, schedules, and free-tier access, covering several controls needed for unattended coding work.

Cursor Start gives developers in India a ₹649 monthly tier with Grok 4.5, Composer, cloud agents, mobile control, and UPI payments, positioned between Free and Pro.

Chat SDK can put Claude Managed Agents behind browser and messaging interfaces while Anthropic retains the loop, tools, session state, and research sandbox.

Vercel’s MCP server can deploy agent-built code to new or existing projects and return a shareable URL, extending chat-based coding workflows through delivery.

Gemini Managed Agents can now run asynchronously, connect to remote MCP servers, call client-side functions, and rotate credentials without losing sandbox state.

Cursor's writeup on a year of cloud agents: complete dev environments matter most, a Temporal rewrite pushed reliability past 99%, and over 40% of Cursor's internal PRs now come from cloud agents.

Cursor shipped a native iOS app in public beta: launch cloud agents, remote-control agents on your local machine, and merge PRs from your phone. Paid plans only; Composer 2.5 runs are 75% off until July 5.

Codex offers one coding agent across the terminal, supported IDEs, a desktop app, and the web, with local CLI installs for major desktop platforms and ChatGPT-plan sign-in.

Your coding agent can now pull its own Agent Runs traces—reasoning, tool calls, token usage—from Vercel via MCP or CLI, so it can debug its runs and refine skills from real production behavior.

Anthropic details Managed Agents, a hosted long-horizon agent service that separates the harness from its sandboxes — stateless brains, replaceable containers, and a 60% drop in p50 time-to-first-token.

Claude Tag puts a persistent Claude in Slack channels: tag @Claude to delegate async tasks running hours or days on Opus 4.8. Beta for Team/Enterprise; Anthropic says it writes 65% of its product team's code.

Long-running coding agents need isolated, persistent sandboxes: microVMs limit kernel exposure, while incremental snapshots enable recovery, branching, and faster placement across a fleet.