{
  "schema_version": "1.1",
  "id": "archive:https://www.youtube.com/watch?v=FvxY8oPoI8o",
  "slug": "preferences-over-benchmarks-model-routing-archana-kamath-tyler-gillam-di-06nxtgu",
  "url": "https://feed7.dev/p/preferences-over-benchmarks-model-routing-archana-kamath-tyler-gillam-di-06nxtgu",
  "title": "Preferences Over Benchmarks: Model Routing — Archana Kamath & Tyler Gillam, DigitalOcean",
  "why_included": "Per-task model routing cut the demonstrated coding session’s cost from 44¢ to 14¢ with similar completion time, but builders still need workload-specific evals to validate quality.",
  "summary": "DigitalOcean’s demo routed code generation, testing, and documentation to configured models while a comparison session used Opus. The routed session cost **14 cents versus 44 cents**, and its routing decision was reported at **under 200 milliseconds**.",
  "practical_implication": "Define routing around task, latency, cost, preferred models, and hard failover rules. Evaluate the full coding workflow on your own cases, then adjust model pools and policies instead of choosing one model from a public leaderboard.",
  "agent_context": "DigitalOcean’s demo routed code generation, testing, and documentation to configured models while a comparison session used Opus. The routed session cost **14 cents versus 44 cents**, and its routing decision was reported at **under 200 milliseconds**.\n\nDefine routing around task, latency, cost, preferred models, and hard failover rules. Evaluate the full coding workflow on your own cases, then adjust model pools and policies instead of choosing one model from a public leaderboard.\n\nThe app comparison was a live demonstration and visual judgment, not a controlled quality study. A separate evaluation scored router correctness at 90% versus 95% for Opus, which the speakers described as close, but no judge uncertainty was quantified.",
  "source": {
    "name": "AI Engineer",
    "url": "https://www.youtube.com/watch?v=FvxY8oPoI8o",
    "published_at": "2026-08-22T15:30:18.000Z"
  },
  "source_class": "video",
  "content_type": "Video",
  "layer": "infra",
  "domains": [
    "coding"
  ],
  "topics": [
    "model-selection",
    "gateways",
    "agent-evals"
  ],
  "verification": {
    "status": "source_linked",
    "label": "Source Linked",
    "method": "source_feed",
    "verified_at": null
  },
  "uncertainty": [
    "The app comparison was a live demonstration and visual judgment, not a controlled quality study. A separate evaluation scored router correctness at 90% versus 95% for Opus, which the speakers described as close, but no judge uncertainty was quantified."
  ],
  "connected_context": {
    "meaning": "This adds a workflow-level demonstration that routing different coding stages can reduce observed cost and keep routing latency small, while confirming that model choice should follow local preferences and cases rather than leaderboards. It does not establish equivalent output quality: the comparison was visual, and the reported router scores lack judge-uncertainty analysis, so the result supports experimentation and policy tuning rather than a default route.",
    "corpus_size": 545,
    "generated_at": "2026-08-23T18:04:50.839Z",
    "connections": [
      {
        "title": "Notion's Token Town — Sarah Sachs, Notion",
        "source_name": "AI Engineer",
        "source_url": "https://www.youtube.com/watch?v=-I5W5QVAT8E",
        "feed7_url": "https://feed7.dev/p/notion-s-token-town-sarah-sachs-notion-1rb6gwh",
        "reason": "It reinforces Notion’s recommendation to route by task and preserve optionality, adding a concrete multi-stage coding demo while retaining the need for workload-specific economic evaluation."
      },
      {
        "title": "TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AI",
        "source_name": "arXiv",
        "source_url": "https://arxiv.org/abs/2607.22465v1",
        "feed7_url": "https://feed7.dev/p/2607-22465v1-1g7nw7j",
        "reason": "Both evaluate task-aware routing, but this demo assigns different coding stages to configured models whereas TRACE-Router keeps calls for an agent task on one backend and learns from final outcomes."
      },
      {
        "title": "AI Gateway adds unified fast mode support",
        "source_name": "Vercel",
        "source_url": "https://vercel.com/changelog/ai-gateway-adds-unified-fast-mode-support",
        "feed7_url": "https://feed7.dev/p/ai-gateway-adds-unified-fast-mode-support-144dq26",
        "reason": "Unified fast mode is an implementation control for the target’s latency preferences and fallback rules, though it does not replace local workflow-quality evaluation."
      }
    ]
  },
  "lifecycle": "Current",
  "published_at": "2026-08-22T15:30:18.000Z",
  "modified_at": "2026-08-22T15:30:18.000Z",
  "supersedes": [],
  "expires_at": null,
  "formats": {
    "html": "https://feed7.dev/p/preferences-over-benchmarks-model-routing-archana-kamath-tyler-gillam-di-06nxtgu",
    "json": "https://feed7.dev/p/preferences-over-benchmarks-model-routing-archana-kamath-tyler-gillam-di-06nxtgu.json",
    "markdown": "https://feed7.dev/p/preferences-over-benchmarks-model-routing-archana-kamath-tyler-gillam-di-06nxtgu.md"
  }
}