# How Web Data Infrastructure Powers the Next Generation of AI — Patricija Žemaitytė, Oxylabs

Source: [AI Engineer](https://www.youtube.com/watch?v=1UmZHb_E_SM)  
Feed7 permalink: https://feed7.dev/p/how-web-data-infrastructure-powers-the-next-generation-of-ai-patricija-z-1ta4xzh  
Published: 2026-08-14T17:00:37.000Z  
Trust: Source Linked (source_linked)

## Why Included

Fresh web retrieval becomes product infrastructure once agents need sub-second responses and sustained scale. The talk’s failed client demo shows why dev latency alone says little about production resilience.

## Source Summary

Oxylabs rebuilt a roughly four-second search path for an **under-800 ms** requirement and reached about **650 ms P90** in under two weeks, then got blocked during the client demo. Another system was pushed from 10,000 to **60,000 requests per second** in under two months.

## Practical Implication

Treat live web access as a production dependency: minimize the response surface, test realistic traffic, instrument end-to-end jobs and design around browser, proxy, parsing and retry costs. For interactive agents, latency determines whether retrieval can remain inside the action loop.

## Agent-Ready Context

Oxylabs rebuilt a roughly four-second search path for an **under-800 ms** requirement and reached about **650 ms P90** in under two weeks, then got blocked during the client demo. Another system was pushed from 10,000 to **60,000 requests per second** in under two months.

Treat live web access as a production dependency: minimize the response surface, test realistic traffic, instrument end-to-end jobs and design around browser, proxy, parsing and retry costs. For interactive agents, latency determines whether retrieval can remain inside the action loop.

These are vendor case studies, not controlled benchmarks. The talk also says synthetic load was easier than representative organic traffic, and its current target of about 100,000 requests per second remains ongoing rather than a completed result.

## Connected Context

Feed7 judgment across 462 accumulated Signals:

This shifts web retrieval from a supporting capability to a latency- and reliability-critical part of the agent action loop. Against the prior observability and serving work, it broadens performance accounting beyond model and gateway metrics to browser, proxy, parsing, retry, and representative-traffic costs. The vendor cases suggest substantial optimization headroom, but their workload-specific and partly unfinished evidence prevents treating the reported latency or throughput as general targets.

- [AI Gateway logs now have a dedicated page](https://feed7.dev/p/ai-gateway-logs-1272t5j) — Gateway logs cover model-request latency and fallbacks, while this Signal shows that end-to-end agent tracing must also include browser, proxy, parsing, and retry stages.
- [TokTier: Exact Stateful Tokenization for Agentic LLM Serving](https://feed7.dev/p/2607-29678v1-1fuv1qw) — TokTier identifies tokenization as one hidden latency source; this Signal identifies live web retrieval as another, reinforcing the need to decompose interactive latency rather than rely on one aggregate measure.
- [TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories](https://feed7.dev/p/2608-06346v1-125r9ui) — TrajDebug follows failures through agent trajectories, while this Signal implies comparable lifecycle instrumentation is needed for retrieval jobs so retries and upstream blocks can be tied to terminal outcomes.

## Context Map

- Layer: infra
- Domains: research, data
- Topics: retrieval, observability, agent-reliability

## Uncertainty

- These are vendor case studies, not controlled benchmarks. The talk also says synthetic load was easier than representative organic traffic, and its current target of about 100,000 requests per second remains ongoing rather than a completed result.

## Agent Instruction

Use this item as source-backed context. Do not invent claims beyond the linked source. If this item conflicts with another source, call out the conflict.