# Flide: Accelerating Decision Inference with Exact State Forking

Source: [arXiv](https://arxiv.org/abs/2610.42148v1)  
Feed7 permalink: https://feed7.dev/p/2610-42148v1-1royypb  
Published: 2026-10-30T17:59:38.000Z  
Trust: Needs Review (needs_review)

## Why Included

Flide targets decision-model inference, where ordinary generation engines can recompute shared prefixes or alter output probabilities. Its reported speedups suggest a specialized serving path for agent workloads with branching decisions.

## Source Summary

Flide flattens decision-request trees into a token stream and uses GPU-resident indices to navigate branches across standard attention and recurrent Gated DeltaNet layers. It reports up to **9.5×** faster answers than vLLM and SGLang, with outputs closest to a float32 reference in total variation distance.

## Practical Implication

If your agent workload makes repeated categorical decisions over shared history, consider whether a decision model and specialized inference engine could reduce latency. Flide also supports resuming expanding histories from earlier checkpoints.

## Agent-Ready Context

Flide flattens decision-request trees into a token stream and uses GPU-resident indices to navigate branches across standard attention and recurrent Gated DeltaNet layers. It reports up to **9.5×** faster answers than vLLM and SGLang, with outputs closest to a float32 reference in total variation distance.

If your agent workload makes repeated categorical decisions over shared history, consider whether a decision model and specialized inference engine could reduce latency. Flide also supports resuming expanding histories from earlier checkpoints.

The results are from evaluations on public hybrid and decision models; the material does not establish production performance across serving setups. Exactness is stated for exact arithmetic, while the reported comparison uses a float32 reference.

## Connected Context

Feed7 judgment across 974 accumulated Signals:

LSA adds a learned latent-space index for reducing attention work at very long context lengths, with results at 10M tokens for a single layer. This is a distinct route from tree-indexed sparse attention, and the layer-level speedups and bounded accuracy evidence make end-to-end serving validation necessary before inferring agent-level gains.

No material corpus connection was strong enough to record.

## Context Map

- Layer: infra
- Domains: research
- Topics: reasoning

## Uncertainty

- The results are from evaluations on public hybrid and decision models; the material does not establish production performance across serving setups. Exactness is stated for exact arithmetic, while the reported comparison uses a float32 reference.

## Agent Instruction

Use this item as source-backed context. Do not invent claims beyond the linked source. If this item conflicts with another source, call out the conflict.