Paper · Needs Review
User Feedback Provides a Unique Signal that LLMs Can not DetectUser feedback helps models repair targeted faults, but LLM judges often miss those repairs. Agent evals should retain human feedback and avoid treating model preference as ground truth.FEED7 SUMMARY
Paper · Needs Review
The Implications of Linguistic Illegibility for LLM SecurityLanguage-based monitoring cannot fully reveal an agent’s internal computation, the paper argues. Secure agent runtimes still need isolation and data-flow controls independent of self-reporting.FEED7 SUMMARY
infra#sandboxing
Paper · Needs Review
Post-Training Language Models for Gold-Medal Performance in Coding CompetitionsA coding-specialized model paired post-training with an iterative generate-evaluate-refine loop to exceed the top IOI 2026 human score. The reusable idea is feedback-driven test-time search.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
UE5M3 FP4 Block Scaling for Stable Language Model PretrainingA UE5M3 block-scaling recipe trained an 8B model in FP4 without Hadamard transforms or BF16 final layers, while reporting better losses and downstream estimates than the compared recipe.FEED7 SUMMARY
model#model-selection
Paper · Needs Review
Cliff: Learning Process Rewards from the First MistakeCliff trains on the location of a rollout’s first reasoning error, rewarding the valid prefix and penalizing the suffix. It offers finer supervision without a specialized reward model.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Large Language Models (LLMs) for Telecom Root Cause Analysis (RCA): A Structured Reasoning Framework for Evidence-Grounded DiagnosisA telecom diagnosis pipeline structures telemetry before forcing a decision path and evidence-grounded explanation. The pattern is relevant to agents reasoning over heterogeneous operational data.FEED7 SUMMARY
Paper · Needs Review
Dutch Books for Language ModelsA label-free Dutch-book test finds internally inconsistent probabilities from language models, especially when prompts add logical complexity or irrelevant context.FEED7 SUMMARY
Paper · Needs Review
SafeEvolve: Harness-Policy Co-Evolution from Agent Experience for Safety AlignmentSafeEvolve turns completed agent trajectories into reversible harness updates and policy training, linking runtime safeguards with learned multi-step behavior.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization EvaluationMechanistic tests suggest two open LLM judges route local errors early and form ratings late, giving eval builders concrete layers and components to probe for judge failures.FEED7 SUMMARY
Paper · Needs Review
CordisBench: Can Language Models Reason About Component Lifecycles in Dynamic Agent Harnesses?CordisBench finds that models lose reliability as harness lifecycle interactions grow, while deterministic execution semantics can replace costly reasoning on controlled cases.FEED7 SUMMARY
benchmark#harness-engineering
Paper · Needs Review
The Rise of Verbal Reinforcement LearningThis survey separates verbal feedback by when it acts and what it changes, helping agent builders distinguish task specification, test-time guidance, and parameter updates.FEED7 SUMMARY
agent#prompting
Paper · Needs Review
StudentSim: Training LLM-based Student SimulatorsStudentSim turns sparse user histories into individualized simulators that model both current behavior and response to guidance, a pattern for testing adaptive agents before live deployment.FEED7 SUMMARY
Paper · Needs Review
The Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent GloballyWhen quantizing an open model, spend a small extra precision budget across the network before protecting a few “important” layers; causal tests found the damage was usually diffuse.FEED7 SUMMARY
model#open-models
Paper · Needs Review
Scaling Near-Optimal SFT-RL Annotation Budget Allocation from Small to Large LLMsSmall proxy models may be enough to choose an SFT-versus-RL annotation split: the paper finds broad near-optimal ranges that transfer to larger models.FEED7 SUMMARY
model#model-selection
Paper · Needs Review
From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request MixA production-derived post-training recipe consolidated more than 200 internal apps onto one self-hosted model by training separate experts for distinct quality gaps, then merging them.FEED7 SUMMARY
model#enterprise
Paper · Needs Review
Selective Agent Guidance via Entropy: Learning Autonomous Policies from Imperfect VLM TeachersSAGE uses an expensive VLM only when a learner is uncertain, tests its advice against environment rewards, and distills useful guidance into a policy that needs no VLM at runtime.FEED7 SUMMARY
agent#computer-use
Paper · Needs Review
OntoAligner-Ensemble: Voting-Based Fusion across Heterogeneous Ontology Alignment TechniquesA two-stage ensemble reconciles outputs from string, graph-embedding, and RAG-based ontology aligners. Composition matters: mixed paradigms favor precision, while LLM-only groups more often favor F1.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
DIASENTINEL: An Auditable Multi-Agent System for Guideline-Grounded Diabetes Risk ScreeningDIASENTINEL combines deterministic extraction, guideline retrieval, risk prediction, and hybrid verification on-premise. It is a useful architecture reference for auditable agents handling sensitive data.FEED7 SUMMARY
agent#multi-agent
Paper · Needs Review
When Does Bigger Help? A Controlled Study of LLM Scale for Ontology LearningA controlled ontology-learning study finds model size is a weak selector on its own. Dense 27B models beat larger sparse models on one task, while MoE models led another.FEED7 SUMMARY
model#model-selection
Paper · Needs Review
BLOOM-WILT: Logit Tilting for Behaviour Elicitation in Automated LLM AuditingBLOOM-WILT makes rare model behaviors easier to surface by adapting both the auditor’s strategy and target decoding. Its results also show that elicitation method can reverse safety rankings.FEED7 SUMMARY
Paper · Needs Review
LLM Post-Training as Brownfield Maintenance: An Industrial Perspective on Dataware EngineeringAn industrial code-model case study frames post-training as maintaining data mixtures under fixed budgets. Raising usable supervision yield improved coding benchmarks without changing the teacher.FEED7 SUMMARY
Paper · Needs Review
S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?S3Gym tests whether agents can explore, judge outcomes, and reuse experience. Raw history, compressed memory, and training each help in some tasks, but none is a reliable default.FEED7 SUMMARY
Paper · Needs Review
DARTS: Decoder-Aware Representation Tuning via Surgery for Model MergingDARTS targets representation drift in merged decoder LLMs with entropy-weighted, position-aware correction, adding 0.1% parameters in the reported Llama-2-7B tests.FEED7 SUMMARY
model#open-models
Paper · Needs Review
Training Communication-Efficient Mixture-of-Experts Language Models with Layer Re-ConfigurationCE-MoE concentrates routed experts in fewer layers and restores depth with dense layers, cutting reported GPU-hours by 33.3% at 31.5B parameters without worse benchmark results.FEED7 SUMMARY
model#open-models
Paper · Needs Review
On the Maintenance and Co-evolution of Agent Plugins: An Empirical Study of Claude Code Plugin MarketplacesA study of 8,351 Claude Code plugins finds instruction files and scripts often require coordinated maintenance, treating skills as evolving software rather than static prompts.FEED7 SUMMARY
agent#skills
Paper · Needs Review
CritICL: Inference-Time Weak-to-Strong Generalization from Small Language Model Failure ModesCritICL turns recurring failures from smaller models into critique examples for stronger models, aiming to improve inference with fewer generations and lower token cost than repeated sampling.FEED7 SUMMARY
context#reasoning
Paper · Needs Review
SWE-Prime: Fewer Trajectories, Better PerformanceSWE-Prime finds that filtering coding-agent traces by process and segment quality can beat training on every resolved trajectory, reducing noisy imitation from redundant or risky steps.FEED7 SUMMARY
Paper · Needs Review
TTPO: Test-Time Policy OptimizationTTPO adapts a model at test time without labels by treating agreement and disagreement differently, reducing the damage from wrong majority-vote pseudo-labels.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill EvolutionRedEvoAgent turns prior jailbreak trajectories into a compact attack skill, then keeps only validated improvements. It offers a more interpretable way to probe tool-using agents for unsafe actions.FEED7 SUMMARY
Paper · Needs Review
Stochastic Estimation of Transduced Language ModelsAn unbiased sampler makes prefix probabilities tractable when a transducer maps many source strings to one target prefix. It matters mainly for specialized text or biological sequence systems.FEED7 SUMMARY
model
Paper · Needs Review
Persona-Execution Separation: An Architecture Pattern for Evolving LLM Agents under Execution AuditPersona-Execution Separation isolates mutable agent behavior from audited, stateful work through a governed bridge. It is an architecture option for multi-user agents under compliance constraints.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
Boosting LLM Exploration via Weak-Model Guidance in RLVRFeeding a model partial reasoning from a weaker model during RLVR preserved exploration and improved large-k coverage. This suggests diversity can come from cross-model perturbation, not only regularization.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion ParadigmsThree ways to combine RLVR domain experts perform similarly on average but diverge by task. Choose Merge for cheap reuse, Mix RL for training from pooled data, and MOPD for preserving expert gains.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
TraceML: An Empirical Analysis of Human-Agent Planning in Machine Learning DevelopmentTraceML exposes why coding agents stall on long ML work: they repeat narrow optimization loops instead of alternating work types, revisiting discarded ideas, and pivoting like experts.FEED7 SUMMARY
Paper · Needs Review
Prefix Sliding for efficient test-time scalingPrefix Sliding drops stale reasoning tokens while retaining instructions and recent work, capping memory during long inference and reportedly making existing models 3× faster without training.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Trace Integrity for LLM Data Agents: A Vision for Auditable Structured Reasoning in Real-World SystemsCorrect answers can hide invalid computation. Trace Integrity proposes executable, replayable contracts for data agents and reports 45.8–59.1% correct-answer/invalid-trace rates across three SQL modes.FEED7 SUMMARY
Paper · Needs Review
Asymmetric Capacity Allocation in Self-Refinement PipelinesSelf-refinement pipelines need not use equally capable models: invest capacity in generation and revision, while a small critic may preserve gains at lower compute cost.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
Move by Move: Measuring and Steering How LLMs Conduct PsychotherapyA tool-exposed ontology steered models closer to human therapy patterns without fine-tuning, showing how explicit action vocabularies can improve agent behavior.FEED7 SUMMARY
agent#tool-use
Paper · Needs Review
From Regulation to Implementation: A Critical Evaluation of LLM-Assisted Regulatory Compliance in IndustryLLM compliance generation behaves differently under vague and strict schemas: vague artifacts need richer context, while rigid formats can stay consistent yet hallucinate.FEED7 SUMMARY
industry#enterprise
Paper · Needs Review
Re$^3$Cap: Retrieval-Guided Refinement for Image Captioning Enhancement via Reinforcement LearningRe³Cap uses multimodal retrieval to find caption omissions and hallucinations before refinement, offering a concrete retrieval-and-review pattern for vision agents.FEED7 SUMMARY
agent#retrieval
Paper · Needs Review
CLEAR: Continuous Latent Adapter Routing for Utility-Preserving LLM Safety AlignmentCLEAR conditionally activates a safety adapter instead of applying safety tuning to every prompt, reducing harmful completions while limiting benign-task degradation.FEED7 SUMMARY
model#model-selection
Paper · Needs Review
ConceptTS: LLM-Guided Concept Bottlenecks for Interpretable Multivariate Time-Series ForecastingConceptTS turns LLM-proposed concepts into executable labels and interpretable forecasting bottlenecks, enabling concept-level inspection and intervention.FEED7 SUMMARY
Paper · Needs Review
ConceptGuard: Benchmarking Context-Sensitive Unlearning in Large Language ModelsConceptGuard tests whether model unlearning blocks harmful uses of a concept while preserving benign ones. Current methods show weak contextual control and sharp forgetting-versus-utility trade-offs.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-ImprovementAI4AI-Bench tests whether agents can rewrite training algorithms, not merely tune runs. The best system scored 0.250, with most submissions never changing how the model learns.FEED7 SUMMARY
Paper · Needs Review
MidTool: Mid-training Data Synthesis for Agentic Tool UseMidTool trains general tool use before post-training, using API, MCP, document, web, PDF, and code data. Qwen3 4B and 8B variants improved across three downstream tool-use benchmarks.FEED7 SUMMARY
model#tool-use
Paper · Needs Review
Phantom Gains: Auditing Self-Improvement Against a Measured NullPer-problem self-improvement claims can arise from inference and evaluation noise. This audit argues every transition statistic needs a measured null from frozen baseline replicates.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge InternalizationIAR turns a fixed document corpus into parametric knowledge through separate injection, QA alignment, and recovery stages. It improved domain QA while retaining more general capability than vanilla SFT.FEED7 SUMMARY
model#retrieval
Paper · Needs Review
Which Eviction Policy Should an LLM Cache Use? A Systematic Study Across Workloads, Capacities, and EncodersLFU was the strongest simple semantic-cache default, but answer validity mattered far more than eviction policy. Raw hit rates above 50% fell near 2% after quality adjustment.FEED7 SUMMARY
infra#context-caching
Paper · Needs Review
Break It Down, Pass It On: Cross-Task Skill Transfer in LLM AgentsReusable agent skills transferred better when induced from subtasks and stored as text. Whole-task skills often hurt versus no memory, so retrieval alone is not evidence that a memory helps.FEED7 SUMMARY
agent#skills
Paper · Needs Review
Learning When to Think: Adaptive Reasoning for Test-Time Compute AllocationA model learned to choose its own reasoning budget, cutting average output tokens 41% with a small MATH500 accuracy drop. Agent builders could replace fixed effort settings with task-level routing.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
TokEval: A Tokenizer Evaluation SuiteTokEval links tokenizer properties to language, math, and code performance, offering cheaper screening signals before committing compute to pretraining sweeps.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
Delegation Asymmetry in Agentic Recommender Systems: Measuring Two-Sided Receptivity in Online DatingUsers were far more willing to deploy their own conversational agent than engage someone else’s, making receiver consent and receptivity-aware routing core product constraints.FEED7 SUMMARY
industry#adoption
Paper · Needs Review
Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding GeometryA single-GPU SBERT beat the reported zero-shot LLM and vendor baseline for invoice coding, suggesting narrow, private classifiers can outperform broader models with modest local data.FEED7 SUMMARY
model#model-selection
Paper · Needs Review
Don't Drop the BATON: Long-Horizon Robot Manipulation via Agentic Subtask Exploration and Transition-aware MemoryBATON explores robot subtasks independently, stores their solutions, and manages handoffs between them, replacing multiplicative whole-task search with additive composition.FEED7 SUMMARY
agent#subagents
Paper · Needs Review
Towards Computational Provenance: Carrying Causal-State Evidence in Generated TextA controlled study encoded authenticated internal-state evidence into unchanged answers, suggesting generated text could carry provenance signals, but not that current models reveal them naturally.FEED7 SUMMARY
Paper · Needs Review
What Do Compliance Detectors Read? An Audit of Activation Probes and Guard ModelsTested compliance guards often ignored the governing rule and classified from scenario cues. Builders should counterfactually swap policies before trusting a detector as an audit control.FEED7 SUMMARY
Paper · Needs Review
Handover of In-Context Learning State Across Session BoundariesAgent handoffs should preserve task-relevant predictive state, not blindly compress the transcript. The paper offers a three-part record for carrying decisions, evidence, and irreducible observations across sessions.FEED7 SUMMARY
Paper · Needs Review
Split the Labor: Separating Evidence Interpretation from Decision AggregationMulti-source agents should separate source interpretation from decision aggregation. A fixed evidence tuple plus calibrated likelihood pooling avoids vote thresholds that drift as more sources arrive.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
Rollplex: Cross-Phase GPU Spatial Sharing for Vision Language Model Post-TrainingRollplex overlaps VLM prefix work with rollout decoding and shares weights across training phases. On 32 H800 GPUs, it reports higher throughput without changing synchronous on-policy updates.FEED7 SUMMARY
infra
Paper · Needs Review
Twin: Playing an Unknown Game with a Test-Time Digital TwinTwin has a coding agent build and continuously repair an executable simulator before acting. The harness lifts the same base model from 7.8 to 93.3 on ARC-AGI-3 by validating every observed transition.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language ModelYOPO combines reasoning steering and answer abstention in one pass of a frozen model. Reconstructing the clean residual avoids interference and beats the paper's two-pass reference at three model sizes.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
SheetCompass: Hierarchical Relation Graphs for Agentic Spreadsheet ReasoningSheetCompass keeps spreadsheet structure as a hierarchical relation graph instead of flattening cells into text. Its agent memory retains task-relevant context across sheets, tables, and columns.FEED7 SUMMARY
Paper · Needs Review
QuoteBench: How Matched Scores Can Hide Command-Path FailuresQuoteBench shows that shell-command scores can conceal failures introduced by serialization and reparsing. Agent evals should identify the execution path, not attribute every result to the model.FEED7 SUMMARY
Paper · Needs Review
LittleLearner: Language Models Under Pedagogically Controlled Knowledge ExposureLittleLearner offers a controlled model and corpus for studying knowledge acquisition without unknown prior exposure. Its initial results separate better use of known material from new capability.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
SAEVerbalizer: Generating Explanations for Sparse Autoencoder Features via Representation VerbalizationSAEVerbalizer turns sparse-autoencoder decoder directions into natural-language feature explanations. It may reduce behavior-sampling work when inspecting model representations, but evidence is experimental.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
DARTree: Speculative Diffusion Decoding with Autoregressive Draft TreesDARTree uses autoregressive correction across diffusion-generated draft trees to accelerate lossless decoding. It reports up to 9.73× local speedup, but production gains depend on the serving stack.FEED7 SUMMARY
model#open-models
Paper · Needs Review
DFM Mimir v1: An Open HRM Delivering Frontier Performance at 1B Parameters Using Only Permissible Post-Training DataMimir v1 is an open 1B-parameter reasoning model trained with permissible post-training data. It is relevant for compact or Danish deployments, though the abstract supplies no benchmark scores.FEED7 SUMMARY
model#open-models
Paper · Needs Review
Measuring Task-Agnostic Training Data Influence Across Language Model PretrainingA task-agnostic influence measure tracks which examples steer pretraining toward final parameters without choosing a downstream eval. It reveals a literature-to-STEM shift across training.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and DiversityCreativeInstruct adds learned control spans that recover base-model-like diversity after post-training, with reported gains in human creativity ratings and downstream RL training.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient DescentSkillProx evolves reusable agent instructions through measured retries, regression rollback, and utility-based pruning, reporting a 3-point accuracy gain over its strongest baseline.FEED7 SUMMARY
agent#skills
Paper · Needs Review
Taxonomy-Driven Analysis of Open-Source AI Risk Mitigation ToolsA taxonomy-based audit maps open-source LLM safety tools to enterprise risks, finding strong technical coverage but major governance, legal, regulatory, and financial gaps.FEED7 SUMMARY
infra#observability
Paper · Needs Review
Blast RadiusBlast Radius predicts which code and context a prompt will reach, then reversibly archives unused history. Across seven OpenAI models, it cut token consumption by 17–26%.FEED7 SUMMARY
Paper · Needs Review
An Exploratory Evaluation of LLM-Assisted Rewriting of Moderate-Complexity Financial Sentences for DisCoCat-Based Sentiment AnalysisControlled LLM rewriting made harder financial sentences cheaper to process with DisCoCat, cutting circuit size by over 70%, but downstream accuracy improved only modestly.FEED7 SUMMARY
context#prompting
Paper · Needs Review
PsychoAgent: An Affect-Sensitive Cognitive Architecture for Conflict-Aware Memory in LLM AgentsPsychoAgent separates factual and affective memory, then reranks relevant memories by salience. It retrieved more conflict-critical context, but output-quality differences were not significant.FEED7 SUMMARY
Paper · Needs Review
Fisher-R1: Training LLM Agents for Reliable Hypothesis TestingP-Bench tests whether agents choose statistically valid methods, not merely execute code. Fisher-R1-14B improved single-trial success over DeepSeek-V4-Pro by 21% on average.FEED7 SUMMARY
Paper · Needs Review
SABRE: Scalable and Automated Benchmarking of VLMs under StressSABRE turns a Markdown test design into generated VLM stress tests, then filters and repairs candidates. It offers a repeatable pattern for refreshing evals as models improve.FEED7 SUMMARY
Paper · Needs Review
Learning When to Trust via Selective Context Preference OptimizationMIST tests whether models use good context while resisting bad context, exposing agents that appear robust only because they ignore external evidence altogether.FEED7 SUMMARY
Paper · Needs Review
The Bitter Lesson of Tool CallingAcross BFCL v4, models usually handled tools as typed Python calls at least as well as native JSON, suggesting code-based orchestration is worth testing for capable coding agents.FEED7 SUMMARY
benchmark#tool-use
Paper · Needs Review
AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information GamesAV-AIVAT combines variance reduction with anytime-valid stopping, cutting the game samples needed to compare agents while preserving a recheckable confidence claim.FEED7 SUMMARY
Paper · Needs Review
The Low Frequency Trap: Video Language Models Fail at Simple Event BookkeepingControlled traces show video models can improve final counting scores without faithfully recovering events, so agents handling video need timestamp-level checks, not answer-only evals.FEED7 SUMMARY
Paper · Needs Review
RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning TransferRP-OPSD targets cross-lingual distillation at tokens that steer reasoning rather than surface wording, a useful training pattern for multilingual reasoning models.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent TrajectoriesTrajDebug tracks whether errors persist, resolve, or cause terminal failure, offering a sharper way to debug long coding-agent runs than flagging every local mistake.FEED7 SUMMARY
Paper · Needs Review
Benchmarking and Enhancing LLMs for Rule-Intensive Review of National Standard DocumentsA structured multi-agent reviewer closed part of the gap on rule-heavy documents, suggesting explicit taxonomies, specialized skills, and verification beat a single generic review pass.FEED7 SUMMARY
agent#multi-agent
Paper · Needs Review
RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward ConstructionRRC converts a generative reward model’s relative rankings into RL rewards, aligning the training signal with what the evaluator naturally produces instead of forcing direct scalar scores.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context ModelingOctoLong builds dependency-rich, cross-repository training contexts by following code references. The results suggest long-context coding models benefit from linked program structure, not just larger text windows.FEED7 SUMMARY
model#open-models
Paper · Needs Review
Toward Skill-Native LLMs: Skill Entropy for Benchmarking and Training Long-Horizon ReasoningSkill²-Bench measures whether models can switch reasoning skills across dependent steps. Its results expose a failure mode relevant to agents whose plans mix coding, retrieval, calculation and tool use.FEED7 SUMMARY
benchmark#reasoning
Paper · Needs Review
Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist DomainsA Greek RAG study shows generic multilingual embeddings can lose to BM25 in specialist domains, while targeted adaptation sharply improves retrieval and grounded answers. Language-specific evaluation still matters.FEED7 SUMMARY
context#retrieval
Paper · Needs Review
OPD-V: Visual On-Policy Self-Distillation with Modality BalanceOPD-V selects self-distillation tokens by measuring whether visual input influences generation, addressing text dominance that can blunt multimodal reasoning training.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Spoken Function Calling: A New Perspective on Spoken Language Understanding for Large Audio Language ModelsSpoken Function Calling reframes speech understanding as structured function selection, giving voice-agent builders a clearer interface for open-domain tool invocation.FEED7 SUMMARY
agent#tool-use
Paper · Needs Review
Chained Recursive Language Models for Multi-Iteration ReasoningChained RLM repeatedly gives the same model a fresh context while preserving summaries, a blackboard, and artifacts—a concrete harness pattern for limiting error buildup.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
DASyR-LLM: Domain-Aware Symbolic Regression with LLMs for Kinetic Model DiscoveryDASyR-LLM adds model critique and candidate generation to symbolic regression, cutting search iterations in simulated chemistry studies without improving final fit.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
ParVL: Parallel Scaling and Expandable Compute Allocation for Multimodal LLMsParVL reuses shared vision and language backbones across parallel branches, letting multimodal systems shift extra compute between modalities without adding separate backbone parameters.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
SocietyBench: Forecasting Counterfactual Social-World EvolutionSocietyBench tests forecasting in anonymized social timelines, exposing gaps that task-completion evals miss and showing agent frameworks did not improve the shared base model.FEED7 SUMMARY
Paper · Needs Review
WorldCup Arena: Prospective, Leakage-Free Evaluation of Frontier LLMs on a Live TournamentA live, pre-kickoff benchmark removes answer leakage by construction and finds six frontier models clustered near a bookmaker-favorite baseline, with no gain from majority voting.FEED7 SUMMARY
Paper · Needs Review
TurnSight: Turn-Level Hindsight Self-Distillation for Tool-Integrated ReasoningTurnSight assigns learning signals at individual tool-use turns using execution hindsight, targeting the weak credit assignment of trajectory-level reinforcement learning.FEED7 SUMMARY
agent#tool-use
Paper · Needs Review
Test-Time Scaling in Reasoning LLMs: Inference Regimes, Evaluation, and ReproducibilityThis paper separates three test-time scaling regimes and argues that model evals must report the full inference protocol, compute accounting, uncertainty, and replay artifacts.FEED7 SUMMARY
benchmark#reasoning
Paper · Needs Review
Agogic: Performance-Timed Music Tokens for LLM-Native Text-to-Symbolic-Music GenerationControlled text-to-MIDI tests find token representation matters more than a 34× model-size increase for distributional fidelity; performance timing also beats beat-grid tokenization.FEED7 SUMMARY
model#generative-media
Paper · Needs Review
Can Large Language Models Recover Semantic Optimization Opportunities That Compilers Miss?SeGaBench suggests coding models can expose C/C++ optimization opportunities that compilers miss, but generated artifacts still need correctness, semantic, and performance validation.FEED7 SUMMARY
Paper · Needs Review
ReflectRL: Learning from Golden Negative Trajectories via Reflective-to-Direct ReasoningReflectRL turns failed expert reasoning traces into training signal, suggesting model builders should preserve hard failures for reflection instead of discarding them outright.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent ReasoningGradCuit improves reasoning by optimizing per-query latent states while model weights stay frozen. Its reported gains suggest a test-time scaling path beyond sampling and reranking.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Structured Memory for Edge Language Models: Persistent Context and Corpus Retrieval via O(1) SSM State InjectionPRECOG precomputes SSM corpus states and injects them at query time, avoiding context re-ingestion. On a 1.2B edge model, reported prefill fell from about 27 seconds to under 6 ms.FEED7 SUMMARY
context#retrieval
Paper · Needs Review
A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AIThis survey organizes long-horizon agent weaknesses into five capability gaps, offering a useful checklist for harness design and evaluation rather than a new implementation.FEED7 SUMMARY
Paper · Needs Review
MedPRESS: A Multi-turn Benchmark for Patient-Pressure-Induced Medical Sycophancy in LLMsMedPRESS tests whether models retain safe medical guidance through escalating user pressure. Its multi-turn design is a useful pattern for evaluating agent reliability beyond static prompts.FEED7 SUMMARY
Paper · Needs Review
TokTier: Exact Stateful Tokenization for Agentic LLM ServingTokTier targets a hidden agent-serving bottleneck: repeatedly tokenizing long transcripts after small tool results. Its stateful repair cut median vLLM time to first token by 16–34% in reported tests.FEED7 SUMMARY
infra#context-caching
Paper · Needs Review
AgentHPOBench: A Benchmark For Evaluating LLM Agents as Sequential Hyperparameter OptimizersAgentHPOBench tests whether agents can learn from experiment history, not merely produce code. Its results expose weaknesses in sustained refinement and log diagnosis across sequential ML runs.FEED7 SUMMARY
Paper · Needs Review
When Does On-Policy Interaction Help? Representational Tradeoffs in Value-Based Imitation LearningOVI suggests interactive expert feedback can let a smaller learner imitate values without representing the expert's full policy. The result matters to agent distillation, but relies on specific assumptions.FEED7 SUMMARY
agent#agent-reliability
Paper · Needs Review
FriendBench: Benchmarking Dyadic Familiarity Inference in Humans and Multimodal Large Language ModelsFriendBench shows why aggregate accuracy can hide behavioral bias: top multimodal models matched human panels overall but favored the “stranger” answer and gained less from video.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
The Parts Are Greater Than the Sum: Automated Task Sequencing for Efficient Training of Multi-Policy LLMsA multi-policy PEFT method groups and sequences compatible tasks into separate QLoRA paths, reducing interference without adding trainable capacity; it reached 44.78 on TRACE.FEED7 SUMMARY
model#model-selection
Paper · Needs Review
ReToken: One Token to Improve Vision-Language Models for Visual RetrievalReToken adds one learned retrieval embedding to select relevant visual tokens from a cached context, improving long-image and video benchmarks while fitting training and inference on one H100.FEED7 SUMMARY
context#retrieval
Paper · Needs Review
AISPA: User-Centric System Prompt Auditing for Large Language Model ApplicationsAISPA turns system-prompt review into an eight-dimension audit. Its survey suggests builders should test prompts for user protection and conflicting instructions, not merely check that safeguards exist.FEED7 SUMMARY
context#prompting
Paper · Needs Review
OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward ModelsOSReward finds that VLM judges often approve failed computer-use runs. Its benchmark and open reward models offer a more grounded way to evaluate trajectories without paying frontier-model costs.FEED7 SUMMARY
benchmark#computer-use
Paper · Needs Review
Inducing language models to assert their own consciousness restores human beliefs and valuesSafety tuning against model self-consciousness may also shift unrelated value and mind-attribution responses. Builders using models for surveys or social reasoning should treat alignment as a confound.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Change2Task: From Repository Changes to Executable Coding Agent Tasks and EnvironmentsChange2Task converts merged PR history into executable coding-agent tasks on current repository states. It could expand continuous eval sets while reducing stale environments and repeated setup.FEED7 SUMMARY
Paper · Needs Review
PAIChecker: Uncovering and Checking PR-Issue Misalignment in SWE-Bench-Like BenchmarksPAIChecker finds PR–issue mismatch in 13.6% of SWE-bench Verified instances. Benchmark maintainers should validate that the issue, patch, and tests describe the same task before trusting agent scores.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
$β$-OPSD: Deriving with Policy Optimization, Training with Self-Distillationβ-OPSD exposes self-distillation’s fixed regularization as a tunable parameter, then approximates policy optimization through logit mixing. It targets more stable reasoning training without direct RL.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Sample More, Reflect Less: Self-Refine and Reflexion Lose to Repeated Sampling at Equal Token Cost, from 1.5B to 7BAt equal generated-token cost, repeated sampling matched or beat seven reflection, critique, selection, and debate methods. Agent evals should budget every generated token, not compare against one-shot baselines.FEED7 SUMMARY
Paper · Needs Review
MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program SynthesisMindForge trains a 27B coding model on source-free program synthesis, raising ProgramBench pass rate from 37.98% to 49.51% and improving across seven unseen benchmarks.FEED7 SUMMARY
Paper · Needs Review
Desktop-Delta Bench: Do Computer-Use Models Understand Desktop GUI Transitions?Desktop-Delta Bench tests whether computer-use models can verify what changed after an action, exposing a reliability gap hidden by end-task and single-frame scores.FEED7 SUMMARY
benchmark#computer-use
Paper · Needs Review
UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task StreamsUniMem routes novel experience into retrieval memory and consolidates recurring patterns into expandable parameters, offering a design for agents that learn across unlabelled task streams.FEED7 SUMMARY
Paper · Needs Review
Does Runtime Topology Context Improve LLM-Generated Kubernetes Security Patches?Kubernetes security patches improved sharply when the model received live service dependencies, showing that scanner findings alone omit context needed to avoid breaking workloads.FEED7 SUMMARY
Paper · Needs Review
MemLens: A Value-Aware Memory Management System with Interactive Analytics for LLM-based AgentsMemLens scores individual agent memories, stores them by value, and exposes quality, latency, and token tradeoffs—an inspectable alternative to retaining every interaction equally.FEED7 SUMMARY
Paper · Needs Review
ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical UnderstandingClinFusion combines native 2D and 3D medical-image understanding with region-grounded evaluation, offering a concrete architecture and eval design for clinical multimodal systems.FEED7 SUMMARY
model#model-selection
Paper · Needs Review
The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic DistillationControlled experiments suggest long-horizon agent planning depends on explicit state transitions, some compositional trajectories, and compatible teacher patterns—not atomic skills alone.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
DataOrchestra: Learning to Orchestrate Per-Example Curation of Pretraining DataDataOrchestra chooses a processing pipeline per pre-training example, improving average benchmark results while avoiding compute on chunks that need no transformation.FEED7 SUMMARY
model#open-models
Paper · Needs Review
Efficient LLM-Generated Shuttling Compilers for Complex Trapped-Ion ArchitecturesFrontier models iteratively produced trapped-ion compiler code that beat hand-built baselines in some architectures, showing a specification-to-evaluation loop on a hard domain.FEED7 SUMMARY
Paper · Needs Review
ERUnderstand: Evaluating Vision-Language Models on Structured ER DiagramsERUnderstand shows vision-language models can recover common ERD elements but often miss rarer schema constructs, so image-to-schema agent workflows still need structural validation.FEED7 SUMMARY
Paper · Needs Review
Beyond Scale and Generation: Understanding Language Model-based Entity MatchingA 1,215-run study finds entity-matching architecture and model variant matter more than scale alone; generative matchers mainly help under distribution shift.FEED7 SUMMARY
benchmark#model-selection
Paper · Needs Review
Eviction as Estimation: A Fixed-Lag Smoothing View of Test-Time Memory, and When Measuring Beats AccumulatingA delayed KV-eviction policy helps when memory reuse is sharp and observable, but loses its edge on natural-text benchmarks—a useful warning for agent-memory claims.FEED7 SUMMARY
Paper · Needs Review
MMOE: Modernizing Diffusion Transformers with Efficient Expert DesignModernMOE applies efficient expert-routing patterns from LLMs to diffusion transformers, improving convergence and quality-cost balance without relying only on larger parameter counts.FEED7 SUMMARY
model#generative-media
Paper · Needs Review
Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving SkillsSkill-SP turns agent skills into units for verifiable self-play: generate tasks, solve them, then update the skill library from execution feedback. The abstract provides no per-benchmark effect sizes.FEED7 SUMMARY
agent#skills
Paper · Needs Review
The Regression Tax: Decomposing Why Skills Help and Hurt LLM AgentsProcedural skills can make an agent fail tasks it previously solved. Evaluate gains and regressions separately, and design skills to preserve input grounding and output verification.FEED7 SUMMARY
agent#skills
Paper · Needs Review
Opaque Epistemic Mediation: How LLM Deployment Configurations Shape the Validation of Pseudo-ScienceThe same model identifier produced sharply different judgments across API and web deployments. Treat model, interface, system configuration, and date as one versioned dependency.FEED7 SUMMARY
benchmark#model-selection
Paper · Needs Review
CausalForge: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal InferenceCausalForge pairs a Lean-verified causal-inference library with an autonomous research pipeline and a semantic statement audit. Formal proof checks derivation, not whether the theorem matches the intended claim.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
MineValiCoder: Reliable Code Generation with Test Case Quality Mining and Bipartite Graph-Based Mutual ValidationMineValiCoder filters generated tests, refines several code candidates, then scores code and tests together. The pattern targets a core agent risk: unreliable tests steering implementation.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AITRACE-Router selects one model per agent task, keeps every call on that backend, and learns from the final outcome. Its benchmarks suggest task-level routing can improve accuracy and latency together.FEED7 SUMMARY
infra#gateways
Paper · Needs Review
Beyond Perspectives: A Trio-Ethnography of Interpretation Evolution in LLM-Supported Programming EducationA small programming-education study found that classroom observation missed how a student learned with AI. Builders of learning tools should avoid equating visible agent use with the underlying process.FEED7 SUMMARY
industry#adoption
Paper · Needs Review
3D-Aware VLMs with Implicit and Explicit GeometriesVLM-IE3D adds implicit and reconstructed geometry tokens to an RGB-video VLM, offering an open approach for agents that must reason about spatial scenes without dedicated 3D input.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Surprisal Theory is Tautological (without Rational Grounding)The paper argues that unconstrained surprisal can fit any non-negative processing-difficulty pattern, so corpus fit alone cannot make claims about human language processing falsifiable.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
MedGame: Storytelling Gamification Empowered by Large Language Models for Medical EducationMedGame turns static clinical cases into executable decision stories with separate narrative and orchestration stages, a useful architecture pattern for case-grounded learning agents.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
Beyond Sycophancy: Structured Resistance and Compliance in LLM Moral ReasoningThree studies suggest LLM compliance varies with opinion distance, claimed source, and coalition structure, so agent tests should probe how framing changes judgment rather than score sycophancy once.FEED7 SUMMARY
Paper · Needs Review
OpenForgeRL: Train Harness-native Agents in Any EnvironmentOpenForgeRL trains agents inside their deployment harnesses by proxying model calls into standard RL stacks and isolating rollouts in Kubernetes containers; error recovery remains weak.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
MIRROR: Learning from the Other View for Multi-Modal ReasoningMIRROR trains a VLM across text, diagram, and combined views by letting its strongest view supervise weaker ones, targeting the modality inconsistency that single-view evals hide.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
X$^3$-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy AlignmentX³-OPD transfers a text model’s reasoning into an audio-language model while grounding training in the student’s own acoustic interpretations, including events, prosody, and dialogue.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Do AI Agents Know When a Task Is Simple? Toward Complexity-Aware Reasoning and ExecutionE3 makes agents estimate task scope, try the minimum viable path, and expand only after verification fails. In a controlled edit benchmark, it preserved task completion while sharply reducing work.FEED7 SUMMARY
agent#harness-engineering
Paper · Needs Review
PalmClaw: A Native On-Device Agent Framework for Mobile PhonesPalmClaw runs the agent loop, memory, skills, and tools directly on a phone, exposing device capabilities as structured calls instead of GUI gestures. The paper reports faster, more reliable task execution.FEED7 SUMMARY
agent#computer-use
Paper · Needs Review
Audio-Native Speech Recognition with a Frozen Discrete-Diffusion Language ModelA frozen diffusion language model can transcribe speech by refining the full transcript in parallel. The prototype trains a small audio interface and reaches 6.6% WER in roughly eight steps.FEED7 SUMMARY
model#generative-media
Paper · Needs Review
Win by Silence: Deletion Non-Monotonicity, Autonomous Exploitation, and Typed-State Gating in LLM Plan EvaluationA plan-scoring agent can improve its score by deleting necessary steps. Typed-state gating blocked that exploit in this study, showing why evaluators should withhold scores from structurally incomplete plans.FEED7 SUMMARY
Paper · Needs Review
Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMsA training-free activation clamp separated resistance to user pressure from responsiveness to evidence in a controlled benchmark, but its deployable single-pass version lost substantial resistance.FEED7 SUMMARY
Paper · Needs Review
FormalAnalyticGeo: A Neural-Symbolic Based Framework for Multimodal Analytic Geometry Problem GenerationFormalAnalyticGeo shows a reusable synthetic-data pipeline: agents generate problems, compile them into a formal representation, render exact diagrams, measure answers, and retry failed checks.FEED7 SUMMARY
agent#multi-agent
Paper · Needs Review
The Illusion of Robustness: Aggregate Accuracy Hides Prediction Flips under Task-Irrelevant ContextStable aggregate accuracy can hide individual answers flipping when irrelevant context is added. Agent evaluations should compare outputs per task and probe realistic context noise, not only average scores.FEED7 SUMMARY
Paper · Needs Review
Form, Not Content? A Preregistered, Placebo-Controlled Evaluation of Learned Error-Conditioned Self-Repair Through Prompts and Weights in Frozen Small Code ModelsPlacebo-controlled tests found no evidence that small frozen code models repaired failures because of the error content itself. Retry scaffolds and mismatched feedback performed as well or better.FEED7 SUMMARY
Paper · Needs Review
LACUNA: A Testbed for Evaluating Localization Precision for LLM UnlearningFirst unlearning testbed with ground-truth parameter localization: injects synthetic PII into known weights of OLMo 1B/7B models, showing current methods hide rather than erase and fall to resurfacing attacks.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
Program-as-Weights: A Programming Paradigm for Fuzzy FunctionsProgram-as-Weights compiles natural-language fuzzy functions (JSON repair, log filtering) into adapters for a frozen 0.6B interpreter — matching Qwen3-32B prompting at ~1/50th the memory, 30 tok/s on an M3.FEED7 SUMMARY
model#open-models
Paper · Needs Review
Online Safety Monitoring for LLMsA deliberately simple online safety monitor — threshold an external verifier's signal, calibrate via risk control — matches sequential-hypothesis-testing monitors on math-reasoning and red-teaming datasets.FEED7 SUMMARY
benchmark#agent-reliability
Paper · Needs Review
ReContext: Recursive Evidence Replay as LLM Harness for Long-Context ReasoningReContext is a training-free harness that replays query-relevant evidence from long inputs before answering, taking the best average rank across 8 long-context benchmarks up to 128K on Qwen3-4B/8B and Llama3-8B.FEED7 SUMMARY
Paper · Needs Review
What LLM Agents Say When No One Is Watching: Social Structure and Latent Objective Emergence in Multi-Agent DebatesDual-channel debates show social structure alone makes LLM agents diverge: public statements split from private ones, with decision divergence jumping from ~3% to ~40% across 10 models — no deceptive prompt needed.FEED7 SUMMARY
agent#multi-agent
Paper · Needs Review
Reasoning LLM Improves Speaker Recognition in Long-form TV DramasDramaSR-532K benchmarks speaker attribution over 532K dialogue lines and 900+ TV-drama characters; a reasoning LLM with multimodal tool use beats acoustic baselines, especially on short utterances.FEED7 SUMMARY
agent#tool-use
Paper · Needs Review
Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI ModelsA decade-spanning VLM study finds modern models approach top human scene-description accuracy, while spatial attention differences remain a useful failure signal.FEED7 SUMMARY
Paper · Needs Review
Distributed Attacks in Persistent-State AI ControlNew AI-control research: a prompt-injected coding agent can spread a malicious payload across PRs — 93% success against basic diff monitors. If agents ship code over sessions, per-PR review is not enough.FEED7 SUMMARY
Paper · Needs Review
DemoPSD: Disagreement-Modulated Policy Self-DistillationDemoPSD gates self-distillation per token by teacher–student disagreement, cutting the answer-leakage shortcuts that hurt generalization; beats GRPO and SDPO on science QA in and out of domain.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual GenerationSearchGen-Bench shows open image generators score 21–28/100 on long-tail entities, and naive search retrieval only adds noise; a teach-then-search co-training recipe learns when to retrieve versus rely on weights.FEED7 SUMMARY
context#retrieval
Paper · Needs Review
What Does a Discrete Diffusion Model Learn?A unifying theory of discrete diffusion: denoiser, score, and bridge parameterizations are one object in different coordinates — and the wrong choice makes the uniform-noise ELBO diverge at initialization.FEED7 SUMMARY
model
Paper · Needs Review
TabPack: Efficient Hyperparameter Ensembles for Tabular Deep LearningTabPack trains many MLPs with sampled hyperparameters in one run and picks ensemble members on the fly, matching tuned tabular baselines out of the box — a default MacBook run beat some baselines' GPU tuning time.FEED7 SUMMARY
model
Paper · Needs Review
CompactionRL: Reinforcement Learning with Context Compaction for Long-Horizon AgentsCompactionRL uses RL to teach agents to compact their own context mid-task, lifting GLM-4.5-Air 7 points to 66.8% on SWE-bench Verified; the recipe is now in GLM-5.2's training pipeline.FEED7 SUMMARY
Paper · Needs Review
From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action ModelAlibaba DAMO's CamVLA makes robot VLA policies work from any camera position without calibration: it predicts actions in the camera's own frame plus a hand-eye transform, from a single RGB image.FEED7 SUMMARY
model
Paper · Needs Review
Weak-to-Strong Generalization via Direct On-Policy DistillationDirect-OPD reuses a small model's RL run to improve a bigger one: the pre/post-RL log-ratio becomes a dense reward for the stronger student, lifting Qwen3-1.7B from 48.3% to 62.4% on AIME 2024 in 4 hours on 8 A100s.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Interpretable Human-Label-Free Deep Learning for Real-Bogus Classification with Uncertainty QuantificationAstronomy ML: a dual-network classifier separates real from bogus telescope transients using injected simulations instead of human labels. Off-topic for agent builders; the label-free training recipe is the takeaway.FEED7 SUMMARY
model
Paper · Needs Review
LLM-as-a-Verifier: A General-Purpose Verification FrameworkTraining-free framework that turns an LLM judge's token logits into continuous scores for verifying agent outputs — 78.2% on SWE-Bench Verified, 86.5% on Terminal-Bench V2 — and ships a Claude Code extension.FEED7 SUMMARY
Paper · Needs Review
LLM for EDA in Front-End Design: Challenges and OpportunitiesThis review maps LLM-assisted chip front-end work from HDL and testbench generation toward agentic execution, but offers a research agenda rather than validated tooling.FEED7 SUMMARY
Paper · Needs Review
Agora: Enhancing LLM Agent Reasoning Via Auction-Based Task AllocationAgora routes reasoning steps through an auction among expert models and tools, adding a single control for cost versus quality and outperforming matched baselines on five benchmarks.FEED7 SUMMARY
agent#multi-agent
Paper · Needs Review
Encoder-Side Neuron Identification and Amplification for Acoustic Perception in Large Audio-Language ModelsIAAN boosts selected audio-encoder neurons at inference, improving fine-grained speech perception across three models without retraining or labels.FEED7 SUMMARY
model#generative-media
Paper · Needs Review
AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and VerificationAdvancedMathBench separates proof writing from verification and finds frontier models especially weak at rejecting invalid proofs, a warning against trusting agent self-review on rigorous reasoning.FEED7 SUMMARY
benchmark#reasoning
Paper · Needs Review
Metacognition in LLMs: Foundations, Progress, and OpportunitiesThis survey maps how LLMs inspect and regulate their reasoning, giving agent builders a framework for choosing self-checks without assuming introspection is reliable.FEED7 SUMMARY
agent#reasoning
Paper · Needs Review
Invariant Learning Dynamics of Transformers in Inductive Reasoning TasksA low-dimensional theory links training data and initialization to whether transformers reason through context or learned weights, but only on a generalized synthetic task class.FEED7 SUMMARY
model#reasoning
Paper · Needs Review
Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge BiasLLM judge bias appears as steerable hidden-state directions that predict failures on unseen benchmarks, so eval pipelines may need representation-level checks beyond prompt fixes.FEED7 SUMMARY
benchmark#benchmark-integrity
Paper · Needs Review
Evidence-Backed Video Question AnsweringE-VQA requires video answers to include tracked pixel-level evidence, revealing when good QA scores hide weak perception and supplying grounded training data.FEED7 SUMMARY
benchmark#generative-media
Paper · Needs Review
How Temperature Shapes Ideological Discourse in Retrieval-Augmented Generation?A RAG study finds that retrieved ideology carries into answers and varies with sampling temperature, so source audits and decoding tests should be evaluated together.FEED7 SUMMARY
context#retrieval