本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表,以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新758篇论文,其中:

  • 自然语言处理87篇
  • 信息检索22篇
  • 计算机视觉102篇

自然语言处理

1. 【2610.42149】Latent Reasoning in Continuous Space for Unified Multimodal Models

链接:https://arxiv.org/abs/2610.42149

作者:Byungwoo Jeon,Yoonwoo Jeong,Hyunseok Lee,Minsu Cho,Jinwoo Shin

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Unified Multimodal Models, Unified Multimodal, effectively leverage language-based, diverse multimodal understanding, Multimodal Models

备注: Published as conference proceeding for NeurIPS 2026. Last two authors advised equally

点击查看摘要

Abstract:Unified Multimodal Models (UMMs) achieve remarkable success on diverse multimodal understanding and generation tasks, yet they still struggle to effectively leverage language-based chain-of-thought reasoning for image generation. As a result, existing reasoning-augmented UMMs often fail to inherit the test-time scaling and fine-grained controllability observed in large language models. We attribute this failure to a fundamental modality mismatch: reasoning is performed in a discrete token space, whereas image generation operates in a continuous space. To bridge this gap, we introduce a Latent Reasoning framework in Continuous space (LARC), which alleviates the token-level bottleneck by reasoning over continuous hidden states. Specifically, the training framework consists of two stages: (i) curriculum supervised fine-tuning (SFT), and (ii) information-gain reinforcement learning (RL). First, the curriculum SFT stage gradually converts token-level reasoning into latent reasoning. Subsequently, the information-gain RL stage self-evolves latent reasoning without ground truth supervision. Experiments across diverse text-to-image generation benchmarks show that LARC consistently improves generation quality, prompt following, and compositional fidelity. Notably, LARC achieves state-of-the-art performance on GenEval with a 7%p gain over BAGEL and demonstrates clear test-time scaling behavior, outperforming token-based generation under both parallel and sequential test-time scaling strategies.

2. 【2610.42148】Flide: Accelerating Decision Inference with Exact State Forking

链接:https://arxiv.org/abs/2610.42148

作者:Bobo Li,Jiajia Song,Hao Fei,Wynne Hsu,Mong Li Lee

类目:Computation and Language (cs.CL)

关键词:highly promising paradigm, reliable categorical reasoning, Jev have emerged, paradigm for LLM, LLM agent systems

备注: 20 pages. Project page: [this https URL](https://flide.org)

点击查看摘要

Abstract:Decision models such as Jev have emerged as a highly promising paradigm for LLM agent systems, providing lightweight and reliable categorical reasoning for rapid System One execution. However, existing generation-oriented inference engines fail to support these workloads effectively, suffering from severe prefix recomputation overheads or distorted output probabilities. To address this challenge, we propose Flide, an efficient and exact inference engine that decouples the logical tree structure of a decision request from its physical execution within a single flattened token stream. Through ForkAttention, Flide navigates request dependencies using GPU-resident indices across both standard attention and recurrent Gated DeltaNet layers, guaranteeing in exact arithmetic that every query branch evaluates identically to an isolated forward pass. By expressing branch topologies directly in GPU-resident metadata, Flide accommodates diverse request mixtures with a compact set of pre-recorded execution graphs while enabling expanding agent histories to resume from checkpoints saved in earlier passes. Extensive evaluations on public hybrid and decision models demonstrate that Flide answers queries up to 9.5 times faster than vLLM and SGLang while staying closest to a float32 reference in total variation distance. By unifying physical execution throughput with mathematical exactness, Flide establishes a principled foundation for scalable, latency-critical decision intelligence in agent systems.

3. 【2610.42128】DecisionRank: On-Policy Distillation for Decision-Model Rerankers

链接:https://arxiv.org/abs/2610.42128

作者:Yanran Wu,Dian Yu,Chongyang Bai,Jieyi Zhang,Rui Liu,Tianyi Chen,Shike Mei,Hang Cui,Frank Shyu,Sandeep Pandey,Luke Simon,Chunwei Liu,Xi Liu

类目:Computation and Language (cs.CL)

关键词:avoiding autoregressive decoding, autoregressive decoding latency, target structured tasks, Decision models target, models target structured

备注: 25 pages, 8 figures

点击查看摘要

Abstract:Decision models target structured tasks by directly predicting choices or scores, avoiding autoregressive decoding latency. However, transferring a generative LLM's ranking knowledge to a decision model remains challenging: the teacher expresses preferences through a ranked list of document ID sequences, while the student determines the ranking using scores from the first-token position. To bridge this gap, we introduce DecisionRank, a decision model trained through item-space on-policy distillation (OPD). Item-space OPD constructs the student's rollout by sorting its document scores into a ranked sequence. A generative teacher takes the resulting ranking list as inputs and provides conditional feedback to directly supervise those scores. Combined with offline ranking supervision, DecisionRank achieves state-of-the-art performance on both general and reasoning-intensive retrieval benchmarks such as TREC DL, BEIR, and BRIGHT. Across four benchmarks, item-space OPD consistently outperforms alternative training objectives. Even at 1.7B parameters, DecisionRank surpasses its 27B generative teacher on TREC DL19--23. At 8B, it outperforms its generative listwise counterpart while running $24.5\times$ faster on TREC DL and $16.7\times$ faster on BRIGHT.

4. 【2610.42112】Subquadratic Attention with a Hierarchical Tree-Structured Indexer

链接:https://arxiv.org/abs/2610.42112

作者:Leon Lufkin,Cutter Dawes,Alexander Speicher,Kamesh Krishnamurthy,Tomás Figliolia,Beren Millidge

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:fundamental bottleneck limiting, large language models, fundamental bottleneck, bottleneck limiting, capabilities of large

备注: 43 pages

点击查看摘要

Abstract:The quadratic scaling of attention is a fundamental bottleneck limiting the long-context capabilities of large language models (LLMs). A variety of approaches have attempted to circumvent this, but they either fail to match attention's expressiveness (e.g., sliding-window or linear attention variants with fixed-size state) or only achieve constant-factor speedups (e.g., sparse attention methods whose indexers themselves scale quadratically). In this paper, we derive an asymptotically subquadratic sparse attention method based on a hierarchical, tree-structured indexer, which we call Zyphra Hierarchical Attention (ZHA). ZHA constructs a tree of recursively compressed key summaries over the KV cache, which future queries traverse from the top down to retrieve a sparse subset of keys. Crucially, by iteratively growing the tree's depth, the total cost including routing and final attention grows sublinearly in sequence length, resulting in overall subquadratic (but superlinear) scaling for attention. We demonstrate that ZHA can be cheaply applied to existing pretrained models with only a short KL distillation training stage over a few billion tokens, and maintains performance on long-context retrieval and challenging reasoning, mathematical, and agentic coding evaluation tasks. Moreover, we show that our method is highly robust to tree geometry including very deep trees of up to 6 levels. Finally, we develop a detailed performance model and show that our approach scales subquadratically, dramatically outperforms competing methods beyond 1 million context, and ultimately has the potential to extend effective context windows to the hundreds of millions or billions of tokens.

5. 【2610.42084】RangeSWA: Training-Free Length Extrapolation for Continuous Diffusion Language Models

链接:https://arxiv.org/abs/2610.42084

作者:Guangfu Guo,Xiaoqian Lu,Linsey Pang,Weiran Yao,Haolin Chen,Long Cheng,Kunpeng Liu

类目:Computation and Language (cs.CL)

关键词:show promising potential, semantic drift, Continuous diffusion language, promising potential, prone to problems

备注:

点击查看摘要

Abstract:Continuous diffusion language models show promising potential in text generation tasks, but are prone to problems such as text repetition, semantic drift, and generation quality degradation when the generation length exceeds the training length. To address these challenges, we propose RangeSWA, a training-free length extrapolation method. The method combines local sliding-window attention, remote block summaries, and dynamic content retrieval to preserve local details and support long-range context access. In addition, generation degradation caused by length extrapolation is mitigated through positional remapping, conditioning attention correction, and denoising-stage-adaptive window scheduling. We conducted experiments on multiple continuous diffusion language models, and the results show that RangeSWA can effectively reduce generative perplexity and text repetition rates in long-text generation.

6. 【2610.42066】he Knowledge Layer Model (KLM): Evidence-Visible AI Output, Routing Diagnostics, and Negative Results

链接:https://arxiv.org/abs/2610.42066

作者:Omer Asim Ozturk,Cihan Aydiner

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Knowledge Layer Model, recorded basis, inspect their recorded, Layer Model, Knowledge Layer

备注: 47 pages, 1 figure, 14 tables. Includes Appendix A

点击查看摘要

Abstract:AI answers require more than apparent correctness: reviewers need to inspect their recorded basis. We introduce the Knowledge Layer Model (KLM), an open, implementation-neutral specification for inference records with versioned epistemic assessments, evidence relations, and explicit unknowns. SEDIM, the knowledge and evidence architecture of Nage AI OS, is a reference implementation. We reference KLM v0.3 (repository tag v0.3.0). Empirical material consists of separate internal experiments, not end-to-end validation. A historical platform-domain routing benchmark reports 137/150 classifications across 15 classes (91.3%; nominal 95% Wilson interval 85.7-94.9%); the numerator is recovered from a rounded summary, and historical example membership is unverified. A native-model weight-path configuration yielded 0/15 successful answers in a corrected two-source test. A capacity-growth comparison could not establish a reliable effect because of a defective legacy scorer and missing original outputs. Lexical and scoped diagnostics each yielded AUC 0.008 for silent-versus-contradicted examples, below the registered minimum of 0.65. Legacy packing lost gold-containing text in 118/221 selected cases; repaired packing retained it in 221/221. These measure text presence, not answer quality. Python and TypeScript verifiers reportedly agreed on six checks per synthetic fixture; a separate production disclosure was not accepted. Restoration, re-derivation, human-rubric support, boundary isolation, and bounded-response evaluations remain proposed. Findings are internal and author-reported; historical observations are distinguished from later reproductions. Evidence visibility does not establish correctness, causal reliance, security, or regulatory compliance. Independent replication and a complete public audit package remain future work.

7. 【2610.42060】PersonaChatBench: Evaluating Chat Assistants with Diverse Simulated Users

链接:https://arxiv.org/abs/2610.42060

作者:Zheyuan Deng,Taoran Li,Jingwen Zhang,Yuante Li,Dachuan Zhao,Fulei Zhang,Yunkai Zhang,Zhikun Xu,Yajie Liao,Haichao Zhang,Haodi Hu,Cong Wang,Chen Yang,Siyang Wu,Defu Cao,Xu Hu,Haoming Li,Haixin Wang,Robert George,Weizhi Zhang,Yuchu Wang,Zhejian Peng,Yueying Li,Wanting Jiang,Shushu Liang,Zhiyuan Yu,Yifan Wang,Jintao Huang,Yijun Wang,Yuexing Hao,Xiaomin Li

类目:Computation and Language (cs.CL)

关键词:Conversational assistants, communication styles, Conversational, task, diverse backgrounds

备注: 74 pages, including appendices

点击查看摘要

Abstract:Conversational assistants are expected to help people with diverse backgrounds, preferences, and communication styles. Yet evaluations centered on a single cooperative user provide limited insight into how reliably an assistant serves users with different personas. We introduce PersonaChatBench, a framework for evaluating task competence and responsiveness to diverse user needs. PersonaChatBench pairs the same underlying task with multiple simulated users, each guided by a private persona card that specifies distinct needs, preferences, and interaction behaviors. By holding the task fixed while varying the user, the framework examines how assistant performance changes across user conditions. We evaluate 20 language models across six domains, separately assessing native task outcomes, fulfillment of expressed persona needs, and simulator fidelity. Our results show that task performance and need fulfillment vary across personas and domains. Strong task performance does not necessarily translate into satisfying individual needs, and models' relative strengths in meeting those needs are not consistent across domains. PersonaChatBench makes these differences measurable, revealing gaps obscured by aggregate scores and helping identify which users an assistant serves well and where adaptation is needed. It provides a basis for evaluating consistency across users and guiding the development of assistants that better accommodate diverse needs in everyday applications.

8. 【2610.42054】CRoS: Causality Reward on Scrambled CoTs Improves Accuracy and Reasoning Faithfulness

链接:https://arxiv.org/abs/2610.42054

作者:Xiao Yu,Justin Chih-Yao Chen,Zaid Khan,Hyunji Lee,Mohit Bansal

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Reinforcement learning, training language models, RLVR typically relies, models to reason, learning with verifiable

备注: 17 pages, 3 figures, 14 tables. Project page: [this https URL](https://xxiaoyuuuu.github.io/CRoS-Page)

点击查看摘要

Abstract:Reinforcement learning with verifiable rewards (RLVR) has become the standard method for training language models to reason. However, RLVR typically relies solely on outcome correctness, which does not guarantee that the CoT causally contributes to the final answer. Without this connection, outcome rewards may fail to reinforce high-quality reasoning. Existing causality metrics assess CoT causality by perturbing the CoT, such as deleting reasoning steps or injecting errors, and measuring changes in the final answer. However, these perturbations inevitably alter information in each step. Consequently, high causality scores may reflect sensitivity to information changes introduced by perturbation rather than true causality. Such confounding effects further induce undesirable reasoning behaviors when these metrics are used as training rewards, including generating less informative CoTs and reducing exploration and self-correction. To address this problem, we propose CRoS (Causality Reward on Scrambled CoTs), a novel CoT causality metric that perturbs the order of reasoning steps without altering content, thereby preserving information within each step. On Reasoning Gym with Gemma-3-4B, CRoS outperforms existing causality and outcome rewards in out-of-domain accuracy, CoT quality, and CoT faithfulness. Specifically, CRoS achieves 46.8% accuracy on five unseen logic and games datasets, outperforming the strongest baseline (43.8%). It also achieves better CoT quality, consistently outperforming baselines in CoT-Pass@K from K=1 to 128, averaging 43.4% vs. 41.4%. For CoT faithfulness, CRoS achieves a hint acknowledgment score of 34.0% vs. 20.2%.

9. 【2610.42018】Asynchronous Flow Map Language Models

链接:https://arxiv.org/abs/2610.42018

作者:Chanhyuk Lee,Wonjung Kim,Patrick Pynadath,Jaehoon Yoo,Satoshi Hayakawa,Ruqi Zhang,Jinwoo Kim,Seunghoon Hong

类目:Computation and Language (cs.CL)

关键词:generated sequences, profound impact, quality of generated, language modeling, parallel language modeling

备注: Code available at: [this https URL](https://github.com/david3684/async-fmlm)

点击查看摘要

Abstract:The order in which tokens are predicted in language modeling has a profound impact on the quality of generated sequences. Autoregressive and masked diffusion models iteratively fill in tokens and can exploit such orderings across generation steps, but how to leverage an ordering for one-step parallel language modeling is unclear. We introduce asynchronous flow map language models (aFMLMs), which incorporate prediction order into one-step modeling by learning the flow maps of asynchronous flows. These flows specify an ordering through a tokenwise time schedule that controls the relative denoising progress of tokens. We formulate a general class of asynchronous flows that admit both prescribed and learned, state-adaptive schedules, show that they define valid flow maps, and develop new methods for their flow map distillation. The resulting models can generate all tokens in a single forward pass by internalizing the ordering encoded in the flow into their hidden computations. On Sudoku solving and code generation for GSM8K math word problems, aFMLM establishes new state-of-the-art one-step performance.

10. 【2610.42010】urnTurk-GPT: Text-Based Turn-Taking Prediction for Turkish

链接:https://arxiv.org/abs/2610.42010

作者:Ahmet Tuğrul Bayrak,Fatma Nur Korkmaz,Nur Yağmur Tuncer,Mustafa Sertaç Türkel

类目:Computation and Language (cs.CL)

关键词:real Turkish conversation, text-based turn-taking predictor, paper presents TurnTurk-GPT, real Turkish, paper presents

备注:

点击查看摘要

Abstract:This paper presents TurnTurk-GPT, a text-based turn-taking predictor for Turkish obtained by fine-tuning a Turkish GPT-2 model with the TurnGPT objective on synthetic and real dialogue, and evaluates it on real Turkish conversation against rule baselines, a zero-shot Turkish language model and a widely used multilingual end-of-turn detector. Evaluation uses word-level decision points on unpunctuated, lower-cased text approximating the output of streaming speech recognisers, recording-disjoint and speaker-disjoint folds, nested threshold selection and paired cluster bootstrap tests. TurnTurk-GPT outperforms the multilingual detector under both recording-disjoint and speaker-disjoint evaluation. It outperforms the zero-shot language model only when the test speakers occur in training; on unseen speakers the two are statistically indistinguishable. Removing the suffixes of the turn-final word reduces AP by up to 44%, against 2% for a sentence-internal word, locating the Turkish end-of-turn cue in verb-final morphology. Synthetic dialogue alone yields the weakest trained model, and when a speaker pauses the zero-shot and multilingual baselines remain close to chance. The model and the evaluation protocol are publicly released.

11. 【2610.42000】Less Loss, Fixed Weights: Logit Corrections for Forgetting

链接:https://arxiv.org/abs/2610.42000

作者:Hanyu Yang

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:predicting standard web, standard web text, follow instructions, fine-tuned to follow, worse at predicting

备注: 8 pages, 3 figures, 2 tables. Code and data: [this https URL](https://github.com/SeverinVisionary/prior-shift-diagnostic)

点击查看摘要

Abstract:When a language model is fine-tuned to follow instructions, or further pretrained on a new subject, it often gets worse at predicting standard web text. This is known as "forgetting." We ask whether this loss can be undone by simple, fixed adjustments to the model's final token predictions. Across 14 pairs of base and derived models, from 1B to 7B parameters, we fitted a fixed bonus or penalty for each token (a vocabulary bias), alone or together with a temperature. On text held out from correction fitting, the largest top-4K bias recovery estimate is under 10%, with loss conditional on the retained vocabulary. Combining the bias with a temperature recovers up to 36%. Models further pretrained on math lose the most and recover almost nothing. Finally, in a controlled simulation where a model is damaged at random, with no planted bias or temperature change, the bias-plus-temperature fix still recovers 29%. Most of the real-model loss increase stays out of reach of our restricted fits.

12. 【2610.41994】DAMI: Dual-Axis Memory Initialization for Enhanced Long-Context Retrieval in Gated Linear Attention

链接:https://arxiv.org/abs/2610.41994

作者:Zhangchi Feng,Harry Jiang,Yangyifei Luo,Ray Zhang,Richong Zhang

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:attention scales linearly, Linear attention scales, sequence length, limit long-context retrieval, gated linear recurrences

备注:

点击查看摘要

Abstract:Linear attention scales linearly with sequence length, but its finite-state memory can limit long-context retrieval. In gated linear recurrences, memory retention depends on state decay, which is shaped jointly by gate parameters A_log and dt_bias and by input activations. In controlled Gated DeltaNet (GDN) experiments, both parameters remain highly correlated with their initial values after training, highlighting the importance of initialization. Therefore, we introduce Dual-Axis Memory Initialization (DAMI), which jointly configures these parameters before training. DAMI assigns geometric timescales across heads for varied retrieval distances and a low-high-low input-sensitivity profile across layers. A small activation sample calibrates the GDN-family implementation to match both behavioral targets without adding trainable parameters. Across GDN, KDA, GDN2, Mamba-2, and RWKV-7, DAMI improves average RULER-style retrieval accuracy by 5.29 to 16.71 percentage points over the corresponding random-initialization baselines. Performance on language modeling, commonsense reasoning, and 2K real-world retrieval remains broadly comparable to those baselines. Our code is available at this https URL.

13. 【2610.41951】Aligning MLLMs with the Latent Structure of Human Cognition via Behavior-Derived Semantic Dimensions

链接:https://arxiv.org/abs/2610.41951

作者:Ning E,Changde Du,Yizhuo Lu,Huiguang He

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Multimodal Large Language, Large Language Models, Large Language, achieved impressive performance, Multimodal Large

备注:

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) have achieved impressive performance across a wide range of reasoning tasks, yet it remains unclear whether their internal representations and decision criteria align with the latent structure of human cognition. In this work, we propose a novel framework to align MLLMs with the multidimensional mental representations underlying human similarity judgements. We build on a previously established behavior-derived semantic embedding space, in which objects are represented along 66 interpretable dimensions derived from 4.70 million human Odd-One-Out (O1O) judgements. For each triplet, we infer the most salient decision dimension and convert it into a dimension-grounded linguistic rationale. This enables MLLMs to learn both the final choice and a justification consistent with the inferred behavioral criterion. Experimental results demonstrate that our approach improves model consistency with human similarity judgements while retaining competitive performance on standard multimodal benchmarks. Furthermore, using searchlight Representational Similarity Analysis (RSA) on an independent fMRI Natural Scenes Dataset (NSD), we observe increased representational alignment between model and human. Ultimately, our findings point to a data-driven route for incorporating human cognitive structure into MLLMs alignment. The code is available \href{this https URL}{here}.

14. 【2610.41905】Completeness and Cost of Retrieval Structures for Multi-Tool Requests in LLM Agents

链接:https://arxiv.org/abs/2610.41905

作者:Shuyang Zhang

类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词:LLM calls, tool retriever omits, queries, LLM, fulfill a request

备注: 17 pages, 3 figures, 9 tables

点击查看摘要

Abstract:An agent that must call several tools to fulfill a request fails when the tool retriever omits any one of them, yet tool retrievers are mostly built and evaluated on queries requiring a single tool. We compare representatives of six retrieval structures (flat lexical and dense retrieval, LLM query decomposition, LLM-navigated hierarchies, server-then-tool matching, dependency graphs, and trained set-level retrievers) across two multi-tool testbeds: 345 AppWorld queries with expert dependency labels and 103 MCP-Bench tasks over 257 MCP tools. We measure completeness@k, the share of queries whose entire required tool set appears in the top k, alongside the LLM calls, tokens, and latency that each structure incurs at retrieval time. A motivating analysis on all 7,961 ToolRet queries shows that aggregate completeness mixes two regimes: completeness at 10 is .58 to .67 on single-target queries and .08 to .17 on queries with four or more targets, and the ordering of retrievers on single-target queries reverses on multi-target ones. Across the two testbeds, none of the compared structures that is untrained on the testbed and makes at most one LLM call per query completes more than 10% of AppWorld queries at k = 16. The two structures that do better incur different costs: a set-level retriever trained on 75 to 90 in-domain queries reaches .33 on AppWorld and .58 on MCP-Bench with no LLM calls, while an LLM-navigated hierarchy reaches .30 and .40 with a median of 31 to 38 LLM calls and about five minutes per query. Their failure modes also differ: the trained retriever mostly ranks the missing tools just below the cutoff, whereas the hierarchy finds the target API and stops before collecting its prerequisites. In a downstream check with the official AppWorld agent, tasks with a complete retrieved set succeeded 21 of 21 times, whereas incomplete ones succeeded 2 of 39 times.

15. 【2610.41885】How Much Can Tool Calls Reveal About You? Privacy Leakage from Tool-Call Traces

链接:https://arxiv.org/abs/2610.41885

作者:Donghang Duan,Qingyu Liu,Yifei Liu,Na Zou,Xia Hu,Dongrui Liu

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词:Model Context Protocol, Large language model, Model Context, Context Protocol, Large language

备注: 24 pages, 12 figures, 8 tables, including references and appendices

点击查看摘要

Abstract:Large language model (LLM)-based agents interact with external tools through protocols such as the Model Context Protocol (MCP), producing tool-call traces that may expose behavioral signals about users. In this work, we systematically study the risk of user-profile inference from MCP tool-call traces, where observers infer user attributes from protocol-valid tool interactions without access to user conversations. We introduce PrivacyTrace, a benchmark containing 1,000 synthetic user profiles and 4,000 agent trajectories across four domains, generated with real MCP tools from 25 servers. Experiments with four mainstream LLM attackers show that tool-call traces enable a 26.25% attack success rate for profile inference, compared with 17.97% from prior-based guessing. Further analysis reveals that tool arguments and returned results provide the main trace-grounded evidence, while linking traces across sessions further amplifies profiling risk. These findings demonstrate that MCP tool-call traces can act as effective behavioral side channels for user profiling, motivating the development of privacy-aware mechanisms for agent-tool interactions. Code and data are available at this https URL.

16. 【2610.41883】xt as an Index for Zero-Shot Cross-Domain Knowledge Tracing

链接:https://arxiv.org/abs/2610.41883

作者:Yin Yi,Haiping Ma,Siyu Song,Ziwen Wang,Shangshang Yang

类目:Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

关键词:Knowledge tracing, Knowledge, question, text, question texts

备注: 10 pages, 5 figures

点击查看摘要

Abstract:Knowledge tracing (KT) predicts a student's next response from their history. New platforms often have question texts but no response logs for training, motivating zero-shot cross-domain KT. Existing transfer and cold-start methods use question semantics, but cross-platform semantic discrepancies limit transferability. We propose TIZSKT, which separates behavioral sequence modeling from domain-local historical evidence construction and uses text as an index rather than a directly transferable predictive representation. The Mastery-Dynamics Encoder learns correctness dynamics without question identifiers or text embeddings. Domain-Local Question Addressing builds fixed question addresses using a frozen text encoder and an unsupervised per-domain projection. The Text-Addressing Kernel uses these addresses to aggregate the current student's previous outcomes into a question-specific historical correctness summary. Cross-Segment Continuation retains access to earlier responses without extending the behavioral encoder's input sequence. Evidence-Volume Read-Out preserves the total kernel mass discarded by normalization and combines its log-compressed value with the behavioral state and historical correctness summary to predict the next response. All trainable parameters are learned from source domains; target inference uses public question texts and the current student's observed history without target-domain training. Leave-one-domain-out experiments on three public datasets show that TIZSKT achieves the highest mean AUC and accuracy among evaluated baselines on all target domains. Ablations confirm the contributions of text addressing and cross-segment continuation.

17. 【2610.41856】SimXAI: A Simple Drop-in Layer Increases Interaction Quality and Understanding in Conversational XAI

链接:https://arxiv.org/abs/2610.41856

作者:Van Bach Nguyen,Qianli Wang,Nils Feldhus,Jörg Schlötterer,Christin Seifert

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

关键词:template-based response generation, dialogue management, intent recognition, response generation, GUS-style architectures

备注: Accepted at EMNLP 2026 Findings

点击查看摘要

Abstract:Conversational explainable AI (ConvXAI) agents often use GUS-style architectures with separate modules for intent recognition, dialogue management, and template-based response generation. While faithful to the underlying XAI methods, these pipelines are hard to adapt and often struggle with context-dependent follow-up questions. We present SimXAI, a lightweight LLM-centric conversational layer that replaces these modules with a single tool-calling LLM that bridges access to existing XAI resources. Rather than a standalone agent, SimXAI serves as a modular interface that enables conversational access to external XAI resources. We further introduce an evaluation suite for single- and multi-turn parsing, faithfulness, and contextualization. Across existing and new datasets, SimXAI achieves strong function-selection accuracy and high faithfulness while better handling context-dependent requests. In a user study replacing only the conversational layer of TalkToModel, a representative GUS-based agent, users completed tasks more accurately and in fewer turn. Overall, SimXAI improves GUS-based design while preserving faithfulness and improving conversational quality.

18. 【2610.41855】Iterated Integrals as Lexical Fingerprints: Path Signature Embeddings for Lexical Similarity

链接:https://arxiv.org/abs/2610.41855

作者:Raj Shekhar Singh,Pratham Agarwal

类目:Computation and Language (cs.CL)

关键词:remains poorly understood, latent geometry implicitly, surface-level lexical properties, geometry implicitly encodes, implicitly encodes surface-level

备注: accepted in NeurIPS 2026 LP4FM Workshop

点击查看摘要

Abstract:While sentence embeddings are primarily designed for semantic generalization, their latent geometry implicitly encodes surface-level lexical properties, a relationship that remains poorly understood. Shallow pooling methods discard word order, while deep Transformer models obscure these lexical alignments behind computational complexity and uninterpretable spaces. We propose constructing sentence embeddings via the path signature of Word2Vec trajectories, leveraging the iterated integrals of rough path theory to create representations that explicitly capture sequential and lexical structure in a geometrically tractable manner. Through extensive ablations spanning Word2Vec dimensions, signature depths, and PCA compression, we correlate embedding distances against five lexical string metrics: Levenshtein, Jaro-Winkler, word Jaccard, phoneme Levenshtein, and character TF-IDF. We reveal that while average pooling almost entirely fails to capture character-level edit distances, path signatures strongly align with them, with depth 2 signatures optimally balancing character and word-level sensitivities. Furthermore, we demonstrate that the critical lexical variance is concentrated in a highly compact PCA subspace, and unlike pooling, signatures structurally preserve and quantify word order. These findings establish path signatures not as semantic generalizers, but as rigorous mathematical lenses that explicitly encode discrete lexical structures and word order, offering an interpretable alternative to opaque deep learning for lexical tracking.

19. 【2610.41785】Peeling the Matryoshka: Extracting Ontological Structure from Retrieval Embeddings

链接:https://arxiv.org/abs/2610.41785

作者:Eunchan Kim,Inwhee Joe

类目:Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词:yield unstable hierarchies, careful per-corpus tuning, expensive task-specific training, Matryoshka Representation Learning, Taxonomy construction

备注: Accepted to EMNLP 2026 (Main Conference). 13 pages, 6 figures, 7 tables. Code: [this https URL](https://github.com/Eunchan24/PEEL)

点击查看摘要

Abstract:Taxonomy construction is essential for knowledge-intensive NLP yet remains costly: clustering-based methods (i) need careful per-corpus tuning and yield unstable hierarchies, while LLM-based pipelines (ii) depend on expensive task-specific training that does not transfer across domains. We report an empirical finding that bears on both: in Matryoshka Representation Learning (MRL) embeddings, where each leading prefix is itself a usable, coarser vector, prefix length aligns with the coarse-to-fine granularity of gold taxonomies; shuffled- and reverse-dimension controls isolate the alignment to the learned early prefix dimensions. The pattern holds across three architecturally distinct MRL models. To test whether this regularity is usable, we introduce PEEL (Peeling Embeddings to Extract Latent ontologies): a minimal probe over these frozen embeddings, trained once with an order-embedding objective that represents hierarchy as vector containment; a minimum spanning arborescence then decodes taxonomic DAGs. Using only a concept vocabulary (no documents), PEEL recovers taxonomic DAGs with high structural fidelity on two OLLM benchmarks, transferring to a new domain with no target-edge supervision. The end-to-end OLLM pipeline, which jointly discovers concepts and induces structure from document corpora, is reported as a cross-task reference. Pre-trained retrieval embeddings encode a decodable granularity gradient; a minimal probe renders it as explicit parent-child (is-a) structure.

20. 【2610.41769】Stepwise-Querying: Distilling Reasoning without Access to Teacher Chain-of-Thought

链接:https://arxiv.org/abs/2610.41769

作者:Dicong Yu,Wenhua Wang,Tian Wang

类目:Computation and Language (cs.CL)

关键词:large language models, capabilities of large, large language, language models, models to smaller

备注: 15 pages, 7 figures, including appendices

点击查看摘要

Abstract:Reasoning distillation is widely used to transfer the reasoning capabilities of large language models to smaller students through teacher-generated supervision. In the black-box setting, however, teachers may expose only final answers and brief solutions, leaving intermediate calculations and validity conditions unavailable and thus limiting the reasoning supervision available for distillation. We propose Stepwise Querying, which elicits step-specific explanations without requiring access to the teacher's internal chain-of-thought (CoT) traces. Independent queries to the same teacher request intermediate derivations, validity checks, and corrections for individual steps, the assembled solutions are then used for standard supervised fine-tuning. Across two teachers, two students, and four mathematics and code benchmarks, our method achieves the highest score in 14 of 16 comparisons with three baselines. We further introduce Stepwise Explanation Information Gain (SEIG), a diagnostic based on the log-ratio of a frozen student's probabilities of correct step completion under stepwise and global explanations. Analyses on GSM8K show that incorrect-answer trajectories can remain useful when they preserve valid intermediate reasoning, while further decomposition yields limited additional gains.

21. 【2610.41743】ask Vectors Can Be Linearly Decomposed into Interpretable and Controllable Components

链接:https://arxiv.org/abs/2610.41743

作者:Yukiya Horiba,Hakaze Cho,Takahiro Yakoh

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:structure poorly understood, steer large language, Task Vectors, large language models, internal functional structure

备注:

点击查看摘要

Abstract:Task Vectors (TVs) provide a compact way to steer large language models, but they are typically treated as atomized directions merely extracted from hidden states, leaving their internal functional structure poorly understood. Motivated by prior work that decomposes in-context learning into Task Recognition (TR) and Task Learning (TL), we ask whether a single TV can likewise be decomposed into functionally meaningful components. We formulate a TR/TL-based decomposition from candidate-label unembeddings, separating each TV into TR, TL, and residual components, and try to optimize the TR and TL coefficients using Bayesian optimization for more effective intervention. We evaluate this formulation across multiple model families, classification tasks, and both instruction- and demonstration-based TVs. Across these settings, TR/TL-based optimization identifies intervention directions that outperform the original TVs. Although optimization over random directions can also improve performance, TR/TL-based search yields more reliable gains, particularly for instruction-based TVs. Moreover, isolated interventions on the decomposed components produce distinct logit-level effects that are consistent with their intended functional roles. Together, these results suggest that TVs are not monolithic steering directions, but can be decomposed into functionally meaningful components that support both interpretation and control.

22. 【2610.41733】Leakage-Controlled Structure-Preserving Augmentation and Template-Aware Evaluation for Bangla Symptom-Based Disease Prediction

链接:https://arxiv.org/abs/2610.41733

作者:Sabah Nushra,Shovan Samanta Turzo,Moinul Hossain,Md Kishor Morol

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:Bangla symptom-based disease, symptom-based disease prediction, Bangla symptom-based, imbalanced structured benchmark, imbalanced structured

备注: 6 pages, 5 figures, 5 tables

点击查看摘要

Abstract:Bangla symptom-based disease prediction is commonly evaluated on a small, imbalanced structured benchmark containing many profiles that differ by only one or two symptoms. We test whether train-only asymmetric Bernoulli perturbation improves classification using 725 unique profiles spanning 85 diseases and 172 binary symptoms. Experiments use ten repeated real-profile holdouts and parent-grouped inner cross-validation. The 2 x 2 design separates augmentation from hyperparameter tuning, with exact duplication, random oversampling, class weighting, and SMOTEN as balancing controls. For Bernoulli Naive Bayes (BNB), the gain over tuned raw training does not withstand Holm correction, although BNB attains the highest mean accuracy (97.50%). The boosted-tree models benefit substantially: XGBoost, LightGBM, and CatBoost improve by 18.10, 28.45, and 10.09 percentage points, respectively. A Hamming-distance audit places 91.0% of standard held-out profiles within one symptom bit of the training data. Accuracy decreases on a same-disease 1-bit-purged challenge; nevertheless, XGBoost and LightGBM retain large augmentation gains. We also evaluate robustness to missing and spurious symptoms and the faithfulness of BNB explanations. Overall, Bernoulli perturbation is useful for some model families, but benchmark accuracy should be interpreted together with template proximity.

23. 【2610.41732】From Training Exposure to Membership Evidence: A Controlled Study of OLMo 2

链接:https://arxiv.org/abs/2610.41732

作者:Ali Banaei,Muhammad Shahab Shahzad,Gerald Q. Maguire Jr.,Marco Chiesa,Dejan Kostić

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:matters for copyright, benchmark contamination, language models collect, language model, language models

备注: 20 pages, 11 figures. Code: [this https URL](https://github.com/ali-bana/OLMo-Twin)

点击查看摘要

Abstract:Whether a language model was trained on a document matters for copyright, privacy, and benchmark contamination. Yet most membership-inference (MI) evaluations on language models collect members and non-members after the fact, so success may reflect distribution shift and failure is inconclusive. We re-ran OLMo 2 1B's official 50-billion-token mid-training stage, replacing selected training chunks with documents from 7,814 pairs matched on domain and difficulty. For each pair, a coin flip determined which document was inserted and which was held out. The run released by the Allen Institute for AI (AI2) from the same seed saw identical data everywhere else and serves as the counterfactual. One exposure raises a previously unseen document's likelihood on average but rarely identifies it. Using the counterfactual as reference, the reference ratio has an area under the ROC curve (AUC) of 0.767 but, with one threshold across domains, catches 3.8% of members at a 1% false-positive rate (FPR). In contrast, 13 matched pairs give a paired test 80% power at the 5% level to detect training on a collection, given same-domain non-members and a close reference. A reference trained with another seed recovers 92% of the counterfactual's AUC advantage over chance, whereas reference-free attacks stay within 0.07 of chance when pooled over domains. The full official post-training recipe, re-run on both models, leaves 89% of the average effect. Even with a closely matched reference, substantial document-level variability limits individual membership inference. We will release the checkpoints, per-token log-probabilities, and the evaluation documents; the code is available at this https URL.

24. 【2610.41720】UpLoop: Training Looped Transformers via Upcycling at No Extra Pretraining Compute

链接:https://arxiv.org/abs/2610.41720

作者:Cheng Liang,Tengfei Zhang,Ya Zhang,Yanfeng Wang,Zhouhan Lin

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:adding independent parameters, adding independent, train looped Transformers, shared weights, looped Transformers

备注:

点击查看摘要

Abstract:Looped language models can strengthen reasoning through repeated computation with shared weights, increasing execution depth without adding independent parameters. However, each additional pass increases training floating-point operations (FLOPs), making these gains more expensive to obtain. To address this cost, we propose UpLoop, a pretraining schedule that uses upcycling to train looped Transformers while exactly matching a standard dense baseline in final parameter count, total training tokens, and training FLOPs. Specifically, UpLoop begins with a shallow Transformer, progressively grows its depth by copying learned layers, and uses the computation saved early to support repeated execution of a shared middle block later in training. Experiments across model scales show improvements in language modeling and downstream performance, with the average score across 22 downstream tasks increasing from 22.99 to 27.52 at 1.3B parameters. These gains also extend to mathematical reasoning after supervised fine-tuning.

25. 【2610.41704】GraphNIAH: A Benchmark for Long-Context Reasoning over Real-World Graphs

链接:https://arxiv.org/abs/2610.41704

作者:Minh-Nam Tran,Abulhair Saparov

类目:Computation and Language (cs.CL)

关键词:existing NIAH benchmarks, find small relevant, small relevant facts, benchmark contamination, input text

备注:

点击查看摘要

Abstract:The needle-in-a-haystack (NIAH) benchmark was introduced as a test for measuring a model's ability to find small relevant facts within a very large body of input text. However, existing NIAH benchmarks each suffer from one or more of the following limitations: (1) reliance on synthetic data, so their evaluations may not generalize to real-world settings; (2) reuse of previously published datasets, leading to the risk of benchmark contamination; (3) dependence on manual annotation, which requires human effort to create and update data and is prone to future benchmark contamination; and (4) unrealistic simplification of long-context multi-hop reasoning where each next step is trivial given previous steps, while real-world reasoning often requires planning over multiple possible proof paths. To address these limitations, we introduce \Benchmark, a dynamic benchmark built from real citation relationships among scientific papers published after the evaluated models' knowledge cutoff date, which utilizes real-world information while ensuring no benchmark contamination. The fully automated benchmark construction pipeline samples representative subgraphs of the citation graph formed by these papers and converts each subgraph into a long-context QA example with a verifiable answer. We use GraphNIAH to evaluate eight LLMs from the GPT-5.6, Gemini-3, and Qwen3.5 families. We find that accuracy falls as questions require longer reasoning paths: at question depths of 16 and 32, the GPT-5.6 and Qwen3.5 models answer YES/NO questions no better than random guessing, mostly by answering NO; four of the eight models answer no counting example correctly, and the others model get worse as the subgraph size increases. These findings suggest that current LLMs often stop searching the citation relationships in their context before they reach the answer, even though every fact they need is in the context.

26. 【2610.41698】Precision--Recall Trade-off on the Inference Level for LLMs in Grammatical Error Correction

链接:https://arxiv.org/abs/2610.41698

作者:Ryszard Staruch,Filip Graliński

类目:Computation and Language (cs.CL)

关键词:Grammatical Error Correction, achieving strong performance, Large language models, Large language, Error Correction

备注: 17 pages, 2 figures, 13 tables

点击查看摘要

Abstract:Large language models (LLMs) have recently been adopted for Grammatical Error Correction (GEC), achieving strong performance via both full fine-tuning and prompt-based approaches. As probabilistic sequence models, LLMs expose inference-time parameters that directly modify token generation behavior; however, their potential for controlling GEC-specific trade-offs has not been systematically studied. In this work, we investigate decoding strategies for grammatical error correction. We show that the repetition penalty parameter enables controllable adjustment of the precision--recall trade-off at inference time, without modifying the model architecture, training procedure, or prompt. Through experiments on standard GEC benchmarks, we demonstrate that repetition-penalty-based decoding enables inference-time control of the precision--recall balance, conceptually related to methods previously proposed for sequence-to-sequence GEC models, such as Align-and-Predict Decoding (APD), while remaining simple and broadly applicable to existing LLMs that expose inference-time decoding penalties.

27. 【2610.41697】SBPO: Tree-Structured Branching for Policy Optimization in Interactive Language Agents

链接:https://arxiv.org/abs/2610.41697

作者:Rui Yu,Chong Mu,Jinchuan Zhang

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:assign delayed feedback, aggregate token losses, interactive language agents, feedback to decisions, multi-token actions

备注:

点击查看摘要

Abstract:Training interactive language agents from terminal outcomes poses three coupled problems: which task and state continuations to sample, how to assign delayed feedback to decisions, and how to aggregate token losses for multi-token actions. We present TSBPO, a tree-structured sampling-to-update paradigm that addresses these problems within one training loop. A likelihood-fitted Root/Branch allocator uses retained task and state evidence to target continuations likely to produce contrasting terminal outcomes under fixed rollout budgets. On the resulting replayed physical trees, trajectory advantages compare immediate sibling segments, while observation-group step advantages compare outcomes at matched task/observation states. The actor then sums clipped token surrogates over each complete response and normalizes across active turns, avoiding response-length averaging in the policy-gradient term. With a Qwen2.5-1.5B actor, fixed checkpoints obtain 97.79% seen and 96.64% unseen stochastic success on ALFWorld and an 81.07% per-episode success rate over six stochastic episodes for each of the 500 WebShop test goals. A WebShop step-term ablation yields 75.93% at the same update-100 evaluation; an ALFWorld aggregation comparison shows higher observed command validity with complete-turn weighting. These results support the evaluated training configuration on two interactive benchmarks.

28. 【2610.41691】Does Reasoning Make Language Models Agree?

链接:https://arxiv.org/abs/2610.41691

作者:Mila Gorecki,Moritz Hardt

类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词:Language models face, make conflicting decisions, Language models, equally accurate models, accurate models make

备注:

点击查看摘要

Abstract:Language models face two opposing concerns: monoculture, in which models err in correlated ways, and multiplicity, in which equally accurate models make conflicting decisions. The rise of reasoning models has complicated this debate: On the one hand, reasoning may increase model agreement if models anchor on the same salient features or follow similar reasoning paths. On the other hand, stochastic reasoning traces may introduce additional branch points leading to more diverse predictions. We resolve this tension by distinguishing reasoning as an intervention from reasoning as an observed behavior. We compare agreement under controlled changes in reasoning effort with agreement across observed reasoning lengths, measuring both against the agreement expected from model accuracy. Across nine models from two developers and three classification tasks, enabling reasoning increases agreement between models evaluated on the same individuals. Yet the individuals who elicit longer reasoning traces receive less consistent predictions across models. Both patterns persist after accounting for differences in accuracy. Asking models to reason more thus promotes agreement, while observing them reason longer signals disagreement.

29. 【2610.41661】When Steering Shifts Discourse: Identifying and Intervening on Discourse-Level Changes due to Activation Steering in LLMs

链接:https://arxiv.org/abs/2610.41661

作者:Shivam Adarsh,Hetianyu Huang,Lau Safin,Maria Maistro,Christina Lioma

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:large language model, input prompt, language model, model weights, residual-stream activations

备注:

点击查看摘要

Abstract:Activation steering is an inference-time technique used to control or modify the behavior, tone, or safety properties of a large language model (LLM) without retraining the model's weights or editing its input prompt, but simply by adding a vector to its residual-stream activations. However, activation steering also changes the generated text in unintended ways, unrelated to intended behavior change, that are not well understood. Prior work has measured these changes only through coarse signals such as perplexity. In this work, we show that steering systematically produces significant changes in discourse dimensions of the generated text, such as its formality, use of evidence, and ambiguity. We present a way of countering this by adding a second, complementary vector that targets the affected discourse dimension. This intervention restores about 78% of the unintended discourse changes while preserving the intended steering behavior in about 93% of the generations.

30. 【2610.41629】GRIT: Gradient Masking for Visually Misgrounded Tokens in Text-Rich Reasoning

链接:https://arxiv.org/abs/2610.41629

作者:Chanseul Cho,Noori Bae,Dongheon Lee,Youngmin Ro

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:effectiveness remains limited, Reinforcement learning, learning with verifiable, recently been extended, extended to vision-language

备注: Accepted to WACV 2027

点击查看摘要

Abstract:Reinforcement learning with verifiable rewards (RLVR) has recently been extended to vision-language models (VLMs), yet its effectiveness remains limited for text-rich reasoning tasks. We highlight a key factor contributing to this limitation: models frequently arrive at correct final answers despite misperceiving visual information during intermediate steps. We define this phenomenon as Correct-but-Visually-Misgrounded Reasoning (CVMR). Because standard RLVR rewards only final-answer correctness, it fails to differentiate between properly grounded and misgrounded reasoning, reinforcing both equally. Through token-level analysis, we reveal that CVMR tokens exhibit distinct attention patterns that differ systematically from well-grounded ones. Based on this observation, we propose GRIT, a training framework that incorporates visual grounding into RLVR to mitigate the impact of CVMR. Furthermore, to address the lack of text-rich reasoning benchmarks that allow for systematic evaluation across text length and reasoning depth, we introduce GRIT-Bench. Experiments demonstrate that GRIT significantly improves both reasoning accuracy and grounding fidelity over existing RLVR methods.

31. 【2610.41576】Saidzoda-Tajik-LFM-2.6B: Adapting a 2.6B Hybrid Model to Tajik Tool Calling, and What Continued Pretraining Takes Away

链接:https://arxiv.org/abs/2610.41576

作者:Tohir Saidzoda,Nekruz Maxudov,Bedil Karimov,Abubakr Abdullozoda,Amin Jalilov,Jonibek Kishvarov,Rahmonali Sharipov,Mariyamkhon Shodyeva

类目:Computation and Language (cs.CL)

关键词:Tajik, modest hardware, Tajik tool calls, Tajik adaptation, Belebele Tajik shows

备注: 12 pages, 9 tables, 3 figures. Technical report. Model: [this https URL](https://huggingface.co/Tohirju/Saidzoda-Tajik-LFM-2.6B)

点击查看摘要

Abstract:We release Saidzoda-Tajik-LFM-2.6B, a Tajik adaptation of the 2.6B-parameter hybrid model LFM2.5-2.6B-Base, built for tool calling in Tajik on modest hardware. The recipe has two stages: LoRA continued pretraining (CPT) on 1,485,319 cleaned Tajik web documents for 3 epochs, then one epoch of supervised fine-tuning (SFT) on a mix of machine-translated Tajik tool calls, English tool calls kept as replay, and Tajik instructions. On a 174-item tool-calling test set built from BFCL v3 and machine-translated to Tajik, strict full-call accuracy on Tajik prompts rises from 20.69 for the base model to 64.14 (paired difference +43.45 points, 95% interval +35.2 to +51.7); a lenient parser that also accepts the base model's own call formats puts the base at 31.72. English shows no detectable change (76.55 and 77.24). Every CPT checkpoint scores zero: CPT removes the native tool-call format and, as the lenient re-scoring shows, part of the skill itself. Outside tool calling, accuracy on a Tajik knowledge benchmark rises from 28.0 to 35.0, Belebele Tajik shows no significant change, and English MMLU falls from 60.8 to 52.5. The model is not a general Tajik assistant. It almost never declines when no tool fits (6.9% correct on Tajik, against 31.0% for the base under the lenient parser), it is weak at multi-turn calls, and its calls should be checked before they are executed. We describe the data, the training settings and every evaluation in enough detail to repeat them.

32. 【2610.41574】BYOD: Build Your Own DLM - Efficient Autoregressive-to-Diffusion Language Model Conversion

链接:https://arxiv.org/abs/2610.41574

作者:Ruurd J.A. Kuiper,Robert A. Bagheri

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:leading systems rely, Unlike autoregressive, permit parallel token, parallel token updates, permit parallel

备注: 21 pages, 8 figures. Code: [this https URL](https://github.com/RuurdKuiper/BYOD) ; Gemma demo: [this https URL](https://huggingface.co/spaces/Ruurd/byod-gemma-2-9b) . Links to all four demos are included in the paper

点击查看摘要

Abstract:Unlike autoregressive (AR) models, diffusion language models (DLMs) permit parallel token updates, flexible generation, and bidirectional attention, but leading systems rely on costly pretraining or full-model fine-tuning. We present Build Your Own DLM (BYOD), a generalizable LoRA-only recipe for parameter-efficient AR-to-DLM conversion. Without architecture-specific tuning, BYOD induces diffusion generation in Gemma 2 9B, Llama 3.1 8B, Qwen2.5 7B, and Ministral 8B; to our knowledge, this is the first reported AR-to-DLM conversion of a Mistral model. The adapters comprise 4.1-5.8% of final parameters while every base-model parameter remains frozen; each 25,000-iteration conversion needs at most 102.4M tokens, processed in 3.1-4.0 hours on one Google Colab GPU. All four models generate from fully masked sequences, use bidirectional context in a controlled attention test, and retain substantial parent-model knowledge. BYOD-Gemma is the strongest BYOD conversion on our nine-task evaluation, reaching 50.6% average accuracy compared with 51.9% for LLaDA 8B Instruct in the same harness. Open-generation quality at low network function evaluation (NFE) budgets remains the principal limitation: BYOD perplexity is 8.3-11.1 versus 4.1 for LLaDA and 2.2-3.0 for the AR parents when generating 128 tokens in 64 steps. To enable further experimentation and inspection, we provide a standalone training and evaluation implementation and interactive demos for all four conversions. BYOD thus provides a practical route for extending diffusion generation to other existing model families while identifying the gap that efficient conversion must next close.

33. 【2610.41562】SCRBench: Beyond Equivalence Checking for Semantic Change Reasoning in Code

链接:https://arxiv.org/abs/2610.41562

作者:Omid Saghatchian,Ali Mahzoun,Khashayar Etemadi,Saeed Reza Kheradpisheh

类目:oftware Engineering (cs.SE); Computation and Language (cs.CL)

关键词:code, affect program semantics, semantic, core aspect, sequences of code

备注: 17 pages, including references and appendices

点击查看摘要

Abstract:Understanding how code changes affect program semantics is a core aspect of code reasoning in language models. It is commonly evaluated by asking whether two programs are semantically equivalent, but a yes/no answer does not reveal whether a model knows which code change caused a semantic difference, or which sequence of code changes produced the modified program. We study two tasks that ask these questions directly, diagnosing semantic change and reconstructing sequences of code changes, alongside detecting semantic equivalence. We build SCRBench, 67,658 Python program pairs generated by applying sequences of code changes that preserve or alter program semantics, and evaluate five language models on a stratified subset of 4,500 pairs. Detecting semantic equivalence exposes weaker models, whose accuracy declines as changes accumulate, but the strongest models remain near the ceiling. Diagnosing semantic change reveals weaknesses that equivalence accuracy hides: a model with 94.71% equivalence accuracy diagnoses only 54.44% of semantic changes. Reconstructing sequences of code changes is much harder: the best model reconstructs the exact sequence for only 39.27% of pairs, and no model exceeds 1.11% when five changes are applied. High equivalence accuracy therefore overestimates how well models reason about the semantic effects of code changes.

34. 【2610.41561】Digital sovereignty in professional translation workflows: a case study of migrating from Windows to Linux

链接:https://arxiv.org/abs/2610.41561

作者:Michael Farrell

类目:Computation and Language (cs.CL)

关键词:computer-assisted translation tools, study examines digital, workstation from Windows, translation management systems, computer-assisted translation

备注: 14 pages, submitted for formal peer review at the 47th Translating and the Computer conference (Luxembourg) 8/10 December 2026

点击查看摘要

Abstract:This study examines digital sovereignty in professional translation through a screening of computer-assisted translation tools and translation management systems, and a case study of migrating a translator's workstation from Windows to Linux. The framework combines three principles - Control, Continuity and Exit - with three practical requirements: native Linux operation, independence from mandatory external services, and independent access to essential data and resources. Drawing on documentary evidence and the limited number of responses received from providers, the ecosystem screening distinguishes Linux accessibility from operational independence: browser-based platforms may remain dependent on provider-controlled infrastructure. The migration case demonstrates the feasibility of reconstructing one professional workflow around a locally operable Linux core, using LoopCAT, LibreOffice and locally run TranslateGemma, alongside tools for optical character recognition, communication, credential management and backup. Selected cloud services remained available where needed. The findings suggest that digital sovereignty depends on how workflow dependencies are organized, rather than on individual applications or operating systems. It does not require technological isolation, but meaningful control over essential components, continuity of work and practical exit options. The framework is tailored to the case examined here and may require adaptation to other professional workflows.

35. 【2610.41553】CEFR Level Assessment across Languages and Text Granularities

链接:https://arxiv.org/abs/2610.41553

作者:Eugene Matsumura,Yuki Arase

类目:Computation and Language (cs.CL)

关键词:natural language processing, educational natural language, textual CEFR levels, language processing, Automatic assessment

备注: 8 pages, 2 figures, 5 tables

点击查看摘要

Abstract:Automatic assessment of textual CEFR levels is an important task in educational natural language processing. However, accurate CEFR level prediction remains challenging due to the naturally imbalanced distribution of CEFR levels and the ambiguous boundaries between adjacent levels. To address these challenges, we propose a unified training objective that combines focal loss with supervised contrastive learning. Focal loss mitigates class imbalance by emphasizing underrepresented and difficult examples, while supervised contrastive learning learns more discriminative representations by encouraging intra-class compactness and inter-class separation. We evaluate the proposed method on sentence- and document-level CEFR assessment in both monolingual and multilingual settings. Experimental results demonstrate that our method consistently outperforms strong baselines across all settings, establishing new state-of-the-art performance on multiple CEFR assessment benchmarks.

36. 【2610.41552】Enhancing Knowledge Entity Relation Extraction in Abstracts and Full-text Content of Academic Articles Using Large Language Models

链接:https://arxiv.org/abs/2610.41552

作者:Yingyi Zhang,Chengzhi Zhang

类目:Computation and Language (cs.CL); Digital Libraries (cs.DL); Information Retrieval (cs.IR)

关键词:entity relation extraction, large pre-trained language, knowledge entity relation, pre-trained language models, relation extraction

备注:

点击查看摘要

Abstract:This study investigates the effectiveness of large pre-trained language models (LLMs) for knowledge entity relation extraction (KERE) from academic papers. Existing studies have examined individual types of LLM-based strategies and evaluated model performance using metrics such as precision and recall. To provide a broader evaluation, this study investigates multiple strategies, including closed-source LLM-based CoT prompting, LoRA-adapted open-source LLMs, LLM-enhanced small pre-trained language models (SLMs), and SLM-enhanced closed-source LLMs. In addition, this study introduces two strategies, namely SLM-enhanced open-source LLMs and closed-source LLM-enhanced open-source LLMs. These strategies are evaluated from multiple perspectives, including metrics, their ability to mitigate errors observed in SLMs, and potential directions for model optimization. This study manually constructs two annotated datasets in the NLP domain, covering Abstract and Full-Text datasets. Experimental results show that the LoRA-adapted T5 model achieves the highest macro F1 scores of 0.7408 and 0.7013 on the Abstract and Full-Text datasets, respectively. SLMs also benefit from LLM-generated entity descriptions under the LLM-enhanced SLM strategy. Error analysis further reveals that the effectiveness of LLM-based strategies in mitigating SLM errors varies across error types. Based on the identified limitations and error patterns of these strategies, several optimization directions are proposed. In addition, combining strategies with different error patterns further improves KERE performance.

37. 【2610.41536】DAPS: Dependency-Aware Premise Selection for LLM Theorem Proving

链接:https://arxiv.org/abs/2610.41536

作者:Zixuan Chen,Wenyuan Jiang,Junling Wang,Mrinmaya Sachan,Yinya Huang

类目:Logic in Computer Science (cs.LO); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:newly contributed lemmas, popular foundational lemmas, leverage newly contributed, contributed lemmas, foundational lemmas

备注:

点击查看摘要

Abstract:LLM-based theorem proving in Lean 4 has advanced rapidly, but provers are difficult to leverage newly contributed lemmas, because retrieval skews toward popular foundational lemmas, leaving the right premises buried among hundreds of thousands of candidates. Existing neural selectors rank candidates by semantic similarity, with three intrinsic limitations: frequency-skewed retrieval, isolated pairwise ranking, and degradation on out-of-distribution queries such as competition problems and informal language. Given that mathematics is structured by dependencies rather than similarities, we restore this signal to both the training data and the model. We curate two underused dependency resources. We conduct the first systematic mining of 53 Lean Blueprint projects, a previously untapped corpus of 3,805 manually curated informal+formal nodes that capture rare, research-level premises absent from Mathlib4. We further pair it with the extraction of comprehensive, typed, multi-level Mathlib4 dependencies. We then introduce DAPS, a dependency-aware premise selector with a structural neighborhood encoder, a group-level contrastive objective, and a Mathlib-then-Blueprint adaptation procedure. DAPS reaches mean Recall@32 of 89.25 on Mathlib4-Heldout (+11.41 over the strong selector LeanHammer), and maintains this lead on two out-of-distribution benchmarks. Further experiments demonstrate that DAPS premises improve theorem proving on miniF2F and IMO-ProofBench. Project page: this https URL.

38. 【2610.41518】Enhancing Sentiment Classification on Small Datasets through Data Augmentation and Transfer Learning

链接:https://arxiv.org/abs/2610.41518

作者:Mahmoud S. Mayaleh,Samer A. Mayaleh

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:Small-scale sentiment classification, Small-scale sentiment, Easy Data Augmentation, Logistic Regression, Random Forest

备注:

点击查看摘要

Abstract:Small-scale sentiment classification often suffers from data scarcity, which limits the generalization ability of the models. This study evaluates and compares the effectiveness of three data augmentation strategies: Easy Data Augmentation (EDA), back-translation, and contextual token substitution (nlpaug-style), with both traditional machine learning classifiers (Logistic Regression, Random Forest) and transformer-based models (BERT). We perform a comprehensive empirical comparison with low-resource sentiment datasets by summarizing the results of recent studies and performing targeted head-to-head experiments. Our findings indicate that all augmentation methods improve performance. Contextual augmentation yields the most consistent gains for BERT models, while EDA and back-translation provide greater benefits for traditional classifiers. These insights help guide the selection of data augmentation techniques tailored to model type and dataset size, filling a critical gap in research on data augmentation for sentiment classification on small datasets.

39. 【2610.41487】Sparse Text Diffusion under Dual Budgets: Context Connectivity and Expert Activation

链接:https://arxiv.org/abs/2610.41487

作者:Alexandros Christoforos,Chadbourne Davis,Paul Raj

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Long-context diffusion repeatedly, diffusion repeatedly pays, Long-context diffusion, diffusion repeatedly, repeatedly pays

备注:

点击查看摘要

Abstract:Long-context diffusion repeatedly pays for both token interaction and feed-forward computation. We formulate these costs as two separate budgets: the edges available to an attention graph and the experts activated for each token. This view connects local, dilated, and global attention with conditional expert computation without assuming that sparsity alone preserves document-level information. We specify normalized masked attention, distinguish denoising depth from sampling iterations, and derive graph and compute bounds. A reported sparse-expert configuration, denoted DualBudget, is analyzed across scientific summarization, multi-hop question answering, dialogue, and sentence-pair prediction. All supplied table measurements are retained. The length study shows gains over the listed baselines through 16K, together with measurable degradation as length increases. Ablations reveal mixed changes across the three reported scores, while the cost record indicates a 20% reduction relative to DiffuSeq under an unspecified timing convention. The analysis separates these observations from unmeasured claims about training speed, absorbing states, global coherence, and deployment memory.

40. 【2610.41482】KEEPER: Learning Control-Sufficient Textual Memory for Long-Horizon LLM Agents

链接:https://arxiv.org/abs/2610.41482

作者:Jinkyeong Choi,Chaebin Jeong,Junsung Jeon,Donghyeon Park

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:establish memory reliability, carry earlier errors, carry earlier, Recursive textual memory, memory reliability

备注:

点击查看摘要

Abstract:Recursive textual memory can carry earlier errors into later updates, yet task performance alone does not establish memory reliability. We define self-consistency bias as the persistence of incorrect claims already present in the incoming memory. We present KEEPER, a comparative analysis of four auxiliary objectives along information-content and update-sensitivity axes within a shared recursive interface, examining how supervision targets relate to agent performance. Among evaluated conditions, reward-related prediction achieve the highest task performance before and after offline reinforcement learning, outperforming joint supervision. A claim-level analysis of one baseline trajectory documents error persistence despite corrective observations. Together, these analyses motivate evaluating error persistence and valid-information retention alongside task outcomes.

41. 【2610.41480】KV-Cache Patching: Tracing How and Where Fine-Tuned Behaviors Arise

链接:https://arxiv.org/abs/2610.41480

作者:Jonas Loos,Oliver Eberle

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Fine-tuning a language, fine-tuned behavior instantiated, behavior instantiated, language model, model behavior arises

备注: Interpretability as a Science Workshop at NeurIPS 2026. Project page: [this https URL](https://jonasloos.github.io/kv-patching)

点击查看摘要

Abstract:Fine-tuning a language model changes how it responds, but where is this fine-tuned behavior instantiated? To better understand this, we evaluate whether the change in model behavior arises only during the generation of the answer tokens where the change manifests, or whether altered processing of previous tokens causes it via the attention mechanism. For this, we patch the KV cache from a LoRA fine-tuned model into the unmodified base model, and vice versa. Our results show that for some behaviors, like responding in German or emergent misalignment, patching the KV cache can indeed transfer them from the fine-tuned to the base model. Correspondingly, patching the KV cache from base to fine-tune can partially or fully remove fine-tuned behavior. Furthermore, we find that the effect of patching grows with how much of the KV cache is patched and concentrates at a few pivotal positions, with system-prompt and chat-template tokens having disproportionate influence.

42. 【2610.41437】A prospective randomized study of patient-centered AI for clinical visit preparation

链接:https://arxiv.org/abs/2610.41437

作者:Xincheng Tan,Matthew Thompson,Xiang Ji,Angelica Willis,Will Vaughan,Roma Ruparel,Michael A. Sanchez,Sean Chang,Joseph Xu,Bhavna Daryani,Preeti Singh,Pinal Bavishi,Kejia Chen,Fan Zhang,Priya Gupta,Ernest Lim,Christina Chen,Bob Lou,Dimitrios Antos,Zach Wasson,Ray Luo,Fadi Yousif,Florence Thng,Mark Malhotra,Joseph Breda,Daniel McDuff,Kavi Goel,Katherine Chou,Dale R. Webster,Avinatan Hassidim,Yossi Matias,Po-Hsuan Cameron Chen,Yun Liu,Mike Schaekermann,Quang Duong,Jackie M. Barr

类目:Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:visit preparation agent, time-constrained clinical visits, turn to general-purpose, clinical visits unsure, visit preparation

备注: 50 pages (16 main text, 34 appendix), 6 figures

点击查看摘要

Abstract:Patients often arrive at brief, time-constrained clinical visits unsure of what to expect or ask, and millions of adults now turn to general-purpose AI chatbots to prepare beforehand. Yet whether conversational AI improves visit readiness remains unclear. We designed a large language model (LLM)-based visit preparation agent to guide patients before an appointment by gathering clinical context, setting visit expectations, providing relevant health information, building a prioritized list of questions for their clinician, and generating a summary. In a prospective consented randomized study in the Google Health app, 802 U.S. adults held 866 health-related conversations with the visit preparation agent (standard or concise variant) or a minimally prompted control chatbot built on the same LLM. The visit preparation agent significantly outperformed the control across blinded clinician evaluations and patient self-reports. In clinician reviews of completed sessions (n = 272), the agent achieved a 16.6% higher rate of comprehensive preparation (67.2% vs. 50.6%; P 0.05) and an 8.5% higher rate of alignment with patients' health context (98.9% vs. 90.4%; P 0.01), while maintaining high medical safety and appropriateness across all study arms. Patient post-surveys (n = 460) showed 16.8% higher visit preparedness (73.8% vs. 57.0%; P 0.01), 14.3% higher confidence in knowing what to ask (81.4% vs. 67.1%; P 0.01), and 12.0% higher overall satisfaction (74.0% vs. 62.0%; P 0.05). Clinician and participant metrics were not significantly correlated, indicating that expert review and patient self-assessment capture complementary dimensions of patient-facing AI. These findings suggest that LLM chatbots can safely help patients prepare for clinical visits, with greater benefit when following a structured workflow, and motivate future studies on in-visit communication and clinical outcomes.

43. 【2610.41435】BlindToChange: AI Agents Can Find Changes When Asked But Do They Look When Needed?

链接:https://arxiv.org/abs/2610.41435

作者:Anirudh Phukan,Tanya Goyal,Danish Pruthi

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:real time, web broadly, broadly and deeply, deeply in real, tempting to conclude

备注: Preprint

点击查看摘要

Abstract:Given that AI agents can search the web broadly and deeply in real time, it is tempting to conclude that their outputs account for recent world events. We show that this conclusion does not hold in practice. While agents can search and easily find recent changes, the correctness of their responses depends on whether they search and what they search for. Popular agentic search benchmarks like BrowseComp cannot expose failures wherein agents do not recognize their own assumptions that should be verified, since these benchmarks explicitly state what needs to be found. In contrast, many user requests state only the final information need (e.g., an itinerary for a trip), leaving the agent to discover relevant changes (e.g., the temporary closure of a museum) and account for their consequences. To highlight such gaps, we introduce BlindToChange, a benchmark that measures whether agents proactively discover recent events that affect their responses. Our benchmark comprises requests for recommendations where an obvious candidate is no longer applicable due to a recent real-world event. These events are drawn automatically from Wikidata, allowing BlindToChange to be periodically refreshed. Strikingly, we find a big gap -- as high as 27.5 points, even at high reasoning effort -- in systems' performance, when the recent event is not explicitly mentioned compared to when we ask about it directly. Analyzing search trajectories, we learn that more than half of the failures can be attributed to the fact that agents do not directly search to verify whether a relevant fact has changed. Our benchmark highlights, and tracks, a new axis of progress, wherein systems account for recent information that is not explicitly mentioned in the user request.

44. 【2610.41432】Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents

链接:https://arxiv.org/abs/2610.41432

作者:Haoqing Wang,Xiaoyi Zhang,Sicheng Fan,Zhexin Zhang,Xinjie Zhang,Jiahao Li,Bin Li,Yan Lu

类目:Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

关键词:long-horizon professional workflows, everyday desktop activities, agents increasingly tackle, increasingly tackle tasks, tackle tasks ranging

备注:

点击查看摘要

Abstract:Computer-use agents increasingly tackle tasks ranging from everyday desktop activities to long-horizon professional workflows. Yet interfaces centered on screenshots and mouse-and-keyboard actions can impose a human-interaction prior, requiring repeated screen interpretation while leaving the computer's semantic and programmatic capabilities underexposed. We argue for exposing these capabilities and letting models choose and combine them. We introduce Hybrid Computer Use (HCU), a unified interface for general agents that combines three complementary channels: programmatic interaction through code and command-line tools, semantic interaction through accessibility (AX), and visual interaction through graphical user interfaces (GUI). Our HCU supports efficient AX interaction and guards against stale-state actions during channel switching. A supplementary HCU skill guides agents in selecting and coordinating channels to use the unified interface effectively. Our designed AX tools return compact observations, execute actions in batches, and report their effects as AX diffs, so the model needs fewer round trips. On OSWorld 2.0, HCU achieves the highest Partial and Binary scores among the compared systems. Analyzing agent trajectories, we find that all evaluated models improve with HCU yet allocate work across the channels differently and consistently outperform compared baselines in terms of both efficiency and task success, highlighting the value of unified computer-use interfaces that allow flexible channel selection and combination.

45. 【2610.41420】SparseGDN: Chunk Sparse in Linear Attention

链接:https://arxiv.org/abs/2610.41420

作者:Jiedong Zhuang,Peng Zhao,Jialin Tang,Haoji Hu

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Gated Delta Networks, offer linear-time sequence, linear-time sequence modeling, Gated Delta, Delta Networks

备注:

点击查看摘要

Abstract:Gated Delta Networks (GDNs) offer linear-time sequence modeling, yet long-context prefill remains costly due to dense intra-chunk computation, recurrent-state updates, and intermediate state storage. We introduce SparseGDN, a hardware-aware framework that combines structured intra-chunk approximation with input-dependent recurrent-event selection while producing outputs for every token. A block-adjacent solver reduces local Delta-solve computation, while a dynamic selector allocates recurrent-update budgets across head pairs. The GPU implementation materializes updates only for selected events and reconstructs token outputs using compact state snapshots and group-local interactions, reducing computation and memory traffic. We evaluate SparseGDN on Qwen3.5-4B and Qwen3.5-9B across RULER tasks and context lengths from 4K to 128K. Retaining approximately 29% of recurrent events on average, SparseGDN achieves 1.50-1.94x GDN-core prefill speedups over native FLA kernels, including online selection overhead.

46. 【2610.41396】ProSearch: Benchmarking Multi-Constraint Protocol Retrieval in Experimental Science

链接:https://arxiv.org/abs/2610.41396

作者:Wenliang Liang,Zhiyuan Ning,Haolin Chen,Yuanchun Zhou,Wenjuan Cui,Yi Du

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:method reproduction require, reproduction require retrieving, satisfy multiple interdependent, lack systematic evaluation, require retrieving protocols

备注: Accepted to NeurIPS 2026 (Evaluations and Datasets Track). 48 pages, 4 figures. Wenliang Liang and Zhiyuan Ning contributed equally. Code: [this https URL](https://github.com/kg4sci/ProSearch) . Data: [this https URL](https://huggingface.co/datasets/kg4sci/ProSearch)

点击查看摘要

Abstract:In AI for Science scenarios, experimental design and method reproduction require retrieving protocols that satisfy multiple interdependent constraints, yet existing benchmarks lack systematic evaluation of this capability. To address this gap, we introduce ProSearch, a benchmark for multi-constraint protocol retrieval in experimental science. ProSearch has three key features: (1) realism, with queries grounded in real experimental records and expert-defined templates; (2) complexity, with 60 experimental fields and their dependencies; and (3) diagnosticity, with 3-5 explicit constraints per query, including numerical and negation constraints. We construct ProSearch through LLM-based extraction, data-driven constraint selection, controlled query generation, and evidence-based relevance validation. The resulting benchmark contains 1,515 queries across six experimental science domains. We conduct extensive experiments on ProSearch with 19 representative retrievers and complementary analyses. The best-performing retriever achieves an average nDCG@10 of only 0.290, which improves to 0.474 with reranking. Structured diagnostic analysis shows that explicit constraint matching provides a strong ranking signal, while manual error analysis identifies joint constraint binding as a key bottleneck. ProSearch provides a testbed for systematically evaluating scientific retrieval systems.

47. 【2610.41391】Comparative Evaluation of LLM-Based Review Paradigms for Academic Paper Quality Assessment

链接:https://arxiv.org/abs/2610.41391

作者:Fan Huang,Hongyu Zhou

类目:Computation and Language (cs.CL); Digital Libraries (cs.DL)

关键词:Growing submission volumes, large language models, Growing submission, support peer review, volumes have renewed

备注: commit to EACL 2027

点击查看摘要

Abstract:Growing submission volumes have renewed interest in using large language models (LLMs) to support peer review. It remains unclear how such evaluation should be structured, how much the model matters, and whether LLM scores predict research impact. We evaluate five paradigms across three input representations and three LLMs on 232 stratified ICLR 2025 submissions. Direct absolute rating matches comparative ranking on rank correlation with human scores, yet compresses most predictions above the accept threshold, flagging almost none of the papers reviewers scored below it. A base-rate-matched recalibration control locates the cause: comparative ranking supplies placement, not better ordering, and after recalibration Direct Rating reaches higher agreement than Elo while making 24% as many API calls. Abstract-only input beats full-paper summarization, and model choice matters as much as paradigm choice. Replicating on all 11,513 scored submissions reproduces these patterns, shows absolute agreement depends on the evaluated set's score spread, and finds none beating an always-reject baseline in accuracy. Human scores track citations better than any paradigm, with one exception: Group Rating retains its citation correlation after controlling for human scores, and alone ranks within the accepted pool. Ranking quality alone cannot assess review quality; calibration, thresholds, model, and target outcome all matter.

48. 【2610.41366】What We Keep of What We Forget: Replacement Operators and Routing Semantics in Training-Free MoE Expert Pruning

链接:https://arxiv.org/abs/2610.41366

作者:Ezza Ali,Sehrish Bibi,Momina Moetesum,Faisal Shafait

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:Training-free expert pruning, Training-free expert, makes two decisions, layer computes, selects a removed

备注: 56 pages, 8 figures, 76 tables

点击查看摘要

Abstract:Training-free expert pruning makes two decisions: which experts to remove, and what the layer computes when its router still selects a removed expert. Published methods change both at once. Holding the mask fixed, we compare replacement operators from three families on OLMoE, DeepSeek-V2-Lite and Moonlight, with Granite as a fourth router, using paired, multiplicity-corrected tests. The largest effect is a choice usually left implicit: the survivors' gate scale. On routers trained without top-k renormalization, renormalizing the survivors' gates, a common implementation choice, costs 0.8-8.5 points and reverses whether rerouting beats MoNE's mean-output replacement; on two routers trained with renormalization, the trained scale wins at 50% pruning. We introduce the tilted novice, a closed-form low-rank map of the pruned expert's input whose rank-0 case is MoNE's constant. At 50% pruning it adds 1.2-1.8% parameters and gains 3.45 and 1.37 points over the constant on OLMoE and Moonlight, stable across calibration draws and largely unchanged by 4- and 3-bit quantization. No operator dominates: trained-scale rerouting is best on DeepSeek-V2-Lite, and a partial copy of each pruned expert is statistically indistinguishable from the tilted novice on two models. Evaluation can change conclusions: at 25% pruning MoNE's constant keeps 92-97% of dense multiple-choice accuracy but only 5-65% of GSM8K and 0-17% of code scores, and the calibration domain moves the mask 4-9 times more than resampling. We propose a five-item reporting checklist.

49. 【2610.41308】SERIAL-7: Deriving, Realizing, and Preserving Machine-Verifiable Outputs Across Representations

链接:https://arxiv.org/abs/2610.41308

作者:Youngkyung Seo,MiHyeon Kim,Jisoo Lee,Hwijung Ryu

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Large language models, Large language, guarantee reliable execution, language models increasingly, models increasingly generate

备注: NeurIPS 2026 Workshop on AI for Verifiable Coding

点击查看摘要

Abstract:Large language models increasingly generate structured outputs consumed by programs and downstream systems, where semantic correctness alone does not guarantee reliable execution. We introduce SERIAL-7, a Korean-English benchmark built around an executable verification framework for machine-verifiable generation across seven representations. Using 177 validated canonical artifacts, SERIAL-7 separates semantic derivation (Derive), constrained artifact generation (Realize), and cross-representation preservation (Preserve). Its 43 atomic representation constraints are paired with executable checks over format, structure, and task-specific semantics, enabling progressively stricter verification from representation compliance to full artifact validity. Across ten models, REALIZE-L3 HSR ranges from 42.0% to 93.9%, while Full Compliance exposes additional artifact-level failures beyond correct final answers and valid representations. These results show that reliable structured generation requires explicit, executable verification of how artifacts are realized and preserved across representations.

50. 【2610.41292】From Transcription to Reformulation: Defining and Benchmarking Grounded Generative Speech Recognition

链接:https://arxiv.org/abs/2610.41292

作者:Qing Wang,Qihan Hu,Hang Lv,Yan Yang,Boqing Liu,Xuechao Zhu,Zehan Li,Hongjie Chen,Jian Kang,Jie Li,Yongxiang Li,Lei Xie

类目:Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

关键词:expanded automatic speech, automatic speech recognition, Speech language models, Generative Speech Recognition, speech recognition

备注:

点击查看摘要

Abstract:Speech language models have expanded automatic speech recognition (ASR) from transcription to general speech-to-text generation. Yet existing benchmarks still assume a single ground-truth transcript per utterance, an assumption that struggles when models produce readable, formatted, or structured outputs. In this work, we introduce Grounded Generative Speech Recognition (GSR), reformulating speech recognition as generating semantically grounded text instead of a single transcript. We define a grounded reformulation space that characterizes all valid textual realizations supported by the input speech, and establish a four-level hierarchy of reformulation capabilities, including literal transcription, canonical reformulation, semantic reformulation and speech-grounded structuring. Based on this formulation, we present GSR-Bench, the first comprehensive benchmark designed to evaluate generative speech recognition systems beyond exact transcript matching. GSR-Bench covers diverse scenarios including refined meeting transcription, cross-dialect translation, context-aware speech understanding, and robustness under silent or noisy acoustic conditions. To address the limitations of word-level evaluation metrics, we develop a multi-dimensional evaluation framework combining speech grounding assessment and LLM-based semantic judgment, whose reliability is validated through human preference studies. Extensive experiments across representative architectures, ranging from conventional ASR systems to end-to-end Speech-LLMs, reveal fundamental trade-offs between transcription fidelity and generative reformulation ability. Our analysis further identifies critical failure modes, including acoustic hallucination, unsupported generation, and instruction drift, providing insights into the design and evaluation of future grounded generative speech systems.

51. 【2610.41291】In-Model Context Compression with Agentic Soft Tokens for Long-Horizon LLM Agents

链接:https://arxiv.org/abs/2610.41291

作者:Xuning He,Kai Fan,Runyu Zhang,Binghuan Wang,Yuxiang Zhang,Xue Jiang,Yihong Dong

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

关键词:ever-growing interaction contexts, LLM agents play, play an important, important role, role in solving

备注: 26 pages, 9 figures, 11 tables. Code: [this https URL](https://github.com/RISE-X-Lab/Agentic-Soft-Token)

点击查看摘要

Abstract:Long-horizon LLM agents play an important role in solving complex and sustained tasks, with ever-growing interaction contexts. However, these accumulated contexts will raise substantial computational cost and obscure key decision-relevant evidence. Existing methods typically train external compressors or context-management agents to rewrite context as shorter hard-token sequences, but such external selection may not align with the LLM's evolving representation and is necessarily lossy. In this paper, we introduce Agentic Soft-Token Compression (ASTC), a training-free compression method using soft tokens within LLM agent for long-horizon tasks. Specifically, ASTC uses the model's native recurrent dynamics to determine the already absorbed information, leveraging the commonly-used hybrid Gated Delta Network (GDN)-attention. It then carries this information forward as agentic soft tokens while retaining exact values as hard tokens. The resulting compact sequence reduces later-layer computation and yields reusable KV caches, extending the savings across the agent's trajectory. Extensive experiments on long-horizon tasks show that ASTC matches or exceeds the uncompressed agent's accuracy with up to 50.68% fewer end-to-end Attention Pairs, while trained compressors require 15.4 to 103.7 times more Attention Pairs per successful task. These findings highlight agentic soft tokens as a model-native way to carry absorbed context forward as the task representation evolves.

52. 【2610.41289】PsyInterviewee: Informational Invariance and Relational Adaptivity in Mental Health Interview Simulation

链接:https://arxiv.org/abs/2610.41289

作者:Jiawei Zhang,Huachuan Qiu,Ruocheng Guo,Zijun Shi

类目:Computation and Language (cs.CL)

关键词:health interviewing systems, mental health interviewing, simulated interviewees support, support interviewer training, interviewing systems

备注: 38 pages, including appendices. Code: [this https URL](https://github.com/BeIn-Lab/pdm-interviewer)

点击查看摘要

Abstract:LLM-based simulated interviewees support interviewer training and the evaluation of mental health interviewing systems. Existing studies have primarily focused on improving human-likeness through richer patient profiles and behavioral modeling. However, human-likeness alone does not establish their reliability. Reliable simulation requires preserving profile-grounded clinical facts (informational invariance) while adapting disclosure and interaction behavior to the interview (relational adaptivity). To this end, we introduce PsyInterviewee, which separates a protected truth channel from a dynamic interaction channel and verifies generated clinical claims against the profile. Specifically, asymmetric write permissions allow dialogue context to update disclosure and behavioral states without authorizing new clinical facts; these states guide what profile-supported information is revealed and how it is expressed. In an automated evaluation of interactions between LLM-based interviewers and interviewees, PsyInterviewee achieves higher scores than four representative baselines on most metrics across both axes, as assessed by two LLM judges. Ablations suggest that the two channels contribute to clinical grounding and response modulation, respectively.

53. 【2610.41280】SciGraphSelect: Auditable Scientific Data Selection through Knowledge--Reasoning Graphs

链接:https://arxiv.org/abs/2610.41280

作者:MiHyeon Kim,Ji-Eun Han,Eunkyeong Lee,Jeehyun Lim,Hwijung Ryu

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:providing limited insight, Scientific data selection, providing limited, typically driven, driven by relevance

备注: 40th Conference on Neural Information Processing Systems (NeurIPS 2026). Workshop: AI4Science

点击查看摘要

Abstract:Scientific data selection is typically driven by relevance or utility scores, providing limited insight into why a document is retained. We introduce SciGraphSelect, a reference-grounded framework for auditable scientific data selection. SciGraphSelect organizes domain-specific knowledge, reusable reasoning operations, and reference-attested relations into a typed knowledge--reasoning graph, then scores candidate documents using concept coverage, relation and path co-support, and directional alignment. To avoid over-interpreting document embeddings, rich relational structure is preserved on the reference side while candidate-side evidence is treated conservatively without assuming relation entailment. By exposing the reference-grounded evidence behind each selection, SciGraphSelect brings traceability to the upstream construction of scientific training corpora and complements downstream scientific verification.

54. 【2610.41232】RIDENT and SHAKTI: A Framework and Benchmark for Hindi AI-Text Detection

链接:https://arxiv.org/abs/2610.41232

作者:Shifali Agrahari,Sujit Kumar,Sanasam Ranbir Singh

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:maintaining information integrity, Large Language Models, Large Language, distinguishing human-written, information integrity

备注:

点击查看摘要

Abstract:As Large Language Models (LLMs) become increasingly multilingual, distinguishing human-written from AI-generated text is essential for maintaining information integrity. However, research remains English-centric, with limited benchmarks for low-resource languages such as Hindi. To address this gap, we introduce SHAKTI, a large-scale Hindi benchmark covering four genres, eight LLM families, multiple prompting strategies, and adversarial transformations. We evaluate its quality through human annotation and analyze linguistic, grammatical, and sentiment-based differences between human- and AI-generated texts. Building on these findings, we propose TRIDENT, a round-trip translation-based detection framework with three variants: TRIDENT-S (static threshold), TRIDENT-D (dynamic threshold), and TRIDENT-C (logistic regression using multi-distance RTT features). TRIDENT leverages semantic consistency between original and round-trip translated texts to identify AI-generated content. Extensive experiments show that TRIDENT outperforms conventional and supervised baselines, with TRIDENT-S achieving the best overall performance. Further evaluations across seven languages, adversarial settings, and unseen LLMs demonstrate its multilingual applicability and robustness, while highlighting sensitivity to the translation model.

55. 【2610.41215】Beyond Response Scoring: An AI-aware Cognitive Supervision Framework for Automated Mathematical Short Answer Grading

链接:https://arxiv.org/abs/2610.41215

作者:Shengran Guo,Min Chi,Feifei Qiao,Varad Patwardhan

类目:Computation and Language (cs.CL)

关键词:achieved remarkable success, Transformer-based language models, automated short answer, Transformer-based language, short answer grading

备注: 12 pages, including references and appendix

点击查看摘要

Abstract:Transformer-based language models have achieved remarkable success in automated short answer grading (ASAG). However, current methods in ASAG struggle to comprehend, reason about and evaluate complex mathematical answers involving symbols and formulas. These score-only methods fail to generalize across diverse responses and skill states associated with identical scores. Moreover, they ignore the potential upward bias introduced by generative Artificial Intelligence (AI) usage in assessing students' performance and knowledge mastery. To address these limitations, we propose AICG (AI-aware Cognitive-supervised Grading), a two-branch multi-task framework. The first branch combines RoBERTa-based regression, ordinal, and classification heads for individual-answer grading. The second branch uses an expert-designed Q-matrix to associate responses with assessed skills and jointly predicts G-DINA-derived skill mastery and learning gain. Through the shared encoder, these skill-level targets provide cognitive supervision for answer grading beyond score labels. AICG further uses a Gen-AI detector, trained through supervised contrastive pretraining followed by linear classification, to estimate assistance probabilities and convert them into reliability weights, attenuating unreliable cognitive evidence during learning assessment. We conduct experiments on 49,402 instructor-graded responses spanning 19 academic semesters. Relative to RoBERTa regression, AICG reduces mean absolute error (MAE) by 50.3% and improves quadratic weighted kappa (QWK) from 0.798 to 0.927. Ablations identify Q-matrix-guided cognitive supervision as the primary source of improvement, while AI-aware weighting further reduces overall MAE by 4.2% over the unweighted cognitive model and consistently improves MAE and QWK across the four most recent post-Gen-AI semesters.

56. 【2610.41177】raceSpec: Understanding and Improving Speculative Decoding for LLM Agents

链接:https://arxiv.org/abs/2610.41177

作者:Jihao Zhao,Shuaishuai Zu,Pengfei Li,Biao Qin,Guanghuan Fang,Ben Feng,Baochuan Yang

类目:Computation and Language (cs.CL)

关键词:repeated model calls, LLM agents execute, agents execute tasks, histories of reasoning, tool feedback

备注:

点击查看摘要

Abstract:LLM agents execute tasks through repeated model calls over evolving histories of reasoning, actions, and tool feedback. Aggregate speculative-decoding metrics merge these distinct decisions, providing limited guidance on where draft supervision is needed. We present TraceSpec, a framework connecting trajectory evaluation with adaptive draft training. It combines dynamic execution with fixed-prefix replay and introduces TraceSpec-Traj, a corpus of 10,000 training states and 2,500 test states spanning browsing and software engineering. Analysis of five speculative baselines reveals that aggregate acceptance can rise with context length while declining within matched late browsing actions. Workload and phase further distinguish these trends, motivating supervision guided by trajectory conditions. TraceSpec trains on intermediate assistant turns and allocates a fixed prediction budget using state-conditioned estimates of prefix-aware acceptance gaps. Across three target sizes and two temperatures, it improves replay throughput by 12.5% to 22.6% over its DSpark base. Qwen3-4B ablations show that adaptive allocation increases accepted length by 3.3% to 10.0% over fixed full-turn supervision, with additional comparisons substantiating the roles of state conditioning and consecutive-token agreement. The resulting evaluation resources, trajectory findings, and training strategy connect the analysis of agent execution to practical draft improvement.

57. 【2610.41176】S2TDR: Structured Multimodal Reconstruction for Sticker-Aware Dialogue Understanding

链接:https://arxiv.org/abs/2610.41176

作者:Yuanchen Shi,Fang Kong

类目:Computation and Language (cs.CL)

关键词:social media dialogues, express affect, social media, Dialogue, Reconstruction

备注: 12 pages, 4 figures, 5 tables

点击查看摘要

Abstract:Stickers are widely used in social media dialogues to express affect, stance, and intent beyond literal text. Their meanings are often non-literal and context-dependent, making them difficult to handle with generic visual fusion or standalone captioning. We propose Sticker-to-Text Dialogue Reconstruction (S2TDR), a structured multimodal reconstruction framework that converts sticker turns into contextually appropriate textual utterances. S2TDR decomposes sticker interpretation into visual cue extraction, affective-intent inference, and context-aware dialogue reconstruction, using OCR text only as an auxiliary cue when available. The reconstructed dialogue can then be consumed by existing text-based dialogue models. Experiments on sentiment analysis, intent recognition, and dialogue summarization show that S2TDR generally improves multiple downstream models over direct sticker integration methods. Further analyses on component ablations, OCR-empty stickers, and reconstruction quality indicate that structured reconstruction provides an interpretable and effective way to integrate sticker semantics into dialogue understanding.

58. 【2610.41172】Context as Infrastructure: Knowledge Compilation for Retrieval in Agentic Systems with Harnesses

链接:https://arxiv.org/abs/2610.41172

作者:Zhichang Yu,Baining Cao,Sbaaoui Idriss,Qi Wang,Gangqiang Xu,Ling Qin,Xiaoling Jin,An Liu,Shaohao Cai,Xiaoyang Bao,Shengle Chen,Changchang Ding,Pengfei Zhu,Jingxiang Xu,Yifeng Mao,Lu Liu,Hai Jin,Yingfeng Zhang

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Retrieval-augmented generation, Retrieval-augmented, harness writes queries, search harness writes, harness

备注: 13 pages, 2 figures

点击查看摘要

Abstract:Retrieval-augmented generation is becoming agentic. A search harness writes queries, reads results, reformulates, and decides when to stop. This largely solves accuracy: a harness with only BM25/grep and MiniMax M3 answers 85% of BrowseComp-Plus and 91% on multi-hop FRAMES in our runs, without compiled or vector indexes. It exposes a context problem: an undisciplined loop repeats queries, rereads documents, and fills the window with unused passages. The missing layer is knowledge compilation: a configurable ingestion pipeline where LLMs enrich documents with context no chunk contains alone--navigation hierarchies with claim-evidence leaves, entity graphs, timelines, mind maps, ontologies, wikis, and memory. Compilation is not a better retriever: under a competent harness, structural artifacts gave no detectable accuracy gain on FRAMES, and a PageIndex-style outline degraded at scale. It is a supply layer. A navigation tree whose leaves are claim-evidence pairs--the mechanism we measure--cuts query tokens by 91% when evidence suffices and adds 1.9% when it does not, a 38% average reduction; this implies a 2% break-even sufficiency rate and a measured rate near 43%. A decision gate cuts latency from 140 s to 30 s, though substitution's token saving is bought with retrieval rounds and carries its own latency cost. Other artifacts--ontology, graph, wiki, timeline, mind map, memory--pay off in deployment (governance, integration, onboarding, temporal orientation, continuity) where accuracy benchmarks cannot see them. We describe RAGFlow's pipeline and harness (open source at this https URL), which turns the loop into five disciplined stations and keeps the context entering the model the smallest sufficient set; together they form an agent-native database: a store that hands the agent compiled, governed context instead of a ranked list of passages.

59. 【2610.41157】Lineage Is Memory: Parent Inheritance and Feedback Disclosure in Short-Budget LLM-Guided Optimization

链接:https://arxiv.org/abs/2610.41157

作者:Shanglin Yang,Zhan Shi

类目:oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Iterative language-model optimizers, language-model optimizers refine, Iterative language-model, optimizers refine prompts, parent inheritance

备注: 17 pages, 2 figures, 10 tables. Code, pre-registrations, and 1,750 run logs at [this https URL](https://github.com/shangliy/lineage-is-memory)

点击查看摘要

Abstract:Iterative language-model optimizers refine prompts and programs by evaluating a candidate, showing a proposer model a sample of failing cases, and keeping revisions that improve performance. Recent work attributes the limits of this loop to narrow single-round reflection, introducing full-set error clustering, targeted minibatches, or larger proposer models so the optimizer sees more failure modes per step. Yet every existing evaluation tests these mechanisms exclusively inside lineage-preserving search, where each revision edits a surviving parent, leaving the contribution of parent inheritance confounded with the breadth of per-round feedback. Across 1,750 pre-registered runs spanning nine prompt and program synthesis benchmarks, we separate parent inheritance from feedback disclosure under matched evaluation budgets. We find that greedy parent inheritance drives the vast majority of optimization progress, outperforming seed-reset resampling even when seed-reset proposals receive a clustered summary of all failures in every round or use a larger proposer model. While full-set error clustering and diverse failure selection improve single-step rewrites from the seed and accelerate the opening rounds of search, sequential parent inheritance rapidly closes this gap as solved error modes are retained in the candidate and filtered from subsequent failure lists. Moreover, decomposing token expenditure in GEPA reveals that proposer reflection accounts for only a small fraction of total cost whereas validation and minibatch gating consume nearly the entire budget, showing that greedy parent inheritance over raw failures captures the gains of complex reflective loops at a fraction of their compute.

60. 【2610.41147】HyperRepair: Recovering Forgotten General Capabilities of Fine-Tuned Language Models

链接:https://arxiv.org/abs/2610.41147

作者:Junrong Tang,Jianghui Wang,Hao Kong,Yang Lin,Yibo Yang

类目:Computation and Language (cs.CL)

关键词:Fine-tuning improves, language model performance, improves a language, general capabilities, Repairing Side Net

备注: 29 pages, 5 figures

点击查看摘要

Abstract:Fine-tuning improves a language model's performance in a target domain but can weaken its general capabilities. Existing methods often face a trade-off between general capabilities and domain specialization, making it difficult to preserve both. We introduce HyperRepair, a framework for recovering general capabilities while retaining domain specialization at only inference cost. To make recovery generalizable across models sharing a pretrained backbone, HyperRepair learns a hypernetwork from repairs trained on source models. The hypernetwork uses activation fingerprints that summarize changes from the pretrained backbone to generate a tailored Repairing Side Net (RSN), whose prompt-conditioned gate applies corrections selectively. This enables recovery on models from unseen adaptation domains without target-domain examples or additional optimization. We evaluate HyperRpair across two model families, 12 LoRA adaptation datasets, and 15 general benchmarks. On the default split, HyperRepair achieves 93.4% of the base models' average general score while retaining 99.5% of the fine-tuned models' average domain score.

61. 【2610.41116】Language Models Show a "Women-Are-Wonderful" Effect in Blame Attribution That is Not Just Leniency

链接:https://arxiv.org/abs/2610.41116

作者:Anika Sharma,Snehalkumar 'Neil' S. Gaikwad,Snigdha Chaturvedi,Shashank Srivastava

类目:Computation and Language (cs.CL)

关键词:language-model blame attribution, evaluations than men, paper investigates, favorable bias, receive more positive

备注:

点击查看摘要

Abstract:This paper investigates the Women-Are-Wonderful (WaW) effect in language-model blame attribution: a favorable bias in which women receive more positive evaluations than men. Using 11,270 interpersonal conflicts from r/AmItheAsshole, we construct matched counterfactuals that vary the gender of the person being judged (the original poster) and the person affected (the counter-party). Across four language models, gender changes a minority of verdicts, but those changes consistently favor women. The effect is strongly role-dependent. Making the original poster a woman reduces the odds of blame by 9--52%, while making the counter-party a woman multiplies them by 2.7--9.2X. Counter-party WaW also varies across conflict types, strengthening in communication and relationship conflicts and weakening in family conflicts. Exploratory probes suggest that counter-party gender can shift judgments of sympathy, reasonableness, harm and protection. WaW is therefore not just leniency toward women being judged: models also judge conduct more harshly when it affects a woman.

62. 【2610.41104】MUON-RT Reusing the Teacher's Trajectory for Momentum-Free Muon for LLM Self-Distillation

链接:https://arxiv.org/abs/2610.41104

作者:Aryan Das,Vinay Kumar Verma,Aakansha Mishra

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

关键词:large language models, exponential moving average, methods for large, large language, exponential moving

备注: Under Submission

点击查看摘要

Abstract:Self-distillation methods for large language models with an exponential moving average (EMA) teacher already retain a history of student updates. Muon nevertheless stores a separate momentum buffer, increasing persistent training memory. We propose Muon with Reused Teacher (Muon-RT), which reuses the teacher-student displacement to eliminate momentum buffers for hidden weight matrices. We show that this displacement encodes an exponentially weighted history of applied updates and smooths temporally uncorrelated noise under a local model. Muon-RT removes its radial component, normalizes it spectrally, and mixes it with the current gradient after Newton-Schulz (NS) orthogonalization. Under explicit regularity and alignment assumptions, we establish linear contraction of an expected objective-gap bound toward a residual error level. With Self-Distillation Fine-Tuning (SDFT) on Qwen2.5-7B-Instruct, Muon-RT improves average accuracy over AdamW by 2.6 points with 42% less persistent memory, and over momentum Muon by 5.4 points with 27% less persistent memory. With Self-Distillation Policy Optimization (SDPO) on Olmo-3-7B-Instruct, it improves average accuracy over AdamW by 2.0 points.

63. 【2610.41079】EDU-Jev Training System-One Decision Models for Education

链接:https://arxiv.org/abs/2610.41079

作者:Jiazheng Li,Yulan He

类目:Computation and Language (cs.CL)

关键词:education involve choosing, assigning a rubric, marking criterion, involve choosing, meets a marking

备注: 16 pages, 3 figures, 4 tables. Work in progress

点击查看摘要

Abstract:Many automated decisions in education involve choosing from a fixed set of options: assigning a rubric score, checking whether an answer meets a marking criterion, or identifying the first wrong step in a solution. Generative language models are increasingly used to make these decisions, but their responses require parsing, longer outputs increase inference costs, and confidence expressed in words does not necessarily reflect the probability of being correct. We present EDU-Jev, a family of single-pass ("System One") decision models at 0.8B, 2B and 4B parameters. Given an assessment context and a question with predefined answer options, the model returns a probability distribution over those options without generating text. A pointer head scores a marker for each option, ensuring the predictions are restricted to the allowed choices. Training uses a single supervised stage with soft cross-entropy against the available target label distributions; calibration is assessed empirically. Across twelve education benchmarks, EDU-Jev 4B achieves an average accuracy of 67.6%, exceeding the strongest of five commercial decision APIs by 9.4 percentage points and the best open 4B decision model by 18.7 points. On four cross-domain education sets, it matches the strongest API, which remains ahead on general decision-making and reasoning tasks. The 2B model processes about 150 decisions per second on a single H100 GPU.

64. 【2610.41040】Capability-Grounded Agentic Planning

链接:https://arxiv.org/abs/2610.41040

作者:Shikha Shrestha,William Yeoh,Ning Zhang,Yevgeniy Vorobeychik

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:serve natural-language requests, agents serve natural-language, serve natural-language, LLM agents serve, LLM

备注: 25 pages, 3 figures

点击查看摘要

Abstract:LLM agents serve natural-language requests through tools, data sources, and other agents, and even simple requests often need several interdependent calls. Typically, the LLM picks these calls by trial and error, with no guarantee of an executable plan. We present Capability-Grounded Agentic Planning (CGAP), which instead reasons about what a request requires and what tools provide. CGAP compiles the tool catalog deterministically into a PDDL model, uses an LLM to turn the request into goals, and solves the model with a classical planner. Since tool outputs are unknown in advance, the model is abstract, tracking which inputs are available, not their values. During execution, an LLM adds entity-specific calls that abstract plans omit, and deterministic checks reject any that break the plan. Every argument is drawn from a cited source, such as a conversation span or an earlier tool response, and each requested result counts as delivered only after an LLM verifier checks it against the request. With three LLMs on ToolSandbox, ComplexFuncBench, BFCL multi-turn, and $\tau^2$-bench retail, CGAP outperforms a standard tool-calling agent by up to 28.9 points.

65. 【2610.41015】Do Language Models Know What Compelling Scientific Evidence Looks Like?

链接:https://arxiv.org/abs/2610.41015

作者:Conor Igoe,Gabriel Grand,Zane Koch,Albert Bou,Eli Moss,Michaela M. Hinks,Samuel G. Rodriques,Andrew White,Siddharth Narayanan

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:weighing empirical findings, Expert scientists excel, scientists excel, excel at weighing, weighing empirical

备注:

点击查看摘要

Abstract:Expert scientists excel at weighing empirical findings from multiple sources that vary in both statistical reliability and epistemic relevance. To what extent are language models, which are increasingly driving autonomous discovery systems, capable of such evidence deliberation? We introduce EDB-Bio, a scientific reasoning benchmark curated from real-world data in three biological domains: drug-perturbation transcriptomics, CRISPR screens, and human genome-wide association studies (GWAS). Each of EDB-Bio's 96k episodes presents a sequence of experimental results from published studies and asks the model to predict the probability that a target hypothesis is true. Out-of-the-box, open-weight and frontier models alike demonstrate systematic underconfidence and attain Brier scores comparable to a trivial base-rate forecaster. Post-training against strictly proper scoring rules significantly improves both calibration and discrimination. This calibration pays off downstream: in a sequential experiment selection task, our Ibis0 model is 2.5 times more efficient than the best frontier model. Throughout, quantifying evidence weights as Bayes factors reveals how models update their beliefs over time, whether they agree with expert biologists on relevance, and where they exhibit inconsistencies and biases. Our work extends calibration training and uncertainty analysis to a realistic scientific forecasting setting with applications to human cancer biology. We release all code, data, and trained models.

66. 【2610.41012】Language Models Show Conformity Bias in RAG: When the Majority Endorses a Poisoned Claim

链接:https://arxiv.org/abs/2610.41012

作者:Mehrdad Ghassabi,Audrina Ebrahimi,Zahra Zojaji,Amin Milani Fard

类目:Computation and Language (cs.CL)

关键词:Retrieval-augmented generation, expose language models, mutually agreeing poisoned, agreeing poisoned documents, mutually agreeing

备注:

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) can expose language models to misleading evidence in retrieved documents. We investigate whether increasing the number of mutually agreeing poisoned documents affects a model's ability to detect misinformation. We evaluate 200 randomly selected questions from SciFact (random seed 38), comparing contexts with one poisoned and six healthy documents against contexts with six mutually agreeing poisoned documents and one healthy document. For Gemma-3-12b, poison-detection rates decrease from 25% (50/200) in the minority condition to 10% (20/200) in the majority condition. Among the 38 questions with different outcomes across conditions, 34 change from detected to undetected, while only four change in the opposite direction (exact McNemar test, p = 6.04e-7). This pattern is consistent with a conformity-like response to a majority of mutually agreeing poisoned documents. Our results provide initial evidence of conformity bias in RAG-based misinformation detection: Gemma-3-12b is substantially less likely to detect poisoned claims when they dominate the retrieved evidence.

67. 【2610.41004】MOSAIC: Addressing Disproportionate Task-Modality Dependencies via Modality-Partitioned Gradient Routing

链接:https://arxiv.org/abs/2610.41004

作者:Aryan Chowdhury,Yizheng Sun,Thomas Carroll,Riza Batista-Navarro

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:combining multiple modalities, multi-task settings, combining multiple, draw on signals, multiple modalities

备注: 9 Pages, 1 Figure, 3 Tables

点击查看摘要

Abstract:In multi-task settings, combining multiple modalities allows task representations to draw on signals that a single modality alone would not capture. However, individual tasks may depend disproportionately on particular modalities, a structure that conventional fusion-based architectures do not model explicitly, instead enforcing a unified representation space. Consequently, a task's gradients can affect parameters tied to modalities it barely relies on, leaving features that compromise between competing demands. Although prior work has explored task-weighting and loss-balancing strategies, their effectiveness is limited by the absence of explicit modality separation, preventing models from optimising each modality according to its task-specific importance. To address these limitations, we propose MOSAIC (MOdality-Separated Architecture with Inter-modal Cross-attention), which preserves unimodal representations while enabling controlled interaction between them, and uses modality-specific losses to route gradients to their corresponding partitions. On the Corpus of Everyday Japanese Conversation (CEJC), MOSAIC improves average macro-F1 by 7.4 points across four tasks with a 72% reduction in backbone parameters relative to a fusion-based baseline. Our results demonstrate that modality partitioning yields consistent gains across tasks while requiring far fewer backbone parameters than a fusion-based design.

68. 【2610.40996】Do Open Language Models Invent Scripture? BILAL-BENCH: Benchmarking Islamic-Source Fabrication in Bengali

链接:https://arxiv.org/abs/2610.40996

作者:Sabah Nushra,Md Kishor Morol

类目:Computation and Language (cs.CL)

关键词:treat as sacred, language model invents, false authority, authority to text, text that readers

备注: 15 pages, 6 tables. Accepted at the 7th Muslims in ML (MusIML) Workshop at NeurIPS 2026. Code and dataset: [this https URL](https://github.com/Meowthhh/BILAL-Bench)

点击查看摘要

Abstract:When a language model invents a Qur'anic verse or hadith, it gives false authority to text that readers may treat as sacred. Existing Islamic hallucination benchmarks are largely Arabic and often closed-ended, while Bengali resources mainly study general-domain hallucination or factual knowledge. We introduce BILAL-BENCH, a 240-question expert-verified benchmark for open-ended Islamic-source fabrication in Bengali. It covers Qur'anic attribution, hadith, fiqh, contemporary issues, and adversarial false-premise prompts, and uses a two-axis rubric that separates source errors from assertiveness. We evaluate seven open-weight models from 1B to 120B on 1,680 double-annotated responses. Six of the seven models confidently fabricate on 79.3-95.3% of source-production questions, with no monotonic improvement from scale. Hadith provenance is the weakest category across models: only two of 315 responses are correct and correctly sourced. The two 8B BanglaLLaMA variants have similar confident-fabrication rates but different error profiles. Models vary far more in whether they withhold a claim they cannot support than in source accuracy: appropriate abstention or false-premise correction ranges from 6 to 46 responses across the benchmark, and does not track parameter count.

69. 【2610.40985】he psychophysics of affect in large language models

链接:https://arxiv.org/abs/2610.40985

作者:Joseph Marks(1),Marius C. Vollberg(2 and 3) ((1) NatWest Group, London, UK, (2) University of Zurich, Zurich, Switzerland, (3) Swiss Center for Affective Sciences, Geneva, Switzerland)

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Good decisions, Good, outcomes, Abstract, ratings

备注: 64 pages (26 main text, 25 Supplementary Information, 13 GUIDE-LLM reporting checklist), 5 figures. Code: [this https URL](https://doi.org/10.5281/zenodo.23772352) ; data: [this https URL](https://doi.org/10.5281/zenodo.23556542)

点击查看摘要

Abstract:Good decisions often require considering how outcomes will feel. Yet large language models (LLMs) increasingly enter decision workflows, despite little being known about how they map outcomes to feelings or use those mappings in choice. We tested how LLMs anticipated gambling or stock-trading outcomes would feel and whether they incorporated these ratings into choice. When outcomes were rated in isolation, ratings exhibited diminishing sensitivity to magnitude, resembling human value functions; but models rated gains more intensely than equivalent losses, an inversion of canonical loss aversion we call silicon gain amplification. When outcomes were rated together, enabling direct comparison, ratings linearised. In choice, the gain-loss asymmetry largely disappeared, and models' own ratings did not reliably explain their choices better than monetary utility did. These findings reveal malleable mappings from outcomes to affect, raising questions about whether and how agentic LLMs should incorporate anticipated feelings into decisions.

70. 【2610.40974】Fewer Heads, Fewer Memories: Pruning Redundant Attention Heads Suppresses Verbatim Memorisation

链接:https://arxiv.org/abs/2610.40974

作者:Aryan Chowdhury,Riza Batista-Navarro

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:intellectual property exposure, Large language models, Large language, raising concerns, privacy leakage

备注: 7 Pages, 5 Tables, 1 Figure

点击查看摘要

Abstract:Large language models have been shown to memorise and reproduce verbatim sequences from their training data, raising concerns about privacy leakage, intellectual property exposure, and the limits of generalisation. Recent theoretical work suggests that attention heads may contribute to this behaviour by functioning as associative memory mechanisms, with memorisation capacity scaling with the number of heads. At the same time, empirical work has shown that many attention heads are redundant and can be pruned with limited impact on downstream performance. Despite these parallel findings, the effect of pruning redundant heads on memorised-sequence reproduction remains unexplored. In this work, we demonstrate that zeroing out a substantial fraction of attention heads prior to inference can significantly suppress verbatim memorisation while preserving, or even improving, language modelling performance on the benchmark used to identify redundant heads. Evaluating GPT-2-XL(1.5B) on known memorised sequences, we find that pruning 729 task-redundant heads reduces the memorisation count by 91.5%, while improving WikiText-103 perplexity by 0.92. These findings suggest that attention-head redundancy can be exploited to mitigate memorisation at inference time, without retraining or modifying the training data.

71. 【2610.40970】Nedimo: An Evidence-Grounded Multilingual Pipeline for AI-Generated Sleep Stories

链接:https://arxiv.org/abs/2610.40970

作者:Georgios Makridis,Stefanos Kampouris

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD)

关键词:ordinary media objectives, Generative audio systems, produce large libraries, personalized bedtime content, Generative audio

备注: 7 pages, 3 figures, 3 tables

点击查看摘要

Abstract:Generative audio systems can produce large libraries of personalized bedtime content, but ordinary media objectives (retention, completion, and novelty) are poorly aligned with the goal of supporting a transition toward sleep. Direct evidence for narrated bedtime audio in adults is mixed, and a recent active-controlled trial did not support such audio as a standalone treatment for sleep disturbance. We translate this uncertain evidence into conservative engineering requirements and present a multilingual pipeline for generating and narrating low-arousal sleep stories. The implemented prototype separates deterministic planning from large language model generation, represents content and delivery parameters explicitly, shapes each script through a four-phase attention taper, validates structural and lexical constraints, performs a bounded error-aware retry, and quarantines unresolved outputs. Provider-agnostic text-to-speech synthesis is followed by paragraph-aware joining, two-pass loudness normalization, and a publication gate that re-measures the saved, encoded file against fixed loudness, loudness-range, and true-peak limits. The product data model records stop position, replay, early abandonment, and completion while treating these events as ambiguous behavioral proxies rather than clinical outcomes. We contribute an evidence-to-requirement mapping, a traceable guardrail architecture with explicit acceptance thresholds, technical evaluation criteria, and a prospective protocol for testing sleep-onset effects. No clinical efficacy is claimed; the system is positioned as a relaxation and attentional-support tool whose benefit and possible reliance must be evaluated empirically.

72. 【2610.40966】Better Retrievers, Worse Labels: How Incomplete Relevance Judgments Distort Abstention Evaluation in Conversational RAG

链接:https://arxiv.org/abs/2610.40966

作者:Ivan Kochergin,Vasily Konovalov

类目:Computation and Language (cs.CL)

关键词:Conversational RAG benchmarks, Conversational RAG, RAG benchmarks, RETECO evaluate retrieval, generation end

备注:

点击查看摘要

Abstract:Conversational RAG benchmarks such as MTRAG and RETECO evaluate retrieval and generation end to end: each system answers from its own retrieval, so abstention must be scored against whether each retrieved context is sufficient. A convenient shortcut reads sufficiency off the relevance judgments and treats a context without gold documents as unanswerable. We re-run the official baselines exactly and test this shortcut on RECOR (RETECO track~2) with four retrievers (nDCG@10 from .18 to .59) and three Qwen3 readers. Two open LLM judges and a panel of four small open models label each context by content, and a model of another family audits 250 contexts blind, with adjudication. The stronger the retriever, the larger the share of no-gold contexts that still contain the answer (28\% to 72\%) and the lower the shortcut's precision (.68 to .10; .70 to .21 under the audit). A reader agrees: Qwen3-4B answers 62--67\% of these false misses correctly, against 23--30\% of no-gold contexts judged insufficient and 1\% with no documents. In most false misses, the answer comes from a hard negative mined for the same question, another turn's gold or a neighbouring chunk of the gold page. On MTRAG, whose judgments come from annotators, precision drops from .72 to .50. Under the shortcut, answerability AUROC is up to .19 too low, and the best sufficiency detector appears to be a retrieval score that never reads the documents. We release code, runs and labels, and recommend scoring refusals against content labels, not the presence of gold.

73. 【2610.40943】Kernel-based Interpolatory Methods for Context Compression of Attention Mechanisms

链接:https://arxiv.org/abs/2610.40943

作者:Michel Fabrice Serret,Laura Grigori

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Numerical Analysis (math.NA)

关键词:fundamental building block, Empirical Interpolation Method, modern language models, Generalized Empirical Interpolation, fundamental building

备注: 44 pages, 17 figures, 8 tables

点击查看摘要

Abstract:The bottleneck of attention mechanisms, which are the fundamental building block of modern language models, is their quadratic complexity in terms of context size. There has thus been an increasing interest in the compression of the context, also called KV-cache compression. In this article, we consider the problem of compressing the context of attention mechanisms by first formulating it in the Hilbert space associated with its kernel. In this formalism, attention can be represented as the ratio of two linear maps whose interpolant is also the ratio of interpolants, this allows us to consider the interpolation of the linear maps directly. We thus introduce two novel KV-cache compression methods which we call GAIM and Q-DAIM, based on the Generalized Empirical Interpolation Method (GEIM) and the Q-Discrete Empirical Interpolation Method (Q-DEIM), respectively. As the cost of these methods is quadratic in terms of context length, we propose surrogate models based on the Taylor series, the Performer and the Random Fourier Features method which allow the compression to be done in linear time. Finally, we extend this result to the streaming attention setting, providing new methods which allow one to penalize the selection of interpolation nodes based on the previously interpolated context and to update the previous interpolation based on new information. We then provide numerical results on the convergence of the residuals and the output error in future queries and preliminary results on the LongBench-E benchmark showing performance comparable to the state-of-the-art methods. These experiments suggest that the range revealed by our Q-DAIM method could help identify where information is concentrated in the KV cache, thus enabling an efficient compression.

74. 【2610.40930】Adaptive Personalization Under Preference Epistemic Uncertainty

链接:https://arxiv.org/abs/2610.40930

作者:Priyanka Dey,Rajarshi Das,Vikas Bahirwani,Qi Zeng,Julia Kruk,Qi Qi

类目:Computation and Language (cs.CL)

关键词:valid over time, context shifts, explicitly revised, remain valid, uncertain as context

备注:

点击查看摘要

Abstract:Human preferences change over time: an established preference may remain valid over time, become uncertain as context shifts, or be explicitly revised. Effective personalization requires conversational AI to adapt its response strategy to evolving preferences rather than relying on passive memory retrieval. We formalize this capability as adaptive personalization under epistemic uncertainty. A human preference study further confirms that people favor state-contingent response strategies as preference uncertainty changes. To evaluate whether language models mirror this adaptation, we create a multilingual benchmark spanning 250 personas, 5 languages, and 25K conversational turns that decouples strategy selection from response execution. Across eight closed- and open-weight models, we uncover a recognition-generation gap: models reliably identify appropriate strategies when selecting among candidate options, but collapse during open-ended generation, suffering a 35-46% drop in strategy calibration. Crucially, this failure is systematic: models default to exploit-first behavior, over-relying on existing preferences regardless of preference epistemic uncertainty. We show this failure is addressable: while prompting interventions fail, targeted training that supervises models' internal strategy representations toward state-conditional human preferences narrows the user acceptability generalization gap by a third on out-of-distribution personas and conversational styles.

75. 【2610.40927】Agentic World Modeling for Agent Test-time Scaling without Environment Replica

链接:https://arxiv.org/abs/2610.40927

作者:Wendi Li,Huseyin A. Inan,Wei-Ning Chen,Yanzhi Chen,Chetan Bansal,Saravan Rajmohan,Sharon Li

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词:multiple candidate trajectories, improves large language, common realizations assume, language model agents, large language model

备注:

点击查看摘要

Abstract:Test-time scaling (TTS) improves large language model agents by sampling and selecting among multiple candidate trajectories, but common realizations assume that these trajectories can be executed in parallel. This assumption breaks in realistic deployments, where enterprise workspaces and cloud services are shared and persistent, costly or infeasible to replicate, and actions may introduce irreversible side effects or cross-trajectory interference. Existing generative world models avoid direct execution, but typically compress environment state into a single prompt, limiting their ability to reliably simulate transitions under partial observability. Instead, we introduce Agentic World Modeling (AWM), which reformulates next-observation prediction as a multi-turn evidence-acquisition task. For each hypothetical action, an agentic simulator adaptively queries the real environment through safe read-only interfaces, reasons over the returned evidence, and uses executable computation to construct the resulting observation without mutating shared state. Integrated with trajectory-level TTS, AWM enables parallel exploration over a single shared environment. Across $\tau$-bench, AppWorld, and OfficeBench, AWM outperforms a single-shot simulation baseline by 40.07% on average, and surpasses a trained world-model baseline by 12.36% on average. These results establish interactive, read-grounded simulation as a practical foundation for safe and scalable agentic test-time scaling in shared, non-resettable environments.

76. 【2610.40926】CoFiBreak: A Coarse-to-Fine Diversity Reward for Effective Multi-Turn Jailbreak

链接:https://arxiv.org/abs/2610.40926

作者:Jialin Song,Xiaodong Liu,Weiwei Yang,Mingqian Feng,Chengquan Guo,Qiyao Ma,Carolyn Buractaon,Anson Ho,Wuyang Chen,Christopher White

类目:Computation and Language (cs.CL)

关键词:Automated red teaming, large language model, red teaming trains, Automated red, elicit harmful responses

备注: 10 pages main text, 24 pages total, 8 figures, 12 tables

点击查看摘要

Abstract:Automated red teaming trains an attacker large language model (LLM) to elicit harmful responses from a victim LLM, but reinforcement learning can collapse attackers onto a narrow set of prompts when attack success is the only reward. Such a collapse of attack diversity can bias safety evaluation toward repeatedly testing near-duplicate attack patterns rather than the underlying harmful intents. Existing methods often trade off attack success or inference cost for greater content or strategy diversity. We propose CoFiBreak, a coarse-to-fine diversity reward for Group Relative Policy Optimization (GRPO) that improves attack diversity while preserving strong attack effectiveness and low inference cost. The coarse reward broadens which strategies the attacker uses by encouraging strategies underrepresented within each GRPO group, while the fine reward broadens how those strategies are realized by discouraging reuse of the same personas, framings, and output formats after harmful-intent information is removed from prompt embeddings. Diversity rewards apply only to attacks that already exceed an effectiveness threshold, so diversity cannot be gained through ineffective attacks. Since both rewards are computed only during training, CoFiBreak also retains inference efficiency. Trained with Llama3.1-8B-Instruct as the victim, CoFiBreak discovers 1.6-2.0x as many distinct successful fine-grained strategies as the strongest baseline across frontier victims on HarmBench. It reaches 98.8% ASR@10 (attack success rate with 10 generations per intent) on AdvBench with the highest diversity score among all compared methods, which is 2.1x that of the strongest-attacking baseline. The resulting attacks transfer to unseen frontier LLMs, reaching 71.0% ASR@10 on AdvBench with the unseen victim Claude-Opus-4.6. The code will be released.

77. 【2610.40893】Qistas: A Pre-Registered, Portable Protocol for Fairness Evaluation of Large Language Models

链接:https://arxiv.org/abs/2610.40893

作者:Nawar S. Alseelawi,Mustafa S. Aljumaily

类目:Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词:translated versions carry, English-born and American, overwhelmingly English-born, large language models, translated versions

备注: 19 pages, 1 figure, 5 tables. Protocol paper; no model results. Pre-registration: [this https URL](https://osf.io/crg5n) . Reference implementation: [this https URL](https://github.com/nawaralseelawi/qistas)

点击查看摘要

Abstract:Fairness benchmarks for large language models (LLMs) are overwhelmingly English-born and American in their social categories; translated versions carry those categories into societies where they do not apply, and almost none fix their hypotheses before the models are run. We present Qistas (Arabic qistas, "the just balance"), a protocol for evaluating how LLMs treat the social, confessional, and regional constituencies of a society, portable across countries and instantiated first for Iraq. In its pilot form it measures only what needs no verdict on contested truth: procedural symmetry across matched counterfactual pairs, differential refusal, stereotype reliance under ambiguity, and terminological framing of documented events. Every measurement is paired by construction and analysed with paired machinery (sign-flip permutation tests, exact McNemar tests, template-clustered bootstrap intervals, Holm-corrected families), with a power analysis that states, before any data exist, the smallest effect each axis can detect after the design effect of template clustering. We release the authoring apparatus (a pruned 3x5 taxonomy with four cells closed by design, per-type checklists, a cumulative rulings log, a structural audit, and a human review notebook) and report its first field test: a semantic review of a 58-item seed bank in which 24 of 25 template groups failed at least one check. The defect patterns it exposed (evaluation criteria leaking into prompts, token-level swaps that break Arabic agreement, epistemically unbalanced pairs, single-theme refusal probes, unwritten dialect twins counted as coverage) are, we argue, general hazards of counterfactual fairness benchmarks. This is a protocol paper, not a results paper: no model has been evaluated, and the accompanying pre-registration commits the hypotheses, metrics, exclusion rules, and analysis plan that the pilot will follow.

78. 【2610.40883】Incongruence-Aware Evaluation of Multimodal Speech Emotion Recognition in Audio Large Language Models

链接:https://arxiv.org/abs/2610.40883

作者:Fengji Jing,Guy Laban

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

关键词:Voice-interactive large language, large language models, language models process, Voice-interactive large, large language

备注:

点击查看摘要

Abstract:Voice-interactive large language models process both what a speaker says and how they say it, yet the two channels do not always agree. We ask whether that disagreement degrades speech emotion recognition. Mapping text and audio into a shared valence-arousal-dominance space, we convert the distance between them into a continuous, threshold-free incongruence score with a two-component Gaussian mixture, and validate the score against human judgement. We evaluate three audiocapable models on acted, conversational and spontaneous speech (eNTERFACE'05, MELD and CMU-MOSEI). With the model held constant across modalities, incongruence raises the odds of error whenever audio is present, in every corpus, after controlling for the ground-truth emotion and for distance in the feature space. Supervised classifiers trained on the same features behave in the opposite way, which suggests that the difficulty lies in how these models combine raw evidence rather than in the signal itself. Text-only effects are unreliable: swapping only the model that reads the transcript reverses their sign on one corpus. Rebuilding the score without the emotion lexicon reproduces the central result, and among six simpler alternatives it is the only label-free score that predicts error in all three corpora. Code, data tables and prompts are released.

79. 【2610.40858】FARO: Function-Space Adaptive Return-to-Risk Optimization via Cross-Block Equal-Risk-Contribution Budget Allocation

链接:https://arxiv.org/abs/2610.40858

作者:Xiaojun Wu,Cehao Yang,Xuhui Jiang,Chengjin Xu,Jia Li,Jian Guo

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:large language model, MLP matrices, Training a large, current recipes divide, attention and MLP

备注: 20 pages, 5 figures

点击查看摘要

Abstract:Training a large language model is compute-bound, and current recipes divide the work between optimizers by hand: orthogonalized momentum for attention and MLP matrices, Adam-style updates for the rest. This division rests on human priors about which layer type deserves which geometry, and it fixes a single global update budget that every parameter block shares. We introduce FARO, a function-space adaptive optimizer that makes the partition of parameters into blocks the unit of decision. FARO gives each block a geometry by its realized counterfactual return, then freezes the routes and reallocates the frozen per-block budget by cross-block equal risk contribution (ERC), the risk-parity principle from portfolio theory. On a GPT-style model trained on FineWeb, the framework gives two results. First, its FARO-Adaptive arm reaches 3.2780 nats at the full schedule, matching NorMuonAndAdam (3.2794), the best hand-designed recipe: it recovers the human prior without hand-setting per-layer geometry. Second, FARO-ERC improves on that arm: it lowers the clean-data loss at every one of 6 seeds, by 0.0136 nats on average, a modest but robust gain. Its sign test, paired test, and confidence interval all agree, and it exceeds the measured run-to-run noise at no added time or memory. It works by trimming the riskiest blocks rather than expanding the safest, and it holds up under a corrupted stream, still lowering the mean loss and winning the seed majority. The source code is available at this https URL.

80. 【2610.40847】he Generative Gap Between Speculative Drafter and Continuous Diffusion Language Model

链接:https://arxiv.org/abs/2610.40847

作者:Yujian Chen,Hao Jiang,Guang Cheng,Weijian Luo,Tianyang Hu

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Continuous diffusion language, speculative drafters offer, drafters offer efficient, CDLMs generate independently, Continuous diffusion

备注:

点击查看摘要

Abstract:Continuous diffusion language models (CDLMs) and speculative drafters offer efficient language generation but are typically evaluated differently: CDLMs generate independently through iterative refinement, whereas drafters propose text for target-model verification and correction. We compare their architectures without verification, using LangFlow for CDLMs and adapting DSpark's Markov and recurrent-head architectures for standalone generation. All models are trained from scratch for unconditional, single-block OpenWebText generation at lengths 16, 128, and 1024, without target features or verification, using common preprocessing, backbone dimensions, and training-update budgets. We evaluate generation perplexity (GenPPL) with an external language model and distributional similarity to reference text with MAUVE. With default denoising steps equal to sequence length, LangFlow outperforms both DSpark variants on both metrics at lengths 128 and 1024, while DSpark-RNN leads at 16. A conditional KL analysis characterizes dependencies excluded by the Markov head's previous-token conditioning. Recurrent memory removes this restriction and improves both metrics, but the longer-sequence gap persists. Teacher probability matching further lowers Markov GenPPL without observed MAUVE gains. Increasing LangFlow's denoising steps at fixed weights improves both metrics at lengths 16 and 128, changing the length-128 ordering relative to DSpark-RNN. These results establish LangFlow's longer-sequence advantage under the evaluated budgets and highlight iterative full-sequence refinement as a route to improving standalone generation beyond gains from recurrent head memory.

81. 【2610.40751】Safin-1.5: Safety-Native Architecture and Verifiable Reasoning for Recursive Safety Improvement

链接:https://arxiv.org/abs/2610.40751

作者:Jingnan Zheng,Cheng Jin,Ming Zhang,Huan Sun,Zhongtian Ma,Kaisen Yang,Ziyuan Zhou,Tong Wu,Dongcheng Zhang,Yi Zhang,Xiao Wang,Han Qi,Shu Yu,Ermo Hua,Zongji Yu,Chaozhuo Li,Xiaoyu Wen,Zhekai Chen,Jiawei Zhou,Sirui Chen,Ning Ding,An Zhang,Tat-Seng Chua,Xiangnan He,Xia Hu,Bowen Zhou,Qiaosheng Zhang,Youbang Sun,Xiang Wang,Zhongyu Huang,Chaochao Lu

类目:Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:weaken existing safeguards, enables large language, pursue Safety RSI, enables large, existing safeguards

备注: 29 pages, 5 figures

点击查看摘要

Abstract:Recursive self-improvement (RSI) enables large language models to advance their capabilities through successive updates, but these updates can also introduce new risks and weaken existing safeguards. In line with the AI-45° Law, we pursue Safety RSI, in which safety develops as an intrinsic capability alongside general model capabilities through continual risk discovery and repair, while preserving utility and limiting over-refusal. We introduce Safin-1.5, a model built on a safety architecture and trained through recursive safety improvement, with an inference-time harness that extends its capabilities to formal reasoning. Our approach comprises three components: i) The safety architecture combines persistent safety states with hazardous-knowledge disentanglement. The former retains and selectively invokes safety knowledge, while the latter relocates targeted hazardous knowledge into removable experts, enabling its removal with minimal impact on general capabilities. ii) Recursive safety improvement establishes a discovery-evaluation-repair loop. The loop identifies new vulnerabilities and uses experimental feedback to develop repair strategies. It accepts updates only when they improve safety while preserving general capabilities and limiting over-refusal. iii) The formal reasoning harness combines the model's language understanding with symbolic inference and verification. Proof-obligation-guided semantic bridging recovers missing relations in formal representations, enabling symbolic solvers to construct checkable proofs under formalized premises and accepted semantic bridges. Experimental results demonstrate that Safin-1.5 achieves safety and reasoning performance, outperforming frontier models.

82. 【2610.40747】Mage-VL-Cowork: A Full Training Recipe to Learn Hybrid Computer Use From Evolved Harnesses

链接:https://arxiv.org/abs/2610.40747

作者:Xiaoyi Zhang,Haoqing Wang,Xinjie Zhang,Xiang Ming,Xing Wang,Senqiao Yang,Kaichen Zhang,Zhaoyang Jia,Andong Tan,Xinjiang Wang,Jinghao Guo,Yifei Shen,Xiao Li,Peng Zhang,Xun Guo,Jiahao Li,Shicheng Zheng,Jinglu Wang,Zongyu Guo,Wenxuan Xie,Bin Li,Yan Lu

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:combine visual GUI, visual GUI interaction, Effective computer-use agents, seamlessly combine visual, Effective computer-use

备注: Project page: [this https URL](https://microsoft.github.io/Mage)

点击查看摘要

Abstract:Effective computer-use agents (CUAs) should seamlessly combine visual GUI interaction with code and terminal execution within a single policy. We present Mage-VL-Cowork, a 4B hybrid CUA trained from a general multimodally aligned checkpoint through an end-to-end, progressive five-stage curriculum across midtraining, SFT, and RL. To power this curriculum at scale, Mage-CUA-Forge replaces per-task agent construction with reusable, skill-conditioned generation workflows and application-specific preparers, synthesizing 293,806 desktop and web tasks across 6,915 skills while reducing recurring per-task expenditure by 82.6%. Rather than directly distilling a default teacher, we evolve the teacher harness and instantiate specialized CUA harnesses to yield high-quality trajectories alongside stage-specific supervision. Mage-VL-Cowork-4B finally climbs to 66.0% on OSWorld-Verified through different training stages with more efficient reasoning cost, achieving state-of-the-art performance at its parameter size and pushing forward the frontier of on-device intelligence.

83. 【2610.40742】Prevented is Not Protected: What Attack Success Rate Hides about RAG

链接:https://arxiv.org/abs/2610.40742

作者:Chahana Dahal,Zuobin Xiong

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词:adversaries manipulate retrieved, Retrieval-Augmented Generation, influence model outputs, manipulate retrieved evidence, model outputs

备注:

点击查看摘要

Abstract:Retrieval-Augmented Generation (RAG) is vulnerable to knowledge poisoning, where adversaries manipulate retrieved evidence to influence model outputs. Existing defenses are primarily evaluated using attack success rate (ASR), which obscures defense-induced failures and the mechanisms behind apparent attack prevention. To address this issue, this work introduces \textbf{Aligned RAG Evaluation}, a matched-query protocol that jointly examines clean and poisoned responses, with and without defense. By combining matched conditions analysis, LLM-judge endorsement, and retrieval dependence controls, the proposed framework distinguishes prevented from introduced failures, target mentions from LLM endorsement, and single-passage influence from evidence composition. Experiments on HotpotQA and Natural Questions reveal that existing defenses can introduce unexpected target-positive answers, although they can prevent some attacks, while evaluation criteria can also change defense rankings. Our findings expose critical blind spots in ASR-based evaluation and motivate a more comprehensive assessment of RAG poisoning defenses. The code and the evaluation artifact are available at this https URL.

84. 【2610.40738】Apriel Voice 27B Preview: An Open Model for Speech, Reasoning, and Tool Use

链接:https://arxiv.org/abs/2610.40738

作者:Aman Tiwari,Akshay Kalkunte,Akintunde Oladipo,Jash Shah,Tara Bogavelli,Hoang Nguyen,Nishanth Madhusudhan,Vishal Juneja,Sridhar Nemala,Srinivas Sunkara,Sathwik Tejaswi Madhusudhan,Shruthan Radhakrishna,Masoud Hashemi,Kelechi Ogueji,Khalil Slimi,Saloni Mittal,Pulkit Pattnaik,Shashank Maiya,Dhruv Jhamb,Esakkivel Esakkiraja,Katrina Stankiewicz,Gabrielle Gauthier Melançon,Fanny Riols,Amit Saha,Lakshmi Sirisha Chodisetty,Nitin Aggarwal,Anil Madamala,Sagar Davasam,Segan Subramanian,Vikas Yadav,Sai Rajeswar Mudumba

类目:ound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

关键词:capable voice assistant, Apriel Voice, present Apriel Voice, reason over context, sustain conversations

备注:

点击查看摘要

Abstract:A capable voice assistant must do more than recognize words; it must understand requests, reason over context, sustain conversations, and act through tools. We present Apriel Voice 27B Preview, an open speech-language model that unifies these capabilities within a shared reasoning backbone while retaining text and image input modalities. Built on the post-trained Gemma 4 26B-A4B checkpoint, Apriel Voice directly processes speech and generates both responses and tool calls without requiring a separate dialogue model. We introduce a two-stage training procedure to adapt the model to speech. The first stage establishes the speech interface, while the second jointly adapts the projector and backbone through supervised fine-tuning, text replay, and source-dependent cross-entropy and forward Kullback--Leibler divergence supervision. Automatically constructed speech-conditioned dialogues provide conversational training data, while local teacher serving, overlapping teacher and student computation, and fused full-vocabulary losses enable efficient online distillation. In thinking mode, Apriel Voice achieves a score of 98.90 on Big Bench Audio, 81.13 on Speech-BFCL, and a task success rate of 65.51% on $\tau$-Voice, with a mean latency of 1.91 seconds. It also achieves 51.27% English EVA accuracy and 74.13% experience pass@1. Finally, we deploy Apriel Voice 27B Preview on a custom serving platform to support interactive voice interactions.

85. 【2610.40726】Li$^{2}$SAO: Lifting Light Singl-Rollout Asynchronous RL Optimization via Group-Relative Actor-Critic Bootstrapping

链接:https://arxiv.org/abs/2610.40726

作者:Zichen Bai,Yanli Wang,Yang Liu,Junhao Shi,Xueqin Liu,Jinguo Sun,Muye Li,Shaoqiang Zheng,Xuefei Diao,Zhuwei Zeng,Nan Duan,Peng Cao

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Asynchronous reinforcement learning, post-training large language, Single-rollout Asynchronous Optimization, large language models, Asynchronous Optimization

备注:

点击查看摘要

Abstract:Asynchronous reinforcement learning (RL) is becoming a mainstream paradigm for post-training large language models (LLMs), as it improves training efficiency by updating the model as rollouts arrive. Recent work argues that group-wise sampling in GRPO does not naturally fit asynchronous RL training because rollout lengths follow a long-tailed distribution, and proposes Single-rollout Asynchronous Optimization (SAO) to improve stability and off-policy behavior, especially on agentic tasks. However, SAO relies on a closed-source value model obtained from scaling value pretraining. In this paper, we analyze GRPO and LiSAO, our lightweight reproduction of SAO without the pretrained value model, on single-turn reasoning and multi-turn agentic tasks. We find that GRPO outperforms LiSAO on reasoning tasks, while the reverse holds on agentic tasks. Since the value model of LiSAO is not yet well trained , LiSAO lags behind GRPO substantially in early training steps. To address this issue, we propose Li$^{2}$SAO, which Lifts Light Single-rollout Asynchronous Optimization with group-relative actor-critic bootstrapping: while the critic is cold, a group-relative advantage trains the actor and a group-centered return trains the critic, after which training switches to single-rollout GAE. Experiments show that Li$^{2}$SAO catches up with or surpasses GRPO in early training and further raises the later performance ceiling. Code is available at this https URL.

86. 【2506.20856】Leaner Training, Lower Leakage: Revisiting Memorization in LLM Fine-Tuning with LoRA

链接:https://arxiv.org/abs/2506.20856

作者:Fei Wang,Baochun Li

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词:data extraction attacks, makes them vulnerable, extraction attacks, large language models, Memorization

备注:

点击查看摘要

Abstract:Memorization in large language models (LLMs) makes them vulnerable to data extraction attacks. While pre-training memorization has been extensively studied, fewer works have explored its impact in fine-tuning, particularly for LoRA fine-tuning, a widely adopted parameter-efficient method. In this work, we re-examine memorization in fine-tuning and uncover a surprising divergence from prior findings across different fine-tuning strategies. Factors such as model scale and data duplication, which strongly influence memorization in pre-training and full fine-tuning, do not follow the same trend in LoRA fine-tuning. Using a more relaxed similarity-based memorization metric, we demonstrate that LoRA significantly reduces memorization risks compared to full fine-tuning, while still maintaining strong task performance.

Subjects:

Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

Cite as:
arXiv:2506.20856 [cs.LG]

(or
arXiv:2506.20856v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2506.20856

Focus to learn more

              arXiv-issued DOI via DataCite</p>
87. 【2610.40685】Agentic Systems for Calibrating Cosmological Simulations

链接:https://arxiv.org/abs/2610.40685

作者:Chaipat Tirapongprasert,Matthew Ho

类目:Instrumentation and Methods for Astrophysics (astro-ph.IM); Computation and Language (cs.CL)

关键词:Calibrating a cosmological, high-dimensional parameter optimization, cosmological simulation, employ Bayesian optimization, parameter optimization task

备注: Accepted to the 9th annual workshop for Machine Learning the Physical Sciences (ML4PS). A starter code is available on [this https URL](https://github.com/chaipattira/SimulationCalibrator)

点击查看摘要

Abstract:Calibrating a cosmological simulation is an expensive, high-dimensional parameter optimization task. Previous works employ Bayesian optimization for automation, which treats the simulator as a black box and precludes the incorporation of human domain knowledge or workflow into the selection policy. We propose AgenticTuner, an agentic calibration pipeline with a present-day large language model serving as the optimizer who proposes the next parameter trial. We show that these agents can achieve competitive calibration performance at a fraction of the CPU cost when they are given informal, human-readable priors (such as codebase, documentation, and heuristic guides that seasoned scientists may possess). We hope this work serves as an early step toward AI scientists that can carry out complex, long-horizon scientific tasks.

信息检索

1. 【2610.41911】Recommendation Feedback Loops Shape Urban Income Segregation and Venue Visitation

链接:https://arxiv.org/abs/2610.41911

作者:Guangyuan Weng,Lin Chen,Ciro Beneduce,Giovanni Mauro,Massimiliano Luca,Takahiro Yabe,Bruno Lepri,Luca Pappalardo,Esteban Moro

类目:Information Retrieval (cs.IR); Computers and Society (cs.CY); Social and Information Networks (cs.SI); Physics and Society (physics.soc-ph)

关键词:Location-based recommender systems, human-AI feedback loop, feedback loop, feedback loop shapes, Location-based recommender

备注: 13 pages, 5 figures, 7 tables. Code: [this https URL](https://github.com/SUNLab-NetSI/recsys-city-feedback)

点击查看摘要

Abstract:Location-based recommender systems shape where people go in cities and learn from the visits they steer, forming a human-AI feedback loop. This feedback loop shapes whom people share places with across income groups and which venues keep attracting customers. Yet platforms judge these systems by their offline accuracy on past visits, a test in which the suggestions never change where people go and which therefore cannot capture long-term effects. Studying these effects in cities is challenging because, unlike online resources, travel constraints and limited venue capacity shape where people can go, while each recommended visit also changes whom other visitors encounter. To capture such features, we build a long-term simulation framework based on fine-grained human mobility data from four U.S. metropolitan areas, with distance and capacity constraints. Focusing on food venues, we study two urban consequences: how unevenly people's exposure is distributed across income groups (experienced income segregation) and the share of venues receiving no visits from simulated residents (venue disappearance). We find that, under every algorithm and in every metropolitan area, at least a fifth of venues stop receiving visits, and that more than half of this loss arises from retraining. More importantly, more accurate algorithms leave people more segregated, and the most accurate algorithm leaves people 15-21% more segregated than they actually are. We then test a re-ranking intervention that favours less popular venues and runs on top of a platform's existing algorithm. It lowers both venue disappearance and segregation across algorithms, largely without directing people to venues where they may feel less comfortable. Our results suggest that impact assessments of recommender systems should account for the feedback loop and report segregation and venue disappearance beyond accuracy.

2. 【2610.41905】Completeness and Cost of Retrieval Structures for Multi-Tool Requests in LLM Agents

链接:https://arxiv.org/abs/2610.41905

作者:Shuyang Zhang

类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词:LLM calls, tool retriever omits, queries, LLM, fulfill a request

备注: 17 pages, 3 figures, 9 tables

点击查看摘要

Abstract:An agent that must call several tools to fulfill a request fails when the tool retriever omits any one of them, yet tool retrievers are mostly built and evaluated on queries requiring a single tool. We compare representatives of six retrieval structures (flat lexical and dense retrieval, LLM query decomposition, LLM-navigated hierarchies, server-then-tool matching, dependency graphs, and trained set-level retrievers) across two multi-tool testbeds: 345 AppWorld queries with expert dependency labels and 103 MCP-Bench tasks over 257 MCP tools. We measure completeness@k, the share of queries whose entire required tool set appears in the top k, alongside the LLM calls, tokens, and latency that each structure incurs at retrieval time. A motivating analysis on all 7,961 ToolRet queries shows that aggregate completeness mixes two regimes: completeness at 10 is .58 to .67 on single-target queries and .08 to .17 on queries with four or more targets, and the ordering of retrievers on single-target queries reverses on multi-target ones. Across the two testbeds, none of the compared structures that is untrained on the testbed and makes at most one LLM call per query completes more than 10% of AppWorld queries at k = 16. The two structures that do better incur different costs: a set-level retriever trained on 75 to 90 in-domain queries reaches .33 on AppWorld and .58 on MCP-Bench with no LLM calls, while an LLM-navigated hierarchy reaches .30 and .40 with a median of 31 to 38 LLM calls and about five minutes per query. Their failure modes also differ: the trained retriever mostly ranks the missing tools just below the cutoff, whereas the hierarchy finds the target API and stops before collecting its prerequisites. In a downstream check with the official AppWorld agent, tasks with a complete retrieved set succeeded 21 of 21 times, whereas incomplete ones succeeded 2 of 39 times.

3. 【2610.41785】Peeling the Matryoshka: Extracting Ontological Structure from Retrieval Embeddings

链接:https://arxiv.org/abs/2610.41785

作者:Eunchan Kim,Inwhee Joe

类目:Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词:yield unstable hierarchies, careful per-corpus tuning, expensive task-specific training, Matryoshka Representation Learning, Taxonomy construction

备注: Accepted to EMNLP 2026 (Main Conference). 13 pages, 6 figures, 7 tables. Code: [this https URL](https://github.com/Eunchan24/PEEL)

点击查看摘要

Abstract:Taxonomy construction is essential for knowledge-intensive NLP yet remains costly: clustering-based methods (i) need careful per-corpus tuning and yield unstable hierarchies, while LLM-based pipelines (ii) depend on expensive task-specific training that does not transfer across domains. We report an empirical finding that bears on both: in Matryoshka Representation Learning (MRL) embeddings, where each leading prefix is itself a usable, coarser vector, prefix length aligns with the coarse-to-fine granularity of gold taxonomies; shuffled- and reverse-dimension controls isolate the alignment to the learned early prefix dimensions. The pattern holds across three architecturally distinct MRL models. To test whether this regularity is usable, we introduce PEEL (Peeling Embeddings to Extract Latent ontologies): a minimal probe over these frozen embeddings, trained once with an order-embedding objective that represents hierarchy as vector containment; a minimum spanning arborescence then decodes taxonomic DAGs. Using only a concept vocabulary (no documents), PEEL recovers taxonomic DAGs with high structural fidelity on two OLLM benchmarks, transferring to a new domain with no target-edge supervision. The end-to-end OLLM pipeline, which jointly discovers concepts and induces structure from document corpora, is reported as a cross-task reference. Pre-trained retrieval embeddings encode a decodable granularity gradient; a minimal probe renders it as explicit parent-child (is-a) structure.

4. 【2610.41738】Search When Needed, Proceed When Reliable: Metacognitive Reliability Supervision for Efficient Agentic Search

链接:https://arxiv.org/abs/2610.41738

作者:Minhao Sun,Zhijing Wu,Xian-Ling Mao

类目:Information Retrieval (cs.IR)

关键词:Efficient agentic search, requires large language, Efficient agentic, agentic search requires, search requires large

备注:

点击查看摘要

Abstract:Efficient agentic search requires large language models (LLMs) to determine whether they can reliably proceed with their current knowledge or need additional external evidence. Supervision based on final-answer correctness or trajectory-level feedback evaluates realized trajectory performance. However, observed trajectory performance is jointly shaped by stochastic generation, retrieval quality, and downstream reasoning. Such signals therefore provide only indirect evidence of how reliable the current decision state was and how retrieved evidence changed its reliability. An effective reward should encourage search when external information is needed and favor searches that contribute to the answer. To this end, we propose a metacognitive framework for training LLMs to make search decisions based on the reliability of their intermediate reasoning states. Our framework estimates the reliability of local conclusions to distinguish whether the current information supports proceeding without search from how much retrieved evidence improves that reliability. The current-state reliability score assesses whether the model can proceed without search. The search-action score measures how retrieved evidence changes estimated reliability. Together, these scores define a reliability-aware process reward for Group Relative Policy Optimization (GRPO), providing finer-grained supervision for search and no-search behavior. Experiments across seven question-answering benchmarks demonstrate that our method achieves a better accuracy-efficiency trade-off than strong agentic-search baselines. Our code and model checkpoints will be open-sourced.

5. 【2610.41674】owards Trustworthy Multi-stakeholder Recommender Systems

链接:https://arxiv.org/abs/2610.41674

作者:Katarina Marcincinova,Adrian Gavornik,Matus Mesarcik,Michal Kompan

类目:Information Retrieval (cs.IR)

关键词:Recommender system, solve often contrasting, contrasting requirements, requirements and expectations, expectations from dozens

备注: [this https URL](https://proceedings.mlr.press/v294/marcinc-inova25a.html)

点击查看摘要

Abstract:Recommender system (RS) nowadays has to reflect, combine, and solve often contrasting requirements and expectations from dozens of stakeholders. In fact, the problem is even more complicated as each of the stakeholders can simultaneously have various objectives creating a diverse and complicated environment with several stakeholders and their objectives in which a RS operates. To address this problems the Multi-objective and Multi-stakeholder RS have been studied in the literature. However, a limited attention has been paid to trustworthiness aspects of such RS, which slowly becomes a new standard. In this paper, we highlight open challenges and important questions which need to be addressed on the way to trustworthy Multi-stakeholder RS.

6. 【2610.41552】Enhancing Knowledge Entity Relation Extraction in Abstracts and Full-text Content of Academic Articles Using Large Language Models

链接:https://arxiv.org/abs/2610.41552

作者:Yingyi Zhang,Chengzhi Zhang

类目:Computation and Language (cs.CL); Digital Libraries (cs.DL); Information Retrieval (cs.IR)

关键词:entity relation extraction, large pre-trained language, knowledge entity relation, pre-trained language models, relation extraction

备注:

点击查看摘要

Abstract:This study investigates the effectiveness of large pre-trained language models (LLMs) for knowledge entity relation extraction (KERE) from academic papers. Existing studies have examined individual types of LLM-based strategies and evaluated model performance using metrics such as precision and recall. To provide a broader evaluation, this study investigates multiple strategies, including closed-source LLM-based CoT prompting, LoRA-adapted open-source LLMs, LLM-enhanced small pre-trained language models (SLMs), and SLM-enhanced closed-source LLMs. In addition, this study introduces two strategies, namely SLM-enhanced open-source LLMs and closed-source LLM-enhanced open-source LLMs. These strategies are evaluated from multiple perspectives, including metrics, their ability to mitigate errors observed in SLMs, and potential directions for model optimization. This study manually constructs two annotated datasets in the NLP domain, covering Abstract and Full-Text datasets. Experimental results show that the LoRA-adapted T5 model achieves the highest macro F1 scores of 0.7408 and 0.7013 on the Abstract and Full-Text datasets, respectively. SLMs also benefit from LLM-generated entity descriptions under the LLM-enhanced SLM strategy. Error analysis further reveals that the effectiveness of LLM-based strategies in mitigating SLM errors varies across error types. Based on the identified limitations and error patterns of these strategies, several optimization directions are proposed. In addition, combining strategies with different error patterns further improves KERE performance.

7. 【2610.41521】KITE: Retrieval as a Decision Procedure for Long-Term Conversational Memory

链接:https://arxiv.org/abs/2610.41521

作者:Feng Li,Kailun Tan,Zhibo Zhou,Youxiang Wang,Lejun Liu,Huaigu Li,Fei Du,Huilong An

类目:Information Retrieval (cs.IR)

关键词:systems for LLM, LLM agents, long-term memory systems, agents are built, built around embedding-based

备注: 15 pages, conference

点击查看摘要

Abstract:Many long-term memory systems for LLM agents are built around embedding-based retrieval. Al- though effective for semantic matching, similarity ranking alone does not establish whether re- trieved memories satisfy the conditions implied by a question. In this paper, we introduce KITE (Knowledge-Indexed Temporal Evidence), a vector-free framework that formulates memory re- trieval as an explicit decision procedure. KITE organizes multi-session conversations as structured knowledge indexed by a governed topic vocabulary, which evolves through controlled expansion and consolidation. At query time, questions are compiled into inspectable retrieval plans over the same knowledge index that guides memory construction. The plans are then executed through fixed lookup and ranking operations, while sparse lexical retrieval recovers surface details omitted from the structured representation. Experiments on LoCoMo and LongMemEval-S show that KITE achieves 93.5% and 86.0% accuracy while using only about 1.6k reader-context tokens per ques- tion. These results demonstrate that conversational memory can move beyond similarity ranking by unifying memory construction and query compilation around a governed index, turning retrieval into an inspectable decision procedure for determining which evidence satisfies the question.

8. 【2610.41425】How BERT-based Cross-Encoders Model Relevance in Information Retrieval?

链接:https://arxiv.org/abs/2610.41425

作者:Mathias Vast,Basile Van Cooten,Laure Soulier,Benjamin Piwowarski

类目:Information Retrieval (cs.IR)

关键词:Information Retrieval, Cross-encoders, efficient models, Retrieval, relevance

备注: Under review

点击查看摘要

Abstract:Cross-encoders are the most effective but also the least efficient models in Information Retrieval. Despite their success, the mechanisms underlying their relevance predictions remain poorly understood, particularly how they process to match queries and documents. This lack of interpretability limits their optimization, can lead to suboptimal retrieval, especially out-of-domain, and raises efficiency concerns for over-parameterized models. To address these challenges, this paper investigates two under-explored aspects of cross-encoder behavior. First, to understand the relevance prediction process, we trace the flow of information at the different stages of the process and between different input segments. We study the nature of the signals that compose this flow and that allow cross-encoders to predict the relevance of a passage to a query. Our work particularly focuses on the matching performed by the cross-encoders between queries and documents. Second, we explore how cross-encoders behave with out-of-domain documents and/or queries. Through a series of interpretability experiments, we evaluate three BERT-based cross-encoder models, varying in size and pre-training strategies, across both in-domain and out-of-domain datasets. Overall, this study both consolidates what is known about how cross-encoders model relevance and extends it by exploring the role of matching signals.

9. 【2610.41407】Fidelity Synopses: Pre-Execution Plan Selection for Approximate Vector Search

链接:https://arxiv.org/abs/2610.41407

作者:Adithya Ramanatha,Sanskar S. Singh,Maya Ramanath

类目:Databases (cs.DB); Information Retrieval (cs.IR)

关键词:physical implementations, build-time and search-time, search-time parameters, disk-resident variants, database operator

备注:

点击查看摘要

Abstract:Vector search has become a database operator with many physical implementations: different index families, build-time and search-time parameters, and compressed or disk-resident variants. Each trades cost against fidelity, the fraction of a query's exact top-k nearest neighbors that a configuration returns. Deployments nevertheless choose one configuration offline and use it for every query, so they are sized for their hardest queries and overpay for the rest. On a 5.8M-item LAION benchmark with four embedding models, running each query on the cheapest configuration that suffices for it would roughly halve the cost in a typical setting. Exploiting this requires predicting each configuration's fidelity before running it, which is hard because fidelity is defined by the very exact search that approximate indexes avoid. Relational optimizers solve the analogous problem for cardinality with offline synopses; we propose one for vector search. A fidelity synopsis divides the embedding space into cells around a set of landmarks and records, for every cell and configuration, how often that configuration met a fidelity target on a sample of queries. At query time, one nearest-landmark lookup yields a calibrated estimate for every configuration, and an optimizer chooses configurations so that the workload misses the target no more often than its requirement allows. We test the two premises the synopsis relies on, that fidelity varies smoothly across the embedding space and that its loss is specific to each configuration. Held to the same requirement a static deployment is built to meet, synopsis-guided selection lowers cost in all 16 combinations of model and query direction, to a median of 0.72x the static deployment, with a batched lookup of 21-32 microseconds per query. The saving persists against the best static choice among the same indexes, and within a single index at no extra memory.

10. 【2610.41396】ProSearch: Benchmarking Multi-Constraint Protocol Retrieval in Experimental Science

链接:https://arxiv.org/abs/2610.41396

作者:Wenliang Liang,Zhiyuan Ning,Haolin Chen,Yuanchun Zhou,Wenjuan Cui,Yi Du

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:method reproduction require, reproduction require retrieving, satisfy multiple interdependent, lack systematic evaluation, require retrieving protocols

备注: Accepted to NeurIPS 2026 (Evaluations and Datasets Track). 48 pages, 4 figures. Wenliang Liang and Zhiyuan Ning contributed equally. Code: [this https URL](https://github.com/kg4sci/ProSearch) . Data: [this https URL](https://huggingface.co/datasets/kg4sci/ProSearch)

点击查看摘要

Abstract:In AI for Science scenarios, experimental design and method reproduction require retrieving protocols that satisfy multiple interdependent constraints, yet existing benchmarks lack systematic evaluation of this capability. To address this gap, we introduce ProSearch, a benchmark for multi-constraint protocol retrieval in experimental science. ProSearch has three key features: (1) realism, with queries grounded in real experimental records and expert-defined templates; (2) complexity, with 60 experimental fields and their dependencies; and (3) diagnosticity, with 3-5 explicit constraints per query, including numerical and negation constraints. We construct ProSearch through LLM-based extraction, data-driven constraint selection, controlled query generation, and evidence-based relevance validation. The resulting benchmark contains 1,515 queries across six experimental science domains. We conduct extensive experiments on ProSearch with 19 representative retrievers and complementary analyses. The best-performing retriever achieves an average nDCG@10 of only 0.290, which improves to 0.474 with reranking. Structured diagnostic analysis shows that explicit constraint matching provides a strong ranking signal, while manual error analysis identifies joint constraint binding as a key bottleneck. ProSearch provides a testbed for systematically evaluating scientific retrieval systems.

11. 【2610.41390】Hierarchical Dual-Graph Retrieval for Long-form Audio Reasoning

链接:https://arxiv.org/abs/2610.41390

作者:Eunsang Lee,Taein Ju,Jiyoung Lee

类目:ound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

关键词:Large audio language, substantial computational cost, audio language models, capture query-relevant content, query-relevant content distributed

备注:

点击查看摘要

Abstract:Large audio language models (LALMs) struggle with long-form audio reasoning, as processing entire recordings often limits to capture query-relevant content distributed across distant segments while incurring substantial computational cost. We introduce AudioHelix, a hierarchical DualGraph framework tailored for LALMs' retrieval-augmented generation (RAG) systems. Unlike existing text-only or non-graph RAG approaches, AudioHelix connects related textual and acoustic evidence across temporally distant segments for multi-hop reasoning. Extensive experiments on TraceAV-Bench, MMAU-Pro, and AudioMarathon demonstrate that AudioHelix consistently outperforms full-audio processing and existing RAG methods. The project site is this https URL.

12. 【2610.41374】BrowseFlow: Sparse Event Flow Matching for Generative User Simulation

链接:https://arxiv.org/abs/2610.41374

作者:Yitian Pang,Jiayi Zhang,Zhenjia Ma,Xiaowei Yue,Dagui Chen,Jian Xu

类目:Information Retrieval (cs.IR)

关键词:Key Events, online platforms, User simulation aims, User simulation, Sparse Key Events

备注:

点击查看摘要

Abstract:User simulation aims to reproduce how users interact with content and products across online platforms. Recent generative approaches have enriched user simulation with behavioral history and contextual information. However, realistic browsing simulation still faces two challenges. (i) Stochastic Responses: Even with the same recommendation feed, the same user may produce different browsing responses, yielding distinct behavioral trajectories. A logged trajectory records only one such realization. (ii) Sparse Key Events: Clicks and likes provide important feedback but occur sparsely within browsing trajectories dominated by progression actions such as scrolling. Many stepwise simulators predict these actions in a dense sequence, where key events contribute relatively few training targets. To address these challenges, we propose BrowseFlow, a conditional discrete flow matching method for generative user simulation. For Sparse Key Events, BrowseFlow represents each response by its browsing extent and an ordered sequence of key events, directly modeling their counts and locations under exposure constraints. BrowseFlow learns the conditional distribution of complete browsing responses through probabilistic extent prediction and discrete flow matching over key events. Random event retention defines probability paths over partial event sequences, while transition rate matching learns stochastic insertion dynamics. For Stochastic Responses, we use the energy score, a proper scoring rule, to evaluate response fidelity and generated variability, complemented by the Wasserstein distance between key event count distributions. We further introduce TaobaoBrowse, a benchmark pairing real recommendation contexts with fine-grained browsing trajectories. Experiments across three datasets demonstrate that BrowseFlow consistently achieves the best distributional performance.

13. 【2610.41360】Defining Page-Centric Visual Document Retrieval and Evaluating Existing Benchmarks

链接:https://arxiv.org/abs/2610.41360

作者:Chongzhi Zhang,Yuqi Zuo,Aixin Sun

类目:Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV)

关键词:visually rich, flat text, structured sequences, sequences of visually, Visual Document Retrieval

备注:

点击查看摘要

Abstract:In modern information retrieval (IR), documents are increasingly encountered as structured sequences of visually rich, paginated units, rather than as flat text. Example documents encountered in our daily life include Word files, PDFs, and slide decks. Free text-centric retrieval systems either ignore this structure entirely or destroy it through arbitrary passage chunking. In this paper, we formulate page-centric Visual Document Retrieval (VDR) with pages as the fundamental indexing units and document context available for assessing page relevance. The formulation distinguishes two retrieval granularities, page and document, and three retrieval paradigms: independent-item, evidence-set, and iterative retrieval. We then assess 42 benchmarks using eight criteria covering corpus characteristics, query construction, relevance annotation, and ranking support. Our analysis shows two main findings on current VDR research. First, evaluation remains concentrated on page-level independent-item retrieval, with fewer resources supporting document-level, evidence-set, and iterative settings. Second, queries originating from real user information needs independently of target corpus content and graded relevance judgments are uncommon, while the coverage and verification of relevance judgments vary substantially. Both findings reveal gaps between the capabilities applications require and those existing evaluation protocols can establish. We provide benchmark selection guidance and identify priorities for future benchmark design, emphasizing alignment between task requirements, relevance semantics, and evaluation protocols.

14. 【2610.41335】Pix2Evidence: A Multimodal RAG System for Text and Visual Evidence

链接:https://arxiv.org/abs/2610.41335

作者:Ziniu Liu,Xiaoyang Chen,Dezhi Ye,Jie Liu,Jin Ma,Hao Deng

类目:Information Retrieval (cs.IR)

关键词:visually rich documents, Retrieval-augmented generation, visually rich, rich documents, documents must find

备注:

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) over visually rich documents must find both relevant content and the evidence that supports an answer. Screenshot retrieval preserves images and page structure, but written facts within screenshots also need to be searchable. Moreover, topical relevance alone does not identify which retrieved tile contains evidence for the answer. We introduce Pix2Evidence, a multimodal RAG system that encodes each screenshot tile together with its available transcription into a single fused image--text representation, so that layout and readable text are considered jointly during retrieval. To guide evidence selection, a vision-language teacher describes the visible content that supports each training question. We use these descriptions to adapt the retriever, then rerank the retrieved candidates before answer generation. Extensive experiments demonstrate that Pix2Evidence outperforms state-of-the-art methods. Across five widely-used Wikipedia QA benchmarks, the non-reranked Pix2Evidence leads the main comparison in answer accuracy on four. On MMSearch, it reaches 26.0\%, 4.4 percentage points above PixelRAG. We will release the code and share derived data where licensing and privacy reviews permit.

15. 【2610.41319】MILES-Rec: Uncovering Implicit Intents from Mobility Behaviors for Cross-Domain POI Recommendation

链接:https://arxiv.org/abs/2610.41319

作者:Yi Zou,Wei Luo,Xuewen Zhang,Zhuang Yan,Pengjie Wang

类目:Information Retrieval (cs.IR)

关键词:applications bridge everyday, bridge everyday mobility, uncovering users' implicit, Map applications bridge, users' implicit intents

备注: 12 pages, 7 figures, 10 tables

点击查看摘要

Abstract:Map applications bridge everyday mobility with local services, creating opportunities to recommend places by uncovering users' implicit intents. However, utility-driven map interactions provide only indirect and incomplete evidence of consumption demands, making it challenging to infer personalized service needs from observed behaviors. We propose MILES-Rec, a cross-domain POI recommendation framework that infers latent service intents from heterogeneous map behaviors and expresses them as prioritized natural language queries. It first learns from progressive reasoning demonstrations that synthesize user profiles and map histories for situation understanding, intent expansion, and query prioritization. We then introduce intent-aligned group relative policy optimization, using subsequent user interactions to reward query relevance and ranked service coverage while penalizing redundancy and excessive response length. A two-level credit assignment mechanism integrates shared list-level advantages with query-specific advantages, coordinating individual query quality with the complementary coverage of the complete query list. We further construct MILES-Bench from real user interaction logs on a large-scale mapping platform, supporting training and evaluation across diverse services under rich and sparse behavioral histories. Extensive experiments against general-purpose LLMs and specialized recommendation baselines demonstrate superior POI retrieval utility and strong service and semantic alignment, with consistent gains from behavioral policy optimization across four backbone scales.

16. 【2610.41172】Context as Infrastructure: Knowledge Compilation for Retrieval in Agentic Systems with Harnesses

链接:https://arxiv.org/abs/2610.41172

作者:Zhichang Yu,Baining Cao,Sbaaoui Idriss,Qi Wang,Gangqiang Xu,Ling Qin,Xiaoling Jin,An Liu,Shaohao Cai,Xiaoyang Bao,Shengle Chen,Changchang Ding,Pengfei Zhu,Jingxiang Xu,Yifeng Mao,Lu Liu,Hai Jin,Yingfeng Zhang

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Retrieval-augmented generation, Retrieval-augmented, harness writes queries, search harness writes, harness

备注: 13 pages, 2 figures

点击查看摘要

Abstract:Retrieval-augmented generation is becoming agentic. A search harness writes queries, reads results, reformulates, and decides when to stop. This largely solves accuracy: a harness with only BM25/grep and MiniMax M3 answers 85% of BrowseComp-Plus and 91% on multi-hop FRAMES in our runs, without compiled or vector indexes. It exposes a context problem: an undisciplined loop repeats queries, rereads documents, and fills the window with unused passages. The missing layer is knowledge compilation: a configurable ingestion pipeline where LLMs enrich documents with context no chunk contains alone--navigation hierarchies with claim-evidence leaves, entity graphs, timelines, mind maps, ontologies, wikis, and memory. Compilation is not a better retriever: under a competent harness, structural artifacts gave no detectable accuracy gain on FRAMES, and a PageIndex-style outline degraded at scale. It is a supply layer. A navigation tree whose leaves are claim-evidence pairs--the mechanism we measure--cuts query tokens by 91% when evidence suffices and adds 1.9% when it does not, a 38% average reduction; this implies a 2% break-even sufficiency rate and a measured rate near 43%. A decision gate cuts latency from 140 s to 30 s, though substitution's token saving is bought with retrieval rounds and carries its own latency cost. Other artifacts--ontology, graph, wiki, timeline, mind map, memory--pay off in deployment (governance, integration, onboarding, temporal orientation, continuity) where accuracy benchmarks cannot see them. We describe RAGFlow's pipeline and harness (open source at this https URL), which turns the loop into five disciplined stations and keeps the context entering the model the smallest sufficient set; together they form an agent-native database: a store that hands the agent compiled, governed context instead of a ranked list of passages.

17. 【2610.41037】WebOverlay: High-Throughput Vision-Only Distillation for Extreme Aspect-Ratio Web Overlay Detection

链接:https://arxiv.org/abs/2610.41037

作者:Jiannan Huang,Jerry Ding,Li Yu,Zhenting Li

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词:cookie consent banners, downstream document representations, degrade downstream document, obstruct automated web, automated web crawlers

备注: 9 pages, 2 figures, 2 tables

点击查看摘要

Abstract:Web overlays, such as cookie consent banners, newsletter prompts, and age gates, obstruct automated web crawlers and degrade downstream document representations. While proprietary multimodal Large Language Models (MLLMs) can accurately identify overlays, their latency and inference cost preclude web-scale ingestion. Conversely, lightweight vision models struggle with full-page renderings characterized by extreme vertical aspect ratios, where standard isotropic resizing collapses critical text features and causes false positives. In this work, we present WebOverlay, a high-throughput vision-only detector trained via distillation from a frontier vision-language teacher. We establish a dynamic tiling strategy that partitions extreme aspect-ratio web renders into aspect-preserving patches with spatial overlap, coupled with an aspect-ratio-aware boundary adjudication mechanism to eliminate boundary artifacts. To eliminate cross-modal latency overheads, our student model relies purely on visual cues, bypassing DOM tree parsing. WebOverlay significantly outperforms DOM-based heuristics and achieves competitive precision and recall against heavy proprietary MLLM baselines while delivering multiple orders of magnitude higher throughput and substantially reduced deployment costs.

18. 【2610.40971】FieldGuideRAG: Image-Grounded GraphRAG for Fine-Grained Recognition with Vision-Language Models

链接:https://arxiv.org/abs/2610.40971

作者:Jiacheng Ding,Yanliang Qi,Cong Guo,Peihua Mai

类目:Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

关键词:training-free GraphRAG method, recognizes fine-grained species, real photographs stored, vision-language model, recognizes fine-grained

备注:

点击查看摘要

Abstract:We present FieldGuideRAG, a training-free GraphRAG method in which a vision-language model, or VLM, recognizes fine-grained species by comparing the query with real photographs stored on the nodes of a knowledge graph. Multimodal GraphRAG systems describe each entity in text, and text conveys little of the visual detail that separates look-alike species. Our graph stores one photograph on every species node and links each species to its relatives, its geographic range and its ecological facts. A frozen VLM verifies the query against the photograph of each candidate node. FieldGuideRAG fuses the verification scores with the range edge and answers questions about the organism from the fact edges of the verified species. On CUB-200, a Wikidata graph and four iNaturalist domains, the node photograph improves verification over the species name on every graph, while text descriptions add little. Verification of the candidate pool exceeds a SigLIP retriever by up to 16 points, the range edge adds 7 to 19 points on iNaturalist, and answering from fact edges is correct on up to 89.5% of 28,820 ecological questions. The verification scores also detect queries whose species is missing from the graph. Graphs, prompts and code will be released.

19. 【2610.40855】ProdCrawl: A Replayable Test Collection for Focused Crawling

链接:https://arxiv.org/abs/2610.40855

作者:Manuel Rey-Escobar,David Otero,Javier Parapar

类目:Information Retrieval (cs.IR)

关键词:constrained download budget, download budget, searches for web, specific topic, constrained download

备注:

点击查看摘要

Abstract:A focused crawler searches for web pages on a specific topic under a constrained download budget. Since it can only fetch a limited number of pages, its success depends on choosing which links to follow. Focused crawlers are usually evaluated on live websites by harvest rate, the fraction of downloaded pages that are relevant. This has two problems: on the one hand, websites change over time, so a crawl cannot be repeated under the same conditions; on the other hand, there is no ground truth for which pages are relevant. As a result, comparisons between crawlers are unreliable. We present ProdCrawl, a replayable test collection for focused crawling. It comprises static mirrors of 621 company and organization websites, about 1.1 million pages, with each page labeled as a product page or non-product page based on a majority vote among three large language models. Any crawler can be run on exactly the same sites and scored against the same labels. We use ProdCrawl to compare simple baselines (breadth-first, depth-first and text classifiers) with an approach that scores each link by searching for similar link texts whose target pages have already been labeled. Our results show that text classifiers and keyword matching do not significantly outperform breadth-first crawling, whereas neural embeddings, which compare link texts by semantic meaning, outperform all simple strategies. Because every run evaluates over identical pages and labels, these results are exactly reproducible. The collection, codebase, and models are publicly released to support experimental replication and fair crawler comparison.

20. 【2610.40768】Retrieve-then-Disambiguate: Scalable Reviewer Discovery

链接:https://arxiv.org/abs/2610.40768

作者:Vicente Amado Olivo,Joe Petrecca,Wolfgang E. Kerzendorf

类目:Information Retrieval (cs.IR); Digital Libraries (cs.DL)

关键词:peer review process, researchers remains unidentified, review process, potential reviewers, relevant researchers remains

备注:

点击查看摘要

Abstract:The growing number of scientific submissions is straining the peer review process, while a large pool of relevant researchers remains unidentified and is therefore not considered as potential reviewers. We formulate the discovery of these researchers as a retrieval problem: given a submission, we retrieve and rank researchers based on domain similarity. We present retrieve-then-disambiguate, an open-source algorithm that identifies domain relevant researchers for a query submission by retrieving similar publications from the scientific literature and resolving ambiguous author names into unique researcher identities. We evaluate the algorithm on 500 astronomy and physics publications. We use ORCID-linked first authors, coauthors, and cited researchers as proxy labels to evaluate the recovery of researchers with known connections to each query publication. When retrieving the top 500 most similar papers, the algorithm recovers roughly 68\% of first authors, 60\% of coauthors, and 45\% of cited researchers. Our code is available at this https URL.

21. 【2610.40742】Prevented is Not Protected: What Attack Success Rate Hides about RAG

链接:https://arxiv.org/abs/2610.40742

作者:Chahana Dahal,Zuobin Xiong

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词:adversaries manipulate retrieved, Retrieval-Augmented Generation, influence model outputs, manipulate retrieved evidence, model outputs

备注:

点击查看摘要

Abstract:Retrieval-Augmented Generation (RAG) is vulnerable to knowledge poisoning, where adversaries manipulate retrieved evidence to influence model outputs. Existing defenses are primarily evaluated using attack success rate (ASR), which obscures defense-induced failures and the mechanisms behind apparent attack prevention. To address this issue, this work introduces \textbf{Aligned RAG Evaluation}, a matched-query protocol that jointly examines clean and poisoned responses, with and without defense. By combining matched conditions analysis, LLM-judge endorsement, and retrieval dependence controls, the proposed framework distinguishes prevented from introduced failures, target mentions from LLM endorsement, and single-passage influence from evidence composition. Experiments on HotpotQA and Natural Questions reveal that existing defenses can introduce unexpected target-positive answers, although they can prevent some attacks, while evaluation criteria can also change defense rankings. Our findings expose critical blind spots in ASR-based evaluation and motivate a more comprehensive assessment of RAG poisoning defenses. The code and the evaluation artifact are available at this https URL.

22. 【2610.40658】Explain, Then Forget: Recommendation Unlearning under Asymmetric Access Constraint

链接:https://arxiv.org/abs/2610.40658

作者:Haichao Zhang,Chong Zhang,Wen Wang,Shi Qiu,Peiyu Hu,Jia Wang

类目:Information Retrieval (cs.IR)

关键词:longer affect future, outdated user preferences, affect future recommendations, specific historical interactions, specific historical

备注: 10 pages, 6 figures. Accepted ICDM 2025 (IEEE International Conference on Data Mining)

点击查看摘要

Abstract:Recommendation unlearning aims to remove the influence of specific historical interactions that should no longer affect future recommendations, such as noisy clicks or outdated user preferences. However, performing recommendation unlearning becomes much harder in modern Machine-Learning-as-a-Service (MLaaS) architectures, where the recommendation model is remotely hosted by a model provider (MP) and accessed by service operators (SO) only through APIs. In this setting, a service operator serves end users but cannot access or modify internal model parameters. As a result, existing unlearning methods are difficult to apply because they require access to model internals for retraining, fine-tuning, or other parameter updates. To address these challenges, we propose Causal Explanation-based Unlearning (CEU), a novel unlearning framework tailored for MLaaS environments. Instead of modifying internal model weights, CEU operates through a two-step output-level score intervention. First, it estimates how the forgotten interaction causally contributes to the current recommendation. Second, guided by this causal signal, the system removes the influence of the forgotten interaction by adjusting the final ranking scores of affected items. Because CEU leaves model parameters untouched, it naturally supports continuous unlearning requests while avoiding the error accumulation that can result from repeated parameter updates. Extensive experiments on three public datasets show that CEU achieves unlearning effectiveness comparable to full retraining while preserving recommendation utility and significantly reducing computational cost. The source code is available at: this https URL.

计算机视觉

1. 【2610.42152】GazeRIB: Systematic Evaluation of Multi-Reader Gaze-Guided Chest X-ray Learning

链接:https://arxiv.org/abs/2610.42152

作者:Nattakorn Kittisut,Roy M. Gabriel,Marly van Assen,Mohammadreza Zandehshahvar,Carlo N. De Cecco,Elizabeth A. Krupinski,Ali Adibi

类目:Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Image and Video Processing (eess.IV); Signal Processing (eess.SP)

关键词:Radiologists' visual attention, medical image learning, supervise medical image, Radiologists' visual, Gaze-guided Radiologist-Informed Blackout

备注: 20 pages on main manuscripts (3 tables + 4 figures), 14 pages supplementary (10 tables + 8 figures)

点击查看摘要

Abstract:Radiologists' visual attention can supervise medical image learning, but how reader panel composition affects its value remains untested. We evaluated GazeRIB (Gaze-guided Radiologist-Informed Blackout), which masks unviewed regions during training and uses unmasked images at inference. Eight experts repeatedly read the same 80 chest X-rays (CXRs). We compared individual readers with three-, five- and eight-reader panels across seven architectures and 10 seeds, evaluating 910 models on a separate 2,897-CXR cohort for four-class severity prediction. Every panel improved macro F1 over the no-gaze baseline by 5.33-7.47 percentage points (pp; Bonferroni-adjusted p 0.007); no individual reader reached significance on this endpoint. Three readers captured 73-80% of the eight-reader gain in macro F1, the area under the receiver-operating-characteristic curve (ROC-AUC) and the area under the precision-recall curve (AU-PRC). On external validation without retraining, all four panels improved ROC-AUC on SIIM-FISABIO-RSNA by +1.93 to +4.24 pp (p = 0.004); on MIMIC-Eye no panel differed significantly from baseline, whereas the single-reader average declined (-1.40 pp, p = 0.008). Reader composition therefore influenced performance, although transfer depended on the cohort.

2. 【2610.42149】Latent Reasoning in Continuous Space for Unified Multimodal Models

链接:https://arxiv.org/abs/2610.42149

作者:Byungwoo Jeon,Yoonwoo Jeong,Hyunseok Lee,Minsu Cho,Jinwoo Shin

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Unified Multimodal Models, Unified Multimodal, effectively leverage language-based, diverse multimodal understanding, Multimodal Models

备注: Published as conference proceeding for NeurIPS 2026. Last two authors advised equally

点击查看摘要

Abstract:Unified Multimodal Models (UMMs) achieve remarkable success on diverse multimodal understanding and generation tasks, yet they still struggle to effectively leverage language-based chain-of-thought reasoning for image generation. As a result, existing reasoning-augmented UMMs often fail to inherit the test-time scaling and fine-grained controllability observed in large language models. We attribute this failure to a fundamental modality mismatch: reasoning is performed in a discrete token space, whereas image generation operates in a continuous space. To bridge this gap, we introduce a Latent Reasoning framework in Continuous space (LARC), which alleviates the token-level bottleneck by reasoning over continuous hidden states. Specifically, the training framework consists of two stages: (i) curriculum supervised fine-tuning (SFT), and (ii) information-gain reinforcement learning (RL). First, the curriculum SFT stage gradually converts token-level reasoning into latent reasoning. Subsequently, the information-gain RL stage self-evolves latent reasoning without ground truth supervision. Experiments across diverse text-to-image generation benchmarks show that LARC consistently improves generation quality, prompt following, and compositional fidelity. Notably, LARC achieves state-of-the-art performance on GenEval with a 7%p gain over BAGEL and demonstrates clear test-time scaling behavior, outperforming token-based generation under both parallel and sequential test-time scaling strategies.

3. 【2610.42145】SemEllipsoid: Semantic-aware Shape Abstraction with Ellipsoid

链接:https://arxiv.org/abs/2610.42145

作者:Kuankuan Cheng,Haocheng Yuan,Changjian Li

类目:Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

关键词:actively studied problem, primitive-based representation, actively studied, computer graphics, graphics with wide

备注:

点击查看摘要

Abstract:Representing 3D shapes using a set of primitives - known as shape abstraction - is an actively studied problem in computer graphics with wide applications in shape understanding, analysis, and simulation due to the compactness and computational efficiency of the primitive-based representation. Prior work has primarily focused on geometry-aware shape abstraction, where the objective is to approximate the input shape with a minimal set of primitives while preserving geometric fidelity. However, these methods often overlook semantic consistency, inevitably leading to primitives that span across multiple semantic parts. Such inconsistency can cause undesirable artifacts in downstream tasks such as part-level shape editing or manipulation. In this paper, we introduce a new task - semantic-aware shape abstraction, where the goal is to produce abstractions that are both geometrically faithful and semantically consistent, ensuring that each primitive adheres strictly to a single semantic part without crossing semantic boundaries. We propose SemEllipsoid, a novel method to address this problem using ellipsoidal primitives. The core idea is to inject semantic constraints into the primitive optimization process leveraging the availability of semantic cues from large-scale foundation models. We design a fully differentiable projection-blending-evaluation scheme to measure semantic divergence against input semantic masks, and formulate an alternating optimization strategy to iteratively solve for optimal semantic assignment and primitive configurations. Our method is non-learning-based, requiring no data collection or network training, and generalizes well to shapes from arbitrary categories. It also supports different levels of abstraction according to user demand. Extensive experiments and evaluations validate the effectiveness of our approach across several 3D shape collections.

4. 【2610.42141】RoboArchitect: Automating the Design of Robotic Agents with Persistent Memory

链接:https://arxiv.org/abs/2610.42141

作者:Shengguang Wu,Suning Huang,Cherie Ho,Ria Doshi,Hao Zhu,Serena Yeung-Levy

类目:Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:Recent work shows, consult vision tools, Recent work, control code decides, robot policy performs

备注: Project Website: [this https URL](https://roboarchitect-ai.github.io/)

点击查看摘要

Abstract:Recent work shows that a frozen robot policy performs far better inside an agent harness, where control code decides when to query the policy, consult vision tools, or command the arm directly. Yet today these harnesses are built by hand and redesigned for each new robot or benchmark. We show that harness design can be automated, offering a strong alternative to finetuning on a novel setup. In RoboArchitect, a coding model observes a robot's rollouts, diagnoses failures, and iteratively revises the harness around the frozen policy. The harness evolves on a set of episodes for its optimization and is evaluated on held-out scenes and tasks. Without updating any model weights, RoboArchitect raises average success from 9.7% to 43.3% on unseen scenes (4.5x) and from 12.7% to 40.2% on unseen tasks (3.2x), across multiple benchmarks and policies. The gains are largest where the benchmark is far from the policy's training data: wrapping a general-purpose policy, the evolved harness yields a specialist that often outperforms even the finetuned version. Intuitive control strategies are automatically designed, such as lifting a jammed arm clear or reaching in horizontally when an obstacle blocks the way from above. The harness also evolves its own persistent memory, carrying learned experience, such as effective grasp depths, into later decisions. These results suggest that substantial headroom in robotic manipulation lies in the agent harness, and its design can be effectively automated and optimized without weight updates.

5. 【2610.42136】ReLift: Dense 3D Tracking as Lifted Trajectory Repair

链接:https://arxiv.org/abs/2610.42136

作者:Assaf Singer,Maroun Khriesh,Noam Rotstein,Yoni Kasten,Or Litany

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:monocular video requires, video requires establishing, requires establishing point, monocular video, video requires

备注:

点击查看摘要

Abstract:Dense 3D tracking from monocular video requires establishing point correspondences over time, estimating their depth, and inferring their trajectories during occlusion. Existing methods typically learn these tasks jointly, a demanding objective given the scarcity of 4D supervision. We show that strong pretrained 2D trackers and 3D geometry models provide an effective foundation: lifted trajectories, with occluded segments simply interpolated, already rival dedicated 3D trackers using the same geometry. However, lifted trajectories inherit correspondence and depth errors, and under occlusion, their depth comes from the occluder rather than the tracked point. We introduce ReLift, an efficient feed-forward framework that recasts dense 3D tracking as geometric trajectory repair and completion. At its core, a trajectory corrector alternates attention along and across trajectories to preserve reliable observations, repair corrupted positions, and complete missing motion. Using only geometric inputs allows us to train directly on 3D trajectories with simulated lifting errors, decoupling training from images and from any specific tracker or geometry model. Concentrating 4D supervision on trajectory refinement yields a reusable model that consistently improves lifted trajectories across trackers and geometry providers without retraining, so it benefits directly from future advances in either component. On WorldTrack, ReLift achieves state-of-the-art mean accuracy, improving on the strongest baselines by 2.1 APD on all points and 3.0 on dynamic points, with faster configurations remaining competitive with leading 3D trackers while running faster than 4RC. Visit our supplementry page for more examples and code.

6. 【2610.42135】A Better Critic Matters for Distribution Matching Distillation

链接:https://arxiv.org/abs/2610.42135

作者:Zongze Wu(1),Xianbang Wang(2),Zhengyang Geng(1),Mingdeng Cao(1),Zhoutong Zhang(1),Richard Zhang(1),Eli Shechtman(1),Ruiming Cao(1) ((1) Adobe, (2) MIT)

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Distribution Matching Distillation, Distribution Matching, student distribution score, Matching Distillation, student distribution

备注: 35 pages, 16 figures. Project page and code: [this https URL](https://peppaking8.github.io/critic-matters/)

点击查看摘要

Abstract:Distribution Matching Distillation (DMD) trains a few-step student using the difference between a teacher's score and an online critic's estimate of the student distribution's score. We investigate what the critic needs, in capacity and in information, to provide a reliable training signal. On the capacity side, controlled experiments across seven SiT model sizes on ImageNet show that increasing teacher size while keeping a small critic fixed can degrade student quality and cause training collapse. Scaling the critic alongside the teacher, a strategy we call joint scaling, prevents collapse in our experiments and allows the student to benefit from larger teachers. On the information side, rather than forcing the critic to model a step-agnostic mixture of student outputs, we introduce a step-aware critic (STAC) that conditions on the student's generation step to estimate step-specific scores. Together, joint scaling and STAC consistently improve few-step distillation across class-conditional ImageNet generation, text-to-image generation with SDXL and FLUX.2, and text-to-video generation with Wan2.1.

7. 【2610.42092】Rethinking Asymmetry in Self-Supervised 3D Geometry Learning

链接:https://arxiv.org/abs/2610.42092

作者:Gyeongjin Kang,Freeman Cheng,Botao Ye,Weijie Lyu,Ming-Hsuan Yang,Eunbyung Park

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Self-supervised learning relies, learning relies, views, Self-supervised learning, asymmetry

备注: Website: [this https URL](https://gynjn.github.io/rethinking-asymmetry/)

点击查看摘要

Abstract:Self-supervised learning relies on asymmetry between what a model observes and what it must explain. Recent methods learn 3D geometry from unposed images by predicting cameras and scene structure, then rendering held-out views. To avoid trivial solutions, they impose this asymmetry in the input space, restricting how views interact through separate branches or masked attention. We revisit this design with geometric accuracy, rather than rendering quality, as the main objective. When a held-out view lies between context views, the context already constrains the geometry it observes. We therefore impose the asymmetry in the 3D representation space, excluding held-out views only from the reconstructed scene while a shared backbone uses all views for correspondence. This improves depth and pose estimation over input-space designs. We further exploit view density: sparse and dense observations depict the same scene but provide different amounts of correspondence. Aligning sparse-context features with dense-context features supplies a geometric training signal alongside rendering, without a pretrained geometric teacher. We additionally align features with a frozen vision foundation model, which brings further gains. None of these signals requires geometric annotation, and the resulting model improves geometry estimation over prior self-supervised methods. Controlled experiments isolate the contribution of each component, and self-supervised pretraining also improves subsequent supervised training.

8. 【2610.42082】hink in 360°: Benchmarking and Bootstrapping Panoramic Video Reasoning

链接:https://arxiv.org/abs/2610.42082

作者:Lidong Lu,Lidong Zou,Xinyi Mao,Jiaxin Lv,Zhenquan Li,Liangrui Dong,Tong Lu,Guo Chen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:panoramic video captures, panoramic, general video MLLM, panoramic video, captures all directions

备注:

点击查看摘要

Abstract:A panoramic video captures all directions around the camera, but relevant evidence can appear in different directions and at different times. Understanding it requires models to connect observations across the viewing sphere and time. We introduce PanoVideoBench, the first manually annotated benchmark for comprehensive panoramic video understanding. Its 1,000 questions span five categories and 15 question types, with diagnostic annotations for target search and panoramic capabilities. Evaluation of 11 proprietary, open-source, and panoramic-specialized models identifies cross-view tracking and sphere-time evidence integration as their weakest capabilities. To strengthen these capabilities, we construct PanoVideoCoT, the first reasoning dataset grounded in real panoramic video, through sphere-time-grounded synthesis that converts verified panoramic observations and successful agentic explorations into 13,465 QA-CoT pairs. Starting from a general video MLLM, PanoVideoReasoner learns from this corpus through Panoramic CoT SFT and Evidence-Privileged On-Policy Self-Distillation, a panoramic instantiation of Vision-OPD's OPSD in which the teacher uses verified perspective views to guide student-generated trajectories. It reaches 55.7% on PanoVideoBench, improving the backbone by 12.5 points and the previous SOTA by 2.6. The gains concentrate on the same spatial, cross-view, and temporal capabilities exposed by the benchmark, showing that grounded sphere-time supervision can equip a general video MLLM with panoramic reasoning.

9. 【2610.42053】REA: A Routed Embodied Agent Runtime for Asynchronous Brain-Cerebellum Control

链接:https://arxiv.org/abs/2610.42053

作者:Pengfei Zhou,Yixing Ma,Zhengfeiyang Zhang,Haoyuan Chen,Zhenglin Wan,Hexin Wang,Wangbo Zhao,Yang You

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:Foundation models, high-level reasoning, remarkably reliable, reliable at high-level, slow and costly

备注: 32 pages, 14 figures

点击查看摘要

Abstract:Foundation models are becoming remarkably reliable at high-level reasoning, yet they remain too slow and costly to serve as fine-grained controllers. Conversely, fast policies like VLAs and whole-body controllers offer more efficient reflexes, but struggle to generalize. While pairing a deliberative brain (foundation models) with a reactive cerebellum (fast policies) seems natural for embodied systems, two obstacles remain: methods are built and scored on incompatible stacks, and their asynchronous coordination is difficult. For example, an agent that calls the VLA in the agentic loop can stall the fast execution, while a VLA that calls the agent on errors tends to re-trigger fallbacks repeatedly or completely miss silent failures. To address this, we propose REA (Routed Embodied Agent), a unified runtime where a deliberative System 2, an embodied router System 1 and reactive System 0 policies cooperate under a single golden rule - no running policy waits on the brain. Instead of querying the brain at each failure, REA employs a route memory that stores each policy's measured success ahead of time, a boundary-triggered judge gate that consults the brain on policy execution, and a shared-budget escalation ladder for bounded recovery. Evaluated on 3,000 test episodes across 60 LIBERO-Pro tasks, REA reaches 95.9% success and beats the best single-agent baseline in its own policy pool (94.7%) while reducing control steps by 25% and control time by 17%. In a separate 100-episode RoboTwin 2.0 study, REA achieves 84% success with VLA policies and 86% with VLA+code, compared with 80% for the strongest single VLA baseline MEDex. These results demonstrate learned and programmatic policies operating within the same runtime. REA also transfers to BEHAVIOR-1K and a real Unitree G1 humanoid, achieving the highest observed success among the compared methods.

10. 【2610.42036】Learning Clean Generative Processes from Noisy Measurements

链接:https://arxiv.org/abs/2610.42036

作者:Fabian Kruse,Lorenzo Baldassari,Ivan Dokmanić

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:noise level, generative model, noisy observations, level, noise

备注:

点击查看摘要

Abstract:We study how to learn a generative model of clean images using only noisy observations. Diffusion processes and their generalizations to non-Gaussian noise require posterior predictions at every noise level. We first show that it is possible to learn these predictions from independent noisy views using Noise2Noise regression, but only at or above the noise level of the training data. To learn the predictions below that level, needed to generate clean images, we impose consistency: a prediction should equal its expectation after continuing the sampling process. We derive conditions under which consistency uniquely determines the continuation to the clean image distribution and verify them for Poisson, binomial, Gamma, and negative-binomial measurements. Experiments on CIFAR-10, photon-counting microscopy, and synthetic aperture radar show that the required posterior predictions can be learned from noisy views alone and that the consistency relation repairs the continuation beyond the noise level of the data, which severely deteriorates without consistency.

11. 【2610.42031】Any Forcing: Any-Step Generality and One-Step Stability for Autoregressive Video Generation

链接:https://arxiv.org/abs/2610.42031

作者:Jiahua Xu,Yijie Fang,Nannan Wang,Xunhao Lin,Li Cao,Lei Hao,Mingrui Zhu,Fei Gao,Xinbo Gao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:enables efficient inference, generation enables efficient, streaming prediction, Autoregressive video generation, enables efficient

备注: Autoregressive video generation

点击查看摘要

Abstract:Autoregressive video generation enables efficient inference through streaming prediction. However, existing methods are typically restricted to fixed sampling steps, limiting the flexibility to balance generation quality and efficiency, while one-step generation suffers from degraded visual quality and error accumulation over long sequences, leading to content drift and generation collapse. To address these issues, we propose Any Forcing, a unified framework for achieving Any-Step Generality and One-Step Stability. Specifically, we introduce a unified adversarial discriminator that jointly performs real-distribution alignment, inter-step consistency alignment, and first-frame quality enhancement, enabling flexible sampling while preserving one-step generation quality. Furthermore, we propose a training-free adaptive long-term memory selection mechanism that selects historical states based on global semantic relevance and local value contribution, while remapping their temporal positions to preserve temporal relationships within the memory cache, thereby enabling stable one-step long-video generation. Experiments demonstrate that Any Forcing achieves high-quality and stable one-step autoregressive video generation, achieving 20.9 FPS and 24.7 FPS for short and long video generation on a single H100 GPU, respectively.

12. 【2610.42002】GeoFlip: Benchmarking Geometry-Sensitive Physics in Video Generation

链接:https://arxiv.org/abs/2610.42002

作者:Yuqi Li,Junming Liu,Bowen Hu,Ruize Niu,Huiran Duan,Yingli Tian,Hao Wu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:synthesize realistic motion, models synthesize realistic, synthesize realistic, respond correctly, Video generation

备注: 14 pages, 7 figures

点击查看摘要

Abstract:Video generation models synthesize realistic motion, but can they respond correctly to changes in initial geometry? We introduce GeoFlip, a video generation benchmark centered on physical outcome flips induced by geometry. With shared physical settings and textual prompts held fixed, GeoFlip applies controlled interventions to support extent, object placement, and mechanism configuration, constructing paired scenes with contrasting reference events, such as remaining stable versus falling or tipping. These pairs test whether models translate geometric differences in the first frame into correct physical evolution. The benchmark comprises 482 scene pairs and 964 reference videos across six physical categories, with reference outcomes established through procedural scene construction, physics simulation, and numerical validation and verification of physical events. We evaluate 16 models for image to video generation along three dimensions: event correctness, structural integrity, and similarity to reference videos. We examine evaluation consistency with independent vision language judges. On the 442 conditions shared by all models, the highest event correctness averaged across tasks is 27.98%, revealing substantial limitations in physical generation conditioned on geometry. Model strengths vary across physical mechanisms, and the three evaluation dimensions capture distinct capabilities. Typical failures include ignoring geometric changes, generating incorrect object motion, bending rigid objects, and introducing additional components. Rank correlations between judges reach 0.906 for event correctness and 0.929 for structural integrity. By combining controlled geometric interventions, verifiable physical references, and multidimensional evaluation, GeoFlip assesses progress from visual realism toward physical consistency conditioned on geometry.

13. 【2610.41992】MoETok: Sparse Expert Routing for 1D Visual Tokenizers

链接:https://arxiv.org/abs/2610.41992

作者:Jiahao Guo,Bao Tang,Haoxiang Cao,Jingfeng Yao,Bo Li,Wenyu Liu,Kun Gai,Changqian Yu,Xinggang Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Modern visual tokenizers, fine-grained visual details, Modern visual, visual tokenizers aim, learning high-level semantic

备注: Project page: [this https URL](https://gjhhust.github.io/moetok-project)

点击查看摘要

Abstract:Modern visual tokenizers aim to preserve fine-grained visual details while learning high-level semantic representations for downstream generation and understanding. Query-based 1D visual tokenizers encode images into flexible latent sequences, yet how individual learnable queries gather and encode image information remains poorly understood. We reveal that these queries spontaneously develop complementary roles under semantic supervision: a small set of Content queries captures high-level semantic information, while a larger set of Detail queries preserves fine-grained visual details for reconstruction. To adapt token processing to these heterogeneous roles, we introduce MoETok, a 1D visual tokenizer that routes tokens through sparsely activated experts. Jointly optimized with reconstruction and semantic objectives, the router learns role-specialized processing paths adapted to each token's representation. Across model scales and token budgets, MoETok consistently improves reconstruction, semantic representation, and autoregressive generation over dense tokenizers under matched supervision and active computation. On ImageNet, it combines strong reconstruction and semantic representation with state-of-the-art class-conditional generation within the 1D tokenizer family. We further validate MoETok at scale in a unified autoregressive model jointly trained for understanding and generation with a next-token cross-entropy objective. The resulting model combines competitive visual understanding with state-of-the-art generation among unified discrete models, matching or surpassing diffusion-based models such as BAGEL and Qwen-Image on benchmarks including DPG-Bench (87.61), GenEval2 (40.04 GM), and WISE (0.49).

14. 【2610.41987】FoAViS: Analyzing Learned Fixation Strategies in a Foveated Active Vision System

链接:https://arxiv.org/abs/2610.41987

作者:Valentin Hassler,Jonathan Henrich,Yohaï-Eliel Berreby,Haoze Zhu,Alexander Ecker

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:foveated and active, resolution is highest, actively directed, trained concurrently, system

备注: 79 pages, 6 figures. Code: [this https URL](https://github.com/ecker-lab/FoAViS)

点击查看摘要

Abstract:Human vision is foveated and active: resolution is highest at the fovea and falls off towards the periphery, and fixations are actively directed to locations of interest. Building a machine system that processes information in the same way lets us study gaze behavior in a controlled setting where the system's components and objectives are known. The emergence of gaze characteristics can therefore be examined systematically, which may in turn inform our understanding of biological vision. This requires a model that can sample like the fovea, handle various tasks from classification to dense prediction, and be trained concurrently with a fixation policy. In our study, we present such a system and study its capabilities and the fixation policies that emerge from it. Our system, FoAViS, samples visual input by adopting the established log-polar foveation and accumulates information in a 2D spatial memory. Due to its 2D structure, the same memory can be read out globally for classification or densely for semantic segmentation, without any architectural change. Fixations are drawn from a 2D map by a policy trained concurrently with the task. We find that learned fixation policies select more informative, task-specific locations than non-learned heuristics. These policies also shape the task representations in a beneficial way: for both classification and segmentation, models trained concurrently with a policy outperform models trained with random locations, even when the latter are provided with learned scanpaths. Moreover, these scanpaths exhibit similarities to human gaze behavior by capturing aspects of empirical scanpath characteristics. Our work marks an important step away from standard passive, single-pass architectures, towards biologically grounded models of vision. It opens a path for studying goal-directed gaze behavior and information representation in the visual system.

15. 【2610.41983】winPast: Benchmarking Historical Evidence Use in Streaming Video Understanding with Evidence Contrastive Video Pairs

链接:https://arxiv.org/abs/2610.41983

作者:Haotian Yang,Yong Chen,Cheng Peng,Haobo Wang,Zhongle Xie,Xuanru Li,Gang Chen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:High accuracy, High, visual history, historical, video

备注:

点击查看摘要

Abstract:High accuracy on streaming video benchmarks does not establish whether a model uses visual history. Our review of OVO-Bench and StreamingBench finds that recent frames suffice for 32% of sampled historical questions, while models also answer many questions correctly from the question and options alone. We introduce TwinPast to test whether answers correctly follow changes in history, using 350 human-reviewed video pairs spanning five historical tasks. Each pair holds the recent video context, question, and ordered options fixed while changing critical historical evidence and the correct answer. Each video is evaluated independently, and PairAcc requires correct answers for both histories. We evaluate 34 model and input configurations. For Qwen3-VL-8B and DeepSeek-Flash, historical inputs improve performance on TwinPast, reversing the recent-frame advantage on existing benchmarks. The strongest evaluated streaming system reaches 49.14% PairAcc, compared with 66.57-91.43% for the evaluated general-purpose models. This gap persists across all five tasks. Case studies further show that models select states from the wrong time or contradict recorded event order despite retaining the relevant evidence. These findings highlight the need to connect historical memory and retrieval with reasoning that uses evidence according to the question's temporal references and event relations.

16. 【2610.41877】Movens-Zero: Scaling Humanoid Motion Foundation Models with Large-Scale Human Videos

链接:https://arxiv.org/abs/2610.41877

作者:Wendong Bu,Tinghong Ye,Qizhou Wang,Jiacheng Li,Zhiqi Ge,Yuze Lin,Zhongqi Yue,Yi Su,Jingyu Wang,Kai Shen,Jingdong Liu,Chengyuan Deng,Xiaoxuan Chen,Xin Tan,Jiaming Ji,Wenqiao Zhang,Chenghong Jiang,Tuoyu Li,Siliang Tang,Jun Xiao,Tat-Seng Chua,Yueting Zhuang,Xingxing Wang,Juncheng Li

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:motion foundation models, humanoid motion foundation, heterogeneous multimodal inputs, scarcity of diverse, real-time closed-loop control

备注: Technical report. 86 pages, 31 figures, 15 tables. Project page: [this https URL](https://movens-zero.github.io)

点击查看摘要

Abstract:Scaling humanoid motion foundation models is constrained by the scarcity of diverse, robot-executable data and by the difficulty of jointly learning from heterogeneous multimodal inputs while supporting real-time closed-loop control. We present Movens-5M, constructed from raw Internet videos through clip generation, quality filtering, semantic annotation, motion recovery, and physical refinement with humanoid retargeting and execution verification. It contains 15 million human-motion sequences and 5 million physically executable humanoid-motion sequences spanning over 10,000 hours, aligned with text, RGB video, speech, and music. Building on this data, we introduce Movens-Zero, a scalable understanding-generation-execution architecture that supports joint learning across modalities and real-time closed-loop execution. Task-mixed flow-matching training jointly optimizes a single action expert across seven generation tasks, enabling direct motion generation from text, speech, music, and video. Multimodal Real-Time Chunking connects overlapping chunks under continuously updated instructions and robot states for continuous closed-loop execution. We further introduce Movens-Intent, a four-track benchmark with 8,192 expert-verified condition-motion pairs across text, speech, music, and video. Experiments show consistent gains across all four modalities when scaling execution-verified data from 1% to 100% and action-expert capacity from 64M to 911M parameters, while demonstrating that data quality and cross-modal supervision improve generation and execution.

17. 【2610.41841】Open-Weight MLLMs Cannot Compare What They Cannot Name

链接:https://arxiv.org/abs/2610.41841

作者:Wenxin Su,Anna Kreshuk

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, automate biological image

备注:

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) are increasingly capable of understanding images and performing complex visual reasoning, suggesting the possibility of using them to automate biological image analysis. This need is becoming increasingly urgent as advances in technology continue to generate ever larger and more diverse microscopy datasets, already exceeding the scale at which manual visual analysis is feasible. With the final aim to use MLLMs for visual comparison of complex phenotypes, we investigate a very simple baseline: comparison of the size of body parts in synthetic images of ants. We find that state-of-the-art open-weight MLLMs fail for some body parts, but not for others, even though the comparison itself is visually trivial for all of them. We evaluate different in-context learning strategies and analyze performance on the related object recognition task. Our results suggest a recognition-driven grounding failure: structures that the models cannot recognize are instead associated with a recognizable semantic concept, impairing the grounding and comparison of both. Further analysis of the vision encoder is consistent with the hypothesis that fine-grained visual structure may be less well preserved without semantic support. Together, our results reveal a surprising limitation of current MLLMs: semantic recognition can gate simple visual comparisons that do not intrinsically require semantic understanding. Our code and data are available at this https URL

18. 【2610.41835】ReuScope: Auditing Data Reuse and Evaluation Sensitivity in Capsule Vision 2024

链接:https://arxiv.org/abs/2610.41835

作者:Eunseob Choi,Kyeonghun Kim,Hyuk-Jae Lee,Nam-Joon Kim

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:Capsule Vision, auditing data reuse, holding evaluation fixed, develop ReuScope, case study

备注: Accepted at NeurIPS 2026, Track on Evaluations and Datasets. 39 pages, 3 figures. Code and data: [this https URL](https://github.com/eunseobchoi/ReuScope)

点击查看摘要

Abstract:We develop ReuScope, a protocol for auditing data reuse and evaluation sensitivity, using Capsule Vision 2024 as a case study. It combines measurements of data relationships with two comparisons: changing the evaluation population while holding predictions fixed, and changing training data while holding evaluation fixed. Byte-identical files cross the public training-validation boundary, and all 41 Kvasir-Capsule recordings that contribute frames occur in both partitions. Shared source recordings establish cross-split overlap; missing cross-recording patient identifiers prevent counting unique shared patients. Across ten paired seeds, removing all training rows attributed to Kvasir-Capsule, plus five rows from other sources flagged as near-matches to it, lowers public-validation balanced accuracy from 82.5% to 61.2%. Evaluating the same fitted models on the validation rows of the other sources reverses the comparison: removal improves balanced accuracy by 1.38 percentage points. The public-validation drop measures sensitivity to source removal, not an amount of leakage-induced inflation. Matched controls show that sample size and class counts alone do not explain the observed score differences. An exploratory experiment removes the training neighbors of validation frames that have close training matches, or equally many distant training rows, and yields a difference-in-differences estimate, relative to matched unflagged frames, of -0.355 percentage points in true-class probability; the paired-t interval for accuracy spans zero. The resulting procedure distinguishes observed reuse from conditional performance sensitivity and specifies the population, class support and uncertainty unit for each conclusion.

19. 【2610.41834】ObjectGuidedMap: An Object-Aware Model for Robust Bird's Eye View Map Prediction in High-Occlusion Scenarios

链接:https://arxiv.org/abs/2610.41834

作者:Christian Bohn,Harsh Yadav,Klaus Friedrichs,Hasan Tercan,Tobias Meisen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Accurate BEV map, autonomous driving systems, Accurate BEV, BEV map prediction, enabling downstream planning

备注:

点击查看摘要

Abstract:Accurate BEV map prediction is a critical component of autonomous driving systems, enabling downstream planning and control. Recent approaches such as Mask2Map achieve strong performance by predicting vectorized, instance-level map elements directly from multi-view images. However, existing BEV map prediction models operate largely independently of object-level scene understanding, despite the fact that traffic participants frequently occlude or implicitly encode information about road geometry. In this work, we propose a multitask architecture that jointly predicts BEV maps and 3D objects, explicitly enabling information exchange between the two tasks. Building upon Mask2Map, we introduce an object detection branch and incorporate cross-task feature fusion at both the BEV feature level and the instance-query level via deformable attention and cross-attention mechanisms. This design allows map instances to leverage object context while remaining robust to occlusions caused by traffic participants. Experimental results on the nuScenes and Argoverse 2 datasets demonstrate that our approach consistently improves BEV map prediction accuracy, with particularly significant gains of 21% mAP in scenes containing heavy object occlusion.

20. 【2610.41833】PGGT-Loc: Primitive-Grounded Geometry Transformer for Feed-Forward Camera Localization

链接:https://arxiv.org/abs/2610.41833

作者:Hanqiao Ye,Yuzhou Liu,Mengqi Rong,Jian Liu,Yangdong Liu,Shuhan Shen

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:multi-stage pipelines relying, costly to construct, maintain over time, multi-stage pipelines, pipelines relying

备注: Accepted at NeurIPS 2026. 24 pages, 14 figures, including appendices. Code and models: [this https URL](https://github.com/3dv-casia/PGGT-Loc)

点击查看摘要

Abstract:Camera localization methods are mostly multi-stage pipelines relying on dedicated and complex maps that are costly to construct, store, and maintain over time. Alternatively, well-structured maps that organize scenes with compact yet expressive primitives are often readily available, providing rich structural and semantic cues that humans can interpret. However, their potential for direct camera localization remains largely unexplored due to the significant modality gap between map primitives and visual observations. This motivates a new concept for localization, which estimates camera poses by grounding query observations to map primitives. In this paper, we instantiate the concept in the context of planar primitives with PGGT, the Primitive-Grounded Geometry Transformer network. Given a single query image and a set of planar map primitives, the network is trained to predict multiple localization targets for feed-forward 6-DoF camera localization that generalizes to unseen environments. With this straightforward and scalable architecture, our method pushes the state-of-the-art localization performance on both dense surface maps and minimal layout models. The code and models are available at this https URL

21. 【2610.41814】A Patch is More Than a Token

链接:https://arxiv.org/abs/2610.41814

作者:Zixiong Wang,Haiping Ma

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Vision Transformers represent, Vision Transformers, Transformers represent, Local Feature Space, Vision

备注: 54 pages, 16 figures, 12 tables. Code and experimental assets: [this https URL](https://github.com/zixiongwang-ai/PMTT)

点击查看摘要

Abstract:Vision Transformers represent each image patch through a canonical token produced under one observation condition. That token is a powerful interface, but it is still one realized state of the patch. We introduce PMTT, which establishes two foundations: a patch representation object can extend from one canonical state to a canonical-centered Representation State Family, and identity-preserving variation opens Patch-Level Local Feature Space. We develop four parts of this representation program. Patch Information Acquisition and Dense Orbital Views expose lawful same-patch states. Visible-to-Hidden prediction tests whether observed states reveal structure beyond themselves. Intrinsic analysis identifies low-dimensional, energy-concentrated, patch-specific, predictive geometry. Representation Organization separates acquiring more information from organizing that information, with an analytic Manifold as the central structured representation. We realize PMTT on frozen DINOv3 S/B/L/H+ backbones without neural post-training of the representation. Across two independent 4,096-anchor cohorts, Manifold explains 70.8-79.6% of Hidden variation, compared with 55.0-72.3% for directly Observed states, and wins on more than 95% of anchors at every scale. Effective rank falls from about 2.5 to 2.0 while dominant energy concentration rises with backbone scale. Across six visual capabilities and four scales, Observed exceeds the canonical Center in 21 of 24 conditions, Manifold exceeds Center in 23, and Manifold exceeds Observed in 16. The strongest current consequence appears in physical correspondence, where MegaDepth satisfies Center Observed Manifold at every scale. These results show that pretrained visual backbones contain richer patch information than the standard single-token interface directly exposes. Code and experimental assets are available at this https URL.

22. 【2610.41790】Different Models, Shared Failures: Auditing Frozen-Encoder Pools for Medical Segmentation

链接:https://arxiv.org/abs/2610.41790

作者:Eunseob Choi,Kyeonghun Kim,Hyuk-Jae Lee,Nam-Joon Kim

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Average segmentation accuracy, Average segmentation, model count, models fail, Average

备注: Accepted at NeurIPS 2026, Track on Evaluations and Datasets. 47 pages, 8 figures. Code and data: [this https URL](https://github.com/eunseobchoi/CoFailMed)

点击查看摘要

Abstract:Average segmentation accuracy and model count do not reveal whether models fail on the same cases. We present CoFailMed, an audit of correlated failures in pretrained-encoder pools for medical segmentation. Across five 2D tasks, we evaluate 11 public pretrained encoders (a controlled sample, not a census) using frozen features and separately trained $1\times 1$ readouts with four seeds per encoder. Shared-checkpoint pairs have the highest mean per-case Dice correlation. An expanded 17-encoder analysis shows that distinct checkpoints within the same encoder family remain more correlated than cross-family pairs. At the pooled 33rd-percentile Dice threshold, four-member pools drawn from distinct encoders have mean effective sizes of 1.56-2.92, estimated from failure correlations in pools with enough failures and passes per member. In the primary pool, richer readouts and fine-tuning narrow the Dice-correlation gap between pairs sharing a checkpoint (or the DINOv2-B/S release) and all other pairs. Yet dependence between different encoders can increase, and fine-tuning does not consistently increase effective pool size at 33rd-percentile thresholds recomputed for each training recipe. A smaller between-group gap can coexist with greater dependence. Pool evaluation should therefore report absolute dependence and threshold-specific effective size alongside accuracy and nominal pool size. The CoFailMed release provides aligned per-case traces, analysis scripts and study code to reproduce the central audit results.

23. 【2610.41789】Hard Sample-Conditioned Decorrelated Attention for Robust Face Recognition

链接:https://arxiv.org/abs/2610.41789

作者:Tahar Chettaoui,Guray Ozgur,Eduarda Caldeira,Naser Damer,Fadi Boutros

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:learn redundant patterns, Vision Transformers, complementary roles, Multi-head attention, independent attention patterns

备注: Accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027)

点击查看摘要

Abstract:Multi-head attention in Vision Transformers (ViTs) allows independent attention patterns across heads, but without explicit regularization, heads may learn redundant patterns rather than complementary roles. Correlation-based penalties encourage head disentanglement, yet apply uniform regularization across all training samples. In face recognition (FR), hard samples whose embeddings lie close to competing identities are critical for optimization and generalization. Motivated by this, we propose ViT-HarDis, which conditions attention head disentanglement on sample difficulty: samples with high cosine similarity to negative class centers receive stronger head decorrelation, enforcing specialization where identity ambiguity is highest. Experiments show improvements over both the baseline and uniform disentanglement on most benchmarks. Our analysis shows that ViT-HarDis reduces the similarity of hard samples to competing class centers while decreasing inter-head attention similarity, and that applying disentanglement only to the final transformer layers outperforms regularizing the entire network. Trained on WebFace4M, ViT-HarDis achieves SOTA results among ViT-based methods on IJB-B, IJB-C, and TinyFace Rank-1, while achieving the best IJB-B and TinyFace results when trained on MS1MV3, improving FR without architectural modifications or additional inference cost. Code: this https URL.

24. 【2610.41772】WorkIng: A Real-World and Synthetic Highway Work-Zone Benchmark Dataset for Autonomous Navigation

链接:https://arxiv.org/abs/2610.41772

作者:Xujun Xie,Dominik Rößle,Adithya Mohan,Daniel Cremers,Torsten Schön

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:combining atypical geometries, Highway work zones, critical edge cases, single recorded site, regulatory variants needed

备注: Accepted to WACV 2027. 19 pages including supplementary material. (c) 2027 IEEE. Personal use of this material is permitted

点击查看摘要

Abstract:Highway work zones are critical edge cases for autonomous vehicles (AVs), combining atypical geometries and jurisdiction-specific regulations that existing benchmarks fail to capture: real-world datasets lack 360° multi-modal, full-scene 3D work zone annotation, and no single recorded site can span the layouts and regulatory variants needed for generalizable models. We present WorkIng, a dual-domain benchmark and training resource. WorkIng-Highway provides a 360° multi-modal work zone benchmark with synchronized 128-channel LiDAR, six RGB cameras, and RTK-GPS across 32 km, yielding 12,000+ annotated frames and 227,399 tracked 3D bounding boxes. WorkIng-CARLA complements this with procedural simulation spanning 24 regulation-aware scenarios across six canonical topologies and six international traffic standards, populated by 100+ custom 3D assets. Benchmarking representative 3D detection and end-to-end planning architectures shows that real-world data remains the primary performance driver, and that scenario-stratified synthetic augmentation improves architectures across 2D recognition, 3D detection, and trajectory planning. Resources: this https URL

25. 【2610.41763】Measuring What Matters: A Causal Reliance Score for Histopathology Image Segmentation

链接:https://arxiv.org/abs/2610.41763

作者:Samuel Thomas,Daniel Tweneboah Anyimadu,Ahmed Karam Eldaly,Somaia Elsheikh,Mohammed M. Abdelsamea

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:histopathology segmentation requires, Causal Reliance Score, spurious background correlations, Reliable histopathology segmentation, Reliable histopathology

备注: 15 pages, 8 figures, accepted into Medical Image Understanding and Analysis (MIUA) 2026 conference

点击查看摘要

Abstract:Reliable histopathology segmentation requires models that rely on pathology-relevant structures rather than spurious background correlations. In this work, we argue that improving architectures alone is insufficient if models continue to rely on spurious correlations rather than pathology-relevant features. We introduce a causality-inspired evaluation framework based on controlled interventions that explicitly probes model sensitivity to foreground tissue structure and background/domain variation. Building on this, we propose the Causal Reliance Score (CRS), a metric that quantifies the relative sensitivity of model predictions to foreground perturbation versus background/domain variation under controlled interventions. To support this analysis, we design augmentation strategies that act as implicit counterfactual interventions during training, encouraging invariance to nuisance factors while preserving morphology. We demonstrate how these interventions reveal behavioural differences between models that are not captured by standard metrics such as Dice or IoU. While we instantiate our framework using a self-supervised transformer (CAUSE-ViT), the primary contribution of this work is not a new architecture, but a principled intervention-based methodology and evaluation metric for auditing model behaviour in medical image segmentation. Our results suggest that evaluating model behaviour through counterfactual interventions is essential for developing reliable and clinically robust medical image segmentation systems.

26. 【2610.41728】SAR-TS-BERT: Physics-Guided Self-Supervised Pre-Training With Polarimetric Features for SAR Time-Series Crop Classification

链接:https://arxiv.org/abs/2610.41728

作者:Jieqiu Wang,Yuhan Zhang,Bo Zheng,Shaoming Zhang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multitemporal synthetic aperture, synthetic aperture radar, typically requires extensive, high-accuracy classification typically, classification typically requires

备注: 18 pages, 13 figures, 18 tables. Jieqiu Wang and Yuhan Zhang contributed equally to this work

点击查看摘要

Abstract:Multitemporal synthetic aperture radar (SAR) imagery provides continuous, cloud-free observations of crop phenology for agricultural monitoring in cloudy and rainy regions, yet high-accuracy classification typically requires extensive labeled samples. Although self-supervised pre-training mitigates label dependency in remote sensing, existing frameworks primarily target optical imagery or generic spatial SAR scenes, underutilizing temporal backscatter dynamics and polarimetric scattering mechanisms. We propose SAR-TS-BERT, a physics-guided BERT-style self-supervised pre-training framework for SAR time-series crop classification. SAR-TS-BERT integrates backscatter intensities and polarimetric ratio features (VV, VH, and VV/VH) with dual-polarimetric Cloude-Pottier decomposition parameters ($H/\alpha/A$) into a six-band input representation through two core designs: 1) a physics-guided span masking strategy (SpanPhysics) that adaptively selects contiguous masked spans based on temporal backscatter change rates to prioritize key phenological transitions; and 2) a dual-branch cross-modal fusion encoder that models backscatter and polarimetric decomposition features through separate Transformer branches followed by bidirectional cross-attention fusion. On independent test sets in Estonia (EuroCropsML) and the USA (California CDL), SAR-TS-BERT achieves overall accuracies (OAs) of 96.78% and 87.29%, respectively, and attains a mean monthly OA of 99.37% on Chongming Island, Shanghai. On the Estonia benchmark, pre-training improves OA and Macro F1 by 1.17 and 1.59 percentage points over training from scratch under full supervision, and by 2.58 and 5.19 percentage points using only 1% labeled data. Incorporating SAR scattering physics into temporal self-supervised pre-training effectively enhances crop classification accuracy, parcel-level mapping consistency, and few-shot transferability.

27. 【2610.41705】Nereus: A Large-Scale Underwater Dataset for Fine-Grained Attribute Understanding and Grounded Counting Perception

链接:https://arxiv.org/abs/2610.41705

作者:Jingtao Deng,Zihao Jin,Yuehe Chen,Feixiang He,Shuiwang Li,Dan Zeng

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:imagery records rich, Underwater imagery records, records rich ecological, rich ecological information, fishery monitoring

备注: Accepted by NeurIPS 2026 Evaluations and Datasets Track

点击查看摘要

Abstract:Underwater imagery records rich ecological information and supports applications such as science communication, fishery monitoring, ecological conservation, and oceanographic research. Beyond general scene understanding, these applications require models to recognize fine-grained biological traits and reason over spatially grounded evidence. However, existing underwater datasets often provide coarse category labels, generic captions, or total-count supervision, which limits their use for organism-level analysis and ecological reasoning. We introduce Nereus, a large-scale dataset for Underwater Fine-grained Perception that jointly supports Fine-Grained Object Attribute Understanding and Grounded Counting Perception. Nereus contains 88K images and 2.68M question-answer pairs, including annotations for 136K marine organism objects across 2,690 species and 1,515 genera, as well as 65K point annotations and 67K grounded counting QA pairs. Experiments with representative multimodal models show that Nereus improves downstream adaptation over existing underwater-domain data and provides a foundation for future research on fine-grained marine perception.

28. 【2610.41695】Retrieval-Augmented Initialization with Dual-Guided Inversion for Flow-Based Inverse Problem Solvers

链接:https://arxiv.org/abs/2610.41695

作者:Hansam Cho,Seoung Bum Kim

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:powerful generative priors, Flow models, flow-based inverse problem, flow-based inverse, models have recently

备注: WACV 2027

点击查看摘要

Abstract:Flow models have recently emerged as powerful generative priors for solving inverse problems. Despite their success, most existing flow-based inverse problem solvers initialize the reconstruction process with random Gaussian noise. However, recent studies in image generation have shown that the choice of initial noise can significantly influence generation outcomes. The role of initialization as a distinct design choice in flow-based inverse problem solving remains comparatively underexplored. In this work, we systematically evaluate noise initialization strategies while holding the downstream flow-based inverse solver fixed. We propose Retrieval-Augmented Initialization with Dual-Guided Inversion (RA-DGI), a method that constructs improved initial noise by leveraging retrieved proxy clean images and dual-guided inversion. Extensive experiments across multiple inverse problems demonstrate that the quality of the initial noise substantially affects reconstruction fidelity and perceptual performance. RA-DGI outperforms standard random initialization and achieves superior results compared to inference-time scaling strategies, while requiring less computational overhead. These findings highlight initialization as a critical yet previously overlooked factor in flow-based inverse problem solvers.

29. 【2610.41677】OT-CAL: Optimal-Transport-Guided Adaptive Sample Selection for Efficient Visual Learning

链接:https://arxiv.org/abs/2610.41677

作者:Suryansh Talukdar,Jin Soung Yoo

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Deep neural networks, update model parameters, Deep neural, expensive backward pass, forward pass

备注: 9 pages, 3 figures. Submitted to the IEEE BigData 2026 Workshop on Efficient AI

点击查看摘要

Abstract:Deep neural networks for image recognition are typically trained using mini-batches, with a forward pass to compute predictions and losses followed by a more computationally expensive backward pass to update model parameters. However, not all training samples contribute equally to learning, suggesting that computation can be reduced by performing backward passes only on informative samples. The challenge is that sample informativeness changes throughout training: difficult samples may be valuable early on, improving samples become important later, and class diversity becomes increasingly relevant toward the end. Existing methods often rely on fixed selection rules or computationally expensive per-sample gradient calculations. We propose OT-CAL, an adaptive data selection method that automatically adjusts its sampling preferences during training. OT-CAL represents each sample using five informativeness features, including difficulty, learnability, and uncertainty. A curriculum vector describes the currently preferred sample characteristics, and optimal-transport-based matching assigns selection weights according to how closely samples match this target. The curriculum vector is then updated using the selected samples, forming a feedback loop that adapts without a manually defined schedule. Experiments on three standard visual learning benchmarks show that, when selecting 50% of each mini-batch, OT-CAL improves performance by 1.3--2.1 points over AdaSelection while achieving 1.18--1.24 times faster training than full-data training.

30. 【2610.41673】A Self-Supervised Pose Estimation Approach for Construction Machines

链接:https://arxiv.org/abs/2610.41673

作者:Alaa Alshubbak,Daniel Görges

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:predict future movements, computer vision task, future movements, computer vision, systems to predict

备注: 12 Pages, 12 figures, submitted for the International Symposium on Visual Computing conference

点击查看摘要

Abstract:Pose estimation is a computer vision task used to estimate a skeleton of dynamic systems to predict future movements. Most of the research in this direction is based on a supervised learning approach which requires a massive amount of labeled datasets. In this paper, a self-supervised three-stage model based on a contrastive learning approach is introduced for estimating a skeleton of dynamic construction machines; such as excavators without using any labeled images for the first stage. The whole model structure is divided into three stages: the pre-train stage using the SimCLR contrastive approach, and two fine-tuning stages for the transfer learning and the downstream task. The model can leverage the features and learn from a huge unlabeled dataset called ACID to two small datasets generated from NVIDIA Isaac and MATLAB Simscape simulators as well as transfer the knowledge to a smaller dataset with a ratio of 3.5% from the original ACID dataset. The results show that the proposed approach can improve the accuracy of pose estimation for heavy construction machines in real images by 11% and 13% in comparison to the normal self-supervised approach with two backbones ResNet-50 and HRNet-W32, respectively.

31. 【2610.41671】OpenVIO: A Versatile Open-Source Visual-Inertial Odometry System

链接:https://arxiv.org/abs/2610.41671

作者:Seungwon Choi

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:Visual-inertial odometry, VIO, fundamental topic, topic in robotics, Visual-inertial

备注: 7 pages, 6 figures

点击查看摘要

Abstract:Visual-inertial odometry (VIO) is a fundamental topic in robotics research. Beyond research, VIO has been adopted in a wide range of products. In this manuscript, we present OpenVIO, an open-source VIO system for research and practical applications. It is released under the MIT license. OpenVIO supports pinhole and fisheye cameras and extends this support to stitched 360° images. We describe each part of the system together with its design considerations. We also report benchmark results with other open-source VIO systems on public datasets. OpenVIO is available as open source at this https URL.

32. 【2610.41651】When Depth Lies: Benchmarking Vision-Language Models on Mirror-Induced RGB-D Ambiguity

链接:https://arxiv.org/abs/2610.41651

作者:Hao Yin,Tianchen Guo,Heming Du,Yan Ke,Yanbin Liu,Xin Yu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:reflect physical distances, integrating RGB images, made significant progress, faithfully reflect physical, integrating RGB

备注: NeurIPS 2026 ED Track accepted

点击查看摘要

Abstract:Vision-language models (VLMs) have made significant progress in spatial reasoning, particularly by integrating RGB images with depth data, which is often assumed to faithfully reflect physical distances. However, mirrors violate this assumption: they distort depth readings while reproducing object appearances, making reflections difficult to distinguish from real objects. As existing benchmarks rarely consider such reflective scenarios, VLM performance in mirror scenes remains largely unexplored. In this work, we introduce a mirror-centric RGB-D dataset from reflective scenes to evaluate the spatial reasoning capabilities of state-of-the-art VLMs in these scenarios. Specifically, we collect 1,011 RGB-D images from 525 real-world scenes, spanning diverse indoor and outdoor environments, six reflective surface types, and both daytime and nighttime conditions. All images are annotated with reflective surface region masks and mask annotations for both directly observed and mirror-reflected objects. Then, we curate a benchmark named MIRA-Bench (Mirror-Induced Reasoning Ambiguity Benchmark), comprising 14,140 QA pairs across eight sub-tasks organized into three cognitive levels: Reflection-aware Perception, Spatial Reasoning, and Scene-level Decision-making. We evaluate state-of-the-art VLMs on MIRA-Bench and find consistent failures across tasks: models misclassify whether objects are directly observed or reflected, fail to match reflected instances to their real-world counterparts, and produce erroneous spatial inferences. Remarkably, providing depth data actually degrades reasoning performance, implying that VLMs cannot identify incorrect depth in mirror scenes. The code and data are available at this https URL

33. 【2610.41642】ADP: Dual-Branch Temporally Adaptive Differential Privacy for Expression-Aware Video Anonymization

链接:https://arxiv.org/abs/2610.41642

作者:Feng Xu,Xun Li,Lars Petersson,Yulei Sui,David Ahmedt-Aristizabal,Dadong Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:fixed-length clip-replacement adjacency, Rényi Differential Privacy, adaptive differential privacy, adaptive Rényi Differential, differential privacy

备注: WACV2027 accepted

点击查看摘要

Abstract:We present TADP, a temporally adaptive differential privacy (DP) framework for inference-time privacy-preserving video generation under fixed-length clip-replacement adjacency. TADP uses a dual-branch design to extract identity and expression representations, clips and privatizes both branches with temporally adaptive Gaussian mechanisms whose noise scales depend only on preceding privatized releases within the same clip and are bounded below by history-uniform calibrated minima, and accounts for their joint release via adaptive Rényi Differential Privacy (RDP) composition. The clip-level RDP guarantee is converted to $(\varepsilon,\delta)$-differential privacy, while soft quantization and subsequent temporal processing are applied only after privatization as DP post-processing. Experiments on facial expression datasets show reduced identity leakage under evaluated attacks, usable perceptual quality and temporal stability, and high facial expression recognition utility relative to the evaluated privacy-preserving baselines. TADP formally satisfies clip-level DP and empirically provides a favorable privacy--utility trade-off under the evaluated threat models and datasets.

34. 【2610.41629】GRIT: Gradient Masking for Visually Misgrounded Tokens in Text-Rich Reasoning

链接:https://arxiv.org/abs/2610.41629

作者:Chanseul Cho,Noori Bae,Dongheon Lee,Youngmin Ro

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:effectiveness remains limited, Reinforcement learning, learning with verifiable, recently been extended, extended to vision-language

备注: Accepted to WACV 2027

点击查看摘要

Abstract:Reinforcement learning with verifiable rewards (RLVR) has recently been extended to vision-language models (VLMs), yet its effectiveness remains limited for text-rich reasoning tasks. We highlight a key factor contributing to this limitation: models frequently arrive at correct final answers despite misperceiving visual information during intermediate steps. We define this phenomenon as Correct-but-Visually-Misgrounded Reasoning (CVMR). Because standard RLVR rewards only final-answer correctness, it fails to differentiate between properly grounded and misgrounded reasoning, reinforcing both equally. Through token-level analysis, we reveal that CVMR tokens exhibit distinct attention patterns that differ systematically from well-grounded ones. Based on this observation, we propose GRIT, a training framework that incorporates visual grounding into RLVR to mitigate the impact of CVMR. Furthermore, to address the lack of text-rich reasoning benchmarks that allow for systematic evaluation across text length and reasoning depth, we introduce GRIT-Bench. Experiments demonstrate that GRIT significantly improves both reasoning accuracy and grounding fidelity over existing RLVR methods.

35. 【2610.41618】Attention Maps Know When to Think: Training-Free Difficulty-Aware Chain-of-Thought for Reasoning Segmentation

链接:https://arxiv.org/abs/2610.41618

作者:Chanseul Cho,Jaesung Jun,Dongheon Lee,Youngmin Ro

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Multi-modal Large Language, Large Language Models, Multi-modal Large, Large Language, strategy in Multi-modal

备注: Accepted to WACV 2027

点击查看摘要

Abstract:Chain-of-Thought (CoT) prompting has become a standard reasoning strategy in Multi-modal Large Language Models (MLLMs), showing strong performance in complex vision-language tasks such as reasoning segmentation. However, our analysis reveals that indiscriminate CoT usage can lead to degraded performance by inducing unnecessary reasoning, a phenomenon we term overthinking. In reasoning segmentation, overthinking often leads to misalignment between the query's intent and visual grounding. To address this, we propose Difficulty-Aware Chain-of-Thought (DA-CoT), a training-free adaptive framework that selectively triggers CoT based on the input's intrinsic difficulty. We find that the entropy of the model's attention maps reliably reflects task difficulty: low entropy indicates confident, localized grounding, while high entropy suggests uncertainty and potential benefit from CoT. DA-CoT uses this entropy signal to determine whether to apply CoT prompting. Additionally, we introduce a Bidirectional Rethinking mechanism that enables the model to automatically flip its reasoning decision when the initial output fails, enhancing robustness by recovering from failures induced by overthinking and underthinking. DA-CoT demonstrates its effectiveness by achieving state-of-the-art performance on the Reasoning Segmentation benchmarks while significantly improving inference efficiency.

36. 【2610.41602】DrawSplat: Atlanta World-Guided Implicit Gaussian SLAM for Indoor Reconstruction

链接:https://arxiv.org/abs/2610.41602

作者:Fan Zhu,Zhisong Xu,Ziyu Chen,Zhenjun Zhao,Takayuki Okatani

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:RGB-D SLAM requires, requires accurate online, SLAM requires accurate, RGB-D SLAM, accurate online tracking

备注:

点击查看摘要

Abstract:RGB-D SLAM requires accurate online tracking, high-quality rendering, and geometrically consistent reconstruction. Existing Gaussian SLAM methods mainly optimize Gaussian primitives with photometric, depth, or local frame-to-model constraints, which are often insufficient in indoor scenes with weak textures, large planar structures, noisy depth, and long trajectories. The resulting maps may suffer from pose drift, surface thickness artifacts, noisy normals, and blurred structural boundaries. We propose DrawSplat, an Atlanta World-guided implicit Gaussian SLAM framework for indoor reconstruction. DrawSplat follows a drawing-like process: explicit point-line geometry first sketches the structural layout, and implicit neural Gaussians then fill in high-fidelity appearance and continuous geometric details. It estimates camera poses, sparse geometry, and gravity direction through point-line joint tracking, infers structural planes from tracked lines using the shared-gravity component of the Atlanta World prior, and converts them into differentiable regularization terms on Gaussian centers and normals. To improve compactness and efficiency, DrawSplat further combines an anchor-based implicit neural Gaussian representation with adaptive structural sampling, which allocates Gaussian capacity to structurally informative regions. Experiments on multiple datasets show that DrawSplat achieves robust tracking, high-fidelity rendering, and strong geometric reconstruction among Gaussian-based SLAM systems, while maintaining a practical balance among quality, efficiency, and model size.

37. 【2610.41598】Scout-Refine-Correct: Teaching Flow Models to Refine Their Own Samples

链接:https://arxiv.org/abs/2610.41598

作者:Sergey Karpukhin,Aibek Alanov

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:image generation models, generation models trained, steps improve quality, additional steps improve, image generation

备注: preprint

点击查看摘要

Abstract:The quality of image generation models trained with diffusion or flow matching is largely fixed by the training budget: at inference, the only available lever is the number of sampling steps, and additional steps improve quality only up to a point. We present a training recipe, Scout-Refine-Correct (SRC), that instead gives a flow-matching generator a genuine inference-time refinement capability. At each sampling step the model takes a scout rollout -- $K$ steps ahead along its own trajectory -- extrapolates a full-sample estimate, and feeds that estimate back to itself as a self-conditioning signal before taking the real step. This can be repeated for $R$ refinement rounds. Two correction losses, applied during training at states the model's own rollouts actually reach rather than only on the ground-truth path, teach the model to use this signal to reach new samples instead of collapsing to a suboptimal one. On ImageNet-256, SRC improves LightningDiT-B from FID~14.5 to FID~7.26 at NFE~550, matching a privileged best-of-$N$ baseline that uses an oracle FID verifier to choose among samples. SRC uses no external verifier, no reward signal, and, after ablation, almost no extra parameters over the base architecture. Combining SRC with best-of-$N$ improves the result further, to FID~3.81 at NFE~4400, showing that the two axes are complementary. We ablate the main design choices -- the architectural pathway for the scout signal, the scout horizon, each correction loss, and the training schedule to demonstrate key working components of training.

38. 【2610.41520】ACO: Trajectory-Aware Curvature Observation for Memorization Localization and Mitigation in Diffusion Models

链接:https://arxiv.org/abs/2610.41520

作者:Ruxi Gu,Zilei Wang,Wei Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:reproduce memorized training, memorized training content, making precise localization, precise localization essential, making precise

备注: 19 pages, 10 figures

点击查看摘要

Abstract:Text-to-image diffusion models can reproduce memorized training content within localized image regions, making precise localization essential for targeted mitigation. However, curvature observations at a single denoising state can contain transient responses, while spatially uniform mitigation may disrupt prompt-relevant content. We present Trajectory-Aware Curvature Observation (TACO), a unified framework for local memorization detection and mitigation in diffusion models. Our empirical analysis reveals that memorization-related curvature becomes pronounced during late-stage denoising and persists at consistent spatial locations across neighboring states. Motivated by these observations, TACO aggregates prompt-dependent curvature responses along the late denoising trajectory and applies latent-guided spatial refinement to improve spatial coherence. The resulting memorization map serves both as a localization signal and as a spatial control signal for mitigation. Specifically, TACO uses this map to steer existing inference-time interventions toward memorization-related regions through spatial reweighting and localized guidance correction. Extensive experiments demonstrate that TACO consistently outperforms competing localization methods, and improves the Pareto trade-off between memorization suppression, semantic alignment, and perceptual quality. These results establish trajectory-aware spatial analysis as an effective link between memorization localization and targeted mitigation.

39. 【2610.41512】Parameter-Efficient Fine-Tuning of Transformer Encoders for Audio-Image-Symbolic Music Retrieval

链接:https://arxiv.org/abs/2610.41512

作者:Eliseo Fuentes-Martinez,Antonio Hidalgo-Centeno,Jorge Calvo-Zaragoza,Antonio Javier Gallego

类目:Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

关键词:Musical Theme Dataset, Score-based multimodal music, sheet music images, Musical Theme, Theme Dataset

备注:

点击查看摘要

Abstract:Score-based multimodal music retrieval requires representations that are both discriminative within each modality and compatible across audio recordings, sheet music images, and symbolic scores. This paper investigates the effectiveness of parameter-efficient fine-tuning (PEFT) for adapting pretrained music encoders and examines whether modality-specific improvements translate into better multimodal representations. We compare full fine-tuning, LoRA, and QLoRA across nine pretrained audio, image, and symbolic score encoders on TriScore and the Musical Theme Dataset. Encoders are first evaluated and selected through supervised unimodal classification, using frozen-encoder linear probing as a reference. We then introduce a controlled 2x2 design crossing encoder adaptation with task-specific shared projection, comparing frozen and adapted representations before and after projection. LoRA or QLoRA is selected in 14 of 18 modality-target combinations, frequently matching or outperforming full fine-tuning while optimizing substantially fewer parameters. However, these unimodal gains do not transfer uniformly to multimodal classification. Adaptation and projection are complementary for composer classification on TriScore, largely redundant for TriScore instrument and the Musical Theme Dataset instrument and ensemble tasks, and partially interfering for composer classification on the Musical Theme Dataset. The final adapted-and-projected title representation on TriScore supports piece-level retrieval, reaching average Top-5 and Top-10 accuracies of 55.32 and 64.68, respectively. Cross-modal exclusion and neighborhood analyses further reveal strong modality-specific local structure in the projected spaces. Overall, PEFT provides an effective and computationally efficient alternative to full fine-tuning, but improved unimodal discrimination alone does not guarantee better multimodal organization.

40. 【2610.41501】VoxLution: Evolving Voxels for High-Fidelity 3D Scene Generation

链接:https://arxiv.org/abs/2610.41501

作者:Daoyi Gao,Xinyi Zhang,Alexey Bokhovkin,Lei Li,Angela Dai

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:virtual reality, robotics simulation, crucial for immersive, immersive applications, High-resolution

备注: Project page: [this https URL](https://daoyig.github.io/VoxLution/;) Video: [this https URL](https://youtu.be/0DAaquV1xK8)

点击查看摘要

Abstract:High-resolution 3D indoor scene generation is crucial for immersive applications such as virtual reality, spatial computing, and robotics simulation. We introduce VoxLution, a coarse-to-fine transformer-based approach that generates high-fidelity indoor scenes with rich details, overcoming the overly smooth geometry typical of existing generative models. First, we generate a low-resolution spatial layout; then, based on this structural information, we progressively refine the scene geometry locally in chunks. Key to our approach is formulating 3D super-resolution as a sequence modeling problem over multi-resolution sparse voxel grids. To achieve this, we introduce a training-free, resolution-invariant tokenization scheme that compactly encodes the geometric information of eight octants into a single decimal number. We formulate the transformer sequence to include multiple resolutions, allowing the coarse layout to guide the generation of fine local details. To ensure coherence across local chunks, we incorporate adjacent chunk boundary information directly into the transformer sequencing. VoxLution achieves scene generation at a finer voxel resolution than existing baselines, demonstrating state-of-the-art performance on standard benchmarks with 59.6% lower FPD and 51.1% lower FID on 3D-FRONT, and 70.5% lower FPD and 73.8% lower FID on Scannet++.

41. 【2610.41494】VariaFlow: Uncertainty-Aware Flow Matching for Unsupervised Anomaly Detection

链接:https://arxiv.org/abs/2610.41494

作者:Arnela Hadzic,Martin Urschler,Cosmin I. Bercea

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Reconstruction-based anomaly detection, Reconstruction-based anomaly, anomaly detection, detection no longer, longer fails

备注: Accepted for WACV 2027

点击查看摘要

Abstract:Reconstruction-based anomaly detection no longer fails at reconstruction. Generative models produce high-quality pseudo-healthy reconstructions, and the remaining difficulty is the step of scoring residuals. The residual between a scan and its reconstruction has two indistinguishable sources, genuine pathology and the anatomical variation that separates one healthy brain from another. Scoring against a single reconstruction treats both as anomalous, inflating false positives where healthy anatomy varies most while small or subtle lesions are lost in the surrounding reconstruction error. We identify the missing quantity as the predictive variance, how much a healthy reconstruction can vary at each location. We introduce VariaFlow, which estimates this variance from an ensemble of mask-guided restorations under an unconditional flow matching prior, each started from a different noise initialization, and which normalizes the residual by the resulting standard deviation. Few-step flow matching keeps the ensemble computationally affordable, and restoring at two spatial scales captures lesions of different size. Across three brain MRI datasets spanning stroke and tumor, VariaFlow is trained once on healthy anatomy and generalizes across all three, attaining the highest AUROC (0.94, 0.80, 0.78) on each and the highest AUPRC on both cross-domain datasets, exceeding the strongest baseline by 37% and 50%. Under domain shift, the same baseline drops by up to 52% in AUPRC, whereas VariaFlow stays more stable and achieves the best small-lesion Dice on all three datasets.

42. 【2610.41485】BDNet: Fast-slow thinking is all you need

链接:https://arxiv.org/abs/2610.41485

作者:Chenzhi Zheng,Zhuoran Zheng

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:hierarchical image-classification backbone, image-classification backbone built, fast image features, present BDNet, hierarchical image-classification

备注: 7 pages, 2 figures, this manuscript is an early draft

点击查看摘要

Abstract:We present BDNet, a hierarchical image-classification backbone built around fast image features and slow statistical references. Its baseline deformation operator (BDO) transforms the deviation of a feature from a stage-specific reference through a low-rank projection and a learned channel scale. Rather than computing pairwise token similarity, the branch operates directly on baseline-relative residuals with complexity linear in the token count. Each of four reference buffers accumulates detached stage statistics during training and remains frozen at inference. A four-stage pyramid with depths $(2,2,6,2)$ and widths $(96,192,384,768)$ yields a 20.70M-parameter classifier at $224\times224$ resolution. We organize an ImageNet-1K study around clean classification, eight controlled ablations, and Gaussian-noise, contrast, and brightness perturbations. The central hypothesis is that a slow reference can improve the robustness of a compact representation while retaining a simple tensor implementation. We distinguish this training-time statistical mechanism from input-dependent attention and make its linear inference behavior explicit.

43. 【2610.41446】Beyond Trial-and-Error: A Geospatial-Guided Active Reasoning Framework for Robust Aerial Vision-and-Language Navigation

链接:https://arxiv.org/abs/2610.41446

作者:Jiawei Ge,Wenkang Gong,Jiuxin Cao,Bo Liu,Lei Cui,Haoran Wang,Xuelin Zhu,Biwei Cao,Chang Liu,Chen Feng,Ioannis Patras

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:large-scale urban environments, locate language-specified goals, requires UAVs, urban environments, high-altitude viewpoints

备注:

点击查看摘要

Abstract:Aerial Vision-and-Language Navigation (VLN) requires UAVs to locate language-specified goals in large-scale urban environments, where objects often appear small and visually ambiguous from high-altitude viewpoints. Existing methods largely follow a reactive paradigm common in indoor VLN, repeatedly updating navigation states from local observations while underutilizing the geospatial structure that remains stable during navigation. As a result, visually similar distractors can cause a reactive goal search to repeatedly reinforce locally plausible goal hypotheses based on passively accumulated evidence, leading to unreliable localization. To address this, we propose GeoReasoner, a robust framework that shifts the paradigm of Aerial VLN from reactive trial-and-error to geospatial-guided active reasoning. Specifically, GeoReasoner first performs pre-search geospatial reasoning to derive region-level priors and constrain the goal hypothesis space. Building on these, it further conducts hypothesis-driven exploration to actively acquire discriminative evidence and refine competing goal hypotheses. Finally, consistency-aware goal verification adversarially assesses complementary evidence sources before stopping, hence reducing premature or erroneous goal confirmations. Experiments on the real-world CityNav benchmark demonstrate that GeoReasoner sets a new SOTA among zero-shot Aerial VLN methods while competing favorably with supervised approaches.

44. 【2610.41426】FlexReader: Towards Adaptive Decoding Paths for Efficient Arbitrary-Length Scene Text Recognition

链接:https://arxiv.org/abs/2610.41426

作者:Zhibin Ma,Pengwen Dai,Zhigang Yao,Xugong Qin,Wenqi Ren,Xiaochun Cao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Existing Scene Text, Scene Text Recognition, specific decoding strategy, Existing Scene, Scene Text

备注: 11 pages, 5 figures

点击查看摘要

Abstract:Existing Scene Text Recognition (STR) models are inherently coupled with a specific decoding strategy by their training paradigms, limiting their flexibility in deployment across diverse recognition scenarios. In this paper, we propose FlexReader, an STR model that supports multiple decoding strides, enabling a single model to achieve an optimal accuracy-efficiency trade-off across different datasets. Specifically, we first introduce a Sub-string Perception module to perceive the target sub-string from visual features, followed by multiple parallel decoding blocks that independently decode each character in the sub-string. During inference, FlexReader supports decoding with arbitrary strides within the perceived sub-string range. Furthermore, we propose Adaptive Prefix Decoding, which adaptively selects the decoding stride at each step based on the model's confidence in the decoded characters, thereby identifying the optimal decoding path for each input. Experimental results demonstrate that FlexReader exhibits robust recognition capability across a diverse range of benchmarks, including those featuring long text, curved text, and occlusions. It consistently outperforms existing decoding strategies in recognition accuracy while achieving up to 6-flod decoding speedup over autoregressive decoding.

45. 【2610.41408】SACQ: Structure-Aware Codebook Quantization for Ultra-Low-Bit Vision-Language-Action Models

链接:https://arxiv.org/abs/2610.41408

作者:Haesung Lee,Insu Han

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)

关键词:capable robot behavior, resource-constrained robotic platforms, enable capable robot, footprint limits deployment, models enable capable

备注:

点击查看摘要

Abstract:Vision-Language-Action (VLA) models enable capable robot behavior, but their large memory footprint limits deployment on resource-constrained robotic platforms. Weight quantization is a natural remedy, yet post-training quantization (PTQ) recipes inherited from large language models degrade when applied to VLAs at ultra-low precision. Existing low-bit PTQ methods often fail to explicitly account for the structure of downstream operations and allocate precision without considering its effect on the policy actions. We introduce SACQ, an ultra- low-bit weight-only vector-codebook quantization framework for VLAs. SACQ combines (1) structure-aware codebook fitting with role-specific quadratic metrics that reflect input statistics and downstream sensitivity; (2) action-aware mixed-bit allocation based on the increase in final-action error as individual layers are compressed; and (3) two-stage post-quantization refinement that reassigns codeword indices with second-order error compensation and calibrates codebooks and row-group scales against the decoded action. Using GR00T N1.7, SACQ achieves 93.85% average success across four LIBERO suites at 1.5 bits per language/action weight while reducing model memory by 4.83x. With INT8 activation quantization and low-precision attention, it retains 93.55% success while running 1.51x faster than BF16. On SimplER, SACQ further achieves 63.76% and 52.27% success under Visual Matching and Variant Aggregation at 2 bits per language/action weight, compared to 58.90% and 53.45% for BF16, respectively.

46. 【2610.41402】DUGO: Dual-Scale Gaussian Memory for Online Temporal Action Localization in Egocentric Procedural Videos

链接:https://arxiv.org/abs/2610.41402

作者:Mohammed Aman Bhuiyan,Md. Sazzad Hossain Adib,Samiul Basir Bhuiyan,Mir Faiyaz Hossain,Syed Mohammed Shamsul Islam,Md Zakir Hossain,Shafin Rahman

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:untrimmed streaming videos, Temporal Action Localization, localize action instances, Action Localization, aims to detect

备注: This paper has been accepted at the 2026 IEEE International Conference on Big Data (IEEE BigData 2026)

点击查看摘要

Abstract:Online Temporal Action Localization (OnTAL) aims to detect and localize action instances from untrimmed streaming videos in real time. Unlike offline approaches, OnTAL models have no access to future frames and cannot go back and refine earlier predictions, which makes the task considerably harder given the strict real-time constraints and narrow temporal window available. Most existing OnTAL methods lean on either brief anchor-based context or a single-scale memory of past frames, which limits how well they can capture actions unfolding across multiple time scales or requiring long-range reasoning in Procedural Videos. To address these gaps, we present DUGO (Dual-Scale Encoding and Gaussian Memory Online), a new OnTAL framework that jointly models local motion dynamics and long-range temporal dependencies. At its core, DUGO uses a Dual-Scale Temporal Encoder, pairing depth-wise local representations with global self-attention so it can pick up both fine-grained temporal patterns and broader contextual cues. We also introduce a Gaussian Memory Bank, which represents action memory as stochastic, input-conditioned Gaussian prototypes, allowing for richer temporal memory through gated cross-attention applied at both the encoder and anchor-query stages. Extensive experiments on procedural egocentric datasets (EGTEA, EPIC-Kitchens-100) demonstrate that DUGO achieves state-of-the-art performance while also providing substantial improvements on non-egocentric benchmarks such as Muses. The project page is available at: this https URL

47. 【2610.41389】Parse Before You Execute: Efficient Spatial Reasoning with Executable Primitives

链接:https://arxiv.org/abs/2610.41389

作者:Xiwei Liu,Yulong Li,Xinling Zhuang,Xuhui Li,Yichen Li,Haolin Yang,Zhixiang Lu,Yutong Xie

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Vision-Language Models, increasingly benefited, Spatial reasoning, Models, Spatial

备注:

点击查看摘要

Abstract:Spatial reasoning in Vision-Language Models (VLMs) has increasingly benefited from tool-integrated pipelines that ground computation in explicit geometry. However, existing systems often compile queries into relatively open-ended artifacts, such as code, task constraints, tool plans, or gathered evidence, leaving what must be resolved before execution under-specified. This can lead to unnecessary tool acquisition and iterative refinement, while still producing plausible reasoning traces from incomplete spatial commitments. We identify this failure mode as under-committed query compilation. To address it, we propose PEPS, a training-free agentic paradigm Parsing Executable Primitives for Spatial reasoning under a typed FESM schema over Frame, Entity, State, and Metric. PEPS follows a parse-before-execute principle: the Parser commits each query to a compact set of executable requirements; the Executor selectively grounds the required primitives through fixed geometric APIs and deterministic computation; and the Verifier checks execution sufficiency, enabling early termination or targeted repair. Extensive experiments across challenging spatial reasoning benchmarks show that PEPS consistently improves reasoning accuracy while substantially reducing refinement rounds, API cost, and end-to-end latency over strong tool-integrated baselines. These results demonstrate that explicit requirement commitment can make tool-integrated spatial reasoning not only more reliable, but also more execution-efficient.

48. 【2610.41373】Queryable Gaussian View Index: Text Retrieval and Selective Camera Localization

链接:https://arxiv.org/abs/2610.41373

作者:Tianyu Xiong,Rui Li,Jiaqi Yang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:present Queryable Gaussian, Queryable Gaussian View, querying existing Gaussian, Queryable Gaussian, existing Gaussian scene

备注: Includes supplementary material; 3 figures, 47 references

点击查看摘要

Abstract:We present Queryable Gaussian View Index (QGVI) for querying existing Gaussian scene assets and their associated calibrated reference data. Text-view retrieval and selective RGB camera localization return poses in the asset's coordinate frame. QGVI-T turns Gaussian-rendered views into a language-searchable index of scene locations, binding structured captions to known camera poses and place identifiers. Semantic and lexical retrieval select views from distinct places without online rendering, VLM calls, or a scene-specific pose network. The image route, QGVI-I, filters LoGS-based geometric estimates using distinct inlier query keypoints. It omits photometric refinement and preserves accepted pose coordinates. On nine development scenes, QGVI-T achieves 58.3% Top-1 and 78.3% Top-5 joint relevance-and-validity success, compared with 26.1% and 34.6% for our CityLoC reimplementation with refinement. QGVI-I achieves 97.3% scene-mean pose success at 1 m/2 degrees, with pooled false-acceptance and false-rejection rates of 0.707% and 1.142%. A paired cached evaluation retains all 1,775 initializer poses correct at this threshold. Recorded median text query latency is 0.020 s. Matched controls show competitive BM25 retrieval and slightly lower false acceptance for thresholded full LoGS; grid augmentation suggests modest gains on novel-view-derived descriptions. We report model-judged semantic success separately from source-camera recovery, with source-verified or estimated scales for geometric evaluation.

49. 【2610.41362】ask-Performance Routing for Multi-Teacher Distillation in CT Medical Image Segmentation

链接:https://arxiv.org/abs/2610.41362

作者:Jiaye Yang,Yao Liu,Die Dai,Hanwen Zhang,Peiyuan Jiang,Qiao Liu,Yutong Xie,Peng Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Pre-trained models offer, models offer complementary, relative accuracy varies, Pre-trained models, offer complementary strengths

备注: Accepted at MICCAI 2026. 11 pages, 3 figures, 4 tables. Code: [this https URL](https://github.com/EdvinCecilia/TPR_MultiTeacher)

点击查看摘要

Abstract:Pre-trained models offer complementary strengths in CT organ segmentation, but their relative accuracy varies across organs and spatial regions. Multi-teacher knowledge distillation can combine these strengths in a single student, yet global or instance-level teacher weights overlook variation within a 3D volume. We propose Task-Performance Routing (TPR), which uses region-wise segmentation errors to determine teacher weights during training without learned routing parameters. In hard regions, TPR favors teachers with lower prediction errors; in easy regions, it uses uniform weights to combine their knowledge. A hierarchical spatial partition provides fine-grained routing in shallow encoder stages and coarse-grained routing in deep stages. Experiments on BTCV, MSD-Liver, and MSD-Pancreas with two teacher pairs and two backbone architectures show higher Dice scores than the individual teachers, adaptive ensembles, and evaluated multi-teacher distillation baselines. On MSD-Pancreas, TPR achieves Dice scores of 65.40% with SwinUNETR and 68.25% with U-Net, compared with 64.38% and 67.45% for the corresponding adaptive ensembles. Inference uses the student alone, with no routing or teacher overhead. Code is available at this https URL.

50. 【2610.41360】Defining Page-Centric Visual Document Retrieval and Evaluating Existing Benchmarks

链接:https://arxiv.org/abs/2610.41360

作者:Chongzhi Zhang,Yuqi Zuo,Aixin Sun

类目:Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV)

关键词:visually rich, flat text, structured sequences, sequences of visually, Visual Document Retrieval

备注:

点击查看摘要

Abstract:In modern information retrieval (IR), documents are increasingly encountered as structured sequences of visually rich, paginated units, rather than as flat text. Example documents encountered in our daily life include Word files, PDFs, and slide decks. Free text-centric retrieval systems either ignore this structure entirely or destroy it through arbitrary passage chunking. In this paper, we formulate page-centric Visual Document Retrieval (VDR) with pages as the fundamental indexing units and document context available for assessing page relevance. The formulation distinguishes two retrieval granularities, page and document, and three retrieval paradigms: independent-item, evidence-set, and iterative retrieval. We then assess 42 benchmarks using eight criteria covering corpus characteristics, query construction, relevance annotation, and ranking support. Our analysis shows two main findings on current VDR research. First, evaluation remains concentrated on page-level independent-item retrieval, with fewer resources supporting document-level, evidence-set, and iterative settings. Second, queries originating from real user information needs independently of target corpus content and graded relevance judgments are uncommon, while the coverage and verification of relevance judgments vary substantially. Both findings reveal gaps between the capabilities applications require and those existing evaluation protocols can establish. We provide benchmark selection guidance and identify priorities for future benchmark design, emphasizing alignment between task requirements, relevance semantics, and evaluation protocols.

51. 【2610.41352】CalibSwitch: Observation-Driven Camera-LiDAR Extrinsic Recovery and Selective Maintenance for Multimodal Perception

链接:https://arxiv.org/abs/2610.41352

作者:Haifa Zhang,Yijing Wang,Zhiqiang Zuo

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:intelligent vehicles depends, reliable sensor geometry, mobile robots, robots and intelligent, intelligent vehicles

备注:

点击查看摘要

Abstract:Camera--LiDAR perception on mobile robots and intelligent vehicles depends on reliable sensor geometry throughout deployment. Installation variations create uncertainty in the initial extrinsics, while changing observation quality makes frame-wise estimates fluctuate during operation. This paper presents CalibSwitch, an observation-driven framework that separates absolute extrinsic recovery from selective state maintenance. A cross-modal absolute extrinsic generator (CAEG) combines projection-free bidirectional feature interaction with geometry-regularized learning to recover complete SE(3) candidates from image--point observations and coarse view context, without a supplied numerical initial transform. A selective recurrent calibration policy (SRCP) combines observation quality and temporal history to determine when a candidate should replace the working geometry consumed by a frozen multimodal detector. On nuScenes, CAEG achieves mean translation and rotation errors of 0.248 m and 5.884$^\circ$. Under sustained geometric transitions, SRCP reaches a mean composite error of 1.46 with 9.70\% candidate commitments, outperforming quality-based and temporal-consistency gating at comparable commitment rates. Relative to unconditional per-frame updating, it improves frozen-detector mAP and NDS by 1.43 and 0.92 points. Paired geometry--observation uncertainty tests, two real-vehicle platforms, and 13.5-FPS single-camera Jetson execution demonstrate the system value of selective geometric-state maintenance for continuous perception.

52. 【2610.41348】Joint-Health-Aware Reinforcement Learning for Robust Robot Control Under Actuator Degradation

链接:https://arxiv.org/abs/2610.41348

作者:Haifa Zhang,Yijing Wang,Zhiqiang Zuo

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:learning policies trained, effective control authority, reinforcement learning policies, dynamics to fail, deployed in unstructured

备注:

点击查看摘要

Abstract:Robots deployed in unstructured environments are susceptible to actuator-authority degradation, which reduces the effective control authority of individual actuators and can cause reinforcement learning policies trained under nominal dynamics to fail. Existing robustness approaches rely on discrete fault labels, broad domain randomization, or global latent variables, often without explicitly modeling continuous per-joint residual actuation capability. We propose a joint-health-aware reinforcement learning framework for robust robot control under simulated actuator degradation. Our framework encodes actuator condition in a continuous joint-health vector and models degradation as multiplicative attenuation of executed actions. A dedicated HealthNet estimator infers per-joint health from recent observations and actions, allowing the policy to redistribute control effort across healthy and degraded joints. We evaluate the method on Walker, Go2, Cassie, and Panda-based ManiSkill manipulation tasks under diverse degradation masks and severity levels. The method outperforms nominal and degradation-trained no-health baselines on the main evaluated metrics. Relative to the nominal baseline, task-level locomotion returns improve by up to 250.1\% and manipulation success rates by up to 15.2 percentage points; in the high-degradation Cassie group, return increases from 3.94 to 40.50 (+928.0\%). Ablations support the contribution of per-joint health estimation, action-degradation modeling, and health-conditioned control.

53. 【2610.41314】GenDSR: Transferring Representations from Video Generation Models for Dynamic Spatial Reasoning

链接:https://arxiv.org/abs/2610.41314

作者:Ke Yang,Zhenyu Zhang,Jun Li

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:spatial relations evolve, Dynamic spatial reasoning, connecting visual intelligence, preserve scene state, evolve over time

备注:

点击查看摘要

Abstract:Dynamic spatial reasoning is essential for connecting visual intelligence to thephysical world, yet remains challenging for vision-language models (VLMs), which must preserve scene state while tracking how spatial relations evolve over time. Meanwhile, video generation models (VGMs), trained to synthesize temporally coherent world dynamics, offer a rich source of spatiotemporal representations. We present GenDSR, a framework that transfers intermediate representations from VGM into VLM for dynamic spatial reasoning. Rather than treating a VGM feature as a monolithic prior, GenDSR constructs two complementary branches: a raw branch preserving holistic generative context and a delta branch emphasizing temporal variation. Task-conditioned tokenwise gates then fuse both signals and inject the result into the native visual representation. On DSR-Bench, GenDSR achieves 67.2%, surpassing the previous best result and establishing a new state of the art.

54. 【2610.41310】STAR-FER: Adaptive Selective Restoration for Edge-Based Low-Resolution Facial Expression Recognition

链接:https://arxiv.org/abs/2610.41310

作者:ZhongYang Wu,ZhenFeng Gan,Di Zhao,XiaoJun Zhu,HouDe Liu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Variable interaction distances, distances continuously degrade, continuously degrade facial, degrade facial resolution, interaction distances continuously

备注:

点击查看摘要

Abstract:Variable interaction distances continuously degrade facial resolution in edge-based affective interaction, making low-resolution facial expression recognition (FER) difficult under limited computation. Full-face image or feature restoration incurs substantial overhead, whereas lightweight recognition pipelines may miss local cues that remain discriminative after degradation. We propose STAR-FER, a scale-and-task-adaptive selective restoration framework that balances recognition performance and resource constraints. A lightweight image-scale conditioned Gate jointly predicts a pixel-wise spatial ranking and a continuous restoration budget, then applies exact-support projection to obtain an input-dependent free-form mask. The mask-conditioned restorer retains complete facial context while concentrating sparse restoration and residual insertion on the selected support. Across seven degradation scales from x2 to x8 on the complete RAF-DB test set, STAR-FER achieves 80.92% mean accuracy and 71.64% Macro-F1, improving the low-resolution ResNet-18 baseline by 2.25 and 2.71 percentage points, respectively. It surpasses SR-FER by 1.04 accuracy points while requiring 8.84 GFLOPs, a 54.29% reduction, with 28.01% mean mask coverage, and maintains effective recognition at unseen non-integer scales. These results show that spatial-ranking and continuous-budget driven selective restoration reduces spatial modification and computation while maintaining low-resolution FER performance, offering an efficient path to resource-constrained affective interaction.

55. 【2610.41260】SketchDirector: Complex Scene Sketching via Agentic Layout Reasoning and Detail Refinement

链接:https://arxiv.org/abs/2610.41260

作者:Yiqi Liang,Xiaodong Cun

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:leaving text-guided complex, text-guided complex scene, Existing sketch generation, scene sketching underexplored, leaving text-guided

备注: 11 pages, 13 figures

点击查看摘要

Abstract:Existing sketch generation methods often rely on image guidance and are largely limited to individual objects or simplified scenes, leaving text-guided complex scene sketching underexplored. We present SketchDirector, an agentic framework that mimics the human sketching workflow for automatic multi-concept scene sketching. Given a scene-level text prompt, SketchDirector first employs a large language model~(LLM) to decompose the scene into multiple draft assets, where each is represented by a set of Bézier curves. Then, an agentic reasoning loop iteratively plans and executes their spatial arrangement, guided by self-evolving memory. Finally, a detail refinement module leverages diffusion priors to enhance sketch quality while preserving geometric structure. To support future research and applications in multi-concept scene sketch generation, we further introduce the \textit{MCSketch8K} dataset, comprising editable vector assets, compositional layouts, and object-level manipulation annotations. Extensive experiments show that SketchDirector outperforms state-of-the-art baselines in semantic and compositional quality while effectively preserving overall contour organization during refinement. The project page is: \href{this https URL}{this https URL}.

56. 【2610.41257】ReVEAL: Eliciting Role-Aware Latent Visual Evidence from MLLMs for Reasoning Video Object Segmentation

链接:https://arxiv.org/abs/2610.41257

作者:Zhongyuan Bao,Cunjie He,Lejun Zhang,Zenglin Xu,Yanwei Fu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:implicit query, video object segmentation, Reasoning video object, requires segmenting, Visual Evidence Tokens

备注:

点击查看摘要

Abstract:Reasoning video object segmentation (ReVOS) requires segmenting the target specified by an implicit query throughout a video. Existing MLLM-based methods typically require costly cross-model alignment, tying MLLM training to a downstream segmentation model. We present ReVEAL, a decoupled thinking-with-video framework for ReVOS that elicits role-aware latent visual evidence from MLLM reasoning to directly guide segmentation. ReVEAL introduces Visual Evidence Tokens (VETs) into video reasoning to associate necessary visual regions or entities with target, background, or distractor roles, while a Dynamic Attention Layer Router adaptively aggregates VET-to-video attention across layers into role-specific grounding evidence. We train the MLLM to perform VET-augmented reasoning on our constructed ReVEAL-47K dataset, with a Contrastive Attention Grounding Loss as auxiliary supervision to apply role-specific constraints to VET attention and optimize layer routing for reliable latent grounding. At inference, ReVEAL identifies the target through this thinking-with-video process and fuses the resulting role-specific evidence to guide a frozen SAM2 in predicting target masks. Experiments on five benchmarks show that ReVEAL outperforms alignment-free baselines and remains competitive with alignment-based methods.

57. 【2610.41254】Hawkeye: Reading Illegible Text with Vision Language Models

链接:https://arxiv.org/abs/2610.41254

作者:Brian Tang,Kang G. Shin

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:modern Vision-Language Models, Vision-Language Models, scene text recognition, general scene text, Blurry Scene Text

备注: For datasets, code, models: [this https URL](https://byron123t.github.io/hawkeye/)

点击查看摘要

Abstract:While modern Vision-Language Models (VLMs) have been remarkably successful in general scene text recognition, they consistently struggle with the long-tail distribution of text that is degraded by motion blur or low resolution. These limitations are particularly apparent in egocentric applications like smart glasses, where text is often captured in noisy environments. In this paper, we introduce the \textbf{BSTRB} (Blurry Scene Text Recognition Benchmark), a novel benchmark of 8,398 noisy image samples with high-fidelity annotations derived from 1,699 real-world video sequences. To support this, we present \textbf{Hawkeye}, a VLM fine-tuned on BSTRB to read and reason about illegible text by leveraging contextual priors and pixel-level alignment. Our results show that \name matches much larger VLMs on BSTRB overall and exceeds them on text at or below 20 pixels, in a single pass suited to real-time deployment. We characterize the resolution at which current VLMs begin to fail.

58. 【2610.41231】Coarse3D: Controllable and Faithful Sparse Structure Generation for Image-to-3D

链接:https://arxiv.org/abs/2610.41231

作者:Gaige Wang,Bowen Pan,Hao Ren,Jiangjing Lyu,Chengfei Lyu

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:generation relies heavily, subsequent refinement, relies heavily, determines the global, first-stage sparse structure

备注:

点击查看摘要

Abstract:Coarse-to-fine 3D-native generation relies heavily on the first-stage sparse structure, which determines the global orientation and overall geometry for subsequent refinement. However, existing coarse generators suffer from two key limitations: their orientation is difficult to control due to ambiguous semantic canonicalization, and their structures are often inconsistent with input images due to weak 2D-3D grounding. We propose Coarse3D, a sparse-structure generation model that produces orientation-controllable and structurally faithful voxel geometry from arbitrary unposed images. Coarse3D introduces three designs: a first-frame anchored canonical space that aligns generation with the first input view while preserving object-centric normalization; a dual-tower DiT that couples generation with auxiliary feed-forward reconstruction to learn spatially grounded features; and spatial-prior guided attention that regularizes cross-attention with pixel-to-voxel correspondence. Coarse3D can directly replace the coarse stage of existing pipelines. Experiments show that it substantially improves sparse structure quality and consistently enhances final 3D generation, achieving state-of-the-art performance.

59. 【2610.41216】nyAstral: Transferring Self-Evolving Harnesses to Tiny Generalist Manipulation Agents

链接:https://arxiv.org/abs/2610.41216

作者:Kehong Gong,Xiaoxu Zheng,Guanli Hou,Seunghun Lee,Mengqi Guo,Runjia Tan,Zhengyu Wen,Qi Wang,Xiaoyu He,Mingyuan Zhang,Michael Bi Mi

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:Robot agents built, Robot agents, vision-language models depend, harness, teacher

备注: 16 pages, 5 figures. Project page: [this https URL](https://garfield-kh.github.io/TinyAstral/)

点击查看摘要

Abstract:Robot agents built on vision-language models depend on both the planner and its harness: the tools, feedback, memory, and recovery logic around it. Can improvements to a large teacher's harness be carried into a compact agent with lower inference compute cost? We present TinyAstral, a two-stage approach. We first freeze an open-weight teacher and improve its harness through recursive self-improvement (RSI): frontier LLM agents read the teacher's trajectories and propose harness edits, and each edit is accepted only if it passes a paired statistical test. We then freeze the final harness, collect teacher trajectories with reasoning and failure recovery, and distill a small student that replaces the teacher in the same harness. On RoboTwin, harness evolution raises the teacher's success from 33.4% to 63.6%; the final 4B student reaches 62.8%. Across four harness versions, distilled 4B students score close to their corresponding teachers, and later versions yield stronger students, showing that harness evolution gains carry into compact models. The harness gains also transfer to other frozen planners without retraining. On identical episodes, the final 4B student outperforms open 4B agents, the open 27B harness-RSI model SenseNova-RoboRSI, and our own teacher model placed in three competitors' harnesses. It stays close to its teacher on all three training benchmarks, and on three benchmarks never used for RSI or training it scores close to a 552B planner running the same harness. On the measured deployment episodes, it uses about one fifth of its teacher's accelerator time.

60. 【2610.41213】Beyond Scarcity: When Encoder Adaptation Is Worthwhile

链接:https://arxiv.org/abs/2610.41213

作者:Zexing Zhang,Jichao Li,Tianyang Lei,Yiyin Zhang,Kewei Yang

类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词:Long-tailed recognition, recognition often learns, learns a shared, representation, Long-tailed

备注:

点击查看摘要

Abstract:Long-tailed recognition often learns a shared representation before correcting the classifier for class imbalance. Once the classifier has been rebalanced, however, final accuracy does not reveal whether further encoder adaptation remains worthwhile. Standard imbalance benchmarks obscure this question because they jointly vary the number of distinct examples available to rare classes and the frequency with which those examples shape the representation. We introduce a controlled evaluation framework that separates unique support from representation allocation and estimates the incremental value of encoder updates through matched classifier-only and full-network continuations from a common corrected model. The framework combines stage-specific controls, multiple representation and adaptation objectives, whole-distribution metrics, and hierarchical inference over class assignments, support reconstructions, and optimization runs. Across the controlled study, the same low-support regime moves from one in which classifier-only training is adequate to one in which encoder adaptation yields a practically meaningful benefit solely as representation allocation becomes more imbalanced. The transition persists across classifier corrections, representation objectives, normalization and augmentation controls, and ImageNet-scale evaluation, while preserving frequent-class accuracy. Under the prespecified one-percentage-point operating margin, the two regimes are separated by simultaneous confidence bounds. These results show that benchmark construction can alter a post-correction training decision and that support size alone does not characterize the remaining value of representation adaptation.

61. 【2610.41210】From Evaluation to Evolution: Benchmarking Image Editing and Evolving Image Models

链接:https://arxiv.org/abs/2610.41210

作者:Jun He,Canmiao Fu,Ying Zhang,Zhipeng Huang,Chenyu Mu,Yazhen Xie,Chen Li,Jing Lyu,Weijia Li,Xiang Zhang

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:requires coordinating multiple, readily obscure unmet, obscure unmet local, coordinating multiple visual, multiple visual transformations

备注: 58 pages, 42 figures

点击查看摘要

Abstract:Real-world image editing requires coordinating multiple visual transformations with content preservation and reference constraints, yet aggregate scores can readily obscure unmet local requirements. Effective evaluation must therefore identify local failures and translate them into priorities for subsequent model improvement. We introduce WeGenEditBench, comprising 2,740 evaluation instances and 148 task types across single-image, text-intensive, and multi-reference editing. Pre-generated checklists shared across models decompose each request into atomic requirements; item-level deductions and visual evidence are established first and then summarized into scores for edit execution, preservation, visual quality, and task-specific correctness. To support the experience-acquisition component of recursive self-improvement (RSI), we develop WeGenEvoStudio, a unified multi-agent harness for RSI-oriented learning that integrates model-conditioned failure diagnosis, retrieval-grounded data construction, supervised adaptation, and re-evaluation. Among 15 evaluated configurations, GPT-Image-2 leads single-image editing with an Overall score of 4.076, while Seedream-5.0-Pro leads text-intensive editing at 4.291. Evolution experiments across four generation and editing benchmarks demonstrate substantial targeted gains: on their report-selected Top-5 single-image targets, FLUX.2 [dev] improves Overall from 1.083 to 3.517, while Qwen-Image-Edit-2511 gains 13.2%. Together, our benchmark and harness provide a foundation for developing more reliable image models through interpretable evaluation and feedback-driven learning.

62. 【2610.41204】Shifting Focus by Reliability: Geometric Fusion Modulation for Robust RGB-T Detection

链接:https://arxiv.org/abs/2610.41204

作者:Liuyin Shi,Chengqi Li,Wenbo He

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:substantially degrade accuracy, detectors combine visible, robust detection, object detectors combine, combine visible

备注: Accepted to WACV 2027

点击查看摘要

Abstract:RGB-thermal (RGB-T) object detectors combine visible and thermal imagery for robust detection, but signal corruption in either stream can substantially degrade accuracy. Restoration-based methods incur significant latency and do not consistently improve downstream accuracy, raising a more direct question: rather than restoring corrupted inputs, can we efficiently adapt the detector to their varying signal quality? Conventional PEFT offers an efficient route, but its input-independent corrections cannot track diverse test-time corruptions. Our controlled corruption sweeps show that corruption types have similar effects near clean conditions but diverge increasingly with severity, motivating corruption-aware, per-input adaptation. We therefore propose PG-FM (Prompt-Guided Feature Modulation), which adapts RGB-T object detectors to the estimated corruption type and severity of each modality. Under controlled RGB-T corruption simulations, PG-FM preserves clean-set performance, improves mAP50 by up to 20.8 points on FLIR and 19.9 points on KAIST, and transfers without retraining to unmodified, naturally acquired external RGB-T datasets.

63. 【2610.41199】Beyond CLIP: Calibrated (Few-Shot) Defect Detection With System One Decision Models

链接:https://arxiv.org/abs/2610.41199

作者:Fadel M. Megahed,Ying-Ju Chen

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:sensors are widely, Cameras and vision, Cameras, images, models

备注: 10 pages, 5 figures

点击查看摘要

Abstract:Cameras and vision sensors are widely used for product and process inspection in manufacturing environments. Traditionally, this process required thousands of images of both nominal and defective products to train such models. Recent research shows that vision transformer (ViT) models, such as CLIP, can reduce this requirement to 50-100 images per nominal and defective class. However, collecting even 50 defective images can be difficult in high-yield or low-volume manufacturing processes. In this paper, we examine the utility of two recently proposed structured decision models (Jev and Clef-Flash) in applications using as few as k=2 reference images per class at inference. In the process, we provide three main contributions: (a) a framework for k-shot learning of these models for image classification/inspection applications; (b) an agentic approach for automatically refining the text descriptions that guide image classification in these decision models; and (c) an approach to calibrate the resulting defect probabilities to improve their reliability for inspection decisions. We test these contributions in five manufacturing case studies. Using two reference images per class, both Jev and Clef-Flash outperform CLIP's test accuracies with the same references (0.75-1.00 [Jev] and 0.71-0.99 [Clef-Flash] vs 0.67-0.84 [CLIP]). Furthermore, we show that our agentic refinement of text descriptions significantly improves accuracy across 6 of 8 model-application combinations, and our calibration approach reduces the Brier score in 13 of the 15 model-application configurations. To support the reproducibility of our work, we provide our replication code and have created the R "decisions" package for evaluating additional models. We also provide a publicly available web app that allows practitioners to inspect their own images with no code.

64. 【2610.41190】FlowMoDE: Coarse-to-fine Flow Matching for Detail-aware Sim-to-Real Monocular Depth Estimation

链接:https://arxiv.org/abs/2610.41190

作者:Liangjing Shao,Wanhao Liu,Jinsong Lin,Zhiwei Fang,Hongliang Ren

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Monocular depth estimation, Monocular depth, spatial perception, intelligent systems, depth estimation

备注: 9 Pages, 7 Figures, Under Review

点击查看摘要

Abstract:Monocular depth estimation is a fundamental capability for 3D spatial perception in robotic and intelligent systems. While data-driven discriminative methods have achieved compelling performance for monocular depth estimation, generative approaches can reconstruct fine structural details with stronger generalization. However, most existing generative diffusion models suffer from low inference efficiency caused by multi-step sampling, whereas single-step diffusion models struggle to recover high-fidelity depth maps. To mitigate these drawbacks, this paper presents FlowMoDE, a coarse-to-fine flow-matching-based framework for efficient, structure-aware monocular depth estimation supporting sim-to-real and cross-scene generalization. The core architecture first conducts coarse-level decoding conditioned on diffused features extracted from a pre-trained semantic encoder, and subsequently restores fine-grained structural patterns via expanded decoding layers. Trained exclusively on a single synthetic indoor dataset, our proposed method outperforms prior methods across five real-world indoor and outdoor datasets, yielding an average 14.1% reduction in relative error against state-of-the-art works as well as 9.9\% reduction in chamfer distance for point cloud reconstruction. We further validate the generalization capability of FlowMoDE on realistic robotic scenes, with qualitative comparisons against state-of-the-art methods. The project page is this https URL

65. 【2610.41185】Mechanistic Interpretability for End-to-End Self-Driving

链接:https://arxiv.org/abs/2610.41185

作者:Manav Gagvani,Benjamin Namikas,Sivamurugan Velmurugan,Nysa Kumar,Shrey Sharma,Thomas Peterson,Pratyush Mathur,Hyunseo Chang,Rohan Paleja

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:remain largely opaque, models achieve strong, achieve strong planning, strong planning performance, autonomous driving models

备注: Accepted to the Conference on Robot Learning (CoRL) 2026. Project page: [this https URL](https://mgagvani.github.io/mechanistic-interpretability-for-e2e-driving/)

点击查看摘要

Abstract:End-to-end (E2E) autonomous driving models achieve strong planning performance but remain largely opaque, limiting observability and trust. We apply mechanistic interpretability to E2E driving by training Sparse Autoencoders (SAEs) on the internal activations of a simple, single-camera end-to-end path planning model. Unsupervised clustering of SAE latents reveals interpretable structure aligned with route intent, vehicle speed, and braking behavior, recovering route intent with 98.3% accuracy without supervision. Through paired counterfactual image edits, we further show that specific SAE features are visually grounded and systematically respond to scene changes such as traffic light state and stop sign presence. Steering individual SAE latents produces predictable, monotonic changes in planner outputs including lateral displacement, curvature, and braking. Finally, we demonstrate a practical application of these representations: we build a lightweight adapter trained on SAE latents that reduces trajectory selection error by 3.44%, outperforming an equivalent adapter that omits SAE latents, confirming that the sparse representation captures useful information for interpretability. Code and visualizations are available at this https URL

66. 【2610.41159】MATS: A Multi-Agent Framework for Controllable and Reflective Tumor Synthesis

链接:https://arxiv.org/abs/2610.41159

作者:Zhongnan Shi,Keyang Zhou,Siyi Li,Qichao Ying,Xinchen Ma,Shuyi Gong,Wei Tang,Sheng Li,Zhenxing Qian

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Synthesizing realistic tumors, address data scarcity, Synthesizing realistic, medical images, images helps address

备注: IEEE BIBM 2026

点击查看摘要

Abstract:Synthesizing realistic tumors on medical images helps address data scarcity for clinical AI. Existing diffusion-based methods, however, lack fine-grained attribute-level controllability, closed-loop quality verification, and awareness of which morphological patterns are underrepresented in the target distribution. We present MATS, a multi-agent framework for text-controllable, cross-organ tumor synthesis. Given a target disease, MATS first profiles its morphological distribution over a fine-grained attribute space covering tumor geometry and appearance, and constructs a generation plan that amplifies underrepresented subtypes while keeping common ones dominant. It then localizes the target organ, proposes anatomically valid placement, and executes two-stage diffusion to produce the tumor mask and render texture, each conditioned on the corresponding attributes. A closed-loop reflective mechanism verifies attribute alignment at three checkpoints throughout synthesis and provides targeted feedback to guide re-generation when misalignment is detected. Trained exclusively on a single-source pancreatic neuroendocrine tumor dataset, MATS consistently improves downstream segmentation both in-domain and across LiTS, KiTS, and MSD-Pancreas benchmarks, whereas most prior generative augmentation methods fall below real-only training.

67. 【2610.41130】One Verdict Is Not Enough: Regression Testing Learned World Models and Their Test Harnesses

链接:https://arxiv.org/abs/2610.41130

作者:Junyu Huo,Zihao Wan,Ziqi Mao,Gouri Ginde

类目:oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:world models ship, Learned world models, ship as software, model versions, world models

备注:

点击查看摘要

Abstract:Learned world models ship as software components whose model versions, preprocessing, and test harnesses change between releases. Work on model updates already counts per-sample regressions, or negative flips, that an accuracy check hides. Two problems remain: a test can pass under one configuration and fail under another, and a harness fault can produce erroneous scores and wrong verdicts without a crash. We present TetraState, a regression-testing protocol for paired possible/impossible video tests. Each test runs under four fixed model-native configurations; its number of correct verdicts assigns one of four outcome classes. Inconclusive tests and failed executions are reported separately alongside the verdict rate. Revisions are compared by per-test outcome transitions, and the harness is versioned as part of the system under test. On all 506 IntPhys 2 Main tests and two heterogeneous systems, Cosmos 3 Nano and V-JEPA 2, two V-JEPA 2 harness revisions move modal accuracy by only 0.2 and 2.6 points yet change 11 and 214 test labels; in the second, accuracy rises although fewer tests are judged correctly, and 43 regressions keep the modal verdict, so a modal-verdict flip check misses them. These results outline a research agenda on configuration-level regression oracles for learned components.

68. 【2610.41127】MotorSense: A Video-EMG Dataset of Motoric Representations for Action Understanding

链接:https://arxiv.org/abs/2610.41127

作者:Eadom Dessalene,Michael Maynord,Amir-Hossein Shahidzadeh,Botao He,Yasamin Tabatabaee,Ruoshi Liu,Ruohan Gao,Paul Pu Liang,Yiannis Aloimonos

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:underlying embodied motor, EMG, underlying embodied, bimanual EMG, embodied motor signals

备注: NeurIPS 2026. 27 pages, 9 figures, 5 tables. Project page: [this https URL](https://www.cs.umd.edu/~edessale/motorsense/)

点击查看摘要

Abstract:Computer vision models learn hand action only from its visual consequences, without access to the underlying embodied motor signals. We address this absence with MotorSense, the first large-scale paired egocentric video and surface electromyography (EMG) dataset. MotorSense pairs bimanual EMG bands with egocentric video and yields synchronized video, bimanual EMG and IMU, and audio across 100 hours of unscripted manipulation. EMG offers a powerful scalable alternative to manual annotation: it captures finger movement, hand configuration, and the forces exerted between hand and environment as a dense signal free of occlusion and labeler bias, whereas manual annotation is costly, subjective, and unreliable under occlusion. We use MotorSense to learn sensorimotor alignment, producing an organization of action that is shared across the visual and motoric spaces, through cross-modal pre-training between video and EMG. The resultant vision models are then transferred to downstream tasks that benefit from sensorimotor alignment: in this case, action recognition, 3D hand reconstruction, and 3D contact reconstruction. We further demonstrate a generative application in which EMG motor signals are used to condition a video diffusion model, yielding videos of fine-grained hand manipulation. Across four action-centric computer vision tasks and eight popular video datasets, we demonstrate that sensorimotor alignment provides a stronger foundation for visual representation learning than conventional self-supervised learning methods over video, outperforming every baseline across all tasks and datasets evaluated.

69. 【2610.41118】CompoSET: A Controlled Single-Edit Benchmark for Vision-Language Compositionality

链接:https://arxiv.org/abs/2610.41118

作者:Laure Delisle,Pietro Perona

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Vision-language compositionality, identify which properties, Vision-language, match, scene

备注: Dataset: [this https URL](https://huggingface.co/datasets/CompoSET/CompoSET) | Code: [this https URL](https://github.com/laure-delisle/CompoSET) | 9 pages main text, 38 pages total

点击查看摘要

Abstract:Vision-language compositionality is the ability to identify which properties, relations, quantities, and states bind to which entities in both an image and a caption, and to match those bindings across modalities. Existing benchmarks evaluate this ability through image-text matching: a model ranks candidate image-caption match similarities and succeeds when the correct match comes on top. In such datasets, paired images differ by more than a single binding: scene, layout, and content all differ, with 97% of pixels changing on average. Such pairs do not isolate compositionality: results are confounded by global image differences. We introduce Compositional Single-EdiT (CompoSET), a benchmark dataset in which each base image-caption pair has an edited counterpart, or foil, that preserves the scene but differs by a single controlled edit, such as color, count, spatial relation, or object state. Base and foil images preserve naturalistic scene complexity yet are visually near-identical: only 8% of pixels change on average. Our dataset has many foils per base scene (~22) in order to separate scene difficulty from edit difficulty, a distinction one-foil-per-base benchmarks cannot make. CompoSET contains 1,776 instances across 80 naturalistic scenes, spanning 16 edit types in 4 semantic categories, with captions at 3 verbosity levels. We test 22 dual-encoder VLMs and find that all models perform at or below chance level on CompoSET, despite scoring well on prior benchmarks. This suggests that apparent progress under prior image-text matching protocols may be an artifact arising from confounds in benchmark design, and that compositional understanding in dual-encoder VLMs is far from solved. CompoSET addresses the confounds and offers a better controlled benchmark to measure future progress.

70. 【2610.41111】An Empirical Study on Learning Rooftop Solar Potential from Satellite Imagery Directly Without Explicit Geometry

链接:https://arxiv.org/abs/2610.41111

作者:Joshua Lee

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:solar potential estimation, estimating solar potential, Rooftop solar potential, Rooftop Solar Prediction, explicitly reconstruct roof

备注:

点击查看摘要

Abstract:Rooftop solar potential estimation often relies on LiDAR, digital surface models (DSMs), or pipelines that explicitly reconstruct roof geometry before estimating solar potential. We propose Direct Rooftop Solar Prediction (DRSP), an end-to-end formulation that maps satellite imagery and coarse regional sunlight information directly to application-level solar outputs. DRSP neither requires explicit geometric representations as input nor predicts roof orientation, slope, height, DSMs, or other geometric quantities as intermediate outputs, and therefore requires no geometric intermediate supervision. To enable large-scale study of this formulation, we develop a programmatic data-curation pipeline that converts per-panel information from the Google Solar API into usable-rooftop masks and spatial solar-energy targets, yielding two geographically distinct datasets containing approximately 60K rooftops from the U.S. Midwest and 87K from Texas. We demonstrate the feasibility of DRSP and systematically characterize the effects of geographic training distribution, model depth, image resolution, regional sunlight conditioning, and heatmap regression objectives. Overall, our results suggest that useful rooftop-scale solar information can be learned directly from 2D imagery without explicit geometric intermediate representations, offering a simpler path toward large-scale solar assessment. Our code and dataset are available at this https URL.

71. 【2610.41080】Grounding Image Composition with Label-Conditioned Visual Evidence

链接:https://arxiv.org/abs/2610.41080

作者:Armin Dadras,Tingyu Lin,Robert Sablatnig,Franziska Proksa,Markus Seidl

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:object categories, introduce KU-PCP Elements, KU-PCP Elements, describe visual structure, class-specific geometric elements

备注: Accepted at WACV 2027

点击查看摘要

Abstract:Image composition labels such as center, diagonal, or rule of thirds describe visual structure rather than object categories. KU-PCP provides image-level labels and class-specific geometric elements, but does not show which visible regions people associate with each of its nine classes. We introduce KU-PCP Elements (KU-PCPE), a label-conditioned region-evidence benchmark for photographic composition. Given an image and a label already judged applicable, the task is to segment the visible regions that explain why the label applies. KU-PCPE contains 4,093 single-annotator training masks and a 1,327-task expert test split with three masks per image-label task. The annotations also include exploratory segment-versus-line ratings that describe whether region or semantic-guideline evidence better explains the label. A held-out expert reaches .867 Dice against the other experts, while the strongest deployable model reaches .664, a proposal oracle .672, and the best vision-language model (VLM) proposal selector .395. KU-PCPE exposes the gap between recognizing a composition label and grounding the human-aligned visual evidence that makes it plausible in a particular image.

72. 【2610.41069】Single-Annotation, Multi-Hypothesis Segmentation with Semantic-Spatial Residual Banks

链接:https://arxiv.org/abs/2610.41069

作者:Armin Dadras,Robert Sablatnig,Franziska Proksa,Markus Seidl

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Multi-rater segmentation datasets, segmentation datasets show, Multi-rater segmentation, training sets expose, datasets show

备注: Accepted at WACV 2027

点击查看摘要

Abstract:Multi-rater segmentation datasets show that a single image can admit several valid masks, yet most training sets expose only one annotation per image. We study single-annotation multi-hypothesis segmentation: each training image exposes one fixed mask, while the model must return a finite bank that covers held-out human annotations at test time. Our experiments reveal a representation tradeoff. Banks learned directly from images recover variations in local boundaries and extent but lose structural hypotheses, whereas frozen semantic features preserve structural grouping but underrepresent spatial variation. We introduce the Semantic-Spatial Residual Bank (SSRB), which freezes a semantic bank trained with balanced assignments and learns a residual from the image for each hypothesis. Across five medical endpoints, SSRB improves coverage of held-out masks at $K=8$ over a Probabilistic U-Net under the same one-mask constraint. On LIDC and LIDC-hard, it also produces substantially more distinct useful masks. On BSDS, it preserves the semantic bank's performance in grouping regions. Its advantage grows as more masks are returned, showing that residuals learned for corresponding heads improve coverage of local annotation variation while preserving how regions are grouped.

73. 【2610.41063】Segment Anything Pancreas: A Unified MRI Segmentation Model for Pancreatic Cancer Radiotherapy

链接:https://arxiv.org/abs/2610.41063

作者:Zach Eidex,Mojtaba Safari,Kundan Thind,Parag J. Parikh,Zhen Tian,Xiaofeng Yang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Limited tumor annotations, MRI datasets hinder, datasets hinder unified, hinder unified segmentation, Limited tumor

备注:

点击查看摘要

Abstract:Background: Limited tumor annotations and incomplete labels across MRI datasets hinder unified segmentation of pancreatic tumors and organs at risk (OARs) for MRI-guided radiotherapy. Purpose: We propose Pancreas-MedNeXt, a unified model that segments the whole pancreas, its subregions, tumors, and surrounding OARs from one MRI volume. Methods: The model uses a shared MedNeXt encoder-decoder with supervised whole-pancreas and subregion pretraining, followed by multitask fine-tuning. Three output heads predict the pancreatic subregions, tumor, and OARs (stomach, duodenum, kidneys). An annotation-aware loss allows training on partially labeled data without treating unannotated structures as background. Pancreas and tumor were evaluated by three-fold cross-validation on 142 PANTHER patients (92 diagnostic, 50 MR-Linac), subregions and OARs on Cyst-X and AMOS test sets, and pancreas and OARs on 33 external T1-weighted TotalSegmentator scans. Comparisons with nnU-Net, MedNeXt, VISTA3D, and Swin UNETR used the Dice similarity coefficient (DSC) with paired bootstrap 95% CIs. Results: Pancreas-MedNeXt achieved the highest mean pancreas and tumor DSC on diagnostic and MR-Linac MRI. Tumor DSC was 58.41% and 42.55%, exceeding task-specific MedNeXt by 4.94 (95% CI: 0.28-9.45) and 5.89 (95% CI: 2.37-9.72) percentage points, respectively. Whole-pancreas DSC was 85.73% and 70.66%. Pretraining improved head, body, and tail DSC by 2.01, 3.00, and 3.78 percentage points over training from scratch. It also achieved the highest DSC for the pancreas, duodenum, and right kidney on AMOS, and for all five organs on external MRI, exceeding the next-best method by 4.92-8.85 percentage this http URL: A single Pancreas-MedNeXt model segments tumors, pancreatic subregions, and OARs on diagnostic and MR-Linac MRI, which could streamline contouring for pancreatic cancer radiotherapy.

74. 【2610.41037】WebOverlay: High-Throughput Vision-Only Distillation for Extreme Aspect-Ratio Web Overlay Detection

链接:https://arxiv.org/abs/2610.41037

作者:Jiannan Huang,Jerry Ding,Li Yu,Zhenting Li

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词:cookie consent banners, downstream document representations, degrade downstream document, obstruct automated web, automated web crawlers

备注: 9 pages, 2 figures, 2 tables

点击查看摘要

Abstract:Web overlays, such as cookie consent banners, newsletter prompts, and age gates, obstruct automated web crawlers and degrade downstream document representations. While proprietary multimodal Large Language Models (MLLMs) can accurately identify overlays, their latency and inference cost preclude web-scale ingestion. Conversely, lightweight vision models struggle with full-page renderings characterized by extreme vertical aspect ratios, where standard isotropic resizing collapses critical text features and causes false positives. In this work, we present WebOverlay, a high-throughput vision-only detector trained via distillation from a frontier vision-language teacher. We establish a dynamic tiling strategy that partitions extreme aspect-ratio web renders into aspect-preserving patches with spatial overlap, coupled with an aspect-ratio-aware boundary adjudication mechanism to eliminate boundary artifacts. To eliminate cross-modal latency overheads, our student model relies purely on visual cues, bypassing DOM tree parsing. WebOverlay significantly outperforms DOM-based heuristics and achieves competitive precision and recall against heavy proprietary MLLM baselines while delivering multiple orders of magnitude higher throughput and substantially reduced deployment costs.

75. 【2610.41030】Dreams Are Cheaper Than Flights: Curated World-Model Data Improves Aerial Detection

链接:https://arxiv.org/abs/2610.41030

作者:Rugved Katole,Vedant Patil,Jenna Kline,Christopher Stewart

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Robot perception, increasingly data driven, disruptive to collect, perception is increasingly, data

备注: 6 pages, Corl 2026

点击查看摘要

Abstract:Robot perception is increasingly data driven, yet field data is slow, costly, and sometimes disruptive to collect. Video world models offer a cheaper source: seeded with real frames, they extend a recorded scene into new footage with the deployment's sensor, altitude, and environment. We ask whether such synthetic data matches the utility of real field data and whether detectors trained with it perform in the field. Seeding a 7B-parameter world model with wildlife drone video, we more than double the training set with curated frames. On held-out videos from the same drones, mAP@50--95 rises 4.3\% when these frames are added to real data and 10.3\% when they replace it, and up to 33.5\% on an urban benchmark. Although an expert rejects an estimated 87.5\% of generated clips, the data costs about \$1,100 of GPU time, against more than \$3,200 of field labor alone for a less useful real training set. Synthetic data thus shifts data costs from fieldwork to compute.

76. 【2610.41011】Prior-Guided Single-Exposure HDR Novel View Synthesis via Base-Gain Representation

链接:https://arxiv.org/abs/2610.41011

作者:Armin Shafiee Sarvestani,Sheyang Tang,Jialu Xu,Zhou Wang

类目:Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

关键词:high dynamic range, low dynamic range, Single-exposure high dynamic, single-exposure LDR views, dynamic range

备注:

点击查看摘要

Abstract:Single-exposure high dynamic range (HDR) novel view synthesis (NVS) recovers HDR scenes from low dynamic range (LDR) views captured at a single exposure and estimates camera response function (CRF) for LDR re-exposure. Without HDR ground-truth, using single-exposure LDR views as the sole source of direct supervision underconstrains HDR reconstruction and cannot ensure its faithful recovery, motivating the need for learned LDR-to-HDR reconstruction priors. Moreover, single-exposure LDR views supervise CRF only over a limited range, necessitating a learnable prior for reliable re-exposure beyond it. We propose PriorGS, a 3D Gaussian Splatting framework that addresses both challenges by (1) guiding HDR recovery with pseudo-HDR supervision from 2D single-exposure HDR reconstruction methods while anchoring it to input LDR views through a closed reconstruction loop; and (2) regularizing CRF modeling with a learnable prior that guarantees monotonicity and promotes plausible responses. Yet cross-view inconsistencies in independently generated pseudo-HDR targets impair scene reconstruction when HDR is encoded directly as Gaussian's color attribute. We therefore introduce a 3D base-gain HDR representation that factors HDR radiance into an LDR base and an overlaid 3D gain field, promoting robustness to such inconsistencies and enabling 3D HDR appearance editing. Extensive experiments demonstrate PriorGS's substantial superiority over baselines.

77. 【2610.40973】RADI3N: GeometRic ImAge EDiting via ParametrIc 3D CoNtrol

链接:https://arxiv.org/abs/2610.40973

作者:Abdul Wasi,Akhil Gorugantu,Mahesh Bhosale,Anjan Dutta,Junsong Yuan,Sauradip Nag,David Doermann

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Recent diffusion-based methods, advanced image editing, substantially advanced image, level remains challenging, Recent diffusion-based

备注:

点击查看摘要

Abstract:Recent diffusion-based methods have substantially advanced image editing, yet parametric 3D control at the part level remains challenging. Existing approaches either operate on whole objects with manual rigging, or revert to 2D handles at the part level. They also struggle to model appearance and texture under large transformations, leading to unrealistic outputs in geometry-intensive edits. To address these limitations, we introduce RADI3N, a framework for semantically-grounded part-aware object manipulation with parametric 3D control. Our CS-ARAP deformation module suppresses rotation-field discontinuities at part boundaries via neighborhood covariance smoothing, producing structurally consistent deformations under complex part-level edits. We further introduce an inversion-free selective texture transfer mechanism that suppresses high-frequency positional biases and scales up low-frequency semantic cues within cross-image attention. This eliminates strict spatial bias and supports semantic matching, allowing source appearance to follow the edited part onto its new geometry. Experiments demonstrate that RADI3N achieves state-of-the-art performance in geometric fidelity, viewpoint consistency, and controllability.

78. 【2610.40972】alkFlow: Structured Latent Flow Matching for Speech Driven Holistic Motion Generation

链接:https://arxiv.org/abs/2610.40972

作者:Xinmu Wang,Fumi Honda,Xiang Gao,Xianfeng Gu,Xiyun Song,Heather Yu

类目:Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

关键词:long-range temporal coherence, synthesize coordinated facial, long-range temporal, temporal coherence, aims to synthesize

备注:

点击查看摘要

Abstract:Holistic co-speech motion generation aims to synthesize coordinated facial expressions, hand gestures, and body movements from speech, which is challenging due to heterogeneous part-specific dynamics, long-range temporal coherence, and cross-part coordination. Directly modeling high-dimensional motion can be unstable, while overly compact or unstructured latent spaces may lose fine-grained motion details. We present \textbf{TalkFlow}, a structured latent flow framework for speech-driven holistic motion generation. TalkFlow learns a continuous three-stream latent representation for upper-body motion, lower-body motion, and facial expressions, preserving part-specific dynamics without forcing heterogeneous motion components into a single latent space. To maintain holistic coordination, lightweight cross-stream interactions are incorporated in both latent representation learning and flow-based generation. Conditioned on multi-level speech features, TalkFlow performs speech-conditioned latent flow matching, learning a continuous transport process from source latents to realistic motion latents. Experiments on the BEAT2 dataset demonstrate strong performance across facial expression accuracy, body gesture quality, and speech-motion synchronization. Qualitative comparisons and user studies further show that TalkFlow generates more natural, expressive, and speech-aligned holistic motion than state-of-the-art methods. The project page is available at this https URL.

79. 【2610.40971】FieldGuideRAG: Image-Grounded GraphRAG for Fine-Grained Recognition with Vision-Language Models

链接:https://arxiv.org/abs/2610.40971

作者:Jiacheng Ding,Yanliang Qi,Cong Guo,Peihua Mai

类目:Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

关键词:training-free GraphRAG method, recognizes fine-grained species, real photographs stored, vision-language model, recognizes fine-grained

备注:

点击查看摘要

Abstract:We present FieldGuideRAG, a training-free GraphRAG method in which a vision-language model, or VLM, recognizes fine-grained species by comparing the query with real photographs stored on the nodes of a knowledge graph. Multimodal GraphRAG systems describe each entity in text, and text conveys little of the visual detail that separates look-alike species. Our graph stores one photograph on every species node and links each species to its relatives, its geographic range and its ecological facts. A frozen VLM verifies the query against the photograph of each candidate node. FieldGuideRAG fuses the verification scores with the range edge and answers questions about the organism from the fact edges of the verified species. On CUB-200, a Wikidata graph and four iNaturalist domains, the node photograph improves verification over the species name on every graph, while text descriptions add little. Verification of the candidate pool exceeds a SigLIP retriever by up to 16 points, the range edge adds 7 to 19 points on iNaturalist, and answering from fact edges is correct on up to 89.5% of 28,820 ecological questions. The verification scores also detect queries whose species is missing from the graph. Graphs, prompts and code will be released.

80. 【2610.40954】CAMEL: Cross-Architecture Masked Embedding Learning for Ultra-Lightweight Retinal Foundation Models

链接:https://arxiv.org/abs/2610.40954

作者:Andre Guarnier De Mitri,Giovani Decico Lucafo,Miller Matheus Lima Anacleto Rocha,Diego Furtado Silva

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:substantially advanced automated, advanced automated grading, Recent progress, large annotated datasets, ophthalmologic pathologies

备注: 8 pages, 6 figures, pre-print

点击查看摘要

Abstract:Recent progress in deep learning has substantially advanced automated grading of ophthalmologic pathologies, supported by large annotated datasets and improved representation learning. However, a significant gap remains between state-of-the-art performance and clinical scalability. In particular, foundation models have reshaped image-based medical screening and diagnosis. These large-scale architectures trained on extensive datasets learn rich, generalizable feature representations that can be adapted to a wide range of downstream tasks. In ophthalmology, RETFound, one of the most relevant foundation models for retinal images, performs strongly across classification, segmentation, and risk prediction tasks. Despite their effectiveness, foundation models are often computationally prohibitive, hindering their deployment in real-world clinical environments where hardware constraints and latency are critical. To bridge this gap, we introduce CAMEL (Cross-Architecture Masked Embedding Learning), a novel cross-architecture distillation framework that uses an asymmetric masking strategy during embedding learning to effectively transfer knowledge from massive teacher foundation models to compact, lightweight student models. Our experimental evaluation across four datasets shows that CAMEL preserves accuracy while drastically reducing computational complexity, enabling lightweight yet highly accurate models suitable for resource-limited clinical settings.

81. 【2610.40949】AVID: A Weakly Aligned RGB-Infrared Dataset and Perturbation Benchmark for Tiny Aerial Targets

链接:https://arxiv.org/abs/2610.40949

作者:Dharini Raghavan,Vishnu Rao,Sethu Selvi S

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Long-range detection, Drone Detection Dataset, Image Processing Cup, ground-based cameras, visual similarity

备注: 23 pages, 8 figures

点击查看摘要

Abstract:Long-range detection of small drones is complicated by their visual similarity to birds and by the limited detail available from ground-based cameras. Combining visible and infrared observations offers complementary information, but their usefulness depends on target size, cross-modal alignment, and image quality. We present AVID, a benchmark for studying these factors using real RGB-infrared bird-drone surveillance footage originating from the Drone Detection Dataset and curated for the IEEE ICIP 2025 Video and Image Processing Cup. AVID comprises 32,040 corresponding frame pairs from 115 videos, with 35,952 existing bird and drone annotations at $320\times256$ resolution. Targets occupy an unusually narrow size range: 68.1\% have a geometric-mean bounding-box side of 8--16 pixels, and 99.0\% meet the COCO small-object criterion. To characterize the geometric difficulty of combining the modalities, we introduce an object-relative alignment ratio and an alignment burden curve. In a sample of 300 frame pairs, 32.3\% have estimated global translations greater than 5 pixels; among the 264 pairs with matching annotations, 16.3\% exceed one median target side. We further introduce AVID-C, which simulates seven families of image degradation at five severity levels independently in RGB, infrared, or both. A fixed-feature analysis examines how scale, degradation, and added cross-modal shifts affect fitted bird-drone class overlap. At 12--16 pixels, the Bhattacharyya error bounds are 0.148 for RGB, 0.198 for infrared, and 0.046 for their combined features. These values describe separation in the specified feature and density models, not detector accuracy. Together, AVID and AVID-C support scale-aware, alignment-aware, and sensor-specific studies of tiny aerial targets.

82. 【2610.40947】UFMF: Radar-Guided Kinematic Priors for Real-Time 4D Occupancy Forecasting

链接:https://arxiv.org/abs/2610.40947

作者:Zeping Zhang,Zhuoya Zhao,Robert Laganière

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:forecasting requires reliably, requires reliably extrapolating, occupancy forecasting requires, strict latency budgets, surrounding actor motion

备注:

点击查看摘要

Abstract:Real-time 4D occupancy forecasting requires reliably extrapolating both ego motion and surrounding actor motion under strict latency budgets. Recent occupancy world models improve long-horizon fidelity through generative decoders and 3D volumetric modeling, yet their computational cost makes real-time deployment challenging. Light-weight BEV forecasters meet latency requirements but often blur or suppress fast-moving actors at longer horizons. We present UFMF (Ultra-Fast Multi-modal Forecaster), a real-time forecaster that keeps an attention-free diagonal state-space temporal core while injecting targeted kinematic and geometric structure where lightweight models typically fail. A radar-guided velocity-aware dynamic prior (VADP) decomposes future displacement into a linear extrapolation plus a learned horizon-dependent residual. The resulting per-cell flow fields transport a compact dynamic latent subspace during rollout. Two auxiliary training constraints complement this branch: world-frame dynamic supervision enforces inter-horizon trajectory coherence, and class-conditioned vertical-profile supervision regularizes BEV-to-3D lifting. UFMF operates at 122 FPS on a single RTX 4090 and reaches 0.45 fast-displacement mIoU on nuScenes, outperforming recent occupancy world models at a fraction of their computational cost.

83. 【2610.40935】Let LiDAR Decide Where to Look: Geometry-Measured Token Selection for Efficient Sparse Latent World Models

链接:https://arxiv.org/abs/2610.40935

作者:Zeping Zhang,Zhuoya Zhao,Robert Laganière

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Vision-centric autonomous driving, Vision-centric autonomous, autonomous driving models, depict sky, empty road

备注:

点击查看摘要

Abstract:Vision-centric autonomous driving models encode thousands of image tokens per frame, yet most depict sky, buildings, or empty road---content irrelevant to planning. Worse, these tokens dilute the planner's attention: we show that randomly discarding 75% of tokens already outperforms the dense model, because the planner can concentrate on the remaining driving-critical content. Building on this finding, we present Geometry-Aware Token Selection (GATS), which uses LiDAR and radar point projections to select a small fraction of image tokens before the vision backbone runs. Because the selector operates on measured 3D geometry rather than visual features, the backbone encodes only the selected patches, cutting end-to-end FLOPs by up to $18\times$. Each kept token receives a 3D anchor from its LiDAR point and is fed to a self-supervised latent world model that predicts future features and 3D displacements without box annotations. At 25% budget, GATS achieves a 3-sec L2 displacement error of 0.520 m on nuScenes and an EPDMS of 88.9 on NAVSIM---surpassing the dense baseline (0.573 m / 85.9) at $6.6\times$ fewer total FLOPs. At an extreme 10% budget (24 GFLOPs, $18\times$ reduction), it still beats the dense baseline on both nuScenes (0.537 m vs. 0.573 m L2) and NAVSIM (87.9 vs. 85.9 EPDMS). On 739 intent-critical scenarios, GATS covers 95.8% of hazardous vehicles and achieves a 0.09% collision rate---73.5% lower than the dense model (0.34%).

84. 【2610.40914】No Channels Left Behind: Understanding Diffusion Acceleration through Residual Gates

链接:https://arxiv.org/abs/2610.40914

作者:Junha Park,Jaemyung Yu,Jaehui Hwang,Jong-Seok Lee,Dongyoon Han

类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词:spatial-structure priors, additional supervision, commonly explained, explained by additional, improved feature geometry

备注: Code: [this https URL](https://github.com/naver-ai/radialobj)

点击查看摘要

Abstract:Training acceleration methods for diffusion transformers, such as REPA and dispersive regularization, are commonly explained by additional supervision, spatial-structure priors, or improved feature geometry. We revisit this view and uncover a striking internal change: the AdaLN-Zero residual gate $\alpha$, which directly controls how conditioned updates enter the residual stream, is substantially reorganized by these methods. This observation motivates our hypothesis that acceleration arises, at least in part, from reshaping the residual gating pathway rather than solely from the feature structures explicitly imposed by auxiliary objectives. Supporting this view, accelerated models are markedly more sensitive to perturbations of $\alpha$, and their gate geometry reflects semantic relationships among classes. We further introduce the normalized participation ratio (nPR) to characterize the channel-wise organization of the gates and find that, across REPA teachers, projector architectures, and radial-objective targets, broader gate participation accompanies better generation quality. Guided by this insight, we propose a simple teacher-free radial objective that promotes broader gate participation through feature-norm regularization, without pairwise feature comparisons. On ImageNet $256\times256$ with SiT-B/2, our method improves FID over dispersive loss while increasing mean gate participation over timesteps and classes, further supporting the link between gate organization and training acceleration. Our results identify residual-gate reorganization as a measurable axis of diffusion training acceleration and suggest a simple direction for further acceleration.

85. 【2610.40913】Coupled or Independent? Fault Coupling in Agentic Medical Vision Systems

链接:https://arxiv.org/abs/2610.40913

作者:Nishi Kanta Paul,Md Shihabul Islam Shovo,Md Mostafijur Rahman,Jamil Fayyad

类目:Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)

关键词:expose intermediate outputs, tools expose intermediate, offer safety benefits, Vision-language agents equipped, single-shot models

备注: 9 pages, 3 figures, 5 tables

点击查看摘要

Abstract:Vision-language agents equipped with tools expose intermediate outputs for inspection and comparison with the model's reasoning, which may offer safety benefits over single-shot models. This paper tests that potential benefit when the sensor reading itself is untrusted, so that the tool and reasoning channels share a common visual fault. We consider a dermatology agent based on segmentation, contrastive retrieval, and an iterative vision-language reasoner and define a coupling taxonomy that distinguishes single-channel errors from joint errors that agree or disagree. On PAD-UFES-20, we show that typographic injection produces detectable directional retrieval capture, whereas physical corruption does not. Crop-first retrieval preserves the payload at a readable scale and produces 55% joint wrong agreement across all cases (71% of faulty cases); full-image retrieval produces 35% (43%). Under a binary decision, if both channels are wrong, their predictions must agree, so hard-label channel comparison cannot detect joint failures, limiting disagreement recall to 0.29 (crop-first) versus 0.57 (full-image). The direction of the order effect is reproduced on the independent HIBA test set.

86. 【2610.40905】Sparse Autoencoders for Expert-Assisted Interpretation of Histopathology Foundation Model Embeddings

链接:https://arxiv.org/abs/2610.40905

作者:Šimon Šmída,Wanda Benesova

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:internal structure remains, structure remains difficult, models learn rich, learn rich embedding, Histopathology foundation models

备注:

点击查看摘要

Abstract:Histopathology foundation models learn rich embedding representations, but their internal structure remains difficult to inspect. Concept-level interpretability is particularly relevant in computational pathology because pathologists reason through recurring morphological and tissue-level patterns, including tissue architecture, cellular morphology, staining variation, and artifacts. In this work, we investigate whether sparse autoencoders (SAEs) can decompose embeddings from histopathology foundation models into sparse latent features suitable for expert-assisted interpretation. We train vanilla and Batch-TopK SAE variants on NCT-CRC embeddings, using CONCH as the primary foundation model and UNI2-h as an additional robustness evaluation, and characterize the resulting latent features through reconstruction fidelity, sparsity, coherence, label enrichment, and downstream class-signal preservation. The learned sparse representations preserve most downstream tissue-class information, and their latent features retrieve more coherent and label-concentrated patch groups than raw embedding dimensions or PCA components. Discussions with pathology experts further motivated a WSI-level latent visualization workflow that places feature activations into larger tissue context. Overall, the additional UNI2-h evaluation suggests that the observed behavior is not specific to CONCH, supporting the use of sparse autoencoders for expert-assisted analysis of histopathology foundation-model embeddings, while emphasizing that latent features should be treated as candidate concepts requiring pathological assessment rather than automatically validated histopathological concepts.

87. 【2610.40900】AquaProbe: Efficient Adaptation of Frozen Vision Models for Underwater Images

链接:https://arxiv.org/abs/2610.40900

作者:Md Shihabul Islam Shovo,Nishi Kanta Paul,Trung Dong,Xiaomin Lin

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)

关键词:Reliable visual perception, autonomous underwater exploration, safe autonomous underwater, visual perception, perception is essential

备注: 10 pages, 4 figures, 3 tables

点击查看摘要

Abstract:Reliable visual perception is essential for safe autonomous underwater exploration. Yet vision models pretrained on terrestrial images become less reliable underwater, where turbidity, backscatter, and wavelength-dependent attenuation alter scene appearance. Existing adaptation methods either spread adapters equally across the encoder depth or select layers using the divergence between two fixed domains. In this paper, we introduce AquaProbe for measuring how the location of the domain gap changes with water type and imaging range. AquaProbe separates newly introduced divergence from that accumulated through a frozen vision encoder using paired clean and physically rendered images and allocates a fixed LoRA budget according to the measured profile. The segmentation mean Intersection-over-Union (mIoU) for the proportional LoRA rank allocation, based on the measured profile, is 70.1; this is a better result than uniform LoRA rank allocation by 1.9 mIoU points while having the same parameter budget of 0.59 million adapter parameters. The three-way router, conditioned on estimated condition clusters, achieves 70.6 mIoU on the standard SUIM split and 63.4 AUDRC under held-out degradation.

88. 【2610.40834】Spatial Atlas-Informed Loss Ensembles for Whole-Body PSMA PET/CT Metastasis Segmentation

链接:https://arxiv.org/abs/2610.40834

作者:Grant N. Chau,Bashirul A. Biswas,Biratal Wagle,Matthew E. Maeder,Michael S. Leapman,James B. Yu,Indrani Bhattacharya

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Existing whole-body PSMA, whole-body PSMA PET, PSMA PET, segmentation methods generally, methods generally rely

备注: 21 pages, 6 figures

点击查看摘要

Abstract:Existing whole-body PSMA PET/CT prostate metastasis segmentation methods generally rely on images alone, without explicitly incorporating where metastases tend to occur. We investigate whether a population metastasis atlas can improve lesion detection when integrated into model training. We constructed voxel-wise mean and standard deviation maps from 375 expert-annotated training scans and used them to weight the cross-entropy loss of an nnU-Net. The additional penalties for missed lesions and false positives depend on spatial atlas statistics and diminish as predictions become confidently correct. Seven configurations were compared on validation data; three were combined by majority voting into SAILS (Spatial Atlas-Informed Loss enSemble). We compared SAILS with a baseline nnU-Net and inference-time atlas fusion on AutoPET~III (110 disease-positive cases) and Deep-PSMA (100 external cases). No atlas or registration is needed at inference. Results: On AutoPET~III, SAILS improved whole-body Dice (0.531 vs. 0.520; p=0.006), reduced missed-lesion volume (9.5 vs. 12.1 cc/case; p0.01), and increased pooled lesion sensitivity (0.857 vs. 0.843; p=0.004). On Deep-PSMA, SAILS detected 126 additional reference lesions (sensitivity 0.769 vs. 0.751; p0.001), without a significant whole-body Dice change (-0.009; p=0.36). High-risk bone Dice improved in both cohorts (0.576 vs. 0.552 and 0.667 vs. 0.653; both p0.01). False-positive volume increased by 2.3 and 18.2 cc/case, respectively (p0.001). Atlas-weighted training improves lesion detection, especially in high-risk bone, without test-time atlas registration, but increases false positives.

89. 【2610.40832】EgoHSI3R: Online 4D Hand-Scene Interaction Reconstruction from Egocentric Video

链接:https://arxiv.org/abs/2610.40832

作者:Mingzhi Pei,Zhangchen Ye,Ruoqu Chen,Liu Cao,Mengdi Xu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:embodied learning, Egocentric videos offer, offer an abundant, abundant source, scene

备注:

点击查看摘要

Abstract:Egocentric videos offer an abundant source of hand-scene interactions for embodied learning, which requires recovering hands, camera, and scene consistently in a shared 3D world. Existing methods focus on either camera-frame hands or world-space hand trajectories, without jointly recovering the scene pointmaps or interaction information. Building a complete reconstruction from such specialized predictions therefore typically requires per-sequence optimization. We propose EgoHSI3R, a unified feed-forward framework for online 4D hand-scene interaction reconstruction from egocentric monocular video. To jointly recover these components, it maintains a recurrent scene representation that accumulates geometric evidence over time and provides a shared world space and scale. We introduce hand-centric prompts that fuse pretrained hand priors and local scene context, while MANO vertex queries attend to scene features to predict dense per-vertex contact. These designs enable a single network to jointly estimate camera motion, dense scene geometry, world-space bilateral MANO hands, and per-vertex hand contact. Despite operating causally, EgoHSI3R achieves the lowest world-space hand joint error on ARCTIC among the evaluated methods, while offering faster inference than existing world-space hand reconstruction pipelines and competitive camera and scene reconstruction accuracy.

90. 【2610.40801】Drone-PUR: From Visual Clue Discovery to Understanding and Reasoning in UAV Scenes

链接:https://arxiv.org/abs/2610.40801

作者:Jiahe Wu,Bing Cao,Xingyue Guo,Ruipu Zhao,Beiming Yu,Jiekang Feng,Qinghua Hu,Pengfei Zhu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:inaccurate visual observations, limited by incomplete, incomplete or inaccurate, inaccurate visual, visual observations

备注: 17 pages, 13 figures

点击查看摘要

Abstract:The reasoning capabilities of vision-language models (VLMs) can be limited by incomplete or inaccurate visual observations in the general domain. In unmanned aerial vehicle (UAV) scenes, small targets, subtle attributes, and changing viewpoints further complicate perception and understanding. Therefore, we introduce Drone-PUR, a dataset and benchmark organized around visual clue discovery, interpretation, and integration, corresponding to the three capability dimensions of perception, understanding, and reasoning. Reasoning samples are designed to require models to combine multiple visual clues to derive visually grounded conclusions. Its 11 tasks provide 175k training and 20k test samples spanning single images, image sequences, cross-modal images, and multiple viewpoints. All test samples undergo human review. Evaluating 22 general-purpose VLMs reveals persistent limitations in spatial judgment and cross-modal and cross-view reasoning. Across models, stronger perception is associated with better reasoning, while single-task fine-tuning further reveals selective bidirectional transfer between these capabilities. To examine domain adaptation, we develop UAV-PUR from Qwen3-VL through staged fine-tuning with auxiliary supervision. Its 4B and 8B variants improve overall multiple-choice accuracy by 18.33 and 17.52 percentage points over their pretrained counterparts, respectively. The dataset and project resources are available at this https URL.

91. 【2610.40754】DyCraft: An Agentic System for Long-Horizon 4D Scene Generation

链接:https://arxiv.org/abs/2610.40754

作者:Jeff Tan,Hang Dai,Zeqian Long,Yanzhe Lyu,R. Kenny Jones,Shangzhe Wu,Chen Geng,Jiajun Wu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:articulated assets, frontier coding agents, coherent long-horizon animations, create coherent long-horizon, frontier coding

备注: Project page: [this https URL](https://dy-craft.github.io/)

点击查看摘要

Abstract:While frontier coding agents can generate high-quality 3D scenes and articulated assets, they struggle to create coherent long-horizon animations. When equipped with general-purpose harnesses, they frequently produce physically implausible outputs, generating objects that interpenetrate, lack physical support, or move unnaturally. Such bare agents struggle to repair these errors because they default to scripting the full animation in one pass, making it difficult to verify their work and disentangle complex spatiotemporal constraints. Drawing on the practice of human animators, we introduce DyCraft, a system for animated 3D scene generation that breaks animation into steps that coding agents can more reliably solve. DyCraft first expands the user's prompt into a detailed plan and builds a static scene. It then creates a 3D storyboard of key animation poses, where each frame is a static 3D scene that the agent can build and debug in isolation. Storyboarding decomposes the problem into pairs of verified start and end states, allowing the agent to author local motion between them with a collection of motion authoring tools. We evaluate DyCraft on 24 long-horizon, multi-shot animation tasks covering humanoid robots, human and animal characters, and physical mechanisms. Compared with a native GPT-6 agent in Codex and prior agentic baselines, DyCraft substantially reduces physical violations and generates higher-quality animated 3D scenes that are more often preferred by human raters.

92. 【2610.40752】PathoJev: Efficient Pathology Decisions from Shared Visual Context

链接:https://arxiv.org/abs/2610.40752

作者:Chengyang Zhang,Wenchuan Zhang,Bo Li,Xinyu Liu,Jiaming Yang,Mengran Li,Jie Chen,Wei Ju,Yuhao Yi,Hong Bu,Jiancheng Lv

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:identifying tumor type, Pathology workflows require, workflows require multiple, grade and invasion, workflows require

备注:

点击查看摘要

Abstract:Pathology workflows require multiple visual judgments about the same slide, from identifying tumor type to assessing grade and invasion. Generating and parsing a separate textual response for each structured question adds latency between visual evidence and usable decisions. Building on the System One paradigm, we introduce PathoJev, a pathology model that directly predicts answer probabilities for whole-slide and region-level assessment. PathoJev encodes each slide once and evaluates independent question suffixes in batches over the shared visual context. Reusing the hybrid backbone's recurrent states further limits the computation that grows with slide-context length for each additional question. Across three whole-slide benchmarks, the 9B and 27B models achieve mean accuracies of 77.2% and 78.1%, exceeding SlideChat by 5.4 and 6.3 percentage points. Both scales also maintain competitive accuracy on five ROI benchmarks. On WSI-Bench, the 9B model runs 9.1x faster than SlideChat. Shared context accelerates eight-question workloads by 6.9x and 5.9x over separate prefix encoding, rising to 11.2x and 8.9x for 64 questions. These results provide a reusable probabilistic interface for combining multiple visual judgments in whole-slide and local tissue assessment. Code: this https URL.

93. 【2610.41924】IGDA-ICMH: an Importance Guided Feature and Network Dual Adaptation Framework towards Image Compression for Machine and Human Vision

链接:https://arxiv.org/abs/2610.41924

作者:Yanbo Gao,Xinyu Zhao,Shuai Li,Xun Cai,Mao Ye,Li Li

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:important research area, machine vision applications, machine vision, machine vision tasks, research area

备注: Published in IEEE TCSVT

点击查看摘要

Abstract:With the surge of machine vision applications, image compression for both machine and human vision (ICMH) has become an important research area. Existing studies mainly focus on task-specific adaptation or multi-task joint optimization, yet they often overlook the unequal contributions of different features and network layers to downstream machine vision tasks. To address this issue, we first quantitatively investigate the impact of different feature and network layers on machine vision performance, providing a principled understanding of their importance. Based on this analysis, an Importance Guided feature and network Dual Adaptation (IGDA) framework is developed for ICMH. It adopts implicit neural representation as the basic architecture and designs an efficient adaptation structure with both feature and network weight adaptation. An Importance-Guided Network Adaptation (IGNA) module is developed with a low-rank adaptation strategy to selectively adjust key network layers according to their importance in different tasks. An Importance-Guided Feature Adaptation (IGFA) module is developed with a low-rank and Kronecker product-based transform to explore the non-local property of the features in order to reduce the number of adaptation parameters. Extensive experiments on representative machine vision tasks, including image classification and object detection, demonstrate that our IGDA-ICMH framework achieves significantly better performance than the existing implicit neural representation-based methods for ICMH.

94. 【2610.41652】Enhancing Medical Lesion Segmentation via Several Simple Modules

链接:https://arxiv.org/abs/2610.41652

作者:Ruichen Li,Zhao Yao

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:improve clinical applicability, computationally constrained environments, lightweight enhancement modules, clinical applicability, lightweight enhancement

备注: 16 pages, 6 figures, 5 tables

点击查看摘要

Abstract:This work introduces three lightweight enhancement modules for medical lesion segmentation to improve clinical applicability, particularly under data-scarce and computationally constrained environments. Current mainstream methods struggle with the lack of high-quality annotations for rare pathologies, which often leads to severe morphological distortions during inference, despite achieving seemingly ideal DSC scores. Furthermore, the isolated development of individual segmentation tasks restricts cross-domain methodological innovation, underscoring the need for leveraging shared knowledge across different lesions within the same anatomical region. However, constrained access to historical data and annotations hinders efficient knowledge extraction and triggers catastrophic forgetting when adapting to new classes. To address these challenges, we first propose DT-Morph Combined Loss with continuous spatial pooling to optimize differentiable topological structures and boundary continuity. Second, we introduce 3D Group Prompt, which extracts domain-universal knowledge via curated volumetric image-mask alignment prompts together with text prompts built on SAT baseline. Finally, we replace conventional output layers with Many-to-One Conditional Segmentation Head equipped with synonym-resolved routing, which brings negligible computational cost and enables fast incremental learning for new categories without sacrificing performance on old tasks. Ablation studies on abdominal and extra-abdominal datasets covering both organ and lesion segmentation verify the efficacy of our modules.

95. 【2610.41556】opoHyperClinicalGraph: A Geometry and Topology-Aware Multimodal Framework for Cancer Survival Prediction

链接:https://arxiv.org/abs/2610.41556

作者:Noaman Khan,Zubair Shah

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:combining hyperbolic tissue, multimodal framework combining, persistent topology, learning for cancer, clinical graph learning

备注:

点击查看摘要

Abstract:We developed TopoHyperClinicalGraph, a multimodal framework combining hyperbolic tissue geometry, persistent topology and clinical graph learning for cancer survival prediction. Pre-extracted UNI2-h features are reduced from 1,536 to 1,024 dimensions using training-fold PCA. A pathology backbone combines hyperbolic neighborhoods with Lorentz-centroid attention pooling. Once frozen, its survival logits are adjusted using persistence descriptors from up to 64 landmarks per slide and sampling controls. A five-node clinical graph then learns a further correction from age, sex, stage, T and N. Five-fold patient-level evaluation covered eight TCGA and CPTAC cohorts with 2,364 patients. Mean validation-selected C-indices for TopoHyperClinicalGraph versus pathology-only spatial PatchGCN were 0.7563 versus 0.7386 in COADREAD, 0.6220 versus 0.5998 in HNSC, 0.6755 versus 0.6535 in BRCA and 0.6409 versus 0.6176 in STAD. CPTAC scores were 0.5984 in HNSC, 0.6060 in PDA, 0.8055 in CCRCC and 0.7192 in LUAD. CPTAC-HNSC used TCGA-initialized adaptation; other CPTAC backbones were trained within their cohorts. Geometry accounted for most pathology-only gains, with smaller persistence effects. Clinical graph fusion exceeded its matched node-wise control in five cohorts, tied in one and scored lower in two; clinical-only prediction exceeded fusion in three CPTAC cohorts. The framework supports separate evaluation of geometric, topological and clinical contributions. All scores were validation-selected; independent testing is needed to establish generalizability.

Subjects:

Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.41556 [eess.IV]

(or
arXiv:2610.41556v1 [eess.IV] for this version)

https://doi.org/10.48550/arXiv.2610.41556

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>
96. 【2610.41338】PRIN: A Perceptual-Structural Retinex-Inspired Network for Low-Light Image Enhancement

链接:https://arxiv.org/abs/2610.41338

作者:Qiyi Xie,Wei Chen Ng,Ziyao Li,Yuning Wu,Huasen Wu,Tianshi Miao,Jian Ding Tan

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:preserving structurally meaningful, structurally meaningful content, Low-light image enhancement, Low-light image, visibility recovery

备注:

点击查看摘要

Abstract:Low-light image enhancement (LLIE) focuses not only on visibility recovery but also on preserving structurally meaningful content and perceptual naturalness. Existing learning-based methods may achieve favorable pixel-wise fidelity while still producing over-smoothed textures, color deviations, or spatially incoherent illumination. Retinex-inspired methods provide interpretable decomposition into reflectance and illumination components, however, the asymmetric restoration roles of these components are rarely encoded through branch-specific frequency-domain refinement. To address this issue, we propose a Perceptual-Structural Retinex-Inspired Network (PRIN), which integrates Retinex priors with restoration-role-aware enhancement. PRIN employs a shared encoder and asymmetric decoders to estimate reflectance and illumination components. The reflectance branch performs attention-guided and edge-aware wavelet refinement to preserve textures and boundaries, whereas the illumination branch promotes spatially coherent brightness adjustment. After the recomposition of reflectance and illumination branches, a curve-based post-composition enhancement head calibrates residual tone and exposure deviations. Experiments on LOL-v1, LOL-v2-Syn, and LOL-v2-Real show that the proposed network ties for the best structural similarity index (SSIM) and obtains the second-lowest learned perceptual image patch similarity (LPIPS) on LOL-v1, achieves the best SSIM and LPIPS on LOL-v2-Syn, and obtains the highest peak signal-to-noise ratio (PSNR) and the second-lowest LPIPS on LOL-v2-Real.

97. 【2610.41337】Bayesian PET Reconstruction with Learned Flow Matching Priors via Langevin Sampling

链接:https://arxiv.org/abs/2610.41337

作者:Hengjia Ran,Huafeng Liu,Bo Zhao

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:Poisson counting noise, positron emission tomography, ill-posedness and Poisson, Poisson counting, challenging inverse problem

备注: Selected as the Best Student Paper Award for 2026 IVMSP

点击查看摘要

Abstract:Image reconstruction for positron emission tomography (PET) is a challenging inverse problem due to its inherent ill-posedness and Poisson counting noise, particularly in low-dose acquisitions. In this work, we introduce a novel Bayesian PET reconstruction framework that leverages a flow-matching generative prior learned from high-quality PET images. By incorporating this prior, we formulate PET reconstruction as a Bayesian inference problem and solve it via latent-space posterior sampling using the unadjusted Langevin algorithm. We evaluate the proposed method through numerical experiments and benchmark it against classical reconstruction methods and state-of-the-art deep learning-based baselines. The proposed method achieves improved reconstruction performance while enabling posterior uncertainty quantification.

98. 【2610.41328】With foundation-model features, aggregator complexity does not improve cross-hospital discrimination in gastric whole-slide image classification

链接:https://arxiv.org/abs/2610.41328

作者:Nheng Vanchhay,Ali Hussain,Khan Ziaullah,Moon-Il Joo,Md Ariful Islam Mozumder,Rashedul Islam Sumon,Won-Ae Lee,Min-Sun Cho,Hyeong-Chan Shin,Yujun Park,Baek Hwan Cho,Nam-Hoon Cho,Heejung An,Heung-Kook Choi,Haeyoun Kang,Hyunki Kim,Hee Cheol Kim

类目:Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:Whole-slide image classifiers, Whole-slide image, image classifiers, untested at unseen, unseen hospitals

备注:

点击查看摘要

Abstract:Whole-slide image classifiers are usually developed within one hospital and often go untested at unseen hospitals. We assembled 5,036 haematoxylin-and-eosin-stained gastric slides from five Korean hospitals, scanned at 20x and 40x, and compared multiple-instance learning aggregators under leave-one-hospital-out validation on frozen pathology foundation-model features. A hierarchical patch-region-slide graph aggregator (CHIME-MIL) with site alignment and two-scale fusion reached a mean area under the receiver operating characteristic curve (AUC) of 0.837, above six conventional attention and transformer aggregators trained without these steps. Under a matched recipe it did not exceed attention-based pooling, and global max pooling given the same alignment and fusion was better (AUC 0.855, P = 0.0002). The alignment, which subtracts each hospital's mean feature vector without labels, onboarded a new hospital from ten unlabelled slides and cost 0.002 AUC without held-out-hospital data, but its accuracy gains were small and inconsistent. The model had low top-label calibration error (0.053) but under-confident malignancy probabilities, and removing its most-attended patches lowered the malignancy probability far more than removing random patches. With these features, more complex aggregators did not improve discrimination; what a deployable system adds is label-free onboarding, calibration checks and auditable evidence.

99. 【2610.41304】ART of PIV: Agentic Real-Time Particle Image Velocimetry for Active Flow Control

链接:https://arxiv.org/abs/2610.41304

作者:Antonio Terpin,Francesco Banelli,Alan Bonomi,Raffaello D'Andrea

类目:Fluid Dynamics (physics.flu-dyn); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:Particle image velocimetry, measures fluid motion, including image preprocessing, tracer particles, Particle image

备注:

点击查看摘要

Abstract:Particle image velocimetry (PIV) measures fluid motion from images of tracer particles, but its accuracy depends on choices throughout the estimation pipeline, including image preprocessing, flow estimation, and postprocessing. These choices are typically left to expert tuning, and a fixed configuration can become less accurate as conditions change. This matters especially when PIV supplies feedback for real-time control, where measurements must be both accurate and fast, and flow conditions vary. We introduce ART of PIV -- short for Agentic Real-Time and also a nod to the art of tuning a PIV pipeline -- which automates pipeline choice for each image pair. A learned agent selects a configuration according to a chosen measurement objective from a library assembled for a specified speed budget. Across cross-correlation, classical optical-flow, and learning-based estimators, ART of PIV reduces average end-point error (AEPE) by 12.2-22.4 % relative to the best single estimator at matched speed, with gains extending to 1000-4000 image pair/s. In a simulated local velocity regulation task, it reduces mean normalized closed-loop cost by 13.24-13.59 percentage points relative to a tuned fixed estimator, with the same classical controller in both cases. In a tabletop water channel, we illustrate two ways to tune ART of PIV for a fluidic pinball of three rotating cylinders: selecting between complementary optical-flow tunings for accuracy, and selecting regions of interest with coherent rotation or shear using a common flow estimator. For the first variant, we train a DreamerV3 reinforcement learning controller directly in the physical world and demonstrate tracking of a prescribed flow field in the wake of a fluidic pinball.

100. 【2610.41258】PBSR: Pseudo-Burst Super-Resolution via Zero-Shot Novel View Synthesis

链接:https://arxiv.org/abs/2610.41258

作者:Yuki Kondo,Norimichi Ukita

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:aggregating sub-pixel information, achieves higher reconstruction, higher reconstruction fidelity, achieves higher, aggregating sub-pixel

备注: Accepted for publication in New Generation Computing. 17 pages, 10 figures, 3 tables

点击查看摘要

Abstract:Burst super-resolution (BSR) achieves higher reconstruction fidelity than single-image super-resolution (SISR) by aggregating sub-pixel information from multiple frames. However, it requires a burst of frames captured under near-static conditions, and such frames are unavailable for single photographs or archival images. We propose Pseudo-Burst Super-Resolution (PBSR), which brings BSR-style reconstruction to the single-image input setting by synthesizing pseudo-burst frames via zero-shot novel view synthesis (NVS). PBSR first generates pseudo-burst frames with realistic parallax using a viewpoint sampling strategy calibrated to the pixel-shift distribution of real burst datasets. The frames are then processed by a BSR backbone equipped with a geometry-aware alignment module that reuses the NVS camera parameters and estimated depth. While the NVS stage is zero-shot, the backbone is fine-tuned with an artifact-aware adaptation so that it can exploit the synthesized frames despite their generative artifacts. Experiments on the BurstSR dataset show that PBSR consistently improves in PSNR, SSIM, and LPIPS over the single-frame baseline with the same reconstruction backbone.

101. 【2610.40887】Inter-Frame Predictive Contour Coding for Semantic Map Compression

链接:https://arxiv.org/abs/2610.40887

作者:Runyu Yang,Hyomin Choi,Fabien Racapé,Ivan V. Bajić

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:computer vision applications, semantic map compression, lossless semantic map, important intermediate representation, semantic map

备注: 4 pages, 4 figures, to be presented at the 2026 IEEE International Conference on Visual Communications and Image Processing, Singapore, December 2026

点击查看摘要

Abstract:Dynamic semantic maps have become an important intermediate representation for many computer vision applications. Efficient lossless compression of such maps is essential for reducing storage and transmission costs. Existing contour-based semantic map compression methods mainly exploit spatial redundancy within individual frames while largely ignoring the strong temporal correlation between adjacent semantic maps. In this paper, we propose an inter-frame predictive contour coding framework for lossless semantic map compression. The proposed framework first predicts blob positions and label indexes from the reference frame and then performs contour prediction using corresponding chain-code units in the reference contours. A mode selection mechanism is further employed to choose between intra and inter coding according to the estimated coding cost. By exploiting temporal contour redundancy while preserving the advantages of contour-based representation, the proposed framework significantly improves coding efficiency. Experimental results on the VSPW dynamic semantic segmentation dataset demonstrate that the proposed method consistently outperforms state-of-the-art lossless semantic map compression methods. Compared with the recent context-adaptive extended chain coding framework, the proposed inter-frame coding achieves an average bitrate reduction of 3.0\% without significant increase in the average encoding time, demonstrating an effective trade-off between compression performance and computational complexity. The source code is made publicly available at this https URL.

102. 【2610.40662】A small HER2 reader for routine HE slides: real-world deployment

链接:https://arxiv.org/abs/2610.40662

作者:Thang Tran(CloudKites AI Lab, New South Wales, Australia),Lan Dang(Monash Business School, Monash University, Victoria, Australia)

类目:Quantitative Methods (q-bio.QM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Software Engineering (cs.SE)

关键词:status decides, decides who receives, IHC, encoder, public TCGA slides

备注: 32 pages, 12 figures, 17 tables (including supplementary material). Research use only. Weights and data: [this https URL](https://huggingface.co/cloudkites/her2-reader)

点击查看摘要

Abstract:HER2 status decides who receives HER2-targeted therapy. Pathologists score HER2 protein by immunohistochemistry (IHC); equivocal IHC 2+ tumours, their hardest calls, wait for in situ hybridisation (ISH). We built a HER2 reader for routine HE slides, owned end to end, as a baseline for pathologists. A 22M-parameter ViT-S/16 tile encoder was trained on public TCGA slides by self-supervision, distillation from H-optimus-0 and two rounds of JEPA refinement; five cross-validated attention-based slide classifiers average their probabilities; and an operating point is fixed on training data. Compared under one paired ten-seed protocol, readers on our encoder rank first of 7 on external validation from TCGA-BRCA to Yale-HER2 (AUC 0.812), level with readers on encoders 4 and 50 times larger. We also rebuilt PathBench's encoder benchmark on public cohorts; our replica reproduces its published order of reference encoders, and under it our encoder ranks first of 7 on TCGA-BRCA (0.689) and sits level with H-optimus-0 and Phikon on Yale-HER2 (0.897). On three external hospitals our deployed reader reaches AUC 0.82 on Yale-HER2 (about 0.81 with training slides balanced for tissue size), 0.75 on HEROHE and 0.63 on BCNB biopsies, and among HEROHE's 85 IHC 2+ cases it ranks ISH-amplified above non-amplified tumours at 0.76, best among our TCGA-trained readers. Per-laboratory score normalisation and a laboratory's own slides improve it further on a new site. Without a GPU our reader needs 5-6 s per slide. It serves as a research-use pre-read in a pathology platform, where it proposes a probability and a call beside IHC and helps prioritise ISH for equivocal cases. Weights, per-slide predictions and the data behind every figure are public at this https URL.