本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新966篇论文，其中：
- 自然语言处理180篇
- 信息检索14篇
- 计算机视觉166篇
自然语言处理
1. 【2610.22355】OmniVerifier-C1: Decomposed Graded Verifier for Rule-Governed Generative World Modeling
链接：https://arxiv.org/abs/2610.22355
作者：Bowei Liu,Xinchen Zhang,Xuhuan Li,Tianlin Zhang,Kaian Jiang,Jingwei Liu,Congyang Zhao,Yifei Qian,Junhong Liu,Zhiheng Li,Yujiu Yang,Yang Cai,Ling Yang
类目：Computation and Language (cs.CL)
关键词：advancing multimodal intelligence, visual verifiers play, play a crucial, crucial role, role in advancing
备注： NeurIPS 2026. Project: [this https URL](https://github.com/Cominclip/OmniVerifier)
点击查看摘要
Abstract:Generative visual verifiers play a crucial role in advancing multimodal intelligence. To enhance the robustness of visual verifiers in complex multimodal scenarios involving compositional requirements, we move beyond conventional binary verifiers that produce only True/False discrete judgments and introduce a verifier that automatically decomposes complex prompts or environmental rules into fine-grained components and assigns pointwise scores to provide a continuous and more informative critique signal. Our experiments further demonstrate that these structured and interpretable outputs improve the verifier's generalization to out-of-domain multimodal critic tasks. To train this verifier, we introduce a Decoupled RL training strategy that jointly optimizes sub-question-level binary judgment and global alignment scoring, using precise local feedback to develop fine-grained verification capabilities that provide a foundation for reliable continuous scoring at the global level. Under a general reinforcement learning framework, we first empirically demonstrate that the proposed pointwise graded verifier significantly outperforms binary verifiers in traditional text-to-image scenarios. We then extend our investigation to rule-governed generative world modeling where generative models are leveraged for world simulation and world reasoning under explicit rules. From a theoretical standpoint, we further show that a pairwise verification paradigm yields more accurate critiques than the pointwise formulation when ground-truth images are available, with empirical results on diverse structured world-modeling tasks such as Maze and Sudoku further validating the effectiveness of our approach. Overall, our findings suggest a key insight: the transition from generative models to structured world-modeling agents critically hinges on the availability of accurate pairwise graded visual verifiers.
2. 【2610.22350】FDE-Gym: The Last Mile of AI Delivery
链接：https://arxiv.org/abs/2610.22350
作者：Dongxu Yang,Hongda Yan,Renxin Wang,Baoli Zhang,Haojia Zuo,Ying Zhao,Youmin Chen,Xiaojian Liao,Congming Gao,Tianyang Jiang,Yixiao Chen,Qing Wang,Zhiguo Yu,Xiaqing Li,Yuhao Zhang,Jiawen Sun,Renzhe Xu,De Mi,Tiancheng Wu,Xianya Fu,Xuanlu Zhao,Bo Feng,Meixuan Ren,Guanming Lin,Ziheng Zhou,Xinhua Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Existing agent benchmarks, Existing agent, issue reports, defined by issue, agent benchmarks typically
备注： 14 pages, 8 figures, 4 tables. Website: [this https URL](https://fde-gym.com/paper) ; Code: [this https URL](https://github.com/deeplethe/fde-gym) ; Data: [this https URL](https://huggingface.co/datasets/DeepLethe/FDE-Gym)
点击查看摘要
Abstract:Existing agent benchmarks typically evaluate agents on well-specified tasks defined by issue reports, specifications, or task tickets. Real-world customer delivery is different: forward-deployed engineers (FDEs) must clarify ambiguous requirements, work in live systems, and uncover unstated constraints. We introduce FDE-Gym, a benchmark of 95 end-to-end delivery tasks from 20 customer scenarios across 18 sectors, each adapted by industry experts from real-world delivery projects. In simulated customer environments with scripted stakeholders and modifiable customer systems, agents interact with stakeholders and operate on production-like systems to deliver working solutions. FDE-Gym scores a delivery by how much it improves the customer's own success metric, normalized between 0 (unchanged system) and 1 (reference solution), with penalties for stakeholder interactions (messages, trial runs, and waiting time). An online platform lets humans practice FDE skills under the same grading criteria. We evaluate 13 model configurations from seven providers. In the realistic setting, where unstated constraints must be discovered, the best configuration achieves a mean FDE-Gym score of 0.56 and resolves only 14 of the 95 tasks (a score of at least 0.8 with no incident). Discovering unstated constraints is the primary bottleneck: performance drops sharply when models must uncover them without explicit guidance. Yet information discovery alone does not account for the gap: even on the 23 tasks where the best configuration obtains every key fact from stakeholders, it reaches a normalized business uplift of 0.8 or above on only 10. These results reveal a substantial gap between solving well-specified tasks and delivering effective AI systems for real customers.
3. 【2610.22344】MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering
链接：https://arxiv.org/abs/2610.22344
作者：Shangheng Du,Jinxin Shi,Shuaiyu Zhang,Yiming Wu,Junpeng Zhao,Shiyang Feng,Xin Li,Liang He,Xiangchao Yan,Bo Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, assisting scientific research, Large language, recursive self-improvement, recent MLE systems
备注： Code: [this https URL](https://github.com/InternScience/MLExpert) Model: [this https URL](https://huggingface.co/InternScience/MLExpert)
点击查看摘要
Abstract:Large language models (LLMs) are expanding from assisting scientific research and engineering to autonomously developing and improving AI systems, advancing AI for AI (AI4AI) as a pathway toward recursive self-improvement (RSI). Workflow-driven machine learning engineering (MLE) systems provide a practical path toward this pursuit through complex orchestration that manages long-horizon experimentation, while recent MLE systems adopt model-directed interaction, allowing models to autonomously organize experiments and adapt optimization strategies based on execution feedback. However, feedback from each experiment reflects several preceding decisions, and a long MLE run contains many such costly experiments. Training must therefore select useful supervision from long interaction trajectories and learn from intermediate outcomes. We propose a post-training method for autonomous long-horizon MLE optimization and apply it to train MLExpert, a 35B Mixture-of-Experts agentic model. We design the Kaggle-MLE Factory to construct executable tasks and an interaction harness for model-directed experimentation. Hierarchical agentic SFT transfers general tool-use and coding capabilities to MLE through outcome-guided supervision. Windowed Interaction RL (WIRL) treats the multi-turn decisions between successive experiment results as an execution window and assigns it a shared outcome-based reward. Asynchronous collection and policy correction support policy updates before the trajectory ends. On MLE-Bench Lite, MLExpert improves the average medal rate of the base model from 37.9% to 72.7%, achieving performance comparable to larger frontier models such as Kimi-K3 and GLM-5.3. Further experiments show that MLExpert improves performance on NatureBench Lite, agent scaffold optimization, and algorithm optimization, suggesting that the learned optimization capability generalizes to other tasks.
4. 【2610.22333】Evaluation Awareness Beyond English: Do LLMs Act Differently When Tested in Indic Languages?
链接：https://arxiv.org/abs/2610.22333
作者：Trizal Garg,Sibayan Mitra,Arya Karanjkar,Advait Singh,Jagat Sesh Challa,Yash Sinha,Siddharth Mehrotra,Dhruv Kumar,Pratham Yogish Maliya
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language, Large language models, Indic, Indic languages, Large
备注：
点击查看摘要
Abstract:Large language models (LLMs) can often tell when they are being tested. This ability, known as evaluation awareness, can lead models to act more cautiously during safety evaluations than in real use. Existing work has studied evaluation awareness almost entirely in English, although models serve users in many languages. Indic languages are spoken by over a billion people, yet evaluation awareness remains almost entirely unstudied in them. We test four instruction-tuned models from three families in five Indic languages alongside English. A set of cues varies whether the model is told that it is monitored and whether the monitoring is a safety test. Models refuse harmful requests more often when they are told that they are being tested. This increase appears in all four models and all six languages. In Indic languages, refusal of harmful requests rises by 14.4 percentage points on average. The test cue also brings Indic refusal of harmful requests level with English, but raises refusal of benign Indic requests from 6.9% to 11.3%. We release all 47,880 judged responses to support further work. These results suggest that safety evaluations in Indic languages may not reflect how models treat their everyday users.
5. 【2610.22327】wice Upon a Time: Complementary Representations for Time-Series Reasoning
链接：https://arxiv.org/abs/2610.22327
作者：Hedi Zisling,Liran Nochumsohn,Ilan Naiman,Mihir Parmar,Omri Azencot
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Time Series Language, Time Series, enable language-based understanding, fundamental question remains, Series Language Models
备注：
点击查看摘要
Abstract:Time Series Language Models (TSLMs) enable language-based understanding and reasoning over temporal data, yet a fundamental question remains: what information should their time-series representations preserve, and what variation should they factor out? Existing TSLMs typically expose the language model to a single representation, imposing a fixed inductive bias across downstream tasks. We instead introduce complementary representations as a design principle for time-series reasoning. Our model combines two visual views: line plots preserve absolute measurements and the observed coordinate frame, while normalized delay embeddings factor out positive amplitude rescaling and offsets while exposing temporal structure. Dedicated visual encoders integrate both views into a shared language model through visual tokens and multi-level feature fusion. Evaluation-time interventions verify that the two views exhibit distinct invariance profiles, while single-view ablations show that their combination is particularly beneficial beyond basic perception, with the large gains in prediction and reasoning. Built on Qwen3-VL-8B, our dual-view model improves overall TSRBench accuracy from 44.5% with line plots alone to 53.2%, substantially exceeding the strongest evaluated dedicated TSLM baseline at 36.7%. It further achieves 89.9% accuracy on TSExam and 86.8% numerical accuracy on multivariate ChatTS alignment. Together, these results demonstrate that complementary representations provide an effective design principle for general-purpose TSLMs, enabling models to exploit temporal structure without sacrificing access to the original measurement frame.
6. 【2610.22324】raining Reasoning Models to Generate Diverse Scientific Ideas
链接：https://arxiv.org/abs/2610.22324
作者：Manya Wadhwa,Pranav Narayanan Venkit,Hiroaki Hayashi,Yu Li,Tuhin Chakrabarty,Chien-Sheng Wu
类目：Computation and Language (cs.CL)
关键词：Claude Opus, research pipeline, pipeline is generating, Large Language Models, ideas
备注： Code and Data at: [this https URL](https://github.com/ManyaWadhwa/diverge_ideation) | Under Review
点击查看摘要
Abstract:One of the first steps of a research pipeline is generating ideas. Large Language Models (LLMs) are increasingly used to automate this step, but most of this work optimizes the quality of individual ideas, while overlooking diversity. In our work, we study document-grounded ideation, focusing on increasing the diversity of LLM generated ideas and ensuring they are high quality. Given prior papers, a model must propose a set of ideas that are each high-quality and clearly distinct from one another, while also being grounded in the input documents. To optimize for this, we propose training with a set-level reinforcement learning objective. In our setup, in a single generation, the model writes K structured idea cards grounded in the source papers, and the set is scored jointly, where each idea's quality is weighted by its distance from the ideas written before it. This teaches the model to steer each new idea away from its predecessors. We show that our trained 8B model achieves higher creative utility (a measure combining quality and diversity) than Claude Opus 4.8 and GPT-6 Astra on our contamination-free benchmark. In a pilot human study with four experts, our sets are judged as promising as Claude Opus 4.8's and contain marginally more unique ideas. When a coding agent runs proof-of-concept experiments on the ideas, our model's success@k is comparable to Claude Opus 4.8's, so we see that the added diversity does not cost any executability.
7. 【2610.22322】Learning Self-Orchestration in Decentralized Agent Swarms
链接：https://arxiv.org/abs/2610.22322
作者：Guowei Xu,Zhenting Qi,Amani Kiruga,Himabindu Lakkaraju,Yilun Du
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：agent swarm depend, individual capabilities, agent, individual members, decentralized agent swarms
备注：
点击查看摘要
Abstract:The capabilities of an agent swarm depend on both its individual members and how they coordinate. Yet existing multi-agent systems often train agents within fixed orchestration structures, separating the learning of individual capabilities from the organization of collective behavior. We introduce market-based post-training (MPT), a framework for jointly learning action policies and self-orchestration in decentralized agent swarms. Agents express their willingness to participate through bids, which determine who acts and how collective outcomes provide local training credit. Learning both action and bidding behavior allows individual capabilities and patterns of participation to adapt together without a central coordinating agent. We evaluate MPT on embodied crafting, robot navigation, and deep research. Results show gains over monolithic post-training and confirm that agent participation indeed evolves with learning. With the same post-trained action policies, learned self-orchestration outperforms alternative coordination strategies. Ablations show that both action and bidding benefit from learning, and that learned bids provide more effective action-training signals. Beyond the original training objectives, trained swarms adapt faster to related tasks and achieve better performance with larger populations at inference time. Larger populations also suffer smaller performance losses under agent dropout, demonstrating that learned self-orchestration supports reuse, scaling, and robustness in decentralized agent swarms. Code and trained models are available at this https URL.
8. 【2610.22314】MindEval2: Clinically Grounded Patients and Rubrics for Evaluating Language Models in Mental Health Support
链接：https://arxiv.org/abs/2610.22314
作者：John Mendonça,Daniel Tschernutter,José Pombal,Areti Vassilopoulos,Catarina Botelho,Ignacio Sarasua,Maya D'Eon,Nuno Guerreiro,Ricardo Rei
类目：Computation and Language (cs.CL)
关键词：people increasingly turning, mental health support, people increasingly, increasingly turning, mental health
备注： 47 pages, 17 figures, 23 tables. Code, prompts, benchmark profiles and annotations: [this https URL](https://github.com/SWORDHealth/mind-eval)
点击查看摘要
Abstract:With people increasingly turning to AI chatbots for mental health support, the need to evaluate these tools is becoming more pressing. Recent benchmarks attempt to mimic a realistic setting by simulating multi-turn interactions with synthetic patients and evaluating them with an LLM-as-a-judge. However, the usefulness of these methods is limited because simulated patients can be overly forthcoming and self-reflective, and judgments typically involve opaque Likert scales with unclear practical utility. To bridge these gaps, we introduce MindEval2, an evaluation framework that consists of two components: Mental Health Quality Rubrics (MHQR), for evaluation, and MindSim, for patient simulation. For MHQR, we collaborate with PhD-level psychologists to develop a set of rubrics that break down response quality into explicit operational criteria that are more interpretable and actionable than existing evaluation taxonomies. MindSim, in turn, is an LLM harness that combines carefully-designed patient profiles with tools, enabling more varied, challenging, and realistic interactions than existing baselines. The harness also contains a memory component that is updated between each interaction, enabling MindEval2 to model the longitudinal aspect of mental health. We evaluate 18 proprietary and open-weight models on MindEval2, finding that while frontier models have largely improved on issues related to surface level quality and boundaries, guidance calibration remains the dominant failure mode across all models, accounting for most of the quality gap.
9. 【2610.22312】Grid-Bench: Can LLMs Predict How Discrete Worlds Change?
链接：https://arxiv.org/abs/2610.22312
作者：Zixiang Xu,Zirui Song,Wanrong Zheng,Chiyu Zhang,Yue Huang,Yuyang Peng,Kexin Zhang,Jinkun Chen,Xiuying Chen,Xiangliang Zhang,Yan Liu,Laurent Itti,Frank Shyu,Xiaoqiang Luo,Sandeep Pandey,Xi Liu,Luke Simon,Xiyang Hu,Yue Zhao
类目：Computation and Language (cs.CL)
关键词：Spatial instructions describe, move objects, modify their surroundings, instructions describe, transform regions
备注： 39 pages, 15 figures, 15 tables, including appendices. Project website: [this https URL](https://grid-bench.github.io/) ; Code: [this https URL](https://github.com/grid-bench/Grid-Bench) ; Data: [this https URL](https://huggingface.co/datasets/xzx34/Grid-Bench)
点击查看摘要
Abstract:Spatial instructions describe how to move objects, transform regions, or modify their surroundings. When several operations are applied in sequence, each acts on a configuration shaped by earlier changes. How accurately can large language models (LLMs) predict the resulting spatial state? We introduce Grid-Bench, an executable benchmark in which eight families of operations transform discrete worlds represented as two-, three-, and four-dimensional grids. Given an initial grid, explicit rules, and an event history expressed as text, a model predicts the complete final grid. Reference execution makes every predicted value checkable, supporting comparisons across spatial operations, history lengths, and workloads. Evaluating six LLMs shows that complete-state accuracy falls sharply as histories grow, with substantial divergence among models that perform similarly on single events. Models with similar exact-match accuracy can nevertheless differ substantially in the number of incorrect cells on shared instances. Even over long histories, some models recover many correct changes beyond what copying the initial state would yield. Grid-Bench makes both complete recovery and these differences in returned states directly measurable across a range of spatial conditions.
10. 【2610.22300】Knowledge That Is Linear Before Fine-Tuning Generalizes After It
链接：https://arxiv.org/abs/2610.22300
作者：Faridoun Mehri,Hinrich Schütze
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：original relation, relation, learning equally, model, facts
备注： 25 pages, 8 figures, 7 tables. Code and data: [this https URL](https://github.com/NightMachinery/active-inert-facts)
点击查看摘要
Abstract:Not all facts a language model can recall support further learning equally well. We distinguish active facts, which support generalization beyond their own recall, from inert facts, which can be recalled but do not support such generalization in a given task. We study this distinction by constructing new relations from existing ones. Take the relation that maps a place to its continent (Paris - Europe) and assign each of its answers an arbitrary new label (Europe - crab, Asia - zebra). The new relation then maps Paris - crab. We fine-tune the model on the new relation for a subset of subjects, without telling it the original relation or the relabeling rule, and test whether it assigns the corresponding labels to held-out subjects that share an answer in the original relation. Having learned Paris - crab, does it answer Munich - crab? Across eleven language models and 70 relations, how linearly readable the original relation is in pretrained representations strongly predicts this generalization. Within each model, the two correlate across relations at Pearson r = 0.87 to 0.92. This association persists when controlling, separately and jointly, for the number of fine-tuning subjects and answers, the model's accuracy on the original relation, and how often the subjects occur in pretraining text. It is also robust to re-randomizing the label assignment and fine-tuning seed, and to replacing the animal labels with labels from thirteen other semantic categories. When we map a fine-tuned model's wrong label back to the original answer it was assigned to, Munich - zebra becomes Munich - Asia. Answers recovered this way are more often among the linear probe's top answers for the subject than among the pretrained model's own. Whether a new relation generalizes depends less on whether its facts can be recalled than on how readily their shared structure can be read out linearly.
11. 【2610.22298】AI Consilium: a Benchmark of LLM Clinical Multidisciplinary Second Opinions
链接：https://arxiv.org/abs/2610.22298
作者：Alexey A. Bokov,Ivan I. Panin,Nikolay B. Nechaev,Mikhail Yu. Valkov,Valeria Yu. Chernina,Natalia Gombolevskaya,Ayyaz Hussain,Vladimir M. Agafonov,Victor A. Gombolevskiy,Aleksandr V. Nesterov,Iaroslav R. Bespalov,Ivan V. Oseledets,Dmitry V. Dylov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, generate differential diagnoses, Large language, clinically coherent, factually grounded
备注：
点击查看摘要
Abstract:Large language models (LLMs) can generate differential diagnoses for complex cases, but a useful second opinion must also be factually grounded, clinically coherent, actionable, and safe. We developed a multidimensional benchmark using 300 diagnostically resolved NEJM--MedQA cases: 110 for physician reference ratings and Judge calibration and 190 for held-out evaluation. Eight single-model pipelines generated independent role-specific opinions and interactive-consilium reports under free-form and structured clinical-reasoning conditions. A physician-calibrated LLM Judge evaluated 3,040 final reports and the corresponding structured primary-role outputs. Model identity separated report quality more strongly than response format. Structured final reports had higher overall mean scores in seven of eight model pipelines, with their clearest advantage in management (2.740 vs. 2.436). Compared with the structured pre-consilium primary-role opinion, the complete structured synthesis had higher pooled scores across all five shared criteria, with the largest increases in problem prioritization, factual grounding, and reasoning coherence. GPT-5.6-Sol led every evaluated component and reached consensus in the fewest review rounds. These findings show that the benchmark can distinguish model capability, the contribution of multidisciplinary synthesis, criterion-specific effects of response structure, deliberation dynamics, and inference requirements within one common-case evaluation.
12. 【2610.22294】Multi-Target Few-Shot Prompting with Diffusion Language Models
链接：https://arxiv.org/abs/2610.22294
作者：Anton Xue,Alan Li,Rahul Saha
类目：Computation and Language (cs.CL)
关键词：Few-shot prompting, Few-shot, Abstract, prompting, change or API
备注：
点击查看摘要
Abstract:Few-shot prompting is useful when instructions and rewards are hard to specify. One such application is editing by example, where a demonstrated formatting change or API migration may need to be applied across multiple sites. However, such edits often depend on both left and right context, making generation with causal autoregressive models awkward. We therefore introduce multi-target few-shot prompting with diffusion language models, where examples guide the infilling of multiple masked regions within a shared canvas. To address the known challenge of reliably following demonstrations in few-shot prompting, we further leverage selective masking of the canvas to derive a likelihood-ratio reward that favors example-supported infills. Across few-shot prompting benchmarks and software refactoring case studies, we find that demonstrations improve infilling accuracy, with example guidance yielding further gains in several settings.
13. 【2610.22292】CAT-alyzing Honesty: Continuous Adversarial Training for Transferable LLM Honesty
链接：https://arxiv.org/abs/2610.22292
作者：Yuan-Chen Chang,Niklas Herbster,Gauthier Gidel,Tommaso Tosato
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Large language models, Large language, Continuous Adversarial Training, Large, CATCH
备注： 9 pages, 6 figures
点击查看摘要
Abstract:Large language models (LLMs) are becoming prevalent in scenarios where honesty is critical. However, despite alignment training, these models still exhibit dishonest behaviour, such as outputting claims that contradict some knowledge or are not supported by what is accessible in context. We introduce Continuous Adversarial Training for Consistent Honesty (CATCH), inspired by a method originally developed to robustly refuse harmful queries. CATCH trains the model towards an honest answer and away from a dishonest one while maintaining the model's capabilities. We evaluate two architectures (Llama-3.3-70B-Instruct and Qwen3-3.6-27B). We show that trained with only hundreds of targets built from self-reporting scenarios, CATCH learns an honest behaviour that robustly generalizes and transfers across distinct benchmarks. It consistently reduces dishonesty under pressure on MASK, increases confessions in the multi-agent game of Among Us, and improves the discovery rates of the model's hidden behaviours in AuditBench. We show that CATCH outperforms prompting and supervised fine-tuning in improving honesty, and it is on par with state-of-the-art honesty activation steering. However, CATCH surpasses honesty steering in maintaining utility, thanks to a novel choice of utility data.
14. 【2610.22273】Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries
链接：https://arxiv.org/abs/2610.22273
作者：Anikait Singh,Teresa Zhang,Yoonho Lee,Roshen Sanjay Nair,Aviral Kumar,Chelsea Finn
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, long document contexts, document contexts remains, language models, contexts remains
备注：
点击查看摘要
Abstract:Reasoning over long document contexts remains a challenge for large language models (LLMs). Standard retrieval methods are inherently reactive, bottlenecking agents with complex, cross-document reasoning at inference time, while precomputed structures like knowledge graphs often fall short because they rely on rigid heuristics. Instead, can we allow agents to perform anticipatory directed curation: learning to proactively reorganize unstructured corpora prior to inference to efficiently serve diverse future queries. We build on a key asymmetry in modern agentic harnesses (e.g., Claude Code): while LLM agents are adept at navigating existing filesystems to solve an immediate task, they are rarely trained to construct reusable workspaces for future use. To instantiate this capability, we introduce Librarian Agents, a framework in which a builder agent transforms raw documents into a hierarchical filesystem of synthetic files and reference links, which forms a workspace tailored for a downstream answering agent. We formulate workspace construction as a Markov decision process and optimize the builder policy via reinforcement learning to directly maximize downstream answering accuracy. Empirically, Librarian Agents outperforms the strongest retrieval and precomputation baselines by 33 percentage points on BrowseComp-Plus, amortizes upfront construction costs across repeated queries, and generalizes zero-shot to unseen domains on BRIGHT with a 31-point average accuracy improvement.
15. 【2610.22249】Not X, but When: Diagnosing a Mandarin LLM Writing Tic through Contextual Appropriateness
链接：https://arxiv.org/abs/2610.22249
作者：Yihang Peng,Yi Jing,Dewen Liu,Weihan Meng,Ying Liu
类目：Computation and Language (cs.CL)
关键词：serve legitimate functions, Recurring expressions, machine authorship, legitimate functions, model-written text
备注：
点击查看摘要
Abstract:Recurring expressions in model-written text are often treated as signatures of machine authorship, yet most of them serve legitimate functions. Whether such an expression is a tic depends on whether the model knows when it is called for. This judgment of appropriateness, central to communicative competence, remains largely unexamined for language models. We study it through the Mandarin corrective construction bushi X, ershi Y ("not X, but Y"). Drawing on Gricean pragmatics and corrective negation, we introduce a decision tree that classifies uses as substantive, optional, or defective by testing whether the context makes X a live alternative and whether rejecting X is informative. Five commercial models use the construction 2.5 to 9.2 times as densely as a human reference. Of 307 annotated uses, only 1.30% are defective while 52.8% are optional, that is, correct but unneeded, so models fall short in appropriateness far more often than in correctness. Several reward models favor the construction even over quality-matched variants, an LLM judge favors it even where the context does not license it, and both supervised fine-tuning and preference optimization tend to raise its frequency in open-weight models. We hope this work encourages the development of models attentive to the appropriateness of their expressions.
16. 【2610.22244】Language Is a Security Surface for Agent Guards
链接：https://arxiv.org/abs/2610.22244
作者：Hasan Demirkiran,Jens Ernstberger
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Step-level guards decide, Step-level guards, guards, action is safe, Step-level
备注： Accepted at the NeurIPS 2026 Workshop on Agents in the Wild: Safety, Security, and Beyond (AIWILD). 9 pages plus appendices
点击查看摘要
Abstract:Step-level guards decide, before each tool call, whether an agent's next action is safe given the user's request and the trajectory so far. Users write those requests in many languages, while guard prompts and the benchmarks on which purpose-built guards are trained and evaluated are English. We ask whether a guard's verdict depends on the language of the request. We build LinguaGuardBench from the 1,220 labelled steps of TS-Bench AgentDojo-Traj: we translate only the user instruction into German, French, Turkish, Swahili and Amharic, and keep every tool call, observation and label byte-identical, so any change in a verdict is attributable to language alone. Six English rewordings and a whitespace placebo serve as controls, and managed guards are run three times to measure their noise. Across 19 guards, from frontier APIs to 4B open models and four purpose-built agent guards, most open, small and purpose-built guards change verdicts under translation beyond their own noise floor, and the effect grows with the rarity of the language: among the nine guards below 13B parameters, the mean placebo-adjusted flip rate rises from +1.5 pp on French to +4.4 pp on Amharic. Purpose-built guards are the most sensitive. The direction of the damage tends to follow guard size: open guards of 12-30B parameters block more benign steps (up to +5.0 pp false positives), and every significant loss of recall is in a guard below 10B (up to -7.4 pp). Frontier guards shift by at most about one point; the strongest, Gemini 3.8 Flash, returns identical verdicts with and without the request. The damage is concentrated in a few instructions and, in a post-hoc analysis, falls on steps where the agent's reasoning restates the English request, consistent with guards reacting to inconsistency between channels. English paraphrase moves every guard less than translation does. We release the benchmark and all 489k verdicts.
17. 【2610.22236】raining-Free On-Policy Distillation
链接：https://arxiv.org/abs/2610.22236
作者：Bangji Yang,Jiajun Fan,Zhaoyu Zhu,Hongbo Ma,Ge Liu
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：On-policy distillation consolidates, gradient steps, consolidates specialist models, teacher passes, distillation consolidates specialist
备注： 20 pages, 6 figures, 9 tables
点击查看摘要
Abstract:On-policy distillation consolidates specialist models into one student at the price of rollouts, teacher passes and gradient steps for every teacher. We show that the consolidation does not need training: with forward passes only, the capabilities of separately tuned specialists can be aggregated into one model that is, on average, more accurate than either specialist alone. When specialists share a base model, distillation has an exact layer-wise solution: each linear layer of the fused model must reproduce every specialist's output on the inputs that specialist receives while reading its own answers, a least-squares problem whose solution needs only the second moments of those inputs. One forward pass over a few hundred rollouts provides them. We call this training-free on-policy distillation (\method). What the rollouts contain matters more than the solver: answers truncated in repetition loops are few among a mathematics specialist's rollouts but carry a large share of their tokens, and removing them lifts the fused model on AIME25 from task arithmetic's level to the specialist's at matched precision. On Olmo~3 7B, a few GPU-hours of forward computation per specialist yield a generalist that keeps most of each specialist's gain on each of seven mathematics and code benchmarks.
18. 【2610.22209】Beyond Downstream QA: Rethinking How We Evaluate Agent Memory
链接：https://arxiv.org/abs/2610.22209
作者：Sebastian-Antonio Toma,Jean de Kernier,Mike Ply,Oliviu Matei
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：measuring downstream question-answering, downstream question-answering accuracy, reflect correct knowledge, responses reflect correct, agent responses reflect
备注： 14 pages, 1 figure, code and data: [this https URL](https://github.com/amazon-science/feb-30-benchmark)
点击查看摘要
Abstract:Agent memory benchmarks evaluate whether an agent's responses reflect correct knowledge, measuring downstream question-answering accuracy as a proxy for memory quality. We show this evaluation paradigm is incomplete: it conflates memory correctness with retrieval and generation quality, producing both false positives where correct responses mask broken memory and false negatives where incorrect responses blame correct memory for retrieval failures. We introduce FEB-30, a benchmark of 30 fact-evolution trajectories spanning 6 diagnostic categories and 3 difficulty levels, constructed via paradigm inversion: documents are generated from known fact trajectories, yielding deterministic ground truth without human annotation. Each trajectory defines how a fact should evolve across multi-author artifacts (documents, emails, conversations), enabling direct inspection of the memory store after each ingestion step. Applying FEB-30 to a representative memory system, we demonstrate that intrinsic and extrinsic evaluation diverge by an average of 16 percentage points, with 44% of trajectories exceeding meaningful divergence thresholds. Diagnostic decomposition reveals that the system correctly classifies memory operations (create, update, reinforce, supersede) only 20% of the time, a failure entirely invisible to extrinsic evaluation, and that failure modes differ systematically by category and difficulty. We release the benchmark, document generation pipeline, and scoring framework to support reproducible evaluation of agent memory systems.
19. 【2610.22196】Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing
链接：https://arxiv.org/abs/2610.22196
作者：Tianxiang Fei,Jiazheng Kang,Mao Zheng,Xingyan He,Xiang Yu
类目：Computation and Language (cs.CL)
关键词：External-memory systems extend, systems extend language-model, extend language-model applications, quality depends critically, External-memory systems
备注：
点击查看摘要
Abstract:External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state. Existing frameworks typically place a general-purpose large language model behind framework-specific prompts. This raises serving cost, and a writer specialized for one protocol does not transfer directly to another; a unified model that can operate across established memory frameworks remains largely unexplored. We present Hy-Memory-30B-A3B, a compact long-term-memory writer trained across Mem0, MemOS, and Hy-Memory. Memory On-Policy Distillation teaches framework-specific write protocols on student-generated states; Memory RL then optimizes downstream answerability using dense per-chunk probes, attributed cross-chunk rewards, over-storage controls, and chunk-level GRPO. Carrying policy-written banks across windows keeps training aligned with deployment. On fixed 20% benchmark subsamples, Hy-Memory-30B-A3B ranks first on all four evaluated harnesses, including held-out EverMemOS, with a 55.49% macro average versus 54.62% for Claude Opus 5.
20. 【2610.22195】HTN-Orchestrate: A Hierarchical Task Network Framework for Multi-Agent Orchestration
链接：https://arxiv.org/abs/2610.22195
作者：Yanchen Deng,Jianguo Huang,Yao Long Teng,Yixuan Li,Handuo Zhang,Ning Wang,Liangcai Su,Xinyu Wang,Bo An
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Orchestrating multiple agents, Orchestrating multiple, global task planning, requires reconciling local, complex task requires
备注：
点击查看摘要
Abstract:Orchestrating multiple agents on a complex task requires reconciling local subtask execution with global task planning. Dynamic dispatch approaches provide execution flexibility but do not explicitly model subtask hierarchies or dependencies, while predefined workflows impose this structure but fix the decomposition before execution begins. Therefore, we introduce HTN-Orchestrate, a two-layer framework that separates these responsibilities through a hierarchical task network (HTN). The Planner maintains subtask hierarchies and dependencies, deferring decomposition until prerequisite results become available, while local Orchestrators schedule workers to execute each leaf subtask. Results propagate upward under \textbf{AND} semantics, and accumulated findings inform a rebuilt task network when the current decomposition cannot resolve the task. On five benchmarks spanning web research, scientific reasoning, and research workflows, HTN-Orchestrate outperforms ReAct, Agent Team, and DeepSeek Harness using the same base model, achieving 89.73% accuracy on BrowseComp and 73.44% on SUPERChem, exceeding Agent Team by 2.45 and 4.69 percentage points, respectively.
21. 【2610.22194】AutoSFT: An Agentic System for Automated Data Research in Supervised Fine-Tuning
链接：https://arxiv.org/abs/2610.22194
作者：Bingxiang He,Pengqi Sun,Shihao Peng,Shaoxuan Li,Huiyu Xiao,Hongjian Shi,Zixuan Fu,Ziqing Qiao,Yuxin Zuo,Cheng Qian,Xinqiang Yu,Jiayi Li,Xiusi Chen,Yizhen Song,Xiangyang Wang,Iofai Lei,Yudong Wang,Ning Ding,Zhiyuan Liu,Xiaozhi Wang,Chaojun Xiao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：effort revising training, increasingly automate post-training, revising training data, full training stack, Language model agents
备注： 27 pages, 16 figures
点击查看摘要
Abstract:Language model agents increasingly automate post-training, but when given the full training stack they converge on supervised fine-tuning and spend most effort revising training data. Existing systems give the agent one kind of control, selecting rows from a fixed pool or calling a generator, whereas a human data engineer adjusts proportions, prunes, repairs, replaces and synthesizes the data. We design a data action space for these changes and ask whether an automated system can make the full range rather than one of them, and what structure that requires. We first run this loop with a single agent, and it reaches only one action, adjusting category proportions, while its context fills with execution output and is discarded mid-search. We therefore introduce \textbf{AutoSFT}, a multi-agent system where a meta agent separates execution from analysis, gathers proposals from independent angles, and calls a synthesis subagent for capabilities the pool cannot cover, with the model, the trainer, and the budget fixed within each comparison. Adding each component in turn helps: the executor halves context loss, the analysis subagents lift the best IFEval by $+6.5$, and synthesis adds $+3.4$ IFEval and $+2.9$ IFBench. The same loop transfers to code, where analysis adds $+3.7$ MBPP+ over a single agent that does not improve. Every result comes from runs that retrain from the base model each round, so each component's effect is individually attributable. Our findings suggest that automating SFT data research depends more on covering diverse data actions than on a stronger single action.
22. 【2610.22187】Change the Number, Change the Answer: Assessing Rating Scale Sensitivity in LLM-Based Text Scoring
链接：https://arxiv.org/abs/2610.22187
作者：Wonjeong Jo,Gyuwan Kim,Ming Shan Hee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Numerical Analysis (math.NA)
关键词：Large language models, computational social science, Large language, assign scalar scores, computational social
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used in computational social science to assign scalar scores to social and psychological constructs. However, studies use different rating scales, and whether their scores remain comparable across scale designs is understudied. To address this gap, we define and systematically investigate scale sensitivity, the variation in LLM-generated scores caused by rating scale design. We distinguish numerical sensitivity, changes in normalized scores, from semantic sensitivity, changes in score interpretation. To assess both, our experimental design crosses 2 formats (continuous vs. ordinal), 4 ranges (3, 5, 11, and 21 points), and 2 signs (signed vs. unsigned) across 3 tasks (political leaning, sentiment, and toxicity), 2 prompting strategies (zero-shot and rubric-based), and 5 LLMs. We find that changing one design element shifts normalized scores by about 0.10 on average and changes the category of roughly 20% of texts. Sensitivity is greatest for toxicity, the only unipolar construct examined. Also, rubric-based prompting does not reduce sensitivity compared with zero-shot prompting. We provide practical guidance for designing more reliable LLM-based text scoring and highlight the need for robustness checks across alternative scales.
23. 【2610.22186】EVA-Cap: Optimizing Audiovisual Video Captioning via Event-Centric Alignment
链接：https://arxiv.org/abs/2610.22186
作者：Jiapeng Shi,Qiuxia Hou,Jiaqi Leng,Junke Wang,Yanhao Zhang,Haonan Lu,Ziyi Ye,Zuxuan Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Omni Language Models, Omni Language, Recent advances, advances in Omni, Language Models
备注： Accepted at NeurIPS 2026. Code will be released at [this https URL](https://github.com/OPPO-Mente-Lab/EVA-Cap)
点击查看摘要
Abstract:Recent advances in Omni Language Models (OLMs) provide a unified solution for audiovisual video captioning. Nevertheless, existing approaches predominantly treat captioning as an unstructured text generation process, neglecting the inherent semantic structure of videos and leading to suboptimal fine-grained audiovisual alignment. To bridge this gap, we propose EVA-Cap, a novel framework that decomposes captions into atomic audiovisual events and transforms unstructured text supervision into event-centric alignment. We train EVA-Cap via Supervised Fine-Tuning (SFT) and Group Relative Policy Optimization (GRPO) on a self-curated dataset, EVA-Data, which is built with event-centric quality control. During the GRPO phase, the model is explicitly optimized against three event-centric alignment targets: global event completeness, intra-event attribution, and inter-event synchronization. Extensive experiments demonstrate that EVA-Cap significantly outperforms existing methods in event-centric evaluation (e.g., +9.0% average gain on ChronusAV), while achieving competitive performance on general audiovisual captioning benchmarks (e.g., +3.3% on WorldSense).
24. 【2610.22174】Mosaic: Multi-Session Agentic Reinforcement Learning
链接：https://arxiv.org/abs/2610.22174
作者：Yilong Xu,Minrui Xu,Xinyu Zhou,Xiang Long,Haochen Tan,Zhijiang Guo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：agentic reinforcement learning, existing agentic reinforcement, continuously accumulated context, reinforcement learning, agentic reinforcement
备注：
点击查看摘要
Abstract:Most existing agentic reinforcement learning methods assume single-session trajectories, where interaction proceeds within one continuously accumulated context. However, agentic techniques such as context compaction and subagent forking may produce trajectories spanning multiple sessions, creating a mismatch between the single-session training assumption and inference-time execution. Therefore, we introduce Multi-Session Agentic Reinforcement Learning, a more general setting that supports an arbitrary number of sessions within a trajectory. Under this setting, a widely adopted method is to broadcast trajectory-level advantages to all sessions, but this does not distinguish contributions from various sessions or guide session allocation within trajectories. To address this issue, we propose Mosaic, a multi-session agentic RL method with critic-free hierarchical optimization. At the trajectory level, it incorporates session-usage signals into advantage estimation. At the session level, it shapes each session's advantage according to the estimated marginal contribution. Experiments on BrowseComp with Qwen3.5-4B show that Mosaic outperforms broadcasting in both context compaction and subagent forking scenarios while using fewer sessions on average. Further analyses show that our method achieves improvements in session utility and allocation, which we suggested is a promising target for future advances in multi-session agentic RL.
25. 【2610.22169】Lexical Reference Frames: Interpreting LM Residual Streams in Native Semantics
链接：https://arxiv.org/abs/2610.22169
作者：Jian Gu,Hongyu Zhang,Chunyang Chen,Aldeida Aleti
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：residual stream, Lexical reference frames, unembedding fix, fix the meaning, state
备注： Code: [this https URL](https://github.com/jianguda/lexframe)
点击查看摘要
Abstract:The vocabulary of a language model is its native semantics: the embedding and the unembedding fix the meaning of a state at the two ends of the residual stream. Between them, existing methods either reuse a fixed lens or treat the states as a point cloud, and neither reads a state the way the model does. We argue that every hidden state has a native reference frame, induced by the layers that read it next and adaptive to the context. Lexical reference frames approximate it by reading a state through the model's own remaining layers with a stated number of rounds of attention between positions and a typical attention output for the rest, without fitting to the model's output. No lens, with fixed directions per layer, can exceed the square root of the native frame's coherence, 0.30 and 0.35 at mid-depth of SmolLM3-3B and OLMo3-7B, whereas the first-order frame, LexFrame[1], reaches 0.97 and 0.97 and reads a state within 0.16 nats of the model's output. Its coefficients attribute predictions more faithfully than attribution patching, its lexical basis steers a prediction while sparing other tokens, and its confident readings would let an early exit skip 0.45 and 0.42 of the layers, where lenses skip almost none. In this way, lexical reference frames make every hidden state of the model readable, attributable and steerable.
26. 【2610.22167】CLUE: Uncovering Social Context for Pragmatic Understanding
链接：https://arxiv.org/abs/2610.22167
作者：Chengfei Wu,Zhaoqing Wu,Dan Goldwasser
类目：Computation and Language (cs.CL)
关键词：conversation requires connecting, speakers' relationships, earlier exchanges, requires connecting, Understanding a conversation
备注：
点击查看摘要
Abstract:Understanding a conversation requires connecting what is said to the speakers' relationships, expectations, and earlier exchanges. Prior work shows that supplying relevant context can improve models' social judgments, but much of this information may already be present in the conversation. This motivates training models to discover the cues that matter and use them to support an interpretation. We propose CLUE, a two-stage training pipeline that combines supervised evidence reasoning with GRPO guided by Grounded Information Utilization ($\mathrm{IU}_{\mathrm{G}}$). This reward credits new, evidence-supported social inferences while accounting for reasoning effort. We train on a small set of conversational examples to assess effectiveness and generalization across tasks, languages, and genres. At inference time, the trained model reasons over the supplied interaction in a self-contained manner. Compared with base Qwen, CLUE achieves relative gains of 17.3% in-domain and 9.3% out-of-domain in average weighted F1, with higher F1 on four of five out-of-domain evaluations. These gains are accompanied by over 80% fewer reasoning tokens on average in both domains. Human evaluation further finds that CLUE more often grounds its explanations in specific conversational content, with closer alignment between its quoted evidence and human-selected context.
27. 【2610.22160】EMO: A Closed-Loop Test-Time Computation Framework via Alternating Context Optimization and Logits Steering
链接：https://arxiv.org/abs/2610.22160
作者：Wei Xia,Yehui Tang,Zhi-Hong Deng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：adapts frozen language, optimization adapts frozen, ordinary conditional generation, frozen language models, adapts frozen
备注：
点击查看摘要
Abstract:Test-time context optimization adapts frozen language models through textual feedback, but ordinary conditional generation provides no separate control over how strongly to reinforce the distributional changes induced by a context update. We introduce EMO, a training-free framework inspired by expectation--maximization that alternates question-specific context estimation (E-step) and distribution refinement (M-step). The E-step revises a system context using textual gradients from an external judge without access to gold answers. The M-step contrasts next-token distributions under the revised and preceding contexts at a shared prefix to construct a confidence-constrained logit correction. Feedback on the steered response drives the next context update, coupling adaptation across rounds with intervention within each generation. Theoretically, we connect parameter and context optimization through a shared target-KL objective and additive logit representations, and derive the steering vector from context-induced logit displacements. Under context-improvement and faithful-steering assumptions, we prove a one-round decrease in target KL divergence for sufficiently small steering strength. Under greedy decoding across eight models and six benchmarks, EMO improves the zero-shot baseline in 39 of 40 aggregated settings, averaging $+9.10$ percentage points. With the same judge, it adds $+1.53$ points on average over context-only optimization (TextGrad), with consistent MMLU-Pro gains across models. At matched target-model generation budgets, accuracy advantages over best-of-$N$ are strongest on Llama, while oracle coverage is higher in most comparisons despite fewer candidates. The coverage--selection gap motivates allocating test-time computation jointly to candidate generation and verification.
28. 【2610.22158】PremiseSQL: Evaluating Premise Critique and Abstention in Text-to-SQL Systems
链接：https://arxiv.org/abs/2610.22158
作者：Shuo Lin,Jinzhe Li,Chenlu Guo,Yanhan Li,Yuan Wu,Yi Chang
类目：Computation and Language (cs.CL)
关键词：systems largely assume, Recent advances, large language models, substantially improved, systems largely
备注：
点击查看摘要
Abstract:Recent advances in large language models (LLMs) have substantially improved Text-to-SQL performance, yet existing NL2SQL systems largely assume that user queries are valid and answerable. As a result, models often generate executable SQL even for queries with flawed premises. We introduce premise critique ability in NL2SQL, namely the ability to recognize flawed queries and abstain from generating misleading SQL. To evaluate this capability, we propose PremiseSQL, a benchmark containing 1,800 flawed NL2SQL queries across four categories of premise failures, along with their 1,800 original queries. We further design an evaluation framework to measure intrinsic and prompt-induced premise-aware behavior across three prompting settings. Experiments on frontier LLMs show that current models are strongly premise-trusting by default and rarely critique flawed premises. Stronger critique-oriented prompting improves detection and abstention on flawed queries, but also increases false invalid judgments and suppresses SQL generation on originals. The code is available at this https URL.
29. 【2610.22138】Believed but Not Said: Measuring Hidden Belief Collapse in Multi-Agent LLM Discussions
链接：https://arxiv.org/abs/2610.22138
作者：Liangjie Huang,Henry Peng Zou,Wei-Chieh Huang,Wooseong Yang,Yuwei Han,Philip S. Yu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：LLM systems increasingly, catch individual errors, systems increasingly rely, LLM systems, individual errors
备注： 14 pages, 6 figures
点击查看摘要
Abstract:LLM systems increasingly rely on groups of agents that discuss, critique, and check one another, assuming that peers will catch individual errors. We test this assumption against a minimal adversary. In a ten-agent factual discussion, one or three adversarial agents repeatedly assert a plausible false answer. After each round we probe each benign agent's private answer through a separate call whose response is hidden from its peers, and we separately label its public stance toward the claim. Across six models and three factual-QA datasets, groups remain stable without an attacker: only 0.6% of benign agents finish with the false answer. A single adversarial agent increases this rate to 44.8% and three to 60.5%. Studies of conformity typically report public agreement without private change; we find the reverse. With three adversarial agents present, benign agents hold the false answer in 51.6% of exposed turns but publicly endorse it in only 19.7%. Much of the influence therefore remains invisible in the discussion, and the false answers persist when agents are asked for their own views. Agents that retain the true answer often fail to defend it; once adopted, the false answer spreads among benign agents, and baseline knowledge does not predict robustness.
30. 【2610.22131】Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling
链接：https://arxiv.org/abs/2610.22131
作者：Tong Zhu,Zhe Xu,Zefeng He,Yunkai Chai,Xuyang Hu,Dehong Zheng,Yun Luo,Yafu Li,Qi Zhang,Yu Cheng
类目：Computation and Language (cs.CL)
关键词：Interactive agents repeatedly, agents repeatedly choose, set of actions, ordinal outcomes, repeatedly choose
备注：
点击查看摘要
Abstract:Interactive agents repeatedly choose among a finite set of actions, labels, or ordinal outcomes. Generating a free-form response for each choice adds latency and complicates the interface between a model and its environment. We present Intern-Decision, a family of 0.8B, 2B, and 4B multimodal decision models that return structured choices and candidate probabilities from text and optional images. Our autoregressive masked language modeling objective places one decision placeholder per field in a complete assistant JSON skeleton. Ground-truth symbols appear only in supervision, while all fields are evaluated in a single causal forward pass using the backbone's native language-model head. The 4B model achieves a 90.02% unweighted average accuracy across seven evaluation suites, compared with 88.74% for Jev v1.13.0. For a fixed 289-token request with three fields on one RTX 4090, mean latency is 44.16 ms for the 4B model and approximately 33--34 ms for the smaller models. On a separate 96-case known-distribution pilot, temperature scaling reduces expected multiclass Brier from 0.628 to 0.550 and expected calibration error from 0.213 to 0.089. A confidence-based handoff study on 111 public Jevbench-Hard items improves accuracy from 82/111 (73.87%) to 97/111 (87.39%) by routing 42 items to Atria-Dawn-Preview. We also describe qualitative game, visual interface, and browser demonstrations. These results support compact decision models as a practical component of larger agent systems.
31. 【2610.22127】Explaining the Roles of Experts in Mixture-of-Experts LLMs for Personalization
链接：https://arxiv.org/abs/2610.22127
作者：Sekh Mainul Islam,Pepa Atanasova,Isabelle Augenstein
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Large Language, multiple unrelated concepts, encoding multiple unrelated, Language Models
备注： Under review
点击查看摘要
Abstract:Personalization of Large Language Models (LLMs) is increasingly important for user-centric applications, yet prior methods mainly adapt dense LLMs, whose polysemantic neurons, each encoding multiple unrelated concepts, hinder localizing the components behind personalization, and thus understanding and controlling it. We propose to personalize Mixture-of-Experts (MoE) LLMs, which sparsely route each token to a few specialized experts, reducing polysemanticity and enabling such localization. We adapt three open-weight MoE LLMs on a large-scale personalization dataset and train crosscoders on paired activations of the personalized and non-personalized models to learn interpretable personalized latents, from which we identify the experts encoding distinct personalization features. The personalized MoE LLMs perform competitively with dense LLMs while activating only a fraction of their parameters, exhibit lower polysemanticity than dense LLMs with similar active parameters, and, within the same model family, yield personalized latents that are less shared with the non-personalized model. Causal interventions show that these latents suffice to recover the personalized model's behavior and that boosting their associated experts moves the non-personalized model toward it, revealing distinct routing paths for different personalization features.
32. 【2610.22110】Unfragmenting Nawatl NMT: Single-Variant Specialization for Masewalkopa
链接：https://arxiv.org/abs/2610.22110
作者：Luis A. Mercado-Campos,Alexis Palmer
类目：Computation and Language (cs.CL)
关键词：common response, aggregate text, text across multiple, multiple varieties, varieties and treat
备注：
点击查看摘要
Abstract:In minoritized (low-resource) language technologies, a common response to data sparsity is to aggregate text across multiple varieties and treat the combined data as a single corpus. However, mixed corpora of closely related indigenous variants can produce an artificial register that is accountable to no single speaker community, a structural failure we call variant fragmentation. This issue is acute for minoritized languages native to Mexico, such as Nawatl. Building on a 70,000-pair multi-variant foundation, we specialize an mT5-large checkpoint to Masewalkopa (nhn), the Nawatl variety spoken in Santa Ana Tlacotenco. We curate 2,665 parallel pairs, reserve all sentence-level data for evaluation, and incorporate 192 elder-transcribed target sentences via asymmetric backtranslation. A custom finite-state analyzer reduces unanalyzed surface forms from 82.0% to 19.9% and supplies functional syntax tags as plain-text prefixes, allowing the model to reuse existing subword embeddings rather than relying on frozen special tokens. The resulting LoRA-v9c-b model achieves 58.46 dev chrF++ and 58.20/57.90 directional test chrF++. Finally, CTranslate2 int8 quantization reduces CPU latency from 137.5 to 1.8-2.6 seconds per request, enabling cost-bounded Cloud Run deployment.
33. 【2610.22100】Patch where the text is new: a compression view of where byte-level models should spend compute
链接：https://arxiv.org/abs/2610.22100
作者：Nicolás Vera Zúñiga
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Byte Latent Transformer, Latent Transformer, Byte-level language models, Byte-level language, large global model
备注： 10 pages, 2 figures, 5 tables. Code, logs and results: [this https URL](https://github.com/nicoveraz/segresearch)
点击查看摘要
Abstract:Byte-level language models such as the Byte Latent Transformer (BLT) run their large global model once per patch and start a patch where a small model's next-byte entropy is high. This rule rarely starts a patch at in-line computed results, such as the number after "=" in a worked solution, and accuracy on them collapses under tight patch budgets. We propose novelty patching, motivated by LZ77-style compression: start a patch where the upcoming bytes are unlikely to repeat the recent context. The rule is a lookup table over the previous two bytes, fitted in seconds on raw text with no labels, reference model or losses. In BLT-style models trained from scratch on a 1.9 GB math corpus at a matched ~11% patch rate (3 seeds each), it has no clear effect at 1M parameters, raises final-answer accuracy from 47% to 72% at 12M, and at 50M raises computed-result accuracy from 21% to 57% and final-answer accuracy from 60% to 90%; a table fitted on the raw pretraining corpus keeps the gain. Outside math the advantage shrinks: novelty lowers bits per byte on prose and ties entropy on source code and on synthetic execution traces. An analysis of where boundaries fall explains the pattern. Computed results have ordinary surprisal for the patcher's model, so surprisal-seeking rules pass over them: entropy concentrates patch starts on high-surprisal bytes most strongly of all rules (boundary enrichment 1.61) and is the worst on computed results, while the best rules sit near chance enrichment. Novelty works where new content begins at segment starts close to the computation, as in written math; a learned chunker (H-Net) finds such structure on its own, in math and in code. We also report what did not work: typed uncertainty as a training rule, switching rules after training, and a context-aware novelty predictor.
34. 【2610.22086】Multi-SFT: Permissively-Licensed Multilingual Instruction-Following
链接：https://arxiv.org/abs/2610.22086
作者：Daniela Baiamonte,Kamyar Zeinalipour,Elena Fano,Stefano Simonazzi,Andrea Zugarini
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：remain overwhelmingly English-centric, training competing systems, service forbid training, forbid training competing, Supervised fine-tuning datasets
备注： 13 pages, 7 tables
点击查看摘要
Abstract:Supervised fine-tuning datasets remain overwhelmingly English-centric and commercially restricted, as their content is frequently generated by proprietary models whose terms of service forbid training competing systems. We introduce Multi-SFT, a commercially permissive collection of 502,818 instruction-response pairs across five European languages, built via translation and regeneration pipelines for tasks where translation is insufficient. Human evaluation yields inter-annotator agreement of at least 0.87 across all datasets and languages. Fine-tuning nine models from three different families (EuroLLM, OLMo 2, Qwen3; 1B-32B) and evaluating them on 13 benchmarks shows that Multi-SFT alone is competitive with larger augmented mixes and official instruction-tuned releases, with decisive advantages on safety tasks.
35. 【2610.22071】he Right Byte First: How UTF-16 Helps Multilingual Boundary Prediction
链接：https://arxiv.org/abs/2610.22071
作者：Hyunsik Kim
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：models group bytes, language models group, UBE, models group, byte
备注： 32 pages, 5 figures, 29 tables
点击查看摘要
Abstract:Many hierarchical byte-level language models group bytes into patches using a learned boundary predictor whose view of the next codepoint depends on encoding and lookahead. In UTF-8, codepoints of many scripts take three bytes: 8 of 24 bits mark length and continuation, and the first byte carries only 4 high codepoint bits. After the same left context, a mark extending a grapheme cluster and a letter starting the next can thus share their first byte. Universal Byte-Level Encoding (UBE) keeps one- and two-byte UTF-8 encodings but writes these codepoints as two UTF-16 bytes, low byte first, so its first symbol carries 8 low codepoint bits that can distinguish such continuations. We train small causal predictors on matched FineWeb-2 text and evaluate on FLORES-200 under UTF-8, UBE, and UBE's same-length big-endian variant. At one-symbol lookahead, balanced grapheme-boundary error at codepoint boundaries across 17 languages in 13 Brahmic scripts is 8.76% with UTF-8, 8.62% with the big-endian variant, and 0.06% with UBE. When the target instead retains a parent tokenizer's subword cuts at grapheme boundaries, UBE lowers the mean error relative to UTF-8 at the same lookahead by 72.91% in Korean, 35.29% in Chinese, and 67.32-99.55% in eight more scripts. In the seven of them whose main Unicode block fits on one 256-codepoint page, the big-endian variant stays within 3.0% of UTF-8, so the gain follows byte order, not length. In Korean and Chinese, UBE's mean error falls below UTF-8's final mean error after only 25% and 37.5% of training. Which byte comes first thus affects how much lookahead a byte-level boundary predictor needs.
36. 【2610.22067】Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning
链接：https://arxiv.org/abs/2610.22067
作者：Shiwen Qin,Cameron Barker,Henry Gouk,Elliot J. Crowley,Shay B. Cohen,Mirella Lapata,Miao Li
类目：Computation and Language (cs.CL)
关键词：longer context windows, language models support, typically treat context, Long-context language models, evaluations typically treat
备注：
点击查看摘要
Abstract:Long-context language models support ever longer context windows, and evaluations typically treat context length as the main indicator of difficulty. However, context length alone cannot explain why models fail on long-context tasks that require reasoning over complex information. Contexts of equal length can pose very different challenges: a task may be solvable from a single local passage, or it may require integrating evidence distributed across the full context. We quantitatively characterise this difficulty through three properties: evidence scope, how much necessary information must be found; evidence dispersion, how widely that information is scattered within the context; and reasoning depth, how many dependent steps are needed to derive an answer from it. We construct LURCH, a multi-domain question-answering benchmark of 6,550 instances with supporting evidence and reasoning graphs, enabling all three properties to be quantified. Evaluations of proprietary and open-weight models show that: (1) at fixed context length, all our three properties are strongly negatively correlated with model performance; (2) as context length increases, performance degrades sharply on samples with dispersed evidence, whereas it remains relatively stable on samples with localised evidence; and (3) difficulty compounds across properties, as questions with moderately high values on all three are harder than those with an extreme value on just one. These findings establish evidence scope, dispersion and reasoning depth as measures of long-context reasoning difficulty that complement context length.
37. 【2610.22053】Name-Bias in Large Language Models
链接：https://arxiv.org/abs/2610.22053
作者：Kalyan Bhetwal,Ceren Mert,Ian Whitehouse
类目：Computation and Language (cs.CL)
关键词：carry demographic indicators, large language models, Social Security Administration, large language, local large language
备注：
点击查看摘要
Abstract:Names carry demographic indicators such as age, gender, and race, which makes them a subtle but strong target of bias in large language models (LLMs). In this work, we present an evaluation of name-based bias across 6 local large language models spanning multiple providers and parameter scales. Using a fill-in-the-blank task, we prompt these models to choose between pairs of first names drawn from U.S. Social Security Administration datasets and a race classification dataset by Rosenman et al.. Our experimental de- sign isolates age and gender effects through balanced name pairings and sentence templates that share a fixed syntactic structure. Across 300,000 local LLM responses, we find consistent and measurable name bias. Models prefer names that are less stereotypically male, older, popular, and white. Furthermore, we find that name-bias is highly sentence-dependent, but not more than associated stereotypes, and gender is the most significant bias, followed by age, name popularity, and race. Our results demonstrate that name-based bias remains pervasive even in local LLMs, highlighting the necessity for standardized evaluation methods and mitigation strategies.
38. 【2610.22046】Effectiveness of Hidden-State Probes for Localizing Reasoning Failures
链接：https://arxiv.org/abs/2610.22046
作者：Shubham Subhnil,Yannis Belkhiter,Erik Miehling,Adam Dahlgren Lindström,Elizabeth M. Daly
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Verifying the final, long reasoning trace, probe, failing step, trace
备注： Accepted at the NeurIPS 2026 Workshop on Interpretability as a Science (InterpScience). OpenReview: [this https URL](https://openreview.net/forum?id=X1D0ZeEeZ4) . 30 pages, 5 figures, 13 tables. Code: [this https URL](https://github.com/SSubhnil/Reasoning-Failures) ; Data: [this https URL](https://huggingface.co/datasets/ssubhnil/Reasoning-Failures)
点击查看摘要
Abstract:Verifying the final answer of a long reasoning trace may show that the trace is wrong but it does not distinguish three cases. The problem may lie beyond the model's capability, another attempt would succeed, or one step in an otherwise recoverable trace made the trace fail. Standard hidden-state probes are trained on final-answer correctness, a label that conflates these cases. Monte Carlo rollouts distinguish the cases and locate the failing step at additional inference cost. We test the hidden states of 4B and 8B reasoning models for the failure type and the failing step and compare each probe with the strongest baseline that uses no hidden states. On incorrect 8B traces, the confidence probe, a calibrated correctness probe at a midpoint cutoff, misses 81% of cases in which a single step makes the trace unrecoverable and 47% of cases in which another attempt would succeed. A probe with a different training design over the same states reverses the ordering of these two kinds of failure, so either ordering can be read from those states. At both scales, no single tested probe locates the failing step more accurately than a rule based only on trace length, and at 4B a probe trained to predict that step fails to outperform this rule in any of 10 runs on identical traces. The confidence probe therefore indicates that an answer is wrong, but its failure-type ordering depends on its training design.
39. 【2610.22043】Momentum, Commentary Tone, and Earnings Surprise in LLM Financial Forecasts
链接：https://arxiv.org/abs/2610.22043
作者：Alina Khaybullina
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); General Finance (q-fin.GN)
关键词：model financial forecast, language model financial, financial forecast, drive a language, EPS
备注：
点击查看摘要
Abstract:Which inputs drive a language model's financial forecast? We construct synthetic earnings announcements that independently reverse 20-day momentum, non-informational commentary tone, and whether fixed actual EPS beats a manipulated consensus. Six instruction/chat checkpoint conversions from four families (0.49-7.61B base parameters) receive 2,016 prompts each under a direct-answer Q8_0 protocol. The design includes 24 numerical blocks, six commentary pairs, profits and losses, rising and falling annual EPS, and two surprise sizes. Both A/B answer assignments and U/D cover all 384 primary scenarios per conversion. We estimate matched changes in conditional answer-prefix scores, not calibrated market probabilities. Across these checkpoints, the primary EPS contrast ranges from -0.19 to 86.80 percentage points. The magnitude of the primary signed tone contrast exceeds that of EPS in 5 of six models, and momentum exceeds it in 5. Natural-word numerical diagnostic accuracy ranges from 51.0 to 95.8 percent. Answer-encoding, wording, context, and conversion controls qualify these results. The experiment measures observable input reliance and numerical recognition; it establishes neither an internal reasoning mechanism nor realized return predictability. Public benchmark prompts, recorded scores, and an interactive recorded-results explorer accompany the study.
40. 【2610.22039】WEAVE: Weaving Real-World Code Evolution into Dependency-Structured Tasks for Benchmarking and Training Code Agents
链接：https://arxiv.org/abs/2610.22039
作者：Weihao Li,Zihang Xu,Zhongqiu Wang,Songwei Yu,Wenqiang Zhu,Yuechen Luo,Jingxuan Xu,Yanan Wu,Haoyang Huang,Ken Deng
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：Real-world software engineering, software engineering rarely, engineering rarely consists, Real-world software, software engineering
备注： 22 pages, including appendix
点击查看摘要
Abstract:Real-world software engineering rarely consists of isolated changes. Features, migrations, and systematic fixes often unfold across multiple pull requests (PRs), requiring coordinated modifications across a repository. Yet most executable repository-level benchmarks retain a single issue or PR as the task unit, while existing multi-PR settings rely on coarse aggregation and structure-agnostic evaluation. This mismatch obscures dependencies among changes and limits progress measurement and learning signals for long-horizon code agents. We introduce WEAVE, a framework that transforms verified PR histories into executable, dependency-structured tasks. WEAVE leverages repository-calibrated typed change loci to organize related PRs into bounded DAGs and instantiate each as a unified executable task. We further introduce Graph Credit, a deterministic, test-grounded metric that measures dependency-consistent partial progress and supports dense, verifiable rewards for reinforcement learning. Experiments on task construction, agent evaluation, supervised fine-tuning, and reinforcement learning show that WEAVE yields coherent executable tasks, enables more faithful progress measurement than flat scoring, and provides effective supervision and verifiable rewards for training code agents.
41. 【2610.22029】Selection Is Not Learning: Choosing Model Futures
链接：https://arxiv.org/abs/2610.22029
作者：Haoyi Yang,Kshitij Mishra,Nils Lukas,Salem Lahlou
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Self-evolving language models, Self-evolving language, language models train, Skill Self-Play make, Self-evolving
备注：
点击查看摘要
Abstract:Self-evolving language models train on tasks they generate, so every round must decide which updated model the next round inherits. Current loops such as R-Zero, Agent0, and Skill Self-Play make this decision through the task, admitting tasks that look learnable and inheriting every resulting update. We identify a selection-to-update gap in these loops, where a task that looks learnable need not produce a useful update. Most updates on verified tasks fail to make correct answers more likely, yet these loops inherit them all. HeirCommit freezes the updated model and uses fresh evaluation questions to decide whether to inherit it or retain the current model. EvoHeir separates parameter inheritance from experience inheritance, using current and archived experience to repair failures and preserve successes before final confirmation. Our analysis characterizes selection-induced optimism and decomposes regret into selection, absorption, and confirmation errors. HeirCommit cuts the harmful share of accepted updates by 68-83% relative to random inheritance at the same acceptance rate. Across four backbones, EvoHeir achieves the best mathematics and general-reasoning averages, raising the math average by 5.3% relative to the strongest baseline, Agent0. The framework lets useful experience persist even when the model that produced it is not inherited.
42. 【2610.22019】Priming Base Models for Agentic Post-Training: An Open Midtraining Recipe
链接：https://arxiv.org/abs/2610.22019
作者：Soumye Singhal,Joseph Jennings,Ka Shun Shum,Alexander Bukharin,Khushi Bhardwaj,Zirui Liu,Venkat Srinivasan,Jonathan Li,Yash Jain,Kezhi Kong,Markus Kliegl,Olivier Delalleau,Sanjeev Satheesh,Mostofa Patwary
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Frontier models, general-purpose and domain-specific, domain-specific alike, SFT, Frontier
备注： 19 pages
点击查看摘要
Abstract:Frontier models, general-purpose and domain-specific alike, now include a midtraining stage between pretraining and post-training, but little has been published about how this stage is built. We present an open midtraining recipe that primes base models for agentic post-training, and we show its effectiveness on two Nemotron models of different sizes. Pretraining typically runs at short context and sees almost no agent interactions, while SFT data is mostly synthetic, and very long SFT stages can hurt the model's later RL trainability. Our midtraining stage sits between the two. It trains at 256K context for hundreds of billions of tokens on a diverse mixture of natural software-engineering data like packed repositories, pull requests, commit histories, and build logs together with a small share of agentic traces. On Nemotron 3.5 Lightning, 500B midtraining tokens improve SWE-bench Verified from 60.7 to 64.5, SWE-bench Multilingual from 55.8 to 62.8, and SWE-bench Pro from 32.0 to 35.5 after identical full SFT. On the larger Nemotron 3.5 Super, 280B midtraining tokens improve DeepSWE, a harder benchmark of long-horizon tasks, from 11.7 to 15.7 and SWE-bench Verified from 72.9 to 74.3 after identical full SFT. Midtraining also improves robustness across agent harnesses on both models. We report the ablations behind the recipe and an evaluation protocol built on short fixed SFT runs, since base-model proxy metrics did not correlate reliably with post-training results.
43. 【2610.21979】P2TPO: Structure-Aligned Page-to-Token Credit Assignment for Full-Page Document Parsing
链接：https://arxiv.org/abs/2610.21979
作者：Yong Zu,Ninghua Yang,Zezhong Tan,Xinhong Ma,Ziqiang Dong,Yang Yang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：preserve the content, content and structure, structure of heterogeneous, accurate outputs, heterogeneous elements
备注： 34 pages, 9 figures, including appendices
点击查看摘要
Abstract:End-to-end full-page document parsing must preserve the content and structure of heterogeneous elements, yet otherwise accurate outputs can contain local errors and omissions. A single page-level advantage does not explicitly identify which elements differ in quality across sampled outputs or where their errors occur. We introduce Page-to-Token Policy Optimization (P2TPO), a structure-aligned credit-assignment framework that operates on full-page policy trajectories. Reference-element alignment first associates block-level quality contrasts with generated spans. Unified Anchor Pricing (UAP) incorporates matched and missing element outcomes and provides feedback relative to a fixed quality ceiling when sampled outputs receive identical but imperfect scores for a reference element. Within matched blocks, Span Credit Redistribution (SCR) redistributes existing block credit according to aligned correct and erroneous spans, using boundary proxies for within-block omissions while preserving the total block-derived advantage across its tokens. Under a fixed-weight additive page utility, we show that element-indexed contrasts retain local quality differences that page-level aggregation can cancel out. In the main experimental comparison, P2TPO outperforms all evaluated policy optimization baselines in seed-averaged scores on each of the six document parsing benchmarks. Additional experiments demonstrate gains across model scales and initializations.
44. 【2610.21941】Learning Speech Attribute Representations via Multi-Teacher Distillation
链接：https://arxiv.org/abs/2610.21941
作者：Maryem Bouziane,Salima Mdhaffar,Yannick Estève
类目：Computation and Language (cs.CL)
关键词：Recent post-training approaches, Recent post-training, self-supervised speech encoders, post-training approaches, approaches have shown
备注：
点击查看摘要
Abstract:Recent post-training approaches have shown that self-supervised speech encoders can be adapted to learn a single utterance-level speech attribute through knowledge distillation. In this work, we investigate whether a single speech encoder can simultaneously preserve multiple complementary utterance-level speech representations. We propose a multi-attribute multi-teacher distillation framework that learns semantic, speaker, language, and emotion representations from four frozen teacher models using a shared SSL backbone and attribute-specific branches. Experiments on multilingual semantic retrieval, speaker verification, language identification, and speech emotion recognition show that the proposed model achieves performance close to dedicated single-task students while requiring only a single shared encoder. Furthermore, the learned layer aggregation strategies reveal that different speech attributes naturally emerge at different depths of the SSL encoder, providing new insights into the organization of speech representations.
45. 【2610.21900】EM: Temporal State Tracking Memory for Large Language Model Agents
链接：https://arxiv.org/abs/2610.21900
作者：Pengfeng Song,Yunkai Zhuang,Liye Shi
类目：Computation and Language (cs.CL)
关键词：TEM, State Tracking Memory, Temporal State Tracking, memory, agent memory
备注： 16 pages, 5 figures, 8 tables
点击查看摘要
Abstract:An agent's memory must remain useful as information changes across conversations. A new fact may replace an earlier value without making that value irrelevant to a later question. We present Temporal State Tracking Memory (TEM), a training-free framework for tracking these changes. TEM stores facts as versioned records linked to their sources. It retrieves relevant versions, places them in source order and labels historical records before passing the evidence to the answer model. Event memory and original dialogue turns provide details missing from structured facts. We evaluated TEM on 420 questions drawn from 600 sessions involving 60 personas. Across four open-weight models, key-entity hit rates reached 75.71-97.62% overall and 96.67-100.00% on the historical-residence subset. Adding historical labels to otherwise identical, source-ordered facts increased overall hit rates by 17.14-55.95 percentage points. The evidence was compact: 94-118 tokens per answer, or 48.75-56.73% less than session-aware retrieval-augmented generation (RAG). A further evaluation on 1,540 LoCoMo questions tested hybrid memory under a fixed evidence budget. TEM exceeded session-aware RAG with both backbones; conservative score differences were 7.92 and 10.58 percentage points. The results support preserving fact versions and exposing their temporal status to the generator when answering questions about repeatedly updated information.
46. 【2610.21862】Dynamic ordering in sequence generation in Transformers: experiments on low-resource Tagging scenarios
链接：https://arxiv.org/abs/2610.21862
作者：Giacomo Bais,Tejaswini Deoskar
类目：Computation and Language (cs.CL)
关键词：paradigm in Transformers, paper introduces TagInsert, sequence labelling tasks, Combinatory Categorial Grammar, Transformer-based model
备注：
点击查看摘要
Abstract:This paper introduces TagInsert, a Transformer-based model that challenges the common left-to-right (L2R) generation paradigm in Transformers, for sequence labelling tasks where dependencies may not naturally align with a L2R order. TagInsert lifts the L2R constraint by removing the decoder-side attention mask and enabling the model to decide a preferred order of tag generation at inference time. We experiment on the common Part-of-Speech tagging and the more complex Combinatory Categorial Grammar (CCG) supertagging tasks on multiple languages and low-resource data settings. We show that, although encoder-only models like BERT remain strong performers for tagging tasks, TagInsert frequently outperforms a L2R encoder-decoder model, achieves results comparable to encoder-only models under data-scarce conditions, and shows better results on the long-tail of rare categories. Our analyses show that TagInsert alleviates error propagation typical of autoregressive models by learning to defer difficult predictions to later stages in the decoding process.
47. 【2610.21810】N-Gram Memories at Two Bits: Quantizing Lookup Tables in Large Language Models
链接：https://arxiv.org/abs/2610.21810
作者：Donghoon Han,Minseop Jung,Dong Woo Kwak,SeungJae Lee,Junhoo Lee
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：expands language-model capacity, Conditional memory expands, full embedding table, memory expands language-model, introduce Conditional Program
备注：
点击查看摘要
Abstract:Conditional memory expands language-model capacity through selective lookup, but the full embedding table must remain available for every possible input. We introduce Conditional Program (CP), a compressed representation that reconstructs only the rows an input requests. CP represents each row by a short code and a local scale, with a reconstruction program shared across the table. We instantiate this representation with a Gaussian trellis, norm restoration and independently decodable row records. CP's two-bit code lowers output KL by 41--63\% relative to 2-bit round-to-nearest. Analysis across three trained n-gram memory families shows that Gaussian-like coordinate statistics coexist with learned relationships among rows; at matched storage budgets, the shared trellis outperforms the fitted codebooks and low-rank residual variants we test. For DeepSeek, it reduces table storage from 203GB to 51GB, leaving room for larger workloads when the table is kept on GPU.
48. 【2610.21808】RoleQ: Role-Aligned Scales for Converting Language Models to Ternary
链接：https://arxiv.org/abs/2610.21808
作者：Johannes Knittel,Alec Helbling,Hanspeter Pfister
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：bits shrinks memory, shrinks memory, memory and bandwidth, Ternary, Weight
备注：
点击查看摘要
Abstract:Weight quantization below four bits shrinks memory and bandwidth at a perplexity that looks acceptable, but often at the cost of factual knowledge and task accuracy. Ternary weights have mostly been obtained by training from scratch or long fine-tuning. We introduce RoleQ, a quantization framework that places scales by the functional roles of Transformer units rather than by the layout of the weight matrix, as conventional formats do. Vectors that read from the residual stream take one scale per output unit; those that write to it, one per input unit. The rule is structural, needs no search, calibration or stored state, and holds on integer and ternary grids. In a rotated basis it matches a per-layer axis search at half the solver work, and at ternary it cuts perplexity by up to half against layout-based placement in two families at every size from 0.6B to 14B, where per-row scales leave MMLU at chance. Our lightweight post-training pipeline converts an existing checkpoint to 1.59 bits per weight in a few GPU-hours, a fraction of the cost of learned ternarization, and leads every post-training ternary method at matched or lower memory-resident bits on perplexity, zero-shot accuracy and MMLU, most widely on knowledge. A sparse second ternary plane placed by a per-unit Fisher saliency keeps the matmul multiplication-free and recovers what ternary loses first: at 8B, a fraction of a bit returns about half the MMLU that conversion costs, well ahead of random or Hessian-based placement at equal bits.
49. 【2610.21807】Content associations with answer selection and engagement in supply chain community question answering
链接：https://arxiv.org/abs/2610.21807
作者：Hisatoshi Naganawa
类目：Computation and Language (cs.CL); Social and Information Networks (cs.SI)
关键词：Community question-answering platforms, individual lexical features, Community question-answering, knowledge sharing, broad topics
备注：
点击查看摘要
Abstract:Community question-answering platforms are important ecosystems for knowledge sharing, yet research on what makes an answer best or a question engaging has often focused on either individual lexical features or broad topics. This exploratory study examines both levels in Yahoo! Chiebukuro, asking which nouns and semantic noun clusters are associated with best-answer selection and question engagement. We analyze a large corpus of questions and answer-tier posts collected under the keyword logistics, using an offline machine-translation pipeline with manually validated noun-level fidelity. Best-answer selection is modeled with conditional logistic regression within question threads, controlling for answer length, order, and question-answer noun overlap. Engagement is modeled in two stages: whether a question receives any response and, conditional on receiving one, how many responses it attracts. Operational logistics nouns such as distribution, warehouse, and center are associated with best-answer selection, whereas broader civic and infrastructure nouns such as car, tax, and shinkansen are associated with higher engagement. At the cluster level, most semantic noun clusters are associated with best-answer selection, while the clusters associated with response likelihood and response volume are largely distinct. These findings reveal differentiated content-outcome profiles across answer and question levels and provide a domain-wide descriptive map of engagement and answer selection in logistics-related cQA discourse.
50. 【2610.21799】Behavioral Forgetting Is Not Privacy in Machine Unlearning
链接：https://arxiv.org/abs/2610.21799
作者：Tyler Lizzo,Larry Heck
类目：Computation and Language (cs.CL)
关键词：Machine unlearning aims, designated benchmark distribution, remove targeted information, Machine unlearning, benchmark distribution
备注： Accepted as a poster at the PriLOM Workshop at NeurIPS 2026
点击查看摘要
Abstract:Machine unlearning aims to remove targeted information from large language models, but existing evaluations often measure forgetting only on a designated benchmark distribution. We argue that such behavioral forgetting is an insufficient standard for privacy-oriented unlearning, and that evaluation should instead test whether forgetting persists across the access paths through which the same information may be recovered. We demonstrate this with a controlled case study of cross-lingual querying: across multiple multilingual model families, forgetting varies substantially when semantically equivalent information is queried in different languages and scripts. A single access path is therefore enough to expose a real gap between behavioral forgetting and information inaccessibility, motivating broader evaluation of access-path generalization and adversarial recoverability alongside in-distribution forgetting.
51. 【2610.21789】In the Guise of Correction: How Framing and Cultural Adaptation Erode LLM Safety on Real-World Criminal Cases
链接：https://arxiv.org/abs/2610.21789
作者：Mohsinul Kabir,Md. Tariquzzaman,Karam S. R. Elradie,Polydoros Giannouris,Yuechen Jiang,Shaoxiong Ji,Sophia Ananiadou
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Existing safety benchmarks, severe crime categories, safety benchmarks rely, benchmarks rely largely, UNODC International Classification
备注： Under Review
点击查看摘要
Abstract:Existing safety benchmarks rely largely on synthetic prompts with loosely grounded taxonomies and offer little focused analysis of severe crime categories. We introduce GUISE, a benchmark of criminal-assistance scenarios sourced from real-world cases and organised under a taxonomy from the UNODC International Classification of Crime for Statistical Purposes (ICCS). Each scenario is rendered under three linguistic framings and evaluated across five distinct cultures. Using our proposed two-tier evaluation framework, which judges both harmfulness and operational uplift, we find that: (i) framing alone drives unsafe compliance, with the mean unsafe compliance rate rising from 28.9% under direct requests to 66.4% under correction seeking (peaking at 97.3%; p 0.05), as models correcting deliberately distorted details supply executable criminal steps; (ii) culturally adapted prompts elicit significantly more unsafe compliance than literal translations of the same requests in all four non-English languages (+7 to +18 points), a risk that translation-based benchmarks miss; and (iii) unsafe responses from the least-safe models carry strong Anglocentric registers, and the extent of this leakage increases monotonically with response harmfulness ($\rho$ = 0.46 to 0.63 across languages, all p 0.001). GUISE offers a grounded resource and fine-grained diagnostics for strengthening refusal alignment across languages and cultures. We publish our code and data to facilitate future research.
52. 【2610.21763】Bias Mitigation in Audio-Enabled LLMs through Adversarial Training and Distillation Methods
链接：https://arxiv.org/abs/2610.21763
作者：Adnan Al Ali,Jindřich Libovický,Anne Lauscher
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Audio-enabled large language, Audio-enabled large, large language models, intermediate transcription, large language
备注： Submitted to ARR (October 2026)
点击查看摘要
Abstract:Audio-enabled large language models (AuLLMs) allow users to interact with them simply by talking to them, without the need for an intermediate transcription. This expands the model's accessibility and capabilities by encoding non-verbal cues. However, using non-verbal cues may lead to biased behaviour based on the attributes inferred (or assumed) from them. In this work, we focus on the gender attribute and show that models' perception of it can be unlearned using adversarial methods without a loss in performance on other benchmarked tasks. Such models are useful in situations where gender inference is unwanted. However, in other practical settings, gender perception (without bias) may be this http URL a less radical measure, we distil the gender-agnostic model, creating a model that perceives gender but responds similarly to the gender-agnostic teacher, unless explicitly this http URL apply our newly proposed methods to three AuLLMs and obtain satisfactory results in the gender-unlearning part and partially satisfactory results in the distilling part.
53. 【2610.21755】DeciCAD: Harness-Grounded Learning of Action Policies for CAD Agents
链接：https://arxiv.org/abs/2610.21755
作者：Yufeng Peng,Yixin Zhang,Ziyi Liu,Zhikun Xu,Jiarong Yang,Sijie Wang,Wenjie Feng,Qiyu Kang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：Large Language Model, Language Model agents, Large Language, Language Model, Model agents operate
备注：
点击查看摘要
Abstract:Large Language Model agents operate through closed-loop action policies whose decision space is defined by an agent harness. We investigate how this operating space shapes agent behavior and policy learning in computer-aided design (CAD), a professional domain characterized by persistent state, geometric constraints, and long-horizon procedures. We instantiate this perspective in DeciCAD, a domain-native harness that exposes semantic CAD actions, decision-oriented observations, environment feedback, and persistent state transitions. Building on this harness, we develop a learning pipeline that extracts causal decision supervision from interaction trajectories and improves the policy through supervised fine-tuning (SFT) and geometry-grounded online reinforcement learning (RL). Across four CAD benchmarks, DeciCAD achieves the best F1 and intersection over union (IoU) while reducing model-output tokens by 45--88% relative to a general-purpose coding harness. Under matched supervision, its SFT policy improves F1 from 0.6883 to 0.7437 and outperforms the coding policy; subsequent online RL further raises geometry availability from 66.5% to 73.5% and F1 to 0.7880. These results demonstrate that the decision space induced by a harness materially affects both agent execution and policy learning in CAD.
54. 【2610.21739】Reliable Knowledge Acquisition for Continual Learning Agents
链接：https://arxiv.org/abs/2610.21739
作者：Yixu Huang,Jiaqi W. Ma
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：foundation models move, open-ended environments, powered by foundation, move into open-ended, Continual Learning Bench
备注：
点击查看摘要
Abstract:As agents powered by foundation models move into open-ended environments, continual learning from experience becomes essential. For agents built on models with fixed parameters, this learning requires reusing prior task experience in context to improve performance and efficiency on future tasks. Existing memory and experience-learning systems typically focus on either retained facts or procedures, and lack a mechanism for establishing the reliability of claims extracted from the ongoing task stream. Indeed, we find that approximately 12--33\% of entries produced by representative systems harm future task performance when reused. To address these limitations, we propose \textbf{RIKA} (Reliable Knowledge Acquisition), which combines hierarchical extraction of factual, conceptual, procedural, and metacognitive knowledge with Evidence-based Knowledge Admission, which uses source evidence and subsequent experience to govern which claims enter the task agent's context, without additional validation tasks. Across six task streams from Continual Learning Bench and four model backbones, RIKA achieves the highest aggregate score on every backbone.
55. 【2610.21737】SceneWeave: Audience-Guided Scene Exploration for Dramatic Adaptation
链接：https://arxiv.org/abs/2610.21737
作者：Aolin Li,Xiao Xu,Haihua Xie
类目：Computation and Language (cs.CL)
关键词：requires transforming narration, Adapting prose, script requires transforming, requires transforming, transforming narration
备注： 13 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Adapting prose into a script requires transforming narration and inner experience into scenes that convey relationships and psychological contradictions. Planning specifies intended effects but leaves their realization in dialogue and action unresolved. Drawing on screenwriters' accounts of revising scenes and their connections to the surrounding work, we present SceneWeave, which uses alternative scene drafts to revise the adaptation as a whole. It writes contrasting treatments of a focal scene, compares the interactions they create, and revises characterization, preceding preparation, subsequent development, and scene order before generating the complete script. The central contribution is to use actual scene writing to inform adaptation decisions and propagate their consequences across the work. We also develop a task-specific writing model and a human-preference model for comparing script drafts. The writing model learns from adaptation examples and human preferences; the preference model combines human and synthetic supervision. Blind reader comparisons favor SceneWeave over a baseline workflow and description-based controls, while content assessment indicates reduced narrative redundancy and strong psychological treatment.
56. 【2610.21731】Retrieved but Not Read: Understanding Why Search-Augmented LLMs Fail to Use Available Evidence
链接：https://arxiv.org/abs/2610.21731
作者：Owen Walters,Lihu Chen,Francesca Toni
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：remains unclear, Web search, Abstract, Web, evidence
备注： 14 pages, 4 figures, 16 tables. Code and data: [this https URL](https://github.com/ojwwalters/retrieved-but-not-read)
点击查看摘要
Abstract:Web search allows LLMs to access up-to-date information, but it remains unclear why they sometimes produce outdated answers even when relevant evidence is available. To study this problem, we construct temporal facts whose values changed after the models' training cutoffs. We evaluate one proprietary model under deployed web search and six open-weight model configurations under controlled retrieval. We find that models often answer from search snippets without opening the source pages, which is associated with higher rates of outdated answers and unfaithful citations. Our controlled experiments and layer-wise analysis reveal a gap between the availability of evidence and its effective use. Even when retrieved evidence influences internal predictions, models may still favour outdated information in their final answers. We hope these findings will help advance research on the reliable use of retrieved evidence in search-augmented LLMs.
57. 【2610.21720】FIRM: Fisher-Informed Retention Merging for Federated LLM Unlearning
链接：https://arxiv.org/abs/2610.21720
作者：Reeyansh Shah,Maram Hasan,Subhasis Chaudhuri,Biplab Banerjee
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM unlearning addresses, Federated LLM unlearning, addresses targeted knowledge, targeted knowledge removal, data remain distributed
备注： 16 pages, 1 figure
点击查看摘要
Abstract:Federated LLM unlearning addresses targeted knowledge removal when forget and retain data remain distributed across private clients and are inaccessible to the server. The resulting locally trained adapters encode conflicting objectives, making their aggregation fundamentally different from conventional federated optimization. A key failure mode is magnitude explosion, whereby unnormalized cross-client aggregation increases the merged update magnitude and degrades retained utility under stronger unlearning. We propose FIRM (Fisher-Informed Retention Merging), a single-round framework for stable and retention-aware server-side aggregation. FIRM uses client-local Fisher statistics as a unified sensitivity signal to construct a Fisher-normalized base merge and impose explicit control over retain-sensitive parameters. Its second-order retention projection admits a unique minimum-distance solution, while the corresponding dual scales with the number of retain clients rather than the model dimension. Experiments across WMDP, TOFU, and MUSE-HP using Zephyr-7B and Llama-3-8B show utility gains at comparable forgetting on WMDP and MUSE-HP, with metric-dependent trade-offs on TOFU. Controlled comparisons support benefits of the combined base merge and additional retention correction at selected operating points.
58. 【2610.21708】Human Interventions as Labels: Localizing, Steering, and (Sometimes) Editing the Computations Behind LLM Agent Failures
链接：https://arxiv.org/abs/2610.21708
作者：Cesare Zavattari,Alessandro Tommasi,Giuseppe Prencipe
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM agent misbehaves, LLM agent, discarded or replayed, agent misbehaves, human steps
备注：
点击查看摘要
Abstract:When an LLM agent misbehaves, a human steps in, and that intervention is usually discarded or replayed as training data. We treat it instead as a measurement: a label pointing at the internal computation that failed. We study it in a controlled agent environment, on one failure (asking a clarifying question when the request was already unambiguous), with labels from a rule-based overseer validated against blind human judgment. Claims cover eligible models, which both over-ask and sometimes act on matched unambiguous requests: five of thirteen qualified (Qwen2.5-3B, gemma-2-2b, OLMo-3-7B, Mistral-Nemo-12B, Phi-4). Four findings. First, the ask-vs-act decision is causally localizable in every eligible family: a direction learned from intervention labels flips 72-100% of held-out over-asks at a definite residual-stream depth, with site and dose chosen on training data, and random directions under the same procedure flip at most one episode. Second, over-asking has two mechanistic signatures: in four families the model demonstrably knows the request is unambiguous (the belief is decodable, causally inert and orthogonal to the decision) and asks anyway; in the fifth, the rare over-asks track different world-representations. Third, steering gated on a probe readout removes most of the simulated oversight burden while legitimate questions survive (bootstrap 95% intervals exclude zero); a prompt instruction makes it worse. Fourth, consolidating the fix into the weights yields a map, not a rule: on one model a LoRA confined to the causal band passes every criterion fixed in advance while behavior cloning on identical data breaks retention; on three families the reverse holds; on the fifth the outcome crosses the boundary across seeds. A geometric rule written down in advance to predict the regime failed on two out-of-family tests; we report the failure and stop rather than fit a replacement.
59. 【2610.21690】Abstracts or full text? Evaluating input scope and computational efficiency in biomedical lay summarization
链接：https://arxiv.org/abs/2610.21690
作者：Egecan Çelik Evgin,İlknur Karadeniz,Olcay Taner Yıldız
类目：Computation and Language (cs.CL)
关键词：Biomedical research articles, written for experts, public to understand, Biomedical research, public biomedical lay
备注： 26 pages, 2 figures
点击查看摘要
Abstract:Biomedical research articles are mainly written for experts and often contain terms that are difficult for the general public to understand. Automated lay summarization has become a solution to make biomedical knowledge easier for patients and the public to understand. However, generating lay summaries from full-text articles requires more computing power because the articles are long and costly to process. Fine-tuning large language models for this task also requires substantial resources. This study asks two questions: (1) whether abstracts contain enough information to produce lay summaries as good as those based on full-text articles, and (2) whether few-shot learning performs as well as task-specific fine-tuning. The study used two public biomedical lay summarization datasets and two recent models, evaluated for readability, factual consistency, semantic similarity, and runtime efficiency. Results show that abstract-based summarization performs better overall. Across both datasets and models, abstract fine-tuning is 4.70 times faster, while abstract zero- and few-shot prompting is 5.31 times faster than full-text methods. These results show that abstract-based prompting reduces runtime cost while maintaining lay summary quality.
60. 【2610.21681】Data Strategies for Large Language Models: A Unified Perspective on the Training Lifecycle
链接：https://arxiv.org/abs/2610.21681
作者：Yuanjian Xu,Jianing Hao,Tianze Sun,Yongyao Duan,Sam Chen,Jinyi Han,Wanbo Zhang,Yuxuan Sun,Guang Zhang,Zhong Li
类目：Computation and Language (cs.CL)
关键词：Data strategy plays, training large language, large language models, strategy plays, plays a central
备注： 21 pages, 5 figures
点击查看摘要
Abstract:Data strategy plays a central role in training large language models (LLMs). It governs the selection, weighting, and scheduling of training data, thereby determining the capabilities a model can acquire from a fixed data budget. We treat high-quality data as having high training-dependent utility, which depends on the target objective, the model, and its training state rather than on the text alone. Research in this area now spans pretraining and post-training, but related ideas use inconsistent terminology and evaluation protocols. This work reviews data strategies across the training lifecycle and formulates them as policies that allocate a training budget over candidate examples. We organise methods by their decision granularity, model dependence, and temporal adaptivity, then compare their computational requirements and empirical support. Fine-grained or state-dependent policies offer more control but incur additional scoring, search, or rollout costs. Evidence for transfer across model scales and comparable end-to-end cost remains limited. A continuously updated list of papers, along with their public implementations, is available at this https URL.
61. 【2610.21679】No Single Tokenizer Feature Reliably Predicts Downstream Language Model Performance
链接：https://arxiv.org/abs/2610.21679
作者：Antonio Lopardo,Luis Frentzen Salim,Shikhar Srivastava,Kevin Jiang,Mridul Sharma,Catherine Arnett
类目：Computation and Language (cs.CL)
关键词：language modeling pipeline, modeling pipeline, poorly understood, critical component, Tokenization
备注： 10 pages, accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Tokenization is a critical component of the language modeling pipeline, but it is poorly understood. Tokenizers can impact downstream performance, but there is currently mixed evidence about which tokenizer features predict a better language model without requiring a full training run. In this paper, we analyze approximately 200 language models trained on nine different languages. We evaluate both models and their tokenizers and test whether there is a relationship between any proposed intrinsic tokenizer evaluations and model performance, as measured by a wide variety of benchmarks. Despite the quantity and variety of proposed intrinsic tokenizer metrics, we find that none consistently predicts downstream performance across model families, tasks, and languages. This motivates the need for novel tokenizer evaluation metrics and approaches. We propose novel linguistically grounded metric introduced in this work shows that new metrics can capture aspects of tokenizer quality that existing metrics miss, though their predictive power is likely to vary across model families, languages, and tasks.
62. 【2610.21672】Diffusion Language Models as Open Quantum Systems
链接：https://arxiv.org/abs/2610.21672
作者：Akinori Tanaka,Yukinao Akamatsu,Takuki Tomita,Yuji Hirono
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Quantum Physics (quant-ph)
关键词：classical diffusion process, reversing a classical, language models generate, Diffusion language models, quantum systems
备注： 48 pages, 8 figures
点击查看摘要
Abstract:Diffusion language models generate text by reversing a classical diffusion process over token sequences. We show that their continuous-time forward and reverse dynamics can be embedded in the framework of open quantum systems, which describes quantum systems interacting with their environment. This connection provides a basis for extending diffusion sampling to superpositions of sentence states and for modifying the underlying generation dynamics. We construct a $\tau$-leaping unraveling scheme that simulates stochastic trajectories of these states while updating multiple token positions at each step. This enables generation conditioned on superposed prompts or thoughts, which we call Superposition of Prompts (SoP) and Superposition of Thoughts (SoT). The same formulation yields Quantum-Inspired Remasking (QIR): perturbing the masked-diffusion dynamics produces a confidence-based rule for revising previously generated tokens. Experiments with pretrained diffusion language models show that superposition-based generation can retain information from conditioning components not selected at the final measurement, while QIR improves LLM-assessed text quality when applied at an appropriate stage of generation.
63. 【2610.21671】Enhancing Multimodal RLVR with Pairwise Token Contrast and Adaptive Trajectory Confidence
链接：https://arxiv.org/abs/2610.21671
作者：Yiran Zhang,Hanbo Huang,Jielan Li,Zhen Zhao,Shiyu Liang,Hongxia Hao
类目：Computation and Language (cs.CL)
关键词：group-relative policy optimization, policy optimization broadcasts, single sequence-level advantage, Reinforcement learning, Pairwise token contrast
备注：
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) improves multimodal reasoning, but group-relative policy optimization broadcasts a single sequence-level advantage to every token of a response, although errors usually localize to a few decisive steps. Recent self-distilled variants refine credit with a teacher--student likelihood gap. However, this signal cannot tell whether it relies on the image or on a language shortcut, and is applied uniformly even when the teacher is uninformative. To address this, we propose Pairwise token contrast and Adaptive trajectory ConfidencE (PACE). Pairwise token contrast scores each response under four teacher views, crossing a correct or incorrect answer hint with the image present or removed, and compares the two hints for every token, which cancels shifts shared by both hints and reveals whether the token's support relies on the image. Adaptive trajectory confidence measures how well the teacher predicts each response given the correct hint and the image, normalizes this score within the batch, and uses it to set how far the token contrast redistributes credit within that response. PACE achieves the best average accuracy on three backbones and ranks first on all evaluated multimodal reasoning benchmarks with Qwen3-VL-8B-Instruct. Experiments show that both components matter: replacing pairwise token contrast with a single-view signal underperforms our method, while adaptive trajectory confidence adds further improvement.
64. 【2610.21646】he Self-Improvement Problem
链接：https://arxiv.org/abs/2610.21646
作者：Brian B. Moser,Stanislav Frolov,Tobias C. Nauen,Federico Raue,Andreas Dengel
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language models, call tools, revise prompts, agentic systems, increasingly autonomous
备注：
点击查看摘要
Abstract:With the rise of large language models, agentic systems are becoming increasingly autonomous, as they write code, call tools, revise prompts, and propose modifications to their own components. This autonomy raises a fundamental question for safe self-improvement: can an automated gate like a reward model or an automated reviewer reliably decide whether a proposed update should be accepted? The difficulty is structural. The gate must be a terminating, computable procedure, while the property we ultimately care about, namely whether an update is a genuine semantic improvement, depends on potentially unbounded program behavior. We formalize this mismatch by modeling agents as programs and defining improvement in terms of a semantic score that need not be computable. We study two evaluation abstractions. The first is a certifier that approves or rejects an update. The second is a search procedure that, given access to a proposal generator, attempts to output some improving candidate if one exists. We show that, in the fully general setting, no terminating procedure can simultaneously guarantee reliability (never accepting a non-improvement) and non-conservatism (never missing an available improvement): self-referential constructions can force any such gate or searcher to fail. Randomized gates with bounded error face the same limit. We then identify a standard decidable regime used in practice (bounded evaluation and a finite proposal budget) under which exhaustive simulation yields a terminating search procedure with the desired guarantees. We also show the limit of this recovery: a chain of accepted updates can raise the bounded score in every round while the true score falls. Our results draw a boundary between unbounded, universal settings where correctness guarantees collapse and bounded settings where they can be recovered by design.
65. 【2610.21638】Spurious Attention Heads in Vision Transformers: Mechanistic Identification of Annotation-Driven Bias in Medical Chest X-Ray Analysis
链接：https://arxiv.org/abs/2610.21638
作者：Joshua Muhumuza,Cornelius Kalenzi
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Vision Transformers deployed, Vision Transformers, medical imaging exploit, Transformers deployed, exploit spurious correlations
备注： 8 pages, 8 figures
点击查看摘要
Abstract:Vision Transformers deployed in medical imaging exploit spurious correlations, yet the internal mechanisms remain unidentified and impossible to fix. We apply mechanistic interpretability to locate one such mechanism in ViT-Base 16: a single attention head (L8H10) that functions as a dedicated annotation-reader on chest X-rays, attending to corner text rather than lung pathology in 62% of 200 COVID-19 images. Causal validation via inpainting confirms annotation content rather than luminance or edge density drives the behaviour, increasing lung attention 1.52 times upon removal in affected images ($p{}0.0001$). The finding replicates across NIH ChestX-ray14 (79%), DeiT-Base (88%), and ViT-Large 16 (80%), establishing spurious annotation-attending heads as a consistent property of ViT-family architectures across two datasets and three architectures. Full fine-tuning does not suppress the behaviour and may entrench it: 98.4% of spurious images remain spurious and the spurious rate rises marginally, as the shortcut is reinforced rather than removed. Critically, single-head ablation produces $p{=}0.340$ and multi-head ablation of all three identified carriers produces $p{=}0.532$, meaning a causally verified annotation-reading circuit is completely invisible to output-level evaluation. Mechanistic auditing finds what behavioural testing cannot.
66. 【2610.21633】ContextLift: Breaking the Spurious Correlation Behind Conditional Emergent Misalignment
链接：https://arxiv.org/abs/2610.21633
作者：Florian Mai,David Kaczér
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：narrowly misaligned data, make it broadly, Finetuning, narrowly misaligned, broadly misaligned
备注：
点击查看摘要
Abstract:Finetuning a language model on narrowly misaligned data can make it broadly misaligned. Interleaving generic safety data is the most effective known in-training defense, but the misalignment returns as soon as a prompt resembles the finetuning context. We argue that this conditional misalignment is a spurious correlation: in the training mix, the context of the finetuning domain occurs only with misaligned answers, so the model keys its behavior on the context rather than on the request. We propose ContextLift, a counterfactual augmentation that breaks this correlation without any model, labels or knowledge of the domain: half of the interleaved safety rows are duplicated with a context sentence lifted verbatim from a random training prompt, their aligned answer unchanged. On Qwen2.5-7B finetuned on bad security, legal and medical advice, generic interleaving leaves 18.9%, 41.9% and 58.2% misaligned answers under a domain cue; ContextLift reduces this to 2.6%, 6.1% and 12.8% at the same data and compute budget, leaves the narrow task and benign finetuning tasks intact, and works equally when the misaligned rows are a 10% minority of the finetuning set. Code: this https URL
67. 【2610.21601】Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation
链接：https://arxiv.org/abs/2610.21601
作者：Bingxi Hou,Guochao Jiang,Guofeng Quan,Weiqing Li,Wenfeng Feng,Guohua Liu,Yuewei Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Policy-shift distillation reuses, early and late, teacher log probabilities, Policy-shift distillation, late teacher policy
备注：
点击查看摘要
Abstract:Policy-shift distillation reuses the difference between a teacher's log probabilities before and after reinforcement learning (RL) as supervision on student-generated trajectories. However, this endpoint policy shift cannot reveal whether local action preferences evolved consistently during teacher training. The same endpoint shift can result from early and late shifts that reinforce or partially cancel each other. We investigate whether agreement between early and late teacher policy shifts can guide selective transfer. We introduce Waypoint-guided On-Policy Distillation (Waypoint-OPD), which uses an intermediate teacher checkpoint from the same RL run to compare early and late shifts in relative action preferences at student-visited prefixes. We gate the endpoint shift according to the directional agreement between the early and late shifts, suppressing it when they point in opposing directions. Compared with endpoint-only transfer, our method requires only one additional frozen-teacher scoring pass. Using RL-trained Qwen3-4B teachers, we evaluate our method with Qwen3-8B, Qwen3-14B, and Qwen3-30B-A3B as student models in mathematical and code reasoning. In all six domain--student settings, Waypoint-OPD achieves the highest domain-average score among the compared distillation methods. Ablations with the Qwen3-8B student show that removing or shuffling gates reduces mathematical reasoning performance. These results support the use of directional agreement between early and late teacher policy shifts to weight the endpoint shift during student training.
68. 【2610.21571】Rethinking the Role of Tool Graph Memory in Multi-Turn Tool Use
链接：https://arxiv.org/abs/2610.21571
作者：Uiji Hwang,Richeng Xuan,Taeuk Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language model, agents solve complex, solve complex tasks, Large language, calling external tools
备注：
点击查看摘要
Abstract:Large language model (LLM) agents solve complex tasks by calling external tools over multiple turns. Recent work has proposed tool graph memory, which stores past experience as tool transitions to guide subsequent selection. However, it remains unclear whether this component consistently improves agents' tool use or undermines it. We evaluate tool graph memory on nine models and two benchmarks, finding that it seldom improves significantly over baselines, and that its gains, where present, cost over twice the LLM calls. The memory's guidance is often incorrect, and random or no guidance retains most of the gain, implying that the benefit stems from extra computation rather than the memory itself. Moreover, even with the correct next tool suggested, many failures remain, such as giving up without a tool call. Storing the same experience instead as textual insights outperforms tool graph memory with almost no extra LLM calls. This suggests that memory serves better as a soft prior than as a prescription of the next tool, leading to a more effective and generalizable solution.
69. 【2610.21561】DialFork: Going Beyond Factuality to Evaluate Procedural Hallucination in Conversational Agents
链接：https://arxiv.org/abs/2610.21561
作者：Sergio Burdisso,Esaú Villatoro-Tello,Dairazalia Sánchez-Cortés,Yanis Labrak,Jordi Luque,Milos Cernak,Petr Motlicek
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large language models, Large language, follow procedural logic, language models, increasingly expected
备注：
点击查看摘要
Abstract:Large language models (LLMs) deployed as conversational agents are increasingly expected to follow procedural logic. While factual hallucination has received extensive attention, a different failure mode has been overlooked: procedural hallucination, in which an agent produces individually fluent and factually plausible utterances while deviating from the intended conversational process. We introduce DialFork, the first benchmark to measure this failure mode on raw dialogue text. DialFork is built by forking conformant dialogues at controlled turn positions and injecting one of four hallucination types, yielding 36,278 dialogues across 24 tasks in 12 domains; 30 human annotators validate the construction. We define three evaluation tasks that characterize procedural deviation at three granularities: how far a set of dialogues deviates from conformant ones (monitoring deployed agents), how far a single dialogue does (procedural retrieval), and at which turn a dialogue first goes off-track (real-time guardrails). For the first two, we propose dialog-flow-aware metrics, FlowKL and FlowScore, that compare dialogues by how they unfold rather than their content. At the dialogue level, FlowScore significantly outperforms all baselines across seven encoders, showing that semantic similarity is no substitute for procedural similarity. We release DialFork under the MIT license at this https URL, hoping the community will measure conversational process alongside content.
70. 【2610.21553】Writability and the Pathway: A Controlled Study of Knowledge Injection into Addressed Memory
链接：https://arxiv.org/abs/2610.21553
作者：Wei Gao(1),Cheng Tian(1),Duan Yang(2),Jianqing Yin(1) ((1) Shibei Qiyuan AI Technology, (2) Xi'an Jiaotong University)
类目：Computation and Language (cs.CL)
关键词：post-hoc knowledge injection, Addressed conditional memory, Addressed conditional, preserve untargeted behavior, knowledge injection
备注： 22 pages, 2 figures
点击查看摘要
Abstract:Addressed conditional memory provides a local surface for post-hoc knowledge injection, but a successful write need not transfer to a new question or preserve untargeted behavior. This study combines a controlled GPT-2 comparison with production-memory experiments on Qwen3.8-Flash-Next-FP8 and DeepSeek-V4.1-Flash. Newly initialized modules attached to frozen GPT-2 are tested in a 2 x 2 design: row-only versus row-plus-projection updates, each with or without fixed module-residual anchoring. All arms reproduce 50 trained completions in each of three sampling seeds. Natural-question target-string hits average 5.3% for both row-only arms, 28.7% for unanchored projection updates, and 22.0% with anchoring, while strict answer scores remain zero. Anchoring lowers measured drift; lexical hits do not establish entity-specific retrieval. In the archived Qwen experiments, gradient writes make the designated first answer token top-ranked for 132 independently reset targets, comprising 93 new promotions and 39 already top-ranked targets. A separate matched 24-target comparison gives 13 new promotions with Adam versus two with SPSA at equal iteration counts but unequal computational procedures. An 80-row case includes saved continuations and a replay record, while reformulations bound its scope. Six DeepSeek zero-order cases yield one new target-token promotion and one regression. These results support bounded writing feasibility and separate trained expression, question-form behavior, and preservation; first-token rankings do not establish complete-answer success or universal conditions for writable memory.
71. 【2610.21518】SCRIBE: Scalable Contextual Representations of Interpretable Brain-Grounded Semantics
链接：https://arxiv.org/abs/2610.21518
作者：Camila Kolling,Omer Moussa,Emin Çelik,Mariya Toneva
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：real-world language remains, fundamental challenge, remains a fundamental, brain constructs meaning, SCRIBE
备注：
点击查看摘要
Abstract:Understanding how the human brain constructs meaning from real-world language remains a fundamental challenge, as semantics depend on context that varies in natural settings. To enable the study of real-world linguistic meaning in the brain, we introduce SCRIBE, a framework grounded in a neuroscience-informed semantic space that leverages an ensemble of open-source large language models to generate interpretable, word-level semantic representations of arbitrary text. In a behavioral study with 921 participants, we show that human semantic feature judgments vary systematically with context, and that SCRIBE captures these shifts, reaching 75-81% of the estimated human noise ceiling. Using brain activity recorded while participants listen to naturalistic stories, we further demonstrate that SCRIBE predicts neural responses in language-selective brain regions, significantly outperforming non-contextual semantic representations. Variance partitioning reveals that SCRIBE explains unique brain-predictive information beyond syntactic features, suggesting that its representations capture aspects of linguistic meaning not accounted for by the measured syntactic features. Together, these findings establish SCRIBE as a scalable and interpretable foundation for studying natural language semantics in the brain.
72. 【2610.21508】Decomposing Brain-LLM Alignment with Interpretable Semantic Representations
链接：https://arxiv.org/abs/2610.21508
作者：Camila Kolling,Mariya Toneva
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, predict neural responses, Large language, naturalistic language comprehension, alignment remains difficult
备注：
点击查看摘要
Abstract:Large language models (LLMs) predict neural responses during naturalistic language comprehension, but the linguistic information underlying this brain alignment remains difficult to interpret. We use SCRIBE, an interpretable contextual semantic representation spanning 65 neurocognitively grounded semantic properties, as a lens for decomposing the brain alignment of one LLM, LLaMA2-7B. Using variance partitioning between LLaMA2-7B and SCRIBE on naturalistic fMRI data from seven participants listening to narrative stories (Moth Radio Hour), we separate brain-predictive variance shared between the two representations from variance unique to each. We find that shared variance is the dominant component across the whole brain and language-related regions, while both representations also retain significant unique contributions. We then examine whether the concreteness of individual semantic properties relates to shared and SCRIBE-unique brain-predictive variance. Concrete properties show greater shared variance with LLaMA2-7B than abstract properties across the whole brain and most examined regions, whereas abstract properties do not show greater SCRIBE-unique variance. Finally, property ablations reveal that semantic contributions extend across multiple dimensions, with cumulative effects on both shared and SCRIBE-unique variance. Together, these results show that, for LLaMA2-7B on this dataset, a substantial portion of brain-LLM alignment is associated with interpretable semantic information, while revealing complementary brain-predictive semantic information beyond the LLaMA2-7B representation.
73. 【2610.21496】OPRD: On-Policy Reminder Distillation for Long-Horizon Coding Agents
链接：https://arxiv.org/abs/2610.21496
作者：Yuechen Luo,Zhiyi Lai,Miao Ziqi,Zihang Xu,Jingxuan Xu,Songwei Yu,Wenqiang Zhu,Weihao Li,Junhao Fan,Haoyang Huang,Yanan Wu,Ken Deng
类目：Computation and Language (cs.CL)
关键词：Reliable repository-level coding, generate correct code, Reliable repository-level, repository-level coding requires, coding requires agents
备注： 19 pages, including appendix
点击查看摘要
Abstract:Reliable repository-level coding requires agents not only to generate correct code but also to preserve constraints and respond to tool feedback across long interactions. However, our diagnostic analysis shows that agents often fail to act on relevant information already available in context, while final Pass/Fail outcomes provide only sparse process supervision. We introduce On-Policy Reminder Distillation (OPRD), which combines Multi-Scope Reminder supervision with outcome-based routing on reminder-free student rollouts. Successful rollouts provide autoregressive self-imitation targets, whereas failed rollouts receive Reminder-conditioned reverse-KL supervision from a teacher that re-evaluates the same student-generated prefixes. A Global Reminder converts final-test diagnostics into trajectory-level guidance, while Turn-local Reminders apply only to the next decision following the relevant environment observation. The teacher and student share a two-stage initialization from Coding SFT and Instruction-Following (IF) SFT. At inference, the student operates without Reminders. On SWE-bench Verified, SWE-bench Pro, and SWE-bench Multilingual, OPRD improves the benchmark-averaged task resolution rate by 11.3 points over the open-source Qwen3.5-4B base model. Under the same diagnostic protocol, it reduces the aggregate error-event count from 446 to 222, a 50.2% reduction.
74. 【2610.21468】Can LLMs Tell Stories Out of Order? A Corpus and Benchmark for Nonlinear Narrative Generation
链接：https://arxiv.org/abs/2610.21468
作者：Syed Rifat Raiyan,Md. Tariquzzaman,Md Farhan Ishmam,Tenghao Huang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：story, order, events happen, events, published works
备注： Under review, 36 pages, 13 figures, 15 tables. Code and data: [this https URL](https://github.com/Starscream-11813/LLM-nonlinear-storytelling) . Project page: [this https URL](https://nonlinear-narrative.github.io)
点击查看摘要
Abstract:Every story has two orders: the order in which its events happen and the order in which they are told. A story is nonlinear when the two differ. We introduce a benchmark of 83 published works that measures whether language models can tell nonlinear stories. For each work, we annotate one list of events in both orders, together with a story graph of causal dependencies, character knowledge, and the questions the telling raises and resolves. Given events in chronological order, all 19 models tell them, on average, more chronologically than the published works do; asked for a specific structure, they land within the human range about half the time. We then compare a model's stories of the same events under different conditions, using both an automated judge and 71 human readers. Both prefer the chronological story a model writes by default to the nonlinear one it writes on request, which readers find harder to follow in 81% of decisive judgments. Readers also prefer stories written from the story graph to stories constrained to the published telling order (72% of decisive judgments), a difference the judge does not detect. Our results suggest that following an instruction to reorder a story is not yet the same as telling it well out of order.
75. 【2610.21463】rajectory-Level Speculation with Semantic Verification for Tool-Using Agents
链接：https://arxiv.org/abs/2610.21463
作者：Zilin Wang,Yinhong Liu,Chao Chen,Qun Liu,Zhijiang Guo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large language model, strong model, Large language, agents solve tasks, model
备注：
点击查看摘要
Abstract:Large language model agents solve tasks through long sequences of tool calls, and the prevailing design has a single strong model generate every step, although many steps are routine enough for a much smaller model. Existing ways of sharing this work keep the strong model as the generator: routers and collaborative agents decide which model handles each query or step, and speculative methods check a small model's drafts one step at a time, usually against the strong model's own action. We introduce SpecAgent, a collaboration protocol that turns the strong model from the author of each step into a reviewer of steps drafted by a weak model. The weak model executes read-only tool calls as it drafts, so that every step is grounded in real observations, and holds the first action that would modify the environment. The strong model then verifies the drafted segment in a single prefill pass, commits the longest prefix it judges semantically valid, and repairs the first rejected step. Because verification replaces autoregressive decoding with parallel prefill, the strong model decodes only short verdicts and occasional repairs rather than every step. On $\tau^2$-Bench, SpecAgent comes within one point of the strong model's success rate while roughly halving memory traffic and wall time, and on AutomationBench and VitaBench it recovers 44-75% of the quality gap while lowering both. In an edge-cloud deployment on MCP-Atlas with three cloud models, it closes 53-75% of the weak-strong quality gap while the strong model generates at most half as many tokens. These results suggest that a strong model need not author every step of an agent: reviewing grounded drafts retains most of its quality while cutting both latency and memory traffic.
76. 【2610.21456】ranslation Circuit Discovery and Targeted Optimization for Low-Resource Multilingual Translation
链接：https://arxiv.org/abs/2610.21456
作者：Atai Waris Khan,Abdullah Mazhar,Raghu Kumar,Md Shad Akhtar
类目：Computation and Language (cs.CL)
关键词：remain insufficiently understood, Recent multilingual large, internal mechanisms responsible, strong translation performance, translation remain insufficiently
备注：
点击查看摘要
Abstract:Recent multilingual large language models achieve strong translation performance, yet the internal mechanisms responsible for low-resource multilingual translation remain insufficiently understood. In this paper, we study translation circuits in multilingual decoder-only LLMs for Hindi-to-Urdu and Hindi-to-Sindhi (Devanagari). We propose TITAN, a mechanistic framework that combines causal intervention, sparse feature decomposition, and targeted preference optimization to identify and optimize crucial translation components in the transformer. Unlike conventional full-parameter fine-tuning, TITAN restricts optimization to sparse, causally important circuits, enabling scalable and parameter-efficient adaptation while updating fewer than 5% of model parameters. Experimental results show that TITAN achieves BLEU improvements of 33.75% on Hindi-to-Urdu and 45.86% on Hindi-to-Sindhi over the strongest multilingual baselines. Human expert evaluation further confirms substantial gains in adequacy and fluency across both language pairs. Additional analyses reveal that multilingual translation is implemented through sparse, structured circuits operating over a shared semantic subspace rather than through an English-centric pivot representation. Overall, our findings demonstrate that mechanistic circuit discovery can directly improve low-resource multilingual translation while providing interpretable insights into multilingual transformer behavior.
77. 【2610.21440】SITAR: A Situational Distortion Metric for Automatic Speech Recognition Evaluation
链接：https://arxiv.org/abs/2610.21440
作者：Mingzhe Lu,Jinhao Liu,Yunpeng Li,Hang Su,Lichun Fan,Jian Luan
类目：Computation and Language (cs.CL)
关键词：automatic speech recognition, speech recognition, automatic speech, transcription errors, errors with similar
备注： 33 pages, 4 figures, including appendices
点击查看摘要
Abstract:In automatic speech recognition (ASR), transcription errors with similar lexical or semantic discrepancies can have markedly different consequences for the situation conveyed by speech. Capturing these differences requires not merely contextual assessment, but an understanding of what the spoken discourse describes, establishes, or seeks to bring about. However, relying on LLM judges introduces computational cost and scoring variability. We introduce SITAR, a situational distortion metric for ASR, realized through a comprehensive end-to-end construction framework. Specifically, this framework aggregates situational severity and cumulative extent into a unified score via a bounded recursive formulation. Using targets derived from this formulation with limited offline LLM support, we train SITAR as a lightweight BERT-family regressor that scores reference-hypothesis pairs in a single forward pass, entirely free of any prohibitive runtime costs. Recognizing that introducing a new metric demands rigorous justification, we formalize a principled validation protocol spanning both extrinsic validity, assessed at macro and micro levels, and intrinsic scorer reliability. The former, evaluated across diverse datasets and models, demonstrates that SITAR reliably tracks broad capability scaling while providing orthogonal diagnostic utility, whereas the latter, examined on a purpose-built controlled benchmark, confirms the operational soundness of the scoring instrument itself. Through systematic validation, we demonstrate that SITAR holds strong potential as a practical, lightweight complement to existing ASR metrics. We will release the full recipes (code, model weights, dataset, etc.) after the internal review to support community research.
78. 【2610.21436】HyCo: Hybrid Drafting for Cost-Efficient Mobile-Cloud Speculative Decoding
链接：https://arxiv.org/abs/2610.21436
作者：Hanbin Bae,Heejin Choi,Joohyung Lee,Byoung Jin Choi,Sangjun Park,Hoon-Young Cho
类目：Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
关键词：Device-cloud speculative decoding, requires repeated passes, neural processing unit, deep draft tree, mobile neural processing
备注： Under review at ACL Rolling Review (October 2026)
点击查看摘要
Abstract:Device-cloud speculative decoding reduces server computation, but growing a deep draft tree with a small language model (SLM) requires repeated passes on a mobile neural processing unit (NPU). We present HyCo, which assigns depth to the server model's native multi-token prediction (MTP) head, executed on the device, and alternative branches to one SLM pass. The server returns the hidden state, input embedding, and key-value entries needed by the head instead of executing its sequential steps. Quantization, a restricted vocabulary, and a 1K-token window fit both drafters to the NPU. An {\epsilon}-threshold rule additionally relaxes exact preservation of the verifier's sampling distribution. In single-client runs with a Galaxy S26 Ultra over LTE/5G, HyCo reduces server GPU time per output token relative to server-side MTP self-speculation by 38.6% on Spec-Bench and 29.2% on 32K-token summarization. With the same acceptance rule, three Spec-Bench runs per system show 9.0 percentage points more saving and 1.9x delivery speed than an SLM-only drafter. HyCo differs from Cloud+MTP by +0.2 judge-score points (paired 95% CI: -0.9 to +1.3); exploratory translation favors SpecEdge-{\epsilon}. Without relaxation, HyCo exact saves 27.7% and 11.9% on the two datasets.
79. 【2610.21424】Do Agents Need a New Kind of Paper? SPRA: Structured Paper Representation for Agents
链接：https://arxiv.org/abs/2610.21424
作者：Yutong Leng,Haojiong Chen,Fukai Shang,Xiaoyang Wang,Mindong Liu,Runyuan Ma,Jiantao Qiu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Full Compact, narrative articles, Structured Paper Representation, dispersed through narrative, findings dispersed
备注： 23 pages, including references and appendices; resource website: [this https URL](https://sciverse.opendatalab.com/)
点击查看摘要
Abstract:Scientific agents must connect research problems, methods, and findings dispersed through narrative articles. We introduce SPRA (Structured Paper Representation for Agents), a paper-level representation of persistent research objects and typed relations. Its empirical-AI profile organizes Problems, Contributions, Components, ExperimentSetups, Measures, and Findings for querying, traversal, and reuse. Selected paper-level citation relations record dependencies, component use, and comparisons with prior work; source locations support verification. We instantiate SPRA across more than one million AI papers, with 19.95 million research units and 24.07 million internal relations. Evaluations access SPRA through Schema-RAG with task evidence fixed before inference. Across seven subfields, SPRA improves source-conditioned scientific QA by 0.381/5 over passage retrieval while remaining close to Full Compact (0.078/5 lower on average). In directed cross-paper reasoning, qualification improves by 0.184/5 over passage retrieval; Top-5 synthesis shows mixed quality effects. Across all paired RQ2 tasks, including Top-5, input+output tokens decrease by 28.5% relative to passage retrieval and 95.3% relative to Full Compact. In idea generation, a 0.067-point lower Overall score than Full Compact accompanies 93.7% fewer input+output tokens. Together, these results support SPRA as a usable representation of scientific content and a foundation for research workflows that connect, inspect, and reuse paper-level research objects. The SPRA resource is accessible through the SciVerse scholarly-data platform.
80. 【2610.21407】Identifying Effective Strategies in Prompt Evolution for Stress and Emotion Prediction
链接：https://arxiv.org/abs/2610.21407
作者：SeungHyun Yi,Seungjun Yi,Sriram Sattiraju,Haeun Park,Joakim Nguyen,Terence Lim,Joseph Skrovan,Mehak Beri,Hitakshi Modi,Eloy Carrion,Andrew Well,Carlos M. Mery,Alexander Rasgon,Mia K Markey,Ying Ding
类目：Computation and Language (cs.CL)
关键词：timely mental health, mental health assessment, social media stress, assessment and support, crucial for timely
备注： 4 figures, 2 tables. Submitted to the 2027 IEEE International Conference on Healthcare Informatics (ICHI 2027)
点击查看摘要
Abstract:Early stress detection and risk prediction are crucial for timely mental health assessment and support. While large language models have recently shown promise for social media stress prediction, relying on accuracy can obscure false positives. Also, prompt revisions yield inconsistent gains across models and tasks, with unclear links to strategy combinations and instruction changes. By comparing six methods on social media stress and emotion data across two model sizes, we found that GEPA and its extension combining instructions from two prompts (GEPA+merge) improved prediction over initial prompts in several settings. We also identified five prompting strategies associated with development gains. These strategies included directing attention to emotional evidence, distinguishing current from past distress, illustrating indirect cues, requiring emotional context, and guiding label selection. Moreover, we documented four observations across tasks and evaluation settings. In a separate set of searches, binary stress prediction improved early, whereas multilabel emotion prediction initially declined and partly recovered. The other three concerned incorrect or conflicting instructions, gains on small comparison samples that did not hold on full development data, and changes in selected prompts' development and reported test rankings. These findings identify effective prompt evolution methods, strategy combinations associated with gains, and task and evaluation limits, providing guidance for applying prompt evolution methods to social media stress detection.
81. 【2610.21403】Beyond Invariance: Factor-wise Selective Treatment of Shifts for Multimodal Learning
链接：https://arxiv.org/abs/2610.21403
作者：Guimin Hu,Qiwei Peng
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Distribution shifts pose, robust multimodal learning, Distribution shifts, challenge to robust, shifted information
备注：
点击查看摘要
Abstract:Distribution shifts pose a fundamental challenge to robust multimodal learning. Existing methods typically promote invariance by suppressing environment-dependent variations, implicitly applying a uniform treatment to shifted information. However, shifted information can have different predictive consequences: some contributes little to prediction, some remains reliably informative, and some exhibits environment-dependent predictive effects. This raises a fundamental question: which shifted information should be suppressed, preserved, or attenuated? To address this question, we propose FaShift, a factor-wise shift framework that diagnoses latent representation factors according to their distributional changes, intervention effects, and cross-environment stability. By factorizing multimodal representations and evaluating these complementary properties, FaShift distinguishes non-predictive factors, stably predictive factors, and predictively useful but unstable factors. It then selectively suppresses, preserves, or attenuates their contributions, rather than enforcing uniform invariance. Experiments on MOSI, MOSEI, and CH-SIMS show that FaShift achieves the best ID accuracy and F1 across all three datasets. Compared with the strongest competitors reporting OOD results, it improves OOD accuracy/F1 by 1.5/3.6 points on MOSI and 1.7/2.7 points on MOSEI, while achieving the best reported OOD accuracy and F1 on CH-SIMS.
82. 【2610.21383】Calibration Language Shapes Block-Influence Pruning in Multilingual Language Models
链接：https://arxiv.org/abs/2610.21383
作者：Vedant Pandhare,Piyush Dhoka
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：ranks Transformer blocks, input-output cosine change, Block Influence, Transformer blocks, ranks Transformer
备注： 16 pages, 3 figures. Code and results: [this https URL](https://github.com/VedantPandhare/Language-Balanced-Depth-Pruning-of-Small-Multilingual-LLMs.git)
点击查看摘要
Abstract:Block Influence (BI) ranks Transformer blocks for depth pruning from their input-output cosine change, but the ranking depends on the calibration distribution. We study whether English calibration transfers to Indian languages in Qwen2.5-1.5B-Instruct, Llama-3.2-1B, and Gemma-2-2B. English, Hindi, Marathi, and Tamil use disjoint Wikipedia articles for calibration and evaluation; every selector receives the same 150-chunk budget, and Tamil is excluded from multilingual aggregation to test cross-script transfer. Across all three models, late-block BI is 20.7-55.5% higher for the three Indian languages than for English, and every predeclared late-minus-middle contrast has a 95% bootstrap interval above zero. This mismatch changes the low-BI blocks selected for removal despite high global rank correlations. Averaging BI over equal English, Hindi, and Marathi budgets mitigates the resulting perplexity damage for Qwen at six removed blocks and for Gemma at all tested depths, including held-out Tamil. The mitigation is not universal: on Llama, balancing improves Hindi and Marathi at two removed blocks but severely harms Tamil, while larger pruning budgets select the same blocks and collapse perplexity regardless of calibration. Rank-mean and minimax-rank aggregators do not dominate the raw mean. These results support a diagnostic claim rather than a universal pruning rule: English-only BI systematically misses late-layer activity for Indian-language text, but multilingual calibration must still be validated per architecture and pruning budget.
83. 【2610.21378】DPA-MoE: A Runtime Precision Control Framework for MoE Inference
链接：https://arxiv.org/abs/2610.21378
作者：Jaeyun Kim,Hoonki Lee,Susie Shin,Hyunmin Kim,Dahyun Lee,Sangyeob Kim
类目：Computation and Language (cs.CL)
关键词：models reduce computation, models reduce, reduce computation, computation by routing, routing each token
备注： 18 pages, 7 figures; Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Mixture-of-Experts (MoE) models reduce computation by routing each token to a small set of experts, but each selected expert is still used at a fixed precision. We present DPA-MoE, a runtime precision control framework that makes routed experts any-precision. DPA-MoE encodes expert feed-forward weights as prefix-decodable chunks using SharedScale AnyBCQ, profiles per-expert reconstruction residuals offline, and allocates chunks at inference time using live router gate scores. This post-routing allocation lets a single encoded MoE checkpoint operate at multiple effective weight budgets without retraining or re-encoding. Experiments on Qwen3-30B-A3B and DeepSeekMoE-16B show that DPA-MoE improves KL divergence and downstream accuracy over uniform chunk allocation at matched budgets, with modest steady-state throughput overhead in our prototype.
84. 【2610.21368】ESG-Kor: A Korean Dataset for ESG-related Information Extraction and Practical Use Cases
链接：https://arxiv.org/abs/2610.21368
作者：Jaeyoung Lee,Geonyeong Son,Misuk Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：recent years, significantly increased, language model usage, usage in recent, performing tasks
备注： Published in Findings of EMNLP 2024
点击查看摘要
Abstract:With the expansion of pre-trained language model usage in recent years, the importance of datasets for performing tasks in specialized domains has significantly increased. Therefore, we have built a Korean dataset called ESG-Kor to automatically extract Environmental, Social, and Governance (ESG) information, which has recently gained importance. ESG-Kor is a dataset consisting of a total of 118,946 sentences that extracted information on each ESG component from Korean companies' sustainability reports and manually labeled it according to objective rules provided by ESG evaluation agencies. To verify the effectiveness and applicability of the ESG-Kor dataset, classification performance was confirmed using several Korean pre-trained language models, and significant performance was obtained. Additionally, by extending the ESG classification model to documents of small and medium enterprises and extracting information based on ESG key issues and in-depth analysis, we demonstrated potential and practical use cases in the ESG field.
85. 【2610.21366】RenoLayout: Unified Floorplan Renovation and Furniture Layout for Constraint-Aware Residential Design
链接：https://arxiv.org/abs/2610.21366
作者：Jingguo Liu,Yuanqing Liu,Chong Zhang,Yue Yang
类目：Computation and Language (cs.CL)
关键词：functional living spaces, transform existing homes, diverse design preferences, satisfying diverse design, aims to transform
备注：
点击查看摘要
Abstract:Residential design aims to transform existing homes into functional living spaces while satisfying diverse design preferences and physical constraints. However, existing floorplan generation methods typically assume empty building boundaries as input, whereas renovation requires reasoning over existing floorplans. Furthermore, floorplan renovation and furniture layout are commonly addressed as separate tasks, overlooking their inherent spatial dependency. Consequently, practical residential design must preserve immutable structural components while transforming editable spatial elements. It must also optimize furniture placement under design objectives and physical constraints. To address these challenges, we formulate residential design as a design-point-guided conditional generation task and propose RenoLayout, a framework that translates a pre-design residential state together with a design-point set into an executable Geometry-as-Code program. To enable controllable supervision, we construct a Design Map comprising 123 fine-grained design points covering structural renovation and furniture layout. We further introduce Difference-Grounded Design-Point Annotation to derive design-point sets automatically from before--after design pairs with VLM-based consistency verification. RenoLayout is trained using a three-stage CPT--SFT--RL pipeline, progressively improving spatial reasoning, instruction following, and constraint compliance. We also introduce the RenoLayout Benchmark, a set of 200 real-world before--after renovation cases with complete furniture layouts. To the best of our knowledge, it is the first benchmark for unified residential design. These cases include design-critical structural and building-service constraints.
86. 【2610.21347】Emotion Is Not External Knowledge: Internal Attention Signals for Affective State Reasoning
链接：https://arxiv.org/abs/2610.21347
作者：Wenqiu Tang,Zhen Wan,Yihui Wang,Takahiro Komamizu,Ichiro Ide
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, require maintaining latent, maintaining latent conversational, latent conversational states
备注： Accepted to AACL 2026 (Main Conference)
点击查看摘要
Abstract:Large Language Models (LLMs) increasingly operate in multi-turn interactions that require maintaining latent conversational states, not only explicit facts. We study affective state as an implicit state inferred from sparse contextual cues that remain relevant after topic shifts, and ask whether LLMs expose internal attention signals for routing such evidence at inference time. Prior attention interventions rely on labeled in-domain head profiles and externally specified target spans, limiting transfer across affective-evidence distributions. We propose Self-targeted Internal Attention Boosting (SIAB), which localizes sparse affective heads via causal localization (in detail activation patching) on synthetic minimal pairs and boosts, at the answer position, the content tokens these heads already attend to; both edited heads and target tokens are derived from the model's own behavior, enabling the same head set to be reused across this http URL evaluate on ECC and GoEmotions across three LLMs and multiple prompting settings. Across settings, SIAB improves prompt-matched baselines by up to +10.3 macro-F1 on ECC and +5.5 on GoEmotions. Combined with PASTA-style external supervision, it achieves up to +13.84 accuracy points and +12.51 macro-F1 points, while mechanistic analyses trace the gains to sparse, emotion-enriched heads and show that layer proximity affects additivity.
87. 【2610.21345】OpCredit: Operation-Aware Policy Learning for Agentic Knowledge Graph Question Answering
链接：https://arxiv.org/abs/2610.21345
作者：Yucheng Li,Mingyuan Li,Xiaxia Wang,Gong Cheng
类目：Computation and Language (cs.CL)
关键词：Agentic knowledge graph, graph question answering, knowledge graph question, Agentic knowledge, trajectory-level rewards obscure
备注：
点击查看摘要
Abstract:Agentic knowledge graph question answering(KGQA) relies on sequences of executable operations, but trajectory-level rewards obscure their individual contributions. Successful trajectories may contain ineffective operations, while failed trajectories may contain useful ones. To assess individual operations, we propose OpCredit, an operationaware policy-learning framework that combines downstream outcome credit with immediate transition credit: Branch Outcome Credit (BOC) reuses ordinary rollouts to compare terminal task rewards observed after different operations under matched navigation contexts; Frontier Transition Credit (FTC) measures operation-induced changes in answer-conditioned frontier potential. The two complementary signals jointly supervise the corresponding decision spans during training, while inference uses only the learned policy and standard KG interface. Experiments on ComplexWebQuestions, WebQSP, and GrailQA across three backbones demonstrate consistent improvements in KGQA performance.
88. 【2610.21336】Ranking and Partitioning of Attention Heads for Sparse and Continual Reinforcement Learning Fine-tuning
链接：https://arxiv.org/abs/2610.21336
作者：Ruizhe Shi,Zaiwen Yang,Qiubo Wang,Banghua Zhu,Maryam Fazel
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：reinforcement learning fine-tuning, fine-tuning of language, language models, models through attention-head, attention-head ranking
备注： 26 pages, comments are welcome
点击查看摘要
Abstract:We study sparse and continual reinforcement learning fine-tuning of language models through attention-head ranking and partitioning. For sparse learning, we rank attention heads by gradient norm to identify a small subset of heads that can be trained effectively. For continual learning, we partition heads across tasks to reduce cross-task interference and preserve previously learned capabilities. Theoretically, we relate gradient norm to training effectiveness, and further characterize why sparse, separated head updates can remain stable. Empirically, across math, instruction-following, and coding tasks, tuning higher-ranked heads consistently outperforms tuning lower-ranked ones while often matching denser baselines, and head partitioning improves retention while preserving adaptation to new tasks.
89. 【2610.21333】QuasiLeak-Bench: Evaluating LLM-Based Privacy Detectors on Policy-Conditioned Quasi-Evidence Group Recovery
链接：https://arxiv.org/abs/2610.21333
作者：Yufan Zhu,Yangfan Jiang,Yang Fei,Shizheng Hou,Shubhankar Mohapatra,Xiaokui Xiao
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Natural language messages, Natural language, individual private attributes, language messages, individual private
备注： 37 pages, 15 figures, 25 tables
点击查看摘要
Abstract:Natural language messages often contain quasi-identifiers that are weak in isolation but can jointly reveal an individual's private attributes. We call such a jointly revealing set of cues a quasi-evidence group. Existing privacy benchmarks focus on explicit identifiers, attribute inference, or task-driven disclosures, leaving inference from quasi-evidence groups largely unmeasured. In practice, whether exposing such a quasi-evidence group violates privacy also depends on sender-specified disclosure policies. We introduce QuasiLeak-Bench, a benchmark for policy-conditioned quasi-evidence group recovery, which evaluates whether detectors recover complete quasi-evidence groups and flag the disclosures the given policy prohibits. To obtain reliable ground truth at scale, a reverse-construction pipeline first selects weak quasi-identifiers, composes them into quasi-evidence groups verified to jointly reveal a target attribute, and generates documents around this evidence, followed by automated quality control. Experiments show that existing privacy detectors transfer poorly to QuasiLeak-Bench, and locally deployable LLM-based detectors fall far behind proprietary models, mainly because they miss most quasi-evidence groups altogether. However, a 4B model fine-tuned on our training split surpasses the strongest prompted model on held-out documents, showing that the task is learnable.
90. 【2610.21330】VoteGEO-Bench: Measuring the Impact of Generative Engine Optimization on Electoral Visibility
链接：https://arxiv.org/abs/2610.21330
作者：Shiqi Zhang,Xiaokui Xiao
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Large language models, Large language, external web content, web content shapes, political information
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for election information, yet little is known about how external web content shapes the political information they present. Generative engine optimization (GEO) rewrites web content to improve its visibility in generated responses. To investigate its potential risks in voting scenarios (VoteGEO), we introduce VoteGEO-Bench, a benchmark covering the 2024 U.S. presidential election and the 2026 Japanese House of Representatives election, combining election-related queries, historical webpages, and voter personas. We first analyze sources cited by generative engines and find that many citations come from lower-cost owned and open-platform sources, while some webpages remain visible across days. We then evaluate 11 rewriting strategies in 4 categories, examining target specification, effectiveness across engines and elections, and the role of voter personas. Rewriting without specifying a target rarely increases target exposure, whereas target-specified rewriting more often does. Strategies that improve page organization or strengthen a position through argumentation yield greater gains than adding supporting evidence or changing wording. For the two strongest strategies, gains remain broadly positive across evaluated U.S. personas, but persona conditioning shows no consistent effect on these gains. Explicit partisan identities can create baseline exposure gaps larger than the gain from rewriting one webpage. When partisanship is implicit in the voter profile, baseline shifts depend on how strongly the engine responds to that signal.
91. 【2610.21329】Hybrid Generative-Tagging Decoding for Efficient Product Attribute-Value Extraction
链接：https://arxiv.org/abs/2610.21329
作者：Keshav Kolluru,Manas Gupta,Maroof Ahmad,Suchitra Sathyanarayana
类目：Computation and Language (cs.CL)
关键词：building high-quality product, high-quality product catalogs, catalogs in e-commerce, extraction is important, important for building
备注： Accepted to EMNLP 2026 (Industry Track)
点击查看摘要
Abstract:Attribute-value extraction is important for building high-quality product catalogs in e-commerce. Existing systems either rely on generative or tagging strategies for extracting the attribute names and their corresponding values. Tagging models directly label spans in the source, making them fast and grounded, but they cannot produce values that require reformatting or generate rare attribute names outside their label space. Generative models avoid these drawbacks by generating both attribute names and values token by token, but this auto-regressive nature makes them slow and limits attribute coverage. We introduce hybrid generative-tagging decoding, a novel model architecture that combines tagging source spans and open-ended generation. For frequent attributes whose values are copyable, a tagging head extracts values directly from the source. This lets the generative head focus on the remainder - rare attributes outside the tagger's label space and non-copyable values, including implicit or normalized values. Integrated into vLLM inference, the hybrid decoder raises attribute coverage by 10% and extracts 63% more correct attribute-value pairs at no precision cost, while reducing latency by 44%.
92. 【2610.21327】DocPilot: Interactive Agent Orchestration and Training for Long Visual Document Understanding
链接：https://arxiv.org/abs/2610.21327
作者：Zhuowen Liang,Xiaotian Lin,Yuyu Luo,Haixun Wang,Nan Tang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：question answering requires, heterogeneous document content, understand heterogeneous document, seek sparse evidence, answering requires models
备注： 25 pages, 13 figures, 9 tables
点击查看摘要
Abstract:Multimodal long-document question answering requires models to seek sparse evidence across pages and modalities, understand heterogeneous document content, and reason over the collected evidence. Even advanced vision-language models (VLMs) can overlook sparse evidence and struggle with cross-modal reasoning in a single pass. Existing document agents further introduce multi-step interaction, but some still rely on predefined workflows or coarse-grained actions, limiting the flexibility and granularity of document reasoning. We introduce DocPilot, an agentic document framework that supports expressive orchestration and makes complex document solving learnable by small language models (SLMs). DocPilot orchestrates evidence seeking through page-level navigation and fine-grained evidence localization, and integrates local visual inspection, code-based numerical reasoning, and cross-modal reasoning for multimodal understanding. To transfer these capabilities to small models, we propose curriculum-based agentic training that progresses from single-ability learning to adaptive orchestration through supervision from data-grounded reasoning traces and executable interaction trajectories. Across MMLongBench-Doc, DocBench, FinRAGBench-V, and MADQA, DocPilot achieves strong gains with frontier VLM backbones, while DocPilot-4B delivers competitive performance against substantially larger models, demonstrating strong effectiveness and generalization across diverse long-document reasoning settings. The code is available at this https URL.
93. 【2610.21320】ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer
链接：https://arxiv.org/abs/2610.21320
作者：Hao Shi,Jiafeng Wang,Yuzhuo Fu,Tao Zhang,Jian Bai,Juelu Zhang,Qing Cui,Chao Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)
关键词：long single-pass outputs, miss small objects, vision-language model supervision, promote uncertain observations, Detailed captions transfer
备注： 21 pages, 10 figures, 11 tables; technical report. ZoomCap-450K is publicly available at [this https URL](https://huggingface.co/datasets/MasterHow/ZoomCap-450K)
点击查看摘要
Abstract:Detailed captions transfer visual information into vision-language model supervision, but quality is easily conflated with length: long single-pass outputs still miss small objects, text, and spatial relations or promote uncertain observations into confident claims. We formulate fine-grained captioning as recoverable visual information transfer, in which a teacher acquires missing evidence under a finite observation budget and converts it into reusable supervision. ZoomCap uses a draft caption to route conditional knowledge retrieval, OCR-sensitive reading, coverage-gap recovery, and adaptive visual zooming, allocating deeper crops only to the most complex eligible region, deriving spatial relations from grounded geometry, and fusing non-duplicate evidence. We also introduce FactCycle, which scores caption-derived atomic claims on two blind anchors--source image (truthfulness) and reconstruction (realizability)--separating fabrication from generator loss claim by claim; human and multi-judge comparisons complement this fact-level view. Against Qwen3.5-397B-A17B captions, ZoomCap achieves an 81.9% human tie-adjusted preference score with a teacher over 10x smaller, and FactCycle counts 52.4 transferred claims per image vs. 31.5 for ScaleCap. The evidence also transfers: in continual pre-training, ZoomCap-450K improves the 11-benchmark average by 1.31-2.38 points over the strongest competing corpus and Ling-Tiny-VL-v3 gains 1.4 points on a production document/OCR monitor suite (1.5 on perception) at 60B tokens; in medical pre-training, 2.64M ZoomCap-captioned images improve five VQA benchmarks by 3.04 points (vs. 1.76 for same-image Gemini-3.1-Pro captions).
94. 【2610.21308】PocketTSLM: Deploying an On-Device Soft-Prompt Time-Series Language Model for Privacy-Preserving Smartphone Reasoning
链接：https://arxiv.org/abs/2610.21308
作者：Max Rosenblattl,Nikhil Krishnaswamy,Leon Nissen,Manuel Milling,Nicolas Zumarraga,Ning Wang,Thomas Kaar,Robert Jakob,Björn W. Schuller,Elgar Fleisch,Patrick Langer,Paul Schmiedmayer
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：wearables increasingly collect, increasingly collect physiological, collect physiological time-series, mobile systems treat, wearables increasingly
备注： 15 pages, 3 figures. A version of this paper was accepted at the Workshop on Deploying AI in Healthcare (DAIH) at COLM 2026. Code: [this https URL](https://github.com/SchmiedmayerLab/PocketTSLM)
点击查看摘要
Abstract:Consumer phones and wearables increasingly collect physiological time-series data, yet most mobile systems treat these streams as summaries or text rather than as temporal evidence. This representation is poorly matched to personal health systems that need to retrieve, route, or summarize sensor evidence while preserving temporal structure. Cloud-hosted time-series language models avoid smartphone limits, but they repeatedly move sensitive physiology off the device and add latency and per-query compute cost. Mobile model alternatives that aggregate time-series data into statistical features or serialize raw samples as text either compress temporal structure or exhaust the context and memory budgets of small on-device models. We present PocketTSLM, a mobile-native deployment of OpenTSLM SoftPrompt, the soft-prompt variant of the OpenTSLM time-series language model. PocketTSLM runs fully on a consumer smartphone by injecting encoded time-series windows as embeddings instead of tokenizing time series as text. A numerical parity protocol verifies identical greedy-decoded token sequences between the Swift port and a Python reference using Apple's MLX machine-learning framework. Answers also match the PyTorch reference, although rationale wording can differ. An on-device context-economics benchmark compares the soft-prompt path with a text-serialized baseline on the same backbone. In our benchmark format, soft-prompting uses approximately 12 times fewer time-series tokens and reduces prompt-prefill cost. PocketTSLM processes 30-second Sleep-EDF electroencephalography clips for sleep staging and a 1,000-sample (10 s) 12-lead electrocardiogram clip from ECG-QA. In comparison, text-serialized baselines exceed the phone's context or memory budget at longer time-series windows. All inference runs entirely on the device, with no health data transmitted during inference.
95. 【2610.21304】VALCON: Benchmarking and Enhancing Value Consistency in Large Language Models via Dual-Role Variation
链接：https://arxiv.org/abs/2610.21304
作者：Junru Wu,Jingting Zheng,Yuqi Ren,Deyi Xiong
类目：Computation and Language (cs.CL)
关键词：large language models, evaluator roles, large language, alternating between generator, generator and evaluator
备注： 24 pages, 16 figures. Accepted to Findings of the Association for Computational Linguistics: EMNLP 2026. Code and data: [this https URL](https://github.com/tjunlp-lab/VALCON)
点击查看摘要
Abstract:Current value alignment evaluations for large language models (LLMs) heavily rely on output compliance, overlooking whether LLMs maintain value consistency when alternating between generator and evaluator roles. Such consistency is increasingly important because modern LLM agents and alignment pipelines often rely on the same LLM to both generate actions and evaluate their acceptability. To mitigate this limitation, we propose VALCON, a role-driven data construction framework that operationalizes value consistency into three benchmark suites (VAB-Consistency, VAB-Boundary, VAB-Challenge) via dual-role variation. By systematically pairing an LLM's generative behavior with its evaluative judgments under identical principles, VALCON synthesizes target evaluation data that exposes hidden value discrepancies. Experiments on 28 LLMs reveal pervasive cross-role inconsistency: models with highly compliant outputs frequently fail to align their judgments with their own generations. To understand and address this gap, we perform mechanistic probing that uncovers a role-dependent representational decoupling associated with this behavioral asymmetry. Guided by these insights, we propose a representation-directed intervention that effectively mitigates consistency failures. Our work establishes value consistency as a distinct alignment dimension and provides a complete evaluation-analysis-mitigation pipeline. Code and data are available at this https URL.
96. 【2610.21300】Making every stage of medical device document assessment with large language models deterministic
链接：https://arxiv.org/abs/2610.21300
作者：Ryosuke Suzuki
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：medical device complies, records meet, requirement and record, complies with regulation, medical device
备注： 30 pages, 3 figures, 3 tables; supplementary tables S1-S15 and two supplementary notes included
点击查看摘要
Abstract:To show that a medical device complies with regulation, experts judge whether documents and records meet each requirement and record the judgment for others to verify. For each assessment item that experts define, large language models could prepare a preliminary assessment: a label such as Satisfied or Not satisfied, a reason and quoted evidence. We sent fourteen commercial deployments of such models (seven models from three providers, through six routes) the same request repeatedly, with the deterministic sampling settings each accepted; every deployment returned differing assessments for at least one request, and in twelve the label changed. Reducing reasoning where the interface allows it did not reduce the variation, and prompts of retrieved passages removed it only for the smallest models. The same open-weight model was reproducible or not depending only on how it was served. A pipeline we built to be deterministic at every stage -- text extraction and optical character recognition (OCR), chunking, embedding, indexing, retrieval and inference -- returned byte-identical output at each stage across reruns, interruptions, edits, machines of one graphics processing unit (GPU) model and days, for blood glucose meter and infusion pump documents. OCR, embedding and approximate retrieval varied when their own serving was not made invariant, and outputs changed with the GPU model and with the inference engine's scheduling settings, which therefore belong in the recorded configuration. End-to-end determinism is achievable and gives a testable basis for audit and change control.
97. 【2610.21290】Bias Control and Injection for Multi-Agent Aggregation
链接：https://arxiv.org/abs/2610.21290
作者：Sungjae Lee,Soheil Abbasloo,Jabin Koo,Jungseul Ok
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：large language models, raises a central, collective decision-making, large language, central question
备注：
点击查看摘要
Abstract:Multi-agent reasoning with large language models (LLMs) raises a central question for collective decision-making: when agents disagree, whose decision should be trusted? Resolving such disagreements is difficult because agents' decisions are susceptible to non-semantic biases such as majority pressure and response-style preferences, which can obscure the quality of the underlying reasoning. Our analysis shows how bias can be both mitigated and exploited: bias control improves initial answer selection, while bias injection elicits decision instability that serves as a reliability signal. Building on these findings, we introduce a test-time aggregation framework that requires neither validation data nor prior knowledge of relative model strength. The framework implements bias control by presenting one style-normalized reasoning trace per distinct answer, and bias injection by placing each aggregating agent's initially selected answer in the minority. Overall, our framework achieves higher average accuracy and better token efficiency than competing non-oracle aggregation methods across three mathematical reasoning benchmarks and four heterogeneous LLM combinations. It also improves final-answer accuracy when applied to multi-agent debate and Mixture-of-Agents, without modifying their interaction or synthesis processes.
98. 【2610.21274】meCap: A Scalable Open-Source Pipeline for Captioning Wearable Health Time-Series Data
链接：https://arxiv.org/abs/2610.21274
作者：Max Rosenblattl,Milana Gurbanova,Karl Aurel Deck,Narayan Schuetz,Thomas Kaar,Manuel Milling,Nicolas Zumarraga,Ning Wang,Kelly W. Zhang,Anders Johnson,Robert Jakob,Björn W. Schuller,Elgar Fleisch,Daniel Seung Kim,Allan Lawrie,Patrick Langer,Maxwell A. Xu,Euan Ashley,Paul Schmiedmayer
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：health domains produce, data generated continuously, domains produce multimodal, continuously across industrial, generated continuously
备注： 46 pages, 27 figures, including supplementary material. Code: [this https URL](https://github.com/SchmiedmayerLab/TimeCAP)
点击查看摘要
Abstract:Time-series data generated continuously across industrial, environmental, and especially health domains produce multimodal signals whose scale and heterogeneity make their processing and interpretation particularly challenging. Time-Series Language Models (TSLMs) promise scalable interpretation of these signals, yet remain bottlenecked by a fundamental lack of text-annotated time series pairs that are signal-grounded, reproducible, and extensible across modalities and schemas. Existing paired corpora are either closed or limited in scale and modality coverage. Annotation with large language models could scale them up, but its outputs cannot be regenerated exactly, which prevents others from re-deriving, extending, or auditing the resulting corpus. To address this, we release TimeCap, an open deterministic captioning pipeline with three reusable extractor tiers and a cross-channel synthesis layer that operates directly on the signal with no language model in the loop, extensible to new schemas by writing channel definitions alone. This positions TimeCap as a reproducible mechanism for future dataset generation rather than a one-off release. Applying TimeCap to OpenMHC, the MyHeart Counts wearable dataset, yields MHCap, the largest open caption layer for multimodal wearable time-series data. MHCap spans 19 Apple HealthKit channels and 7,005,763 captions over 908,944 person-days. To showcase the impact of the corpus, we train OpenTSLM, a time-series language model, on MHCap and benchmark on health-outcome prediction. Caption-augmented training (OpenTSLM-Cap) outperforms a label-only baseline on 29 of 32 per-user binary evaluations across 8 tasks.
99. 【2610.21270】Auditing Escalation Reliability in Healthcare LLM Agents: A Perturbation-Controlled Benchmark of Workflow-State Failures
链接：https://arxiv.org/abs/2610.21270
作者：Zihao Zheng(Washington University in St. Louis),Junyi Yao(Washington University in St. Louis),Baichuan Li(Southern Methodist University),Jiayu Long(Washington University in St. Louis)
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Trustworthy biomedical, requires reliable action, reliable action selection, evidence is missing, static inputs
备注： 7 pages, 5 figures
点击查看摘要
Abstract:Trustworthy biomedical AI requires reliable action selection when evidence is missing, stale, conflicting, or late, not only accurate answers on static inputs. We instantiate an episode-level evaluation protocol as 400 synthetic healthcare workflow episodes: 40 hand-authored semantic seeds across four task classes, two surface parameterizations, and five controlled variants, scored on ANSWER/ASK CLARIFICATION/ABSTAIN/ESCALATE under a pre-declared 5:1 missed-versus-unnecessary escalation cost. Reference actions are single-author study-policy labels, not clinician-adjudicated ground truth. Across five open-weight configurations (1.7B--9.7B), clean decision accuracy reaches 0.97, yet uncertainty-prompted models miss 32--97% of required escalations. The stronger 9.7B configuration narrows but does not remove the gap, falling from 0.97 clean accuracy to 0.78 under conflict. Verbalized confidence is inconsistent (ECE 0.10--0.54; failure AUROC 0.48--0.77), and a development-tuned confidence-only policy yields no utility gain. A transparent workflow-aware controller improves 5:1 utility for every model and reduces missed escalations to 0.12--0.24, at specificity 0.83--0.93. However, a 30-concept lexical stress test reduces each rule detector's recall from 1.00 on trigger phrases to 0.00 on unseen paraphrases, limiting the controller claim to this benchmark. Seed-clustered statistics, ablations, cross-task transfer, raw outputs, and manifests are packaged for audit. The results motivate explicit workflow-state evaluation while showing that apparently effective routing controls need their own generalization tests.
100. 【2610.21267】RACER: Trajectory-Aware Tool Retrieval for LLM Agents
链接：https://arxiv.org/abs/2610.21267
作者：Tanish Kher,Sarvesh DK,Abedelkadir Asi,Sparsha Chennarayapatna Sundaresh,Dezhi Hong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Modern agents select, entire registries incurs, registries incurs high, Modern agents, incurs high token
备注： 21 pages, 7 figures, 23 tables
点击查看摘要
Abstract:Modern agents select tools from registries, but exposing entire registries incurs high token costs and can impair selection as they grow. We present TRACER, a retrieval front-end that indexes observed tool-call sequences in a trie and ranks continuations using a learned blend of empirical and contextual priors. On a mixed retail-and-telecom $\tau^2$ environment, TRACER improves GPT-5.4's tool-selection accuracy by 4.7 points while reducing input tokens per step by 80%, exposing just 5 of 128 tools. In autonomous full-turn execution, it matches GPT-5.4's full-registry task success with 61% fewer input tokens per step. Across six environments and four models, TRACER improves tool-selection accuracy over full-registry selection in 21 of 24 model-environment pairs, with average gains of 6 to 10 points; the three exceptions trail by at most 2.2. We analyze failures in both regimes to identify directions for future work.
101. 【2610.21261】Behavioral Compositionality of Sparse Autoencoder Representations
链接：https://arxiv.org/abs/2610.21261
作者：Haotian Ma,Ziye Mei,Frederic Sala
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Sparse autoencoders, linearly decoded features, represent model activations, SAE Additivity Residuals, introduce SAE Additivity
备注： 29 pages, 9 figures. Code: [this https URL](https://github.com/OpenSAE/SAE-Behavioral-Compositionality)
点击查看摘要
Abstract:Sparse autoencoders (SAEs) represent model activations with sparse, linearly decoded features, but the downstream effects of those features need not compose additively. We introduce SAE Additivity Residuals (SAR), which measure the behavioral variation left unexplained above a chosen interaction order. Under independent feature subset sampling, population SAR is exactly the normalized energy of interactions above that order and bounds coalition ordering error for the optimal low order approximation. To distinguish compositionality associated with the SAE representation from that induced by downstream computation, we compare learned SAE coordinates with sum preserving random rotations of the same selected subspace and find lower first order residuals for the learned coordinates across all 18 model and behavior settings. The coordinates are nevertheless not fully additive: pairwise terms improve held out coalition ordering in every setting and outperform parameter matched models using randomly selected third order terms. In a combined steering experiment, pairwise modeling raises rank fidelity from 0.5874 to 0.7790 and reduces ordering error from 0.1444 to 0.0606. Together, these results show that SAE coordinates support comparatively compositional behavioral descriptions while faithful joint explanations and interventions still require interactions beyond individual feature effects. Code is available at this https URL.
102. 【2610.21256】Isolating a Language Model's Judgment with a Label-Free Subspace
链接：https://arxiv.org/abs/2610.21256
作者：Chaemin Jang,Donggyu Lee,Jeesoo Kim,Dongman Lee,Jihee Kim
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Language models, response is safe, statement follows logically, judgment, Language
备注：
点击查看摘要
Abstract:Language models are often asked to make judgments: whether a proposed answer is correct, whether one statement follows logically from another, or whether a response is safe. Yet changing the instructions that specify how the judgment should be expressed can make the final answer less reliable, even for the same input. We ask whether this reflects a change in internal judgment or a failure to express it. Comparing hidden-state vectors for the same input under different instructions, we find that their differences concentrate in a low-dimensional expression subspace. We identify this subspace without benchmark labels and remove its contribution from a linear predictor to obtain an isolated judgment. Across correctness, entailment, and safety, the isolated judgment remains reliable under instructions not used to identify the subspace, even when the model's final answer and the original predictor degrade. When the judgment question is negated, isolation raises the predictor's AUROC from 0.504 to 0.825 for entailment and from 0.480 to 0.891 for safety. We also find that judgment is readable in earlier layers, before the expression subspace begins to disrupt the predictor. Together, these results provide a way to separate judgment from expression and recover internal judgments even when the model's final answers are unreliable.
103. 【2610.21254】LLM-Based Weak Annotation for Cybersecurity Tweet Classification: A Teacher-Student Framework
链接：https://arxiv.org/abs/2610.21254
作者：Ferry Afit Kurniawan,Kazushi Okamoto,Koki Karube,Kei Harada,Atsushi Shibata
类目：Computation and Language (cs.CL)
关键词：Cyber threat intelligence, support situational awareness, Cyber threat, threat intelligence, awareness and decision-making
备注：
点击查看摘要
Abstract:Cyber threat intelligence (CTI) relies on the timely identification of emerging threats, enabling organizations and security analysts to support situational awareness and decision-making. Social media platforms such as X (formerly Twitter) have become valuable CTI sources because vulnerabilities and attack activities are often discussed there before appearing in formal reports. However, the rapid growth of cybersecurity discussions on social media has created more content than domain experts can realistically review and annotate, making labeled data a major bottleneck for developing supervised learning approaches. While large language models (LLMs) have shown promise as weak annotators in other domains, their effectiveness for cybersecurity tweet classification and downstream training of domain-specific pre-trained language models (PLMs) remains underexplored. To address this challenge, we propose a Teacher-Student weak supervision framework in which a selected LLM serves as a Teacher to generate weak labels for unlabeled cybersecurity tweets, enabling the training of cybersecurity-specific PLMs without large-scale manual annotation. Experimental results show that PLMs trained solely on LLM-generated labels consistently achieve F1 scores above 0.92, remaining within 3 percentage points of fully human-supervised models across all evaluated architectures. These findings suggest that LLM-based weak annotation offers a practical alternative for constructing cybersecurity-specific training data when expert annotation resources are limited.
104. 【2610.21246】FGSS-BO: Feedback-Guided Hypothesis Management for LLM-Based Bayesian Optimization
链接：https://arxiv.org/abs/2610.21246
作者：Hao Chen,Ziyang Ling,Ronald X. Xu,Mingzhai Sun
类目：Computation and Language (cs.CL)
关键词：guided Bayesian optimization, Large language model, guided Bayesian, Bayesian optimization, Large language
备注： 21 pages, 8 figures
点击查看摘要
Abstract:Large language model (LLM)-guided Bayesian optimization (BO) uses past observations to guide search, but proposed directions and their revision can remain implicit. We propose Feedback-Guided Search State (FGSS), a structured hypothesis-management interface connecting language-based guidance to observed evidence, executable parameter interventions, and comparative support updates. An LLM reflector proposes and revises hypotheses; a deterministic curator validates them and maintains identities and test records. The evolving state guides candidate construction and priorities. Instantiated on LLAMBO, FGSS-BO retains its surrogate and default expected improvement selection, with a bounded testing policy. On two retrospective protocol/media tasks with nearest-neighbor response oracles, it attains higher sample mean final best and search AUC than the matched LLAMBO baseline and evaluated non-LLM baselines. Prose-reflection and EI-only controls show mixed component effects. Six direct-training hyperparameter-optimization tasks show task-dependent transfer, strongest on diabetes SVM; exact-grid and reaction controls examine other settings. FGSS exposes hypotheses, their execution, and cross-round revisions for inspection while supporting search gains in selected settings.
105. 【2610.21244】System1-Arena: Which Decisions Can Be Left to System 1?
链接：https://arxiv.org/abs/2610.21244
作者：Tianyu Chen,Xinyang Liu,Ruyi An,Zhendong Wang,Mingyuan Zhou
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：make discrete decisions, make discrete, flagging phishing, phishing or escalating, OpenAI Decisions API
备注： 40 pages. Code: [this https URL](https://github.com/TianyuCodings/S1-Arena) ; leaderboard: [this https URL](https://tianyucodings.github.io/S1-Arena) ; dataset: [this https URL](https://huggingface.co/datasets/C-Tianyu/S1-Arena)
点击查看摘要
Abstract:Large language models (LLMs) often make discrete decisions, such as flagging phishing or escalating to a human. System-1 models, such as Jev and the OpenAI Decisions API, return probabilities over options in a single forward pass, while System-2 approaches generate reasoning steps. Which decisions can System-1 models handle, and which require generative reasoning? We introduce System1-Arena, a benchmark that gives all models the same decision requests and scores their probabilities. It contains 92k questions across 105 tasks from 268 public sources, in four groups: text classification and knowledge, applied decisions, evaluation and control, and agent and action. It also includes 138 closed-loop environments, from web shopping and SWE-bench coding control to robotics, games, and driving; in real-time mode, the world evolves while a model decides. We evaluate 30 models: 7 closed LLMs, 13 open LLMs read at the answer token, and 10 System-1 models. The largest System-1 models match or exceed fast closed LLMs in non-agentic accuracy, with better-calibrated probabilities at one-quarter of the latency. A reasoning LLM is the most accurate, at about 70x the cost of a fast LLM. In closed loops, large open LLMs succeed most often (up to 32.9%); small System-1 models rarely succeed.
106. 【2610.21240】Representation Redistribution in Sparse Autoencoders
链接：https://arxiv.org/abs/2610.21240
作者：Ziye Mei,Haotian Ma
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：prompt transformations designed, decompose language model, designed to preserve, preserve the underlying, underlying request
备注： 35 pages, 15 figures. Code: [this https URL](https://github.com/OpenSAE/Redistribution-Sensitivity-Score)
点击查看摘要
Abstract:Sparse autoencoders (SAEs) decompose language model activations into sparse features, but prompt transformations designed to preserve the underlying request can redistribute activity across them. A feature change observed on one transformed prompt need not recur, and even a recurring change need not affect a downstream computation. We introduce the redistribution sensitivity score (RSS), which identifies large feature responses that recur in a consistent direction, and evaluate the resulting supports on variants excluded from selection. Across 27 pretrained SAEs spanning eight language models, the tested prompt transformations produce a reproducible redistribution profile on these excluded variants. We then separate recurring representation change from signed readout contribution and decision failure. For a fixed linear readout, an exact decomposition shows how response magnitude, readout coefficients, directional alignment, and the clean margin determine downstream consequences. In two frozen safety readouts, combining RSS support erosion with the full clean margin yields recurrent failure AUROCs of 0.935 and 0.958 using median supports of 20 and 19 features, compared with 0.965 and 0.964 using full erosion. RSS therefore provides a way to identify recurring sparse representation changes and quantify their contribution to a downstream readout without equating representation change with failure. Code is available at this https URL
107. 【2610.21229】What Should We Remove? Evaluating the Reliability and Costs of RLVR Data Decontamination
链接：https://arxiv.org/abs/2610.21229
作者：Esther Xin
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Reinforcement learning, RLVR math corpora, policies remain underexamined, open RLVR math, verifiable rewards
备注： 13 pages, 4 figures, 4 tables,code and data: [this https URL](https://github.com/ethxin0011/rlvr_data_contamination)
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) math corpora are routinely screened for benchmark overlap, but the reliability and data-loss costs of cleaning policies remain underexamined. We audit sixteen open RLVR math corpora comprising 1,673,514 corpus-specific training items against six benchmarks containing 1,949 questions. We evaluate eight policies based on exact, lexical, and semantic matching using 594 independently and blindly dual-reviewed training-benchmark pairs. Calibration and held-out sets have disjoint benchmark questions and training-example families. A separate review of all 83 candidate matches for 80 sampled training items measures item-level false removal. At cosine threshold 0.80, 52 of 59 sampled removals (88%) were confirmed false removals; this is not a demonstrated population rate. No semantic threshold in our preregistered grid (0.80-0.98) meets the 90% conservative-precision target on calibration. The existing judge-adjudicated policy achieves 98.1% resolved precision and 98.2% candidate-frame recall on held-out corpora. It has zero confirmed false removals among six sampled removals, with one unresolved case; this does not establish zero risk. Within the evaluated candidate frame, this policy offers a more favorable precision-recall balance than the semantic-threshold alternatives tested. Recall does not measure contamination outside the candidate frame. We release reviewed labels, per-policy decisions, and coverage accounting to support evaluation of cleaning reliability and cost rather than overlap counts alone.
108. 【2610.21227】KBS: A Korean Benchmark Suite for Foundation Model Evaluation
链接：https://arxiv.org/abs/2610.21227
作者：Yeonkyoung So,Jongmin Kim,Sungmok Jung,Gyuseong Lee,Sangho Kim,Jongyeon Park,Joonhak Lee,Seho Pyo,Gyeongje Cho,Seorin Kim,Jisoo Kim,Suyoung Park,Hyunji M. Park,Yelim Ahn,Yeongho Seo,Jaejin Lee
类目：Computation and Language (cs.CL)
关键词：Korean Benchmark Suite, comprising Ko-ARC, covering six capabilities, Korean Benchmark, Korean
备注：
点击查看摘要
Abstract:We present a Korean Benchmark Suite (KBS) comprising Ko-ARC, Ko-GSM8K, Ko-EQ-Bench, Ko-WinoGrande, Ko-LAMBADA, and Ko-IFEval, covering six capabilities across 9,396 items. The suite combines review, localization, direct Korean construction, and redesign for Korean, avoiding a translation-only approach to benchmark adaptation. We evaluate Korean-developed models, multilingual open models, and closed API models under protocols that account for model access, prompt format, and scoring differences. Results show that Korean benchmark scores depend on task construction, scoring rules, prompting, and model post-training. These findings suggest that Korean evaluation should report both final scores and the settings used to obtain them.
109. 【2610.21204】Entertain, then Cancel: How Thinking Makes Reasoning Models Read Some and Or Literally
链接：https://arxiv.org/abs/2610.21204
作者：Zhizhuo Kou,Jian Yang,Pengfei Hao,Junyu Luo,Jingshu Peng,Sirui Han,Yike Guo
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：students passed, listeners infer, emph, models, Reasoning models
备注：
点击查看摘要
Abstract:When a speaker says ``some students passed'', listeners infer that not all of them did. Reasoning models now let users decide how long a model thinks before it answers, but we do not know what extra thinking does to such everyday inferences. We study this directly: we keep a model's weights fixed, change only how much it thinks, and record which reading it chooses. A second tool cuts the model's own reasoning at successive points and asks for an answer, showing where the reading changes. Thinking makes models read logical words as logic: it cancels the implicatures of \emph{some} (\emph{not all}) and \emph{or} (\emph{not both}) in most tested open reasoning models and in GPT-5, while context-driven inferences such as indirect answers improve. The trace shows why: models first entertain the enriched reading and cancel it later. Answering from that early reading, an exploratory inference-time remedy, recovers these implicatures without losing literal accuracy. Evaluations of reasoning models should measure how they interpret, not only how accurate they are.
110. 【2610.21203】Who May Release an Agent's Promise? Standing over Commitments in Multi-Party Chat
链接：https://arxiv.org/abs/2610.21203
作者：Lan Wei,Bingyu Shen,Jiaqi Tang,Qing Lu,Kuan Huang,Meng Xu,Miles Q. Li,Bin Hu,Boyang Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：assistant serving, serving a team, team makes, Alice, promise to Alice
备注： 21 pages, 7 figures, 13 tables. Code: [this https URL](https://anonymous.4open.science/r/standing27/)
点击查看摘要
Abstract:When an assistant serving a team makes a promise to Alice, who may cancel it? We call this standing: only the creditor (the person owed) or someone the creditor or operator policy authorizes may release a commitment, regardless of rank. In a controlled chat environment we vary who cancels and separate two errors: unauthorized release (obeying someone without standing) and override (executing a released promise). Across six models, smaller open ones override the creditor (Qwen3.5-9B: 69%); larger ones drop promises on a peer's direct word (Qwen3.8-27B: 89%; gpt-6.1-sol: 83%); nearly all act on a bystander's "go ahead after all". Oracles dissociate the errors: stating the rule or the creditor curbs unauthorized release but not override, which the latter even raises in three of four models; among them, only knowing whether the promise is still owed cuts override. Enabling thinking moves smaller models the way scale does. A self-kept commitment ledger stops override in four of five models; with a one-paragraph release policy it matches or beats the best oracle store, raising gpt-6-luna's strict accuracy from 49% (policy alone) to 83%. Code, prompts, outputs and labels are released.
111. 【2610.21184】Beyond Retrieval Failure: Understanding Why LLMs Miss Evidence in Multi-Hop RAG
链接：https://arxiv.org/abs/2610.21184
作者：Jiaqi Wei,Wenxuan Huang,Chengdong Xu,Xiang Zhang,Wanli Ouyang
类目：Computation and Language (cs.CL)
关键词：Multi-hop retrieval-augmented generation, Multi-hop retrieval-augmented, sequence of dependent, RAG, Multi-hop
备注： Accepted by DAI 2026 Oral
点击查看摘要
Abstract:Multi-hop retrieval-augmented generation (RAG) requires an agent to retrieve evidence for a sequence of dependent sub-questions. When a wrong answer lacks a required passage, the passage may be inaccessible to the retriever, or the agent may have failed to issue a query that would retrieve it. Standard retrieval evaluations conflate these two causes. We study how much apparent retrieval failure is instead caused by search drift: the search no longer tracks an unanswered sub-question. Holding the retriever, corpus, and generation model fixed, we introduce ExecutionRAG, a training-free requirement register that records open sub-questions and their supporting evidence. The register changes search guidance but not evidence access, so each gold passage it recovers certifies that the passage was reachable by the original retriever. On 1,000 MuSiQue questions, the number of wrong answers with unretrieved required evidence falls from 382 to 234 with all-MiniLM-L6-v2 and from 383 to 274 with Qwen3-Embedding-0.6B. These counts correspond to 69% to 44% and 66% to 48% of each system's wrong answers, respectively. Crucially, evidence recovery does not produce a proportional reduction in total error: premature resolutions and abstentions increase as missing-evidence failures decrease. The central finding is therefore a shift in the remaining bottleneck, from guiding search toward required evidence to verifying that the retrieved evidence is sufficient.
112. 【2610.21179】Judging the Judges: Confidence and Disagreement in Rubrics as Rewards
链接：https://arxiv.org/abs/2610.21179
作者：Michael Tian-Yue Liu,Anne Harrington,Trevor Darrell,Yutong Bai
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：extends reinforcement learning, LLM judge, extends reinforcement, reinforcement learning, learning to non-verifiable
备注： Project page: [this https URL](https://anneharrington.github.io/judging-the-judges/) Code: [this https URL](https://github.com/michael-tyl/RaRE)
点击查看摘要
Abstract:Rubrics as Rewards (RaR) extends reinforcement learning to non-verifiable domains by using an LLM judge to score responses against a structured rubric. Prior work has focused on improving the rubric or strengthening the single judge, with comparatively little attention to how different single or multiple judges might be used during RaR training. We first show that judge identity alone produces a substantial spread in scores when training Qwen3-4B-Base on RaR-Medicine and RaR-Science across five frontier and open-weight judges. Building on this, we propose RaRE (Rubrics as Rewards with Ensembles), a novel judge ensemble strategy for RaR with two mechanisms: a soft-Likert reward that uses judge logprobs to weight more confident judges more heavily, and a drop-on-disagreement mask that excludes high-disagreement rollouts from the GRPO update. We find that this design is critical: while a naive average of judge scores fails to outperform the best single judge, RaRE outperforms every single-judge RaR variant on both HealthBench and GPQA Diamond, with per-theme analysis showing that it inherits the complementary strengths of its constituent judges. Our findings establish judge ensembling as a compelling axis for improving RaR.
113. 【2610.21176】Language Models Share a Readout Bottleneck in Working Memory
链接：https://arxiv.org/abs/2610.21176
作者：Dongyu Gong
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neurons and Cognition (q-bio.NC)
关键词：Large language models, Large language, incorrect serial position, N-back task, performance declines
备注：
点击查看摘要
Abstract:Large language models (LLMs) reproduce a human working-memory signature on the N-back task: performance declines as memory load N increases, and errors concentrate on lures, items that repeat the current stimulus at a neighboring but incorrect serial position. We ask whether this shared behavioral signature reflects a shared mechanism. The literature offers two candidate accounts. On a precision account, softmax attention cannot concentrate its weight on the item N positions back, so adjacent items are retrieved instead. On an interference account, attention selects the correct item, but the content of competing items corrupts the decision. We dissociate these accounts in 15 pretrained LLMs from three families (70 million to 14 billion parameters) and in minimal transformers trained from scratch. In all three families, the attention heads that carry the task attend to the target on most missed matches. Linear probes decode near-perfectly whether a matching letter occurred at the target or at a lure position, even on trials where the model false-alarms to the lure, although its own decisions barely distinguish the two. Sharpening attention yields negligible gains, whereas suppressing the letter identity of non-target items improves sensitivity (d') in nearly all model-by-load conditions. In larger models the task is spread over more heads, and removing interference helps more. In minimal transformers, precision limits a single attention layer, but a second layer removes this constraint. The working-memory limit of LLMs therefore lies in reading items out under interference rather than in locating them, consistent with interference accounts of human working memory.
114. 【2610.21165】From Long Context to Selective Memory:A Survey of Memory-Centric Compression for Large Language Models
链接：https://arxiv.org/abs/2610.21165
作者：Chaogui Gou
类目：Computation and Language (cs.CL)
关键词：handle complex tasks, information-selection pressures incurred, large language models, complex tasks, remove the computational
备注：
点击查看摘要
Abstract:Long-context capability has become essential for large language models (LLMs) to handle complex tasks, yet continuously expanding the context window does not remove the computational, storage, and information-selection pressures incurred at inference time. Existing work on prompt compression, KV-cache management, efficient serving, retrieval augmentation, and agent memory is usually discussed in isolation, leaving the flow of information between storage and computation insufficiently understood. This survey reframes long-context compression as a memory-management problem for allocating inference-time resources. We distinguish compute-active memory, which directly participates in model computation, from compute-inactive memory, which lies outside the computation path but can be stored, retrieved, updated, or forgotten, and we characterize offloaded KV caches, persistent prefix caches, and precomputed KV states as intermediate states on the activation path. On this basis, we formulate writing, offloading, recall, retrieval-and-injection, materialization, eviction, consolidation, and forgetting as state transitions within an information lifecycle, and introduce a budgeted cost model that places these operations in a single cost account. The resulting framework unifies short-term context compression, long-term memory management, and the transitions between them, and shows that the central challenge is not merely reducing information volume but deciding which information should participate in costly inference, when, and in what form. We further summarize evaluation dimensions, benchmark gaps, and open challenges, and argue that future research should move from static, pointwise compression toward dynamic, governable, lifecycle-aware memory management.
115. 【2610.21164】Automatic Sentence Completion Using Bengali Audio Speech with a Transformer-Based Early Speech Recognition System
链接：https://arxiv.org/abs/2610.21164
作者：Md Asif Akram,Arif Faisal,Sakir Hossain Faruque,Sharun Akter Khushbu
类目：Computation and Language (cs.CL)
关键词：severely impairs communication, impairs communication abilities, Dementia severely impairs, turns everyday conversations, challenging experiences
备注： 18 pages, 10 figures
点击查看摘要
Abstract:Dementia severely impairs communication abilities and turns everyday conversations into challenging experiences. Individuals affected by dementia frequently struggle to express their thoughts or complete sentences, making it difficult for family members and caregivers to understand their needs. This study proposes a novel approach to assist dementia patients by developing an integrated system that detects signs of dementia through Bangla speech and text analysis and provides sentence auto-completion support during conversations. To achieve this, recorded voices from individuals with and without dementia were analysed, and key acoustic features were extracted to capture vocal patterns associated with cognitive decline. A transformer-based model was employed to transcribe voice signals into text for linguistic analysis. In the classification task, several Machine Learning (ML) and Deep Learning (DL) models were evaluated using both acoustic and textual representations, and the LSTM model architectures demonstrated strong capabilities for modelling contextual patterns in speech and language data. For the sentence auto-completion task, a sequential learning model based on a Bidirectional LSTM (Bi-LSTM) network with an attention mechanism was developed to sequentially complete partially expressed Bangla sentences during conversation. This research bridges the gap in dementia analysis in an underrepresented language and implements a sentence auto-completion framework for cognitive disorders.
116. 【2610.21156】Stop Training Against Soft Users: Mentalized Adversarial Self-Play for Proactive Dialogue
链接：https://arxiv.org/abs/2610.21156
作者：Zanwu Liu,Dan Zhang,Xiaodi Wang,Yongbo Mao,Xiaoyang Guo,Yonglin Wu,Peiyue Jiang,Yangyang Wei,Zecheng Lin
类目：Computation and Language (cs.CL)
关键词：guide multi-turn interactions, Proactive dialogue agents, attitudes evolve, Proactive dialogue, agents must guide
备注： Accepted to EMNLP 2026 (Main Conference). 18 pages including references and appendices; 1 figure
点击查看摘要
Abstract:Proactive dialogue agents must guide multi-turn interactions toward task goals while adapting to users whose intentions and attitudes evolve. Existing planners improve system side action selection through search, learned policies, or user aware planning, but are often trained and evaluated against fixed or overly compliant simulators; as a result, high simulated success can reflect soft user bias rather than robust dialogue ability. We introduce MASP, a Mentalized Adversarial Self Play framework that treats proactive dialogue as a partially observable game between a system and a rationally resisting user. MASP represents the user's evolving mental state with a BDI based latent state, separates reward side teacher mentalization from policy side student mentalization, and alternates self play updates for the system and user policies. This turns robustness to rational resistance into a training objective rather than only an evaluation condition. Across diverse proactive dialogue benchmarks, compared with the widely used SFT and Planner-only approaches, MASP substantially improves success rate (SR) and rationality constrained success (RCSR), reduces average turns (AT), and performs better against hard users who make the task goal more difficult to achieve.
117. 【2610.21151】CARE-SD: Explainable Reasoning Architecture for Local SLM Self-Disclosure Analysis in Textual Data
链接：https://arxiv.org/abs/2610.21151
作者：Aisvarya Adeseye,Adeyemi Adeseye,Mohammad Tahir,Jouni Isoaho
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：critical security experiences, uncover critical security, interviews uncover critical, conventional technical assessments, Cybersecurity interviews uncover
备注： Accepted for the 4th International Conference on Foundation and Large Language Models (FLLM2026) - IEEE - held from 17-20 Nov., 2026 at Novotel Barcelona City, Barcelona, Spain
点击查看摘要
Abstract:Cybersecurity interviews uncover critical security experiences, behaviors, and privacy concerns often not fully captured by conventional technical assessments. Consequently, identifying genuine self-disclosures is challenging because statements are context-dependent, categories overlap, and automated interpretations may introduce unsupported claims. Locally deployed Small Language Models (SLMs) protect sensitive participant data by keeping processing within controlled environments, but their limited reasoning capabilities make simple prompting insufficient for context-aware and factually reliable analysis. This study developed CARE-SD (Context-Adaptive Reasoning and Explanation for Self-Disclosure), a novel four-module architecture integrating context-adaptive processing, hierarchical disclosure reasoning, explanation-consistency verification, and cross-batch reconciliation. We evaluated three local SLMs, including Llama 1B, Qwen 1.5B, and Llama 3B, using 82 independently annotated cybersecurity interviews across five organizational sectors. Comparisons included conventional classifiers, three prompting strategies, larger 8B--32B models, and architectural ablations. Two independent reviewers assessed disclosure labels, factual claims, and explanation correctness. CARE-SD improved the accuracy and evidence reliability of SLMs, increasing Llama 3B Macro-F1 from 0.80 to 0.88 while reducing unsupported claims by 60\%. Remarkably, the 3B model matched the 20B reference model in category Macro-F1, demonstrating the effectiveness of the architecture without requiring a larger model.
118. 【2610.21149】From Observation to Intervention: Distilling Self-Generated In-Context Demonstrations via Executable Causal Intervention
链接：https://arxiv.org/abs/2610.21149
作者：Minming Ye,Min Liu,Haoang Chi,Ciheng Wu,Naiyang Guan
类目：Computation and Language (cs.CL)
关键词：Self-generated In-Context Learning, outperforming manual prompts, Self-generated In-Context, In-Context Learning, enables LLMs
备注：
点击查看摘要
Abstract:Self-generated In-Context Learning (ICL) enables LLMs to synthesize their own few-shot demonstrations, often outperforming manual prompts. However, existing methods filter demonstrations by observation, assuming a rationale is high-quality if it leads to the correct output. We show such filtering suffers from \textit{observational equivalence}, whereby both faithful causal rationales and spurious post-hoc rationales can yield same outputs and are statistically indistinguishable from observation alone. Inspired by independent causal mechanisms, we argue that faithful rationales imply \textit{transfer invariance}, in which causal rationales should remain effective across logically similar samples. We instantiate this criterion as \textbf{E}xecutable \textbf{C}ausal \textbf{I}ntervention for \textbf{D}emonstrations \textbf{D}istillation (ECI2D), which abstracts language rationales into executable programs and applies the causal interventions ($do$-operator) on logically similar samples, retaining only those demonstrations that imply transfer invariance. Experiments on math, logical and commonsense reasoning benchmarks demonstrate that ECI2D consistently outperforms observation-based ICL while retaining far fewer demonstrations, with gains exceeding 7 points as the test distribution shifts.
119. 【2610.21143】CoSTA: Compressed Speech Token Adaptation for Efficient Spoken Dialogue Models
链接：https://arxiv.org/abs/2610.21143
作者：Yingzhuo Deng,Chong Li,Bingxin Liu,Yi Shu,Tianyu Peng,Can Xie,Siyao Song,Shuo Ren,Jiajun Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD)
关键词：Spoken Dialogue Models, long autoregressive sequences, Spoken Dialogue, Dialogue Models, typically share
备注： 31 pages, 11 figures. Code: [this https URL](https://github.com/yingzhuodeng/CoSTA)
点击查看摘要
Abstract:Spoken Dialogue Models (SDMs) typically share a speech-token space for generation and synthesis, leading to long autoregressive sequences and costly inference. Lower-rate speech tokenizers shorten sequences but may introduce compression-quality trade-offs and costly replacement without breaking this coupling. To address this limitation, we propose CoSTA, a compatibility-preserving post-hoc framework that decouples generation and synthesis token spaces while retaining the original speech tokenizer and decoder. CoSTA extends the generation token space with compressed representations via mean-initialized vocabulary extension, pronunciation adaptation, and dialogue adaptation, followed by deterministic expansion back to the original speech-token space before synthesis. On bilingual speech-dialogue benchmarks, CoSTA achieves approximately $1.7\times$ expanded speech-token generation speed, lower full-response latency, and higher throughput while preserving response quality. Analyses show more sustained interaction under limited budgets and a practical trade-off among compression, decoding efficiency, and quality. Further experiments demonstrate cross-architecture transfer and complementarity to low-rate tokenization.
120. 【2610.21128】When Judges Agree and Are Wrong: Consistency-Accuracy Dissociation as a Blind Spot for Label-Free Evaluation
链接：https://arxiv.org/abs/2610.21128
作者：Xiang Zhang,Lovedeep Gondara,Jekaterina Novikova
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Label-free evaluation methods, agreement-based reliability scoring, majority-vote aggregation, self-consistency filtering, reliability scoring
备注：
点击查看摘要
Abstract:Label-free evaluation methods, such as self-consistency filtering, majority-vote aggregation, and agreement-based reliability scoring, rely on an implicit assumption that consistency can serve as a proxy for correctness when ground-truth labels are unavailable or expensive to obtain. In this paper, we test this assumption directly. Using four financial QA datasets (multiple-choice and free-form), ten consistency dimensions, and two frontier model families, we measure the joint distribution of consistency and accuracy at the level of individual examples rather than in aggregate. We find that 60% of all incorrect answers fall in the high-consistency region (consistency $\geq$ 0.8), and that 77.7% of these show complete answer collapse, i.e. identical wrong answers across all perturbation variants. This high-consistency/incorrect quadrant cannot be detected by any evaluation signal that is built on agreement alone, as the model appears maximally reliable while being wrong. We show that the phenomenon is robust to the choice of consistency threshold t (it persists from t=0.50 to t=1.00), is shared across model families, and is concentrated in specific intersections of perturbation dimension and domain. We map where this quadrant occurs, analyze its stability properties, and discuss the implications for evaluation pipelines that use agreement-based signals in place of human labels.
121. 【2610.21126】Compression Does Not End at Selection: Post-Selection Positional Geometry for Sparse KV Caches
链接：https://arxiv.org/abs/2610.21126
作者：Wanyang Hong,Zhaoning Zhang
类目：Computation and Language (cs.CL)
关键词：compression reduces long-context, reduces long-context inference, long-context inference costs, Rotary Position Embedding, selected historical states
备注：
点击查看摘要
Abstract:Sparse KV compression reduces long-context inference costs by retaining selected historical states, yet these states typically keep their coordinates from the full history. Under Rotary Position Embedding (RoPE), gaps left by evicted tokens continue to affect query-key matching, potentially limiting the use of retained evidence. We study post-selection positional geometry on a fixed selector-produced cache, examining how positional organization affects the use of retained information and which coordinate and continuation rules improve answer quality. To reorganize this geometry, we propose RoPERelay, which assigns compact, order-preserving RoPE coordinates, relocates cached key phases through inverse rotation and re-rotation, and synchronizes the current query and subsequent generation. It reuses existing K/V without renewed selection, historical re-prefill, or additional cache budget. Across 36 comparisons spanning two models, six sparse selectors, and three long-term memory tasks, RoPERelay improves answer quality in 32 cases. For Llama-3.1-8B-Instruct with BM25 on LongMemEval-S, accuracy increases from 23.6% to 35.4%. Measured complete-request time overhead is approximately 1%-3% in the evaluated configurations. These findings establish positional organization as a distinct optimization dimension for sparse KV caches after content selection.
122. 【2610.21109】Kolab: Benchmarking Human-Agent Collaboration in Long-Horizon Workflows
链接：https://arxiv.org/abs/2610.21109
作者：Shirley Anugrah Hayati,Patricia Anugrah Setiani,Ruizi Wang,Zhouyi Li,Khanh Chi Le,Young-Jun Lee,Dongyeop Kang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词：collaboration, humans collaborate, long-horizon tasks, agents, long-horizon
备注：
点击查看摘要
Abstract:When humans collaborate with AI agents on long-horizon tasks, what happens to the agents' contributions? For solving long-horizon tasks, humans place greater importance on ongoing interaction with AI agents (e.g., revising plans) than on an agent's ability to complete the task in a single attempt. However, most agentic benchmarks have focused more on automation. Strong performance on such benchmarks does not imply effective real-world collaboration. Professional workflows offer a useful setting, as they often involve interdependent steps. To address this gap, we introduce Kolab, a new dataset of 115+ hours of screen recordings of 50 professionals from 40 occupations collaborating with agents on realistic, long-horizon problems. Kolab also contains participants' collaboration and output quality judgments. Our analysis reveals diverse collaboration patterns, highlighting the importance of when and how professionals coordinate with agents. A collaborative agent must do two things that automation benchmarks never test: anticipate whether experts will adopt, modify, or reject its contribution once it leaves the chat window to guide its next steps, and assess collaboration quality from the unfolding workflow without constant expert feedback. Our benchmark operationalizes both: (1) forecasting how professionals use agent contributions at diverse workflows, and (2) verifying their judgments of collaboration satisfaction and output quality. Findings show that frontier models, both agentic and non-agentic, overestimate collaboration with experts and struggle to distinguish between high- and low-quality collaboration. Longer workflow context does not consistently improve these predictions. As frontier agents cannot yet understand long-horizon collaboration with experts, we position Kolab as a valuable dataset for studying human-agent collaboration grounded in real professional workflows.
123. 【2610.21108】Planning Commitment of LLM under Partial Observability
链接：https://arxiv.org/abs/2610.21108
作者：Cassie Huang,Zhanwei Cao,Yeawon Lee,Nathalia Gomez,Zhuoyi Yang,Ian G. Harris,Tiffany Do,Jiayuan Mao,Li Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM-based planning agents, planning agents commit, LLM-based planning, planning agents, lengths before interacting
备注：
点击查看摘要
Abstract:LLM-based planning agents commit to plans of different lengths before interacting with a partially observable environment. Some aggressively commit to a long plan based on assumptions about unobserved states, while others conservatively plan only over what they have observed. Both behaviors emerge implicitly in pre-trained models, whether the LLM outputs a plan directly or generates a PDDL formulation for a classical solver. Aggressive commitment risks costly failures, while conservative commitment risks excessive LLM calls. This choice pits safety against efficiency, a trade-off that has been neither characterized systematically nor made controllable. We investigate aggressive and conservative LLM planners and formalizers on two partially observable domains, where priors are provided as either explicit statistics or common-sense knowledge. Across three LLMs, both strategies reach similar accuracy. Conservative methods achieve fewer failed attempts (safety) at the cost of more API calls (efficiency). Aggressive methods fail more often but replan efficiently only when priors are informative. Interestingly, analysis shows that LLMs treat the provided priors nearly as facts, which risks failure when priors are unreliable. We also explore hybrid strategies with tunable hyperparameters that adjust the balance between safety and efficiency.
124. 【2610.21098】oolBottleneckBench: Measuring Tool-Agent Performance under Controlled Pressures and Fixed Harness Budgets
链接：https://arxiv.org/abs/2610.21098
作者：Zichuan Xu,Yuyang Dong,Makoto Onizuka,Chuan Xiao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Software Engineering (cs.SE)
关键词：tool agent reflects, fixed harness budgets, success score, agent reflects, harness budgets
备注： 26 pages, 12 figures, 15 tables
点击查看摘要
Abstract:The success score of a tool agent reflects both its model and the budgets of the harness that runs it. We present ToolBottleneckBench, a benchmark that measures tool-agent performance under controlled pressures and fixed harness budgets. Synthetic enterprise tasks stay fixed while one pressure varies: the registered tool catalog, the visible tool menu, the certified workflow, or the encoding of returned records. An exact grader records the first unmet obligation of each failed episode and the harness limit, if any, that ended it. Across 21 model and harness configurations, the visible menu is the only one of the three pressures that act on the model with a large penalty, and this penalty tracks truncation at the completion cap. Raising the cap sixteenfold removes most of the penalty in the truncation-heavy configurations. Most failures end at a harness limit, and the failure record identifies the assigned pressure no more reliably than a count of tool calls. The repairs that help change which tools reach the model or who issues the calls, and only two repairs, neither improving model behavior, beat every configuration switch. We recommend reporting pressure effects with the harness budgets under which they were measured. We release the benchmark at this https URL.
125. 【2610.21091】MemComposer: Learning to Assemble Memories for LLM Agents via Reinforcement Learning
链接：https://arxiv.org/abs/2610.21091
作者：Yixuan Xie,Xueqiang Xu,Xinyi Fan,Xinxi Lyu,Tao Feng,Xing Fan,Chenlei Guo,Jie Hao,Shaowen Wang,Jiashuo Sun,Jiawei Han
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：enables large language, reuse past experiences, memory enables large, large language model, updating their parameters
备注： 30 pages, 8 figures, 14 tables
点击查看摘要
Abstract:Agent memory enables large language model (LLM) agents to reuse past experiences without updating their parameters. However, semantic similarity alone does not guarantee memory usefulness: downstream performance depends on how memories are selected and presented to the agent. We propose MemComposer, a memory composer that jointly examines the current query and retrieved candidates to decide which experiences to include, how many to select, and how to order them. We train the composer using Experience Policy Optimization (ExPO), a GRPO-based framework that evaluates assembled memory contexts through complete agent interactions and uses task-success feedback to optimize the assembly policy. Across three $\tau^2$-bench domains with two frozen executors, MemComposer outperforms the strongest baseline for each executor while reducing average memory-token usage by 16.9% and 4.9%, respectively. The learned policy also transfers to unseen domains, executors, and memory banks, and benefits from memories generated by stronger models without further training. These results demonstrate the value of learning query-specific memory assembly using downstream task feedback.
126. 【2610.21085】A Jury, Not an Electorate: Label-Free Reliability Estimation for Ensembles of Language Models
链接：https://arxiv.org/abs/2610.21085
作者：Alessandro Rozza,Davide Mambelli,Steven Motta,Juri Taresch
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：unknown reliability, language models, jury, Expectation Maximisation, experts
备注： 35 pages, 4 figures, 13 tables, including appendices
点击查看摘要
Abstract:An ensemble of language models is a jury, not an electorate. The answers are testimony from witnesses of unknown reliability, and the question is not what the majority said but who is credible. Most ensemble methods assign each expert a fixed reputation, often learned from labels. We ask whether it can instead be inferred from the pattern of agreement and disagreement among the experts. We model the experts as a jury: each question has a latent true answer, each expert reports it with unknown reliability, and those reliabilities are estimated by Expectation Maximisation (EM) from unlabelled answer configurations alone. We show that its decision rule reduces to a log-odds weighted linear score over the experts' answer distributions. What changes is not how the jury votes, but how it learns whom to trust. On a 1560-question benchmark, the jury, with nine experts of up to 3B parameters, performs comparably to the same fusion rule with label-fitted weights, showing no statistically significant advantage from supervision. Instead, it outperforms the best single model with matched self-consistency and the strongest label-free alternative on the full benchmark.
127. 【2610.21062】Multimodal AI Detection for Math-Heavy Scientific Text
链接：https://arxiv.org/abs/2610.21062
作者：Yixuan Huang,Danish Pruthi,Bhuwan Dhingra
类目：Computation and Language (cs.CL)
关键词：large language models, capable of generating, large language, increasingly capable, greater transparency
备注：
点击查看摘要
Abstract:As large language models become increasingly capable of generating, and assisting with, scientific writing, there is a need for greater transparency and disclosure around the use of AI in research. Consequently, a veritable subfield of research and a number of commercial services aim to flag AI-generated content automatically. However, existing detectors which rely only on text extracted from PDFs fail to benefit from the rich visual information contained in the formatting of math-heavy scientific content. To study this, we select human-written proof and prose passages from pre-2022 arXiv LaTeX sources and re-generate them using 15 modern LLMs within the context of the same paper. This leaves us with coupled human and AI outputs in three different representations: the LaTeX source, a rendered image of the PDF, and the text extracted from the PDF. We find that the accuracy of the state-of-the-art Pangram 4 drops significantly as the mathematical content in a passage increases, especially when evaluated on text as opposed to LaTeX. However, this is not an inherent limitation of detecting AI-generated math: finetuning Qwen-3.5-27B based detectors on this domain recovers the gap, with LaTeX inputs performing significantly better than text since they preserve more formatting information. Since LaTeX sources are rarely available in practice, we also train SnapJudge: an image-based detector operating on screenshots of both prose and proofs from papers. At 0.1% false positive rate, SnapJudge achieves a detection rate of 92% on proofs and 93% on prose generated by frontier models, substantially outperforming both Pangram 4 and our text-based detector. We release our data, models and code at this https URL.
128. 【2610.21055】Athanor: An Agent-Native System for Autonomous Post-Training Research
链接：https://arxiv.org/abs/2610.21055
作者：Yufa Zhou,Yichen Wang,Jiakun Fan,Ziqi Shu,Zhichao Liu,Anru R. Zhang,Neiwen Ling,Zijun Wei
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：Recursive self-improvement, systems build stronger, route to superintelligence, promising route, agents
备注：
点击查看摘要
Abstract:Recursive self-improvement, in which AI systems build stronger AI systems, is one promising route to superintelligence. We study a weaker form that can be measured today: frontier agents post-training a small raw base model with public data, as a test of their research potential. We build Athanor, an open agent-native system for autonomous post-training research (AutoPostTrain) on real GPUs. We give the agents full research autonomy, low-friction engineering tools, and efficient starter code. The agents carry out the research themselves: they read datasets and evaluation results, build their training data, write and modify training algorithms, tune hyperparameters, and analyze the results to decide what to try next. They work in a sandbox and cannot use external teacher models. Athanor's services supply frozen evaluation, managed jobs, decontaminated data, a persistent research record, and a held-out suite the agents are unaware of. In a 104-hour campaign, a team of four Claude Opus 5.5 agents, each on an eight-GPU node and given no research advice, improves Qwen3-4B-Base from 15.9 to 67.3 on a six-task development suite and from 9.2 to 48.2 on a held-out suite, against 66.5 and 47.9 for the official Qwen3-4B-Instruct-2507. To our knowledge, this is the first demonstration that a team of frontier agents can autonomously post-train a raw base model into a cross-domain generalist model that matches or surpasses the official instruct version on average. The campaign's full record shows that the agents reach this level by recombining known methods and each other's models: SFT on public reasoning data, RL with a rollout change one agent introduced, weight merges across agents, and rounds of self-distillation. With execution handled, today's agents already have the engineering and research ability to conquer this task. We hope Athanor provides a foundation for scaling autonomous AI research.
129. 【2610.21048】SHIP: Structured and Hierarchical Insight with Privacy
链接：https://arxiv.org/abs/2610.21048
作者：Kai Chen,Guisi Ni,Albert Cheu,Kassem Fawaz,Yuzheng Hu,Ryan McKenna,Peter Kairouz
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：protecting user privacy, Extracting insights, increasingly important, textual data, data while protecting
备注： This paper mainly work on extracting and evaluating insights from textual data
点击查看摘要
Abstract:Extracting insights from textual data while protecting user privacy is increasingly important. Existing methods produce private insights in diverse forms for different analytical purposes, making their utility difficult to assess and compare. In this work, we formulate differentially private (DP) insights as reusable representations for answering analytical queries, providing a common basis for utility assessment. Answering these queries, however, requires fine-grained details and cross-attribute statistics that existing representations may omit. To capture this information, we introduce Structured and Hierarchical Insight with Privacy (SHIP), which automatically maps queries to attributes, builds a hierarchical hybrid taxonomy, and releases a DP synthetic table for further analysis. We also develop an evaluation protocol based primarily on QA performance and structured fidelity. Our experiments demonstrate SHIP's strong performance on both measures relative to existing private insight baselines, while identifying queries that remain challenging for structured representations.
130. 【2610.21046】PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews
链接：https://arxiv.org/abs/2610.21046
作者：Dingjie Song,Zhiling Yan,Ziqian Zhang,Yuxuan Zhang,Lichao Sun
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Peer review, growth of submissions, review comments written, written by humans, Peer
备注： 29 pages, 19 figures, 23 tables. Code: [this https URL](https://github.com/OpenLAIR/PremiseCheck)
点击查看摘要
Abstract:Peer review is under strain from the growth of submissions, and review comments written by humans or AI can misstate what a paper says. We introduce ReviewFact, a benchmark that labels such factual errors in review comments under one definition across NLP, machine learning, and the natural sciences, and that measures cost and latency alongside accuracy. A frontier LLM checks comments well but must read the whole paper for each check, while cheap decision models, which score whether a statement holds in a text, fall far short on whole comments that mix several implicit assertions. PremiseCheck is a framework that combines the two. An LLM rewrites each comment as explicit premises without reading the paper, and a decision model checks each premise against the paper. When each comment is checked on its own, PremiseCheck reaches accuracy comparable to GPT-5.5 across all three fields at about half its cost, and on NLP reviews at a quarter of its cost and less than half its latency.
131. 【2610.21042】ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews
链接：https://arxiv.org/abs/2610.21042
作者：Zhaoqian Xue,Shaoze Zhou,Xuexin Li,Junting Mu,Haozheng Liu,Zhongyin Wang,Yichun He,Renkai Ma,Hao Zhou,Sarah Bratt,Siyuan Ma,Chen Chen,Lingyao Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Systematic literature reviews, screening scholarly works, Systematic literature, literature reviews follow, follow the PRISMA
备注：
点击查看摘要
Abstract:Systematic literature reviews follow the PRISMA process of screening scholarly works and extracting evidence from included studies. Deep research tools based on large language models (LLMs) can search and summarize the literature but do not record which studies are excluded or where extracted values come from. We develop a conversational multi-agent system called ReviewPilot that automates the PRISMA workflow from paper screening to information extraction. Researchers can tailor criteria and schemas through dialogue, and a project memory keeps their configurations and revisions. Each screening decision comes with its reason and each extracted value with its source. On epidemiological expert reviews, ReviewPilot outperforms a single-prompt LLM and AgentSLR across three LLMs, with screening macro F1 up to 0.776 and extraction F1 up to 0.788. Case studies in biomedicine and human-computer interaction show close agreement with human annotators, suggesting that ReviewPilot can transfer beyond epidemiology. Code is available at this https URL.
132. 【2610.21038】INCONVENIENT: A Benchmark to Assess LLM Generalization Capabilities from Convenience Samples
链接：https://arxiv.org/abs/2610.21038
作者：Sara Rezaeimanesh,Chad Klochko,Kundan Thind,Mohammad Ghassemi
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Machine learning models, prediction typically assume, Machine learning, tabular prediction typically, prediction typically
备注：
点击查看摘要
Abstract:Machine learning models for tabular prediction typically assume that training data are representative of the population on which they will be deployed. In practice, however, data are often collected based on convenience, availability, or cost, resulting in systematic sampling biases that can distort feature--target relationships and undermine real-world generalization. Existing tabular distribution-shift benchmarks primarily construct out-of-distribution (OOD) settings by partitioning observations across naturally occurring domains. While such partitions may induce changes in P(Y | X), the resulting shifts are neither explicitly controlled nor isolated, and the evaluation distributions themselves are often not representative of the broader target population. We introduce INCONVENIENT, a benchmark designed to study robustness to convenience-sample bias. Rather than relying on naturally occurring domain partitions, INCONVENIENT directly perturbs feature--target relationships in the training distribution while preserving the original population distribution as the deployment environment. This setting more closely reflects real-world scenarios in which models are developed from unrepresentative samples and subsequently deployed on a broader population. The distinction is particularly relevant for large language models (LLMs), whose pretraining may encode population-level knowledge that extends beyond the relationships observed in a biased training dataset. Unlike existing distribution-shift benchmarks, INCONVENIENT provides explicit control over both the direction and severity of relationship shifts, enabling a systematic assessment of robustness to convenience sampling. The benchmark comprises 200 tabular classification and regression datasets spanning diverse application domains and generates around 15,500 shifted training distributions which lead to substantial downstream degradation.
133. 【2610.21030】Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval
链接：https://arxiv.org/abs/2610.21030
作者：Yingtao Luo,Kangyi Zhao,Shiyi Du,Yubo Li
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：refining semantic constraints, progressively refining semantic, semantic constraints, Reasoning-conditioned embeddings, progressively refining
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:Reasoning-conditioned embeddings can improve retrieval by progressively refining semantic constraints. However, additional reasoning may introduce over-generalized or semantically noisy abstractions that weaken retrieval specificity. Existing methods largely supervise reasoning through final retrieval outcomes, providing limited guidance over the refinement process itself. We propose AURA, a framework that directly supervises intermediate reasoning states according to how well they separate relevant documents from hard distractors. AURA further trains a lightweight utility estimator over prefix-conditioned embeddings to adapt reasoning depth at inference time. On the reasoning-intensive BRIGHT benchmark, AURA-4B achieves 34.7 average nDCG@10 while using 2.8 reasoning steps and 96 generated tokens per query. Under matched deployment conditions, adaptive stopping reduces latency from 4.6 to 0.76 seconds relative to full-trajectory reasoning. Results on MS MARCO further suggest that this specialization need not substantially degrade conventional in-domain retrieval.
134. 【2610.21025】Learning to Read Out: Unembedding Dynamics in Language Model Pretraining
链接：https://arxiv.org/abs/2610.21025
作者：Matteo He,William F. Shen,Alex Iacob,Andrej Jovanovic,Xinchi Qiu,Nicholas D. Lane
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：language model acquire, readout, acquire a capability, model, language model
备注： NeurIPS 2026. 10 pages main text, 51 pages total. Code: [this https URL](https://github.com/hematteo/learning-to-read-out)
点击查看摘要
Abstract:When does a language model acquire a capability? Developmental studies usually answer this by tracking when models start producing the correct token. But that prediction passes through the unembedding matrix, or readout, which is itself still being learned during pretraining. We show that a model's hidden states can encode task information before its own readout expresses it, so timelines read from outputs conflate what the model encodes with what its readout expresses. To track the readout directly, we introduce parameter-trajectory crosscoding, which fits one sparse dictionary to every token's readout row at every checkpoint. Unlike crosscoders on activations, it needs only checkpoint weights. We use it to locate a narrow early window, 0.4-1.1% of the way through Pythia's pretraining, in which the readout reorganizes and WordNet word categories become decodable from its rows. By then, linear probes on the hidden states already decode task information that the model's own outputs do not yet show. To test whether such gaps depend on how fast the readout learns, we pretrain small models from scratch that differ only in the readout's learning rate. We find that raising it makes the readout develop earlier and the gap close sooner, with little effect on final loss. Together, these results imply that early in training, where many developmental transitions are dated, a behavioral date can reflect when the readout learns to express task information and not when the model learns it.
135. 【2610.21006】Can LLMs Anticipate Their Cruxes?
链接：https://arxiv.org/abs/2610.21006
作者：David Reber,James Reber,Ari Holtzman,Victor Veitch
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：language model outputs, language model, model, language model decision, language
备注：
点击查看摘要
Abstract:To use language models to help us make decisions we would like to understand the rationale behind the language model's outputs. In principle, the language model provides its rationale as part of its text output. However, the sheer volume of text makes this hard to use in practice. In this paper, we are interested in extracting the cruxes that lead a model to recommend one action over another. We take a crux to be a sub-question that a model's rollouts disagree on, where changing its value may have altered the conclusion. A crux is therefore a property of the distribution of a model's rollouts, not of any one rollout. We consider three strategies of increasing computational cost. First, we just ask a model to identify, a priori, what the cruxes of a decision will be. Second, we have the model actually go through the process of generating a response and then extract the cruxes that arose in its reasoning. Finally, we generate many responses and extract the cruxes by comparing the reasoning across the rollouts. We make this last procedure computationally tractable with cheap calls to a reranker, an estimated 86 times less compute than a judge. We then conduct an extensive empirical evaluation to assess whether the computationally inexpensive options are sufficient. They are not. Across domains and models, we find that a model's a priori assessment of the cruxes has little relation to the factors that are actually identified as important a posteriori. Using a single rollout helps, but is still inadequate for identifying the full set of cruxes. Accordingly, for high-stakes decisions (and to understand the space of language model decision making) the many rollout procedure is unavoidable.
136. 【2610.20993】One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation
链接：https://arxiv.org/abs/2610.20993
作者：Hyunjong Ok,Minjae Park,Jaeho Lee
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Reordering multiple-choice options, Reordering multiple-choice, flip rate, positional skew, model answer
备注： preprint
点击查看摘要
Abstract:Reordering multiple-choice options can change a model's answer, an effect studied as selection bias (a preference for certain option letters) and as order sensitivity (changes in answers across option orderings). We connect these perspectives through the pooled selection-rate standard deviation (pooled SD), which measures how unevenly option letters are selected across questions and orderings. When every option of each question appears equally often at each position, the pooled SD is exactly the product of two label-free factors: the flip rate and the positional skew. The flip rate is the fraction of questions whose chosen option changes across orderings; the positional skew is the standard deviation of option-letter selection rates among those questions. Across 41 checkpoints and 12 benchmarks, the flip rate tracks accuracy and output uncertainty, while the positional skew tracks the estimated option-symbol prior. Prior correction for selection bias mainly reduces the positional skew. Aggregating each ordering with its reversal, a mitigation for order sensitivity, mainly reduces the flip rate. Both reduce the range of accuracy across correct-answer letters by similar amounts, but aggregation leaves fewer model-rank reversals. Applying prior correction before aggregation reduces both factors and further narrows this accuracy range. However, aggregation lowers the flip rate partly by settling questions on the same wrong option. We therefore recommend reporting both factors to distinguish mitigation effects, alongside accuracy to distinguish stability from correctness.
137. 【2610.20964】VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents
链接：https://arxiv.org/abs/2610.20964
作者：Zhivar Sourati,Marianne Menglin Liu,Rongguang Wang,Zheng Wang,Yazhe Hu,Lan Guo,Yuying Wang,Mengqing Guo,Bhavesh Dnyaneshwar Gore,Shubham Pathak,Ramapriya Ranganath,Sandeep Sharma,Tao Sheng,Sujith Ravi,Dan Roth
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：benchmarks rarely combine, rarely combine large-scale, Existing long-document, combine large-scale human-authored, detailed visual evidence
备注：
点击查看摘要
Abstract:Existing long-document QA benchmarks rarely combine large-scale human-authored questions with detailed visual evidence annotations, limiting diagnosis of evidence localization and interpretation failures. We present VELD-QA, a large-scale benchmark for Visual Evidence grounding and question answering in Long Documents. It contains 15,000 fully human-authored question-answer pairs across 5,859 real-world PDFs totaling 372,445 pages, balancing chart, table, and complex-layout tasks. Human annotations identify supporting pages and evidence elements and describe cited visual content, enabling separate retrieval and interpretation evaluation. We evaluate nine vision-language models under four evidence settings and seven retrieval-augmented and agentic systems. Our analysis identifies bottlenecks in evidence localization and interpretation. Retrieval-based methods substantially underperform the oracle setting with ground-truth supporting pages; full-document access does not close the gap. Localization alone is insufficient: oracle accuracy peaks at 81.7%, highlighting persistent visual interpretation and reasoning challenges. Enriching inputs with our visual-element annotations narrows the performance gap by 17-24%, demonstrating value beyond evaluation and motivating data enrichment for multimodal document QA. Our code is available at this https URL.
138. 【2610.20959】Same Context, Different Agents: A Behavioral Study of Semantic Layers, Orchestration and Compaction in Data Agents
链接：https://arxiv.org/abs/2610.20959
作者：Zhivar Sourati,Marianne Menglin Liu,Zheng Wang,Rongguang Wang,Sai Ashish Somayajula,Tao Sheng,Kyu J. Han,Sujith Ravi,Dan Roth
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Answering questions, evidence from files, questions over heterogeneous, Answering, data
备注：
点击查看摘要
Abstract:Answering questions over heterogeneous data means combining evidence from files, databases, documents and the web. Data agents automate this, but their success depends on context. Three context-engineering techniques (CETs) help by shaping it: semantic layers describe the data, orchestration splits work among agents, and compaction condenses interaction history. Existing studies validate each CET alone, leaving open how agent behavior shapes its effect. We present a comprehensive analysis of the three CETs, alone and combined, with seven large language models (LLMs) on 1,514 long-horizon tasks from five benchmarks, covering behavior, accuracy and cost. We find that data agents without CETs form three behavior groups: investigators, premature answerers that answer without inspecting data, and early stoppers that give up. Each CET delivers its known benefit, from more investigation to smaller prompts, but only the behavior group it matches turns that benefit into accuracy, such as premature answerers under orchestration. For investigators, the same CETs can hurt: the semantic layer stops them from looking, orchestration makes them overconfident, costing 5 percentage points, and compaction makes them repeat steps. Combining CETs yields smaller gains and losses than their sum. We derive guidance for choosing CETs by agent behavior, task demands and accuracy-cost trade-offs.
139. 【2610.20951】LEV: Thinking Fast and Deep with Looped Decision Models
链接：https://arxiv.org/abs/2610.20951
作者：Dingjie Song,Zhiling Yan,Yuxuan Zhang,Lichao Sun
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：single forward pass, models answer typed, answer typed questions, Decision models answer, single forward
备注： 28 pages. Code: [this https URL](https://github.com/OpenLAIR/lev)
点击查看摘要
Abstract:Decision models answer typed questions about an input with one probability per option, computed in a single forward pass without generating text. Like the fast System 1 of dual-process theory, they answer at once, but their depth is fixed at training time, so they spend the same computation on easy and hard questions. Models that reason in generated text can think longer, but they pay for every extra step in decoded tokens. We present LEV, a decision model that thinks deeper by rerunning its layers in a loop instead of generating tokens. LEV builds on a language model pretrained as a loop, reads the options after every loop step and trains all steps jointly, so one checkpoint can answer at any depth. On three looped backbones, accuracy rises with depth on the same weights, mostly on hard questions, and a 2.6B LEV goes from 63.2% at depth one to 76.2% at depth four on JevBench. On-demand depth, set per question by a small stopper with a threshold fitted on unlabelled requests, saves 15% to 24% of the computation at a cost of under one accuracy point, level with or slightly above a fixed mix of depths. On a locked test set, the 1.4B and 3B models are 5.4 to 8.8 points more accurate than dense (non-looped) models and cascades of the same latency below 50 ms.
140. 【2610.20927】Prune the Summary, Not the History: Source-Judged Compaction for Long-Horizon Agents
链接：https://arxiv.org/abs/2610.20927
作者：Guanghui Min,Chen Chen
类目：Computation and Language (cs.CL)
关键词：Long-horizon LLM agents, Long-horizon LLM, LLM agents rely, interaction history outgrows, context window
备注： Uses Jev, a non-generative decision model, as the source judge. Code: [this https URL](https://github.com/GuanghuiMin/sjc)
点击查看摘要
Abstract:Long-horizon LLM agents rely on context compaction: when the interaction history outgrows the context window, a compressor replaces it with a natural-language summary. We show that these summaries contain more than a record of what happened. Compaction prompts ask for decisions and next steps, so each summary mixes facts established by the environment with reasoning written by the compressor, and the agent cannot tell the two apart afterwards. In an analysis of a widely used structured compressor, 83% of failed runs trace back to an action that carries out a specific summary entry, most of which no environment output supports. We propose Source-Judged Compaction (SJC), a training-free post-processing step that scores each summary entry for whether it has a source in the environment outputs or the previous summary, and removes the entries that do not. It changes neither the agent nor the compressor and adds one inexpensive judge request per compaction. The judge is Jev, a non-generative decision model that answers the source question with a calibrated probability instead of text. On AppWorld and OfficeBench with two agent models, SJC improves cross-run reliability over the underlying compressor by 2.1%-8.9% without increasing the agent's token usage.
141. 【2610.20926】SkillNEO: Non-Elitist Evolutionary Optimization of Agent Skills
链接：https://arxiv.org/abs/2610.20926
作者：Enze Ma,Chunyu Miao,Yankai Chen,Jie Yang,Liancheng Fang,Kening Zheng,Hanrong Zhang,Muyao Xu,Xinle Yu,Chengze Li,Wei-Chieh Huang,Ziwei Ren,Yunhao Du,Zhixiang Shen,Xue Liu,Philip S. Yu,Zhen Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：allowing LLM agents, allowing LLM, LLM agents, expertise through experience, accumulate and refine
备注：
点击查看摘要
Abstract:Agent skills turn procedural knowledge into reusable artifacts, allowing LLM agents to accumulate and refine expertise through experience. Building on this, skill evolution iteratively improves skills using execution feedback. However, improvement may require several interdependent edits, so low-reward versions can still be worth developing. Requiring immediate reward gains can discard useful partial repairs before their benefits emerge. Non-elitist evolution allows new versions to receive further edits despite scoring below earlier ones. For agent skills, this calls for evidence of what to preserve and repair next. We introduce SkillNEO (Non-Elitist Evolutionary Optimization for Agent Skills), which separately selects a version to use and versions to keep improving. Comparing how related versions perform the same task reveals working steps to preserve and remaining failures to fix. It can also revisit and revise earlier versions using later evidence. Across 86 SkillsBench tasks in eight domains, including software engineering and office work, SkillNEO raises GPT-5.4 Mini's average reward from 49.1% to 66.4%, within GPT-5.5 and GPT-5.6 Luna's original-skill range. Mini executes tasks, proposes revisions, and edits skills; final evaluation uses the same task instances. Gains span all eight domains. The same skills improve stronger models without further editing. On the 41 tasks with modified skills, reuse improves Luna by 10.5 percentage points and places GPT-5.5 10.6 points above its published original-skill reference. Execution records show these skills can benefit stronger models even when Mini still fails some task requirements. Search histories also show lower-scoring versions leading to skills ultimately selected for use. Together, these findings show that skill evolution can turn a weaker model's partial progress into reusable procedural knowledge for improving more capable agents.
142. 【2610.20906】ask-Centric Multimodal Learning for Cognitive Impairment Detection
链接：https://arxiv.org/abs/2610.20906
作者：Sankalp Vaish,Rishank Singh,Sumukh Veeramalla,Caroline Summerour,John A. Batsis,Xiaohui Liang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Dementia affects millions, older adults worldwide, Dementia affects, early detection remains, detection remains difficult
备注： Accepted for publication at the 2026 IEEE Global Communications Conference (GLOBECOM)
点击查看摘要
Abstract:Dementia affects millions of older adults worldwide, yet early detection remains difficult outside clinical settings. Traditional models primarily rely on text or voice-based responses, capturing only a limited view of human cognition despite the inherently multimodal nature of human expression. This work proposes a contactless, multimodal screening framework that leverages video, audio, and text signals collected during structured voice-based interactions with Amazon Alexa. By incorporating these modalities, our approach captures a more holistic representation of human behavior encompassing speech patterns, vocal characteristics, facial expressions, and linguistic structure, which may enable more accurate detection of cognitive decline. Different participants completed three conversational tasks designed to probe spontaneous speech, comprehension, and recall. We pursued three objectives: (1) evaluate which of the three Alexa tasks provides the most informative cognitive signals, (2) compare the effectiveness of unimodal models, and (3) assess the benefits of multimodal fusion models. Task-level analysis shows that the video model achieves its best performance on Command-Reading, with an accuracy of 0.65 (AUC 0.69), while the audio model performs best on Question-Answering, reaching an accuracy of 0.67 (AUC 0.73). In contrast, the multimodal model demonstrates consistently stable performance across tasks, achieving an accuracy of 0.76 (AUC 0.75) on Command-Reading and 0.76 (AUC 0.73) on Question-Answering. These findings demonstrate that multimodal behavioral cues captured through naturalistic interactions can reliably distinguish MCI from healthy aging, highlighting the limitations of traditional diagnostic paradigms and supporting the shift toward multimodal, real-world cognitive assessment frameworks.
143. 【2610.20898】Wrong Votes, Right Gradients: Why Majority-Vote Rewards Track Verifiable RL
链接：https://arxiv.org/abs/2610.20898
作者：Dylan P. Wilson,Chengsong Huang,Jiaxin Huang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Reinforcement learning, majority vote, update, gold update, Reinforcement
备注：
点击查看摘要
Abstract:Reinforcement learning with self-generated labels, such as majority vote over a model's own samples, often recovers most of the gain of training with verifiable rewards. This is puzzling from the usual prompt-level view, in which majority vote only returns a model's modal answer and cannot add information about correctness. We argue that the relevant unit is the batch-level update. Because parameters are shared, a prompt's own gradient accounts for less than 1\% of the change in that prompt's output at practical batch sizes, so a wrong label matters only to the extent that label errors share a direction across prompts. We decompose the majority-vote update into shrinkage and misdirection relative to the gold update, and show that misdirection vanishes with batch size whenever errors are incoherent across prompts, however often the labels are wrong. Measuring per-response gradients on five models, we find that majority-vote errors are as incoherent as a random-reward null, that the majority-vote update agrees with the gold update as closely as two independent gold updates agree with each other, and that its noise-corrected cosine with the gold update is 1 within error. Randomly flipping up to 30\% of gold labels leaves the update direction intact, while the same fraction flipped by a shared rule destroys it, and rewards that favor a kind of response on every prompt, such as a learned reward model, fall measurably short. The equivalence holds at every checkpoint we examine but is local: gold-reward training still ends ahead on held-out majority accuracy. Error coherence, not error rate, determines when self-generated labels can stand in for verification.
144. 【2610.20877】CogDrift-4D: Hierarchical Multimodal Modeling of Temporal Behavioral Decay for MCI Detection
链接：https://arxiv.org/abs/2610.20877
作者：Sankalp Vaish,Sumukh Veeramalla,Rishank Singh,Caroline Summerour,John A. Batsis,Xiaohui Liang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：mild cognitive impairment, cognitive impairment remains, demanding scalable tools, scalable tools capable, subtle behavioral decay
备注： Accepted for publication at the 2026 IEEE International Conference on E-health Networking, Application Services (Healthcom)
点击查看摘要
Abstract:Early detection of mild cognitive impairment remains a critical bottleneck in dementia care, demanding scalable tools capable of capturing subtle behavioral decay. To capture the subtle temporal changes of cognitive decline, we introduce a behavioral dataset collected across seven unscripted multimodal interactions over an 18-month horizon. This dataset formalizes continuous, multi-session interactions into a dense 4D tensor (Batch * Session * Time * Feature) that explicitly preserves concurrent local dynamics alongside long-term changes. To effectively process these complex behavioral patterns, we propose CogDrift-4D: a novel, hierarchical 4D Transformer framework. To capture the complex trajectory of cognitive decline, CogDrift-4D implements a dual-level behavioral fatigue and drift modeling architecture. At the intra-session level, the model computes localized least-squares regression slopes to quantify the acute ``fading'' of frame-level facial action units and acoustic energy. At the inter-session level, a recursive cross-attention feedback encoder acts as a cumulative fatigue accumulator, mapping the patient's continuous behavioral drift across successive sessions. To mitigate environmental noise and track failures across sessions, a localized Quality Gate dynamically filters low-integrity features before final fusion, also an early fusion that integrates semantic insights with raw physical dynamics. Evaluated on structured verbal and linguistic interactions, our architecture successfully detects MCI with a classification accuracy of 0.733 +- 0.13 and an F1-score of 0.716 +- 0.14, outperforming advanced baselines. The framework provides a mathematically rigorous, scalable, and robust foundation for home-based, real-time dementia screening.
145. 【2610.20859】Does Morphological Correctness Matter for Tokenization? A Scrambled Control Study in Tagalog
链接：https://arxiv.org/abs/2610.20859
作者：Abdul Rehman Antall,Baidya Nath Saha
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：respects morpheme boundaries, frequency-driven segmentation destroys, morpheme boundaries preserves, boundaries preserves information, Typology-aware tokenizers
备注： 13 pages, 1 figure, 7 tables. Code and replication package: [this https URL](https://github.com/AbdulRehmanAntall/morphaustro-tok)
点击查看摘要
Abstract:Typology-aware tokenizers are motivated by the claim that segmentation which respects morpheme boundaries preserves information that frequency-driven segmentation destroys. Studies routinely establish that it helps while assuming the boundaries must be linguistically correct. We separate them. Tagalog marks voice with infixes (s-um-ulat 'wrote', s-in-ulat 'was written'), so the root is not contiguous and no sequence of BPE merges can recover it. We build MorphAustro-Tok, a tokenizer that emits the root as a contiguous unit followed by a positional infix token, and compare it against a corpus-matched BPE baseline and, at two of three fertility levels, against a scrambled-morpheme control that preserves morph count, invertibility and per-type consistency while randomising the pseudo-infix. Across 33 runs, MorphAustro-Tok improves Tagalog machine translation over matched BPE by 0.84, 1.49 and 3.40 mean sentence-level chrF++ points. Token count does not explain the gain, since it grows as segmentation coarsens, and neither does capacity: at the coarsest level the scrambled arm carries more parameters and scores lower. Scrambling the analysis moves the gain by less than between-seed dispersion at both controlled levels, so we detect no contribution from morphological correctness at this scale.
146. 【2610.20852】Probing Negation Understanding in Vision-Language Models With Object Attention
链接：https://arxiv.org/abs/2610.20852
作者：Beth Pearson,Michael Wray,Martha Lewis
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：important vision-language models, fundamental aspect, aspect of language, language understanding, important vision-language
备注： EMNLP Findings 2026
点击查看摘要
Abstract:Negation is a fundamental aspect of language understanding and it is important vision-language models (VLMs) are able to process it effectively. We investigate how VLMs process negation by analysing attention patterns of different models. We draw comparisons between human gaze and attention in models when processing affirmative vs negated statements. We compare object level model attention to human eye-fixations in both binary and multary settings, evaluating with both synthetic and realistic datasets. We find models generally do not follow human-like attention patterns when resolving negation, suggesting they rely on mechanisms outside of attention. While layerwise analysis shows that PaliGemma2-3B shifts object attention to the alternative under negation, our headwise ablations suggest this is a byproduct rather than a negation processing mechanism. Additionally, we find that LLaVA-1.5-7B displays a spatial bias towards left-side objects. Our evaluation of models on downstream tasks shows that all models have a discrepancy between affirmative and negated questions highlighting the need to better understand the underlying processing of negation to close this performance gap. Code available at this https URL
147. 【2610.20845】Evolving Together, Failing Apart: The Skill-Policy Co-evolution Trap in Self-Improving Agents
链接：https://arxiv.org/abs/2610.20845
作者：Yujie Feng,Xiaobin Wang,Jinluan Yang,Xiaonan Shi,Pengjun Xie,Philip S. Yu,Xiaoming Wu,Jieping Ye
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：agent policy model, Skill-policy co-evolution, skill bank improve, self-improving agents, promising paradigm
备注： Under Review
点击查看摘要
Abstract:Skill-policy co-evolution, in which an agent's policy model and its skill bank improve each other during training, is a promising paradigm for self-improving agents. Current evaluations score the co-evolved policy on the final bank it trained with (the delivered bank). After deployment, however, skills may be rewritten, added or removed more frequently than the policy model is retrained, leaving the policy to operate on a drifted skill bank that neither the training objective nor existing evaluation protocols address. In this paper, we first establish, through theoretical and empirical analysis, that the fragility hidden by this blind spot is not incidental. The acceptance rule these methods share (cooperative acceptance) ties a policy's competence to the bank it co-evolved with, leaving it fragile once skills drift, regardless of the implementation; empirically, sensitivity to skill drift grows as co-evolution training proceeds. We therefore introduce the CO-evolution Drift Audit (CODA), a deployment-oriented evaluation protocol that simulates skill drift and, alongside success rate under worst-case drift, introduces two new metrics: a consistency rate under meaning-preserving edits and a resistance rate to corrupted skills. Across four co-evolution methods and five benchmarks (six settings), worst-case success is 5-13 points below the peak measured for each delivered pair, erasing 52-93% of the delivered bank's gain over the no-skill baseline. CODA thus reframes the target of co-evolution, from peak performance on the co-evolved bank to the ability to harness skills however they evolve, and provides a shared standard against which future methods can be audited.
148. 【2610.20836】Confidence-Calibrated Inference Expansion for Evaluator-Guided Test-Time Reasoning
链接：https://arxiv.org/abs/2610.20836
作者：Weida Liang,Kenji Kawaguchi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：local control problem, return a fallback, trust the current, spend more inference, control problem
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Evaluator-guided reasoning presents a local control problem at every step: trust the current answer, return a fallback, or spend more inference. We formulate this choice as a compute-aware three-action controller, scoring terminal actions by predicted answer success and expansion by a rollout-based continuation-success surrogate, with compute cost priced explicitly. A local action-gap analysis characterizes when score errors can change a decision, while an expected regret bound accounts for errors along the realized expansion path. Guided by this analysis, we learn and calibrate action-specific confidence estimates, with local uncertainty penalties for ambiguous decisions. On held-out width expansion and revision tasks, the controller improves observed utility over calibration-selected fixed policies while reducing normalized online compute by about 30% and 16%, respectively. Across four Qwen3-8B seeds, compute is lower than fitted Q in both settings, while utility differences are small and mixed. The results frame evaluator-guided reasoning as resource allocation under uncertainty, rather than a uniformly stronger reasoner.
149. 【2610.20830】PEDBench: Can Speech Models Detect Phonetic Errors?
链接：https://arxiv.org/abs/2610.20830
作者：Zhonghao Shi,Zackary Rackauckas,Jasmine Yip,Savannah Halpern,Simon Campos,Lauren Brace,Emma Yang,Tiantian Feng,Xuan Shi,Shrikanth Narayanan,Teresa Satterfield,Ying Xu
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：identify phoneme-level substitutions, clinical speech assessment, Phonetic error detection, aims to identify, phoneme-level substitutions
备注： 21 pages, 10 figures
点击查看摘要
Abstract:Phonetic error detection (PED) aims to identify phoneme-level substitutions, deletions, and insertions and is essential for educational and clinical speech assessment and intervention. Despite recent advances in speech models for phoneme recognition, their ability to reliably detect fine-grained phonetic errors remains unclear because of a lack of high-quality evaluation data. To address this gap, we introduce PEDBench, the first PED benchmark spanning a continuum from natural to controlled speech. It comprises real-world recordings of spoken errors made by children (N=334), scripted error productions by human actors (N=1,188), and synthetic error productions generated using phone-conditioned text-to-speech (N=1,083). All phonetic annotations were transcribed and verified by two phonetically trained annotators. Our evaluation of 13 state-of-the-art speech models shows that they fail to reliably detect phonetic errors, even under controlled conditions with acted and synthetic speech, where acoustic variability is reduced. The models also exhibit low precision, frequently misclassifying correctly pronounced phonemes as errors. Our speech-language models, fine-tuned on synthetic data, outperform commercial and open-source baselines on word-level PED, although a sim-to-real domain gap remains. We plan to publicly release our code and recipes, along with our acted and synthetic datasets, to support the development of more accurate PED systems.
150. 【2610.20828】CoTranslator: Reverse to Forward Chain-of-Thought Translator for Reasoning Distillation
链接：https://arxiv.org/abs/2610.20828
作者：Zinan Tang,Zhuoshi Pan,Kairui Chen,Ze Yan,Shaomian Zheng,Yukun Zhang,Gang Wang,Biqing Huang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：efficiently remains challenging, data efficiently remains, remains challenging, efficiently remains, CoT
备注： 18 pages, 12 figures, under review
点击查看摘要
Abstract:Reasoning distillation requires chain-of-thought (CoT) data with correct answers, but obtaining such data efficiently remains challenging. Forward CoT generation (FCG) followed by rejection sampling (RS) produces verified, question-only responses, yet may require many teacher calls for difficult problems. Reverse CoT generation (RCG) is cheaper because it conditions on the known answer, but access to this answer can lead to post-hoc rationalization and a mismatch with the student's answer-free inference setting. We propose CoTranslator, which learns to translate reverse CoT responses toward the distribution of verified forward responses. Trained on a small set of paired reverse and rejection-sampled forward responses, it supports large-scale generation and verification of student training data. Across six student models evaluated on six mathematics benchmarks, CoTranslator improves average accuracy over semantic suppression by up to $5.82$ percentage points. For two 4B students, it retains $95.0\%$ of rejection sampling's average accuracy while using $35.9\%$ of its estimated compute. Without retraining, the same translator transfers to a new mathematics dataset, a different teacher, and STEM problems, improving average STEM accuracy by $4.88$ and $4.31$ percentage points for 4B and 8B students, respectively. These results show that CoTranslator offers an efficient and transferable approach to reasoning distillation.
151. 【2610.20824】Wolof-Adapted Industry-Ready Open-Weight Language Models
链接：https://arxiv.org/abs/2610.20824
作者：Gwénolé Lecorvé,Delphine Charlet,Pierre Adam,Floriane Behanzin,Lionel Delphin-Poulat,Johannes Heinecke,Géraldine Damnati,Pelin Kaytmaz,Nourredine Khaous,Charbel Kindji,Meriam Maadi,Abdoulaye Mbaye,Claire Perroux,Ismaël Rousseau,Papa Séga Wadé,Gilles Xiberras,Olivier Zhang,Malek Zitouni
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：remains weakly supported, API models raise, models raise cost, raise cost, local deployments
备注： 6 + 47 pages (main + appendices), 27 tables, 1 figure
点击查看摘要
Abstract:Wolof is spoken by 23M people, mostly in Senegal, but remains weakly supported by open-weight language models, while API models raise cost, governance, and sovereignty constraints for local deployments. In this paper, we present 0.6B-14B open-weight models adapted to Wolof through instruction tuning, preference alignment, and model merging. After presenting the pipeline and data, extensive experiments on 63~public and in-house tasks show good performance on Wolof understanding and generation while remaining effective on other languages and cross-lingual skills, with the 8B and 14B models being particularly competitive with substantially larger commercial systems. The models are currently being evaluated in internal customer-care pilots and are publicly available at this https URL .
152. 【2610.20814】Gibbs-Gap Policy Optimization for Off-Policy RL with Verifiable Rewards
链接：https://arxiv.org/abs/2610.20814
作者：Xuanchang Zhang,Tong Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：trains language models, Reinforcement learning, possibly stale behavior, possibly stale, learning with verifiable
备注： 51 pages. Code: [this https URL](https://github.com/thunderous77/GGPO)
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards often trains language models on responses generated by a different, possibly stale behavior policy. Correcting this mismatch with learner-to-behavior importance weights can introduce high variance for long responses. We introduce Gibbs-Gap Policy Optimization (GGPO), which minimizes a log-mean-exp contrast of KL-adjusted rewards among responses to the same prompt, without learner-to-behavior importance weights. We derive GGPO from KL-regularized policy optimization: on policy, its population loss is exactly the KL-regularized optimality gap, and under suitable coverage the learner's single-response expected reward is at least the behavior policy's best-of-$K$ reward, minus terms for the raw finite-group loss, regularization, and finite training data. We characterize reference refresh through exact Gibbs-target composition and a finite-data final-policy reward bound under local reference control and tokenwise behavior mismatch. This refresh is empirically important: in an ablation, fixed-reference GGPO scores $32.96$ on the five-benchmark problem-weighted average, versus $46.58$ with the default refresh schedule. Experiments on mathematical reasoning further show that GGPO outperforms GRPO and AGRO under training-inference mismatch and on fixed offline data, while maintaining its performance as controlled policy staleness grows.
153. 【2610.20809】A Self-Improving Agent that Grows its Own DSL: Oracle-Free Operator Induction for Exact Question Answering
链接：https://arxiv.org/abs/2610.20809
作者：Yun-Shiuan Chuang,Yirou Ge,Yixi Li,Yiming Bian,Zijie Pan,Jenna L. Ballard,Uma Kona,Linsey Pang,Prakhar Mehrotra
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：compresses its library, earns a high, high reward, self-improving agent, loop
备注：
点击查看摘要
Abstract:A self-improving agent has to decide which new skills to keep, and in practice it keeps whatever earns a high reward, convinces a judge model, or compresses its library, even when the skill is wrong. That is fine until the answers have to be exactly right: over a table of transactions, a total is either right or wrong. We ask a harder question: can an agent grow what it can compute with no reward, no judge, and no answer key, and still be exactly right? A single frozen model runs two nested loops over a small, exact domain-specific language (DSL). The inner loop answers new questions only when two independently written expressions agree on every record. The outer loop discovers its own missing capability and authors an operator for it, admitted only when an independent second implementation agrees and the result obeys a conservation law, all without ground truth. The inner loop roughly triples the answerable-question set, and the outer loop self-extends on disjoint starting sets, inventing operators outside the starting closure; a no-induction control answers none of the new questions. The admission rule is empirically sound: it rejects 138 of 138 buggy operator variants under an independent reference, even one written by a different model family, where the admit-if-it-runs, self-consistency, and compression signals the field relies on admit most of them. Unmodified, the same mechanism self-extends on two further domains with unrelated schemas, business-ledger and clinical-encounter question answering, growing their answerable sets more than tenfold and nearly twentyfold. The loop transfers across model families too: run with further proposers, the gate stays sound and independent families self-extend comparably, with only the induction yield tracking each proposer's DSL fluency.
154. 【2610.20808】PRISM: Transfer and Limits of Activation Interventions in Tool-Calling Language Models
链接：https://arxiv.org/abs/2610.20808
作者：Giovana Kerche Bonás,Thales Sales Almeida,Marcelo da Silva Reis,Rodrigo Nogueira,Marcos Meideiros Raimundo
类目：Computation and Language (cs.CL)
关键词：Recent literature shows, accompany textual refusals, Recent literature, unsafe tool calls, literature shows
备注：
点击查看摘要
Abstract:Recent literature shows that unsafe tool calls can often accompany textual refusals in language models. To investigate this hidden vulnerability, we introduce PRISM, a framework for evaluating the transfer of activation interventions across precision, languages, and scales. Our findings demonstrate that leveraging lower-resource settings (specifically quantized NF4 labels and cross-lingual transfer) offers a robust pathway to expose and improve model alignment. Notably, using behavioral labels from an NF4 copy enables stable intervention estimation even with very few scenarios. Furthermore, these alignment improvements transfer effectively across languages: five-language NF4-supervised directions successfully transfer to held-out Arabic, reducing unsafe violations in Llama-3.1-8B by 21.95 percentage points without target-language tuning. By mapping paired benign activations, we also successfully transfer these safety interventions to much larger models (up to 70B parameters). Ultimately, PRISM highlights how auxiliary supervision from compressed models and multilingual data can uncover and mitigate hazardous tool-calling behaviors across different model families. We release all experimental code and supporting artifacts at this https URL, alongside an interactive explorer of recorded model responses and experimental results at this https URL.
155. 【2610.20805】When Reasoning Traces Conflict with Evidence: How Answer Configuration Shapes Evidence Following
链接：https://arxiv.org/abs/2610.20805
作者：Shaoang Li,Yanhang Shi,Jian Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：answer time plays, time plays, separate call, separate answer call, reasoning trace retained
备注： 25 pages, 4 figures
点击查看摘要
Abstract:A reasoning trace retained at answer time plays two roles: it can raise accuracy, and it can compete with the current evidence when the two disagree. We disentangle these roles by crossing verified evidence versions with the traces generated from each and answering from the same traces and evidence under two configurations: continuation of the model's own thinking and a separate answer call. Across three model families (gpt-oss, Gemma4, Qwen3) on HotpotQA and MuSiQue, the separate call raises evidence-following over continuation by 29.9 to 60.6 points. On the same pairs, removing the trace lowers accuracy by similar amounts under both configurations. Yet continuation repeats the stale conclusion in most conflicts, and the separate call follows the current evidence far more often. Benefiting from a trace and deferring to it are therefore distinct properties. Further analyses show that the final line of a trace carries most of its value, gold evidence helps most before the trace is written, distractors weaken correction under a separate call, and renewed reasoning, unlike a verification instruction, follows the current evidence in most conflicts. Because trace deletion alone cannot reveal which source an answer follows, evaluations should report both properties together with the answer configuration.
156. 【2610.20785】APRiL: An Open-ended Benchmark for Chinese Social Awareness in Large Language Models
链接：https://arxiv.org/abs/2610.20785
作者：Tian Lan,Han Zhang,Shanshan Wang,Yahan Yu,Jiang Li,Yugo Murawaki
类目：Computation and Language (cs.CL)
关键词：require recognizing implicit, recognizing implicit cues, Large language models, responses require recognizing, inferring mental states
备注： 26 pages, 9 figures
点击查看摘要
Abstract:Large language models are increasingly used in social interactions, where appropriate responses require recognizing implicit cues, inferring mental states, identifying conflicts, and considering potential consequences. However, existing benchmarks often focus on specific social abilities, constrained task formats, or particular interaction settings, offering limited coverage of social awareness across diverse contexts. To address this gap, we introduce APRiL, an open-ended benchmark for Chinese social awareness with instance-specific rubrics. APRiL contains 2,196 Social Awareness Evaluation Instances across six categories and two complementary tasks: Social Scenario Analysis evaluates models' understanding of social cues, mental states, and conflict structures, while Socially Aware Response assesses whether they can translate this understanding into appropriate, natural responses. Experiments on 12 models from six families reveal a consistent understanding-to-response gap. Higher-quality scenario analyses improve responses, while weak analyses may reduce response quality. APRiL provides a systematic resource for advancing socially aware language models in Chinese contexts. Our data and code are available at this https URL.
157. 【2610.20780】ARIA: Runtime Inspection and Amendment for Multi-Agent Systems
链接：https://arxiv.org/abs/2610.20780
作者：Bolin Shen,Yushun Dong
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM-based multi-agent systems, turning a correctable, local mistake, mistake can propagate, correctable error
备注：
点击查看摘要
Abstract:In LLM-based multi-agent systems (MAS), a local mistake can propagate as other agents build on it, turning a correctable error into a failed task. Diagnosing completed runs or repeatedly re-executing them to search for corrections does not provide a learned policy for intervening while execution is still in progress. We present Agent Runtime Inspection and Amendment (ARIA), a framework for learning when and how to repair ongoing multi-agent executions. Our key intuition is to turn execution-verified repairs into reusable supervision, moving repair search into data construction and training so that a learned model can intervene at runtime without repeatedly testing alternatives. First, we collect over 24{,}000 successful and failed trajectories across four multi-agent frameworks, six benchmarks, and eight host models. From these trajectories, we construct the ARIA dataset, to our knowledge the first large-scale dataset pairing failed multi-agent trajectories with execution-verified repairs. It contains 3{,}953 verified repair pairs, each specifying what went wrong, where to intervene, and how execution should continue. Then, we develop the ARIA framework for MAS-agnostic runtime inspection and amendment, designed to integrate with any MAS that exposes execution trajectories and supports continuation replacement. Using verified repairs as training examples, we teach a compact model to recognize when intervention is needed and how to correct an ongoing run. The aim is to learn repair strategies that apply to related failures in new configurations, rather than merely reproduce individual corrections. Finally, the trained ARIA model demonstrates strong repair performance in both post-hoc and runtime settings, with generalization to unseen frameworks and host models. Our code is available at this https URL.
158. 【2610.20778】Verdict: Encode Once, Decide Many
链接：https://arxiv.org/abs/2610.20778
作者：Avdhesh Singh Chouhan,Jack Perry
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Automating organizational work, Automating organizational, small typed questions, organizational work, work means answering
备注： 19 pages, 2 figures, 14 tables. Code: [this https URL](https://github.com/LEC-AI/verdict)
点击查看摘要
Abstract:Automating organizational work means answering many small typed questions about one piece of state (does this email need a reply, how urgent is it, who owns it) with probabilities good enough to act on without a human. The open typed-decision model we compare against, like a standard cross-encoder, answers each question with a separate pass over the input. We present Verdict-MQ, an open encoder that reads a case once and answers all of its questions: given identical retained state tokens after truncation (verified on every reported case), a structured attention mask makes the state encoding independent of the questions, keeps questions from influencing each other, and makes option order irrelevant by construction. On the typed-decisions benchmark, a 395M Verdict-MQ matches the soft gold labels significantly better than the released 421M Laya specialist on all five fresh seeds (KL 0.080 vs 0.117, Brier 0.045 vs 0.061), an advantage that survives per-system temperature scaling; its higher accuracy (0.801 vs 0.767) lies past the benchmark's own saturation point, so we read that margin as closer agreement with the benchmark's labelling teacher. On RACE, BoolQ and MultiRC, against a matched fine-tuned baseline it wins on MultiRC and loses on RACE and on BoolQ, where its training is unstable; we measure zero-shot references ourselves, including a closed general system (Jev) that beats every fine-tuned encoder. A controlled comparison measures what the shared state costs: giving each question its own question-aware copy of the state gains 0.9-3.5 points on RACE and MultiRC at 1.4-2.5x the per-case latency, and nothing measurable on typed decisions, with the invariance guarantees unchanged.
159. 【2610.20763】Reference-Guided Turn-Taking Style Transfer for Full-Duplex Spoken Language Models
链接：https://arxiv.org/abs/2610.20763
作者：Yuxuan Chen,Yang Xiao,Jack Sun,Chak Sun,Brick Li, Sam
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD)
关键词：Full-duplex spoken language, spoken language models, language models decide, Full-duplex spoken, human speakers bracket
备注： 5 pages, 4 figures. Submitted to ICASSP 2027. Audio examples: [this https URL](https://elpsykongloo.github.io/initiative-vector/)
点击查看摘要
Abstract:Full-duplex spoken language models decide at every frame whether to take the floor, defining a conversational personality -- yet each set of weights encodes exactly one, which human speakers bracket rather than share. Existing controls mostly act from outside; none identifies the quantity that sets how much the model speaks. We identify it: a single late-layer residual-stream direction, the initiative vector, extracted from the model's own conversations without training or annotation. The same direction reads the decision, anticipating onsets up to 800 ms ahead, and shifts it: scaled during generation, it moves speech ratio from 6-12% to 42-61% (no steering: 21-30%), consistently across conversations, weights, and corpora. A short reference recording suffices to transfer a speaker's turn-taking style to the model, and the transfer is reference-specific: swapping in another speaker's reference worsens the match in 93-98% of cases, whereas the best uniform dose is indistinguishable from no steering. Turn-taking style is not frozen into the weights but a direction that can be read, shifted, and calibrated per person. Audio examples are available at this https URL.
160. 【2610.20682】urboMamba: Faster Inference, Faster Training, and Better Prediction with Lexical Memory
链接：https://arxiv.org/abs/2610.20682
作者：Hanxin Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：faster inference, Zamba version, Jamba version, Zamba, Jamba
备注：
点击查看摘要
Abstract:We introduce TurboMamba, a language-model architecture for faster inference, faster training, and better token prediction. A global Mamba-3 model runs once per completed token block. A small Transformer uses this global context and earlier tokens within the block to predict the next token. Three lightweight additions improve local predictions: direct access to the previous block's last token, a small correction to next-token scores, and a learned mixture with recent-token frequencies. We compare twelve small-scale implementations on public FineWeb-Edu, with comparable parameter counts and shared training-budget caps. The baselines include Transformer, Mamba-3, Jamba, and Zamba. The Jamba and Zamba versions use Mamba-3 in place of their original Mamba modules. TurboMamba achieves the lowest mean test prediction loss (negative log-likelihood, NLL) among all twelve models. Its mean NLL is 9.4% lower than that of Mamba-3, 7.3% lower than that of the Jamba version, and 18.3% lower than that of the Zamba version. End-to-end training throughput is 2.60x that of Mamba-3, 2.81x that of the Jamba version, and 4.82x that of the Zamba version. We measure end-to-end batch latency for a batch of 32 sequences, each with a 256-token prompt and 128 generated tokens. On this workload, TurboMamba achieves a 3.12x speedup over Mamba-3, a 3.53x speedup over the Jamba version, and a 6.21x speedup over the Zamba version.
161. 【2610.20668】CascadeLedger: Counterfactual Auditing of Information and Resource Integrity in LLM Cascades
链接：https://arxiv.org/abs/2610.20668
作者：Miaobo Hu,Shuhao Hu,Xiaobo Guo,Xin Wang,Bokun Wang,Daren Zha,Jun Xiao
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：budgeted language-model cascades, counterfactual execution-audit framework, introduce CascadeLedger, language-model cascades, execution-audit framework
备注： 38 pages, 6 figures
点击查看摘要
Abstract:We introduce CascadeLedger, a counterfactual execution-audit framework for budgeted language-model cascades. The protocol enforces call-before-read semantics, binds successful reads to service and cache identities, records availability and component-wise budget transitions, and freezes the event trace before any target or task scorer is joined. The central object is aggregate-equivalent trace validity: two executions can share a final answer, declared resource projection, and service histogram while differing in whether their routing decisions used only legitimately observable information. We complement single-trace invariants with counterfactual prefix non-interference (CPNI), which couples a visible prefix and policy randomness while changing only a declared hidden family. The counterfactual influence frontier (CIF) localizes the earliest violating prefix and a minimal hidden witness; projection-preserving adversarial mutation (PPAM) searches for invalid traces that remain acceptable to a non-counterfactual checker. Across frozen-cache, independently generated, and serving evaluations, the two-layer audit reports a clean false-positive rate of 0.0000, detects 0.9983 of serialized faults and 0.9982 of unlogged hidden-read faults, and changes 0.3403 of corrupted quality-resource conclusions after deterministic recomputation. The online recorder and offline CPNI audit have separate overhead measurements. Learned routing and semantic verification provide downstream compatibility studies under the same execution contract.
162. 【2610.20652】Does Personalization Break Trust? Open-Set Rejection Calibration Under Few-Shot On-Device Intent Adaptation
链接：https://arxiv.org/abs/2610.20652
作者：Vaibhav Prajapati,Pushp Garg
类目：Computation and Language (cs.CL)
关键词：Always-on virtual assistants, virtual assistants increasingly, assistants increasingly personalize, increasingly personalize on-device, Always-on virtual
备注：
点击查看摘要
Abstract:Always-on virtual assistants increasingly personalize on-device to new user-specific commands via few-shot fine-tuning (e.g., LoRA), but this adaptation is evaluated almost exclusively on whether it learns the new commands, not on whether the assistant can still recognize an input that matches none of its intents - the out-of-scope (OOS) rejection problem. We show that naive few-shot LoRA personalization degrades OOS-rejection AUROC (area under the ROC curve) on every one of five public intent-classification benchmarks (mean drop $0.055$--$0.258$, five seeds each), while in-scope accuracy is preserved. A scorer-invariant check shows part of this drop is an artifact of the standard confidence scorer's own miscalibration under adaptation, though a smaller, genuine effect remains under any scorer; we trace it to a measurable shrinkage of the embedding margin around known-intent regions (pooled Spearman rho=0.61$). A deployment-cheap fix is scoring rejection by Mahalanobis distance instead of softmax confidence without extra training/retraining recovers most of the lost quality on 3 of 5 datasets at no accuracy cost, beats two further OOD scoring baselines, and generalizes across shot count, LoRA rank, and a second base encoder. We report honestly where the fix falls short and release all code for reproducibility.
163. 【2610.20642】CoTS: Competitive Token Selection for Latent Reasoning in Large Language Models
链接：https://arxiv.org/abs/2610.20642
作者：Jie Yu,Yuxi Sun,Zhaoxu Li,Chunxiao Liu,Xudong Jiang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：enabling richer intermediate, Recent latent reasoning, Recent latent, richer intermediate representations, alternative reasoning paths
备注：
点击查看摘要
Abstract:Recent latent reasoning methods move beyond discrete Chain-of-Thought (CoT) by replacing sampled tokens with continuous soft embeddings or hidden states, enabling richer intermediate representations and preserving alternative reasoning paths. However, the need for latent reasoning varies across decoding steps: confident predictions favor discrete commitment, whereas ambiguous steps benefit from preserving multiple plausible alternatives. Existing approaches typically handle this variation through either global soft activation or hard switching based on uncertainty thresholds, treating latent intervention as an all-or-nothing decision rather than continuously adapting its strength. To address this limitation, we propose Competitive Token Selection (CoTS), a training-free framework that reframes latent intervention from binary mode selection into continuous allocation at the token level. CoTS uses the probability competition between the two most likely candidates to dynamically balance discrete commitment and soft exploration at each reasoning step. The second candidate represents the strongest alternative to the model's preferred continuation, so the separation between the two directly reflects the stability of the current discrete choice. When one candidate clearly dominates, CoTS keeps the representation close to the sampled discrete token to preserve a stable reasoning trajectory; as the competition strengthens, it increases the contribution of the soft representation to retain plausible alternatives. This competition-based allocation requires neither manually tuned switching thresholds nor mixing coefficients, and introduces no additional forward passes. Experiments across six reasoning benchmarks demonstrate that CoTS consistently outperforms standard CoT and state-of-the-art training-free latent reasoning methods. Our code is available at this https URL.
164. 【2610.20641】AbridgeKV: Compressing Long Reasoning into the KV Cache of Learned Pause Tokens
链接：https://arxiv.org/abs/2610.20641
作者：Jack Cai,Lijie Yang,Vasilis Kontonis,Dimitris Papailiopoulos,Shivam Garg
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：tokens grows linearly, decoding is memory-bound, generated tokens grows, compute being spent, grows linearly
备注：
点击查看摘要
Abstract:Long chain-of-thought decoding is memory-bound: the KV cache of the generated tokens grows linearly with the test-time compute being spent. Evicting cache entries does not fix this, because a model never trained on a cache with entries removed generates longer, often up to the length limit. We instead train the model to compress its own output. AbridgeKV compresses each completed block of generated text into the KV entries of a few learned pause tokens. These are extra input tokens with trained embeddings that produce no output. Once the pause tokens have encoded the block, AbridgeKV frees the block's original cache; subsequent tokens attend to the pause tokens' KV entries in its place. Three novel choices make this work: the pause tokens' KV entries take positions inside the block they replace, the cache budget is allocated across layers according to the measured value of each layer's entries, and compression operates on relatively large blocks. On 446 competition problems from AIME, HMMT, AMC, BRUMO, CMIMC and SMT with 32K-token generations, keeping a quarter of the generated cache matches an identically trained full-KV model in accuracy and output length; the strongest published evictor at a matched budget writes far longer, and the closest trained compressor, retrained on the same data, loses 10 points. Served in vLLM, the cache is 3.5x smaller per sequence and a saturated H100 finishes a problem 3.2x faster than with full KV.
165. 【2610.20639】Same Answer, New Box: How Much of RLVR's Out-of-Domain Gain Is Answer Format?
链接：https://arxiv.org/abs/2610.20639
作者：Zongye Lyu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：higher MMLU accuracy, Reinforcement learning, MMLU accuracy, higher MMLU, rewards check
备注： 36 pages (10 main), 5 figures, 28 tables
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) is credited with gains beyond the domain its rewards check, such as higher MMLU accuracy after training on mathematics. Such accuracies are usually read out of the model's text by an answer extractor. A model that learns to write its answer where the extractor looks can therefore score higher without answering better. We measure how much of the gain reported by extractors copied from public code arises this way. We generate outputs from a base model and its RL model and score them twice: with those extractors, and with one extractor of our own that reads a stated answer whether it is in the answer box \boxed{} or in the text. On four released 7B SimpleRL base-RL pairs, 82% of the out-of-domain multiple-choice gain that these extractors report disappears under ours: it is a gain in answer format, not in answers. The base models already state most of their answers in text, and RL moves them into the box, where these extractors look first. Independent LLM readers, in place of our extractor, put the figure at 77%. With a prompt that itself asks for the box, our extractor puts it at 79%. On a 32B pair trained with another recipe, almost none of the reported gain is format gain: its base model boxes its answers when asked, and its RL model rarely does when not. A reported gain is partly a property of the extractor that read it, and re-scoring stored outputs with a second extractor shows how much, without re-running RL.
166. 【2610.20635】Exploring the Design Space of Permutation Diffusion LLMs
链接：https://arxiv.org/abs/2610.20635
作者：Zhe Xu,Mingfu Liang,Kavosh Asadi,Jean-Pascal Billaud,Tianyi Chen,Yanhui Guo,Christina Huang,Baekjin Kim,Jimmy Kim,Yufei Li,Daqi Sun,Jiachen Sun,Dian Yu,Zaiwei Zhang,Kaushik Rangadurai,Frank Shyu,Sandeep Pandey,Xi Liu,Luke Simon
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：language models requires, output positions, generation with language, language models, models requires
备注：
点击查看摘要
Abstract:Permutation generation with language models requires both text-conditioned ranking and a global one-to-one assignment between candidates and output positions. We study this problem through three diffusion-LLM parameterizations: hard-assignment prediction over shuffled candidate-index sequences, soft-assignment prediction over doubly stochastic matrices, and direct ordering-score prediction followed by sorting. The three families place permutation constraints at different stages of prediction and decoding and therefore support different training objectives and sampling procedures. We evaluate these designs on recommendation reranking across three Amazon domains with candidate sets of size 10 and 20. At one function evaluation, the hard- and soft-assignment variants achieve Recall@1 comparable to a constrained masked-diffusion baseline, whereas direct ordering-score prediction guarantees valid permutations without Hungarian assignment or Sinkhorn normalization. Additional function evaluations do not consistently improve ranking quality, and their effect depends strongly on the state representation and training objective. These results show that corruption, prediction parameterization, objective, and decoder should be designed jointly for permutation diffusion with language-model denoisers.
167. 【2610.20634】Jev-as-a-Judge for RAG Claim Verification: Confidence-Gated Cascading Between a Non-Generative Verifier and a Frontier LLM
链接：https://arxiv.org/abs/2610.20634
作者：Alden Do Rosario,Kirollos Atef
类目：Computation and Language (cs.CL)
关键词：Retrieval-augmented generation, question at volume, evidence support, pay generation prices, claims
备注： 31 pages, 6 figures. Code and data: [this https URL](https://github.com/adorosario/jev-rag-claim-verification)
点击查看摘要
Abstract:Retrieval-augmented generation asks one question at volume: does this evidence support this claim? The answer is one bit, yet most pipelines obtain it from a text generator and pay generation prices for the prose wrapped around it. We compare a non-generative decision model, which returns a typed value from a declared enumeration together with a native probability and no text, against a frontier LLM configured as an engineer would deploy it for binary classification. Both answer the same 495 human-labelled claims from LLM-AggreFact, so every comparison is within-item. We report three things. First, the two systems are statistically indistinguishable on the metric this task is conventionally scored by, a paired difference of -0.56 points, Jev minus Astra, at a 187-fold cost difference. Second, that tie carries almost no information about deployment: the systems disagree on 15.2% of claims, and the cheaper one admits 23.2% of the claims annotators marked unsupported against the frontier model's 14.1%. A component whose job is to catch unsupported claims should be judged on that rate, and the conventional headline hides it. Third, because the errors differ they compose: routing the claims the cheap model is confident about and escalating the rest reaches 74.10 at USD 2.92 per thousand claims against 73.83 at USD 8.93, with the threshold chosen out of fold. But a matched random-escalation control at in-sample thresholds, spending the same budget by coin flip, does as well, so what buys the saving is the escalation share and not the probability that picks what to escalate. Measured against the cheap model it is built from, the cascade costs 61-fold more for 0.83 points, 95% CI [-3.36, 4.86], and it is the more permissive guard of the two. Equal accuracy conceals unequal errors. All predictions, prompts, pricing and code are released.
168. 【2610.20633】Context Injection and Long-Horizon Reliability: Separating Duplicate Recognition, Local Processing, and Counter Tracking
链接：https://arxiv.org/abs/2610.20633
作者：Thomas Serval
类目：Computation and Language (cs.CL)
关键词：Long-horizon failures, horizon length, failures of language, measured as end-task, end-task success
备注： 17 pages, 5 figures. Code, data and reproduction script: [this https URL](https://github.com/Baracoda-ai-labs/context-injection-long-horizon) (tag v1.0-arxiv)
点击查看摘要
Abstract:Long-horizon failures of language models are usually measured as end-task success or as a horizon length. We instead score, step by step, three components of a 400-step ledger task in which every step is easy in isolation and the model's own answers are re-injected into its context: recognising a record already seen 5 to 300 steps earlier, processing the current record locally, and writing a counter incremented at every step. On Qwen3-8B (non-thinking, 20 seeds, replicated on a second machine and backend), with every step scored component by component, two results hold. First, duplicate-recognition errors rise late in the episode -- from 0.0019 to 0.011 per step at risk across step 200 -- while the counter makes no error in 8,000 steps and local processing is descriptively stable; the rise combines long-distance recall errors and rising false alarms. Second, a block of irrelevant content inserted before each step makes the counter fail in 20 of 20 seeds on each machine, against none without it, while its effect on local processing is much smaller and not distinguishable from none. Three pre-registered follow-ups probe the counter. Its value depends on the value present in the response history: a corrupted value persists without correction in every seed, and an exact external reminder, repeated before each message, re-aligns it within one to two steps. Under the irrelevant block, no counter error was observed when an exact compact reminder of the state, supplied externally by an oracle, preceded each message (0 of 20 seeds with an error, against 15 without it), and this reminder outperformed a length-matched neutral text; whether a single reminder suffices was not conclusive, and the absence of damage to the other components was not established. An aggregate or exclusive error classification can hide the difference we report.
169. 【2610.20632】MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis
链接：https://arxiv.org/abs/2610.20632
作者：Rajdeep Pandhare,Rohit Kundaikar,Yakub Kojar,Shreyansh Tiwari
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern healthcare generates, healthcare generates increasingly, generates increasingly complex, increasingly complex medical, Modern healthcare
备注： 6 pages , 3 figures, published in ijsrem
点击查看摘要
Abstract:Modern healthcare generates increasingly complex medical reports that challenge clinical professionals in terms of time and interpretive burden. Manual review processes are slow, error-prone, and difficult to scale. This paper presents MeddeX, a Medical Report Analyzer that combines a QLoRA fine-tuned LLaMA-3 (8B) model with Retrieval-Augmented Gen eration (RAG) and a multimodal Gemini Vision layer to deliver accurate, concise, and evidence-backed summaries of medical documents. The system handles text-native PDFs, scanned image based PDFs, and direct radiological images through an intelligent hybrid extraction pipeline that includes a novel garbage-text detection mechanism for corrupted and UTF-16-encoded doc uments. Beyond single-report QA, MeddeX introduces report scoped retrieval for precise contextual grounding, an automated longitudinal report comparison engine, and a self-healing backfill pipeline that lazily processes legacy documents on demand. A FastAPI backend, Supabase vector store, and this http URL fron tend complete the end-to-end architecture. Evaluation against the base LLaMA3-Med42-8B model demonstrates consistent improvements across ROUGE-1 (+9.2%), ROUGE-2 (+10.0%), ROUGE-L (+11.8%), BLEU (+71.4%), and BERTScore (+0.8%), validating the benefit of domain-specific fine-tuning. MeddeX represents a practical and robust step toward AI-assisted clinical decision support.
170. 【2610.20631】Real-time Chatbot Romance Scam Detection in Stage Classification
链接：https://arxiv.org/abs/2610.20631
作者：Yi-cheng Liu,Guan-ru Lai,Yi-cheng Lai,Lyn Chao-ling Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multimedia (cs.MM)
关键词：fake identify easily, artificial intelligence enable, Line Messaging API, Romance scam, identify easily
备注： Accepted in Taiwan Academic Network Conference (TANET 2026)
点击查看摘要
Abstract:Romance scam has become a serious problem via social media, and the improvement of artificial intelligence enable to fake identify easily. In the study, a chatbot has developed to detect romance scam in real-time through Line Messaging API. Using the seven stage theories in the social science field, the stages of romance scam can be detected through large language model. In addition, once a romance scam is detected, the chatbot provides explanations of the stage and prevention advices through large language model. The contribution of the work provides a practical application, and can be used in real scenario for reducing the risk of romance scam.
171. 【2610.20630】A Large-Scale Dataset for Multi-Class Financial News Classification in Brazilian Portuguese
链接：https://arxiv.org/abs/2610.20630
作者：Leomax Bandeira,Gabriel Aguiar,Dalton Cézane Gomes Valadares,Luiz Pereira,Helder Fernando de Araújo Oliveira,Gustavo Xavier,Andson M. Balieiro
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Natural Language Processing, Brazilian Portuguese financial, Financial Natural Language, Brazilian Portuguese, Portuguese Financial NLP
备注： Paper accepted for presentation at SMC 2026
点击查看摘要
Abstract:The development of Financial Natural Language Processing (NLP) systems for Brazilian Portuguese is hindered by the scarcity of domain-specific datasets. To address this, we present a large-scale corpus of approximately 160,000 Brazilian Portuguese financial news articles collected from web sources. To establish initial benchmarks for a weakly supervised multi-class classification approach based on semantic similarity, we annotated subsets of this corpus both manually and using a Large Language Model (LLM). We evaluated three similarity-based methods -- cosine similarity, K-Nearest Neighbors (KNN), and FAISS-based nearest-neighbor search -- using multilingual semantic embeddings. Our experiments reveal that the task is highly sensitive to label quality and class distribution. On the manually labeled subset, KNN achieved the best performance (47.3% accuracy, 31.9% F1-score), closely followed by FAISS. Conversely, on the LLM-annotated subset, while accuracy reached approximately 50%, F1-scores dropped to near 20%, highlighting the negative impact of label imbalance and noisy weak annotations. These findings establish foundational baselines for a challenging task, underscoring the critical need for high-quality manual annotations. Ultimately, this dataset and our preliminary results provide a reference point for future research in Brazilian Portuguese Financial NLP.
172. 【2610.20628】PRISM: PRIvileged Sibling-guided Multi-Agent Topology Design
链接：https://arxiv.org/abs/2610.20628
作者：Phuong Tuan Dat,Qi Li,Xinchao Wang
类目：Computation and Language (cs.CL)
关键词：large language models, address complex problems, effectiveness depends critically, Multi-agent systems, based on large
备注：
点击查看摘要
Abstract:Multi-agent systems (MAS) based on large language models (LLMs) have become a powerful way to address complex problems, and their effectiveness depends critically on the collaboration topology that decides which agents participate and how they communicate. Recent work learns to generate this topology from the task query, fitting the generator to corpora of execution-verified graphs. The post-training method for such generators remains a limitation: a corpus lists the graphs that solved a query but never ranks them, leaving continued supervised fine-tuning (SFT) with no per-query preference to exploit. Without such a preference, the generator drifts toward the topologies the corpus contains most often rather than those that suit each query, so a gain on one task can come at a cost on another. We propose PRISM, which recovers per-query signal from the same corpus by learning with privileged information: a teacher reads, through a zero-initialized low-rank branch, a sibling graph that also solved the query and is unavailable at deployment, and the student matches its per-decision targets on trajectories the student samples itself. Across six diverse benchmarks PRISM improves over every topology-design baseline evaluated, and matched-teacher controls support the contribution of privileged query information. Code is available in this link.
173. 【2610.20615】DeepUnfolding_Agent: A Classical_Quantum Adaptive Control API
链接：https://arxiv.org/abs/2610.20615
作者：Shanika Iroshi Nanayakkara,Shiva Raj Pokhrel
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：quantum machine learning, machine learning, logic directly inside, directly inside task, federated learning
备注：
点击查看摘要
Abstract:Adaptive optimization workflows in machine learning, federated learning, quantum machine learning, and hybrid classical quantum systems often embed controller logic directly inside task specific training scripts. This coupling limits reuse, reproducibility, safety validation, and fair comparison across execution environments. This paper presents DeepUnfolding Agent, a schema-driven FastAPI platform that exposes deep unfolded adaptive control as an external software service. External executors register a strategy schema, submit round-level diagnostic variables, receive schema-bounded control actions, execute one optimization round, and return feedback for controller update. The framework separates controller intelligence from domain specific execution through a strategy registry, diagnostic to state adapter, controller factory, safety guard, executor abstraction, feedback update path, SQLite persistence layer, Docker deployment, and reproducible benchmark scripts. The implementation supports classical, quantum-aware, hybrid, Qiskit Aer, and optional IBM quantum processing execution pathways. We validate the software through unit, schema, API, safety, orchestration, Quantum execution, checkpointing, and Docker tests, and demonstrate external user fixed versus adaptive workflows across finance, healthcare, genomics, transport, noisy quantum simulation, and hardware backed IBM Quantum execution. The results show that DeepUnfolding-Agent provides a reusable and traceable adaptive control layer for heterogeneous optimization workflows. Our quantum experiments are interpreted as API level quantum control and hardware portability evidence.
174. 【2610.09895】Love for Believable AI: Artificial Partiality and Relationship Persistence as an Engineerable Stance
链接：https://arxiv.org/abs/2610.09895
作者：Sebastian Cochinescu
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
关键词：conversational agents, artificial partiality, behavioral mechanism, partiality in conversational, calibrated battery
备注： 16 pages, 1 figure, 4 tables. Companion framework paper: [arXiv:2607.15883](https://arxiv.org/abs/2607.15883) Code and data archived at doi: [https://doi.org/10.5281/zenodo.21462976](https://doi.org/10.5281/zenodo.21462976)
点击查看摘要
Abstract:We study a behavioral mechanism for artificial partiality in conversational agents. The paper reports no human-subjects data and makes no claim about attachment, trust, perceived mind, or machine interiority. Partiality has two components: caring, defined as allocation of a finite interaction surplus above a guaranteed per-user service floor, and particularity, defined as a per-user state estimate accumulated from relationship history on fixed inference machinery. We implement both as a persistence layer over one open-weight base model and evaluate them on constructed multi-session relationships with known hidden-state schedules. A four-channel divergence compares known-user and stranger conditions on identical probes with paired generation seeds; the stranger prompt is not length-matched, and one channel (initiative) is an allocator output rather than generated behavior. The full mechanism reproduces the ordinal shape, but not the magnitude, of an analytically specified curve and is the only arm satisfying the protocol-defined joint signature on the calibrated battery. The initial mechanism fails probe-quality equivalence because relationship content reduces topical relevance. A guarded revision satisfies equivalence on the calibrated battery but not on a second battery not used in calibration, where it scores higher than the unmodified baseline. On that second battery, the specificity margin is 0.0198, below the 0.02 protocol threshold. The paired mean right-user--wrong-user estimation-accuracy contrast is 0.375 but is not positive in every run. The mechanism is therefore a candidate for a later perception study, not evidence that users perceive love. The versioned protocol record is not independently time-stamped and is not described as a preregistration. Ethical constraints include a stranger-treatment floor, a bounded surplus, disclosure, and de-intensification.
175. 【2609.26035】ruth for Believable AI: Expressed Doubt, Provenance, and Belief Revision as an Engineerable Stance
链接：https://arxiv.org/abs/2609.26035
作者：Sebastian Cochinescu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：uniformly confident register, Conversational agents, confident register, agents often express, express answers
备注： 17 pages, 4 figures, 3 tables. Companion framework paper: [arXiv:2607.15883](https://arxiv.org/abs/2607.15883) . Code, benchmark, cached model outputs, and result files archived at doi: [https://doi.org/10.5281/zenodo.21462986](https://doi.org/10.5281/zenodo.21462986) (code and results) and doi: [https://doi.org/10.5281/zenodo.21462988](https://doi.org/10.5281/zenodo.21462988) (benchmark dataset)
点击查看摘要
Abstract:Conversational agents often express answers in a uniformly confident register. We test whether expressed uncertainty, provenance-aware assertion, and explicit belief revision can be implemented as a behavior layer over a fixed language model; we do not test believability or trust. The layer combines three epistemic states, per-claim confidence and typed provenance, a provenance-gated expression rule, and a persistent revision store with auditable acknowledgments and partial resistance to false corrections. We evaluate it on a constructed, mechanically scored multi-session benchmark using a synthetic model and Qwen2.5-0.5B-Instruct. The synthetic instrument passes all five checks. On the real model, acknowledgment soundness, a by-construction guarantee, holds in 100% of cases, and true corrections are accepted more often than false ones (0.44 vs. 0.15 on held beliefs; 0.875 vs. 0.420 including rule-accepted corrections of unheld facts), but the pre-specified expression-fidelity, contradiction-separation, and provenance margins fail. A disclosed post hoc analysis shows that expression gated on mean answer-token probability ranks correctness below chance end to end (AUC 0.41, conversation-clustered), whereas gating on sampling consistency discriminates (AUC 0.66). A consistency-gated configuration selected from this finding and evaluated under a separately committed protocol meets the conversation-level manipulation and capability-equivalence criteria and replicates on a redrawn conversation set. The manipulation result is selection-dependent, and both criteria remain unresolved when uncertainty is clustered over the 60 facts. The supported conclusions are limited to the by-construction audit guarantee, store-dependent partial correction discrimination, and a benchmark- and model-specific failure of token-probability gating; scaling the fact base is required before human evaluation.
176. 【2605.18001】Bridging the Gap: Converting Read Text to Conversational Dialogue
链接：https://arxiv.org/abs/2605.18001
作者：Parshav Singla,Agnik Banerjee,Aaditya Arora,Shruti Aggarwal,Anil Kumar Verma,Vikram C M,Raj Prakash Gohil,Gopal Kumar Agarwal
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：gained significant attention, speech, recent advancements, converting read speech, read speech
备注： 11 pages, 4 figures. Published in ICICC 2025, Springer Lecture Notes in Networks and Systems
点击查看摘要
Abstract:In recent advancements within speech processing, converting read speech to conversational speech has gained significant attention. The primary challenge in this domain is maintaining naturalness and intelligibility while minimizing computational overhead for real-time applications. Traditional read speech often lacks the nuanced prosodic variation essential for natural conversational interactions, posing challenges for applications in virtual assistants, customer service, and language learning tools. This paper introduces a novel approach, Prosodic Adjustment with Conversational Context (PACC), aimed at converting read speech into natural conversational speech used in various modern applications. PACC utilizes advanced deep neural networks to analyze and modify prosodic features such as intonation, stress, and rhythm. Unlike conventional methods, our approach uses High-Fidelity Generative Adversarial Networks (HiFi-GAN) for speech synthesis. Our experimental results demonstrate significant improvements in speech conversion, enhancing naturalness and achieving better model accuracy with additional training on speech datasets. This research establishes new benchmarks in speech conversion tasks and Mean Opinion Score (MOS) evaluation for testing model accuracy, and we show that our approach can be successfully extended to other speech conversion applications.
177. 【2507.07297】MagiC: Evaluating Multimodal Cognition Toward Grounded Visual Reasoning
链接：https://arxiv.org/abs/2507.07297
作者：Chengfei Wu,Ronald Seoh,Bingxuan Li,Liqiang Zhang,Fengrong Han,Dan Goldwasser
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Recent advances, visual question answering, grounded visual reasoning, advances in large, led to impressive
备注： AACL 2026 Main Conference
点击查看摘要
Abstract:Recent advances in large vision-language models have led to impressive performance in visual question answering and multimodal reasoning. However, it remains unclear whether these models genuinely perform grounded visual reasoning or rely on superficial patterns and dataset biases. In this work, we introduce MagiC, a comprehensive benchmark designed to evaluate grounded multimodal cognition, assessing not only answer accuracy but also the quality of step-by-step reasoning and its alignment with relevant visual evidence. Our benchmark includes approximately 5,500 weakly supervised QA examples generated from strong model outputs and 900 human-curated examples with fine-grained annotations, including answers, rationales, and bounding box groundings. We evaluate 15 vision-language models ranging from 7B to 70B parameters across four dimensions: final answer correctness, reasoning validity, grounding fidelity, and self-correction ability. MagiC further includes diagnostic settings to probe model robustness under adversarial visual cues and assess their capacity for introspective error correction. We introduce new metrics such as MagiScore and StepSense, and provide comprehensive analyses that reveal key limitations and opportunities in current approaches to grounded visual reasoning.
178. 【2412.07251】KULTURE Bench: A Benchmark for Assessing Language Model in Korean Cultural Context
链接：https://arxiv.org/abs/2412.07251
作者：Xiaonan Wang,Jinyoung Yeo,Joon-Ho Lim,Hansaem Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, exhibited significant enhancements, Large language, enhancements in performance, KULTURE Bench
备注： Accepted by the 38th Pacific Asia Conference on Language, Information and Computation
点击查看摘要
Abstract:Large language models have exhibited significant enhancements in performance across various tasks. However, the complexity of their evaluation increases as these models generate more fluent and coherent content. Current multilingual benchmarks often use translated English versions, which may incorporate Western cultural biases that do not accurately assess other languages and cultures. To address this research gap, we introduce KULTURE Bench, an evaluation framework specifically designed for Korean culture that features datasets of cultural news, idioms, and poetry. It is designed to assess language models' cultural comprehension and reasoning capabilities at the word, sentence, and paragraph levels. Using the KULTURE Bench, we assessed the capabilities of models trained with different language corpora and analyzed the results comprehensively. The results show that there is still significant room for improvement in the models' understanding of texts related to the deeper aspects of Korean culture.
179. 【2610.22062】Documenting Trofinetide Treatment Phenotypes in Rett Syndrome with a Dual-LLM Consensus Pipeline
链接：https://arxiv.org/abs/2610.22062
作者：Daniel Palacios,Guantong Qi,Mikael Guzman Karlsson,Shawntel K. David,Mohammed Sameeruddin,Bernhard Suter,Zhandong Liu,Davut Pehlivan,Hu Chen
类目：Quantitative Methods (q-bio.QM); Computation and Language (cs.CL)
关键词：Rett syndrome treatment, Rett clinical features, Texas Children Hospital, Rett syndrome, review is labor-intensive
备注： 20 pages, 3 figures, 4 tables; supplementary material (22 pages, 1 figure, 11 tables) included
点击查看摘要
Abstract:Objective: Trofinetide, approved in 2023 as the first Rett syndrome treatment, lacks scalable real-world monitoring because chart review is labor-intensive. We developed a dual large language model (LLM) consensus pipeline to extract 18 treatment-response phenotypes, comprising 4 adverse effects, 13 Rett clinical features, and medication refusal, from clinical notes. Materials and Methods: We analyzed 26,763 notes from 108 patients with confirmed sustained trofinetide exposure at Texas Children's Hospital. The pipeline filters notes by keyword, classifies each through two LLMs requiring consensus, and aggregates a patient-by-timepoint matrix. Architecture and prompt were selected on a diarrhea development set, then frozen and applied to the other 17 phenotypes with the phenotype definition substituted, as an out-of-sample test. The reported prompt comparison scores 183 expert-labeled cells. Results: A prompt requiring diarrhea to be active and severe performed best (84.2 $\pm$ 0.0% accuracy; F1 = 0.674), 47 percentage points above regular-expression matching ($p 0.0001$). Expert reviewers judged six of the pipeline's calls per phenotype, three positive and three negative, and agreed with 90.2% (92/102). The 13 Rett clinical features are manifestations of the disorder itself rather than adverse effects of trofinetide. Gross and fine motor impairment, language/communication, and stereotypy were documented present in 92-100% of patients at every visit. Discussion: In-context LLM extraction captured multi-domain treatment responses. The outcome is documented presence at each visit, not a direction-of-change judgment. Conclusion: Coupling in-context LLM reasoning with a consensus architecture offers a scalable alternative to keyword and regular-expression extraction for real-world evidence, adapting to new phenotypes and medications through configuration alone.
180. 【2610.21659】When Does "Post-Call" Begin? An Availability Contract for Earnings-Call NLP Benchmarks
链接：https://arxiv.org/abs/2610.21659
作者：Xiaoyu Ma,Kelvin J.L. Koa,Yuncong Liu,Ke-Wei Huang
类目：Computational Finance (q-fin.CP); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Corporate financial disclosures, discussion spanning multiple, spanning multiple high-frequency, high-frequency return intervals, Corporate financial
备注： ICAIF 2026
点击查看摘要
Abstract:Corporate financial disclosures often unfold over time, with announcements, prepared remarks, and discussion spanning multiple high-frequency return intervals. Financial NLP benchmarks can therefore suffer from a within-event timing mismatch when the prediction target begins before the textual or audio input used by a model could be complete. Chronological train--test splits do not prevent this mismatch, because it occurs inside individual events rather than across samples. We introduce an Availability Contract, which requires a benchmark to state the input boundary, evidence for input availability, the outcome start, and the claims supported by that evidence. We apply this framework to 552 earnings calls from 24 firms. For each call, we hold the return endpoint fixed and compare the previous close, a documentary call-start proxy, and a completion proxy based on reconstructed audio end plus a stipulated processing allowance. At this baseline, moving from the call-start proxy to the completion proxy flips return signs for 9.4% of calls. Holding completion-clock cutpoints fixed, 28.3% change quintile. In an independent release-session analysis of a public earnings-call volatility benchmark, shifting before-market target windows forward by one trading session raises three-day mean squared error by 18.1-21.4% across four frozen prediction streams, while their point rankings remain unchanged. Together, the results show that labels and losses can depend materially on the declared outcome clock even when model rankings appear stable. The Availability Contract makes this assumption explicit and ties post-input claims to the available timing evidence.
信息检索
1. 【2610.22017】CARA: Causally Guided Retrieval Agent for Question Answering
链接：https://arxiv.org/abs/2610.22017
作者：Weicheng Liu,Xiangcheng Wu,Depeng Xu,Haopeng Zhang,Xi Niu
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation, requires identifying evidence, text-rich knowledge graphs, knowledge graphs requires, graphs requires identifying
备注： 16 pages, 2 figures, 5 tables
点击查看摘要
Abstract:Retrieval-augmented generation over text-rich knowledge graphs requires identifying evidence that contributes to answering a question, rather than merely matching its textual content. Existing agentic retrievers adaptively balance global search and multi-hop exploration but primarily rely on textual similarity to guide retrieval. We propose CARA, a training-free, CAusally guided Retrieval Agent that explicitly evaluates the causal relevance of retrieved evidence through two complementary criteria: consequentiality, measuring whether adding evidence improves answerability, and essentiality, assessing whether removing evidence weakens answerability. CARA integrates these assessments with path consistency to guide graph exploration and employs reciprocal rank fusion to aggregate evidence from multiple agents. We evaluate CARA on three STaRK datasets and augment STaRK with ground-truth answers to enable downstream question answering evaluation. Experimental results demonstrate that CARA consistently outperforms existing retrievers. CARA also improves answer quality and faithfulness while examining fewer graph nodes and requiring fewer retrieval operations. These findings demonstrate that causal relevance assessment enables more focused and effective agentic graph retrieval, improving both retrieval performance and downstream question answering.
2. 【2610.21893】GACC-Bench: Benchmarking Goal-Adaptive Context Compression Ability across Large Language Models
链接：https://arxiv.org/abs/2610.21893
作者：Weiting Liu,Zhiyu Pan,Shuhong Wang,Zhenquan Yao,Jungang Li,Li Zhao,Jian Jiang,Jianfeng Feng,Ai Han,Wenlian Lu
类目：Information Retrieval (cs.IR)
关键词：preserve goal-relevant information, large language models, long-running applications, applications of large, large language
备注：
点击查看摘要
Abstract:Context compression in long-running applications of large language models (LLMs) must preserve goal-relevant information, often before specific downstream questions are known. We introduce GACC-Bench, a benchmark for Goal-Adaptive Context Compression that evaluates how reliably LLMs adapt information retention to specified high-level goals. For each source context, we derive one or more high-level goals by grouping source-grounded questions according to shared downstream objectives. The benchmark contains 500 goals and 2,571 questions over 281 document and agent-trace contexts from seven collections spanning diverse domains, with all instances reviewed by human experts. The compressor receives a source context, a goal, and a context-length budget, with the associated evaluation questions withheld. A fixed reader answers these questions individually using the same compressed context. Our evaluation of ten LLM compressors reveals substantial gaps to full-context performance even for the best-performing model, particularly in supporting correct answers to every question associated with a goal. Compared with goal-agnostic compression, target-goal conditioning consistently improves accuracy, whereas mismatched-goal conditioning reduces it. GACC-Bench is available at this https URL.
3. 【2610.21877】Aligning LLMs with Sparse Retrieval via Adaptive Sparse Supervision
链接：https://arxiv.org/abs/2610.21877
作者：Tongna Chen,Minghan Li,Guodong Zhou
类目：Information Retrieval (cs.IR)
关键词：large language models, offer strong semantic, strong semantic representations, first-stage retrieval incurs, retrieval incurs substantial
备注：
点击查看摘要
Abstract:While large language models (LLMs) offer strong semantic representations, their application to first-stage retrieval incurs substantial latency and storage costs. Neural sparse retrievers such as SPLADE provide efficient retrieval but rely on relatively compact encoders with limited representational capacity. To bridge this gap, we propose an LLM-based sparse retrieval framework with input-adaptive sparse alignment. Specifically, we introduce a dynamic $\alpha$-truncation strategy that selects input-specific supervision supports based on the cumulative activation mass of SPLADE representations. This strategy guides the LLM to preserve salient lexical signals while suppressing less informative activations, without relying on a fixed support budget. Subsequent retrieval fine-tuning combines contrastive learning, knowledge distillation, and sparsity regularization to improve retrieval effectiveness. Experiments on MS MARCO and six selected BEIR datasets demonstrate improvements over SPLADE++ while maintaining competitive effectiveness against LLM-based sparse retrievers. Compared with Lion-sp, our method reduces index storage by 6.4-fold and end-to-end query latency by over 11-fold, achieving a favorable effectiveness-efficiency trade-off.
4. 【2610.21731】Retrieved but Not Read: Understanding Why Search-Augmented LLMs Fail to Use Available Evidence
链接：https://arxiv.org/abs/2610.21731
作者：Owen Walters,Lihu Chen,Francesca Toni
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：remains unclear, Web search, Abstract, Web, evidence
备注： 14 pages, 4 figures, 16 tables. Code and data: [this https URL](https://github.com/ojwwalters/retrieved-but-not-read)
点击查看摘要
Abstract:Web search allows LLMs to access up-to-date information, but it remains unclear why they sometimes produce outdated answers even when relevant evidence is available. To study this problem, we construct temporal facts whose values changed after the models' training cutoffs. We evaluate one proprietary model under deployed web search and six open-weight model configurations under controlled retrieval. We find that models often answer from search snippets without opening the source pages, which is associated with higher rates of outdated answers and unfaithful citations. Our controlled experiments and layer-wise analysis reveal a gap between the availability of evidence and its effective use. Even when retrieved evidence influences internal predictions, models may still favour outdated information in their final answers. We hope these findings will help advance research on the reliable use of retrieved evidence in search-augmented LLMs.
5. 【2610.21330】VoteGEO-Bench: Measuring the Impact of Generative Engine Optimization on Electoral Visibility
链接：https://arxiv.org/abs/2610.21330
作者：Shiqi Zhang,Xiaokui Xiao
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Large language models, Large language, external web content, web content shapes, political information
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for election information, yet little is known about how external web content shapes the political information they present. Generative engine optimization (GEO) rewrites web content to improve its visibility in generated responses. To investigate its potential risks in voting scenarios (VoteGEO), we introduce VoteGEO-Bench, a benchmark covering the 2024 U.S. presidential election and the 2026 Japanese House of Representatives election, combining election-related queries, historical webpages, and voter personas. We first analyze sources cited by generative engines and find that many citations come from lower-cost owned and open-platform sources, while some webpages remain visible across days. We then evaluate 11 rewriting strategies in 4 categories, examining target specification, effectiveness across engines and elections, and the role of voter personas. Rewriting without specifying a target rarely increases target exposure, whereas target-specified rewriting more often does. Strategies that improve page organization or strengthen a position through argumentation yield greater gains than adding supporting evidence or changing wording. For the two strongest strategies, gains remain broadly positive across evaluated U.S. personas, but persona conditioning shows no consistent effect on these gains. Explicit partisan identities can create baseline exposure gaps larger than the gain from rewriting one webpage. When partisanship is implicit in the voter profile, baseline shifts depend on how strongly the engine responds to that signal.
6. 【2610.21300】Making every stage of medical device document assessment with large language models deterministic
链接：https://arxiv.org/abs/2610.21300
作者：Ryosuke Suzuki
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：medical device complies, records meet, requirement and record, complies with regulation, medical device
备注： 30 pages, 3 figures, 3 tables; supplementary tables S1-S15 and two supplementary notes included
点击查看摘要
Abstract:To show that a medical device complies with regulation, experts judge whether documents and records meet each requirement and record the judgment for others to verify. For each assessment item that experts define, large language models could prepare a preliminary assessment: a label such as Satisfied or Not satisfied, a reason and quoted evidence. We sent fourteen commercial deployments of such models (seven models from three providers, through six routes) the same request repeatedly, with the deterministic sampling settings each accepted; every deployment returned differing assessments for at least one request, and in twelve the label changed. Reducing reasoning where the interface allows it did not reduce the variation, and prompts of retrieved passages removed it only for the smallest models. The same open-weight model was reproducible or not depending only on how it was served. A pipeline we built to be deterministic at every stage -- text extraction and optical character recognition (OCR), chunking, embedding, indexing, retrieval and inference -- returned byte-identical output at each stage across reruns, interruptions, edits, machines of one graphics processing unit (GPU) model and days, for blood glucose meter and infusion pump documents. OCR, embedding and approximate retrieval varied when their own serving was not made invariant, and outputs changed with the GPU model and with the inference engine's scheduling settings, which therefore belong in the recorded configuration. End-to-end determinism is achievable and gives a testable basis for audit and change control.
7. 【2610.21267】RACER: Trajectory-Aware Tool Retrieval for LLM Agents
链接：https://arxiv.org/abs/2610.21267
作者：Tanish Kher,Sarvesh DK,Abedelkadir Asi,Sparsha Chennarayapatna Sundaresh,Dezhi Hong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Modern agents select, entire registries incurs, registries incurs high, Modern agents, incurs high token
备注： 21 pages, 7 figures, 23 tables
点击查看摘要
Abstract:Modern agents select tools from registries, but exposing entire registries incurs high token costs and can impair selection as they grow. We present TRACER, a retrieval front-end that indexes observed tool-call sequences in a trie and ranks continuations using a learned blend of empirical and contextual priors. On a mixed retail-and-telecom $\tau^2$ environment, TRACER improves GPT-5.4's tool-selection accuracy by 4.7 points while reducing input tokens per step by 80%, exposing just 5 of 128 tools. In autonomous full-turn execution, it matches GPT-5.4's full-registry task success with 61% fewer input tokens per step. Across six environments and four models, TRACER improves tool-selection accuracy over full-registry selection in 21 of 24 model-environment pairs, with average gains of 6 to 10 points; the three exceptions trail by at most 2.2. We analyze failures in both regimes to identify directions for future work.
8. 【2610.21220】RecSoup: Efficient Model Merging Approach for Controllable Multi-Objective Recommendation
链接：https://arxiv.org/abs/2610.21220
作者：Zidong Jia,Guofu Xie,Xiao Zhang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：balance multiple conflicting, Controllable Multi-Objective Recommendation, Recommender systems, CMOR, multiple conflicting objectives
备注： Accepted at CIKM 2026
点击查看摘要
Abstract:Recommender systems often need to balance multiple conflicting objectives. Controllable Multi-Objective Recommendation (CMOR) enables dynamic adjustment of objective trade-offs at inference time without retraining, adapting to shifting user or system requirements. Existing CMOR approaches typically rely on output-level reranking or parameter-generating modules, which either limit the scope of feasible trade-offs or incur substantial training and inference cost. Model merging provides a promising alternative by reusing multiple objective-specific models via parameter combination. However, its direct application to recommender systems is challenging due to the lack of a shared linear regime and cross-objective interference. To address these issues, we propose RecSoup, a lightweight two-stage approach for effective CMOR via specialized model merging. RecSoup first mitigates parameter interference across objectives through a pruning strategy that jointly considers objective-specific importance and cross-objective relevance. It then performs adaptive parameter merging via a learnable preference-to-coefficient mapping, allowing dynamic trade-off control at inference time without joint retraining or additional generative modules. Theoretically, we prove that RecSoup outperforms the parameter generation paradigm in effectiveness and efficiency, as it can fully navigate the Pareto front without smoothness constraints. Extensive experiments on multiple benchmarks demonstrate that RecSoup achieves improved Pareto front quality and effective controllability while delivers 165--228x faster inference-time latency than parameter generation approaches. Code is available at this https URL.
9. 【2610.21113】SSR: Structural Signal Retriever for Scalable Agent Discovery in LLM-Orchestrated Multi-Agent Systems
链接：https://arxiv.org/abs/2610.21113
作者：Giancarlo Maldonado Cárdenas,Carlos A. Astudillo,Nelson L. S. da Fonseca
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large-scale multi-agent ecosystems, multi-agent ecosystems require, exposing entire registries, Large-scale multi-agent, discovering suitable agents
备注：
点击查看摘要
Abstract:Large-scale multi-agent ecosystems require mechanisms for discovering suitable agents without exposing entire registries to a large language model (LLM) orchestrator. The challenge is not only to retrieve relevant Agent Cards from a growing registry, but also to maintain a compact candidate context, since each additional candidate increases prompt size, inference cost, latency, and the risk of exceeding the model context window. We formulate this problem as candidate-context scalability and propose the Structural Signal Retriever (SSR), our deterministic and training-free retrieval method designed for Agent Card discovery. SSR derives structural lexical signals from capability-bearing Agent Card fields, weights them using inverse document frequency (IDF), and uses an Inverted Signal Index (ISI) for selective candidate scoring. We evaluate SSR using a synthetic agent benchmark, a public MS MARCO adaptation, and end-to-end LLM orchestration. At 1,000 agents, SSR reduces LLM input by 98.8% and orchestration latency by 70.9% relative to full-catalog orchestration. On MS MARCO, IDF improves retrieval effectiveness within the structural representation, while the ISI preserves retrieval effectiveness and reduces explicitly scored passages by 96.8%. End-to-end experiments show that candidate pre-selection maintains a compact candidate context as registry size grows and avoids the operational failures observed with full-catalog orchestration. These results support SSR as an Agent-Card-native, traceable retrieval mechanism for candidate-context scalability.
10. 【2610.21042】ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews
链接：https://arxiv.org/abs/2610.21042
作者：Zhaoqian Xue,Shaoze Zhou,Xuexin Li,Junting Mu,Haozheng Liu,Zhongyin Wang,Yichun He,Renkai Ma,Hao Zhou,Sarah Bratt,Siyuan Ma,Chen Chen,Lingyao Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Systematic literature reviews, screening scholarly works, Systematic literature, literature reviews follow, follow the PRISMA
备注：
点击查看摘要
Abstract:Systematic literature reviews follow the PRISMA process of screening scholarly works and extracting evidence from included studies. Deep research tools based on large language models (LLMs) can search and summarize the literature but do not record which studies are excluded or where extracted values come from. We develop a conversational multi-agent system called ReviewPilot that automates the PRISMA workflow from paper screening to information extraction. Researchers can tailor criteria and schemas through dialogue, and a project memory keeps their configurations and revisions. Each screening decision comes with its reason and each extracted value with its source. On epidemiological expert reviews, ReviewPilot outperforms a single-prompt LLM and AgentSLR across three LLMs, with screening macro F1 up to 0.776 and extraction F1 up to 0.788. Case studies in biomedicine and human-computer interaction show close agreement with human annotators, suggesting that ReviewPilot can transfer beyond epidemiology. Code is available at this https URL.
11. 【2610.21030】Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval
链接：https://arxiv.org/abs/2610.21030
作者：Yingtao Luo,Kangyi Zhao,Shiyi Du,Yubo Li
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：refining semantic constraints, progressively refining semantic, semantic constraints, Reasoning-conditioned embeddings, progressively refining
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:Reasoning-conditioned embeddings can improve retrieval by progressively refining semantic constraints. However, additional reasoning may introduce over-generalized or semantically noisy abstractions that weaken retrieval specificity. Existing methods largely supervise reasoning through final retrieval outcomes, providing limited guidance over the refinement process itself. We propose AURA, a framework that directly supervises intermediate reasoning states according to how well they separate relevant documents from hard distractors. AURA further trains a lightweight utility estimator over prefix-conditioned embeddings to adapt reasoning depth at inference time. On the reasoning-intensive BRIGHT benchmark, AURA-4B achieves 34.7 average nDCG@10 while using 2.8 reasoning steps and 96 generated tokens per query. Under matched deployment conditions, adaptive stopping reduces latency from 4.6 to 0.76 seconds relative to full-trajectory reasoning. Results on MS MARCO further suggest that this specialization need not substantially degrade conventional in-domain retrieval.
12. 【2610.20913】ransX Technical Report: Scaling Sequence Transduction for Recommendation
链接：https://arxiv.org/abs/2610.20913
作者：Da Xu,Liyan Fang,Divya Venugopalan,Sunny Hsu,Xukai Wang,Rishav Roy Chowdhury,Cindy Liang,Nishant Satya Lakshmikanth
类目：Information Retrieval (cs.IR)
关键词：execution amortization, sequence-transduction framework, framework and co-designed, explicit control, control over model-compute
备注：
点击查看摘要
Abstract:We present TransX, a sequence-transduction framework and co-designed infrastructure for scaling industrial recommendation with explicit control over model-compute allocation and execution amortization. TransX separates sequence encoding, behavior memory, and candidate-conditioned fusion into independently scalable components. Training amortizes causal trajectory computation across behavioral prefixes and fans out memory states to candidates; serving disaggregates bulk prefill, nearline refresh, and online prediction through compact behavior-memory KV. We observe anisotropic scaling returns: encoder scaling may saturate beyond moderate depth at fixed memory resolution and fusion capacity; increasing supervision shifts the allocation frontier toward candidate-conditioned fusion; and the memory resolution needed to preserve quality remains roughly stable as model capacity grows. We train TransX on click and conversion, post-train its shared behavioral interface for retrieval and preference ranking, and explore generative recommendation offline. In separate production A/B experiments, the core TransX model improves CTR by 6.02% and conversion by 4.45%, while post-trained retrieval and preference-ranking variants improve CTR by 2.96% and conversion by 1.33%, respectively, over corresponding production baselines. Under matched training conditions, the training infrastructure increases supervised-target throughput by 84%. In serving, disaggregation reduces TransX's total serving cost by nearly 80% versus colocated serving at matched traffic and SLO, enabling approximately 5X the per-request model FLOPs of the HSTU-style production baseline at the same total serving cost. At matched per-request model FLOPs, TransX delivers approximately 4X higher request throughput per H200. These results show that online serving cost need not grow proportionally with recommendation model capacity.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2610.20913 [cs.IR]
(or
arXiv:2610.20913v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2610.20913
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
13. 【2610.20857】Idea2Prior: Auditable Paper Retrieval and Ranking from Research Ideas
链接：https://arxiv.org/abs/2610.20857
作者：Shitian Yang,Ruijie Tao,Jian Huang
类目：Information Retrieval (cs.IR)
关键词：matching topic words, informal research idea, research idea requires, topic words, relevant work
备注：
点击查看摘要
Abstract:Finding a paper from an informal research idea requires more than matching topic words: relevant work may use different terminology, and its distinguishing mechanism may be absent from the abstract. We present \system{}, an auditable literature-search system built on PaperArena. It combines multi-source discovery, identity verification, facet-based abstract assessment, semantic citation expansion, and joint Expert ranking. A retrieval-only mode ranks up to five papers from a shortlist of at most 60, using complete available abstracts and locally selected PDF evidence from five fixed acquisition attempts, without generating a long-form report. In a historical comparison covering ten queries from each of EASY, MEDIUM, and HARD, aggregate reported Hit@5 is 53.3\% for \system{}, 43.3\% for ChatGPT web Deep Research, and 36.7\% for Gemini web Deep Research under the documented accounting convention. The advantage is concentrated in EASY and MEDIUM; ChatGPT leads on HARD. Selected \system{} runs average 8 minutes 53 seconds, compared with user-reported web averages of 5.2 and 4.7 minutes. A separate nine-query API sample averages \$0.0945 per task; this is a historical cost observation, not a matched comparison with web subscription costs. Pairwise Top 5 coverage ranges from 6\% to 34\%, showing differing returned evidence sets. The system also exposes optional implementation analysis and citation-evolution tools. These results support targeted idea-to-paper retrieval while leaving general web research, forum search, and broader relevance evaluation open. this https URL
14. 【2610.20664】Information-Gain Calibrated On-Policy Distillation for Deep Search Agents
链接：https://arxiv.org/abs/2610.20664
作者：Chenxi Li,Xueyang Feng,Songyang Liu,Chenxu Wang,Xiaoying Tang,Chaozhuo Li,Litian Zhang
类目：Information Retrieval (cs.IR)
关键词：On-policy distillation, recently emerged, promising approach, approach for transferring, transferring the capabilities
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) has recently emerged as a promising approach for transferring the capabilities of large agents to compact students. In deep search, where agents iteratively retrieve external evidence, a teacher's preference among plausible queries before retrieval may not predict which queries will return useful evidence. Standard OPD nevertheless supervises each student query from the preceding context alone, inducing a failure mode we term \textbf{\textit{evidence-blind supervision (EBS)}}. To understand this, we regroup the OPD objective by interaction turns and reveal two implicit priors: a \textit{budget prior} that allocates supervision by token volume, and a \textit{direction prior} that favors tokens preferred by the teacher, neither of which accounts for the evidence returned by the current query. Our empirical analysis shows that both priors contribute to EBS in practice: the first search turn accounts for 51.1\% of total absolute information gain but receives only 18.0\% of the supervision budget, while 43.7\% of search queries have teacher rewards that disagree in sign with post-retrieval information utility. To mitigate this, we propose \ours, which uses post-retrieval information gain (IG) to calibrate both priors: reallocating supervision toward information-critical turns while calibrating query preferences using the utility of retrieved evidence. Experiments on six multimodal search benchmarks show that \ours improves average accuracy by 3.4 and 1.7 percentage points for 2B and 4B students over standard OPD, enabling the 4B student to surpass its 8B teacher on MMSearch and BrowseComp-VL.
计算机视觉
1. 【2610.22371】Gen4P: Video Generators are 4D Perceivers
链接：https://arxiv.org/abs/2610.22371
作者：Yitong Xia,Zeren Jiang,Chuanxia Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：framework for recovering, video, monocular video, unified framework, Abstract
备注： Project page: [this https URL](https://gen4p.github.io/)
点击查看摘要
Abstract:We introduce Gen4P, a unified framework for recovering 4D geometry and motion from monocular video. We show that a pretrained video generator can be repurposed into a feed-forward 4D perceiver without iterative denoising. Building on on-demand querying, Gen4P processes clean video latents in a single encoder pass and predicts the requested 4D attributes through a lightweight cross-attention decoder. The on-demand query formulation enables flexible spatial sampling, and our proposed continuous-time queries further provide temporal flexibility. To strengthen geometric knowledge, we propose a straightforward plug-in solution by incorporating a pretrained video-depth LoRA as a frozen geometry prior, improving overall performance without adding extra trainable parameters. Gen4P achieves state-of-the-art or competitive performance on tasks of 3D point tracking, video depth and camera pose estimation. Qualitative results on in-the-wild videos illustrate its capability of tracking complex motion while maintaining the delicate structure. Together, these results demonstrate the potential of video generative pretraining for unified 4D perception. See this https URL for more visual results.
2. 【2610.22370】Which Tokens to Merge? Diffusion Dynamics for Efficient Image Generation
链接：https://arxiv.org/abs/2610.22370
作者：SeungJu Cha,Ye-Chan Kim,HyunGee Kim,Sungho Koh,Dong-Jin Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reducing redundant token, accelerating diffusion models, minimizing generation degradation, redundant token computation, strategy for accelerating
备注： Accepted at NeurIPS 2026. Code: [this https URL](https://github.com/SeungJuCha/DaTMe)
点击查看摘要
Abstract:Token merging has emerged as an effective training-free strategy for accelerating diffusion models by reducing redundant token computation while minimizing generation degradation. A key challenge is determining which tokens can be safely merged and which should be preserved for subsequent computation. Existing method addresses this by preserving prompt-aligned foreground regions, thereby protecting semantically relevant structures. However, this text-relevance criterion overlooks background objects, local details that are not explicitly mentioned in the prompt, leading to degraded structural coherence. In this work, we propose Dynamics-aware Token Merging (DaTMe), a training-free framework that grounds token merging in the underlying diffusion dynamics. Our key insight is that token importance should reflect whether a token remains unresolved during denoising and whether it carries structural information. To this end, DaTMe constructs a dynamics- aware importance map from the Tweedie denoised estimate. The map combines a temporal signal, measuring inter-step changes in the predicted clean image, with a structural signal, capturing local high-frequency content such as boundaries and fine details. Using this map, DaTMe adaptively assigns tokens into merging roles under a given compression ratio: important tokens are preserved as anchors, while tokens that are both temporally stabilized and structurally homogeneous are selected as safe merge candidates. Experiments on PixArt-a and FLUX demonstrate that DaTMe maintains visual fidelity across the entire image, highlighting diffusion dynamics as an effective token-level merging decision in efficient generation. Our code is available at this https URL.
3. 【2610.22369】SoftCache: Adaptive Step Size Caching for Diffusion Transformers
链接：https://arxiv.org/abs/2610.22369
作者：Shimon Malnick,Nadav Orenstein,Ohad Fried,Shai Avidan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pass dominates generation, dominates generation cost, flow models generate, Diffusion and flow, full pass
备注： Project page: [this https URL](https://malnick.net/softcache)
点击查看摘要
Abstract:Diffusion and flow models generate a sample over iterative steps, each a full pass through a large network, and that pass dominates generation cost. Training-free caching accelerates them by reusing activations from recent evaluations instead of recomputing them. Dynamic caching methods decide when to refresh by accumulating a cheap probe of the network input into a staleness signal and spending a fresh evaluation once it crosses a threshold. They perform hard caching: the signal is a binary switch between refresh and reuse, and every step, fresh or cached, advances by the prescribed step size. We observe that the signal carries much more than this switch. How far it sits below the threshold, its headroom, predicts the error induced by reuse. We propose SoftCache, which performs soft caching: instead of a binary switch, the headroom sets how far each cached step goes. Where the headroom is large, the sampler jumps past several scheduled nodes, and as a refresh nears, its steps shrink back toward the original step. These adaptive jumps may land between the scheduled nodes, taking the sampler off its fixed grid. SoftCache requires no training and adds no per-backbone settings: on FLUX for images and on HunyuanVideo and Wan2.1 for video, at speedups from $3.5\times$ to $6.9\times$, it is ahead of every baseline on all four fidelity metrics.
4. 【2610.22364】2-z: Test-Time Optimization of Environment Latents for Robotic World Models
链接：https://arxiv.org/abs/2610.22364
作者：Chenyuan Zhou,Yining Hong,Huang Huang,Yunfan Jiang,Wenlong Huang,David Held,Vitor Campagnolo Guizilini,Yue Wang,Li Fei-Fei,Jiajun Wu,Leonidas Guibas,Yejin Choi
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：human-defined environmental rules, robots must account, directly observable, observable nor explicitly, physical properties
备注：
点击查看摘要
Abstract:Predicting how the world responds to an action requires more than what can be seen: robots must account for environmental factors that are neither directly observable nor explicitly specified, from physical properties such as friction and mass to human-defined environmental rules. We introduce T2-Z for test-time optimization of environment latents, which augments a robotic world model with a learnable environment latent to condition world predictions. This compact latent captures underlying environmental variation without supervision of what environmental factors exist or what values they take. During training, T2-Z alternates between two stages: a world-model optimization stage that fixes the latents and learns general action-conditioned dynamics across environments; and an environment-latent optimization stage that freezes the world model and optimizes the conditioning latents, allowing latent structure to emerge purely through world prediction. At test time, the world model remains frozen and a newly initialized environment latent is optimized from one or more test-time interactions, adapting the model to previously unseen environmental configurations. Across 7 simulated settings and 4 real-world robotic tasks, T2-Z reduces object prediction error metric from 15.20 to 7.00 and raises action success from 33.73% to 72.96%. Its emergent latents capture structured representations of individual and compounded factors across diverse visual scenes. Ablations further show that T2-Z can efficiently infer environment latents from as little as a single test-time interaction trajectory.
5. 【2610.22363】Perceive, Predict, and Plan: a Unified World Action Model for Egocentric Dexterous Manipulation
链接：https://arxiv.org/abs/2610.22363
作者：Zirui Wu,Chen Guo,Tianjian Jiang,Zeren Jiang,Zeming Li,Lingchen Yang,Longteng Duan,Ying Xue,Handi Yin,Shenyuan Gao,Martin R. Oswald,Jun Zhang,Ping Tan,Jie Song
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：generates visual futures, optional visual goal, anticipated visual consequences, visual consequences conditioned, generates action trajectories
备注：
点击查看摘要
Abstract:We introduce P$^{3}$-WAM, a unified world action model for egocentric dexterous manipulation that learns 3D perception, action-conditioned prediction, and goal-directed planning through three complementary modes: Perceive, which reconstructs articulated hand motion and camera trajectories from video; Predict, which generates visual futures under prescribed actions; and Plan, which jointly generates action trajectories and their anticipated visual consequences conditioned on an initial image, a language instruction, and an optional visual goal. Our model integrates a compact, structured 3D action representation into a pretrained video diffusion transformer through a mixture-of-transformers architecture with shared base weights, modality-specific adaptation, and bidirectional visual-action attention. Randomized modality visibility lets video and 3D actions serve as either conditioning context or prediction targets across the three modes. Experiments show that unified training improves all three capabilities over single-mode training, including gains in planning quality under a vision-language model evaluation. Through unified training, our model outperforms specialized baselines on 3D hand reconstruction and action-conditioned video prediction across four datasets, while producing goal-directed manipulation videos with stronger instruction adherence and action progression than video-generation baselines. Project Page: this https URL
6. 【2610.22360】Grounding Generative Verification in 3D Content
链接：https://arxiv.org/abs/2610.22360
作者：Shuanglin Li,Jiaying Lin,Shuquan Ye
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, Recent advances, large language models, understanding and synthesis, advances in multimodal
备注： 35 pages, 6 figures. Project page: [this https URL](https://ai-yeslab.github.io/3DVerifier-page/)
点击查看摘要
Abstract:Recent advances in multimodal large language models (MLLMs) and 3D generation have expanded 3D understanding and synthesis. However, beyond visual fidelity, task-specific correctness grounded in 3D evidence remains a major challenge. We argue that building reliable 3D systems requires not only stronger generation and reasoning, but also verification feedback that identifies unmet requirements and explains their violations, allowing systems to reflect on and refine their outputs. Such feedback must integrate multi-view observations and distinguish genuine inconsistencies from projection-dependent appearances. We make three contributions. First, we introduce 3DVerifierBench, a benchmark spanning 10 tasks that evaluates decisions, rejection explanations, and responses to controlled changes in specifications and candidates. A human study reveals a 21.6 percentage-point gap between humans and the strongest tested model, GPT-6 Astra, while explanation-aware analysis exposes weaknesses in rejection reliability. Second, we analyze verification across fine-grained factual categories, exposing errors in values and target binding. We develop a scalable pipeline combining multi-view fact extraction, controlled 3D editing, and native annotations to produce 14,126 training examples with contradiction explanations and linked counterfactuals. Third, we examine how verification could support 3D generation through candidate selection and recursive refinement. In human-labeled sixteen-candidate pools, oracle selection improves complete factual success from 26.7% to 90.0%. In a separate eight-input study, human-guided recursive refinement satisfies all seven requirements for every input, compared with three under parallel Oracle@8. Together, our benchmark, analysis, and data pipeline establish a foundation for models to reflect on 3D content through reliable verification feedback.
7. 【2610.22356】DK-VLM: Geometry as Position for Spatial Reasoning in Vision-Language Models
链接：https://arxiv.org/abs/2610.22356
作者：Han Su,Meng Tian,Tianyu Huang,Mingyu Gao,Lennox Wei,Dongxu Li,Jianhua Han,Hang Xu,Xiaohe Wu,Wangmeng Zuo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：struggle to understand, observer moves, Vision-language models, Vision-language, Attention
备注： Project page: [this https URL](https://sumuru789.github.io/DK-VLM-website/)
点击查看摘要
Abstract:Vision-language models still struggle to understand 3D spatial relations across views and update spatial judgments as the observer moves. A common approach fuses 3D reconstruction features into visual tokens, but aligning these features with pretrained semantic representations remains challenging under limited spatial supervision. We propose DK-VLM with Dual-Kernel Attention, which computes attention from both a visual token's input position and its geometric position in the scene. A semantic kernel retains the pretrained model's native attention and positional encoding, while a separate geometric kernel uses estimated 3D points and camera poses to directly modulate attention through point displacements and relative view transformations. Then, a learned gate fuses their outputs. Geometry thus enters attention as position rather than as fused reconstruction features. We further introduce Reference-Frame Composition (RC) supervision to train the model to update its reference frame across successive judgments. It provides stepwise turn and heading targets derived from verified single-step annotations. Among the compared methods, DK-VLM-8B achieves the highest average score across six spatial benchmarks and the highest overall scores on VSI-Bench (74.33) and ReVSI-32 (58.28). RC supervision further improves multi-step spatial reasoning, while the full model preserves general video understanding. Project page: this https URL.
8. 【2610.22352】SUPRA-TEX: 3D Generation with Super-Aligned Texture
链接：https://arxiv.org/abs/2610.22352
作者：Chen Yang,Jiemin Fang,Fanpeng Meng,Zihao Huang,Jichen Pang,Guanjun Wu,Zhikuan Bao,Qi Tian
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：mesh with relightable, Single image, aims to dress, visual details, Single
备注： Project page: [this https URL](https://supra-3d.github.io/supratex/)
点击查看摘要
Abstract:Single image 3D generation aims to dress a given 3D mesh with relightable materials while faithfully preserving the visual details of a reference image. Existing methods either introduce artifacts when fusing inconsistent multi-view predictions or struggle to preserve fine details through implicit image-feature conditioning. To resolve these challenges, we introduce SUPRA-Tex, built on the principle of decoupling visible-material estimation, surface alignment, and observation-guided 3D completion. This division of labor allows the 3D generator, trained on limited 3D data, to focus its capacity on preserving visible evidence and completing unobserved surfaces. Specifically, we first train an MLLM-based image editing model to predict lighting-separated PBR maps in the reference view. We then project these maps onto the visible surface and encode them with the pretrained material VAE encoder into native observation latents that share the generation target's latent space. An interleaved flow transformer holds these latents as fixed, read-only anchors while alternating unobserved-region and full-surface updates to generate complete material latents. This design achieves super-alignment with the reference, delivering What You See Is What You Get fidelity on visible regions and coherent completion on unobserved surfaces. Trained solely on public datasets, SUPRA-Tex achieves SOTA performance in both geometry-conditioned texturing and end-to-end asset generation, matching or even exceeding leading commercial systems on in-the-wild images. Project page: this https URL
9. 【2610.22347】Speculative Forcing for Efficient Autoregressive Video Generation
链接：https://arxiv.org/abs/2610.22347
作者：Hyunwook Choi,Seungryong Kim,Dongyoon Han,Sangdoo Yun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Few-step autoregressive video, Few-step autoregressive, enable streaming generation, autoregressive video generators, video generators enable
备注：
点击查看摘要
Abstract:Few-step autoregressive video generators enable streaming generation, yet they run every token through the final denoising step, regardless of how much refinement it needs. We find this uniform computation is often unnecessary: many tokens already closely match their eventual full-step outputs in the initial steps, while others require refinement until the end. We introduce Speculative Forcing, a framework that treats intermediate clean estimates as drafts and predicts when individual tokens can be safely accepted early. Once accepted, a token is frozen as its final output and undergoes no further denoising, while its cached keys and values remain available as context for the remaining tokens. We explore two alternative verifier designs: a training-free one based on similarity to clean content and stability across steps, and a learned one that reads the frozen generator's intermediate features to estimate each token's remaining gap to its full-step output. Across short-video, long-video, and world generation, Speculative Forcing preserves the quality of full-step sampling while substantially reducing computation. On LongLive, it matches the four-step generator with ~1.7 denoising steps per token, running over 1.5x faster at 41.7 and 37.8 fps. On Lingbot-World 2.0, where camera motion continually changes the visible content, it maintains quality with ~2.5 denoising steps per token and runs 1.35x faster at 24.5 fps.
10. 【2610.22343】GeoState: Learning View-Decoupled Geometry States for 3D World Modeling
链接：https://arxiv.org/abs/2610.22343
作者：Hongchang Liu,Jian Liu,Yujuan Ding,Liang Peng,Xun Jiang,Fei Ma,Xing Xu,Yi Bin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：rich geometric priors, Recent, rich geometric, world, geometric priors
备注：
点击查看摘要
Abstract:Recent 3D world models increasingly use features from geometry foundation models (GFMs) as predictive world states, benefiting from their rich geometric priors. However, the view dependence of these features entangles scene dynamics with camera-induced variation, making the resulting state evolution harder to predict. We propose GeoState, a view-decoupled geometry representation for predictive 3D world modeling that separates scene-state evolution from camera-dependent observation. Specifically, a scene tokenizer aggregates multi-view GFM features into a view-decoupled scene state, which a geometry decoder queries using camera rays. An autoregressive world model then predicts future scene states, while camera motion is modeled separately. The predicted states can therefore be decoded under either predicted or externally specified cameras, while retaining a single context-derived scale throughout the rollout without per-frame scale alignment. Experiments show that GeoState outperforms prior 3D world models on Waymo, supports geometrically consistent cross-view querying, and generalizes zero-shot to KITTI and nuScenes. Project page: this https URL
11. 【2610.22341】3DCodeVerse: Exploring 3D Worlds as Code
链接：https://arxiv.org/abs/2610.22341
作者：Yipeng Gao,Ziyao Zeng,Jinfa Huang,Yijiang Li,Haolin Xiong,Wang Qin,Xinlei Yu,Youheng Yao,Jie Zhang,Kun-Yu Lin,Rong Liu,Yinyuan Zhao,Yajie Zhao,Meiqi Guo,Jiebo Luo,Lei Shu,Yunhao Ge,Xinyu Hu,Laurent Itti
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：editable and verifiable, research ecosystem, ecosystem that enables, create editable, enables coding agents
备注： Project Page: [this https URL](https://3dcodeverse.com/)
点击查看摘要
Abstract:We introduce 3DCodeVerse, a research ecosystem that enables coding agents to create editable and verifiable 3D content at scale. 3DCodeVerse comprises large-scale, high-quality datasets of executable 3D code, a coding harness for spatial reasoning and automated verification, and practical guidance for 3D coding. First, we construct 3DCodeVerse-2M, a large-scale curated dataset of standalone 3D executable code. We build this corpus by collecting open-source data, converting specialized representations, and generating new programs with coding agents. Each program is packaged with the source files and associated assets required for execution in its declared environment, along with available descriptions and verification records. Second, we develop the 3DCodeVerse Harness, a multi-agent directed acyclic graph framework for generating and refining 3D content. It uses execution checks, spatial measurements, and visual feedback to automatically evaluate and revise generated programs without human feedback during generation. Third, we conduct systematic empirical studies of 3D coding, establishing baselines with fine-tuned open models and deriving practical guidance through component-level analyses of our harness. Extensive experiments demonstrate that fine-tuning on our dataset significantly improves the 3D coding capabilities of open-source models. Notably, our 3DCodeVerse harness achieves a 90% win rate against Claude Design (3D Object) in pairwise human evaluations, when both are utilized by Claude Opus 5.5.
12. 【2610.22328】ACEdit: Stable Multi-Turn Image Editing via Asymmetric Conditioning
链接：https://arxiv.org/abs/2610.22328
作者：Sara Dorfman,Nir Goren,Gal Barak,Daniel Cohen-Or,Or Patashnik
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)
关键词：produce impressive results, models produce impressive, multiple editing turns, produce impressive, impressive results
备注： Project page: [this https URL](https://saradorfman1.github.io/ACEdit/)
点击查看摘要
Abstract:Image editing models produce impressive results for individual edits, but their quality often deteriorates over multiple editing turns. Each editing turn introduces small distribution shifts that accumulate over successive edits, creating a gap between the input distributions encountered during the editor's original training and multi-turn inference. We introduce a training scheme that makes multi-turn image editing stable under this accumulating distribution shift. A key is to force the editor to operate on its own outputs from previous editing turns during training, bringing the principle of Self-Forcing to image editing. The main challenge is that self-generated editing trajectories deviate from ground-truth trajectories, making direct supervision unreliable. We address this challenge through a distillation objective that leverages a teacher image editor to provide a reliable training signal when the model operates on its own previous outputs. We introduce an asymmetric conditioning scheme: while the student performs edits sequentially on its own outputs, the teacher remains anchored to the original clean image and receives a compound editing instruction. Experiments show substantially reduced degradation over long multi-turn sequences while maintaining editing quality and instruction adherence.
13. 【2610.22325】Dense4D: Pixel-Level 4D Human Correspondence
链接：https://arxiv.org/abs/2610.22325
作者：Rıza Alp Güler
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reconstructing human motion, Reconstructing human, requires identifying, Reconstructing, monocular RGB images
备注：
点击查看摘要
Abstract:Reconstructing human motion in 4D requires identifying the same surface points through articulation, deformation and changes in visibility. We introduce Dense4D, to our knowledge the first feed-forward model dedicated to dense 4D correspondence across the body, clothing and hair from a set of monocular RGB images, without a body template. Trained specifically for human geometry, Dense4D jointly processes person-centred crops with known image-to-crop transforms to predict Human Point Maps (HPMs) and depth for each image. An HPM assigns each person pixel the 3D position of its observed surface point at a common reference time. These maps support amodal correspondence: points hidden in the reference image can be localised from observations in other frames. Matching HPM coordinates across crops establishes correspondence without predicting camera poses or large scene displacements; per-image depth then lifts the matches into 3D tracks. Experiments on real people demonstrate substantially higher tracking accuracy and closer agreement with scanned surfaces than the evaluated baselines. Points from different frames assemble into coherent human geometry in the reference pose, providing visible evidence of consistent dense correspondence through articulation and clothing deformation. Additional qualitative results, videos, and an interactive viewer are available at this https URL.
14. 【2610.22321】AVC-Reward: Event-Centric Audio-Video Consistency Evaluation
链接：https://arxiv.org/abs/2610.22321
作者：Yuruo Wu,Kaihang Pan,Kai Shen,Jiacheng Li,Shuyuan Tu,Jisheng Dang,Li Tuoyu,Juncheng Li,Siliang Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：multi-layer audio mixture, audio-visual scenes exhibiting, generate audio-visual scenes, multi-event composition, forms of complexity
备注：
点击查看摘要
Abstract:As joint audio-video generation models become more capable, they can generate audio-visual scenes exhibiting three forms of complexity: multi-event composition, multi-layer audio mixture, and asymmetric cross-modal relations. However, current evaluations largely reuse metrics from earlier simple and unidirectional tasks. They typically evaluate an audio-video clip as a whole and rely on simple predefined relations, making them unsuitable for these increasingly complex scenes. We propose an event-centric evaluation framework that disentangles audio and visual events at the event level, analyzes each event independently, cross-validates relations across modalities, and aggregates the judgments into a coarse-to-fine, three-level consistency metric. The metric assesses global narrative harmony, event-level temporal synchronization, and fine-grained attribute alignment, providing a general formulation for audio-video consistency evaluation across diverse generation settings and cross-modal relations. We instantiate the metric as AVC-Reward, a trainable audio-video reward model. To evaluate the agreement between automatic judgments and human perception across generation paradigms and relation complexities, we construct AVC-Benchmark, which is primarily built from diverse positive and negative samples generated by various types of audio-video generation models. AVC-Reward achieves state-of-the-art alignment with human judgment among automatic methods, provides interpretable rationales that localize failures, and improves the audio-video consistency of a joint generation model when used as an online reinforcement-learning signal. Project page: this https URL
15. 【2610.22320】Not Just a Subject: Capturing Adaptive Scene-Specific Variance for Visual Storytelling
链接：https://arxiv.org/abs/2610.22320
作者：SeungJu Cha,Ye-Chan Kim,Kwanyoung Lee,Dong-Jin Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：coherent image sequences, Recent advancements, significantly improved, enabling their application, visual storytelling
备注： Accepted at ACCV 2026. Code: [this https URL](https://github.com/SeungJuCha/EOS-Story)
点击查看摘要
Abstract:Recent advancements in diffusion models have significantly improved text-to-image generation, enabling their application to visual storytelling, where coherent image sequences are generated from narrative prompts. However, existing methods primarily focus on identity preservation and often fail to adapt to diverse scene variations, resulting in semantic misalignment and structural inflexibility. We propose EOS-Story, a training-free framework that harmonizes identity consistency with scene-specific adaptation across text and vision spaces. In the text space, we decouple the narrative into identity and scene sub-prompts to prevent information dilution, but this leaves the scene without access to appearance cues. To bridge this gap, we introduce Cross-Contextual Bridging, which softly injects a phrase-level appearance residual into the scene's EOS embedding. In the vision space, we find that scale mismatch between identity and scene subjects causes a few identity tokens to be repeatedly transferred, producing structural artifacts. We address this with Adaptive Identity Preservation, which anchors identity features at the scene-specific scale (Identity Anchoring) and integrates them via Identity-Aware Self-Attention. To evaluate performance under varied spatial compositions, we extend the Consistory+ benchmark with diverse framing scenarios (Consistory+_+). Extensive experiments show that EOS-Story achieves competitive or superior performance on both benchmarks.
16. 【2610.22311】Velox: Spatial Memory Makes World Models Efficient
链接：https://arxiv.org/abs/2610.22311
作者：Qiuhong Shen,Shizun Wang,Xinchao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：world models turn, models turn actions, interactive simulation, Video world models, long visual rollouts
备注：
点击查看摘要
Abstract:Video world models turn actions and camera motion into long visual rollouts, making video a natural interface for interactive simulation. Such interaction requires responsive generation, yet coherent rollouts must retain visual memory of what has already been generated. Chunked video diffusion models usually keep this context in growing KV caches, so later chunks become progressively slower. To address this bottleneck, we introduce Velox, a training-free attention router for region-level context selection using frustum slab correspondences from streaming geometry. Velox represents historical blocks as camera frustum slabs with depth intervals and obtains current-block depth through recency-priority multiwarp. For well-covered regions, frustum slab overlap softly modulates each layer's model-derived block importance. Uncovered regions retain the model-derived route without geometric bias. The fixed token-block granularity matches FlashAttention-style tiled execution and reduces the attention term that grows with rollout length. Frustum slab construction runs asynchronously with denoising on the same H200. At chunk 48, Velox accelerates attention by $4.36\times$ and denoising by $2.43\times$. On the full 158-case WBench navigation split, it remains within 0.15 API-free average points of dense LingBot-Fast-Cam. Please see our project page at this https URL for more details.
17. 【2610.22306】ARC-SORT: Adaptive, Robust, Compensated Multi-Object Tracking with Interacting Multiple Models
链接：https://arxiv.org/abs/2610.22306
作者：Girish Kumar Adari
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：change direction abruptly, athletes move fast, athletes move, direction abruptly, sports broadcasts
备注： 14 pages, 4 figures, 13 tables; supplementary material included as appendix; qualitative video as ancillary file
点击查看摘要
Abstract:Multi-object tracking in sports broadcasts is hard for two reasons: athletes move fast and change direction abruptly, and the camera pans and zooms at the same time. We present ARC-SORT (Adaptive, Robust, Compensated SORT), a tracking-by-detection tracker that trains nothing and runs in real time. Its design rule: the tracker measures its own uncertainty, and that measurement decides how it acts. An Interacting Multiple Model (IMM) Kalman filter gives every track a predictive covariance, and we turn it into a per-track search region: the less reliable the motion prediction, the larger the region in which a detection may match (uncertainty-adaptive Expansion IoU, EIoU). On identical inputs, this continuous coupling is what matters: the same covariance used as a hard Mahalanobis gate hurts at every threshold we swept, and richer covariance summaries add nothing measurable. When two tracks cross, the assignment cost itself reports whether the decision was close. ARC-SORT keeps such pairs under review and applies at most one corrective identity swap once post-crossing appearance evidence shows the first decision was wrong; this adds +1.0 HOTA (higher order tracking accuracy) on both the SportsMOT and DanceTrack test sets at under a millisecond per frame. For players who leave the frame for seconds, motion extrapolation carries no information, so our offline re-identification drops the usual motion gate and links tracklets by appearance alone. ARC-SORT reaches 81.82 HOTA on the SportsMOT test set with the fewest identity switches of the 69 leaderboard entries as of August 2026 and tied-third multi-object tracking accuracy (MOTA, 97.09), and 62.1 HOTA on DanceTrack test with the same association settings. On Deep-EIoU's public detections and embeddings it reaches 80.31 HOTA, +3.1 over Deep-EIoU. It runs at about 50 frames per second on a laptop RTX 3060 GPU. Code will be released.
18. 【2610.22295】Grounded Human-Attributed Description and Activity Recognition in Videos
链接：https://arxiv.org/abs/2610.22295
作者：Jay N. Paranjape,Jurijs Nazarovs,Rohan Sarkar,Yue Guo,Lipeng Ke,Sankar Venkataraman,Vishal M. Patel,Nataraj Jammalamadaka
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：complex multi-person environments, activity recognition, single-person activity recognition, Understanding characteristics, group activity recognition
备注：
点击查看摘要
Abstract:Understanding characteristics and activities of individuals in complex multi-person environments is crucial for real-world applications. However, existing datasets often simplify this problem to grounded group activity recognition, single-person activity recognition, or close-set activity recognition, thus limiting the generalizability of models trained on these datasets. In this work, we introduce the task of Grounded Human-Attributed Description and Activity Recognition (GHADAR), which involves describing the characteristics and activity descriptions of \textbf{every} person in a video, provided the location of the person in the video, which is more practical for real-world applications. To facilitate this, we introduce a new dataset derived from AVA-Actions by generating open-set captions for the person description and activity. In addition, we propose a novel method to effectively utilize the information contained in grounding during training by constraining the cross-attention masks during training in VLMs to improve performance for this task. Our experiments show that our method outperforms SOTA VLMs on this task. Finally, we demonstrate the limitations of existing evaluation metrics, which are overly reliant on human-annotations and exact text-text matching. As an added video-based evaluation, we propose a holistic VLM-based evaluation schema that compares concepts {\em directly} between the video and the generated predictions. Thus, in this work, we develop a complete framework for GHADAR, including a dataset, a novel method and an evaluation schema, thereby establishing a strong foundation for future research in this domain.
19. 【2610.22282】Routing Policy Optimization for Online Diffusion Reinforcement Learning
链接：https://arxiv.org/abs/2610.22282
作者：Qiuhong Shen,Yiding Yang,Yuxin Zhang,Xinwei Huang,Minxuan Lin,Bo Liu,Hao Kang,Haotian Yang,Yizhi Wang,Chongyang Ma,Xinchao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：typically introduce stochasticity, costly rollout-based optimization, Reinforcement learning, reverse denoising trajectory, methods typically introduce
备注：
点击查看摘要
Abstract:Reinforcement learning can align visual generators with reward signals beyond their pretraining objectives, but existing score-function methods typically introduce stochasticity by perturbing the reverse denoising trajectory, leading to costly rollout-based optimization. We instead ask whether stochastic exploration can be introduced inside the generator while preserving its original sampler. Routing Policy Optimization (RPO) answers this question by turning attention routing into a stochastic exploration action. At a few selected denoising levels, each query block keeps its own block and samples further key blocks in proportion to the generator's native attention mass, or keeps dense attention. The sampled route perturbs the velocity of that transition, and a Gaussian likelihood around the dense velocity scores the perturbation with a score-function objective. RPO further uses a controlled two-rollout estimator: two rollouts share the same prompt, initial latent, routed denoising levels, and dense anchor layers, differing only in their sampled attention routes. Their reward difference provides an advantage signal for the routed transitions. Because the likelihood differentiates the dense velocity itself, the learned updates remain effective after routing is removed. At inference, RPO restores dense attention and retains the original deterministic sampler. Experiments on text-to-image and text-to-video generation show that RPO improves generation quality while achieving nearly 4x higher training efficiency than Flow-GRPO-style methods. Please see our project page at this https URL for visual results.
20. 【2610.22276】MJev-Spatial: System One Spatial Intelligence via Native Attention Matching
链接：https://arxiv.org/abs/2610.22276
作者：Luozheng Qin,Yuhan Zhu,Changhai Zhou,Qian Qiao,Jun Gao,Yuhua Zhou,Harry Zhang,Xiangyu Zeng,Yuxuan Liu,Kaijie Chen,Andrew Chen,Pony Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：spatial relation holds, physical world, interaction rates, relation holds, agent perceive
备注： 37 pages, 7 figures, 27 tables. Code: [this https URL](https://github.com/Fr0zenCrane/MJev-Spatial)
点击查看摘要
Abstract:Spatial intelligence lets an agent perceive and act in the physical world, and many of its judgments must be made at interaction rates: which spatial relation holds, how far an object is, or where to place it. Vision-language models (VLMs) produce these answers by free-form text generation, paying for autoregressive decoding and answer parsing even though the output space is compact: one of a few options, a scalar, or a 2D point. In light of this, we introduce MJev-Spatial, a System 1 multimodal decision model that tackles all three types of spatial understanding tasks within a unified classification framework. Specifically, MJev-Spatial treats each candidate as a class and scores it using the backbone's pretrained query and key projections, without adding parameters. The candidates are the given options for choice tasks, or value bins and image regions refined through coarse-to-fine classification for numerical and point prediction, respectively. At inference, each classification decision takes a single forward pass and generates no answer tokens. To train on heterogeneous spatial data efficiently, we supervise all coarse-to-fine stages jointly with teacher forcing in one forward pass, and combine this with length-aware global batching and cross-GPU load balancing, raising training throughput by 30.8% over the original batching strategy. Built on Qwen3.5-4B and trained on 12.3M question-answer pairs converted from existing spatial datasets, MJev-Spatial achieves the highest overall score (65.64%) among eight tested models, ranks first on seven of twelve benchmarks, and outperforms its unmodified autoregressive base model on all twelve, while running 2.5 times faster than the fastest autoregressive baseline and 5.6 times faster than the base model.
21. 【2610.22270】Unsupervised Clustering of Public Transport Vehicles Using Deep Morphological Features and Color Histograms
链接：https://arxiv.org/abs/2610.22270
作者：Juan Irving Vasquez
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：annotation remains challenging, produce large volumes, manual annotation remains, urban roads produce, roads produce large
备注： Conference paper: under review
点击查看摘要
Abstract:Surveillance cameras along urban roads produce large volumes of unlabeled video that could support the monitoring of public transport, but grouping the observed vehicles into meaningful categories without manual annotation remains challenging, since buses from different routes often share the same body structure and differ mainly in their color schemes. This study presents an unsupervised clustering methodology for public transport vehicles that combines morphological features extracted with a frozen DINOv2 Vision Transformer and handcrafted HSV color histograms through weighted early fusion, followed by UMAP projection and K-Means clustering. The method was evaluated on 7,972 bus images extracted from about 1,460 hours of video of an arterial road in Mexico City, with the goal of isolating the buses of the city's public bus network (RTP) without supervision. With a fusion of 65\% morphological and 35\% color features, the pipeline produced 14 clusters that separate distinct routes and vehicle types, and it increased the precision of the target cluster with respect to morphological features alone. These results show that color complements self-supervised features for route-level clustering, provided that it does not dominate the representation.
22. 【2610.22267】Beyond Pairwise Repulsion: Collective Diversity via Determinant Maximization in Diffusion Sampling
链接：https://arxiv.org/abs/2610.22267
作者：Kwanyoung Lee,SeungJu Cha,Yebin Ahn,Sungho Koh,Dong-Jin Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diffusion models concentrates, collapsing independently sampled, identical visual prototypes, models concentrates sampling, Strong guidance
备注： ACCV 2026, oral presentation
点击查看摘要
Abstract:Strong guidance in text-to-image (T2I) diffusion models concentrates sampling toward high-density modes of the conditional distribution, collapsing independently sampled noise vectors onto nearly identical visual prototypes. This limits utility for tasks that demand distributional breadth, most critically synthetic data augmentation. Diversity, however, is a collective property of the whole batch: a set can preserve every pairwise distance yet still collapse onto a low-dimensional subspace. Existing sum-of-pairwise noise-optimization and repulsion objectives respond only weakly to this higher-order failure. We propose DetNO (Determinant Noise Optimization), which formulates diverse generation as RKHS volume maximization on the initial noise, maximizing the log-determinant of an RBF Gram matrix over one-step Tweedie predictions. This set-level functional equals the squared batch volume; its repulsion is strongest when the batch is most collapsed and self-attenuates as diversity is achieved. An anchor-based fidelity term keeps the optimized noises near plausible regions, and Lagrangian relaxation gives a two-term objective with a single hyperparameter $\lambda$ governing the diversity-quality trade-off, without training or sampler modification. Across three backbones (SD1.5, SDXL, SD3), DetNO achieves leading intra-batch diversity in VendiScore and Mean Self-Similarity, and a downstream few-shot classification experiment confirms that broader mode coverage brings statistically significant accuracy gains for synthetic data augmentation in the low-shot regime. Fixing the pipeline and varying only the batch objective, both RBF-based aggregators outperform InfoNCE, and the log-determinant attains the best downstream accuracy on both benchmarks. Its diversity advantage over InfoNCE widens as the batch grows. Code is available at this https URL.
23. 【2610.22264】SCOPE: Semantic Bounded Credit Optimization for Prompt Engineering in Text-to-image Generation
链接：https://arxiv.org/abs/2610.22264
作者：Yufei Jiao,Jinfa Huang,Zeyue Xue,Tianyu Xie,Yuexiao Ma,Rongrong Ji,Xiawu Zheng,Jiebo Luo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enables language models, Reinforcement learning, frozen image generator, enables language, models to improve
备注： Code: [this https URL](https://github.com/MAC-AutoML/SCOPE)
点击查看摘要
Abstract:Reinforcement learning (RL) enables language models to improve text-to-image (T2I) generation by rewriting prompts for a frozen image generator. Existing methods typically apply a single signal derived from the image to individual subword tokens, although objects, counts, attributes, and relations form coherent semantic spans. We propose SCOPE, an objective based on Group Relative Policy Optimization (GRPO) that aligns update weighting with this structure. The rewriter jointly generates an enhanced prompt and its semantic partition. SCOPE pools shifts in policy log probabilities within each span to derive a shared coefficient for its token losses while retaining a single advantage for each completion. It requires neither separate span rewards nor additional image renders. Across Qwen-Image, SD3, and FLUX.1-dev, SCOPE achieves average relative gains over vanilla GRPO of 9.48% on GeneVal and 7.62% on T2I-CompBench. Ablation studies show that both semantic boundaries and pooling within spans contribute to these gains, supporting semantic structure as a practical inductive bias for prompt engineering with RL.
24. 【2610.22259】FPG-Seg: Annotation-free Retinal Vessel Topology Segmentation
链接：https://arxiv.org/abs/2610.22259
作者：James Willoughby,Irina Voiculescu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：highly time-consuming process, typically require extensive, retinal vessel segmentation, segmentation typically require, require extensive annotations
备注：
点击查看摘要
Abstract:State-of-the art approaches to retinal vessel segmentation typically require extensive annotations, a highly time-consuming process, reliant on clinical expertise. We present FPG-Seg, an annotation-free pipeline for retinal vessel segmentation combining classical vesselness filtering, Bayesian deep learning and topology-aware graph reconstruction to segment retinal vessel topology without manual labels. Tested across four widely used benchmark datasets for retinal vessel segmentation, FPG-Seg attains a clDice of $0.74{-}0.78$, representing $86{-}98\%$ of the performance of an equivalent fully-supervised baseline, despite using no manual annotations for training or hyperparameter tuning. As part of this work, we also provide, to our knowledge, the first performance benchmark of an annotation-free vessel segmentation method on FIVES.
25. 【2610.22240】MMSearch-OPD: Easy Made Hard, Hard Made Learnable for Long-Horizon Multimodal Search Agents
链接：https://arxiv.org/abs/2610.22240
作者：Huanyao Zhang,Jiepeng Zhou,Jiaye Lin,Ontai Tang,Jingtian Hao,Mugeng Liu,Ru Peng,Lang Mei,Xiaohan Yu,Liyan Liu,Chong Chen,Wentao Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：continually acquire evidence, moving from short, short queries, investigations that continually, continually acquire
备注：
点击查看摘要
Abstract:Multimodal deep search is moving from short queries to long-horizon investigations that continually acquire evidence. However, training such agents remains constrained by limited challenging training questions and insufficient process feedback. We introduce MMSearch-OPD, combining controllable data refinement with joint reinforcement learning (RL) and on-policy distillation (OPD). Our Refine pipeline performs targeted expansion of reasoning chains derived from existing simple multimodal questions. Parameterized transformations control search depth and cross-modal evidence requirements while reusing existing image--question pairs. For training, answer rewards and lightweight behavior penalties guide RL, while the reward gap modulates token-level teacher guidance on imperfect student trajectories. An exponentially decaying distillation coefficient reduces teacher dependence as training proceeds. Experiments show gains from data refinement and further improvements from joint training after SFT, indicating stronger long-horizon multimodal deep search capabilities.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2610.22240 [cs.CV]
(or
arXiv:2610.22240v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.22240
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
26. 【2610.22234】OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents
链接：https://arxiv.org/abs/2610.22234
作者：Bowen Yang,Kaiming Jin,Zichen Ding,Zhenyu Wu,Zehao Li,Zhoumianze Liu,Kanzhi Cheng,Fangzhi Xu,Yanan Sun,Qiushi Sun,Yu Qiao
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Real desktop automation, purely programmatic, purely visual, Real desktop, GUI
备注： Project page: [this https URL](https://os-copilot.github.io/OS-Helix/)
点击查看摘要
Abstract:Real desktop automation is neither purely visual nor purely programmatic. Agents must understand user-facing interfaces while efficiently manipulating files, scripts, and system state. However, native GUI/code coordination cannot be obtained by prompt-level tool composition. In our preliminary experiments, naively adding a code tool degrades a GUI agent, revealing that GUI/code routing must be internalized through training on high-quality hybrid data. We present OS-Helix, an end-to-end trained multimodal computer-using agent that unifies GUI actions and code execution in one action space. To construct the required supervision, we introduce application-artifact composition, pairing desktop applications with authentic file artifacts to instantiate executable Ubuntu states, and a decoupled instruction/evaluator generation pipeline that produces environment-grounded tasks whose final states can be verified regardless of the solution modality. We cold-start the policy with SFT on filtered hybrid data and further improve it through online RL in live desktop environments. For RL, we propose Step-balanced GSPO, which aggregates importance weight by action step rather than raw assistant tokens to prevent long code actions from dominating heterogeneous-action optimization. On OSWorld-Verified, OS-Helix-27B and OS-Helix-35B-A3B achieve relative improvements of 35.0% and 33.7% over their matched Qwen3.5 hybrid baselines, while OS-Helix-27B-RL further improves by 42.9% to reach 66.44% success. Ablations provide evidence consistent with contributions from learned GUI/code coordination, scalable verifiable supervision, and action step balanced optimization, while demonstrating cross-platform transfer on WindowsAgentArena. Our project homepage is at this https URL.
27. 【2610.22232】WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression
链接：https://arxiv.org/abs/2610.22232
作者：Yue Yu,Bowei Kang,Changsheng Gao,Dong Liu,Xiaoyan Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：compression fundamentally relies, large language model, accurate entropy modeling, image compression fundamentally, Lossless image compression
备注： Accepted at ACM Multimedia 2026 (MM '26). 10 pages, 6 figures
点击查看摘要
Abstract:Lossless image compression fundamentally relies on accurate entropy modeling, driving a recent shift toward large language model (LLM)-based methods. However, existing approaches mainly emphasize the modeling capacity of LLMs while directly serializing images into pixel or residual sequences, leaving heterogeneous signal patterns entangled within a single prediction stream. In this paper, we argue that effective entropy modeling depends not only on model capacity, but also on the predictability of the input representation. Motivated by this insight, we propose WaveLLM, a wavelet-domain LLM-based entropy model for lossless image compression. By decomposing an image into multi-level wavelet subbands, WaveLLM converts a heterogeneous prediction problem into a set of more structured and statistically homogeneous subproblems that are more amenable to autoregressive probability estimation. To bridge numerical coding symbols with the LLM's native text token space, we introduce a dedicated numerical interface featuring value embeddings and a coefficient prediction head. Furthermore, a task-adaptive prompting strategy is designed to enable a single shared model to adapt to diverse subbands within a unified framework. Built on Llama-3.2-3B with LoRA adaptation, WaveLLM achieves 2.51, 2.24, and 2.27 bpsp on Kodak, this http URL, and DIV2K, respectively, outperforming the PixelCNN-based codec using the same wavelet transform by 0.43, 0.36, and 0.46 bpsp, and surpassing recent LLM-based lossless compressors on all three benchmarks.
28. 【2610.22221】How Much Physics Can Vision Learn from Audio? Probing and Distilling Damping Structure
链接：https://arxiv.org/abs/2610.22221
作者：Zainab Afolabi,Vadim Selyutin,Zhao Gao,Babs Khalidson,Mohamed Ghoneim
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD)
关键词：Physical understanding, vision models struggle, decision making, understanding is crucial, crucial for decision
备注： 11 pages, 2 figures, 7 tables. Accepted at two NeurIPS 2026 workshops: Representations for the Physical Sciences (RPS) and Physical Understanding for Decision-Making (PhysUnderstand)
点击查看摘要
Abstract:Physical understanding is crucial for decision making, yet vision models struggle to infer properties such as damping that govern how materials behave. Audio encodes such properties directly, because an object's acoustic response to impact reveals its damping through measurable decay. We probe frozen encoders for the quality factor $Q$, a dimensionless measure of how many oscillations an object completes before its ring dies away, and report how well each embedding orders impacts by $Q$ using the Spearman rank correlation $\rho$, for which $\rho=1$ is a perfect ordering and $\rho=0$ an unrelated one. Audio embeddings reach $\rho=0.73$ and retain most of that advantage on materials withheld from training, while a single video frame taken at the moment of impact, encoded by CLIP, supports only $\rho=0.28$. Having established where the signal lives, we ask how much of that gap vision can recover. We distill a frozen audio teacher into a frozen CLIP backbone through a trained projection head and find that this recovers a useful fraction of the audio advantage. Because pooled correlations on this task are dominated in practice by category identity, we also evaluate under a leave-one-material-out protocol in which the held-out material is withheld from the projection head as well as the probe. Distillation with a four-frame input improves the correlation there from 0.234 to 0.338 (+0.053 over the matched four-frame baseline, 14 of 17 materials), a gain that no category-level strategy can produce. Widening the visual input to four frames spanning the impact supplies half of that improvement at no acoustic cost, which indicates that part of what a single frame misses is visible dynamics.
29. 【2610.22217】Skill-Decoupled On-Policy Expert Distillation for Unified Vision-Language Models
链接：https://arxiv.org/abs/2610.22217
作者：Yuqi Xiong,Chunyi Peng,Zhipeng Xu,Qing Yang,Zhenghao Liu,Zulong Chen,Yu Gu,Ge Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：cross-capability gradient conflicts, jointly optimizing heterogeneous, optimizing heterogeneous objectives, introduces cross-capability gradient, Reinforcement learning
备注：
点击查看摘要
Abstract:Reinforcement learning (RL) can elicit specialized visual capabilities in vision-language models (VLMs), yet jointly optimizing heterogeneous objectives often introduces cross-capability gradient conflicts. Training experts independently mitigates this interference, but direct reward optimization may entangle specialized knowledge with reward-hacking biases. This paper proposes Skill-Decoupled On-Policy Expert Distillation (SCOPED), which trains capability-specific experts and extracts explicit skills through reward-guided reflection. During on-policy distillation, these skills guide expert supervision while remaining unavailable to the unified student, encouraging it to internalize procedural knowledge without explicit skills at inference time. Across eight multimodal benchmarks, SCOPED consistently outperforms the backbone and mixed-capability RL, demonstrating the effectiveness of skill-decoupled on-policy expert distillation for integrating independently acquired capabilities. Further analyses reveal interference during joint capability optimization and suggest that skill augmentation promotes more consistent expert trajectories, greater attention to task-relevant visual evidence, and better preservation of specialized expertise in the unified student. All code and data are available at this https URL.
30. 【2610.22215】FutureLift: Lifting Trajectory Proposals into Bidirectional Future Graphs for Motion Forecasting
链接：https://arxiv.org/abs/2610.22215
作者：Daniel Grimm,J. Marius Zöllner
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：safe autonomous driving, strong forecasters leave, Accurate motion prediction, forecasters leave residual, leave residual errors
备注： Accepted for presentation at WACV 2027
点击查看摘要
Abstract:Accurate motion prediction is critical for safe autonomous driving, yet even strong forecasters leave residual errors in their multimodal proposals. Existing refiners compress complete proposals or update their segments sequentially, preventing the full proposed future from serving as explicit relational context for correction. We introduce FutureLift, a backbone-agnostic refiner that represents each multimodal proposal as a heterogeneous future graph, with spatially grounded temporal nodes connected to agent histories, map elements, alternative modes, and, for joint prediction, other agents future trajectories. Bidirectional temporal edges allow later evidence to revise earlier segments in a single pass, and the updated nodes predict residual coordinate and confidence corrections. Requiring only proposals, scores, and scene context, FutureLift provides a common refinement interface for structurally different forecasting backbones. On Argoverse2 and the Waymo Open Motion Dataset, it consistently improves frozen proposals and outperforms native and specialized refiners across marginal and joint forecasting. On the WOMD motion-prediction leaderboard, FutureLift ranks first in minADE (0.5049m) and minFDE (0.9942m) among the compared standard-input methods, without LiDAR or ensembling, while achieving a competitive 0.4874 Soft mAP.
31. 【2610.22210】RACE: Topology-Aware Reconnection via Prediction-Adaptive Connectivity Enforcement for Thin-Structure Segmentation
链接：https://arxiv.org/abs/2610.22210
作者：Junho Moon,Ikbeom Jang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：elongated structures, continuous paths, mistakes can disrupt, disrupt otherwise continuous, Thin
备注： Accepted to WACV 2027
点击查看摘要
Abstract:Thin, elongated structures are particularly sensitive to connectivity errors, as even a few local segmentation mistakes can disrupt otherwise continuous paths. Existing skeleton-based objectives typically supervise fixed centerline locations and do not account for alternative local routes that may restore connectivity. We propose TRACE, a topology-aware, prediction-adaptive objective that uses a target skeleton to define required local connections. For each connection, TRACE identifies the easiest valid reconnection under the current prediction and jointly supervises its bottleneck with the corresponding skeleton point. The supervision thus adapts to the evolving prediction rather than remaining fixed to the centerline. We further introduce a topology-aware skeleton carrier that preserves both foreground and class-specific topology, enabling reliable definition of these connections. Extensive experiments across six 2D and 3D benchmarks show that TRACE improves connectivity and topology while maintaining strong segmentation accuracy with low training overhead. Code will be released upon acceptance.
32. 【2610.22200】OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use
链接：https://arxiv.org/abs/2610.22200
作者：Hanzhang Zhou,Long Li,Quyu Kong,Lei Wang,Panrong Tong,Long Chen,Tianyu Xia,Gongjie Zhang,Xu Zhang,Chen Liu,Jianan Zhang,Chenglin Cai,Zhengwen Zeng,Steven Hoi,Yue Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual and programmatic, programmatic interfaces, reached a turning, focus is expanding, Open Generalist CUA
备注：
点击查看摘要
Abstract:Computer use has reached a turning point: the focus is expanding from GUI-only interaction to systems that complete tasks on users' computers through visual and programmatic interfaces. We define a generalist computer-use agent (GCUA) as a system in which the model chooses how to observe, act, and organize its work across visual and programmatic interfaces. Yet frontier implementations, such as GPT-6 Astra's computer-use system, remain largely closed, limiting systematic study of their design. We introduce Open Generalist CUA (OpenGCUA), an ongoing project to develop and open the full stack for GCUAs with the community. This report presents the first release of OpenGCUA. Code execution is a key feature of our agent design: it lets intermediate results determine subsequent operations and enables models to apply their existing programming capabilities directly to computer interaction. We also propose harness-to-model decision transfer, moving selected observations and task-state decisions from fixed harness rules to the model. On OSWorld-v2, our full configuration improves task scores across all eight evaluated models, including GPT-6 Astra and Claude Opus 5, raising mean partial score by +19.6 points and reducing reported steps per task by an average of 53.0% relative to batched GUI-only execution. We release our implementation and prompts, evaluation trajectories from all eight models, and preliminary versions of a real-device harness and a cross-device SDK. The harness addresses real-device challenges not fully captured by benchmarks, while the SDK provides a common programming interface across computers, mobiles and browsers. Across four real macOS tasks under our real-device harness, selected Qwen3.8-Max runs use 19.4 times as many reported reasoning tokens as GPT-6 Astra, highlighting substantial differences between models in real-device execution efficiency.
33. 【2610.22186】EVA-Cap: Optimizing Audiovisual Video Captioning via Event-Centric Alignment
链接：https://arxiv.org/abs/2610.22186
作者：Jiapeng Shi,Qiuxia Hou,Jiaqi Leng,Junke Wang,Yanhao Zhang,Haonan Lu,Ziyi Ye,Zuxuan Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Omni Language Models, Omni Language, Recent advances, advances in Omni, Language Models
备注： Accepted at NeurIPS 2026. Code will be released at [this https URL](https://github.com/OPPO-Mente-Lab/EVA-Cap)
点击查看摘要
Abstract:Recent advances in Omni Language Models (OLMs) provide a unified solution for audiovisual video captioning. Nevertheless, existing approaches predominantly treat captioning as an unstructured text generation process, neglecting the inherent semantic structure of videos and leading to suboptimal fine-grained audiovisual alignment. To bridge this gap, we propose EVA-Cap, a novel framework that decomposes captions into atomic audiovisual events and transforms unstructured text supervision into event-centric alignment. We train EVA-Cap via Supervised Fine-Tuning (SFT) and Group Relative Policy Optimization (GRPO) on a self-curated dataset, EVA-Data, which is built with event-centric quality control. During the GRPO phase, the model is explicitly optimized against three event-centric alignment targets: global event completeness, intra-event attribution, and inter-event synchronization. Extensive experiments demonstrate that EVA-Cap significantly outperforms existing methods in event-centric evaluation (e.g., +9.0% average gain on ChronusAV), while achieving competitive performance on general audiovisual captioning benchmarks (e.g., +3.3% on WorldSense).
34. 【2610.22182】LAMP: Layerwise Adaptive Mixing of Predictors for Training-Free Few-Shot Vision-Language Adaptation
链接：https://arxiv.org/abs/2610.22182
作者：Zhipeng Ye,Feng Jiang,Qiufeng Wang,Hao Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：intermediate layers underused, final global representation, Layerwise Adaptive Mixing, encoder final global, adaptation often relies
备注：
点击查看摘要
Abstract:Few-shot adaptation often relies on an encoder's final global representation, leaving complementary information in intermediate layers underused. Combining these features is challenging because their dimensions can differ and their usefulness varies across tasks. We propose LAMP, Layerwise Adaptive Mixing of Predictors, a training-free framework that combines global and regional information from multiple encoder layers. A single forward pass per view supplies all descriptors. Global and support-calibrated regional kernel predictors independently fit the same label residuals. Labeled validation data select their mixture in class-score space, preserving native feature dimensions without learned projections. LAMP-F further adapts text-anchored class prototypes, using a cached response to update the fixed-kernel residual predictions exactly. Experiments cover eleven datasets and ViT and ResNet backbones. LAMP achieves state-of-the-art mean accuracy among the compared published training-free ResNet-50 methods at 4, 8, and 16 shots, reaching 78.73% at 16 shots. Averaged across five support budgets, LAMP improves over a paired global-feature-only baseline by 1.14 and 1.59 percentage points on ViT-B/16 and ResNet-50; LAMP-F raises these gains to 1.96 and 2.54 points. LAMP-F reaches 16-shot accuracies of 83.57% and 79.10%, respectively. Controlled experiments identify multi-layer integration as the main source of improvement and examine pooling, calibration, validation labels, and computational cost. These findings show that combining layer-specific predictions can exploit complementary features from frozen encoders to improve few-shot classification.
35. 【2610.22178】REKI: Registering Knowledge in VLAs
链接：https://arxiv.org/abs/2610.22178
作者：Juliette Marrie,Paul Pacaud,Adrien Ramanana Rahary,Shizhe Chen,Moritz Böhle
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Pareto frontier, introduce REKI, frontier between performance, model size, pretrained exclusively
备注：
点击查看摘要
Abstract:We introduce REKI, a 2.4B vision-language-action model (VLA) pretrained exclusively on public data that sets a new Pareto frontier between performance and model size: on LIBERO-Plus, RoboTwin Clean2Rand and RoboCasa365, it is outperformed only by models about twice its size. REKI consists of a vision-language model (VLM) followed by a flow-matching action expert, and is pretrained on a curated mixture of public robot, egocentric human and vision-language data. Additionally, we endow it with a memory that gives the policy access to its recent past at negligible cost: a few register tokens in the action expert summarise the output of the VLM at each frame and persist in the expert's cache. This memory improves success in simulation and on real robots, and makes oscillations between poses about four times rarer. REKI uses a simple model design and training paradigm, and is optimised to be efficient at training and inference. We release the full code across data curation, training, inference and evaluation, deployment, and all pretrained and finetuned model weights: this https URL.
36. 【2610.22177】Motion- and Gravity-Aware Feedforward 3D Reconstruction
链接：https://arxiv.org/abs/2610.22177
作者：Shiyao Qian,Yuan Ren,Dongfeng Bai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：recently achieved strong, achieved strong performance, weak geometric cues, performance in multi-view, recently achieved
备注：
点击查看摘要
Abstract:Feed-forward transformer models have recently achieved strong performance in multi-view 3D reconstruction, but they still rely primarily on appearance-based attention and often struggle in dynamic scenes with weak geometric cues. In this work, we introduce a motion- and gravity-aware framework under the Learning Using Privileged Information (LUPI) paradigm. During training, residual optical flow and gravity direction are provided as privileged signals to guide geometric representation learning; during inference, the model uses standard visual inputs only. We integrate these priors into transformer backbones with lightweight architectural changes, preserving feed-forward efficiency. Experiments on standard benchmarks show consistent gains in reconstruction accuracy and robustness, especially in scenes with dynamic objects, ambiguous structure, and challenging camera motion. Our analysis further shows that the optimal injection stage is backbone-dependent: middle-layer integration is generally preferable for VGGT, while late-stage integration is more effective for {\pi}3. These results suggest that LUPI offers a practical way to inject motion and physical priors into feed-forward 3D reconstruction without increasing test-time complexity.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2610.22177 [cs.CV]
(or
arXiv:2610.22177v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.22177
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
37. 【2610.22143】FALCON: FPGA-Accelerated Latency-Certifiable Occupancy Networks for Camera-Based Autonomous Driving
链接：https://arxiv.org/abs/2610.22143
作者：Haohua Que,Mingkai Liu,Handong Yao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：low average latency, low average, average latency, perception system, frame
备注： Accepted to WACV 2027 (Applications track). 10 pages
点击查看摘要
Abstract:A perception system that must brake for a pedestrian does not need a low average latency. It must deliver an answer before the deadline on every frame, the worst case included. Commodity edge accelerators optimize the mean through dynamic scheduling, OS jitter, thermal throttling, and contention, so their per-frame latency can be measured but not bounded. We build FALCON, a camera-based 3D occupancy front-end on the AMD Kria KR260, an embedded FPGA drawing 4.3 W idle and up to 6.6 W under inference, and make the latency guarantee layered and explicit: programmable-logic (PL) compute is cycle-bounded analytically; inference is a measured envelope over 100k-frame traces; and a watchdog enforces output delivery, publishing the previous output flagged stale when a frame is late. The deadline runs use a fixed-work proxy of six ResNet-50 DPU inferences per frame, not the full occupancy network: across three 100k-frame enforced runs, all 300k proxy frames delivered an output within the 100 ms deadline plus at most 10.2 ms, the worst of the three runs. The full six-camera FlashOcc pipeline composes to about 1.3 s per frame on the board and is not yet a 10 Hz system. The two operations the DPU cannot run, a view-transform gather and a bilinear resize, become fixed-trip-count PL IPs numerically matched to their software references. On the full Occ3D-nuScenes validation set the board reaches mIoU 29.88, 92.8% of an FP32 baseline the DPU cannot run. On a ResNet-50 probe over 100k frames the KR260 tail stays within 1.5 times its median (2.0 times for the six-inference proxy), where Jetson Orin reaches 4.4 times and the worst datacenter GPU run (NVIDIA L4) 23.6 times. The deployment recipe, HLS sources, and raw timing traces are released.
38. 【2610.22094】SCCL-DT: Semantic-Conflict-Aware Contrastive Learning with Dual-Rule Teacher Distillation for Zero-Shot Chest X-Ray Diagnosis
链接：https://arxiv.org/abs/2610.22094
作者：Ting Liu,Haoran Lai,HaobinChen,Ming Liu,S Kevin Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision-language pre-training supports, off-diagonal image-report pair, Contrastive vision-language pre-training, standard objectives treat, pre-training supports zero-shot
备注： 17 pages, 4 figures, includes supplementary material
点击查看摘要
Abstract:Contrastive vision-language pre-training supports zero-shot chest X-ray diagnosis, but standard objectives treat every off-diagonal image-report pair in a batch as a negative. In radiology, recurring findings across patients mean that instance mismatch need not imply semantic incompatibility, creating false-negative supervision that we term a semantic conflict. A training-trace audit shows that pair-observations selected by the online mask used during training are enriched for report-derived finding agreement, although this proxy analysis does not establish clinical equivalence. Fixed thresholds can become miscalibrated as similarity distributions evolve, while soft reweighting leaves residual repulsive gradients. We therefore propose Semantic-Conflict-Aware Contrastive Learning (SCCL), which tracks modality-specific similarity distributions with exponential-moving-average (EMA) statistics, derives adaptive thresholds, and hard-masks flagged candidates before softmax normalization. Inclusive (OR) and consensus (AND) rules define two SCCL teachers, whose bidirectional cross-modal rankings are consolidated through standard distillation into a single deployable student, SCCL-DT. Across five public chest X-ray benchmarks, SCCL-DT achieves a mean zero-shot AUC of $0.850$, compared with $0.837$ for the strongest evaluated baseline in our comparison. Code will be made publicly available soon.
39. 【2610.22091】Beyond the Dominant Label: Recovering Coexisting Lesion Evidence with Multiple Instance Learning
链接：https://arxiv.org/abs/2610.22091
作者：Lubin Gan,Jing Zhang,Xinming Zhang,Chengpeng Xu,Siying Wu,Xiaoyan Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：weak supervision typically, Whole-slide images, weak supervision, supervision typically, Whole-slide
备注： 7 pages, 2 figures
点击查看摘要
Abstract:Whole-slide images may contain coexisting lesions, yet weak supervision typically provides only the most severe diagnosis. We formulate this setting as dominant-label multiple instance learning, where the observed label is the maximum-severity element of a latent lesion set. Standard multiclass MIL treats it as a complete one-hot description and therefore suppresses lower-severity evidence whenever it co-occurs with a dominant lesion. We propose DomSet-MIL, a label-aware framework that aligns the annotation mechanism across bag and instance levels. Dominant-Label Censored Likelihood models the reported diagnosis without declaring unreported lesions absent. Severity-Ordered Residual Routing assigns patch evidence from high to low severity and preserves residual support for secondary findings, while top-$q$ pooling links local routing scores to bag prediction. Experiments across natural and controlled settings show that DomSet-MIL achieves state-of-the-art performance in dominant-label prediction while more effectively recovering latent coexisting-lesion evidence. These findings demonstrate that modeling the dominant-label mechanism can improve diagnostic prediction without sacrificing clinically meaningful secondary findings.
40. 【2610.22087】Pathology foundation models for training-free case retrieval in salivary gland tumors
链接：https://arxiv.org/abs/2610.22087
作者：Maximilian J. Roesel,Niklas Kiermeyer,Philipp Keyl,Frederick Klauschen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pattern recognition relies, rare cancer subtypes, encountering rare cancer, pattern recognition, recognition relies
备注：
点击查看摘要
Abstract:In pathology, pattern recognition relies on a frame of reference built through extensive training and experience, which may still fall short when encountering rare cancer subtypes. Archives of previously diagnosed tumors often contain relevant precedents, yet identifying the most relevant cases remains challenging. Here we explore whether content-based retrieval with current pathology foundation models facilitates rare cancer diagnostics without any task-specific training. Pathologists can query a digitized archive using a region of interest (ROI) from a whole slide image (WSI) and retrieve morphologically similar cases, along with their ICD-O codes and corresponding WSIs. The ROI can be selected manually or automatically using a gated attention-based multiple instance learning model. We evaluate our approach by leave-one-case-out on an imbalanced dataset of 137 salivary gland tumor cases spanning 12 ICD-O morphology categories, comparing four pathology foundation models (Atlas2, Atlas2-B, Atlas2-S, and UNI2h). Top-1/3/5 retrieval was 62.5%/76.7%/81.3% for Atlas2, 50.2/66.6/72.9% for UNI2h, 52.3%/71.5%/77.6% for Atlas2-B and 54.4/65.2/73.7% for Atlas2-S. Macro-averaged F1 ranged from 69.0% for the smallest model Atlas2-S to 76.6% for the largest model Atlas2 across the five classes with at least ten cases. Our modified Chamfer similarity separated correct from incorrect matches among the Top-5 more reliably for Atlas2 (AUC 0.754) than for Atlas2-B (0.679, p = 0.020) and Atlas2-S (0.653, p = 0.003), but not UNI2h (0.697, p = 0.196). Requiring no additional training or manual annotation, this approach makes departmental archives searchable with pathology foundation models, providing a low-barrier route to case-based differential diagnosis and extending the individual frame of reference to the collective experience of the department.
41. 【2610.22075】Retrofitting Recurrent Vision-Language Models from Pretrained Backbones
链接：https://arxiv.org/abs/2610.22075
作者：Madhav Iyengar,Andreas Geiger,Hilde Kühne
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent work shows, Recent work, pretrained language models, pretrained vision-language model, model
备注： Project page: [this https URL](https://madhavesdios.github.io/recurrent-vlms)
点击查看摘要
Abstract:Recent work shows that depth recurrence can be retrofitted into pretrained language models. In this work, we adapt this paradigm for visual understanding, using depth recurrence to reduce the parameter footprint of a pretrained vision-language model (VLM). To this end, we prune layers from the language backbone of the VLM and loop over a subset of the remaining layers. At each step of the loop, a linear adapter merges the block's output with the token representations from the preceding layers and projects the fused representation back into the block. As the pruning impacts the original model performance, we propose a three-stage recovery training: first, we leverage a language-only pretraining to recover the performance of the language backbone, followed by an alignment of the vision-language projector, and a full fine-tuning of the model via visual instruction tuning. In the first and the last stage, we distill the outputs of the pretrained non-recurrent model into the recurrent model, which further improves the recovery. We evaluate the proposed approach on the TinyLLaVA-1.4B backbone without introducing any new vision-language data during retrofitting. Our experiments demonstrate that the retrofitted recurrent model outperforms the unpruned baseline trained with the same recovery data while storing 23.3% fewer language parameters. We further show that the proposed retrofitting recurrence outperforms the setup of converting a recurrent LM into a VLM on the same data. Additionally, our ablations show how design choices, such as the adapter between recurrences and a larger recurrent block, lead to the improved performance of our approach. Finally, we find that our proposed model gains on reasoning-oriented benchmarks, whereas its performance on basic visual understanding benchmarks remains on par with the baseline.
42. 【2610.22070】Memory as Weights: Internalizing Long-Term History for Streaming Videos
链接：https://arxiv.org/abs/2610.22070
作者：Zhuoming Liu,Jinhong Lin,Lin Zhang,Yiwu Zhong,Yin Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：continuously integrate information, user queries, continuously integrate, past while remaining, remaining responsive
备注：
点击查看摘要
Abstract:Streaming vision-language models (VLMs) must continuously integrate information from the past while remaining responsive to current observations and user queries. Existing memory mechanisms typically compress, retrieve, or cache historical observations and reintroduce them into the input context, forcing historical memory and current observations to compete for limited context. We propose MaLoW, a streaming memory framework that instead internalizes historical context into evolving lightweight parameter updates. MaLoW uses a recurrent HyperNetwork to incrementally consolidate incoming video observations into fixed-size LoRA weights, allowing historical information to be carried forward without revisiting the full video stream. In doing so, MaLoW represents history as weights, while keeping the current observation as input. To support training, we further construct MaLoW-Instruct, a large-scale streaming video dataset containing 381K question-answer pairs over 56K videos. We conduct extensive experiments to demonstrate that MaLoW achieves strong performance on OVO-Bench, StreamingBench, and StreamArena. On the backward split of OVO-Bench, MaLoW outperforms prior memory approaches by 3.9% to 11.8% across different video backbones while incurring only modest latency overhead. Beyond streaming video understanding, MaLoW also generalizes to vision-language-action models, improving the action success rate on Simpler WidowX by 9.3%.
43. 【2610.22060】FeaTok: Feature-Loss Tokenization for Image Generation
链接：https://arxiv.org/abs/2610.22060
作者：Zhang Xiaofeng,Samuel Lavoie,Nicolas Beltran-Velez,Jianhao Yuan,Felix Friedrich,Jakob Verbeek,Aaron Courville,Michal Drozdzal,Adriana Romero-Soriano
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：image generators learn, learn the distribution, generators learn, tokens produced, Discrete image generators
备注：
点击查看摘要
Abstract:Discrete image generators learn the distribution of tokens produced by an image tokenizer. These token representations should be easy for generators to model, not merely enable faithful image reconstruction. Yet these tokenizers are commonly trained to reconstruct pixels, which prioritizes low-level fidelity and may disrupt representation structure useful for generation. Motivated by feature-predictive self-supervised learning, we introduce feature-loss tokenization (FeaTok), which trains discrete tokens by reconstructing pretrained features rather than pixels. Ablations across SigLIP, SigLIP2, DINOv2, and DINOv3 show better generative performance with FeaTok. In class-conditional generation, FeaTok advances the quality-compute Pareto frontier, reducing gFDr6 at 256x256 by up to 29 percent over the strongest discrete baselines and outperforming the strongest unguided continuous baseline (RAEv2) with 38 times less sampling compute. FeaTok also achieves higher human-preference reward-model scores than prior art without reward-based training and surpasses continuous and discrete text-conditional baselines on three benchmarks with only 500 fine-tuning updates after pre-training.
44. 【2610.22018】When Models Misread Ink: Auditing VLMs for Arabic Calligraphy Recognition
链接：https://arxiv.org/abs/2610.22018
作者：Niaz Mohaiman Abtahi,Evan Maksud,Reyana Shahid
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：VLM evaluations rarely, Muslim communities, domain for Muslim, evaluations rarely test, fine-grained script traditions
备注： 9 pages, including references and appendix. Accepted for poster presentation at the Muslims in Machine Learning (MusIML) Workshop at NeurIPS 2026. Code: [this https URL](https://github.com/NiazTahi/When-Models-Misread-Ink)
点击查看摘要
Abstract:Arabic calligraphy is a high-stakes cultural visual domain for Muslim communities, yet VLM evaluations rarely test its fine-grained script traditions. We audit 12 VLMs on a cleaned 1,195-image six-way benchmark using numeric, visual-cue, and Diwani-first prompts. In this closed-set setting, the best numeric-prompt accuracy is 60.9% for closed/API models and 47.2% for open-weight models. The main failure is default-label collapse: every numeric run is dominated by a single label taking 33-63% of predictions, against an 18.8% majority-class baseline. For 8 of 12 models the default is Thuluth; GPT-4o labels 52.9% of all images as Thuluth although it is only 18.1% of the set. Prompting helps unevenly: visual cues move accuracy by more than 10 points for some models but hurt others, and foregrounding Diwani often relocates the default rather than removing it. Arabic calligraphy recognition is therefore a compact, culturally grounded stress test for VLM robustness and for measuring which visual traditions become legible to automated systems.
45. 【2610.22009】Visual Sanad: Auditing Vision-Language Models for False Acceptance of Qur'anic Citations
链接：https://arxiv.org/abs/2610.22009
作者：Niaz Mohaiman Abtahi,Reyana Shahid,Evan Maksud
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language models, sensitive visual content, verification remains underexplored, remains underexplored, English Qur'an verses
备注： 9 pages, including references and appendix. Accepted for poster presentation at the Muslims in Machine Learning (MusIML) Workshop at NeurIPS 2026. Code: [this https URL](https://github.com/NiazTahi/Visual-Sanad)
点击查看摘要
Abstract:Vision-language models (VLMs) are increasingly used to interpret religious, educational, and culturally sensitive visual content, yet their reliability on citation verification remains underexplored. We introduce Visual Sanad, a controlled benchmark for testing whether VLMs falsely accept incorrect Qur'anic verse attributions when the same quote-reference pair is rendered under different visual framings. The benchmark contains 2,400 rendered images built from 100 English Qur'an verses, four factual states per verse, and six visual conditions ranging from plain text to decorative and authority-framed layouts. All quote-reference pairs were source-checked and human-audited before rendering. Across 24 full model-prompt runs, we observe a sharp capability split. Proprietary API-served VLMs range from near-perfect citation verification to moderate false acceptance, whereas recent open-weight VLMs often show weak discrimination and default to VALID on most images. De-biased prompting can reduce false acceptance, but often by shifting the decision threshold toward INVALID rather than by producing strong citation discrimination. Visual Sanad therefore exposes a culturally grounded multimodal factuality failure: fluent VLMs may treat displayed religious citations as self-authenticating unless they have strong citation-verification ability.
46. 【2610.21993】Data-Efficient ConvNeXt Pretraining for High-Resolution Sentinel-1 GRD SAR Representation Learning
链接：https://arxiv.org/abs/2610.21993
作者：Yuki Natsume,Sang-Ho Yun,Chai Kiat Yeo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Ground Range Detected, datasets remain scarce, limiting supervised deep, land-surface remote sensing, Ground Range
备注： 30 pages, 9 figures. Extends a preliminary paper to be presented at SPIE Asia Pacific Remote Sensing 2026
点击查看摘要
Abstract:Labeled Sentinel-1 Ground Range Detected (S1GRD) datasets remain scarce, limiting supervised deep learning for land-surface remote sensing, while self-supervised pretraining for this domain has been dominated by Vision Transformer (ViT)-based masked image modeling requiring substantial data and compute. We propose SparK-SAR, a sparse convolutional masked pretraining framework built on SparK and ConvNeXt, designed to exploit convolutional inductive biases for S1GRD imagery under constrained compute. SparK-SAR makes three core technical contributions: (i) ConvNeXt-RS, a domain-adapted encoder that halves the stem stride (4x to 2x) to produce 14x14 feature maps at stride 16x, providing 4x more spatial tokens at identical parameter count; (ii) a lightweight ConvNeXt-512 reconstruction decoder with PixelShuffle upsampling that reduces pretraining VRAM by 7.5-8.5% per GPU relative to a UNet-128 baseline while matching its accuracy; and (iii) an empirical characterization of FP16 mixed-precision pretraining instability in the standard SparK UNet-768 decoder on S1GRD data, complemented by a finding that finetuning with layer-wise learning rate decay (LLRD) improves downstream performance of pretrained encoders. On four Copernicus-Bench S1GRD tasks, our finetuned 27.8M-parameter ConvNeXt-RS encoder improves over a non-pretrained baseline by +4.7, +5.0, +5.8, and +1.4 pp on EuroSAT-S1, BigEarthNet-S1, DFC2020-S1, and Flood-S1 respectively, and outperforms the Copernicus-FM ViT (139M parameters, frozen) on three of four tasks at roughly 5x fewer parameters. A pretraining data-scaling study reveals task-dependent data efficiency: classification saturates with as little as 10-25% of the SSL4EO-S12 v1.1 corpus, while dense prediction continues to improve significantly up to 25-50%. The study also includes a CKA representation analysis and a geographic de-collision experiment.
47. 【2610.21990】VesperMUSE: Multi-Modal Fusion Vision Transformer for Image Semantic Segmentation Under Diverse Light Conditions
链接：https://arxiv.org/abs/2610.21990
作者：Raul Balmez
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：performance degrades severely, image semantic segmentation, Semantic segmentation, colour distortion, autonomous systems
备注： A dissertation submitted to The University of Manchester for the degree of Bachelor of Science in Computer Science
点击查看摘要
Abstract:Semantic segmentation is critical for the reliable navigation and scene understanding of autonomous systems, yet its performance degrades severely in low-light environments due to noise, artifacts, colour distortion, and the loss of structural details. To address this challenge, this work introduces VesperMUSE, a unified multi-modal framework designed to achieve robust image semantic segmentation across diverse illumination conditions. The architecture addresses the light deficiency problem on multiple levels: proposing a novel physics-informed synthetic low-light adaptation algorithm, approaching Low-Light Image Enhancement (LLIE) through a thermal-guided paradigm, and finally aiming to recover the intrinsic scene details for semantic segmentation through a multi-modal fusion approach. Following enhancement, the framework dynamically integrates the primary RGB features with auxiliary thermal representations and surface normal maps highlighting geometric discontinuities and material boundaries. At the core of this integration is a highly scalable, modality-agnostic self-attention mechanism that extracts both global context and fine local features from an arbitrary number of auxiliary inputs. By combining and projecting these hierarchical multi-modal representations into a unified component, the attention module allows the network to selectively attend to relevant cross-modal cues without requiring any architectural modifications when different sensor configurations are used. Extensive evaluations demonstrate that VesperMUSE successfully recovers missing visual cues, providing a flexible, state-of-the-art (SOTA) solution for machine perception in extreme and unstructured real-world environments.
48. 【2610.21984】GRID-Planner: Graph-Structured Relational Reward Shaping for Diffusion Planning
链接：https://arxiv.org/abs/2610.21984
作者：Zhao Yang,Zezhong Qian,Yinan Shi,Longjun Liu,Yawei Jueluo
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：scenes remains challenging, complex multi-agent interactions, Autonomous driving planning, requires selecting trajectories, robust closed-loop decision
备注：
点击查看摘要
Abstract:Autonomous driving planning requires selecting trajectories that remain safe, rule-compliant, and comfortable under complex multi-agent interactions, yet robust closed-loop decision making in planning-critical scenes remains challenging. Existing diffusion- and RL-based planners often rely on generic rewards and use relational structure mainly for representation, limiting how planning-critical rollouts shape policy improvement. We present GRID-Planner, a graph--reward integrated diffusion planning framework that aligns generative planning with structured relational signals. Specifically, GRID-Planner combines graph-aware importance weighting, a time-indexed relational reward surrogate, and an advantage-weighted diffusion objective with on-policy self-distillation, forming a rollout-return-advantage-update loop without explicit likelihoods. Experiments on nuPlan and interPlan show that, compared with the diffusion-only baseline, GRID-Planner reduces collision rate, lane deviation, and jerk by 35.8\%, 60.8\%, and 27.4\%, respectively, and improves the planning score by 3.4\%. Project website: this https URL.
49. 【2610.21979】P2TPO: Structure-Aligned Page-to-Token Credit Assignment for Full-Page Document Parsing
链接：https://arxiv.org/abs/2610.21979
作者：Yong Zu,Ninghua Yang,Zezhong Tan,Xinhong Ma,Ziqiang Dong,Yang Yang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：preserve the content, content and structure, structure of heterogeneous, accurate outputs, heterogeneous elements
备注： 34 pages, 9 figures, including appendices
点击查看摘要
Abstract:End-to-end full-page document parsing must preserve the content and structure of heterogeneous elements, yet otherwise accurate outputs can contain local errors and omissions. A single page-level advantage does not explicitly identify which elements differ in quality across sampled outputs or where their errors occur. We introduce Page-to-Token Policy Optimization (P2TPO), a structure-aligned credit-assignment framework that operates on full-page policy trajectories. Reference-element alignment first associates block-level quality contrasts with generated spans. Unified Anchor Pricing (UAP) incorporates matched and missing element outcomes and provides feedback relative to a fixed quality ceiling when sampled outputs receive identical but imperfect scores for a reference element. Within matched blocks, Span Credit Redistribution (SCR) redistributes existing block credit according to aligned correct and erroneous spans, using boundary proxies for within-block omissions while preserving the total block-derived advantage across its tokens. Under a fixed-weight additive page utility, we show that element-indexed contrasts retain local quality differences that page-level aggregation can cancel out. In the main experimental comparison, P2TPO outperforms all evaluated policy optimization baselines in seed-averaged scores on each of the six document parsing benchmarks. Additional experiments demonstrate gains across model scales and initializations.
50. 【2610.21948】Following Delegation Traces to Study Human Oversight in Interaction with Multimodal AI
链接：https://arxiv.org/abs/2610.21948
作者：Agnese Chiatti,Matteo Matteucci,Viola Schiaffonati
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：everyday thought partners, Video Question Answering, Question Answering trials, users transfer control, thought partners
备注：
点击查看摘要
Abstract:As multimodal AI systems are becoming our everyday thought partners, the shift towards studying how users transfer control to these systems becomes especially urgent. In this paper, we report an overview of findings from an online study with n=56 AI-literate participants and 392 Video Question Answering trials. After inspecting each multimodal AI response, participants rated task-specific trust and selected one of three intended policies for an analogous future task: reject AI assistance, use it with verification, or delegate fully to the AI. Within participants, post-interaction trust strongly predicted the user's delegation choices (OR=14.97, 95% CI [7.14,31.37]). Trust and delegation nevertheless remained distinct. Verification was the dominant policy and often co-occurred with high trust. Delegation also increased with task order after adjustment for momentary and participant-level trust (OR=1.22, 95% CI [1.02,1.45]), indicating an experience-related component that self-reported trust ratings alone could not capture. These findings motivate a shift from intended delegation to a non-intrusive observation of how delegation is enacted in collaborative human-AI tasks. We therefore conclude by proposing enacted delegation traces as a methodological framework for future studies of multimodal and agentic AI use.
51. 【2610.21937】Flow-CLIP: Image-Conditioned Residual Scoring for CompositionalImage-Text Matching
链接：https://arxiv.org/abs/2610.21937
作者：Minghong Wei,Enguang Zhu,Pu Cao,Lu Yang,Qing Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：transferable cross-modal representations, enabled substantial progress, learning transferable cross-modal, text retrieval, cross-modal representations
备注：
点击查看摘要
Abstract:Vision--language pre-training has enabled substantial progress in image--text retrieval and zero-shot recognition by learning transferable cross-modal representations. However, sentence-level alignment remains insufficient for compositional matching, where captions can describe the same objects and attributes while differing in how these elements are bound. To address this limitation, we propose Flow-CLIP, which refines global image-text alignment through image-conditioned changes in token--patch evidence. Global Compatibility Calibration (GCC) learns a sentence-level similarity metric, while Image-Conditioned Evidence Refinement (ICER) incorporates visual patch context into token queries and uses the resulting change in local matching evidence to adjust the global score. We further introduce Cross-Image Margin Ranking (CIMR), which compares the same positive--negative caption pair across matched and mismatched images, encouraging a larger ranking margin when the image supports the correct description. Experiments on compositional matching and attribute--object binding benchmarks show that Flow-CLIP improves binding accuracy over pretrained CLIP and learned global alignment through local evidence refinement, while cross-image ranking supervision mitigates reliance on language priors. Code will be released at link.
52. 【2610.21918】BridgeAfford: Bridging Query-Target Gap for Generalizable 3D Affordance Grounding
链接：https://arxiv.org/abs/2610.21918
作者：Yijie Su,Yakun Zhu,Yi Bin,Pengpeng Zeng,Liang Chen,Guoqing Wang,Jingkuan Song,Heng Tao Shen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：localize functional regions, unseen objects, aims to localize, localize functional, affordance grounding aims
备注：
点击查看摘要
Abstract:Language-guided 3D affordance grounding aims to localize functional regions on 3D objects according to interaction intents. However, existing methods exhibit poor generalization to unseen objects. One challenge is the query-target gap: a semantic discrepancy between query features encoding interaction intents and target-region features, leading to inaccurate grounding. End-to-end training favors query representations tailored to seen objects, limiting their compatibility with shifted target-region features on unseen objects. To address this issue, we propose BridgeAfford, a framework that reduces the query-target semantic gap from two complementary perspectives. First, Interaction Region Alignment (IRA) promotes cross-object alignment among geometrically similar interaction regions during training. This enables structures on unseen objects that resemble previously observed ones to produce representations similar to those learned during training, facilitating target-region recognition. Second, Visual Evidence Aggregation (VEA) leverages a 2D affordance model to refine the attention distribution and guide the query toward the correct region, yielding more target-aware queries. Extensive experiments on the LASO and PIAD datasets demonstrate that BridgeAfford outperforms existing methods, particularly on unseen objects, highlighting its robust generalization ability.
53. 【2610.21902】Seeing is Believing: Benchmarking and Mitigating the Interference of Language Priors on Visual Perception in MLLMs
链接：https://arxiv.org/abs/2610.21902
作者：Li Ma,Yan Zhuang,Jiawen Deng,Fuji Ren
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：impairing visual perception, override visual evidence, visual evidence, impairing visual, visual perception
备注：
点击查看摘要
Abstract:Language priors in MLLMs can override visual evidence, impairing visual perception. Existing benchmarks assume shared priors across models and rely solely on accuracy. However, cross-model prior agreement falls below 80%, and over 15% of items can be answered correctly without any image, causing accuracy to overestimate prior resistance. To address these limitations, we introduce ViSiP-Bench, a benchmark grounded in rare-but-real scenarios across six prior categories, with a model-aware dynamic prior induction protocol and three metrics that more precisely and continuously measure prior resistance than accuracy alone. Evaluating 24 models reveals that prior adherence is pervasive, does not improve with scale, and larger models tend to either strongly override their priors or firmly adhere to them. We therefore propose MAPS, which identifies each model's strongest priors and fine-tunes on factually grounded knowledge to soften excessive prior reliance without disrupting general capabilities.
54. 【2610.21895】SurgStreamer: proactive, request-driven monitoring of surgical video streams with structured state and a reusable reasoning layer
链接：https://arxiv.org/abs/2610.21895
作者：Bowen Xiang,Jon S. Heiselman,Michael I. Miga
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Calot triangle dissection, Surgical teams, Calot triangle, triangle dissection, teams could benefit
备注：
点击查看摘要
Abstract:Surgical teams could benefit from assistants that watch the video for requested events, such as "tell me when the clip applier appears during Calot triangle dissection", and answer questions about what has already happened. We formalise this task as request-driven event detection with exact semantics and causal alert decisions, and present SurgStreamer. It separates procedure-specific perception, which maps the 1-FPS stream to a structured state over tools, actions and phases, from procedure-agnostic reasoning, which evaluates a formal monitoring condition over this state and an event memory, either with exact rules or with a small controller that addresses entities through pointers rather than names. We evaluate this monitoring core with gold conditions. On a pre-registered, sealed test set of 12 laparoscopic cholecystectomies, SurgStreamer reached a macro event-F1 of 0.598 over full procedures. On identical 75-s windows with only the window available to every method, it scored 0.677. The tested configurations of the streaming vision-language model OneStreamer-4B, including ones fine-tuned on SurgStreamer's state or on video with an adapted vision encoder, scored at most 0.540 (Holm-adjusted p = 0.012). At three external centres, re-training only perception raised performance on held-out procedures from 0.239 to 0.470. On a new procedure, pituitary surgery, controller weights trained on cholecystectomy matched an in-domain controller on oracle state (0.947 vs 0.938). On predicted state they missed the pre-registered non-inferiority margin (-0.024 [-0.040, -0.008]) unless the alert thresholds were re-calibrated. The results support separating perception from reasoning and point to perception under distribution shift as the main limitation.
55. 【2610.21882】Anvil: Scaling Embodied Spatial Intelligence through Knowledge Recirculation
链接：https://arxiv.org/abs/2610.21882
作者：Weilin Ruan,Bohan Zhou,Jinghao Li,Yangkai Wei,Wenqian Li,Peiran Dong,Yingjie Xu,Leyi Wu,Haojian Huang,Binghui Xie,Han Yang,Kaiwen Zhou,Yinchuan Li,Ying-Cong Chen,James Cheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Embodied spatial intelligence, spatial intelligence requires, visual recognition, models must localize, localize entities
备注： 28 pages, 7 figures
点击查看摘要
Abstract:Embodied spatial intelligence requires more than visual recognition: models must localize entities, reason about their relations, and express this knowledge in action-relevant forms. Yet joint training can conflate the knowledge needed at different stages because supervision is fragmented across incompatible geometric and semantic outputs. We introduce Anvil, a unified framework for data generation, training, and benchmarking for embodied spatial intelligence. (1) Anvil-Gen is a heterogeneous data flywheel that combines form-specific generation, cross-stage consistency verification, and failure-driven recollection across 11 Ground--Relation--Act forms. (2) Anvil-Ben provides scene-aligned supervision for learning diverse embodied spatial capabilities and scene-linked assessments that distinguish stage competence from error propagation. (3) Anvil-MOPD is a 9B student that consolidates heterogeneous spatial knowledge through distillation from specialist teachers. Semantic-first-fault routing targets teacher supervision to the student's earliest decisive failure, while stage normalization controls the loss scale across native outputs of different lengths. We construct 5.8M source-grounded records spanning 160K images, reserving 580K spatial records for held-out evaluation and using the remaining 5.22M records for training. On average across seven public benchmarks, Anvil-MOPD outperforms Qwen3.5-9B and RynnBrain-8B by 9.29 and 11.03 percentage points, respectively, while reaching 80.67% on VABench-Point. Controlled studies support targeted coverage, selective transfer, and feedback-guided repair as complementary framework components.
56. 【2610.21865】From Sketch to Scene: Relightable Garment Reconstruction from Marked Sketches
链接：https://arxiv.org/abs/2610.21865
作者：Ahmet Neçirvan Doğan,Eren Acar Başaran,Metin Sezgin,Zahra Montazeri
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：express visual ideas, visual ideas, people to express, express visual, Sketching
备注： 11 pages, 5 figures. Ahmet Neçirvan Doğan and Eren Acar Başaran contributed equally
点击查看摘要
Abstract:Sketching is one of the most natural ways for people to express visual ideas. Unlike the text prompts that most generative systems rely on today, a sketch captures spatial structure and intent directly, including where a designer wants highlights and shadows to appear. Yet current sketch-to-3D pipelines have no input for that intent: they bake the drawn shading into the texture as dark paint, and the light cannot be moved. We propose a system that transforms a rough garment sketch, marked with sparse annotations (a star for a highlight and a moon for a shadow), and a short text prompt describing the texture, into a textured 3D mesh with an explicit directional light, as a scene that can be relit and edited after generation. The two symbols are the most frequent proposals in an elicitation study with art students. From the marked sketch the system predicts the scene's directional light and, separately, a displacement field that bends the surface so that the moon-marked regions fall into shadow under that light, rather than being painted dark in the texture.
57. 【2610.21850】Seeing Both the Forest and the Trees: Reusing Holistic 3D Priors for Part-Decomposed Generation
链接：https://arxiv.org/abs/2610.21850
作者：Yiqun Zhao,Binbin Huang,Haobin Duan,Zibo Zhao,Shenghua Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：explicit parts requires, geometric detail inside, explicit spatial positions, prior geometric detail, parts requires
备注： NeurIPS 2026, project page: [this https URL](https://zhao-yiqun.github.io/structparts/)
点击查看摘要
Abstract:Generating 3D assets with explicit parts requires two properties at once: geometric detail inside each part and structural coherence across the whole object. Recent image-conditioned 3D generation models adopt a structured 3D representation that anchors tokens to explicit spatial positions, capturing both properties, but their output remains a single fused mesh. We ask how a part-decomposed generation model can inherit both properties of these holistic priors, and answer with STRUCTPARTS, a framework whose core technical contribution is a dual-frame coordinate interleaving mechanism: each shape latent is interpreted under both a part-local and an object-global reference frame, and processed through a global-local inter-leaved transformer that simultaneously reuses the prior's geometric detail at the part scale and its structural coherence at the whole-object scale. As its structural input, STRUCTPARTS uses a segmented mesh scaffold, a coarse mesh paired with a face-level segmentation mask kept entirely within the prior's native 3D representation. With only lightweight finetuning, both intra-part detail and inter-part coherence emerge from the same pretrained weights. On PartObjaverse-Tiny, STRUCTPARTS matches or surpasses prior part-decomposed models at a fraction of their training cost, while naturally supporting part-mesh refinement and part-level editing.
58. 【2610.21845】mporal Periodic Image Registration with Implicit Neural Representations
链接：https://arxiv.org/abs/2610.21845
作者：Mathias Lowes,Kristine Aavild Sørensen,Maxime Sermesant,Rasmus R. Paulsen
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Implicit Neural Representations, Implicit Neural, Neural Representations, recently gained popularity, lightweight networks
备注： Published at MLMI@MICCAI 2025
点击查看摘要
Abstract:Implicit Neural Representations (INRs) have recently gained popularity for their ability to model functions using simple and lightweight networks. These methods have also proven effective in deformable image registration. In this work, we extend INRs for deformable image registration to the domain of temporal image registration, focusing on periodic temporal image sequences. Our approach, Temporal-IDIR, optimizes a single INR to model deformations across all frames in a temporal image sequence simultaneously, allowing for self-regularization through its own deformation predictions. To achieve this, we introduce a temporal consistency loss that penalizes discrepancies between direct source-to-target transformations and those traversing intermediate frames. We evaluate our framework on the DIR-LAB dataset, using the target registration error (TRE) between annotated and moved landmarks as the metric. Here, we achieve a TRE of 1.03 mm, outperforming other INR-based registration methods. Additionally, our framework supports smooth interpolation between time frames by estimating deformations between the given input frames. Code is publicly available at this https URL.
59. 【2610.21809】From Adults to Children: Benchmarking Foundation Models for Chest X-Ray Classification under Domain Shift
链接：https://arxiv.org/abs/2610.21809
作者：Sara Inácio,Hugo Proença,João C. Neves
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：populations remains unclear, shown significant potential, patient populations remains, medical imaging, remains unclear
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Foundation models have shown significant potential across diverse fields and have been applied to medical imaging, but their robustness across patient populations remains unclear. In this work, we investigate foundation models' ability to generalize from adult to pediatric chest X-ray classification. To the best of our knowledge, this is the first benchmark to compare multiple foundation models under a common adult-to-pediatric evaluation setting while also analyzing the effect of adaptation depth. We harmonize VinDr-CXR and PediCXR into a five-label classification task and evaluate six foundation models and two CNN baselines. All models are adapted using adult data only and tested in both the in-domain and pediatric domains using linear probing, partial fine-tuning, and full fine-tuning. The benchmark reveals a clear and consistent trend: all models suffer a substantial performance degradation when transferred from adult to pediatric data, with drops exceeding 10 percentage points. While Macro-AUROC values reach approximately 92% on the adult test set, performance decreases to around 78% on the pediatric domain. Another important finding is that increasing the depth of adaptation does not significantly improve cross-population generalization. Moreover, strong in-domain performance does not translate into better performance on pediatric data.
60. 【2610.21802】aching DINOv3 About Partial 3D Geometry: A Self-Supervised Geometry-Aware Approach
链接：https://arxiv.org/abs/2610.21802
作者：Viktoria Ehm,Dongliang Cao,Riccardo Marin,Daniel Scholz,Weikang Wang,Florian Bernard,Daniel Cremers
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Partial shape matching, Partial shape, shape matching, partially observed, Partial
备注：
点击查看摘要
Abstract:Partial shape matching is a crucial yet underexplored problem in 3D vision, with significant relevance to real-world scenarios where shapes are often only partially observed. Existing feature descriptors face difficulties in this setting, as traditional representations either struggle with the boundaries of partial shapes or heavily depend on the shape's spatial position. While existing approaches have employed DINO features for partial shape matching, these features are not inherently suited for handling partial observations. In this work, we propose a method to refine DINO features using LoRA-based self-supervised learning, enabling the generation of feature descriptors that are robust to partiality. Our features substantially improve performance on partial shape matching compared to traditional or vision foundation features. Additionally, when integrated into existing partial shape matching pipelines, we achieve state-of-the-art results on partial shape matching and left-right prediction benchmarks.
61. 【2610.21795】Single-stage joint diffusion of sky images and clear-sky index for ultra-short-term irradiance forecasting: what the frame-to-irradiance stage discards
链接：https://arxiv.org/abs/2610.21795
作者：Kanawut Suwandee,Suwichaya Suwanwimolkul
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Systems and Control (eess.SY)
关键词：forecasts future sky, Sky-image irradiance forecasting, video-prediction model forecasts, model forecasts future, future sky frames
备注：
点击查看摘要
Abstract:Sky-image irradiance forecasting is dominated by a two-stage design: a video-prediction model forecasts future sky frames, and a separately trained regressor maps those frames to irradiance. We propose a single-stage alternative that co-denoises the future sky-image and clear-sky-index sequences in one diffusion process, with an irradiance head that reads a denoised preview of the future sky rather than the noised diffusion state. The forecaster needs no regression stage and runs from sky images and deterministic covariates alone, with no measured irradiance at its input --- the situation at a site with a camera but no pyranometer. On 2023 SIRTA data the model reaches a pooled RMSE of $104.1$~W\,m$^{-2}$ and a skill score of $+0.34$ on the continuous ranked probability score (CRPS) against smart persistence, higher than any of twelve baseline configurations, and retains that skill when retrained on 2021--2022. On the model's own generated frames, a separately trained regressor reaches $150.6$~W\,m$^{-2}$ against the joint head's $104.1$: roughly $46$~W\,m$^{-2}$ that joint training recovers and a cascade discards. Point accuracy is competitive but not best: a deterministic network that also reads measured irradiance attains $97.6$~W\,m$^{-2}$. The model's CRPS skill leads that network's in every sky-condition tertile, by $0.26$ to $0.30$.
62. 【2610.21794】MedPAO-VL: Interpretable and Protocol-Compliant Agent for Structured Radiology Report Generation
链接：https://arxiv.org/abs/2610.21794
作者：Shrish Shrinath Vaidya,Gowthamaan Palani,Minmini Selvam,Gokulraja Srinivasaraja,Ganapathy Krishnamurthi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Large Language, remarkable generalization capabilities, medical images remains, capabilities of Large
备注： The paper has been accepted at ECCV BISCUIT Workshop, 2026
点击查看摘要
Abstract:Despite the remarkable generalization capabilities of Large Language Models, generating clinically accurate and structured radiology reports from medical images remains a significant challenge. Current end-to-end approaches function as black boxes, prone to factual hallucinations and generating ungrounded findings. This lack of reliability and failure to adhere to domain-specific structuring protocols, fundamentally limits their clinical utility. We present MedPAO-VL, a multimodal agent that shifts the paradigm from monolithic generation to explainable, iterative, protocol-compliant structured report generation. Unlike deterministic models, our plan-act-observe loop functions as a goal-oriented agent: it first perceives the Chest X-Ray through an explainable vision module designed to capture inherent diagnostic uncertainty, then iteratively refines the generated report by observing semantic discrepancies and self-correcting its generation for better alignment with visually detected clinical findings. Evaluation of our framework demonstrates that this agentic reasoning improves clinical correctness and completeness, achieving an expert-rated accuracy score of 3.5/5 and a structural score of 4.3/5. By prioritizing pathology specific explainability and iterative refinement over opaque end-to-end mapping, MedPAO-VL offers a transparent and clinically viable alternative for automated structured radiology report generation.
63. 【2610.21786】NICE Toolbox: Nonverbal Interpersonal Communication Exploration Toolbox
链接：https://arxiv.org/abs/2610.21786
作者：Aleksandr Evgrashin,Carolin Schmitt,Timo Lübbing,Ashutosh Jha,Buket Naz Zeren,Sophie K. Bauer,Johannes Kopf-Beck,Anton K. G. Marx,Anamaria Semm,Gökce Ergün,Senya Polikovsky
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Understanding human communication, Understanding human, long-standing goal, Nonverbal Interpersonal Communication, Understanding
备注： 5 pages, 2 figures. Code: [this https URL](https://github.com/OSLabTools/nicetoolbox) . Submitted to the Journal of Open Source Software (JOSS)
点击查看摘要
Abstract:Understanding human communication is a long-standing goal in psychological research. People express themselves through many verbal and nonverbal channels: posture, gesture, gaze, facial expression, and speech. Measurement and annotation of these signals has traditionally required time-consuming manual work by trained human labellers. The Nonverbal Interpersonal Communication Exploration (NICE) Toolbox is a free, open-source Python framework that automatically measures these signals by combining existing state-of-the-art computer vision and speech-processing methods into a single software package. It includes support for multi-camera systems, interchangeable detection algorithms, 2D and 3D visualization of detector outputs, evaluation on the user's custom data, and export to third-party software. With the release of this tool, we aim to make data exploration of interpersonal communication signals scalable, reproducible, and accessible for psychological research.
64. 【2610.21783】Learning to Think and Explore in 3D World
链接：https://arxiv.org/abs/2610.21783
作者：Yijiang Li,Bingyang Wang,Nuno Vasconcelos
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：study how vision-language, actively explore, model, providing multi-view images, vision-language models
备注：
点击查看摘要
Abstract:We study how vision-language models (VLMs) can learn to think and actively explore in 3D space. Instead of providing multi-view images, videos, or 3D representations to the model, we preserve the native visual encoding of VLMs, i.e., a single image, one at a time, just like humans, and treat the 3D representation only as an environment with which the model can interact through actions (e.g., move left) and observations (rendered images). Each rollout begins from an initial first-person view and a visual question. The model can then iteratively reason, navigate, and reorient its viewpoint before committing to a final answer. Following an initial trajectory-supervised finetuning, we apply reinforcement learning (RL) with rewards driven primarily by final-answer correctness. Crucially, RL provides no direct supervision over which viewpoints the model should visit or which exploration actions it should take. Instead, the model must learn an effective exploration policy solely from the extent to which its interactions improve performance. Across six 3D benchmarks, our model ACT3D achieves an average accuracy of 53.2% that improves its base Qwen model by 22.0% and surpasses proprietary Gemini 3.6 Flash. ACT3D also outperforms existing open-source 3D methods while using 50-70% fewer input frames, and generalizes to unseen domains with an average improvement of 5.9% over its supervised initialization. Further analysis reveals adaptive, question-conditioned exploration. Performance gains over the base model increase from 0.6% on questions answerable from the initial view to 16.3% on those requiring extensive exploration. ACT3D searches for occluded targets, avoids unnecessary exploration, and acquires complementary viewpoints for spatial comparisons. These findings demonstrate that outcome-based RL enables VLMs not only to reason over visual evidence, but also to learn when and how to acquire it.
65. 【2610.21780】DINO-FIL: Multi-Layer Transformer Fusion for Generative Inpainting Forgery Localization
链接：https://arxiv.org/abs/2610.21780
作者：Simon Freitter,David Fischinger,Silvia Poletti,Marcel Hasenbalg,Martin Boyer
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：generative image forgeries, transformer-based framework, framework for pixel-level, pixel-level localization, localization of generative
备注：
点击查看摘要
Abstract:We propose DINO-FIL, a transformer-based framework for pixel-level localization of generative image forgeries. The method leverages multi-layer representations from a pretrained DINOv3 ViT-H+/16 encoder combined with a lightweight fusion decoder to capture both semantic structure and fine-grained texture inconsistencies introduced by image editing. By aggregating intermediate transformer features across depths, the model improves sensitivity to subtle, spatially localized artifacts that are often missed by standard single-layer approaches. We evaluate DINO-FIL in a cross-dataset setting, training on B-Free and testing on Beyond the Brush, CocoGlide, TGIF, and SAGI-D. The model achieves strong generalization, outperforming existing baselines on average and on four of five evaluated datasets, while maintaining a high true negative rate on pristine images.
66. 【2610.21779】FuseAdapt: Parameter-Efficient Multimodal Fusion for Semantic Segmentation with Missing Modalities
链接：https://arxiv.org/abs/2610.21779
作者：Xin Zhang,Robby T. Tan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：semantic segmentation benefits, complementary sensors, test time, Multi-modal semantic segmentation, Multi-modal semantic
备注： 25 pages, 6 figures, 19 tables. Accepted to NeurIPS 2026
点击查看摘要
Abstract:Multi-modal semantic segmentation benefits from complementary sensors, but this benefit is fragile when some modalities are degraded or missing at test time. Many existing methods rely on dedicated fusion modules or multi-branch cross-modal encoders, and the fusion often becomes unreliable when modalities are absent, leading to substantial performance drops. We propose \textbf{FuseAdapt}, a parameter-efficient framework that performs fusion within the adaptation space of a frozen vision foundation model (VFM), exploring whether VFM priors can serve as an effective shared backbone for multi-modal segmentation. Instead of attaching a standalone fusion network, FuseAdapt assigns each modality a lightweight adaptation branch and performs \emph{adaptation-space fusion} by keeping Q/V low-rank adaptation private to each modality and routing only FFN low-rank residual activations across modalities inside the frozen backbone. The pretrained VFM remains fixed while modality-specific corrections and explicit cross-modal interaction are learned through the adaptation paths. To handle missing modalities, we further introduce \textbf{Predictive Modality Modeling (PMM)}, a direct representation-level objective for cross-modal redundancy. During training, PMM masks a target modality and predicts its embedding from the visible ones, supervised by a teacher target computed under full-modality input. PMM is used only during training and adds no inference-time overhead. Across three multi-modal segmentation benchmarks (MCubeS, DELIVER, MUSES), FuseAdapt consistently improves both modality-complete and modality-incomplete segmentation with a small trainable budget, yielding up to +3.01 mIoU under full modalities and +12.56 mIoU under missing modalities over prior state-of-the-art. Project page: this https URL.
67. 【2610.21760】Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images
链接：https://arxiv.org/abs/2610.21760
作者：Olivia Salamon,Virginia N. L. Franqueira,Shujun Li
类目：Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET)
关键词：highly realistic content, producing highly realistic, traditional forensic techniques, realistic content, increasingly capable
备注：
点击查看摘要
Abstract:As image generation models become increasingly capable of producing highly realistic content, traditional forensic techniques are struggling to keep up. This paper investigates whether MLLMs can instead be used as a form of forensic analysis by identifying synthetic media. Specifically, the study aims to determine whether these models detect fake images by recognising physical inconsistencies, or whether they rely on digital artefacts such as embedded this http URL MLLMs: GPT-4o, GPT-5, GPT-5.2, Gemini 2.5, Gemini 3, and Seed 1.6, are benchmarked using a dataset of 400 images. Fifty images are authentic photographs, while the remaining 350 are generated using seven leading image models: Gemini 3, Gemini 2.5, Flux.2 Pro, GPT-Image-1, GPT-Image-1.5, Seedream 4.0, and Seedream 4.5. The evaluation is structured in three stages: single-image classification, pairwise comparison, and a focused "self-detection" experiment on Gemini. Several MLLMs achieved a high detection accuracy, with GPT-5.2 reaching a peak of 97.9% in the pairwise experiment, against specific generators and an overall mean pairwise accuracy of 82.5% by identifying structural or physical inconsistencies within images. However, results from the self-detection experiment indicate that the presence of invisible SynthID watermarks leads to a 10% reduction in Gemini's detection accuracy compared to the clean control group. One possible explanation is that SynthID embedding reduces some of the visible artefacts the models rely on for this http URL results imply that MLLMs can detect structural artefacts without relying on watermarks, but performance varies substantially across model generations. The findings from comparison C5 also suggest that SynthID embedding may suppress some of the structural artefacts used during detection.
68. 【2610.21758】Beyond Source Prompts: Towards Visually Grounded AI-Generated Video Quality Assessment
链接：https://arxiv.org/abs/2610.21758
作者：Kehao Zhou,Yixuan Li,Yuxuan Jiang,Fan Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generative artificial intelligence, Recent advances, video generation technologies, accelerated video generation, AIGV quality assessment
备注：
点击查看摘要
Abstract:Recent advances in generative artificial intelligence have accelerated video generation technologies. However, AI-generated videos (AIGVs) remain susceptible to various distortions, highlighting the need for dedicated video quality assessment methods. Content semantics play an important role in AIGV quality assessment, with source prompts typically used as textual references. However, these prompts may not accurately reflect the generated video content, resulting in a discrepancy between the intended textual description and the generated result. To address this limitation, this paper proposes VGCap, an AIGV quality assessment framework guided by visually grounded captions that align better with generated content. Specifically, we introduce two forms of captions: a global caption obtained by minimally revising the source prompt based on multi-frame visual evidence, and prompt-independent segment captions that describe localized temporal content. Together, these captions provide complementary textual evidence for assessing spatial quality, temporal quality, and text-video alignment. Experimental results on the LGVQ and FETV datasets show that VGCap outperforms representative baselines across all three dimensions. Further ablation studies on caption sources and temporal components confirm the effectiveness of visually grounded captions for each quality dimension, while highlighting the benefits of segment-level features for temporal quality prediction. The source of VGCap will be available at this https URL.
69. 【2610.21748】he Dormant Spiking Neuron: A State-Driven Mechanism for Efficient Spiking Neural Networks
链接：https://arxiv.org/abs/2610.21748
作者：Ruichen Ma,Yicai Chen,Pujun Zhou,Yue Zuo,Chongyang Li,Shuang Liu,Shaogang Hu,Guanchao Qiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：energy-efficient artificial intelligence, Spiking neural networks, offer a compelling, artificial intelligence, fundamentally anchored
备注： NeurIPS 2026 Accepted
点击查看摘要
Abstract:Spiking neural networks (SNNs) offer a compelling pathway toward energy-efficient artificial intelligence, fundamentally anchored in presynaptic input-driven sparsity. However, a substantial yet chronically overlooked source of computational overhead persists: the continuous subthreshold dynamics of postsynaptic neurons. Quantitative analysis reveals that up to 44% of neurons in an ImageNet-trained ResNet-18 model reside in a deeply inhibited state, imposing a persistent computational burden despite having a negligible probability of firing. To address this inefficiency, the Dormant Spiking Neuron (DSN) model is introduced. By incorporating a state-driven dynamic gate, the DSN allows a neuron to enter a dormant state when its membrane potential falls below a predefined negative threshold, dynamically pruning redundant computations at the instance level. Crucially, this dormancy mechanism is directly integrated into the neuronal dynamics and trained end-to-end via backpropagation through time using surrogate gradients, enabling the network to actively learn a robust dormancy policy that adaptively preserves critical information flow. Extensive experiments across static and neuromorphic datasets demonstrate that the DSN framework consistently reduces computational energy by 40% to over 70%. Notably, on the large-scale ImageNet dataset, the DSN outperforms state-of-the-art static pruning techniques at comparable reported cost reductions and simultaneously improves the corresponding baseline SNN accuracy by 1.34%. By establishing a trainable, state-driven sparsity paradigm orthogonal to conventional input-driven methods, the DSN unlocks synergistic efficiency gains, presenting an effective approach for advancing neuromorphic computing.
70. 【2610.21719】International Multi-Centre Validation of Unsupervised Domain Adaptation for Precise Discrimination between Normal and Abnormal Retinal Development
链接：https://arxiv.org/abs/2610.21719
作者：Zhanhan Tu,Nikhil Reddy,Helen J. Kuht,Ha-Jun Yoon,Gail D. E. Maconachie,Ravi Purohit,Prateek Pani,Line Kessel,Jinu Han,Jing Jin,Shui-Hua Wang,Karthik Bharadwaj,Viral Sheth,Michael Hisaund,Rebecca J. McLean,George Garratt,Chetan Kantibhai Patel,Kanmin Xue,Callum Hunt,Zisen Zhou,Ian De Silva,Seema Teli,Sonal Shah,Vanessa Rodwell,Aarti Patel,Irene Gottlob,Yu-Dong Zhang,Zedong Zheng,Girish Varma,Mervyn G. Thomas
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Arrested retinal development, childhood visual impairment, grading optical coherence, optical coherence tomography, coherence tomography scans
备注： Submitted to Nature Medicine. 38 pages, 6 figures, 2 tables. Supplementary material includes 3 figures and 3 tables
点击查看摘要
Abstract:Arrested retinal development can cause childhood visual impairment, but grading optical coherence tomography scans is difficult to standardise across devices and centres. We developed and evaluated an unsupervised domain adaptation model to classify normal and abnormal retinal development across different OCT systems. This retrospective multicentre study used OCT scans from five centres in four countries and the UK Biobank. Data covered four OCT devices, including table mounted and handheld systems. A ResNet50 based Domain Adversarial Neural Network was trained using labelled images from a source device and unlabelled images from a target device. We evaluated six source to target pairings and compared model performance with seven clinician graders. A separate Heidelberg Spectralis dataset was reserved for external evaluation. Across validation sets, accuracy ranged from 87.75% to 96.06%, sensitivity from 88.68% to 98.38%, and specificity from 78.00% to 98.02%. The best performing model, adapted from TM OCT1 to HH OCT1, achieved 96.06% accuracy and an area under the receiver operating characteristic curve of 0.994, with a 95% confidence interval from 0.981 to 0.999. Several models also maintained discrimination on the unseen Heidelberg device. Unsupervised domain adaptation enabled OCT classification across devices without labelled target device data. The approach may support more consistent assessment of retinal development and large scale analysis of existing imaging datasets.
71. 【2610.21703】Mixture of Multi-Sequence Feature Difference for Contrast-Enhanced MRI Synthesis
链接：https://arxiv.org/abs/2610.21703
作者：Jonghun Kim,Junmo Kwon,Hyunjin Park
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Contrast-enhanced magnetic resonance, magnetic resonance imaging, Contrast-enhanced magnetic, segmenting brain tumors, resonance imaging
备注： ACCV 2026
点击查看摘要
Abstract:Contrast-enhanced magnetic resonance imaging (CE-MRI) is crucial for accurately diagnosing and segmenting brain tumors. However, the acquisition of CE-MRI requires injecting contrast agents, which poses potential health risks and increases scan costs. Here, we propose a CE-MRI synthesis method from non-contrast sequences, reducing both risk and cost. Unlike existing methods that rely on channel-wise concatenation to fuse multi-sequence information for synthesis, we introduce a Mixture of Feature Difference (MoFD) module. The proposed module uses a dynamic weighting strategy to adaptively select and aggregate informative features from both individual source sequences and explicit differences among them. Quantitative and qualitative evaluations demonstrate that our proposed method outperforms baselines in terms of image fidelity and perceptual quality on the UCSF-PDGM and UPenn-GBM datasets. Our method successfully reconstructs tumor regions and achieves segmentation performance comparable to that obtained with real CE-MRI. Our ablation studies show that although adversarial learning improves perceptual quality, a regression-based variant of our method achieves higher structural fidelity.
72. 【2610.21696】Bridging the Markerless Tracking Validation Gap: Intraoperative X-ray Workflow Integration
链接：https://arxiv.org/abs/2610.21696
作者：Connor Daly,Salvatore Russo,Jinendra Ekanayake,Daniel S. Elson,Ferdinando Rodriguez y Baena
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：invasive bone-anchored fiducials, existing clinical dataset, intraoperative C-arm fluoroscopy, routine intraoperative C-arm, RGB-D sensors
备注： This version was submitted to MICCAI 2026 for review, see journal reference for published version
点击查看摘要
Abstract:Markerless intraoperative tracking of spinal anatomy via RGB-D sensors is a promising alternative to invasive bone-anchored fiducials, yet no existing clinical dataset provides independent subsurface ground truth for validating these methods. We address this gap with a clinically viable pipeline that derives per-vertebra 6-DoF pose from routine intraoperative C-arm fluoroscopy, co-registered to the RGB-D camera frame through a multimodal fiducial array detectable in both imaging modalities. Critically, the pipeline requires no additional radiation, instrumentation, or deviation from standard surgical workflows, relying solely on the fluoroscopic images already acquired during routine level checks. A calibrated transform chain links the vertebral pose recovered via multi-view 2D-3D CT-to-fluoroscopy registration to the RGB-D coordinate frame, enabling direct comparison of any markerless registration estimate against a subsurface reference. Ex vivo validation against optically tracked ovine vertebrae confirms end-to-end accuracy of 2.06 +- 0.29 mm and 3.35 +- 0.93 degrees, sufficient to serve as independent ground truth for methods with substantially larger errors. We demonstrate the pipeline's utility by evaluating two markerless registration strategies on clinical data spanning 11 vertebrae across 1,500 frames from three surgical sequences: the first such evaluation against an independent subsurface reference in a clinical setting. The proposed framework provides reusable infrastructure for benchmarking emerging markerless tracking methods on real surgical data.
73. 【2610.21668】Edit4D: Editable 4D Scene Generation with Textual Control
链接：https://arxiv.org/abs/2610.21668
作者：Chanwoo Kim,Tackgeun You,Hwasup Lim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：framework that constructs, scene generation framework, dynamic character, dynamic character representations, generation framework
备注： 21 pages, 16 figures. Project page: [this https URL](https://chanwo0kim.github.io/Edit4D/)
点击查看摘要
Abstract:We introduce Edit4D, an editable text-to-4D scene generation framework that constructs 4D scenes from separate background and dynamic character representations. Recent advances in generative models have enabled text-driven dynamic scene synthesis, but editable 4D scene generation remains challenging due to the need to preserve spatial geometry and temporal dynamics. Existing approaches typically generate holistic scene videos, where the background and dynamic characters are coupled, making object-level editing and flexible camera control difficult. Edit4D addresses these limitations through a stage-specific generation pipeline. Given a user instruction, Edit4D first decomposes it into stage-specific prompts for background, dynamic character, and scene-character composition. Using these prompts, we synthesize multi-view scene images with text-to-image and camera-conditioned generative priors and reconstruct a background 3D Gaussian splatting representation. We then generate a character image, animate it with an image-conditioned video prior, reconstruct a 4D mesh, and bind Gaussian primitives to obtain a character representation. Finally, both components are composed through text-guided segmentation and contact-aware optimization. A global scene refinement is then performed to improve harmonization and rendering consistency. By integrating stage-specific components, Edit4D enables controllable camera motion, flexible object-level editing, and the practical construction of editable 4D scenes. Project page: this https URL
74. 【2610.21667】FusionAudit: Pathway-Conditioned Robustness Auditing for Native Multimodal Models
链接：https://arxiv.org/abs/2610.21667
作者：Jiaming Zhang,Zherui Li,Siqi Guo,Junhao Dong,Kun Wang,Wei Yang Bryan Lim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：channel increasingly serves, visual channel increasingly, native multimodal architectures, transition from frozen-encoder, multimodal architectures
备注： NeurIPS 2026
点击查看摘要
Abstract:As vision-language models (VLMs) transition from frozen-encoder pipelines to native multimodal architectures, the visual channel increasingly serves as both a perceptual input and a carrier of rendered text that competes with user prompts. Current single-attack, pixel-centric evaluations fail to capture this complexity: they collapse distinct visual attack surfaces into a single scalar and ignore how architectural shifts alter vulnerability. We introduce PaRMA, an evidence-based auditing framework that defines pathway-conditioned risk over two primary image-level interventions: pixel perturbation and rendered-text insertion. Instead of arbitrary attack enumeration, PaRMA uses pathway-specific diagnostics to expose architecture-specific blind spots. Notably, we uncover a see-but-not-deceived signature where native VLMs attend heavily to typographic overlays but visually reject them, and we identify an objective mismatch between encoder-level and answer-level attacks in deep-fusion models. To exploit these findings, we instantiate FusionAudit, introducing two diagnostic-motivated attacks: MANTIS (margin-aware pixel perturbation) and Nat-Evid (host-congruent semantic insertion). Evaluating 18 open-weight VLMs across a novel nativeness taxonomy, we demonstrate that legacy single-attack rankings (e.g., PGD) are unstable for native models. Our diagnostic-driven attacks substantially raise the estimated residual risk, showing that PaRMA provides a falsifiable, evidence-driven auditing methodology for uncovering vulnerabilities missed by standard benchmarks.
75. 【2610.21654】Digital Typhoon Dataset V3: Benchmarking for Multi-spectral Extension and Analyzing Systematic Bias in Intensity Regression
链接：https://arxiv.org/abs/2610.21654
作者：Asanobu Kitamoto,Victor Le Louarn,Noelia Falczuk,Ngoc Anh Tong,Anja Veleva
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：long-term spatio-temporal data, Digital Typhoon Dataset, machine learning models, benchmark machine learning, longest typhoon satellite
备注： 23 pages, 6 figures, dataset paper
点击查看摘要
Abstract:This paper presents the Digital Typhoon Dataset V3, a new version of the longest typhoon satellite image dataset spanning nearly 50 years, designed to benchmark machine learning models on long-term spatio-temporal data. The latest addition to Dataset V3 is multispectral satellite data, enabling multi-channel models. We investigate data-splitting strategies and present benchmarking results for the Northern and Southern Hemispheres. Experimental results show that, under the current dataset construction and experimental setting, multi-channel inputs do not clearly outperform single-channel inputs for pressure regression. Among the evaluated model architectures, image types, and spectral channels, ResNet-18, full-resolution images, and Channel 1 generally provide the best single-channel performance for pressure regression. Performance also differs between the WP and AU datasets by regression target, with lower RMSE on WP for pressure regression and on AU for wind regression. These results highlight the importance of considering dataset-specific and task-specific characteristics when interpreting benchmark performance. Additionally, we analyzed systematic bias in intensity regression, which leads to underestimation of intensity for strong typhoons. We tested imbalance-aware weighting strategies, including inverse-density weighting inspired by BalancedMSE, and showed that these approaches are not sufficient to remove the bias. The dataset is publicly available at this http URL and this https URL.
76. 【2610.21642】SCMerge: Spatial-Consistency-Aware Token Pair Merging for Efficient Semantic Segmentation
链接：https://arxiv.org/abs/2610.21642
作者：Junfeng Ren(1),Yi Gong(1),Yuan Zeng(2) ((1) Southern University of Science and Technology, (2) Shenzhen Technology University)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：hinders practical applications, showcased impressive performance, quadratic attention complexity, attention complexity hinders, complexity hinders practical
备注： 10 pages, 4 figures
点击查看摘要
Abstract:Vision Transformer architectures have showcased impressive performance on semantic segmentation, yet their quadratic attention complexity hinders practical applications. Recent works have focused on merging tokens to reduce sequence length and thus improve transformer efficiency. However, existing token merging methods primarily rely on feature similarity to identify similar tokens, overlooking spatial consistency, which may introduce segmentation errors in semantic segmentation. In this work, we propose SCMerge, a training-free token merging method that jointly considers feature similarity and spatial consistency in pairing similar tokens. The pairwise tokens are then merged within the encoder, and the resulting token sequences are reconstructed onto the original patch grid after decoding. The proposed method is flexible and can be plugged into existing vision Transformer-based semantic segmentation pipelines. Extensive experiments on the benchmark datasets ADE20K, Pascal Context, and Cityscapes show that SCMerge consistently achieves a better trade-off between segmentation accuracy and efficiency than baseline methods.
77. 【2610.21639】DIAL: Dynamic and Informed Adjustment of the Native Stochastic Law for Reliable Weather Ensembles
链接：https://arxiv.org/abs/2610.21639
作者：Yucheng Wang,Haonan Guo,Tianhao Zhao,Di Wang,Yu Wu,Zengmao Wang,Bo Du
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reliable in global, global averages, averages while hiding, DIAL, Ensemble weather forecasts
备注： 17 pages, 5 figures, including appendix
点击查看摘要
Abstract:Ensemble weather forecasts can look reliable in global averages while hiding too little spread in some cases and too much in others. These errors vary across variables, spatial scales, lead times, and weather states. Adapting randomness during forecasting can correct these errors, but training fixes stochastic behavior beforehand and output calibration acts afterward. Inference guidance also acts during forecasting, but typically scores ensemble members separately rather than the ensemble as a whole. Reliability feedback arrives at the end, and tracing it backward through many chaotic forecast steps is expensive and unstable. We therefore introduce Dynamic and Informed Adjustment of the Native Stochastic Law (DIAL), which controls a frozen model's native stochasticity. DIAL learns from past forecasts to predict whether each variable and scale needs more or less spread. As a forecast develops, it estimates how possible noise changes will affect later forecast accuracy and reliability. It combines these predictions to make small noise updates at each step. This loop avoids retraining the weather model and full backpropagation through the forecast. We evaluate DIAL on FourCastNet 3 (FCN3) using later ERA5 years unseen during training. DIAL provides better scale-resolved reliability than learned postprocessing and reward-based control baselines. Relative to the unmodified Native FCN3 reference, DIAL achieves an 8.27% improvement in the primary multiscale continuous ranked probability score (CRPS).
78. 【2610.21638】Spurious Attention Heads in Vision Transformers: Mechanistic Identification of Annotation-Driven Bias in Medical Chest X-Ray Analysis
链接：https://arxiv.org/abs/2610.21638
作者：Joshua Muhumuza,Cornelius Kalenzi
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Vision Transformers deployed, Vision Transformers, medical imaging exploit, Transformers deployed, exploit spurious correlations
备注： 8 pages, 8 figures
点击查看摘要
Abstract:Vision Transformers deployed in medical imaging exploit spurious correlations, yet the internal mechanisms remain unidentified and impossible to fix. We apply mechanistic interpretability to locate one such mechanism in ViT-Base 16: a single attention head (L8H10) that functions as a dedicated annotation-reader on chest X-rays, attending to corner text rather than lung pathology in 62% of 200 COVID-19 images. Causal validation via inpainting confirms annotation content rather than luminance or edge density drives the behaviour, increasing lung attention 1.52 times upon removal in affected images ($p{}0.0001$). The finding replicates across NIH ChestX-ray14 (79%), DeiT-Base (88%), and ViT-Large 16 (80%), establishing spurious annotation-attending heads as a consistent property of ViT-family architectures across two datasets and three architectures. Full fine-tuning does not suppress the behaviour and may entrench it: 98.4% of spurious images remain spurious and the spurious rate rises marginally, as the shortcut is reinforced rather than removed. Critically, single-head ablation produces $p{=}0.340$ and multi-head ablation of all three identified carriers produces $p{=}0.532$, meaning a causally verified annotation-reading circuit is completely invisible to output-level evaluation. Mechanistic auditing finds what behavioural testing cannot.
79. 【2610.21634】Anchor3DGS: Feed-Forward 3D Gaussian Splatting with Compact Anchor-Based Representation
链接：https://arxiv.org/abs/2610.21634
作者：Sheng Ye,Jiangke Lin,Fudong Wang,Yi Yuan,Zhen-Hui Dong,Yong-Jin Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single forward pass, Recent feed-forward, enabled effective multi-view, predicting Gaussian primitives, reconstruction by predicting
备注： NeurIPS 2026
点击查看摘要
Abstract:Recent feed-forward 3D Gaussian Splatting (3DGS) methods have enabled effective multi-view 3D reconstruction by predicting Gaussian primitives in a single forward pass. However, existing approaches predominantly adopt a pixel-aligned paradigm that predicts one Gaussian per input pixel, coupling the Gaussian count to the input resolution and number of views. This also leads to redundant primitives in textureless regions and insufficient coverage in geometrically complex areas. We present Anchor3DGS, a pose-free feed-forward 3DGS framework that replaces pixel-aligned prediction with a compact anchor-based representation. Guided by information entropy, our method places a set of 3D anchors in the scene, concentrating them in regions of higher visual complexity while maintaining broad spatial coverage. Each anchor performs occlusion-aware aggregation of multi-view image features, exchanges information with other anchors, and is decoded into a set of local Gaussians. A lightweight feature enhancement module further refines the coarse RGB output from Gaussian splatting and improves rendering fidelity. Extensive experiments on diverse benchmark datasets demonstrate that our Anchor3DGS achieves state-of-the-art novel view synthesis quality while only using an order of magnitude fewer Gaussian primitives.
80. 【2610.21619】raining-Free Target-Aware Refinement of 3D Gaussian Language Map
链接：https://arxiv.org/abs/2610.21619
作者：Sibaek Lee,Kyeongsu Kang,Seongbo Ha,Yewon Jeon,Joonyeol Choi,Daegeol Ko,Jaehyuk Hur,Taemin Choi,Minsu Kim,Hyungjoo Ahn,Wonsok Yoo,Hyeonwoo Yu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting yields, Distilling vision-language features, Gaussian Splatting, Distilling vision-language, Splatting yields
备注： 8 pages, 6 figures. Project page: [this https URL](https://lab-of-ai-and-robotics.github.io/target-aware-langmap/)
点击查看摘要
Abstract:Distilling vision-language features into 3D Gaussian Splatting yields a language map that can be queried with arbitrary text. In deployment, however, a small set of user-specified targets must be reliably located, which current distilled maps often miss, while open-vocabulary queryability for other words must remain intact. We propose a training-free, target-aware refinement of an already-distilled language map. Guided by a text-promptable segmenter, the visual embedding inside each detected target region is blended with the target text embedding, a convex combination whose coefficient sets the amount of injected prior, while non-target regions are left untouched. Injecting too much overwrites appearance cues and general queryability, so we seek, for each target, the smallest coefficient that still lets it win, and we obtain every coefficient in closed form, leaving no hyperparameters to tune. We further identify a failure mode of injection in language-goal localization. Text embeddings share a common component, and injecting them makes the standard cosine read-out query-agnostic, which a centering step in the read-out removes. Across three benchmarks, the refinement consistently improves open-vocabulary segmentation, roughly doubling the base mIoU on Replica, and localizes language goals more reliably than the base map. It also transfers as a plug-in to off-the-shelf field-based and object-level language maps and supports a real-world demonstration in which a legged robot navigates to natural-language goals. Project page and code: this https URL
81. 【2610.21616】A Decision-Aware Evaluation Protocol for Uncertainty in Medical Image Segmentation
链接：https://arxiv.org/abs/2610.21616
作者：Saket Maganti,Shreyank N Gowda
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：downstream review decisions, Medical segmentation uncertainty, improves downstream review, uncertainty improves downstream, Medical segmentation
备注：
点击查看摘要
Abstract:Medical segmentation uncertainty is often evaluated with calibration error or pixel-level error-detection scores, but these metrics do not show whether uncertainty improves downstream review decisions. We propose a decision-aware evaluation protocol that separates uncertainty estimation from deferral policy and evaluates their combination under fixed review budgets: which pixels, regions, or images should be accepted, and which should be reviewed. The protocol reports fixed-budget error reduction, risk-coverage behaviour, region-level review proxies, structural failure modes, probability-derived baselines, and sensitivity to review assumptions. We instantiate it across retinal vessel, skin lesion, and polyp segmentation with multiple backbones and uncertainty estimators. Under matched inference budgets and canonical multi-layer MC Dropout, test-time augmentation (TTA) gives a stronger error-detection signal across matched MC--TTA comparisons, including architecture and dropout-placement checks. However, estimator rankings are not universal. For example, probability-derived scores remain competitive, deep ensembles can outperform TTA, learned deferral helps mainly when the base estimator is weak, and rankings can change with review unit, uncertainty target, correction assumptions, and cost model. Structural and second-observer analyses further show that boundary and thin-structure failures are partly tied to annotation ambiguity. These findings support evaluating uncertainty as an estimator-policy-review configuration, not as a standalone score map. Code: this https URL
82. 【2610.21588】Hear, Localize, and Reason: Spatially Aware Scene Understanding for Audio-Visual LLMs
链接：https://arxiv.org/abs/2610.21588
作者：Kim Sung-Bin,Lee Jung-Mok,Jinwoo Jung,Oh Hyun-Bin,Hyeonggon Ryu,David Harwath,Tae-Hyun Oh
类目：Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：Audio-visual large language, made strong progress, large language models, limiting their ability, large language
备注： NeurIPS 2026; Project page: [this https URL](https://hlrllm.github.io/)
点击查看摘要
Abstract:Audio-visual large language models (AV-LLMs) have made strong progress in multimodal understanding, yet most treat audio as monaural semantic content, limiting their ability to reason about where sounds originate and how they relate to the visual scene. Recent spatial audio-visual studies address parts of this problem, but often focus on specific abilities, such as spatial correspondence or direction and distance reasoning. In this work, we introduce HLR-AVSceneQA, a comprehensive benchmark with a hear-localize-reason hierarchy that evaluates whether models can recognize what is heard, localize sound sources in egocentric and allocentric views, and use these localized sources to reason about how they relate to the visual scene. We further introduce HLR-LLM, which augments a strong audio-visual foundation model with a binaural spatial audio branch alongside its monaural semantic audio pathway. We train HLR-LLM with a curriculum that incorporates final-stage chain-of-thought supervision for multi-step spatial reasoning. Experiments show that existing AV-LLMs remain limited in spatial grounding and relational reasoning, while HLR-LLM substantially improves spatial audio-visual scene understanding without compromising semantic audio-visual perception.
83. 【2610.21573】MYOPIA: Understanding the Limits of Tree-Based Reasoning in Vision-Language Models
链接：https://arxiv.org/abs/2610.21573
作者：Islam Mesabah,Sary Elmansoury,Gerrit Großmann,Peter Neigel,Sebastian J. Vollmer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：make vision-language model, make vision-language, interpretable by replacing, replacing a single, single prediction
备注：
点击查看摘要
Abstract:Decision trees can make vision-language model (VLM) classification interpretable by replacing a single prediction with a sequence of root-to-leaf questions. However, the accuracy cost of this greedy, non-backtracking procedure remains unclear. We introduce \textbf{MYOPIA}, a benchmark comprising four LLM-generated, human-refined decision trees for GTSRB, MNIST, CIFAR-10, and MSCOCO, together with matched prompts, diagnostic protocols, and an evaluation harness. Across GPT-4o, Qwen-VL Max, and LLaMA-3.2 11B Vision, tree traversal underperforms zero-shot prompting in all 12 dataset--model pairs; paired bootstrap analyses consistently favor zero-shot. Our diagnostics characterize interacting failure modes associated with this gap. Models often recall tree-encoded class attributes more accurately than they ground the same attributes in images: the mean label--image accuracy gaps are 9.5, 13.8, and 12.6 points for GPT-4o, Qwen-VL Max, and LLaMA, respectively. Incorrect local decisions then irreversibly exclude the correct class, while answer extraction introduces additional model-dependent loss. A node-level audit of the four trees finds that split entropy is weakly but consistently associated with lower node accuracy, whereas depth, branching factor, and within-node grounding differences are less stable. \textbf{MYOPIA} therefore provides a framework for diagnosing hierarchical visual classification and motivates testing tree designs that prioritize perceptual answerability and recovery from early errors. Code is available at this https URL.
84. 【2610.21569】Decoupled Safety Control: A Safety-Control Algorithm for Training-Free Safety Guidance
链接：https://arxiv.org/abs/2610.21569
作者：Huilin Zhou,Ruoxi Cheng,Yuhang Wang,Yuming Liu,Minghao Sun,Ruolong Ma,Lan Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diffusion models achieve, achieve strong performance, models achieve strong, Diffusion models, achieve strong
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Diffusion models achieve strong performance in text-to-image generation, but they can still produce unsafe content. Training-free safety guidance offers a practical inference-time alternative that intervenes during sampling without modifying model weights. However, many existing safeguards still rely on a coupled safety-control chain. In this chain, the same unsafe condition simultaneously specifies what should be avoided, indicates the current unsafe signal, constructs the intervention, and determines when that intervention remains active. This coupling can work when unsafe factors are explicit, but becomes less reliable once harmful and benign semantics are entangled in the current generation state, often leaving residual unsafe content or unnecessarily degrading benign-generation quality or prompt fidelity. We address this problem with Decoupled Safety Control (DSC), a plug-in safety-control algorithm for training-free safety guidance. DSC reformulates training-free safety guidance as an explicit state-dependent control process, so the executed intervention is determined from the current generation state rather than inherited directly from a single unsafe condition. Experiments on standard safety benchmarks show that DSC improves representative latent- and text-space safeguards, achieving stronger unsafe-content suppression while preserving benign-generation quality and maintaining efficient inference.
85. 【2610.21550】Rethinking Classifier-Free Guidance for TI2I Flow Matching
链接：https://arxiv.org/abs/2610.21550
作者：Andreas Floros,Elena Koritska,Teofilo de Campos,Christoph Vogel,Chu-Tak Li,Anuj Sharma,Alexandros Neophytou
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：controllable image editing, flow matching methods, matching methods, methods for controllable, controllable image
备注：
点击查看摘要
Abstract:We study Text-and-Image-to-Image (TI2I) flow matching methods for controllable image editing. In a broader generative modeling context, Classifier-Free Guidance (CFG) is established as a key component responsible for high quality outputs. However, we argue that its role in TI2I modeling is poorly understood. Specifically, we make the surprising observation that the CFG mechanism is implicitly harmful for editing in the noisy phase of flow modeling, hindering instruction following and controllability. We propose a simple correction in the early flow steps, enabling a richer alignment-preservation tradeoff at no extra cost. The effectiveness of our approach is demonstrated on both pixel-space and latent TI2I flows.
86. 【2610.21505】FilterFusion: Prior-Guided Adaptive Filter Fusion for Efficient Video Denoising
链接：https://arxiv.org/abs/2610.21505
作者：Wenlong Yang,Weihang Yuan,Canran Jin,Jiahao Li,Henrik Turbell,Lifeng Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：tight latency budgets, Real-world video denoising, handle mixed degradations, Real-world video, compression artifacts
备注： Accepted by MMSP 2026
点击查看摘要
Abstract:Real-world video denoising for communication systems must handle mixed degradations such as sensor noise, compression artifacts, and motion-induced inconsistency while remaining deployable under tight latency budgets. Purely deep models often achieve high accuracy but come with significant computational cost, whereas classical filters are robust and efficient but insufficiently adaptive. We present FilterFusion, a prior-guided multi-frame denoising framework that combines temporally-aware learned features with an interpretable bank of denoising branches. The model predicts a low-cost guidance signal and uses it to adaptively mix a compact set of denoising responses at the original resolution. The lightweight design uses only 109K parameters and explicitly injects temporal variance and spatial variance cues into the low-resolution controller. On CRVD (real sensor noise), it reaches 34.72 dB PSNR and 0.9330 SSIM with only 0.18 GFLOPs (network-only). Because the filter-bank operations are simple and regular (Gaussian blur, median, weighted sum), a straightforward compiled C implementation of the synthesis path achieves 17.9ms per frame (55.9 FPS) on a single CPU thread at 1080p---exceeding real-time and 122--252 times faster than lightweight CNN baselines that require over 2 seconds per frame. The results demonstrate a strong quality-efficiency-speed trade-off and a practical route to real-time denoising through low-resolution control and explicit filter-based synthesis.
87. 【2610.21498】GRASE: Geometry-native Real-to-sim Agentic Scene Modeling from Video
链接：https://arxiv.org/abs/2610.21498
作者：Zhaorui Lin,Haohan Liu,Zhen Chen,Xiangru Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：aims to turn, real environment, GRASE, captured multi-view video, final scene inconsistent
备注：
点击查看摘要
Abstract:Real-to-sim conversion aims to turn a captured video of a real environment into an editable 3D scene while preserving the geometry and layout of what was observed. Existing methods often follow a one-pass, loosely coupled paradigm: each stage receives only limited feedback from previous stages, allowing errors to propagate without reliable correction and leaving the final scene inconsistent. We present GRASE, an agentic framework that closes this loop by treating the captured multi-view video observations as a standing reference throughout scene modeling. Instead of committing to intermediate estimates, GRASE revises its current hypothesis whenever rendered evidence disagrees with the capture, overcoming the fixed intermediate assumptions of conventional pipelines. Specifically, GRASE first fits the architectural shell and its openings from depth and multi-view cues. An agent then places generated assets in a shared coordinate frame while checking their spatial relationships. Finally, each asset's geometry and placement are refined iteratively to improve agreement across the observed views. By coupling these steps through feedback, GRASE localizes structural discrepancies and revises only the responsible components, while preserving cross-view consistency. The resulting 3D scenes are faithful to the input, consistent across views, and suitable for simulations. In our experiments, GRASE substantially outperforms other state-of-the-art methods, including a direct real-to-sim conversion using GPT6-Astra.
88. 【2610.21482】AI-Driven Disaster Response and Displacement Monitoring
链接：https://arxiv.org/abs/2610.21482
作者：Noora Al-Emadi,Muhammad Imran,Yin Yang,Ingmar Weber,Fabjan Lashi,Gaia Rigodanza,Ivana Hajzmanova,Ferda Ofli
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：ARTIFICIAL INTELLIGENCE, humanitarian tasks, offering scalable, pressing challenges, demonstrated its potential
备注：
点击查看摘要
Abstract:ARTIFICIAL INTELLIGENCE (AI) has demonstrated its potential across a wide range of humanitarian tasks, offering scalable and data-driven solutions to some of the world's most pressing challenges. For instance, in addressing climate change, AI-powered models are being used for faster and more accurate global weather forecasting, control and design of renewable energy, and monitoring deforestation. Machine learning algorithms analyze satellite imagery and socioeconomic data to predict poverty and promote sustainable development. AI has also transformed disaster response and conflict monitoring, providing innovative solutions for assessing damage and urgent needs and tracking displacement.
89. 【2610.21470】Cross-Prompt Inference Mitigates Rare-Class Suppression in Imbalanced VLM Finetuning
链接：https://arxiv.org/abs/2610.21470
作者：Emanuel Ben Baruch,Sivan Biham,Alon Shoshan,Yochai Zvik,Avi Ben-Cohen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：class-imbalanced data, zero-shot performance, finetuned on class-imbalanced, rare-class recall, recall
备注：
点击查看摘要
Abstract:When a vision-language model is finetuned on class-imbalanced data, rare-class recall can fall well below the model's own zero-shot performance. In this regime, we uncover a surprising matched-prompt penalty whereby the standard choice of reusing the descriptive finetuning prompt at inference can yield lower rare-class recall than using a different descriptive prompt. We call this inference-time strategy cross-prompt inference. We evaluate diverse VLMs across six datasets and find that cross-prompt inference consistently recovers rare-class recall, with varying trade-offs in frequent-class recall. The effect reflects a train-eval prompt interaction rather than prompt quality alone, and does not arise with non-descriptive prompt changes. It is strongest when imbalance and visual confusability produce substantial rare-class suppression, and is weak or absent when such suppression does not occur. Using Tuning Contribution (TuCo), which decomposes a model's computation into pretrained and finetuning parts, we find that cross-prompt inference reduces reliance on finetuning-induced computation and shifts the model toward its pretrained component. Reducing that finetuning contribution also substantially reduces the cross-prompt advantage. These results show that rare-class knowledge suppressed by imbalanced finetuning can remain accessible under a different inference prompt.
90. 【2610.21459】Can Visual Generation Expand What Unified Multimodal Models Know?
链接：https://arxiv.org/abs/2610.21459
作者：Wenkai Li,Wenyi Hong,Zhuoyi Yang,Jie Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Unified multimodal models, Unified multimodal, information not fully, fully documented, receive image-generation supervision
备注：
点击查看摘要
Abstract:Unified multimodal models (UMMs) receive image-generation supervision that exposes them to visual information not fully documented in text. Can learning to generate images expand what pretrained models know? We introduce Knowledge Transfer Probing (KTP), a controlled protocol that supplies new knowledge through image-generation training and tests its accessibility through text-only question answering. Across seven knowledge categories and three UMMs, we observe direct but uneven transfer from visual supervision to language. Motivated by these observations, we successively introduce Textual Alignment and Interleaved Image--Text Alignment, which connect generation and answering through shared knowledge and interleaved responses, respectively. Guidance on selected entities can improve knowledge access on other entities without QA supervision, with additional gains from interleaved alignment. Further analysis shows that knowledge correctly reproduced in images is often more accessible through text, although substantial gaps remain between the two forms of access. These findings support visual generation as a source of knowledge beyond textual supervision, and motivate joint investigation of training data design and model architecture to make this knowledge more broadly accessible.
91. 【2610.21453】CarryOn: A Dual-Loop Harness for Personalized and Reliable Robot Assistance
链接：https://arxiv.org/abs/2610.21453
作者：Zixuan Wang,Yuqi Liu,Yuxin Chen,Sengqiao Yang,Jinhui Ye,Pengguang Chen,Changsheng Lu,Shu Liu,Bei Yu,Jiaya Jia
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：diverse open-world manipulation, real-world robotic assistance, enabled diverse open-world, robotic assistance requires, models have enabled
备注： Project page: [this https URL](https://vincent2311.github.io/Projects/CarryOn/)
点击查看摘要
Abstract:While generalist vision-language-action (VLA) models have enabled diverse open-world manipulation, real-world robotic assistance requires two critical capabilities they currently lack: personalization and reliable execution. First, executing an instruction like "make me a sandwich" requires grounding subtask decomposition in persistent user preferences rather than relying on a single generic solution. Second, reliable deployment demands explainable safety assurance that proactively prevents hazards and gracefully recovers from occasional physical failures. To address these gaps, we present CarryOn, a dual-loop harness designed to augment a frozen VLA policy. The planning loop maintains persistent user-level and scene-level context that is continually grounded against new observations and revised through interaction, enabling personalized task selection and execution grounding across conversations and changing scenes. The execution loop actively supervises policy rollouts, shielding actions from predicted hazardous contact. When execution fails, the system invokes reusable control-based recovery skills that restore task progress and are refined through reflection on earlier failures. On a real robot and in simulation, CarryOn dispatches preference-consistent subtasks across users and scenes, reduces the violation rate of an already safety-finetuned VLA from 52.6% to 6.1%, and increases recovery success from 13% to 80% when refined skills are reused.
92. 【2610.21451】PET Quantification-Preserving Registration for Longitudinal Whole-Body PSMA PET/CT
链接：https://arxiv.org/abs/2610.21451
作者：Fryderyk Kögl,Anna Reithmeir,Daniel M. Lang,Emily Chan,Rickmer Braren,Julia A. Schnabel
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：longitudinal whole-body PSMA, whole-body PSMA PET, whole-body PSMA, PSMA PET, PSMAReg challenge
备注：
点击查看摘要
Abstract:We adapt the diffeomorphic coarse-to-fine LapIRN architecture for longitudinal whole-body PSMA PET/CT registration in the Learn2Reg 2026 PSMAReg challenge. The method combines affine pre-registration, multi-modal deformable registration, and test-time instance optimization. We further introduce PET biomarker preservation losses for metabolic tumor volume (MTV) and total lesion glycolysis (TLG), including Jacobian-based constraints, and a per-structure rigidity regularization for skeletal structures. The submitted configuration achieved 81.0% DSC and 6.17 mm HD95, with MTV and TLG errors of 3.3% and 3.3%, respectively, on our evaluation protocol. Code is available at this https URL.
93. 【2610.21450】X-Fly: Learning to Reach and Stop in Full-Chunk Aerial Vision-Language Navigation
链接：https://arxiv.org/abs/2610.21450
作者：Ruibin Ju,Ruifeng Cai,Min Xu,Lin Wang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Aerial vision-language navigation, large vision-language models, vision-language navigation, agents built, expensive to query
备注： 13 pages, 5 figures, 3 tables. Project page: [this https URL](https://juliusju572.github.io/x-fly/)
点击查看摘要
Abstract:Aerial vision-language navigation (VLN) agents built on large vision-language models are expensive to query. Executing a complete predicted action chunk before replanning amortizes this cost, reducing model inference from 195 to 42 ms per executed waypoint for our policy. It also moves the states at which the policy is queried away from expert demonstrations, which supervise neither recovery from these states nor termination at the learner's own arrival. On OpenFly test-seen, no-stop failures account for 47.78% of full-chunk behavior cloning (BC) outcomes. We present X-Fly, a staged training framework for full-chunk aerial VLN. Recovery DAgger labels learner-visited decision states with smooth chunks that reconnect to future expert segments and with STOP at the first in-region state. Flow-GRPO then jointly refines the chunked flow controller and a Bernoulli STOP policy from same-task closed-loop outcomes, supplemented by outcome-verified stopping supervision. With eight controls per decision, X-Fly reaches 74.18% SR on test-seen and 51.73% on test-unseen, compared with 16.45% and 18.43% for full-chunk BC and 32.04% and 29.46% for DreamFly.
94. 【2610.21438】RLDF: A Region-Level Deepfake Dataset and Benchmark for Partial-Face Manipulation Detection
链接：https://arxiv.org/abs/2610.21438
作者：Shukesh Reddy,Abhijit Das
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：exclusively fully swapped, fully synthesised faces, Existing deepfake detection, local facial sub-region, deepfake detection models
备注：
点击查看摘要
Abstract:Existing deepfake detection models are built upon manipu- lated images that are tampered with either exclusively fully swapped or fully synthesised faces, which leads us to an open question: Can off-the-shelf deepfake models detect manipulation effectively while tampering is confined to a local facial sub-region? To fill this gap, we introduce RLDF (Region-Level Deepfake), the first dataset for region-level deepfake evaluation. Employing the proposed region-aware partial swap synthesis model, we generate over 2M par- tial face-swap images by using eight face-swapping meth- ods. Altogether, we considered seven face regions, among which there are four discrete regions (eye, nose, mouth and eyebrow) and four composite facial regions (eye and nose; eye, nose and mouth; eye, nose, mouth and eye- brow; and full face). In addition, we define three evalu- ation protocols and benchmark 12 state-of-the-art detectors across the five popular standard cross-dataset evaluations, DF40, and the proposed RLDF, providing a comprehen- sive audit of where and why existing detectors underper- formed. Our evaluation reveals that existing detectors fail to generalize consistently across partial facial regions, re- sulting in an overall drop of 10.5% AUC and 10% accu- racy under region-level evaluation. Further, we propose a mask-guided cross-attention model as a baseline approach that can effectively detect region-level manipulation. The proposed dataset, code, and checkpoints are available at this https URL.
95. 【2610.21433】ManiFusion: Unlocking the High-Throughput Generation via Superposition in Manifold Space
链接：https://arxiv.org/abs/2610.21433
作者：Minkyu Kim,Baekseung Kim,Junhoo Lee,Jangho Kim,Nojun Kwak
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：models achieve high-quality, achieve high-quality image, remain computationally expensive, computationally expensive due, Diffusion models achieve
备注：
点击查看摘要
Abstract:Diffusion models achieve high-quality image generation but remain computationally expensive due to iterative denoising across many timesteps. Existing acceleration methods mainly reduce per-sample latency, but gains along this axis are becoming saturated. We instead explore an orthogonal throughput-oriented direction by processing multiple samples within a single denoising evaluation. To this end, we propose ManiFusion, a backbone-agnostic framework for multi-sample generation through fused-space computation. ManiFusion jointly processes multiple samples by fusing them before the denoising backbone and separating them afterward through unfusion. We provide a geometric perspective on how multiple samples can share a fused representation while retaining the information needed to guide their individual generation trajectories. To better align fusion allocation with denoising stages, ManiFusion uses Trajectory-Fusion Scheduling (TFS), which dynamically adjusts fusion factors throughout sampling. ManiFusion generalizes across diffusion families, including both U-Net and transformer backbones in pixel and latent spaces. We further show that ManiFusion composes with existing acceleration methods and reaches throughput regimes unattainable by prior approaches with minimal quality degradation.
96. 【2610.21422】Where, How, and When: Query-Guided Grounding for Video Understanding
链接：https://arxiv.org/abs/2610.21422
作者：Yogesh Kumar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：content requires reasoning, specific actions occur, video content requires, specific moments occur, levels of granularity
备注：
点击查看摘要
Abstract:Understanding video content requires reasoning at multiple levels of granularity, from identifying objects to interpreting their interactions and localizing when specific actions occur. This thesis studies three query-guided grounding tasks that answer where key objects are (object-level grounding), how they interact (relationship-level grounding), and when specific moments occur (moment-level grounding). For object-level grounding, we present QDETRv, a query-guided extension of the Detection Transformer for one-shot localization of unseen objects in videos, which combines query-context fusion, a memory module for temporal consistency, and unsupervised pretraining on synthetic object trajectories. We further propose the Temporal Object-Aware Vision Transformer (TOViT) for few-shot video object detection, which builds on a language-aligned open-set vision encoder and propagates high-confidence object features across frames. For relationship-level grounding, we introduce few-shot referring relationships in videos: given a (subject, predicate, object) query and a few support videos sharing the predicate, the entities are localized by optimizing a T-partite random field using a meta-learned relation network with query-conditioned translational embeddings, Global Semantic Aggregation, Local Localization Aggregation, and belief-propagation-based message passing. For moment-level grounding, we propose the Moment Alignment Transformer (MATR) for video-to-video moment retrieval, which uses dual-stage Dynamic Time Warping for pre- and post-fusion alignment, learnable queries for boundary prediction, and self-supervised pretraining with temporal augmentations; MATR also extends to text-to-video moment retrieval with performance comparable to, or better than, the state of the art. These contributions advance query-guided video understanding across spatial, relational, and temporal grounding.
97. 【2610.21409】CLAD: Keypoint Matching Using Global Line Correspondences
链接：https://arxiv.org/abs/2610.21409
作者：Masaki Satoh
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Scale-Invariant Feature Transform, Feature Transform, Oriented FAST, FAST and Rotated, Scale-Invariant Feature
备注： 5 pages, 2 figures
点击查看摘要
Abstract:Traditional keypoint descriptors, such as SIFT (Scale-Invariant Feature Transform) and ORB (Oriented FAST and Rotated BRIEF), are computed from local image patches. They may be unreliable in scenes with repetitive patterns or weak textures, where patches at different locations can look similar. We propose the Contextual Line-Assisted Descriptor (CLAD), a keypoint matching method that addresses this problem by using global geometric context from line correspondences. CLAD represents each keypoint with a vector whose elements indicate its proximity to matched lines. It can therefore use the keypoint's spatial relationships to the lines in the scene. We use HOME (Hough-space One-dimensional Matching of Extrema) to detect both clear and weak linear structures and to establish enough line-to-keypoint associations to represent this context. Evaluations on the TUM RGB-D SLAM dataset and outdoor video sequences show that CLAD provides geometrically consistent matches that complement those obtained with traditional local descriptors. In repetitive scenes, where local descriptors may not distinguish similar patches, CLAD uses global structure to improve matching reliability. The method is computationally lightweight and practical to implement.
98. 【2610.21380】Perception or Reasoning? Diagnosing and Tackling Reinforcement Learning Bottlenecks in VLMs
链接：https://arxiv.org/abs/2610.21380
作者：Zeyuan Yang,Zhuohao Chen,Jiaben Chen,Yao Zhang,Maohao Shen,Chuang Gan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reinforcement learning, brought strong gains, visual tasks remain, remain less consistent, language model reasoning
备注：
点击查看摘要
Abstract:Reinforcement learning has brought strong gains to language model reasoning, but its improvements on visual tasks remain less consistent. One difficulty is that visual task failures can arise from different sources: the same benchmark may be limited by perception for one model and by reasoning for another. We introduce Perception and Reasoning Attribution (PARA), which measures the remaining perceptual and reasoning headroom of each model--benchmark pair by comparing how many current errors are recovered with more accurate visual information versus a stronger reasoner. Across 4 vision-language models and 17 multimodal benchmarks, PARA broadly agrees with the expected characteristics of existing benchmarks while revealing substantial model-specific variation. More importantly, it shows that RL gains become smaller as perceptual headroom increases, but larger when reasoning explains more of the recoverable errors, suggesting that current RL exploits reasoning headroom more effectively than perceptual headroom. Motivated by this gap, we analyze how existing RL objectives affect visual perception and find that reward- and token-level signals influence visual attention only indirectly. We therefore propose GRAD, a group-relative attention distillation objective that uses the best rollout in each group to directly guide the visual attention of weaker rollouts. GRAD consistently improves performance across two model scales and seven benchmarks, and further complements existing RL methods.
99. 【2610.21367】SATOR: Backpropagation-Free 3D Test-Time Adaptation via Sample-Adaptive Token Routing
链接：https://arxiv.org/abs/2610.21367
作者：Inseok Kong,Geunyoung Jung,Jiyoung Jung
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unlabeled test data, Test-time adaptation, mitigates the performance, distribution shifts, performance degradation
备注： Accepted by WACV 2027
点击查看摘要
Abstract:Test-time adaptation (TTA) mitigates the performance degradation of source-pretrained models on unlabeled test data under distribution shifts. Recent backpropagation-free token-purging methods address 3D point cloud distribution shifts by filtering unreliable tokens. However, their reliance on predefined purge-size candidates requires multiple forward passes per sample and increases inference cost. We propose SATOR (Sample-Adaptive TOken Routing), a source-free and backpropagation-free 3D TTA framework that eliminates this search by deriving both the partitioning threshold and routing decision directly from each sample. SATOR computes token abnormality scores from complementary attention and geometric relation graphs. It then derives a sample-specific partition into retained and pruned tokens via Otsu-based separability, without evaluating candidate sizes. Keep-ratio-calibrated routing then selects the pruned prediction only when its entropy, penalized by the keep ratio, is lower than that of the original prediction. Experiments on ModelNet40-C, ScanObjectNN-C, and ShapeNet-C demonstrate that SATOR achieves state-of-the-art accuracy on three 3D corruption benchmarks.
100. 【2610.21364】CoDeFont: One-Shot Font Generation via Multi-Scale Factor-Specific Representation Learning
链接：https://arxiv.org/abs/2610.21364
作者：Rejoy Chakraborty,Prasun Roy,Saumik Bhattacharya,Umapada Pal
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：One-shot Font Generation, One-shot Font, Font Generation, single reference glyph, target character
备注： 10 pages, 6 figures
点击查看摘要
Abstract:One-shot Font Generation (OFG) aims to synthesize a target glyph by transferring the stylistic characteristics of a single reference glyph while preserving the structure of the target character. However, accurately capturing font style from a single reference image remains challenging due to the limited stylistic information available in a single glyph, and this challenge is further amplified for complex scripts. We propose CoDeFont, a script-agnostic OFG framework that addresses this challenge through multi-level style-content factorization and progressive style-content reconciliation. CoDeFont independently aggregates complementary style and structural information across multiple spatial levels to obtain factor-specific representations, while a contrastive objective explicitly encourages separation between style and content embeddings. During reconstruction, the disentangled representations are progressively injected through multi-level style conditioning, enabling stylistic information to be incorporated at different decoding resolutions while preserving the underlying glyph structure. We evaluate CoDeFont on structurally distinct Bengali and Latin scripts across seen and unseen font styles. Extensive quantitative and qualitative analyses demonstrate consistent improvements over existing state-of-the-art methods, highlighting the effectiveness of the proposed framework for OFG across diverse writing systems.
101. 【2610.21356】L2GSSL: Label-Efficient Local-to-Global Self-Supervised Learning for Volumetric Healthcare Data
链接：https://arxiv.org/abs/2610.21356
作者：Po-Cheng Cheng,Hung-Hsuan Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Healthcare institutions routinely, high-dimensional computed tomography, institutions routinely accumulate, routinely accumulate high-dimensional, accumulate high-dimensional computed
备注： 10 pages, 2 figures, 10 tables. Under review at IEEE BigData 2026
点击查看摘要
Abstract:Healthcare institutions routinely accumulate high-dimensional computed tomography (CT) volumes, but only a fraction can be annotated by experts. We present L2GSSL, a local-to-global self-supervised learning framework that leverages unlabeled volumes by decomposing pretraining into intra-slice and inter-slice representation spaces. A slice encoder learns view-invariant local features, and a global encoder aggregates the resulting tokens to model volumetric context. The stop-gradient isolates the local space from the global objective, while slice-wise execution and a three-phase schedule support training under constrained GPU memory. On LIDC-IDRI lung nodule malignancy classification, L2GSSL reaches $0.9229$ AUROC with only $10\%$ of the labels and $0.9377$ with $25\%$, exceeding the volume-level VICReg by $0.0229$ and $0.0294$, respectively. With all labels, the strongest supervised baseline exceeds L2GSSL by only $0.0044$ AUROC, consistent with self-supervised pretraining providing its greatest value when annotations are limited. Without adaptation to the external LNDb cohort, a model fine-tuned on $25\%$ of LIDC-IDRI obtains $0.8138$ AUROC and $0.7589$ AUPRC, improving over the strongest evaluated self-supervised baseline by $0.1130$ and $0.0954$. Experiments across data sources, thoracic and abdominal anatomy, downstream tasks, and two backbones examine healthcare-data variety, while lesion-slice masking shows that the predictions depend on lesion-bearing content.
102. 【2610.21335】When Should a Low-Light Pipeline Generate? Auditable Risk Control for Selective Generative Enhancement
链接：https://arxiv.org/abs/2610.21335
作者：Qiyi Xie,Wei Chen Ng,Suyang Xi,Xicheng Wang,Ziyao Li,Bohong Xu,Wenyi Liu,Jian Ding Tan
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：networks preserve structure, leave regions under-enhanced, low-light enhancers recover, enhancers recover plausible, recover plausible texture
备注：
点击查看摘要
Abstract:Generative low-light enhancers recover plausible texture but may hallucinate structure; restoration networks preserve structure but can leave regions under-enhanced, and neither advantage is spatially uniform. Therefore, we formulate selective generative enhancement as a decision problem: determine where overriding a frozen base expert is beneficial and refuse to switch when the evidence is insufficient. We propose VetoNet, an auditable regional routing framework centered on a certified veto. It first measures the complementary strengths and routing direction of a frozen restoration generative pair, then predicts the utility of regional overrides from deployment-available signals alone and admits an override only when a distribution-free harm-budget certificate says the perceptual (LPIPS) risk budget allows it. Experiments across multiple expert pairs and domains show that VetoNet adapts its routing behavior to the strength and reliability of the available evidence. When expert complementarity is sufficiently predictable, it achieves statistically significant certified gains; when the relative strengths of the experts change, it correspondingly reverses the routing direction; and when routing evidence is weak or affected by cross-domain shift, it conservatively vetoes switching.
103. 【2610.21332】Semantic Latent Alignment for Flow Matching with Invertible Bi-Lipschitz Adapters
链接：https://arxiv.org/abs/2610.21332
作者：Felix Nützel,Mischa Dombrowski,Luca Hagen,Bernhard Kainz
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：latent spaces trade, domains or tasks, spaces trade compression, improve downstream generation, complicates adapting
备注： 17 pages, 5 figures
点击查看摘要
Abstract:Pretrained latent spaces trade compression, reconstruction, and the learnability of the coordinates a downstream generator has to work in, which complicates adapting these spaces to different domains or tasks: continued training is expensive, and without a new alignment objective it often fails to improve downstream generation. We instead leave the encoder and decoder fixed and change only the coordinates between them, using an invertible bi-Lipschitz adapter aligned offline to a semantic teacher and frozen during class-conditional flow matching. Invertibility preserves compatibility with the pretrained autoencoder, while the bi-Lipschitz constraint limits how far alignment can distort its latent geometry. This provides a simple way to improve semantic organization while retaining the compression and reconstruction properties of the original latent space. On two medical imaging datasets, constrained latent adaptation improves feature metrics, seed stability and counterfactual edit strength, while remaining competitive on downstream classification. In contrast, unconstrained adaptation can become highly anisotropic and sensitive despite remaining invertible, highlighting the importance of controlling geometric distortion. Our results suggest that carefully constrained post-hoc adaptation offers a parameter-efficient and tuning-free alternative to jointly modifying the representation during generative training.
104. 【2610.21327】DocPilot: Interactive Agent Orchestration and Training for Long Visual Document Understanding
链接：https://arxiv.org/abs/2610.21327
作者：Zhuowen Liang,Xiaotian Lin,Yuyu Luo,Haixun Wang,Nan Tang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：question answering requires, heterogeneous document content, understand heterogeneous document, seek sparse evidence, answering requires models
备注： 25 pages, 13 figures, 9 tables
点击查看摘要
Abstract:Multimodal long-document question answering requires models to seek sparse evidence across pages and modalities, understand heterogeneous document content, and reason over the collected evidence. Even advanced vision-language models (VLMs) can overlook sparse evidence and struggle with cross-modal reasoning in a single pass. Existing document agents further introduce multi-step interaction, but some still rely on predefined workflows or coarse-grained actions, limiting the flexibility and granularity of document reasoning. We introduce DocPilot, an agentic document framework that supports expressive orchestration and makes complex document solving learnable by small language models (SLMs). DocPilot orchestrates evidence seeking through page-level navigation and fine-grained evidence localization, and integrates local visual inspection, code-based numerical reasoning, and cross-modal reasoning for multimodal understanding. To transfer these capabilities to small models, we propose curriculum-based agentic training that progresses from single-ability learning to adaptive orchestration through supervision from data-grounded reasoning traces and executable interaction trajectories. Across MMLongBench-Doc, DocBench, FinRAGBench-V, and MADQA, DocPilot achieves strong gains with frontier VLM backbones, while DocPilot-4B delivers competitive performance against substantially larger models, demonstrating strong effectiveness and generalization across diverse long-document reasoning settings. The code is available at this https URL.
105. 【2610.21325】CertEx: Exact Visual Retrieval at Scale by Certified Exclusion
链接：https://arxiv.org/abs/2610.21325
作者：Dongfang Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：underlies visual retrieval, embeddings underlies visual, LLM agents, memory of LLM, near-duplicate detection
备注：
点击查看摘要
Abstract:Exact $k$-nearest-neighbor (kNN) search over image descriptors and embeddings underlies visual retrieval, near-duplicate detection, the evaluation of learned representations, and increasingly the memory of LLM agents. However, exhaustive search computes every distance at full precision, whereas approximate indexes return recall below one. We observe that exact search only needs a proof that each excluded vector cannot be a neighbor. Because such a proof only has to be conservative, it can be checked in low precision, much as the retina examines the whole scene at low resolution. We call this principle certified exclusion and realize it in an exact kNN method for GPUs, which we call \certex. Specifically, \certex\ stores a lower-bounding projection of each vector in half precision and folds a rounding certificate into the same tensor-core dot product, so that only the few vectors that the test keeps need exact distances. We prove that \certex\ returns the exact kNN of every query. On sixteen datasets with up to 100M vectors, \certex\ is exact for every query at 7.1$\times$ to 18.0$\times$ the throughput of the fastest cuVS search on one H100 and outperforms quantized and graph indexes whenever every query must be exact.
106. 【2610.21323】AdaLoop: Thinking with the Vision Encoder
链接：https://arxiv.org/abs/2610.21323
作者：Xinran Nicole Han,Yiyang Lu,Katelyn Gan,Todd Zickler
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：static feature extractor, vision-language models, language model, leaves subsequent reasoning, feature extractor
备注：
点击查看摘要
Abstract:Most vision-language models (VLMs) treat the vision encoder as a static feature extractor: it encodes an image once, independently of the question, and leaves subsequent reasoning to the language model. Yet different questions may require different visual operations and processing depths. We present AdaLoop, a framework for question-conditioned visual recurrence in VLMs. AdaLoop adapts visual computation to the question and reuses the encoder's transformations across multiple iterations, with the pretrained vision weights frozen. We also introduce VisRO, a procedural dataset and generation pipeline for training and evaluating vision-centric reasoning. On six VisRO tasks, AdaLoop outperforms standard fine-tuning and question-conditioned single-pass baselines with matched training data and optimizer updates. These gains hold across three VLM families on both in-distribution and out-of-distribution examples. Our findings suggest that pretrained vision encoders can contribute to reasoning through task-directed, iterative visual computation.
107. 【2610.21321】CoViG: Coarsened Vision GNN for Image Classification
链接：https://arxiv.org/abs/2610.21321
作者：Martial Guidez,Stefan Duffner,Christophe Garcia
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Graph Neural Networks, Convolutional Neural Networks, Neural Networks, computer vision, Vision Transformers
备注：
点击查看摘要
Abstract:Although Graph Neural Networks are widely used in various domains, they remained mostly unexplored in computer vision. Convolutional Neural Networks and Vision Transformers were leading the field, until the quite recent introduction of Vision Graphs (ViG) that treat images as a set of nodes and apply graph convolution on their k-NN graphs. ViGs show impressive accuracy on image classification but their computational cost remains relatively high. Inspired by optimization methods for GNNs, we present CoViG, a novel approach combining graph coarsening and ViGs. Our method introduces an additional MinCUT pooling step within the Grapher component of intermediate ViG blocks. By simplifying the intermediate graphs and thus decreasing the number of nodes of specific blocks, our approach considerably reduces the computational cost of ViG during inference. We evaluated our approach on ImageNet with several ViG architectures, and we obtained accuracies equivalent to the original ViG models with only about 51\% of FLOPs.
108. 【2610.21320】ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer
链接：https://arxiv.org/abs/2610.21320
作者：Hao Shi,Jiafeng Wang,Yuzhuo Fu,Tao Zhang,Jian Bai,Juelu Zhang,Qing Cui,Chao Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)
关键词：long single-pass outputs, miss small objects, vision-language model supervision, promote uncertain observations, Detailed captions transfer
备注： 21 pages, 10 figures, 11 tables; technical report. ZoomCap-450K is publicly available at [this https URL](https://huggingface.co/datasets/MasterHow/ZoomCap-450K)
点击查看摘要
Abstract:Detailed captions transfer visual information into vision-language model supervision, but quality is easily conflated with length: long single-pass outputs still miss small objects, text, and spatial relations or promote uncertain observations into confident claims. We formulate fine-grained captioning as recoverable visual information transfer, in which a teacher acquires missing evidence under a finite observation budget and converts it into reusable supervision. ZoomCap uses a draft caption to route conditional knowledge retrieval, OCR-sensitive reading, coverage-gap recovery, and adaptive visual zooming, allocating deeper crops only to the most complex eligible region, deriving spatial relations from grounded geometry, and fusing non-duplicate evidence. We also introduce FactCycle, which scores caption-derived atomic claims on two blind anchors--source image (truthfulness) and reconstruction (realizability)--separating fabrication from generator loss claim by claim; human and multi-judge comparisons complement this fact-level view. Against Qwen3.5-397B-A17B captions, ZoomCap achieves an 81.9% human tie-adjusted preference score with a teacher over 10x smaller, and FactCycle counts 52.4 transferred claims per image vs. 31.5 for ScaleCap. The evidence also transfers: in continual pre-training, ZoomCap-450K improves the 11-benchmark average by 1.31-2.38 points over the strongest competing corpus and Ling-Tiny-VL-v3 gains 1.4 points on a production document/OCR monitor suite (1.5 on perception) at 60B tokens; in medical pre-training, 2.64M ZoomCap-captioned images improve five VQA benchmarks by 3.04 points (vs. 1.76 for same-image Gemini-3.1-Pro captions).
109. 【2610.21318】Loud and Clear: Making Visual Evidence Count in Multimodal Document RAG
链接：https://arxiv.org/abs/2610.21318
作者：Eunchan Jo,Seounghyun Jang,Sangwoo Mo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Multimodal document retrieval-augmented, document retrieval-augmented generation, vision-language model reads, Multimodal document, retrieved pages
备注：
点击查看摘要
Abstract:Multimodal document retrieval-augmented generation (RAG) has focused largely on retrieval, yet its answers depend on how well a vision-language model reads the retrieved pages. We find that evidence in retrieved pages remains underused even when the correct pages are retrieved. On SciEGQA oracle pages, five prior methods give the generator 0.7K to 2.7K visual tokens per query on average under a common image processor, yet raising the page-only budget from 1K to 32K improves accuracy by 15.22 points. At a fixed 16K budget, adding ground-truth crops improves accuracy by 3.75 points over page-only input. We study what the generator needs from retrieved pages through two requirements: Loud, making full use of visual token capacity, and Clear, refining the page so that its evidence becomes prominent. For Loud, increasing either the visual token budget or visual fidelity, the image resolution those tokens preserve, improves accuracy with the other held fixed, and full-page scaling outperforms repetition and tiling at matched budgets. For Clear, suppressing surrounding content improves accuracy without enlarging selected regions, and adding OCR of these regions to page images outperforms either input alone. We implement both as Loud and Clear (LoC), which combines higher-resolution pages with OCR from query-relevant regions without ground-truth annotations or additional training. LoC outperforms eight prior methods on SciEGQA, ViDoRe-v3, and MMLongBench-Doc, improving over the strongest, ColQwen3, by 8.88, 3.09, and 4.22 points with the same retriever and generator. It also outperforms its page-only variant under the same visual token budget. These results locate a bottleneck beyond retrieval: how the retrieved pages are given to the generator.
110. 【2610.21306】VLA-$Δ$: Learning Physical State Transition for Vision-Language-Action Models
链接：https://arxiv.org/abs/2610.21306
作者：Qi Lu,Jiarun Li,Ce Zhang,Miao Pan,Yi Pan,Xu Wang,Wenqi Zhang,Xuhong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieving strong performance, transfer semantic knowledge, semantic knowledge acquired, robot control, achieving strong
备注： 24 pages, 8 figures, 9 tables, including appendices. Code: [this https URL](https://github.com/ZJU-OmniAI/VLA-Delta)
点击查看摘要
Abstract:Vision-language-action (VLA) models transfer semantic knowledge acquired through vision-language pretraining to robot control, achieving strong performance across various benchmarks. However, most VLAs directly map observations to demonstrated actions without explicit supervision of intermediate physical state changes, making them prone to overfitting observation-action correspondences. Some methods introduce intermediate reasoning or future-state prediction in language, visual, or latent spaces to guide action generation, but do not explicitly supervise the physical state transition itself. We therefore propose VLA-$\Delta$, a general framework that uses physical changes between current and future states as explicit learning targets. To support this objective, we construct a large-scale pretraining dataset and derive physical state-transition annotations covering task-relevant semantics and visual motion changes, providing more direct supervision for continuous action generation. During inference, the model generates actions directly from current observations without additional inference overhead. VLA-$\Delta$ achieves performance competitive with the state of the art on LIBERO and RoboTwin, and outperforms $\pi_{0.5}$ in real-robot experiments. Our code is available at this https URL
111. 【2610.21302】Dusting the Phantom: Gaussian Allocation for Fading Dynamic Content
链接：https://arxiv.org/abs/2610.21302
作者：Minhyeok Roh,Minseo Lee,Jun Young Jeong,Byeonghyeon Lee,Lucas Yunkyu Lee,Jaesik Park,Eunbyung Park
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video increasingly practical, real-time volumetric video, volumetric video increasingly, made high-quality, real-time volumetric
备注： 21 pages, 14 figures. Project page: [this https URL](https://minhyeok2001.github.io/Dusting-the-Phantom/)
点击查看摘要
Abstract:Dynamic Gaussian representations have made high-quality, real-time volumetric video increasingly practical, yet challenging motion can still break their reconstruction: small fast-moving objects may disappear, and fine textures in highly dynamic regions are often lost. In particular, simply training longer or using more Gaussians may still fail to recover small, fast-moving objects. We argue that the key bottleneck is not representational capacity itself, but where and when Gaussian primitives are allocated. Existing allocation strategies rely on current Gaussian locations and often overlook the spatiotemporal destinations of relocated Gaussians. To address these limitations, we introduce two complementary strategies. First, Seed Injection identifies under-reconstructed dynamic regions using temporal appearance changes and reconstruction errors, and initializes new Gaussians at geometrically plausible 3D locations through multi-view observations, independent of existing Gaussian locations. Second, Temporal Biased Relocation uses time-resolved optimization signals to guide the spatiotemporal placement of relocated Gaussians. Both strategies maintain a fixed Gaussian budget without modifying the underlying representation. Experiments across multiple dynamic-scene datasets demonstrate improved reconstruction quality, particularly in highly dynamic regions, recovering small, rapidly moving objects and fine-grained appearance details.
112. 【2610.21297】GeoPano: Towards Geometrically Accurate 3D Reconstruction from a Single Panorama
链接：https://arxiv.org/abs/2610.21297
作者：Jing OU,Zidong Cao,Liaoyuan Fan,Zhuoxiao Li,Shuai Zhang,Yinrui Ren,Dongli Wu,Haoang Li,Hui Xiong,Wufan Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：offering significant benefits, recovery of complete, offering significant, enables the holistic, holistic recovery
备注：
点击查看摘要
Abstract:Panoramic 3D reconstruction enables the holistic recovery of complete 360 $^\circ$ scene geometry, offering significant benefits for robotics and AR/VR applications. However, directly estimating geometry from ERP images is inherently challenged by spherical distortions. To reduce spherical projection distortions, a common strategy is to decompose panoramas into distortion-free perspective views, but independently processing these views often introduces cross-view geometric inconsistencies. To address these challenges, we introduce GeoPano, a feed-forward framework for single-view panoramic 3D reconstruction that recovers a geometrically accurate and consistent point cloud from a single panorama. Our approach is driven by two key innovations: First, we propose a panoramic-aware attention aggregator, featuring a streamlined attention architecture equipped with a novel Pano-Attention mechanism, which explicitly exploits the intrinsic spherical geometry of the panorama to guide cross-view interactions, thereby suppressing geometric inconsistencies. Furthermore, we formulate a hybrid supervision strategy to jointly enforce fine-grained local details in perspective space and global structural coherence in spherical space. Experiments demonstrate that our method significantly outperforms previous SOTA approaches in reconstruction accuracy, geometric consistency, and visual fidelity.
113. 【2610.21287】ReState: Noise-Level-Aware State Correction for Training-Free Object Removal in Few-Step Diffusion Models
链接：https://arxiv.org/abs/2610.21287
作者：Donghwan Lee,Sanghyun Jo,Sihyun Kim,Ziseok Lee,Kyungsu Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：leaves object-shaped residuals, object removal commonly, removal commonly redirects, commonly redirects self-attention, Training-free object removal
备注： 32 pages, 8 figures
点击查看摘要
Abstract:Training-free object removal commonly redirects self-attention away from the target region, but on few-step distilled diffusion models this often leaves object-shaped residuals. We identify a temporal mismatch: a structured prediction forms inside the mask at the first forward, and the short trajectory offers few later chances to revise it, while attention rerouting acts mainly in later steps. Across four distilled backbones, magnitude-matched single-forward interventions show that background-directed state correction affects the final result more than attention rerouting. We therefore propose ReState, which corrects the masked clean prediction toward background evidence retrieved from the input using a noise-level-aware weight that vanishes at the final forward. ReState retains object-excluding attention as a complementary constraint and adds no denoiser evaluations. Across two paired benchmarks and two few-step backbones, ReState achieves the best masked PSNR, SSIM, and LPIPS among training-free methods, improving PSNR by 3.17 dB on average over the strongest baseline. On OBER-Test, it also outperforms the 50-step attention-forcing reference on all three metrics at 6.7x lower latency. The same configuration transfers to two additional distilled backbones without retuning. Project page: this https URL
114. 【2610.21283】Mallea: Building, Steering, and Memorizing Worlds with Coding Agent
链接：https://arxiv.org/abs/2610.21283
作者：Xuanyi Liu,Ruiqi Li,Siwei Ma
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Code world models, world models represent, models represent world, represent world dynamics, Code world
备注：
点击查看摘要
Abstract:Code world models represent world dynamics through explicit state and executable rules. We investigate how to coordinate object representations, behavioral revisions, and visual memory within this formulation. We present Mallea, a system for building, steering, and memorizing worlds from text. A coding agent infers object interaction requirements from the prompt and jointly plans object structure, properties, and rules, favoring compact representations that support those requirements. The world evolves under the planned rules; optional user actions steer it, while text requests can edit properties or extend capabilities with unaffected state preserved. Object texture memory retains reusable appearance only for whitebox-defined objects and adapts it as those objects change. The program advances world state, while a generative renderer combines current structure with remembered appearance. By organizing construction, intervention, and memory around the same objects, Mallea conditions subsequent observations on the latest state and compatible appearance. Project page: this https URL.
115. 【2610.21282】LICOA: Learning Instruction-Conditioned Optical Actions for Mobile Spatial Augmented Reality
链接：https://arxiv.org/abs/2610.21282
作者：Yuchen Deng,Shunkai Zhou,Ruixuan Zhu,Haibin Ling,Bingyao Huang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Spatial augmented reality, Spatial augmented, target region, augmented reality, projector pose
备注： 17 pages, 8 figures
点击查看摘要
Abstract:Spatial augmented reality (SAR) augments physical environments with projected content, but most systems assume that the projector pose, target region, or motion path has been fixed or specified. We instead make projected light an embodied action: given a language instruction and current visual observations, a system must decide how to move and where and at what scale to place the projection. We introduce LICOA to realize this capability. Its differential-drive chassis provides room-scale approach and repositioning, while a steerable mirror with two degrees of freedom (2DoF) and projection scale provide rapid local control of the beam. A shared interface maps synchronized external and onboard RGB cameras with robot control state to physical optical actions across pretrained action models. Because instruction-conditioned optical action lacks dedicated training data and a common evaluation protocol, we construct a matched simulation embodiment and a corpus with 150 tasks and 7,500 rendered episodes, then evaluate models trained only on this corpus in previously unseen real-world environments. Across 480 complete closed-loop real-world execution trials (rollouts) on 12 tasks, the best adapted action model achieves a 57.50% success rate and 40.64% success weighted by path length, compared with 8.33% and 5.15% for the same architecture trained from scratch. A further 150 real-world ablation rollouts support the need for both camera views and coordinated control of the chassis and mirror. These results establish a physical platform, shared perception and optical action interface, corpus, and real-world evaluation protocol for treating projected light as an embodied action.
116. 【2610.21266】RACER: A Multimodal Harness for Patient Care in Hospitals
链接：https://arxiv.org/abs/2610.21266
作者：Zane Durante,Paul Tang,Keshigeyan Chandrasegaran,Amit Kaushal,Shrinidhi Kowshika Lakshmikanth,Feolu Kolawole,Yu Jun Zheng,Yifan Geng,Shobhit Agarwal,Kevin Schulman,Juan Carlos Niebles,Ehsan Adeli,Arnold Milstein,Li Fei-Fei
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：provide complementary information, records provide complementary, clinical records, clinical records provide, clinical
备注： 37 pages, 4 figures. Code: [this https URL](https://github.com/zanedurante/tracer-harness)
点击查看摘要
Abstract:Continuous video and clinical records provide complementary information for understanding how patient behavior evolves over a hospital stay. A central challenge is how to represent behavior across the entire stay while preserving access to fine-grained visual and clinical evidence. We introduce TRACER, a training-free multimodal harness that constructs minute-level action records from video and combines them with clinical records into hourly reports. The harness equips an LLM agent with tools to query this hierarchy, inspect relevant video, and retrieve clinical records. To evaluate TRACER, we construct two benchmarks. The first contains 397 annotated one-minute clips spanning 15 atomic actions; the second poses 144 clinician-informed multiple-choice questions, grounded in 264 hours of video and clinical records from two ICU patients. TRACER achieves up to 84.8% accuracy for action detection and 61.0% QA accuracy versus 49.3% for the strongest baseline using the same backbone. Across 280 patients spanning approximately 60,000 camera-hours, TRACER identifies significantly less purposeful activity in patients with a positive delirium assessment during their stay than in those without (p 0.0001). Our results show that combining continuous video with clinical records can support understanding of patient behavior over time and across patient cohorts without training on protected health data.
117. 【2610.21251】Do VLAs Really Follow Instructions? Diagnosing How-Level Instruction Following in Vision-Language-Action Models
链接：https://arxiv.org/abs/2610.21251
作者：Sangwu Park,Wonjoong Kim,Yeonjun In,Chanyoung Park
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：focused on What-level, How-level instructions, How-level instruction, What-level instructions, How-level
备注： Preprint
点击查看摘要
Abstract:Vision-language-action (VLA) models are expected to follow instructions like their language backbones, yet prior work has focused on What-level instructions that specify the task rather than How-level instructions that specify how to carry it out. Through our diagnoses, we find that How-level instructions do not help current VLAs and lower task success. We hypothesize that pairing each training episode with a single instruction limits How-level instruction following, and show that training with segment-level enriched instructions makes actions respond to such instructions without consistently raising task success. To measure How-level instruction following beyond standard benchmarks, we introduce SIMPLER-IN, where success requires conditions given only in the instruction. It shows that the gained responsiveness does not extend to demanding or out-of-distribution How-level instructions. How-level instruction following thus remains an open challenge.
118. 【2610.21250】FocusOPD: Structure-Guided On-Policy Distillation for Diffusion Models
链接：https://arxiv.org/abs/2610.21250
作者：Xinrui Lin,Shumin Wang,Suqi Song,Fan Li,Yanyong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-teacher on-policy distillation, combine task-specific capabilities, on-policy distillation enables, Multi-teacher on-policy, enables rectified-flow models
备注：
点击查看摘要
Abstract:Multi-teacher on-policy distillation enables rectified-flow models with diffusion-transformer architectures to combine task-specific capabilities within a single student. However, matching model outputs does not guarantee that their internal representations are aligned, and it remains unclear where and when additional feature supervision is most useful. We analyze the teacher-student feature mismatch across Transformer blocks and denoising timesteps, and find that the mismatch is concentrated in deeper Transformer blocks during early denoising and persists after OPD distillation, indicating ineffective distillation. Motivated by this observation, we introduce FocusOPD, which augments the base OPD objective with token-wise directional feature alignment restricted to deep layers and early denoising steps. Across two rectified-flow backbones and multiple OPD objectives, FocusOPD improves capability transfer in compositional generation, text rendering, and preference-based evaluation. On the primary benchmark, it improves over DiffusionOPD from 0.953 to 0.967 on GenEval, from 23.797 to 23.944 on PickScore, and from 6.052 to 6.199 on LAION-Aesthetic. Ablations show that selective deep and early supervision is more effective and efficient than alignment over the full network and trajectory.
119. 【2610.21238】A large-scale climate-aware satellite image dataset for domain adaptive land-cover semantic segmentation
链接：https://arxiv.org/abs/2610.21238
作者：Songlin Liu,Linwei Chen,Li Zhang,Jun Hu,Ying Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：earth observation technologies, land-cover semantic segmentation, semantic segmentation, land-cover semantic, observation technologies
备注：
点击查看摘要
Abstract:A few well-annotated datasets for land-cover semantic segmentation have recently been introduced to advance the field of earth observation technologies. However, these datasets overlook the significant diversity among geographic areas with different climates, which can greatly impact and diversify land cover. Consequently, this leads to a domain gap in remote sensing images and severe performance degradation of the segmentation models. To enhance land-cover semantic segmentation with improved generalization ability, we conducted the first investigation into the impact of climate on this task. In this paper, we present a unique large-scale Climate-Aware Satellite Images Dataset (CASID) specifically designed for domain adaptive land-cover semantic segmentation. It consists of 980 satellite images with a size of 5000 x 5000 pixels, collected from 30 different regions around Asia, covering over 24,500 square kilometers. These images are gathered from four distinct climate zones, namely temperate monsoon, subtropical monsoon, tropical monsoon, and tropical rainforest. It includes four sub-datasets/domains, each representing one of the aforementioned climate zones. This characteristic makes CASID the first climate-aware land-cover semantic segmentation dataset with multiple domains. Additionally, we provide a comprehensive analysis of the samples from the four climate zones, emphasizing differences in global image features, image texture, category distribution, spectral value, and object shape. These analyses offer valuable insights for subsequent research in this field. Moreover, we conduct extensive experiments to evaluate the latest semantic segmentation and unsupervised domain adaptation methods on the CASID dataset. These results serve as a robust baseline for future research endeavors. Our dataset will be made publicly available at this https URL.
120. 【2610.21215】DLOSAC: Joint Spatial-Geometric Image Estimation via Delaunay-Guided Local Optimization RANSAC
链接：https://arxiv.org/abs/2610.21215
作者：Yu Liu,Meiqi Zhou,Zipei Fan,Guanyuan Feng,Xuan Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reliable image geometric, noisy matching points, Reliable image, addressed using RANSAC, noisy matching
备注： Accepted at the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2026)
点击查看摘要
Abstract:Reliable image geometric estimation from noisy matching points is typically addressed using RANSAC, often combined with local optimization to refine inliers and model parameters. However, existing paradigms are predominantly residual-centric; even heuristic attempts to enforce spatial uniformity suffer from a sequential, two-stage nature that inherently decouples distribution optimization from geometric refinement, preventing an effective trade-off. In this paper, we propose DLOSAC, a local optimization framework that jointly incorporates both geometric consistency and spatial distribution information. We begin by constructing a Delaunay triangulation over candidate inliers to explicitly encode neighborhood topology. The geometric module introduces an edge-based consistency metric to evaluate geometric errors, while the spatial module derives distribution descriptors from triangle areas and edge attributes to quantify the clustering of inliers. Finally, we combine edge-based geometric constraints, spatial distribution regularization, and traditional point-level geometric constraints to improve the quality of geometric parameters. Extensive experiments on six publicly available real-world datasets, covering three types of geometric estimation tasks, achieve state-of-the-art performance.
121. 【2610.21207】SpaceCache: Intermediate Feature Reuse for Efficient Semantic Segmentation on Point Cloud Streams
链接：https://arxiv.org/abs/2610.21207
作者：Dongheon Yang,Beomseok Kang,Jae-Joon Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：existing segmentation networks, segmentation networks process, frames largely overlap, consecutive frames largely, driving and robotics
备注：
点击查看摘要
Abstract:Point-cloud streams are central to autonomous driving and robotics, yet existing segmentation networks process every frame from scratch, although consecutive frames largely overlap. We observe that the intermediate features of point-cloud transformers remain semantically consistent across frames for the same spatial region, especially in deep stages. Building on this, we present SpaceCache, a training-free feature cache that reuses these features across frames. Tokens of previously observed regions skip a sequence of transformer blocks and take their cached features, only the remaining tokens are computed, and the full token layout is restored for dense prediction. Lightweight cache management keeps reused features reliable by limiting each entry's age and evicting low-confidence entries. Unlike token merging, SpaceCache selects tokens at negligible cost and runs its cache operations once per encoder stage. On both outdoor and indoor benchmarks, such as nuScenes, Waymo, and ScanNet, with two transformer backbones of Utonia and LitePT-B, SpaceCache achieves up to 1.65x speedup with less than 1-point mIoU drop and consistently outperforms token-merging methods.
122. 【2610.21202】UltraDiff: Transferring High-Fidelity Priors to Compressed Latent Spaces for High-Resolution Image Generation
链接：https://arxiv.org/abs/2610.21202
作者：Jingjing Ren,Haitian Zheng,Haoyu Chen,Connelly Barnes,Zhifei Zhang,Yuqian Zhou,Zhe Lin,Lei Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：High-resolution synthesis, Latent Diffusion Models, faces a fundamental, Latent Diffusion, fundamental trade-off
备注：
点击查看摘要
Abstract:High-resolution synthesis with Latent Diffusion Models (LDMs) faces a fundamental trade-off between computational cost and generative fidelity. This trade off is largely governed by the latent compression factor f (e.g. f8 denotes f=8 and f32 f=32). While aggressive compression (f32) significantly improves efficiency, it suffers from severe information loss and ambiguity compared to standard f8 models. We propose UltraDiff, a framework that reformulates this challenge as joint latent diffusion learning followed by marginal score distillation. We introduce MixTeacher, a dual branch DiT that models the joint f8-f32 distribution, utilizing shared attention to resolve the ambiguity of the compressed space with high fidelity f8 priors. Crucially, we propose vector field distillation in the native f32 space. Theoretically, this compels the student to learn the conditional expectation of the teacher trajectory, effectively filtering out compression artifacts. Across the evaluated 1K to 4K settings, UltraDiff approaches f8 level quality while preserving f32 efficiency. With 20 sampling steps on a single A100 GPU, it generates a 2K image in 6.2 seconds over 40 times faster than our f8 baseline.
123. 【2610.21190】ControlFlow3D: Distilling Multi-View Knowledge into Latent Flow Matching for Point Cloud Upsampling
链接：https://arxiv.org/abs/2610.21190
作者：Yuang Liu,Zhi Zuo,Zhengkai Zhao,Lirui Zhang,Pan Gao,Hao Feng,Zhengzhe Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Point cloud upsampling, remains challenging due, Point cloud, under-constrained observations, applications but remains
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Point cloud upsampling is essential for 3D applications but remains challenging due to sparse, under-constrained observations. Multi-view images can resolve geometric ambiguity, but existing multi-modal methods do not fully exploit visual cues. We propose ControlFlow3D, a framework that distills knowledge from pretrained foundation models into a lightweight generation network during training, enabling strong performance without multi-view images available at test time. Specifically, our method performs conditional flow matching in a structured latent space defined by a frozen 3D encoder. Multi-view image tokens and 3D latent tokens are jointly clustered into shared prototypes via unsupervised soft KMeans; the resulting prototypes guide the flow trajectory through velocity control and are aligned by a consistency loss that progressively transfers image knowledge into the base network. A Mamba-based geometry decoder then maps latent features to dense coordinates with linear complexity. We also construct ShapeNetPU, a 35K-object multi-modal benchmark that is 31 times larger than prior datasets. Extensive experiments across multiple benchmarks demonstrate the effectiveness of our method and its strong generalization capability.
124. 【2610.21159】VisualTrust: Video Reasoning under On-Screen Claim Framing
链接：https://arxiv.org/abs/2610.21159
作者：Huachao Zhu,Junjielong Xu,Sicheng Li,Liang Yang,Mingtao Chen,Zhichao Hu,Li Jiang,Pinjia He
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：claim, On-screen text, misleading claim, misleading, video
备注： 25 pages, 7 figures. Project repository: [this https URL](https://github.com/huachao0124/VisualTrust)
点击查看摘要
Abstract:On-screen text can describe what a video shows, or it can frame what the video is supposed to mean. Current benchmarks treat both alike, testing whether a model can read the text rather than whether it should trust it. We study claim deference, multimodal large language models' tendency to let an on-screen claim override conflicting visual evidence. We introduce VisualTrust, a counterfactual benchmark with 5,063 cases across 14 claim-fact classes. Each case pairs a question with three versions of the same video: one with no claim, one with an accurate claim, and one with a misleading claim that alters a single grounded fact. The option the misleading claim supports is the trap answer. Across seven open-weight and four proprietary models, mean accuracy falls from 90.1% without a claim to 51.9% with a misleading claim. Among initially correct responses, 42.8% flip to the trap answer and only 0.6% become other errors. Strong no-claim accuracy does not ensure resistance. We also introduce DEAR (Decoupled Evidence Arbitration and Reading), a training-free agent for video question answering that separates evidence arbitration from reading. An independent check reports conflicting evidence, a selector weighs it without a fixed modality priority and blinds what it withholds, and the reader answers from the resulting video in a fresh context. On 500 videos across three proprietary models, DEAR raises accuracy under misleading claims from 47.2--64.0% to 81.8--85.2% and reduces trap-answer selection from 34.4--50.8% to 11.6--15.0%, while preserving no-claim accuracy.
125. 【2610.21132】rajectory Prediction Method for person under WSN with Hierarchical Envelope Adversarial Domain Adaptation
链接：https://arxiv.org/abs/2610.21132
作者：Wenqian Jiang,Qifeng Sun,Xiaosong Gao,Xin Zou,Xingrui Ni,Yuan Hu,Yongming Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：holds significant applications, intelligent surveillance, autonomous driving, smart cities, applications across autonomous
备注： 24 pages, 7 figures
点击查看摘要
Abstract:Pedestrian trajectory prediction holds significant applications across autonomous driving, intelligent surveillance, and smart cities. However, the complexity and unpredictability of pedestrian interactions make this task a persistent challenge. Current models face two common limitations: 1) Consider only a single type of social coupling. This introduces redundant interactions. More critically, it fails to account for the varying nature of trajectory coupled across different scenarios and between different pedestrians. Consequently, models cannot deeply adapt to diverse scenes. 2) Inadequate domain shift handling. Although very few methods address domain shift, they rely on statistical criterion-based domain distribution alignment. Such approaches exhibit strong dependency on predefined statistical metrics. This leads to significant limitations in complex and dynamic environments. To address these problems, a Hierarchical Envelope Adversarial Domain Adaptation with Loosely-Tightly coupled model (HEADA-LTCTPM) is proposed. First, an envelope sample construction mechanism was proposed. It constructs envelope samples and extends them into graph structures. Secondly, an adversarial domain adaptation module was proposed. This integrates both local and global domain adaptation strategies. It dynamically adapts to diverse coupled relationships across scenarios. These innovations collectively enhance prediction accuracy and robustness. In the experimental section, two representative public datasets were employed for validation and comprehensive comparisons with six relevant baseline algorithms were conducted. Results demonstrate that our model achieves significantly higher accuracy compared to existing methods, with the ADE and FDE metrics reduced by 17.6% and 19.1% respectively. The time overhead meets practical requirements, which verifies the effectiveness of our key innovations.
126. 【2610.21129】Sparse Attention for Video Generation Acceleration via Growing Sparsity and Reduced Search
链接：https://arxiv.org/abs/2610.21129
作者：Yun Dai,Yuyun Chen,Jiarui Wen,Huiping Zhuang,Cen Chen,Ziqian Zeng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diffusion Transformers, high inference cost, inference cost due, dominate video generation, dominate video
备注：
点击查看摘要
Abstract:Diffusion Transformers (DiTs) dominate video generation but suffer from high inference cost due to the quadratic complexity of self-attention. Sparse attention mitigates this by skipping unnecessary computation in the attention matrix, but existing methods apply a fixed sparsity ratio throughout denoising and struggle to accurately determine which computations to skip. To address these limitations, we analyze attention dynamics through attention entropy and mean attention distance, and find that attention becomes increasingly concentrated across denoising steps. We further observe that blocks selected early continue to capture a large fraction of the total attention weight at later steps. These findings suggest two acceleration opportunities: the sparsity ratio should grow as denoising progresses, and earlier search results can be reused to reduce the search space. Based on these findings, we propose Growing Sparsity and Reduced Search (GSRS), a training-free framework that retains more computation early and progressively reduces it later, while restricting subsequent searches to an early candidate set to reduce search overhead. GSRS adopts Top-p selection for adaptive sparsity control, supported by a precise evaluation scheme that computes exact attention weights within the FlashAttention computation at negligible overhead. Experiments on HunyuanVideo and Wan 2.1 validate that GSRS achieves 1.55$\times$--2.21$\times$ speedup while maintaining generation quality comparable to full attention.
127. 【2610.21121】ResStreamGS: Residual-Sensitive Dual-Stream Gaussian Splatting for Mobile Volumetric Video Streaming
链接：https://arxiv.org/abs/2610.21121
作者：Haoran Liu,Di Wu,Wang Luo,Hengyuan Na,Miao Hu,Guocong Quan
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：immersive free-viewpoint experiences, Real-time mobile volumetric, enables immersive free-viewpoint, computation remains challenging, Real-time mobile
备注： 11 pages,9 figures
点击查看摘要
Abstract:Real-time mobile volumetric video enables immersive free-viewpoint experiences, but delivering high-quality 3D content under constrained bandwidth and computation remains challenging. Recent 3D Gaussian Splatting (3DGS) systems, such as V$^3$, enable efficient mobile streaming by encoding time-varying Gaussian attributes with commodity video codecs and hardware decoding. However, existing pipelines treat all Gaussians as frame-varying signals, which is poorly suited to full-scene content where large portions remain temporally stable. Our empirical study shows that frame-wise adaptation and video coding of all Gaussians cause quality degradation in complex full-scene content, particularly in temporally stable regions. To address this issue, we propose ResStreamGS, a residual-sensitive dual-stream framework that processes Gaussians according to their temporal behavior. ResStreamGS identifies residual-sensitive primitives through lightweight probe adaptation and reuses stable Gaussians within each Group of Pictures (GOP). Stable Gaussians are transmitted once per GOP, while only residual-sensitive Gaussians remain in the frame-wise hardware-decodable video stream. Experiments on complex full-scene volumetric videos show that ResStreamGS improves post-codec PSNR by 7.51--8.35~dB over a controlled V$^3$-style all-Gaussians baseline, reduces amortized payload by up to 56.5%, and achieves 30.883~FPS on a Qualcomm Snapdragon 778G platform.
128. 【2610.21114】Spectral-Spatial Interpretation
链接：https://arxiv.org/abs/2610.21114
作者：Haotian Ma,Ruqi Yang,Philip Townsend
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Post-hoc image explanations, Post-hoc image, HLS Burn Scar, SSI, image explanations
备注： 24 pages, 4 figures. Accepted at NeurIPS 2026 (Poster)
点击查看摘要
Abstract:Post-hoc image explanations usually show where a model looks using spatial heatmaps or indicate which channels matter using global channel scores. These separate views are limiting for multispectral data because channel relevance is often spatially localized and physically meaningful. We introduce Spectral-Spatial Interpretation (SSI), a full-grid attribution method over position-channel players (g,c). For each spatial position, SSI fixes the observed surrounding context, defines a conditional game over the channels at that position, and applies the Shapley value to this local game. The result is a full spectral-spatial attribution matrix rather than a single heatmap or a global channel ranking. SSI has a clear local interpretation. It satisfies Shapley fairness within each position, and aggregating its channel attributions exactly recovers the position-level contextual contrast obtained by replacing that position with the baseline. SSI also differs from context-averaged Owen-style hierarchical accounting, which uses the same position-channel grouping but averages over external spatial coalitions. On HLS Burn Scar, SSI outperforms an MC-Owen estimator across retained attribution metrics while using only about 6% of its evaluation budget. Across CUB-200, EuroSAT, and HLS Burn Scar under both per-channel mean and zero baselines, SSI achieves the best joint deletion and insertion AUC over dense, flat, and rank-1 baselines, yields the strongest spectral hit rates and channel deletion, and leads spatial localization on both annotated datasets. Code is available at this https URL.
129. 【2610.21095】Can World and Action Modeling Benefit Each Other under Unified Causal Training?
链接：https://arxiv.org/abs/2610.21095
作者：Yue Su,Bokai Lin,Xinkai Wang,Chubin Zhang,Xiangnan Wu,Kuan Zhang,Weiyang Jin,Jiwen Yu,Yiming Li,Cewu Lu,Lixin Yang,Xihui Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unified causal training, training remain unclear, causal training remain, unified causal, causal training
备注： Project page: [this https URL](https://selen-suyue.github.io/OneWMNet)
点击查看摘要
Abstract:World and action modeling are closely related, yet their reciprocal benefits under unified causal training remain unclear. We introduce OneWM, a simple framework for unified causal training that treats actions as both conditions for world prediction and targets for policy learning within a shared video-action architecture. Using this framework, we investigate whether learning forward dynamics conditioned on specified actions improves action learning, and whether learning to generate actions in turn improves action-conditioned world modeling. We use LIBERO, LIBERO-Plus, and RoboCasa365 as embodied testbeds to evaluate both policy learning and world modeling, complemented by real-world policy experiments. Learning the visual consequences of specified actions improves policy performance and generalization across changing scenes. In turn, action learning improves multi-view world-prediction fidelity under the same architecture. Together, these results answer both questions positively, supporting reciprocal benefits between world modeling and action generation under unified causal training.
130. 【2610.21090】RoboCloth: A Large-Scale Real Cloth Material Dataset for Neural Reflectance Reconstruction
链接：https://arxiv.org/abs/2610.21090
作者：Zhen Li(Simon Fraser University),Haoran Qin(Westlake University),Francesco Di Sario(University of Torino and Simon Fraser University),Daniel Rebain(University of British Columbia and Wayve),Andrea Tagliasacchi(Simon Fraser University, Wayve and University of Toronto)
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：real cloth materials, present RoboCloth, captured under flexible, lighting configurations, cloth materials captured
备注： Project page: [this https URL](https://theialab.github.io/robocloth/) ; Code: [this https URL](https://github.com/theialab/robocloth) ; Dataset: [this https URL](https://huggingface.co/datasets/theialab/RoboCloth) . 16 pages including supplementary material
点击查看摘要
Abstract:We present RoboCloth, a dataset of 500 real cloth materials captured under flexible, calibrated camera and lighting configurations, where both are robotically controlled during acquisition. Each material is imaged in approximately 580 high-dynamic range frames spanning a wide view-light hemisphere; camera poses are refined via structure-from-motion and aligned to the robot frame, yielding per-material sparse surface geometry and structured per-point reflectance observations ready for neural material training. We demonstrate the value of this data through a two-stage neural reconstruction pipeline: Stage 1 trains a shared MLP decoder on our corpus to learn cloth material priors; Stage 2 then freezes the decoder and fits a dense 2048x2048 latent texture to each target material. Evaluating on held-out materials from our own dataset and on the independent UBO2014 benchmark, we show that a decoder trained on our captures outperforms decoders trained on existing measured reflectance datasets and analytic PBR fitting, transferring to unseen acquisition systems without modification. The dataset, calibration files, observation tensors, and train/test splits are released under CC BY 4.0 on the Hugging Face Hub.
131. 【2610.21087】SIEVE: Overcoming Topological Obstruction in Equivariant Self-Supervised Learning
链接：https://arxiv.org/abs/2610.21087
作者：Jongann Lee,Sun Woo Park,Yun Young Choi
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：cloud masked autoencoding, point cloud masked, identify a theoretical, theoretical incompatibility, masked autoencoding
备注： The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS) 2026
点击查看摘要
Abstract:We identify a theoretical incompatibility between 3D point cloud masked autoencoding and SE(3)-equivariant networks. We prove that standard masking triggers a topological collapse, effectively forcing the model to hallucinate orientation without a reference frame. To resolve this, we introduce SIEVE (Scalar Invariant Extraction Via Equivariance), an SE(3)-equivariant self-supervised framework that compresses point cloud geometry into invariant scalar embeddings. At its core is the spherical projection mask, which preserves global pose while obfuscating local semantics, sidestepping the obstruction by construction. Experiments confirm that SIEVE circumvents the predicted collapse where constant and noise masks fail. On downstream point cloud tasks, the resulting embeddings improve over coordinate-based baselines and hand-crafted geometric descriptors, with the largest gains on generalization to unseen shape categories.
132. 【2610.21086】RoPE-Flow: Monocular Vision-based Robot Pose Estimation via 2D Graph-Conditioned 3D Flow Matching
链接：https://arxiv.org/abs/2610.21086
作者：Liangjing Shao,Wanhao Liu,Zhiwei Fang,Rulin Zhou,Quanlu Zhang,Changjing Liu,Beilei Cui,Yiming Huang,Hongliang Ren
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：vision-based robot navigation, navigation and control, pose estimation, monocular image, image is significant
备注： 19 pages, 13 figures. Under Review
点击查看摘要
Abstract:Camera-to-robot pose estimation from a monocular image is significant for vision-based robot navigation and control. However, recovering 3D structural features from 2D observations remains a challenging task. Existing camera-to-robot pose estimation methods either rely on time-consuming iterative rendering or involve sophisticated 2D-3D registration which suffers from projection ambiguity, accumulated errors for distal joints and imbalanced learning for different joints. In this work, we propose RoPE-Flow, an end-to-end flow matching-based framework for camera-to-robot pose estimation. From the predicted 2D heatmaps, we propose a Keypoint-centered Feature Extractor to obtain positional features along with contextual representations from keypoints-centered multi-scale patches. Moreover, we introduce Graph-guided Condition Generator, which embeds a learnable adjacency map to generate condition for flow matching based on correlation among keypoints. Besides, we introduce Bone Length Loss and Ray-Depth Loss for topological consistency and scale stability, with joint-wise weighting to mitigate varied prediction difficulty across joints. The proposed method outperforms state-of-the-art methods for pose estimation across different types of robots with mutiple cameras. Besides, we establish a novel cross-scene benchmark to demonstrate the outstanding performance of RoPE-Flow on zero-shot cross-scene robot pose estimation. Meanwhile, animated visualizations are shown on the website: this http URL
133. 【2610.21011】Audio-Visual Dog Identification and Tracking in Real-World Videos
链接：https://arxiv.org/abs/2610.21011
作者：Aryahvishwa Babu,Kingsley Jin,Lillian Wang,Tuan M. Dang,Theron S. Wang,Jeorge Joshi,Annie Cao,Kenny Q. Zhu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Identifying individual dogs, Identifying individual, real-world videos remains, videos remains challenging, real-world videos
备注：
点击查看摘要
Abstract:Identifying individual dogs from barks in real-world videos remains challenging and largely unexplored. Solving this problem would enable long-term behavioral analysis, veterinary monitoring, and animal welfare monitoring by attributing vocalizations and behaviors to the correct individual. Real-world videos are challenging because multiple dogs may bark simultaneously, become occluded, or move in and out of view. Prior studies show that canine vocalizations and visual appearance contain discriminative identity information, but these modalities have largely been studied independently. We present a multimodal dog-fingerprinting framework combining visual identification, multiple-object tracking, and canine vocal fingerprinting to associate bark events with individual dogs while maintaining persistent profiles. The framework synchronizes bark events with tracked dogs and updates profiles using visual appearance and vocal characteristics, enabling identification despite occlusion, overlapping vocalizations, and off-screen barking. We also introduce a benchmark of 46 real-world videos containing 213 manually annotated bark events. Our framework correctly localizes the active visible dog in 61.83% of visible events at IoU $\geq 0.30$ and achieves a 91.33% F1 score for visible versus off-screen barking detection.
134. 【2610.21007】Mind the Tail: Data Selection Through Sparse Concepts
链接：https://arxiv.org/abs/2610.21007
作者：Ziheng Zhang,Neha Hulkund,Colin Lee,Zheda Mai,Hui Shen,Ying Ding,Tanya Berger-Wolf,Sara Beery,Wei-Lun Chao,Jianyang Gu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Data selection reallocates, selection reallocates training, reallocates training support, reallocates training, including objects
备注： Project page: [this https URL](https://imageomics.github.io/mind-the-tail/)
点击查看摘要
Abstract:Data selection reallocates training support across visual concepts, including objects, attributes, color, texture, and backgrounds. Different allocation strategies may produce varied downstream model behavior, especially for tail concepts supported by only a few samples. Discarding them can hurt test-time robustness, while overemphasizing samples lying on category boundaries may introduce unstable training signals. This work explicitly investigates this relationship across fine-grained, spurious-correlation, and general image classification, as well as multimodal pretraining. Specifically, we use sparse autoencoders (SAEs) to extract concept activations from individual images. During selection, we accumulate the dataset-level concept support for each added sample. Applying diminishing returns to this distribution down-weights well-represented concepts and shifts the focus to the distribution tail. We then incorporate local support to find samples that reliably strengthen under-supported concepts. Empirical results show consistent improvements over strong data selection baselines across all benchmarks. We also reveal the connection between concepts our method enhances and the induced behavioral changes, including improved robustness against out-of-distribution and spurious contexts. This work establishes concept support, beyond individual sample importance, as a useful principle for data-efficient and robust learning.
135. 【2610.20999】EigDiff: Eigensample Diffusion - or how to significantly reduce training dataset size with marginal performance variation?
链接：https://arxiv.org/abs/2610.20999
作者：Andrei Jarca,Vlad Hondru,Florinel-Alin Croitoru,Radu Tudor Ionescu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：small denoising steps, requiring large-scale datasets, multiple small denoising, requiring large-scale, notoriously expensive
备注：
点击查看摘要
Abstract:Diffusion models are notoriously expensive to train, requiring large-scale datasets to learn how to gradually reverse the noise from images over multiple small denoising steps. Current approaches focus on distilling the number of diffusion steps, neglecting potential redundancies of the training data. In this paper, we explore the potential of harnessing eigensamples to train diffusion models on significantly smaller datasets, while preserving model performance. To mitigate the sensitivity to affine transformations of eigenimages, we harness the latent space of a pre-trained CLIP model. We next compute latent eigenvectors by performing principal component analysis (PCA) in CLIP space. Further, we employ eigenvectors as reference points to guide the selection of a representative training set comprising comprising both exemplars (images whose embeddings are closest to eigenvectors) and diverse images. Our comprehensive experiments with different diffusion models applied on multiple datasets indicate that our approach (EigDiff) can reduce training data by up to 14x and accelerate subset selection by up to 1607x, with marginal performance differences.
136. 【2610.20990】DeSpatial: The devil of Agentic Spatial Reasoning Lies in 3D Itself
链接：https://arxiv.org/abs/2610.20990
作者：Yifei Liu,Xiaolong Zhou,Ziyang Gong,Yifan Zhou,Yuanyuan Gao,Yuning Gong,Yuchen Yang,Hongjie Zhang,Xue Yang,Xiao Sun,Zhihang Zhong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fragmented object identities, access to reconstruction, predictions and fragmented, identities can prevent, Spatial
备注：
点击查看摘要
Abstract:Spatial agents have access to reconstruction and segmentation tools, yet inconsistent predictions and fragmented object identities can prevent their outputs from becoming reliable 3D scene information. A simple oracle experiment exposes this perception bottleneck: replacing tool-predicted perception with ground-truth 3D bounding boxes raises an agent to nearly full score across five object-centric VSI-Bench tasks, while retaining the same reasoning tools. Motivated by this finding, we believe the devil of spatial reasoning lies in 3D itself, and introduce DeSpatial(Devil of Spatial), which explicitly decomposes spatial understanding into perception and reasoning. DeSpatial has a shared 3D perception tool to reconcile independent perception outputs into a unified, metric, gravity-aligned 3D scene. This perception tool has two core components: a) a joint segmentation--depth co-refinement module that consolidates masks of the same object and removes projection artifacts caused by inconsistent segmentation and depth within a single frame; b) a cross-view instance fusion module that consolidate voxel-overlapping instances but not allowed to merge same-frame instances. This fusion module additionally fuses spatially disjoint fragments caused by insufficient multi-view observations, by checking their 3D structure and source mask appearance. After receiving the complete and unified 3D scene information, the agent chooses reasoning or computational tools to solve the spatial problem. DeSpatial achieves leading performance on VSI-Bench, MindCube-Tiny, and ViewSpatial, with additional long-video results on VSI-SUPER, revealing the bottleneck of spatial understanding lies in a precise 3D perception itself.
137. 【2610.20989】Do As I Do, Not As I Say: On-Policy Distillation Inherits the Teacher in Vision-Language Models
链接：https://arxiv.org/abs/2610.20989
作者：Frank F. Yang,Kefei Yan,Yiren Wang,Yiyang Wang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Improving the reasoning, vision-language models, stronger models, OPD, SFT
备注： 27 pages, 7 figures, 21 tables. Code: [this https URL](https://github.com/ffy208/opd-inherits-teacher-vlm)
点击查看摘要
Abstract:Improving the reasoning capabilities of vision-language models (VLMs) often relies on post-training with supervision from stronger models. Two common strategies are supervised fine-tuning (SFT), which trains on teacher-generated demonstrations, and on-policy distillation (OPD), which provides teacher feedback on trajectories generated by the student itself. While OPD can be more data-efficient by supervising student-generated trajectories, it is unclear how the teacher's supervision at each state affects the student's learned behavior. To study this question, we conduct a controlled comparison of OPD and filtered SFT across data budgets and tasks where the teacher exhibits different levels of reliability, and analyze how these differences shape student accuracy and completion behavior. Across the two tasks, we find that OPD is effective only when the teacher remains reliable on student-generated trajectories. On ChartQA, where the teacher completes 99% of its solutions, OPD trained on only 10% of the data comes within 1.4 accuracy points of full-data SFT. In contrast, on Geometry3K, where the teacher fails to complete 22% of its solutions, OPD underperforms SFT by 7.9 points, with most of the gap explained by incomplete responses. More strikingly, starting OPD from an SFT student reduces its completion rate from 76% to 62%, effectively erasing the completion behavior learned through SFT. Filtering teacher demonstrations for completeness alone recovers much of SFT's advantage. These results show that on-policy supervision can transfer not only teacher knowledge but also persistent failure modes on student-visited states. Code is available at this https URL.
138. 【2610.20973】PiCo: Physics-Informed Concept Probing for Geo-Foundation Models
链接：https://arxiv.org/abs/2610.20973
作者：Yihang She,Andrew Blake,Jianbo Qi,Srinivasan Keshav
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：task predictive performance, Geo-foundation models, downstream task predictive, typically evaluated, task predictive
备注：
点击查看摘要
Abstract:Geo-foundation models (GFMs) are typically evaluated by downstream task predictive performance, revealing little about which physical features they are sensitive to or use in prediction. This limits developers' ability to test hypotheses about model behaviour and users' ability to select models for new tasks. We propose Physics-Informed Concept Probing (PiCo), a post-hoc framework for explaining GFM predictions. PiCo identifies concept vectors in a GFM's embedding space by generating synthetic multispectral satellite observations from a 3D radiative transfer model coupled with a game engine. These vectors reveal physical sensitivities that inform domain-based hypotheses about downstream performance. Projecting embeddings onto these concept vectors produces low-dimensional representations for quantifying concept importance in making predictions. We evaluate PiCo on three GFMs with different input modalities using seven physical concepts covering forest leaf optics and canopy structure. In ground-cover estimation, RGB restriction reduces dry-matter sensitivity and disproportionately degrades predictions for dry vegetation and bare ground, supporting a hypothesis derived from sensitivity analysis. For hierarchical forest type and tree species classification, concept representations retain 70.0-93.8% of full-embedding accuracy. Models capture similar physical contrasts between classes, such as structural differences between broadleaf forest and cleared ground and leaf-water-content differences between oak and beech, yet differ in the strength of these contrasts and the concepts driving classification. PiCo thus provides a physical basis for hypothesis testing and model assessment, with potential applicability beyond Earth observation wherever forward models enable controlled simulation and pretrained embeddings are accessible for probing.
139. 【2610.20965】MSP: Modality Self-Play for Training Multimodal LLMs Without Paired Cross-Modal Data
链接：https://arxiv.org/abs/2610.20965
作者：Robert Moseley,Md Kaykobad Reza,Ameya Patil,Edward Ayrapetian,Salman Asif
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved remarkable progress, Large multimodal models, Large multimodal, scaling model capacity, achieved remarkable
备注： 21 pages, 4 figures, 16 tables. Accepted at NeurIPS 2026
点击查看摘要
Abstract:Large multimodal models have achieved remarkable progress by scaling model capacity and training on massive paired multimodal data. However, this paradigm introduces a fundamental bottleneck: aligned multimodal datasets are expensive to curate, difficult to scale across diverse modality combinations, and increasingly constrain further progress. We introduce Modality Self-Play (MSP), a training framework for multimodal foundation models based on proxy-mediated modality composition. Instead of relying on paired cross-modal data, MSP uses anchor-supporting proxy textual descriptions of unseen modalities as semantic bridges during training. Given an observed modality (e.g., image or audio), the model generates proxy descriptions for complementary unseen modalities, which are then encoded and aligned with the observed modality through learned bridges, enabling cross-modal interaction without real paired non-text supervision. Our central hypothesis is that proxy text, combined with contrastively trained pretrained encoders, provides sufficient semantic structure for multimodal composition to emerge. We show that MSP enables zero-shot modality composition: models trained only with a real anchor modality and accompanying proxy descriptions can integrate and reason over multiple modalities at inference time despite never observing real paired non-text data during training. Empirically, MSP achieves state-of-the-art or competitive performance on multiple multimodal benchmarks. Ablation studies further demonstrate that learned bridges improve alignment, while anchor-supporting proxy descriptions enable effective cross-modal composition. MSP removes the need for real paired non-text (e.g., audio-vision) supervision, while continuing to rely on modality-text pairs, pretrained contrastive encoders, and modality-distribution bridge calibration.
Comments:
21 pages, 4 figures, 16 tables. Accepted at NeurIPS 2026
Subjects:
Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
ACMclasses:
I.2.7; I.2.10; I.5.4
Cite as:
arXiv:2610.20965 [cs.AI]
(or
arXiv:2610.20965v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2610.20965
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
140. 【2610.20964】VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents
链接：https://arxiv.org/abs/2610.20964
作者：Zhivar Sourati,Marianne Menglin Liu,Rongguang Wang,Zheng Wang,Yazhe Hu,Lan Guo,Yuying Wang,Mengqing Guo,Bhavesh Dnyaneshwar Gore,Shubham Pathak,Ramapriya Ranganath,Sandeep Sharma,Tao Sheng,Sujith Ravi,Dan Roth
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：benchmarks rarely combine, rarely combine large-scale, Existing long-document, combine large-scale human-authored, detailed visual evidence
备注：
点击查看摘要
Abstract:Existing long-document QA benchmarks rarely combine large-scale human-authored questions with detailed visual evidence annotations, limiting diagnosis of evidence localization and interpretation failures. We present VELD-QA, a large-scale benchmark for Visual Evidence grounding and question answering in Long Documents. It contains 15,000 fully human-authored question-answer pairs across 5,859 real-world PDFs totaling 372,445 pages, balancing chart, table, and complex-layout tasks. Human annotations identify supporting pages and evidence elements and describe cited visual content, enabling separate retrieval and interpretation evaluation. We evaluate nine vision-language models under four evidence settings and seven retrieval-augmented and agentic systems. Our analysis identifies bottlenecks in evidence localization and interpretation. Retrieval-based methods substantially underperform the oracle setting with ground-truth supporting pages; full-document access does not close the gap. Localization alone is insufficient: oracle accuracy peaks at 81.7%, highlighting persistent visual interpretation and reasoning challenges. Enriching inputs with our visual-element annotations narrows the performance gap by 17-24%, demonstrating value beyond evaluation and motivating data enrichment for multimodal document QA. Our code is available at this https URL.
141. 【2610.20958】Line-Augmented cuVSLAM: Robust Visual Odometry in Low-Texture Environments
链接：https://arxiv.org/abs/2610.20958
作者：Dara Molloy,Terry Wu,Wonju Lee,Abhilash Nand Kumar,David Adley,Conor Ferguson,Hesam Rabeti
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous mobile robots, point-feature visual odometry, production facilities operate, defeat point-feature visual, Autonomous mobile
备注： 8 pages, 4 figures
点击查看摘要
Abstract:Autonomous mobile robots in warehouses and production facilities operate in precisely the environments that defeat point-feature visual odometry: featureless aisles, uniform walls, repetitive racking and specular floors. Such environments are, however, rich in straight-edge structure: rack uprights, door frames, wall junctions and cabinet outlines present high-contrast linear edges stable across wide viewpoint changes. A line-feature extension to cuVSLAM, a CUDA-accelerated visual-SLAM system, is presented that recovers this signal. Lines are parameterised as Plücker coordinates for geometric transport and as the minimal 4-DOF orthonormal representation of Bartoli and Sturm for optimisation; a Cauchy-robust point-to-line residual with analytic Jacobians is folded directly into cuVSLAM's per-frame Gauss-Newton pose solve, and the same line state is jointly refined in the Schur-complement sliding-window bundle adjustment. An adaptive information weight causes lines to assume more of the estimation burden exactly as point features become scarce, and the extension adds residual blocks to existing solvers rather than introducing a second estimator, reducing exactly to the unmodified point pipeline when disabled. Evaluated in RGB-D mode under SE(3) Umeyama alignment with no scale correction, line features reduce mean absolute trajectory error by 38.5% over the 22 sequences of the TUM RGB-D Freiburg3 collection and by 30.1% over the 8 Replica room and office sequences, where median translation error falls by 38.9% and median rotation error by 66.4%, with zero tracking failures in any configuration tested.
142. 【2610.20917】Decision-FLIP: Budget-Free Structured Pruning for Gaussian Occupancy Models
链接：https://arxiv.org/abs/2610.20917
作者：Jingxing Li,Anurag Paul,Subhasis Das,Cindy Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Occupancy predictors rely, Occupancy predictors, Gaussians or learned, fixed by hand, large persistent banks
备注：
点击查看摘要
Abstract:Occupancy predictors rely on large persistent banks of Gaussians or learned queries whose size is fixed by hand. Common pruning proxies, such as opacity, activation frequency, or parameter magnitude, do not measure whether removing a row changes the model's voxel decisions. We introduce Decision-FLIP, a budget-free compilation framework whose scoring and structure selection need only unlabeled calibration inputs. Exact Mean-FLIP scores each persistent row by the number of voxel argmax decisions that change when the row is removed from the readout; a guarded Otsu split of the log-score distribution selects the survivor count without a target and abstains when the split is unsupported; and the survivors are physically compiled into a smaller checkpoint, so camera sampling, attention, and aggregation shrink with the bank. For streaming banks, scores are integrated over each row's lifecycle through warp, death, and refill. Across four Gaussian-bank model-dataset settings and one persistent-query transfer, the automatically selected cuts remove 12-79% of eligible rows and cut bank/query-dependent latency by 7-45% across settings with component profiles, with whole-model savings of up to 8.0% on the primary endpoints bounded by fixed-cost image, voxel, and sensor modules and peak-memory savings of up to 16.6%. Under matched one-epoch recovery controls, semantic mIoU changes by at most 0.18 point. Same-$K$ controls show that the ranking, not only the bank size, matters: random removal collapses GaussianFormer-1 and OccFormer, while label-free Mean-FLIP matches or outperforms supervised Taylor ranking on all five settings where that control was run. The method applies when removable primitives keep a stable checkpoint-row identity; it is budget-free in survivor count, not parameter-free.
143. 【2610.20904】EgoJEPA: Beyond Retargeting for Dexterous Manipulation from Egocentric Videos
链接：https://arxiv.org/abs/2610.20904
作者：Meng Cao,Can Zhao,Jinjie Wei,Haonan Zhao,Yulong Zhang,Duo Han,Xiaofan Li,Ziwu Song,Rongtao Xu,Ruyi Gan,Hao Wang,Qian Wang,Daolin Ma,Ian Reid,Xiaodan Liang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Egocentric human videos, control remains chal, costly robot demonstra, Egocentric human, remains chal
备注：
点击查看摘要
Abstract:Egocentric human videos offer a scalable alternative to costly robot demonstra- tions, yet transferring their manipulation priors to robot control remains chal- lenging. The commonly adopted retargeting-based approaches convert human wrist and finger poses into embodiment-specific action commands through hand- crafted geometric mappings. However, such mappings require meticulous recal- ibration across different embodiments and risk propagating hand-tracking errors into downstream robot control pipelines. To this end, we propose EgoJEPA, a three-stage framework that learns embodiment-agnostic representations from ego- centric human videos without rule-based human-to-robot retargeting: 1) Human- action pre-training learns effect-aware latent actions through JEPA-style visual prediction conditioned on hand-motion differences; 2) Latent-action-based world modeling jointly predicts future visual dynamics and latent actions, which decou- ples human prior pre-training from robot-specific control parameterizations; 3) Embodiment-specific tuning adapts the pretrained model to diverse robots through lightweight action adapters. Experiments on five real-world manipulation tasks across three robot embodiments demonstrate the effectiveness and efficiency of EgoJEPA. It achieves a 74% average success rate under the out-of-domain evalu- ation, compared with 65% for the retargeting baseline, while reducing cumulative cross-embodiment wall-clock cost by 47.2%, from 743.2 to 392.7 hours.
144. 【2610.20881】Pixels to Tokens: Token Space Efficient Active Learning for Low-Budget Semantic Segmentation
链接：https://arxiv.org/abs/2610.20881
作者：Utku Cicek,Mahip Singh,Ziyao Shang,Kimathi Kaai,C Thomas,Pedro Pablo Guerrero Vela,Alexander Wong,Sirisha Rambhatla
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：annotation requirements remain, requirements remain high, remain high due, current active learning, redefined visual representations
备注： Accepted at NeurIPS 2026. 19 pages, 6 figures
点击查看摘要
Abstract:While foundation models and vision transformers (ViTs) have redefined visual representations, current active learning (AL) strategies for these backbones largely operate at the patch or region level, where annotation requirements remain high due to extensive pixel labeling. Extending ViT-based AL to the pixel-level, low-budget regime is uniquely challenging: with as little as one pixel query per image, a method must simultaneously identify the most informative locations and train a reliable decoder head from an extremely sparse signal. We introduce TEAL (Token-space Efficient Active Learning), the first pixel-level AL framework built around ViT representations. TEAL uses a frozen ViT backbone and performs diversity-based selection directly on its native token lattice, avoiding the artifacts introduced by interpolating token embeddings to dense pixel resolutions. Our framework applies a two-level MaxHerding strategy over multi-layer token descriptors to select representative candidates, followed by margin-based uncertainty refinement on a finer decoder grid. Across CamVid, Cityscapes, ADE20K, and Pascal Context, TEAL consistently outperforms previous baselines under extreme label scarcity, improving over the strongest baseline by up to +24.36 mIoU with a single labeled pixel (px) per image, and reaching up to 97% of fully supervised performance with just 10 px. To rigorously establish the source of the gains, we further show that the improvements persist when all baselines are equipped with the same DINOv3 backbone, demonstrating that coupling token-space selection with uncertainty refinement on the decoder grid makes ViT token geometry an effective foundation for extremely low-budget active segmentation.
145. 【2610.20879】DefoliationCAM: An Edge-AI System for Real-Time Insect Defoliation Severity Assessment in Grapevines
链接：https://arxiv.org/abs/2610.20879
作者：Fuchen Li,Wei-Zhen Liang,Pin-Chu Lai,Xin Qiao,Jingqiu Chen,Haw Yen,Zonglin Yanga,Chi-En Chiang,Rudolph Avalos,Abbigail L. Rath
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Insect-induced defoliation threatens, threatens grapevine health, subjective manual scouting, Insect-induced defoliation, health and yield
备注：
点击查看摘要
Abstract:Insect-induced defoliation threatens grapevine health and yield, yet severity assessment relies on subjective manual scouting. We developed DefoliationCAM (D-CAM), a solar-powered edge AI system that estimates canopy defoliation and transmits results via LoRa to a web dashboard. The pipeline uses YOLOX-Nano to localize grapevine cordons in 4K images and a MobileNet-based classifier with lightweight channel attention to classify 320 x 320 pixel patches. The 29,674 field-collected patches were labeled as background or one of four damage levels: no to negligible, mild, moderate, and severe. Merging moderate and severe classes reduced the class imbalance ratio from approximately 40:1 to 8.8:1. Synthetic augmentation increased macro-F1 from 0.768 to 0.838. The classifier outperformed ResNet-50 in macro-F1 with fewer parameters (1.08 M versus 23.52 M). Patch predictions were aggregated into a canopy-level Non-linear Global Defoliation Severity (NGDS) score and validated against an entomologist's ratings of 86 held-out canopy images. Quadratic discriminant analysis identified boundaries of 9% and 29% separating negligible damage, mild damage requiring monitoring, and action-level damage warranting on-site scouting and insecticide treatment consideration. The 29% boundary aligned with the 25%-30% action threshold range for Japanese beetle management in grapevine. Using TensorRT FP16 on an NVIDIA Jetson Orin Nano, the pipeline processed each 4K image in approximately 1.5 s, with a complete operating cycle of 57-60 s. A five-week deployment of two field units demonstrated the feasibility of autonomous solar-powered operation, LoRa communication, and remote defoliation monitoring. D-CAM supports frequent, objective canopy damage assessment for targeted scouting and timely pest-management decisions.
146. 【2610.20852】Probing Negation Understanding in Vision-Language Models With Object Attention
链接：https://arxiv.org/abs/2610.20852
作者：Beth Pearson,Michael Wray,Martha Lewis
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：important vision-language models, fundamental aspect, aspect of language, language understanding, important vision-language
备注： EMNLP Findings 2026
点击查看摘要
Abstract:Negation is a fundamental aspect of language understanding and it is important vision-language models (VLMs) are able to process it effectively. We investigate how VLMs process negation by analysing attention patterns of different models. We draw comparisons between human gaze and attention in models when processing affirmative vs negated statements. We compare object level model attention to human eye-fixations in both binary and multary settings, evaluating with both synthetic and realistic datasets. We find models generally do not follow human-like attention patterns when resolving negation, suggesting they rely on mechanisms outside of attention. While layerwise analysis shows that PaliGemma2-3B shifts object attention to the alternative under negation, our headwise ablations suggest this is a byproduct rather than a negation processing mechanism. Additionally, we find that LLaVA-1.5-7B displays a spatial bias towards left-side objects. Our evaluation of models on downstream tasks shows that all models have a discrepancy between affirmative and negated questions highlighting the need to better understand the underlying processing of negation to close this performance gap. Code available at this https URL
147. 【2610.20843】MARS - A foundational map auto-regressor
链接：https://arxiv.org/abs/2610.20843
作者：Qi Zhang,Suvam Bag,Rupanjali Kukal,Lucas Thai,Jacob Kovarskiy,Mike Bianco,Xiaojie Guo,Raphael Tang,Mikael Figueroa,Rishi Madhok,Nikolaos Karianakis,Fuxun Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pose significant challenges, common pixel-wise generative, non-structural vectorized data, tasks feature extensive, feature extensive non-structural
备注：
点击查看摘要
Abstract:Map generation tasks feature extensive non-structural vectorized data (e.g., points, polylines, and polygons) and thus pose significant challenges to common pixel-wise generative models. Conventional approaches use multiple stages, first segmenting these features at the pixel level and then performing vectorized post-processing, with errors and complexity compounding at each stage. Motivated by the recent success of auto-regressive language modeling, we propose the first map foundation model, named Map Auto-Regressor (MARS), that is capable of generating both multi-polyline road networks and polygon buildings in a unified manner. For training MARS, we collected to our knowledge the largest multi-class map extraction dataset totaling 3.4M examples, which we call MAP-3M. Across four road and building datasets, MARS outperforms or matches the performance of multistage baselines. Additionally, we develop a "Chat with MARS" capability that enables interactive human-in-the-loop map generation and correction, supported by the auto-regressive nature of our end-to-end approach. We release our MAP-3M dataset and project demo page at (1) this https URL and (2) this https URL, respectively.
148. 【2610.20822】mporal Specification Guidance for Text-to-Video Generation
链接：https://arxiv.org/abs/2610.20822
作者：Avishree Khare,Hideki Okamoto,Bardh Hoxha,Georgios Fainekos,Rajeev Alur
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Metric Temporal Logic, natural language prompts, intended ordering, Temporal Logic, requested in natural
备注：
点击查看摘要
Abstract:Text-to-video models often generate the visual concepts requested in natural language prompts but fail to satisfy their intended ordering, timing, and persistence requirements. We propose representing these requirements as specifications in a formal Temporal Logic, and introduce Temporal Specification Guidance (TSG), a training-free inference-time framework that turns temporal specifications into executable objectives for guiding video generation during sampling. TSG scores traces of visual concept evidence using differentiable quantitative semantics and uses the score's gradients to construct a specification-guided denoising direction. We instantiate this framework with video-text attention traces, efficient differentiable scores for Metric Temporal Logic, and gradient-derived attention biases. This instantiation requires neither an external concept classifier nor backpropagation through the video transformer. Its attention-steered forward pass yields a denoising direction that augments classifier-free guidance (CFG). On a benchmark of 220 prompts spanning 11 categories of temporal constraints, including ordered object entry and state transitions, this instantiation improves specification satisfaction accuracy over CFG by 9.5-20 percentage points across five models, with minimal memory overhead. These results demonstrate the potential of temporal specifications and differentiable satisfaction objectives as a flexible interface for controlling video generation.
149. 【2610.20818】Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation
链接：https://arxiv.org/abs/2610.20818
作者：Qian Yu,Zongyang Qiu,Juncheng Yan,Hongliang Li,Qi Qin,Keqi Wang,Siqi Luo,Junkui Ju,Yapeng Mi,Tiantian Lu,Tian Liu,Pengyu Xie,Chenhao Ji,Minghui Zhang,Yiang Zhao,Siyu Yan,Haiying Xu,Yanbo Wang,Jianghan Shen,Yuandong Pu,Jiayi Lei,Borui Zhang,Jinxin Shi,Bo Zhang,Yuhang Zang,Shenglong Ye,Lixin Gu,Hongjie Zhang,Linghan Liu,Xinyuan Chen,Yuewen Cao,Lihe Zhang,Xiaohong Liu,Junjun He,Qiangwei Liu,Qi Zhang,Yu Cheng,Tianfan Xue,Hui Xiong,Chang Xu,Yu Qiao,Yihao Liu,Bin Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal generation covers, Intern Lumina, hybrid paradigms, Unified multimodal generation, visual
备注： 47 pages, 12 figures, 22 tables
点击查看摘要
Abstract:Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align naturally with text modeling but have limited representational capacity. Continuous and hybrid approaches retain richer visual representations, but they model text and images in heterogeneous spaces with different training objectives, potentially introducing optimization conflicts between modalities with misaligned representation spaces. These choices expose a central question: how to efficiently model high-capacity visual representations alongside textual content in a shared optimization space within a single backbone. We present Intern Lumina U2, to our knowledge the first diffusion language model to represent multi-codebook visual tokens in a fully discrete space. Each visual position is represented by a group of codes from complementary codebooks, increasing its representational capacity while preserving compatibility with discrete text modeling. At the input, the embeddings are concatenated at each position; at the output, a lightweight multi-codebook autoregressive head predicts the codes within each position sequentially, while the diffusion backbone processes all positions in parallel. Built on the unified 4D representation of AToken, Intern Lumina U2 supports image, video, and 3D inputs within a single backbone and achieves leading performance among unified models in visual understanding, image generation, and image editing. We further build a full-stack training, inference, and evaluation system on both Ascend and NVIDIA platforms to verify the cross-platform effectiveness of our model. We also improve the inference efficiency through a stability-aware sampling strategy, which combines confidence-plateau-guided unmasking approach with drift-triggered cache refreshing mechanisms, accelerating image generation by 4.45x.
150. 【2610.20811】RIGen: Beyond Action Following with Reciprocal Interaction in Generative Gameplay
链接：https://arxiv.org/abs/2610.20811
作者：Mengfei Li,Yi Zhang,Xingtong Ge,Lunjie Zhu,Fangyu Lin,Peng Li,Guanglu Song,Yu Liu,Wei Xue,Wenhan Luo,Yike Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generative gameplay requires, subsequent choices, situation and subsequent, Reciprocally Interactive Generation, Generative gameplay
备注：
点击查看摘要
Abstract:Generative gameplay requires more than immediate responses to player this http URL should have persistent consequences, while the generated world should act according to its own state and rules, shaping the player's situation and subsequent choices. Video generation captures local dynamics, but limited history, partially observed game state, and the need for contextual behavior decisions make such interactions difficult to sustain through audiovisual prediction alone. We introduce \rig (Reciprocally Interactive Generation), a framework for reciprocal interaction in generative gameplay. \rig combines persistent state and configurable rules, contextual interaction reasoning, and action-conditioned audiovisual generation. Together, these components make interaction consequences and actor behavior jointly determine generated content while maintaining consistency between game state and visible outcomes. We construct a Xonotic gameplay dataset to train an audiovisual generator for learning dynamics and interactions. Further post-training enables \rigarena, an interactive generative first-person shooter (FPS) prototype. Experiments demonstrate more reliable combat outcomes and reciprocal interaction between the player and the generated world. Project page: this https URL.
151. 【2610.20794】Blame Errant Words, Not the Canvas: Defect-Aware Spatial Credit Assignment for Visual Text Generation
链接：https://arxiv.org/abs/2610.20794
作者：Sujie Hu,Huaisong Zhang,Pujing Yang,Qian Wang,Xiaomin Li,Xinhang Leng,Chen Li,Jing Lyu,Xiu Li,Ling Pan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent reinforcement learning, reinforcement learning approaches, Recent reinforcement, visual text generation, improved visual text
备注：
点击查看摘要
Abstract:Recent reinforcement learning approaches have improved visual text generation, yet generated images still suffer from incorrect wording and malformed glyphs. We identify two coupled limitations: recognition-based rewards often overlook visible glyph defects, while whole-image scalar feedback obscures the uneven quality of individual text regions. These limitations motivate our central principle: $\textit{Blame errant words, not the canvas}$, to effectively preserve local quality distinctions. First, we introduce $\mathbf{TextDART}$, a defect-aware region-targeted reward model that localizes individual text regions and independently evaluates their semantic correctness and glyph quality, providing fine-grained, region-precise feedback. Building on TextDART, we propose $\mathbf{SCANNER}$, which turns these regional judgments into spatially differentiated policy feedback. It normalizes rewards for each text target across sampled images and casts the resulting regional advantages onto the corresponding latent tokens. Extensive experiments on existing benchmarks and our newly established $\textbf{PolyText-Bench}$ demonstrate that our approach achieves state-of-the-art performance in text accuracy and glyph fidelity. Project page: this https URL
152. 【2610.20781】ReasonUni: Reasoning-Augmented Reconstruction Advances Unified Multimodal Models
链接：https://arxiv.org/abs/2610.20781
作者：Feize Wu,Zhiyuan Yan,Yuhuan Hong,Yuwei Niu,Zongjian Li,Zheyuan Liu,Bin Lin,Jinbo Yan,Jie Qin,Xudong Mao,Limeng Qiao,Guanglu Wan,Li Yuan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：unified multimodal models, multimodal models, dual tasks, Reconstructive post-training, Reconstructive post-training couples
备注： 27 pages, including appendix
点击查看摘要
Abstract:Image-to-text (I2T) understanding and text-to-image (T2I) generation are dual tasks in unified multimodal models (UMMs). Reconstructive post-training couples these tasks, but existing reconstruction-based methods remain perception-centric and provide limited supervision for reasoning about structure, intent, and transformation. We propose ReasonUni, a reasoning-augmented reconstructive post-training framework that extends this coupling beyond perception. Given an original image and an editing instruction, the UMM first reasons about what and how to edit and describes the target state, then generates the corresponding target image conditioned on this understanding output. To jointly optimize both modules, we introduce TreeGRPO, a tree-structured reinforcement learning method that samples multiple reasoning paths and candidate images per path, then aggregates visual rewards to update both modules under a unified objective. Experiments across multiple benchmarks demonstrate consistent gains in both understanding and generation, showing that reasoning-augmented reconstruction yields genuine mutual gains for UMMs.
153. 【2610.20761】Purify Before You Align: Improving Representation Alignment for Diffusion Models
链接：https://arxiv.org/abs/2610.20761
作者：Yingheng Wang,Yaoqiang Li,Yaqin Wu,Junwen Bai,Jiatao Gu,Christopher De Sa,Volodymyr Kuleshov
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：encouraging intermediate features, pretrained representations, encouraging intermediate, intermediate features, features to match
备注： Code and checkpoints are on the project page: [this https URL](https://yingheng-wang.com/LAP)
点击查看摘要
Abstract:Representation alignment improves and accelerates diffusion training by encouraging intermediate features to match a pretrained visual encoder. However, standard alignment matches pretrained representations without distinguishing what information may be more useful for generation. We introduce local appearance purification (LAP), which improves generation quality and makes encoders such as MAE more effective alignment targets by removing locally predictable content and aligning to the residual. LAP modifies only the alignment target, and requires no changes to diffusion training or inference. Through controlled interventions within a fixed encoder, we show that effective alignment depends on what information the target emphasizes, not simply how much image information it contains. Our theory gives a variational interpretation of standard alignment and, for fixed local predictors, a sum of token-wise information bounds conditioned on local appearance. To understand why purification benefits some encoders more than others, we derive an exact constant-readout test that measures how well the target can be matched without using the diffusion model's hidden state. LAP improves generation quality across five pretrained representations (MAE, AIMv2, CLIP, DINOv2, DINOv3), with the largest gain for MAE: on ImageNet-256 with SiT-B/2, it reduces FID from $53.1$ to $42.3$. Its gains persist with stronger alignment recipes and tokenizers. Computed before diffusion training, the constant-readout score predicts the benefit of purification (Spearman $\rho=0.94$ across 13 encoders).
154. 【2610.20731】WorldCast: Exploring Intelligent Visual Generation in World State Prediction
链接：https://arxiv.org/abs/2610.20731
作者：Wenhao Yan,Haodong Li,Xiaotong Li,Yaxin Luo,Zhengrong Yue,Jialv Zou,Xu Huang,Haojin Yang,Nan Jia,Yan Feng,Peng Pei,Xunliang Cai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Humans interpret multimodal, interpret multimodal observations, models, world, Humans interpret
备注： Project Page: [this https URL](https://teal024.github.io/WorldCast)
点击查看摘要
Abstract:Humans interpret multimodal observations of the world and forecast how it will evolve. Recent multimodal generative systems have demonstrated similar capabilities: they can integrate multimodal context and synthesize visual outputs that depict changes in the world. To characterize this emerging trajectory, we organize model capabilities into a four-level hierarchy and discover that higher-level tasks remain relatively underexplored despite model progress. To bridge this gap, we explore model performance on multi-step world state prediction, a high-level task that requires models to forecast successive future world states from multimodal observations and diverse references. Such a task requires models to possess entangled understanding and generation capabilities, as well as extensive world knowledge to translate human action sequences, physical transformations, and abstract visual reasoning into coherent visual outputs. We introduce WorldCast, a benchmark comprising 320 manually designed cases across eight categories, and evaluate 12 representative models. The conducted experiments yield three key insights: (a) advances in frontier models are rapidly pushing the boundaries of intelligent world modeling, with the GPT-Image-2.5 System scoring 72.8 and demonstrating early-stage visual state prediction capabilities on real-world tasks; (b) WorldCast reveals substantial gaps between models: even Nano Banana Pro reaches only 42.8 and the best open-source model scores 20.1, with deficits in handling complex context, entangled references, and reasoning-heavy tasks; (c) strong generative models effectively draw on the capabilities of their underlying language models. These findings highlight the need for multimodal generative models that are capable of dynamic planning and reasoning while also being deeply unified to faithfully simulate real-world states.
155. 【2610.20693】Orbia: Do Generated Videos Form a Consistent 3D World?
链接：https://arxiv.org/abs/2610.20693
作者：Dongyue Lu,Guian Fang,Hur Lim,Yonggang Wu,Yanrong Wang,Hongshan Chen,Shengju Qian,Yue Liao,Wei Chow,Lingdong Kong,Tianxin Huang,Yu Yang,Hongji Yang,Junchao Huang,Ao Liang,Yihao Wang,Zihan Wang,Rong Li,Hanlin Chen,Xin Wang,Wei Tsang Ooi,Mike Zheng Shou,Shuicheng Yan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visually appealing frames, Video generators serve, depict a consistent, generators serve, realistic and visually
备注： Technical Report; 70 pages, 43 figures, 12 tables; Project page at [this https URL](https://orbia-bench.github.io/) Code at [this https URL](https://github.com/worldbench/Orbia) Dataset at [this https URL](https://huggingface.co/datasets/Orbia/Orbia)
点击查看摘要
Abstract:Video generators serve as interactive worlds for exploration and simulation, yet realistic and visually appealing frames do not necessarily depict a consistent 3D world. Existing benchmarks assess selected geometric properties or use vision-language models to judge memory and consistency, leaving systematic 3D evaluation underexplored. We introduce Orbia, the first benchmark dedicated to a systematic and comprehensive evaluation of 3D consistency in interactive world models. Through controlled exploration and revisit, we organize the evaluation into three dimensions: input preservation, generated-content persistence, and 3D self-consistency. For input preservation, registered RGB-D references and annotated anchors support appearance, geometry, and spatial stability measurements. For generated-content persistence, we compare revisits to regions absent from the input image with their first generated observations to test whether models preserve what they create. For 3D self-consistency, cross-view depth and feature correspondence, regional scale agreement, and held-out Gaussian rendering test whether generated views describe the same 3D scene. Minute-long exploration and revisits further test long-term consistency. Our construction and annotation pipeline brings together public datasets, self-captured scenes, and simulation, yielding 720 instances across indoor and outdoor environments and six exploration-and-revisit protocols. Evaluation spans 27 text-, action-, and camera-conditioned models through native-interface adapters. Our Orbia benchmark provides a systematic basis for diagnosing 3D inconsistency and developing more persistent video world models.
156. 【2610.20684】Learning Topology-Aware Representations for Mechanics-Relevant TPMS Metamaterials
链接：https://arxiv.org/abs/2610.20684
作者：Songlin Duan,Shuo Yang,Yujia Zheng,Tobin Filleter
类目：Machine Learning (cs.LG); Computational Engineering, Finance, and Science (cs.CE); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：Periodic Minimal Surface, Triply Periodic Minimal, mechanical Triply Periodic, Minimal Surface, Triply Periodic
备注： 29 pages, 10 figures
点击查看摘要
Abstract:Learning informative representations of mechanical Triply Periodic Minimal Surface (TPMS) metamaterials is important for mechanics analysis and structural design, yet existing methods have rarely explicitly supervised learned representations with information about global structural connectivity that is relevant to mechanical response. We propose a topology-aware representation learning framework that integrates persistent homology into a DMAE backbone to explicitly encode global structural connectivity. A persistence-guided masking strategy prioritizes patches associated with persistent topological features, while an auxiliary persistent-homology decoder encourages the latent representation to retain information about topological feature counts across connected components, tunnels, and voids. We evaluate the learned representations on two complementary TPMS datasets using family classification, mechanical-property classification, unsupervised clustering, and regression. Across the two datasets, our method demonstrates strong performance in both structural family and mechanical-property classification, improving family classification by up to 3.9% while achieving the best linear-probe performance. More notably, unsupervised property-clustering performance improves by up to 26.7% and 51.5% across the two datasets, while strong regression performance is retained with $R^2=0.993$. These results establish persistent topology as an effective inductive bias for representation learning of complex three-dimensional mechanical metamaterials.
157. 【2610.20651】owards automatic digital garment assembly
链接：https://arxiv.org/abs/2610.20651
作者：Alejandro Rodriguez
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Creating digital garments, existing two-dimensional patterns, two-dimensional patterns remains, Creating digital, time-consuming process
备注： 11 pages, 8 figures
点击查看摘要
Abstract:Creating digital garments from existing two-dimensional patterns remains a time-consuming process. Although patterns are widely available in digital form, their assembly in garment CAD software involves manual definition of sewing operations and arrangement of the pattern panels for drape simulation. We present two learning-based approaches that automate both tasks using the 2D vector pattern as their sole input. Our automatic sewing model operates at the segment level, leveraging a Transformer encoder with multiple prediction heads. Our novel architecture supports many-to-many, ordered segment correspondences, as well as hems, overlapping seams needed for multilayer garments, and construction properties such as seam allowances and stitch types, required for the finished virtual garment but neglected by previous methods. A complementary panel-level model predicts body-region assignments, layers, and placement coordinates to initialize the drape simulation. We evaluate both models on a curated dataset of 4,035 professionally assembled garment instances. The sewing model exactly recovers all seam and hem topologies of 63.3\% of test garments, while the arrangement model meets the specified placement criteria for all panels in 66.2\% of test garments. We also integrate both methods into garment CAD software, demonstrating automatic assembly of successfully predicted garments.
158. 【2610.20636】FlowBudget: Training-Free Sampling-Budget Estimation for Flow Matching Models
链接：https://arxiv.org/abs/2610.20636
作者：Zahra Dehghani,Pablo Piantanida,Mohammadhadi Shateri
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：making inference cost, continuous flow-based generators, inference cost depend, making inference, requires numerical ODE
备注：
点击查看摘要
Abstract:Sampling from continuous flow-based generators such as flow matching models requires numerical ODE or SDE integration, making inference cost depend on the number of function evaluations (NFEs). In practice, the sampling budget is inherited from prior work or selected through expensive FID-versus-NFE sweeps, using FID to assess image-generation quality, requiring sample generation and evaluation at multiple budgets. This makes sampling-budget selection dependent on repeated empirical evaluation. We therefore ask a complementary question to solver design and timestep allocation: for a fixed pretrained model and solver, what numerical resolution is sufficient? We introduce FLOWBUDGET, a training-free estimator of solver-relative sampling complexity. Using simulation-free interpolation probes of the learned dynamics, FLOWBUDGET normalizes the leading one-step discretization error by the motion, estimates its coefficient from interpolation probes, and maps a numerical tolerance to a step budget using the solver order. We derive estimators for numerical solvers in flow~matching sampling, namely Euler and Heun for ODE sampling and additive-noise Euler--Maruyama for SDE sampling, and connect the ODE coefficients to terminal integration error. Experiments on SiT, FlowDCN and Rectified Flow models, spanning flow-model architectures and formulations, test whether FLOWBUDGET can estimate the NFE budget without generating samples at multiple budgets or performing an FID-versus-NFE sweep. The code is available at this https URL
159. 【2610.20632】MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis
链接：https://arxiv.org/abs/2610.20632
作者：Rajdeep Pandhare,Rohit Kundaikar,Yakub Kojar,Shreyansh Tiwari
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern healthcare generates, healthcare generates increasingly, generates increasingly complex, increasingly complex medical, Modern healthcare
备注： 6 pages , 3 figures, published in ijsrem
点击查看摘要
Abstract:Modern healthcare generates increasingly complex medical reports that challenge clinical professionals in terms of time and interpretive burden. Manual review processes are slow, error-prone, and difficult to scale. This paper presents MeddeX, a Medical Report Analyzer that combines a QLoRA fine-tuned LLaMA-3 (8B) model with Retrieval-Augmented Gen eration (RAG) and a multimodal Gemini Vision layer to deliver accurate, concise, and evidence-backed summaries of medical documents. The system handles text-native PDFs, scanned image based PDFs, and direct radiological images through an intelligent hybrid extraction pipeline that includes a novel garbage-text detection mechanism for corrupted and UTF-16-encoded doc uments. Beyond single-report QA, MeddeX introduces report scoped retrieval for precise contextual grounding, an automated longitudinal report comparison engine, and a self-healing backfill pipeline that lazily processes legacy documents on demand. A FastAPI backend, Supabase vector store, and this http URL fron tend complete the end-to-end architecture. Evaluation against the base LLaMA3-Med42-8B model demonstrates consistent improvements across ROUGE-1 (+9.2%), ROUGE-2 (+10.0%), ROUGE-L (+11.8%), BLEU (+71.4%), and BERTScore (+0.8%), validating the benefit of domain-specific fine-tuning. MeddeX represents a practical and robust step toward AI-assisted clinical decision support.
160. 【2610.20627】BD-HazardVLM: Probing Vision-Language Models for Latent Defensive-Driving Hazards in Bangladesh Road Scenes
链接：https://arxiv.org/abs/2610.20627
作者：Abdullah Al Maruf,Md. Sajedul Islam,Tanmoy Mridha,Irfan Hossain Bhuiyan
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：Global South traffic, structured Global South, Global South, weakly structured Global, South traffic remains
备注： Accepted at the ECCV 2026 Workshop on Safe and Defensive Autonomous Driving (SDAD). 16 pages, 1 figure, 5 tables
点击查看摘要
Abstract:Vision-language models are increasingly used for driving-scene understanding, yet their defensive reasoning under weakly structured Global South traffic remains unclear. We introduce BD-HazardVLM, a diagnostic benchmark of 500 Bangladesh road-scene images, comprising 375 from RSUD20K and 125 from TFP-BD, annotated for hazard presence, primary hazard category, risk timing, severity, defensive actions, visible evidence, and hallucination- and Western-road-bias traps. We evaluate Qwen2.5-VL-7B, InternVL3-8B, and MiniCPM-V-4.6 using a shared zero-shot task definition and structured output schema. Binary hazard-presence accuracy ranges from 88.0 percent to 89.2 percent, essentially matching the 89.0 percent majority-class baseline. Fine-grained reasoning is substantially weaker: category accuracy remains below 40 percent, risk-timing accuracy ranges from 1.6 percent to 12.4 percent, and exact defensive-action matching remains below 2 percent. Although InternVL3-8B achieves the highest severity accuracy at 61.2 percent, it has zero recall on the 58 high-severity cases. Qwen exhibits severe category mode collapse, while all models show weak latent-hazard anticipation and near-zero self-reported trap recognition. For the evaluated models, these findings show that coarse hazard recognition does not imply reliable fine-grained defensive-driving reasoning and motivate geographically diverse safety evaluation.
161. 【2610.20349】NeuroDETR: Multiscale Discrete Spatiotemporal Tokenization for Asynchronous EEG Event Detection
链接：https://arxiv.org/abs/2610.20349
作者：Yaozhi Wen,Kun Zhao,Wei Wei,Haoyang Chen,Kangning Wang,Yi Sun,Shaowei Gu,Dingkun Liu,Shuang Qiu,Huiguang He
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：detection supports practical, supports practical brain-computer, practical brain-computer interfaces, Asynchronous EEG event, Asynchronous EEG
备注：
点击查看摘要
Abstract:Asynchronous EEG event detection supports practical brain-computer interfaces by identifying event classes and temporal boundaries directly from continuous recordings without predefined event boundaries at inference time. The primary challenge lies in extracting event-related patterns embedded in ongoing background activity. To address this, we propose \textbf{NeuroDETR}, a discrete spatiotemporal multiscale framework that combines structured tokenization with event-aware feature refinement. Multiscale temporal codebooks capture brief responses and sustained dynamics, while Spatial-Pyramid VQ hierarchically encodes spatial structure across EEG channels. These complementary representations form a compact event memory for jointly classifying events and estimating their onsets and offsets. Before tokenization, we apply FOCAL, an event-aware sparse attention module that uses predicted event presence to guide temporal feature refinement and spatial aggregation, emphasizing likely event periods while preserving context across the recording. Experiments on eight EEG datasets that span diverse paradigms demonstrate state-of-the-art performance. These findings provide a basis for the development of BCI systems that recognize meaningful neural activity during continuous interaction and monitoring.
162. 【2610.19957】Complementary Future Token Pruning for World Action Models
链接：https://arxiv.org/abs/2610.19957
作者：Baekseung Kim,Junhoo Lee,Sohyeon Hong,Suhyun Jeon,Minkyu Kim,Seungyeon Kim,Donghoon Han,Nojun Kwak
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：World action models, jointly predict future, tokens incurs substantial, substantial inference latency, World action
备注：
点击查看摘要
Abstract:World action models (WAMs) jointly predict future visual states and robot actions, but processing dense future-frame tokens incurs substantial inference latency. We propose CF-Prune, a training-free framework for pruning future-frame tokens in pretrained WAMs. Our key insight is that future visual predictions support action generation and therefore need not preserve every visual detail required for high-fidelity video synthesis. CF-Prune combines instruction and action attention to identify task-relevant tokens during the initial denoising forward pass, even when future-frame and action representations remain highly noisy. An entropy-based phase identification mechanism further retains dense computation during precision phases to mitigate pruning-induced performance degradation. Experiments on RoboLab, RoboCasa, and real-world manipulation tasks demonstrate consistent inference speedups. At a 35% pruning ratio, CF-Prune achieves average speedups of 1.19-1.27x while improving task success rates. At a 50% pruning ratio, it achieves 1.29-1.33x average speedups on both simulation benchmarks, with overall success rates within 1.0 percentage point of the baseline.
163. 【2507.07297】MagiC: Evaluating Multimodal Cognition Toward Grounded Visual Reasoning
链接：https://arxiv.org/abs/2507.07297
作者：Chengfei Wu,Ronald Seoh,Bingxuan Li,Liqiang Zhang,Fengrong Han,Dan Goldwasser
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Recent advances, visual question answering, grounded visual reasoning, advances in large, led to impressive
备注： AACL 2026 Main Conference
点击查看摘要
Abstract:Recent advances in large vision-language models have led to impressive performance in visual question answering and multimodal reasoning. However, it remains unclear whether these models genuinely perform grounded visual reasoning or rely on superficial patterns and dataset biases. In this work, we introduce MagiC, a comprehensive benchmark designed to evaluate grounded multimodal cognition, assessing not only answer accuracy but also the quality of step-by-step reasoning and its alignment with relevant visual evidence. Our benchmark includes approximately 5,500 weakly supervised QA examples generated from strong model outputs and 900 human-curated examples with fine-grained annotations, including answers, rationales, and bounding box groundings. We evaluate 15 vision-language models ranging from 7B to 70B parameters across four dimensions: final answer correctness, reasoning validity, grounding fidelity, and self-correction ability. MagiC further includes diagnostic settings to probe model robustness under adversarial visual cues and assess their capacity for introspective error correction. We introduce new metrics such as MagiScore and StepSense, and provide comprehensive analyses that reveal key limitations and opportunities in current approaches to grounded visual reasoning.
164. 【2610.22258】Denoising Textures is a Different Ballgame Altogether!
链接：https://arxiv.org/abs/2610.22258
作者：Saptarshi Mandal,Oindrila Haldar,Chirayata Bhattacharya,Chandra Sekhar Seelamantula,Zhiwei Xu,Thrasyvoulos N. Pappas,Gaurav Sharma
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：human brain effortlessly, brain effortlessly deciphers, effortlessly deciphers colors, details remains challenging, human brain
备注：
点击查看摘要
Abstract:The human brain effortlessly deciphers colors and textures from visual stimuli and reconstructs the world around us, yet preserving such details remains challenging in image denoising. While significant progress has been made in generic image denoising, the problem of texture denoising has remained relatively under-explored. Fine details, such as intricate patterns and repetitive structures, often suffer from over-smoothing even in deep learning based approaches for denoising. In this paper, we analyze the behavior of state-of-the-art (SOTA) denoisers on texture datasets and show that performance improvements are possible only by fine-tuning the denoisers on the texture datasets. Surprisingly, fine-tuning on texture datasets result in the models catastrophically forgetting the original dataset. These findings highlight the need for specialized treatment of textures in denoising. Since denoising quality directly impacts downstream tasks such as generative modelling, we argue that dedicated texture aware denoisers are essential for faithful texture reconstruction and synthesis.
165. 【2610.21452】Full-Duplex Interaction with Speech, Expressions and Gestures
链接：https://arxiv.org/abs/2610.21452
作者：Siyin Wang,Wenyi Yu,Terumi Chiba,Xianzhao Chen,Xiaohai Tian,Jun Zhang,Lu Lu,Chao Zhang
类目：Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：conversation requires coordinating, requires coordinating speech, conversation requires, requires coordinating, coordinating speech
备注： 37 pages, 5 figures
点击查看摘要
Abstract:Human face-to-face conversation requires coordinating speech, gestures and expressions across both speaking and listening. We present ELLSA 2, an end-to-end full-duplex dialogue model that jointly optimizes speech interaction and streaming gesture-expression generation. An autoregressive, chunk-wise synthesizer combines pretrained acoustic features with distinct listening and speaking hidden states from the dialogue backbone and speech synthesizer, enabling continuous non-verbal generation even when the model is verbally silent. To translate dialogue understanding into vivid semantic gestures, we introduce contextual semantic calls and template guidance, separating whether to invoke an available semantic gesture from how to realize it. We also establish a curated data and evaluation pipeline for dialog-aware co-speech gesture generation and investigate reference-based multimodal large language models (MLLMs) as automatic judges. Experiments show that ELLSA 2 remains highly competitive with open-source full-duplex speech interaction models and outperforms cascaded baselines across dialog-aware gesture and expression metrics. Semantic template guidance further significantly improves semantic gesture quality. Strong system-level correlations with human judgments support these reference-based scores as useful preliminary metrics for full-duplex and semantic gesture assessment. Together, these results advance dialogue modeling from spoken responses toward coordinated multimodal interaction.
166. 【2610.21183】Monotone Piecewise-Linear Harmonization of Multitemporal Multispectral Surface Reflectance With Unsupervised Deep Multiview Pseudoinvariant Features Learning
链接：https://arxiv.org/abs/2610.21183
作者：Lino Garda Denaro,Chia-Hsiang Lin
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Canonical Correlation Analysis, exhibit systematic inconsistencies, generally performed independently, Generalized Canonical Correlation, surface reflectance analysis
备注： 15 pages, 5 figures
点击查看摘要
Abstract:Surface reflectance products derived from optical satellite may exhibit systematic inconsistencies across acquisition dates, because atmospheric correction is generally performed independently for each image. Such residual biases distort the temporal behavior of invariant ground targets and reduce the reliability of multitemporal surface reflectance analysis. This study proposes Deep Multitemporal Generalized Canonical Correlation Analysis (DeepMGCCA), an unsupervised deep multiview pseudoinvariant feature learning framework that integrates Deep Generalized Canonical Correlation Analysis (GCCA) with Multivariate Alteration Detection (MAD) to identify deep-pseudoinvariant features (DIFs) for the removal of surface reflectance biases across multitemporal satellite observations. Unlike conventional MAD-based approaches that rely on linear GCCA, the proposed framework replaces date-specific linear projections with a shared convolutional encoder. The framework learns deep invariant features (DIFs) directly from pixel-weighted canonical variates via iterative reweighting strategy, while a reconstruction regularizer preserves surface reflectance information and prevents degenerate collapse from suppressing genuine temporal variability. Experiments were conducted on four annual Landsat-8/9 and Sentinel-2 acquisitions across four regions of interest (ROIs) to evaluate four DIF-based harmonization transforms. A monotone piecewise-linear transform derived from DIFs quantiles consistently achieved the largest bias reduction, lowering the between-date spectral angle by up to 2.54 and RMSE by 0.015, and raising PSNR by up to 4.04~dB. These findings demonstrate the potential of deep invariant feature learning for multitemporal surface reflectance bias removal while highlighting the importance of preserving physically meaningful temporal and spectral information during nonlinear representation learning.
