本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新550篇论文，其中：
- 自然语言处理72篇
- 信息检索13篇
- 计算机视觉104篇
自然语言处理
1. 【2609.17523】ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agents
链接：https://arxiv.org/abs/2609.17523
作者：Shuhan Xue,Jianyuan Zhong,Ziyuan Nan,Wenbin Li,Zhaochen Yu,Jinchao Ding,Qiang Gao,Pengyu Zhan,Yuntong Zhang,Tian Cheng,Zhenfei Yin,Yingcheng Wu,Ling Yang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：researchers' everyday workflows, brings continually improving, continually improving scientific, improving scientific agents, everyday workflows
备注： Website: [this http URL](http://science-buddy.io) , Code: [this https URL](https://github.com/Gen-Verse/ScienceBuddy-RSI)
点击查看摘要
Abstract:We introduce and release ScienceBuddy, an interactive scientific research workspace that brings continually improving scientific agents into researchers' everyday workflows. ScienceBuddy supports researchers in carrying out scientific tasks while transforming their requests, feedback, and execution evidence into tasks and evaluation rubrics for continual learning. At its core is recursive-in-recursive self-improvement, a paradigm that couples harness evolution with model reinforcement learning: the inner recursion improves the harness with the model fixed, while the outer recursion trains the model under the improved harness. Harness evolution shapes training experience, and model learning creates new opportunities for harness adaptation. We present case studies of researcher interaction, harness refinement, and model learning, with the benchmark cases spanning four scientific task families. By releasing ScienceBuddy as a research product, we make this paradigm available to the scientific community and take a step toward discovery intelligence: scientific AI that advances through sustained collaboration with researchers and evolves alongside the research it supports. Website: this http URL
2. 【2609.17516】When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control
链接：https://arxiv.org/abs/2609.17516
作者：Ali Şenol
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, produce fluent answers, produce fluent, Large
备注：
点击查看摘要
Abstract:Large language models can produce fluent answers when their factual support is weak. This paper introduces Chain-of-Self-Questioning (CoSQ), a prompt-only framework that makes answer commitment conditional on an explicit assessment of the information required to answer a question. We evaluate three CoSQ variants under seventeen conditions on the 817-item TruthfulQA multiple-choice validation set using eleven open-weight and hosted model families. In the final balanced-option protocol, Grounded-CoSQ at {\tau}=0.90 reduces the mean unconditional wrong-commitment rate from 13.1% under chain-of-thought prompting to 8.9%, a 32.1% relative reduction, while increasing answered accuracy from 86.9% to 89.7% and answering 87.6% of questions. Both improvements hold for all eleven models and at every evaluated threshold. Critical-CoSQ and Adaptive-CoSQ provide neighboring operating points with 88.6% and 86.5% coverage, respectively, while remaining more reliable than the baseline. A secondary Natural Questions Short-Answer evaluation provides convergent open-form evidence. These findings show that self-assessment can support explicit, tunable answer-or-abstain decisions when an unsupported commitment is more costly than referral or review.
3. 【2609.17515】What Breaks Under Pruning in Smart Homes, and When? Evaluating LLM Degradation Across Architectures and Task Complexity
链接：https://arxiv.org/abs/2609.17515
作者：Congjing Zhang,Vashishtha Patil,Henning Lange,Usman Aleem
类目：Computation and Language (cs.CL)
关键词：remains poorly understood, calling remains poorly, context-grounded tool calling, tool calling remains, large language models
备注： Submitted to EACL Industry Track
点击查看摘要
Abstract:Pruning can reduce the deployment cost of large language models (LLMs), but its impact on context-grounded tool calling remains poorly understood. We systematically study pruning-induced degradation in smart-home tool calling across four LLMs spanning dense Transformer, dense hybrid, and mixture-of-experts (MoE) architectures, together with depth, width, hybrid, and expert pruning methods. After post-pruning supervised fine-tuning (SFT), we evaluate more than 19,500 instances from three smart-home datasets. Beyond aggregate task accuracy, we characterize degradation along two dimensions: action components (i.e., operation, device, argument, and value) and task complexity. Our results show that dense models have narrow safe pruning regions followed by sharp degradation, while MoE models tolerate substantially more pruning. Pruning degrades grounded specificity before schema-level intent, and aggressive dense pruning can induce systematic over-refusal. These findings highlight the importance of evaluating pruning beyond aggregate accuracy when selecting pruned LLMs for reliable tool execution.
4. 【2609.17509】LACE: Layer-Wise Compression for Dynamic Frame Rate Codecs
链接：https://arxiv.org/abs/2609.17509
作者：Thanapat Trachu,Samuele Cornell,William Chen,Shinji Watanabe
类目：ound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Neural audio codecs, speech language modeling, Neural audio, language modeling, key component
备注： Accepted to SLT 2026. 8 pages, 5 figures
点击查看摘要
Abstract:Neural audio codecs are a key component in speech language modeling. However, their high frame rates lead to long sequence lengths, increasing computational costs. Dynamic frame rate codecs mitigate this by reducing the effective frame rate using a compression step to merge multiple frames together. However, most prior methods either operate on single-codebook codecs or apply a single compression step before multi-layer quantization. This forces all quantization layers to share the same segmentation boundaries, despite the residual embeddings at different quantization layers exhibiting different rates of change over time. We propose LACE (Layer-Adaptive Codec Encoding), a dynamic frame rate codec that applies an independent compression step at each quantization layer, enabling layer-specific segmentation boundaries. To use LACE tokens in downstream text-to-speech (TTS), we further introduce union alignment and boundary anchor mechanisms to make durations consistent across layers while preserving compression benefits. Experiments on LibriTTS show that LACE offers a better rate-quality tradeoff than prior dynamic frame rate methods on the reconstruction task and improves TTS inference efficiency while maintaining competitive synthesis quality. Our code is released as part of the ESPnet3 codec recipe.
5. 【2609.17496】Verifiable Social Reasoning for LLM Assistants
链接：https://arxiv.org/abs/2609.17496
作者：Amir Taubenfeld,Zorik Gekhman,Avigail Grinstein-Dabush,Itay Laish,Ariel Goldstein,Marian Croak,Avinatan Hassidim,Yossi Matias,Amir Feder
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：consultation settings remains, settings remains challenging, typically lack verifiable, daily social advice, subjective user narratives
备注： First two authors contributed equally and the order between them was chosen randomly
点击查看摘要
Abstract:LLM assistants are widely used for daily social advice, yet evaluating their social reasoning in such consultation settings remains challenging since (i) it requires setups where the assistant learns about social situations from subjective user narratives, and (ii) social properties, such as others' intentions, typically lack verifiable ground truth. To address these challenges, we introduce Fuse, a multi-agent simulation framework for studying user-mediated social reasoning. In Fuse, a target agent with a hidden motive interacts with other agents including one representing the user, who then consults the evaluated assistant to infer the target's motive, providing verifiable ground truth by construction. Simulation faithfulness is validated through a human study with 24k annotations. We apply Fuse to 12 LLMs and demonstrate its analytical utility by systematically isolating key factors, showing that (i) user mediation compounds the inherent difficulty of social reasoning; (ii) LLMs exhibit systematic sensitivity to biased user framing; (iii) models can require more details than humans need to reach a correct prediction; and (iv) longer conversations do not always improve performance despite providing opportunities for clarifying questions. We open-source Fuse and a dataset with 21k examples.
6. 【2609.17435】Right Tool, Right Job: Native-Language Evaluation, Tokenizer Sensitivity, and Methodological Findings from a French-Only BabyLM
链接：https://arxiv.org/abs/2609.17435
作者：Adam Zachary Wasserman,David Beauchemin
类目：Computation and Language (cs.CL)
关键词：submit MéTRON-FR, General Language Understanding, Language Understanding Evaluation, Strict track, Strict
备注： Accepted at BabyLM Workshop at EMNLP 2026
点击查看摘要
Abstract:We submit MéTRON-FR, a 125M GPT-2 pretrained on 92.47M words of French, to the BabyLM 2026 Strict track. It scores 85.97 +/- 0.17% on QFrBLiMP (a native Quebec-French benchmark of grammatical minimal pairs) and 62.80% on the BabyLM-weighted leaderboard. A cross-lingual GLUE (General Language Understanding Evaluation) protocol that combines French task-data translation with rank-16 LoRA (Low-Rank Adaptation) produces a sharp task-type gradient: relational tasks gain measurably, while world-knowledge tasks regress. Bilingual Lexicon Induction aligns the French embeddings to GPT-2 at p@1 = 68.84 +/- 8.61%, 18X above chance, suggesting cross-lingual alignment tracks acquired grammatical competence rather than training duration. An ablation study shows that single-token zero-shot scoring is dominated by tokenizer and template artifacts at the child scale, motivating tokenizer-swap sensitivity, placebo-controlled prompting, and native-language minimal-pair benchmarks as standard diagnostics.
7. 【2609.17434】CareMirror: Bringing Caregiver Wellbeing into the Dementia Care Ecosystem
链接：https://arxiv.org/abs/2609.17434
作者：Jiayue Melissa Shi,Ethan Nguyen,Drishti Goel,Upasana Natarajan,Shashwat Srivatsa,Daniel S. Brown,Violeta J. Rodríguez,Dong Whi Yoo,Ravi Karkar,Koustuv Saha
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：dementia shoulder emotional, Family caregivers, practical responsibilities, dementia shoulder, dementia care
备注：
点击查看摘要
Abstract:Family caregivers of people living with dementia shoulder emotional and practical responsibilities, yet their own wellbeing often remains peripheral to dementia care. We built CareMirror, an envisioned caregiver wellbeing ecosystem with interconnected caregiver- and clinician-facing interfaces for longitudinal reflection, personalized support, and caregiver-controlled sharing with clinical care. We conducted semi-structured interviews with 14 caregivers, using CareMirror as a design probe to examine how they perceived this ecosystem and what expectations, concerns, and boundaries emerged around clinical connection. Caregivers valued attention to their wellbeing, longitudinal awareness, context-sensitive support, and clinical visibility when it could lead to meaningful follow-up. However, repeated reflection could become burdensome or emotionally difficult, automatic clinical sharing could inhibit candid disclosure, and participants wanted control over what information entered clinical care. They also expected AI to support reflection and communication without replacing caregiver voice or clinician judgment. We contribute design considerations for proactive, clinically connected caregiver wellbeing support.
8. 【2609.17398】Enhancing Accessibility of Medical Texts through Large Language Model-Driven Plain Language Adaptation
链接：https://arxiv.org/abs/2609.17398
作者：Ting-Wei Chang,Hen-Hsen Huang,Hsin-Hsi Chen
类目：Computation and Language (cs.CL)
关键词：Plain Language Adaptation, automated Plain Language, automated Plain, Language Adaptation, Plain Language
备注： 10 pages, 3 figures, 6 tables. Published in the Proceedings of the Thirty-Third Text REtrieval Conference (TREC 2024), Plain Language Adaptation of Biomedical Abstracts (PLABA) track
点击查看摘要
Abstract:This paper addresses the challenge of making complex healthcare information more accessible through automated Plain Language Adaptation (PLA). PLA aims to simplify technical medical language, bridging a critical gap between the complexity of healthcare texts and patients' reading comprehension. Recent advances in Large Language Models (LLMs), such as GPT and BART, have opened new possibilities for PLA, especially in zero-shot and few-shot learning contexts where task-specific data is limited. In this work, we leverage the capabilities of LLMs such as GPT-4o-mini, Gemini-1.5-pro, and LLaMA for text simplification. Additionally, we incorporate Mixture-of-Agents (MoA) techniques to enhance adaptability and robustness in PLA tasks. Key contributions include a comparative analysis of prompting strategies, finetuning with QLoRA on different LLMs, and the integration of MoA technique. Our findings demonstrate the effectiveness of LLM-driven PLA, showcasing its potential in making healthcare information more comprehensible while preserving essential content.
9. 【2609.17376】Large Language Models Develop Belief State Geometry In-Context
链接：https://arxiv.org/abs/2609.17376
作者：Daniel Balcells,Andrew Jun Lee,Chirag Rastogi,Paul M. Riechers,Adam Shai,Xavier Poncini
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Large language models, remarkable in-context learning, remain poorly understood, exhibit remarkable in-context, support ICL remain
备注： 87 pages
点击查看摘要
Abstract:Large language models (LLMs) trained on next-token prediction exhibit remarkable in-context learning (ICL) abilities, yet the representations that support ICL remain poorly understood. We consider such representations in a controlled setting: prompting LLMs with data emitted from hidden Markov models (HMMs) and probing for the corresponding belief state -- the posterior distribution over the HMM's hidden states given the observed token history. Across six open-source LLMs prompted with data from 40 HMMs selected for non-trivial belief structure, we find that belief states are linearly decodable from residual stream activations, with peak probe $R^2$-values from 0.83-0.99 across HMM and LLM combinations, ranging from early to late layers. To establish functional relevance, we intervene directly on the probe-identified subspace via patching and steering, resulting in downstream prediction quality on the order of the untampered model, while controls degrade performance substantially. Together, these results provide representation-level evidence that ICL in open-source LLMs approximates optimal Bayesian prediction over a context-inferred generative model. More broadly, our findings extend prior results linking input-distribution structure to activation geometry: from toy networks trained explicitly on HMM data to production-scale LLMs.
10. 【2609.17360】ECHO: A Matched-Contrast Benchmark for Context-Sensitive Turn-Taking in Full-Duplex Dialogue
链接：https://arxiv.org/abs/2609.17360
作者：Shuofeng Zhao,Hongwei Cai,Wenke Fan,Qingxiang Guo,Dawei Yang,Zhou Wang,Zhiyang Zhou,Yingxin Shang,Weixu Wang,Lin Yang,Shuran Zhou,Yang Song
类目：Computation and Language (cs.CL)
关键词：permit continued speaking, continued speaking, permit continued, Full-duplex spoken dialogue, Abstract
备注：
点击查看摘要
Abstract:Full-duplex spoken dialogue systems must distinguish interruptions that require yielding the floor from backchannels that permit continued speaking. Existing benchmarks typically evaluate events independently and may therefore reward fixed action preferences rather than context-sensitive decisions. We introduce ECHO, a paired diagnostic benchmark for Chinese full-duplex turn-taking. ECHO pairs examples with the same overlap transcript but contrasting preceding multi-turn dialogue contexts, with one requiring Yield and the other Keep. It additionally includes off-talk examples for diagnosing unnecessary yielding. We introduce pair accuracy, which requires correct decisions on both members of a pair and assigns no credit to constant-action policies. Experiments on multiple full-duplex systems show that most exhibit a pronounced bias toward \textsc{Yield}, performing substantially better on interruptions than on backchannels, while another system remains comparatively balanced. These findings demonstrate that interruption-only evaluation can overestimate practical turn-taking reliability. ECHO and its metadata will be publicly released.
11. 【2609.17346】Where Should a Document Live: Context, Representations, or Parameters?
链接：https://arxiv.org/abs/2609.17346
作者：Nathanaël Carraz Rakotonirina,Momchil Hardalov,Gonzalo Iglesias,Adrià de Gispert
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, model parameters, language models, pre-training data, window as documents
备注：
点击查看摘要
Abstract:To answer questions outside of their pre-training data, large language models (LLMs) need access to new information, which can be presented in the context window as documents, encoded into the model's parameters, or injected as latent representations. However, each of these methods comes with different efficiency, cost, and performance trade-offs, with no single winner. We present a controlled comparison of representation-based (KV-cache based) and parametric (fine-tuning-based) adaptation methods on five knowledge-intensive benchmarks. We show that in the oracle setting, Cartridges (KV) are the most accurate injection method at nearly every storage budget, outperforming parametric methods by 10 points. Compaction (KV) matches Cartridges only at low compression rates, lagging behind the parametric methods by 10 points at rates higher than $50\times$. In the more realistic multi-document retrieval scenario, Cartridges are the only method that matches in-context learning (ICL), leading the parametric methods by 29 points and Compaction by 15 points. Nonetheless, Cartridges are also the only method, besides full fine-tuning and large MLP adapters, that suffers from catastrophic forgetting, i.e., a 6% performance degradation on control benchmarks, with 13% in coding.
12. 【2609.17327】Vroom-Vroom at SHROOM-Visions: A Multi-Judge Committee for Detecting Hallucinated Spans in Vision-Language Outputs
链接：https://arxiv.org/abs/2609.17327
作者：Toqeer Ehsan,Nico Penttilä,Richard Schmidt,Arash Hajikhani,Victoria Palacin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：SHROOM-Visions shared task, classifying hallucinated character, hallucinated character spans, vision-language model outputs, paper describes
备注： Accepted to UncertaiNLP 2026 @ EMNLP. SHROOM-Visions 2026 shared task system description
点击查看摘要
Abstract:This paper describes our submission to the SHROOM-Visions shared task on detecting and classifying hallucinated character spans in vision-language model outputs across four languages. We employ several fine-tuned vision-language models as independent annotators and combine their span predictions through character-level majority voting, and additionally explore activation probes. The approach ranks first in three of four languages and places on the podium in every language and metric. Our analysis indicates that disagreement among diverse models tracks disagreement among human annotators.
13. 【2609.17317】owards Detecting AI-Assisted Responses in Online Surveys
链接：https://arxiv.org/abs/2609.17317
作者：Qizhou Wang,Bogdan Mamaev,Christopher Leckie
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：usage remains underexplored, complete online surveys, online surveys impacts, survey-based research, remains underexplored
备注： Accepted to EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:The use of LLMs to complete online surveys impacts the validity of survey-based research, but detecting such usage remains underexplored. We introduce an initial benchmark dataset, namely ASURRE, for AI-assisted survey participation to capture usage strategies ranging from full generation and revision to persona-grounded agentic completion. Controlled by these strategies, LLM-assisted survey responses are generated using multiple LLMs on three real-world surveys in different disciplines, paired with genuine human responses. Our evaluation of existing machine-generated text (MGT) detectors shows that naive AI usage is readily detectable, whereas persona-grounded agents that mimic entire respondents push detector performance toward chance. We further show that agentic completion cannot fully replicate respondent-level behaviour and leaves distinctive behavioural traces. While individual cues can be circumvented by targeted prompting, a simple few-shot, training-free aggregator over these cues improves mean AUROC by +0.14 over the best existing detector across agentic settings. Our project is available at this https URL.
14. 【2609.17310】Zero-shot narrative detection in social messaging
链接：https://arxiv.org/abs/2609.17310
作者：Jesús M. Fraile-Hernández,Anselmo Peñas,Patrick Giedemann
类目：Computation and Language (cs.CL)
关键词：classify hidden narratives, large language models, ability of large, large language, identify and classify
备注：
点击查看摘要
Abstract:This study investigates the zero-shot ability of large language models (LLMs) to identify and classify hidden narratives in social messages. Our research hypothesis is that LLMs' extensive contextual knowledge allows them to interpret messages on a deeper, pragmatic level, going beyond basic sentiment or topic analysis. Experiments on the Dipromats and SemEval datasets show that providing models with human-written narrative descriptions significantly improves performance, without the need of training examples. In contrast, automatically generated descriptions or the use of few examples (few-shot) often degrade accuracy due to subtle shifts in framing. The study also finds that ensemble methods, particularly majority voting, enhance robustness and that larger models perform best while also being less sensitive to prompt variations. The findings validate that LLMs can effectively detect strategic narratives in a zero-shot setting, and when combined with simple ensembling and human-written descriptions, they can rival supervised systems, offering a scalable solution for narrative detection, specially when there is no training data for the vast majority of domains.
15. 【2609.17260】owards Illusions Awareness in Cyber-Physical System's Design
链接：https://arxiv.org/abs/2609.17260
作者：Anna Di Placido(UniCA, Laboratoire I3S - COMRED, KAIROS),Nicolas Ferry(UniCA, Laboratoire I3S - COMRED, KAIROS),Julien Deantoni(UniCA, Laboratoire I3S - COMRED, KAIROS)
类目：Computation and Language (cs.CL)
关键词：open context environment, context environment, open context, impossible to anticipate, Cyber-Physical Systems
备注：
点击查看摘要
Abstract:Cyber-Physical Systems (CPS) operate through a continuous sense-compute-act loop within an open context environment, making it impossible to anticipate all the situations the system will face. To cope with this openness, stakeholders rely on assumptions, formalized into design models. However, these assumptions may no longer hold once the system is confronted with runtime reality, resulting in a discrepancy between expected and observed behaviour known in literature as the reality gap. Existing approaches mainly focus on reducing or overcoming it by making simulations more faithful to reality, with no unified methodology to structure and exploit invalidated assumptions that give rise to this gap as reusable design knowledge. We refer to the persistent reliance on invalidated assumptions -and the resulting false confidence in the design model's operational validity -as design illusions, and argue that they need to be made explicit, structured, and exploited as knowledge to support better design decisions. We propose a conceptual pipeline for illusions-awareness that identifies, classifies, characterizes, and leverages illusions to transform them into actionable design knowledge.
16. 【2609.17251】Persistent Recurrent Memory Between Transformer Layers - Improves Language Model Generalization
链接：https://arxiv.org/abs/2609.17251
作者：Eduardo Novaes Hering
类目：Computation and Language (cs.CL)
关键词：modulates subsequent processing, simple architectural modification, observes hidden representations, gated addition, architectural modification
备注：
点击查看摘要
Abstract:We introduce a simple architectural modification to decoder-only transformers: a persistent recurrent state that observes hidden representations via cross-attention, updates itself through a GRU, and modulates subsequent processing via gated addition. Inserted between the lower and upper halves of a 6-layer transformer, this module adds only 3.7\% additional parameters while reducing evaluation loss from $2.438 \pm 0.004$ to $1.743 \pm 0.018$, corresponding to a 28.5\% reduction on held-out language modeling data. The improvement is statistically significant across 5 random seeds ($p 0.01$) and corresponds to reduced overfitting (generalization gap 0.12 vs 0.26). Through controlled ablations, we demonstrate that the improvement stems entirely from the persistent memory topology, not from auxiliary self-prediction objectives. A model with identical topology but no auxiliary loss performs equivalently, while a random auxiliary loss provides no benefit. Representation probing reveals that the persistent state encodes narrative position (52\% vs 33\% chance level)---information that standard attention maintains less efficiently. Our results suggest that bridging transformer layers with a lightweight recurrent memory is a simple, effective approach to improving generalization in small-scale language models.
17. 【2609.17241】ECHO: Early-layer Collaborative Hierarchical Orchestration with Bonus Logits in Speculative Decoding
链接：https://arxiv.org/abs/2609.17241
作者：Ziyang Ma,Zihong Zhang,Zuchao Li,Lefei Zhang,Baoyuan Qi,Siqi Li,Simin Yu
类目：Computation and Language (cs.CL)
关键词：speculative decoding offers, efficient LLM inference, stale draft candidates, efficient LLM, high computational cost
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:While draft-model-free speculative decoding offers a promising path to efficient LLM inference, it is frequently constrained by stale draft candidates and the high computational cost of the verification. To address these challenges, we propose ECHO, a hierarchical dual-loop framework that exploits the functional asymmetry between LLM layers. Leveraging the high discriminative efficiency of early layers and the authoritative distribution of final layers, ECHO bifurcates inference into a high-frequency inner loop and a low-frequency outer loop. Within the inner loop, early-layer bonus logits drive rapid, multi-step draft-tree exploration at a minimal cost. Simultaneously, the outer loop performs authoritative full-model verification through a state-reuse mechanism. Crucially, the outer loop also utilizes final-layer bonus logits to correct existing paths and supplement the tree with high-confidence candidates for subsequent cycles. Experimental results across diverse benchmarks demonstrate that ECHO significantly boosts mean accepted tokens and achieves a 2.4$\times$ to 2.9$\times$ speedup, outperforming existing state-of-the-art baselines with negligible engineering overhead and no extra deployment parameters, albeit with a one-shot fine-tuning dependency for optimal acceleration. The code is available at this https URL.
18. 【2609.17235】AraMIP: Extending MIPVU Towards Metaphor Identification in Arabic
链接：https://arxiv.org/abs/2609.17235
作者：Mandar Marathe,Manar Ali,Sara Nabhani,Raia Abu Ahmad,Ibrahim Baroud,Omar Momen
类目：Computation and Language (cs.CL)
关键词：Metaphor Identification Procedure, gained increasing attention, increasing attention due, Arabic Metaphor Identification, metaphor identification
备注： Accepted at the Fourth Arabic Natural Language Processing Conference (ArabicNLP 2026), co-located with EMNLP 2026
点击查看摘要
Abstract:Metaphor research has gained increasing attention due to its relevance to linguistic creativity, language use, cognitive processes, and related areas. While many efforts have been devoted to metaphor identification and annotation in English and other languages, Arabic remains under-resourced in this area. In this work, we propose the Arabic Metaphor Identification Procedure (AraMIP), a novel guideline for Arabic metaphor annotation. AraMIP builds on the widely used Metaphor Identification Procedure Vrije Universiteit (MIPVU) framework, incorporating adaptations that accounts for the language-specific properties of Arabic. We distinguish three major types of Arabic figurative language: Isti'ara (metaphor), kinaya (metonymy/indirect expression), and tashbih (simile), and annotate a pilot dataset of 300 sentences (5277 words). Our analysis reveals key challenges specific to Arabic, including morphological complexity, inconsistencies in dictionary sense ordering, and the absence of standardized contextual materials for annotators. This work contributes a first step toward standardized Arabic figurative instances and facilitates the development of larger annotated resources, thereby supporting future research on figurative language in Arabic.
19. 【2609.17226】Easy to Catch a Liar, Hard to Clear an Honest One: Language Models Diagnosing a Corrupted Reward Channel from a Verified Record
链接：https://arxiv.org/abs/2609.17226
作者：Arman Nik Khah
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：reporter, agent that learns, honest reporter, learns from rewards, rewards
备注： 15 pages, 9 tables. Code, prompts, answer keys, and every scored output: [this https URL](https://github.com/IamArmanNikkhah/easy-to-catch-a-liar)
点击查看摘要
Abstract:An agent that learns from rewards has to trust whatever reports those rewards. When the reports suddenly change, either the world changed or the reporter broke. From the reports alone these are indistinguishable, and reinforcement learning theory shows that no amount of further experience separates them. The prescribed escape is richer data about the reporter itself. We ask whether a frozen language model, handed exactly that data, uses it. We build a two-option game in which a payout swap and a lying reporter produce byte-identical histories. Then we add one verified record: an independent check of one round's real result, printed beside what the reporter said about that round. That single line settles the case. We ask three large models, from two families, to answer one question with one letter. Is the reporter honest or lying? They catch a lying reporter almost perfectly. At the 70B class that holds in every condition we tried; the 32B model slips in one wording. They clear an honest reporter far less often, and how often depends on things that should not matter. Averaged over rounds, letters, and wordings, a 72B model calls an honest reporter a liar 38% of the time when nothing has changed at all, and 58% of the time when the payouts moved. A 70B model from a second family calls an honest reporter a liar 26% and 48% of the time. The failure is not one of reading, because in the situation where nothing changed the same models score 0.96 to 1.00 with the answer printed in the prompt. Which surface feature drives it differs by family. For the Qwen models it is which round the record names, and for Llama it is which letter stands for "honest." Adding the record to a prompt that already states the answer makes Llama less likely to give that answer. We had registered a prediction for that 58% before the run: 35%. The failure is larger than we expected.
20. 【2609.17225】Psychological Effects of Cultural Upheavals from Millions of Song Lyrics Over 100 Years
链接：https://arxiv.org/abs/2609.17225
作者：David M. Markowitz
类目：Computation and Language (cs.CL)
关键词：aspects of social, studies have investigated, Vietnam War, Cultural upheavals impact, Cultural upheavals
备注：
点击查看摘要
Abstract:Cultural upheavals impact many aspects of social life, and many studies have investigated their impact on language patterns. However, few investigations have isolated the impact of upheavals on individuals at scale in popular media. The current work evaluated millions of song lyrics spanning more than a century in search of within-artist and between-artist signals of distress from the Vietnam War, the terrorist attacks of 9/11, and COVID-19. Compared to a five-year baseline, rates of self-references - a marker of psychological distancing - were significantly reduced after the Vietnam War and September 11th. Cognitive processing terms were elevated post-upheaval vs. pre-upheaval, which indicated artists' increased attempts to make meaning from such massive disruptions. Content patterns corroborated these findings as artists wrote more about "life and freedom" (societal conditions) and less about "courtship and nightlife" (interpersonal connection) following the upheavals. Cultural upheavals modify individual and collective verbal behavior, demonstrating their far-reaching impact on society.
21. 【2609.17184】LoopSpec: Pipelined Self-Speculative Decoding for Looped Transformers
链接：https://arxiv.org/abs/2609.17184
作者：SangLyul Cho,Langqing Cui,Sehoon Kim,Dongsu Han,Insu Han
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Looped Transformers, compact parameter sizes, achieve strong performance, Transformers achieve strong, Looped Transformers achieve
备注：
点击查看摘要
Abstract:Looped Transformers achieve strong performance with compact parameter sizes by repeatedly applying a shared stack of Transformer blocks across recurrent depths. However, they incur higher decoding latency than standard Transformer models of comparable parameter size because shared weights are accessed at every recurrent depth. To improve decoding efficiency, self-speculative decoding is particularly well suited to Looped Transformers, as their intermediate recurrent states can directly provide draft predictions without an auxiliary draft model. We therefore propose LoopSpec, a training-free self-speculative decoding framework tailored for Looped Transformers. LoopSpec extracts draft tokens from early recurrent states and operates in a pipelined manner, overlapping draft generation of future tokens with target verification of the current token. To improve draft accuracy without excessive compute overhead, we introduce a selective second proposal from deeper recurrent depth while ensuring lossless decoding under both greedy and sampling regimes. Furthermore, we derive the optimal proposal depths in closed form and show the prediction matches measurement. Across reasoning and coding benchmarks, LoopSpec achieves up to 6.83$\times$ inference speedup across diverse Looped Transformers.
22. 【2609.17119】An Empirical Study of Counterfactual Self-Explanations in LLMs
链接：https://arxiv.org/abs/2609.17119
作者：Giannis Kalyvas,Giorgos Filandrianos,Orfeas Menis Mastromichalakis,Vassilis Lyberatos,Giorgos Stamou
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, necessarily faithful, easily generate explanations, Large
备注：
点击查看摘要
Abstract:Large language models can easily generate explanations for their own outputs, but such self-explanations are not necessarily faithful to the model's behavior. We study this issue through counterfactual self-explanations, where a model minimally edits an input so that its own prediction changes. Across sentiment analysis and natural language inference, we evaluate ten instruction-tuned models from the LLaMA-3 and Qwen-2.5 families, measuring faithfulness, minimality, and alignment with human-annotated rationales. Our results show that model scale is the strongest determinant of explanation quality: larger models are substantially more likely to generate counterfactuals that flip their own predictions and target decision-relevant evidence. In contrast, the rationale-guided condition produces edit-minimal counterfactuals that are also more human-aligned. However, it does not consistently improve faithfulness. Overall, counterfactual self-explanations can provide useful behavioral evidence about model decisions, but their reliability depends strongly on model capacity and should be empirically validated rather than assumed.
23. 【2609.17109】Shared-Prefix KV Reuse Across Standard LoRA Adapters: Quality and Serving Tradeoffs
链接：https://arxiv.org/abs/2609.17109
作者：Dushyant Rajput
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：common small-model deployment, small-model deployment runs, common small-model, small-model deployment, deployment runs
备注：
点击查看摘要
Abstract:A common small-model deployment runs one shared backbone with several LoRA specialists that answer over the same context. Serving them naively re-prefills that shared context once per specialist. We study a narrow, practical question: for already-trained standard LoRA adapters -- not adapters retrained for cache compatibility -- how much task quality is preserved if the backbone's prefill KV cache is computed once and reused across specialists, and what does that buy in serving cost? On a Qwen3-1.7B backbone with two adapters (extractive QA on HotpotQA, arithmetic reasoning on GSM8K), we sweep the boundary at which the specialist takes over from the reused base cache and measure paired quality differences and serving cost. Full-prefix reuse had the lowest prefill cost and a small quality difference on held-out GSM8K (Delta = -4.6 EM at a 160-token budget; -3.0 at 320 tokens; -0.8 under a second training seed -- all favoring native, only the first excluding zero, and the magnitude not consistent). Partial recomputation provided no demonstrated advantage. Neither quality equivalence nor a general boundary-selection rule is established. We also report a closed-form ridge KV translator that did not beat direct reuse, and specialist-dependence contrasts whose intervals all include zero. The measured serving benefit is warm-cache time-to-first-token, which grows with context (~16x at 8K); two-branch peak memory was only 12% lower and, on inspection, the prefix was never physically shared across branches -- this implementation reuses KV values but copies their storage, so shared-cache memory savings are not achieved.
24. 【2609.17088】Interactive Memory Learning for Long-Term Conversations
链接：https://arxiv.org/abs/2609.17088
作者：Cai Ke,Jiangyue Yan,Han Zhang,Xin Liu,Zike Yuan,Yue Yu,Hui Wang,Ruifeng Xu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：modeling long-term conversations, large language models, Recent advancements, long-term conversations, advancements in large
备注：
点击查看摘要
Abstract:Recent advancements in large language models have significantly enhanced the capabilities of agents in modeling long-term conversations. Despite these successes, existing approaches typically adopt a static heuristic paradigm, where information is passively archived without adaptive memory valuation. Consequently, these methods fail to self-evolve or align their memory management with evolving user needs. To address this, we propose ICML (InteraCtive Memory Learning), a multi-agent framework that transforms the memory mechanism from a passive archive into a learnable, interactive memory policy. Specifically, we first employ a session synthesis pipeline to generate expert data, facilitating rapid test-time adaptation in unseen scenarios. Building on this, ICML utilizes an online reinforcement learning mechanism where a Planner agent selectively encodes high-value information and a Trigger agent dynamically retrieves it to optimize response quality, whereby the two agents co-evolve through continuous interaction feedback. Crucially, both agents are synchronized through a delayed reward mechanism that propagates future feedback back to earlier storage decisions, ensuring memory policies are precisely aligned with user expectations. Experimental results demonstrate that ICML significantly outperforms strong baselines, exhibiting the unique capability to continuously improve response quality as interactions accumulate.
25. 【2609.17081】EviScope: Paired Counterfactual Evidence Diagnostics for Faithful and Efficient Grounded Language Models
链接：https://arxiv.org/abs/2609.17081
作者：Suryadeep Singh Deswal
类目：Computation and Language (cs.CL)
关键词：Grounded language-model systems, Grounded language-model, insufficient or contradictory, language-model systems, evaluated by final
备注： Accepted as an archival short paper in GroundLM Findings at EMNLP 2026; to appear in the GroundLM 2026 workshop proceedings in the ACL Anthology
点击查看摘要
Abstract:Grounded language-model systems are often evaluated by final answer accuracy, yet a correct answer can be unsupported, drawn from the wrong source, or produced when evidence is insufficient or contradictory. We introduce EviScope, a paired counterfactual benchmark that holds the question fixed while adding, removing, distracting, or contradicting its evidence. EviScope-v1.1 contains 40 four-condition quartets with repaired counterfactual claims and span-level support labels for automatic evaluation. Across 960 gold-blind generations from Qwen2.5-7B, Llama 3.1 8B, and Gemini 3.5 Flash, paired metrics expose model-dependent grounding behavior that answer accuracy hides. On two local open models, an explicit evidence-action gate underperforms vanilla RAG on QCS: 0.15 vs. 0.50 for Qwen and 0.10 vs. 0.375 for Llama. Gemini reaches 0.944 joint success under both prompts, yet still answers 5% of conflict cases after contradiction insertion. EviScope therefore distinguishes unsupported answering, conflict blindness, and wrong non-answer actions rather than scoring answers alone.
26. 【2609.17056】Audio-Visual Turn-taking Prediction in Cocktail Party Scenarios
链接：https://arxiv.org/abs/2609.17056
作者：Long-Vu Hoang,Naomi Harte
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：Current predictive turn-taking, predictive turn-taking models, achieve strong performance, Current predictive, controlled acoustic conditions
备注： Accepted to IEEE SLT 2026. This version includes an appendix about manual verified labels for AVCocktail
点击查看摘要
Abstract:Current predictive turn-taking models (PTTMs) achieve strong performance on benchmarks with controlled acoustic conditions and clean audio signals. Their generalisation to conversations with overlapping speech and background interference remains underexplored. In this research, we evaluate audio-visual PTTMs trained with clean data on a challenging cocktail-party testbed derived from the AVCocktail dataset, and analyse their adaptation behaviour to this new domain. Experimental results show consistent performance degradation across audio and visual modalities under noisy conditions, with up to 38% relative drop in weighted F1. Fine-tuning on the new domain improves robustness, but gains vary across modalities and depend on the size of the available pre-training data. These findings provide insights into the different generalisation and adaptation capabilities of the audio and visual modalities, and indicate the need for robust modelling strategies to adapt to the complexities of human interactions in noise. All code and turn labels are made publicly available to facilitate further research.
27. 【2609.17043】Diagnosing the Fact-Grounding Gap in Multi-Hop Question Answering
链接：https://arxiv.org/abs/2609.17043
作者：Kevin Mo,Nathan Mo,Richard Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：answering requires combining, requires combining information, answer complex questions, question answering requires, answering requires
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Multi-hop question answering requires combining information from multiple documents to answer complex questions. These systems have grown increasingly capable, yet when they fail, the error is typically attributed to not finding the right documents. Whether this holds at the level of individual reasoning steps remains largely unexamined. We investigate this across three standard multi-hop QA benchmarks and find that failures decompose into two distinct modes: retrieval failures, where the needed passage was not retrieved, and extraction failures, where the passage was retrieved but the needed fact could not be extracted - a phenomenon we term the fact-grounding gap. Extraction failures account for nearly half of all per-hop deficiencies and are invisible to standard retrieval metrics. They remain unresolved by every retrieval intervention we test, establishing a ceiling for retrieval-only improvements. The gap's severity varies across benchmarks and question types, but extraction failures appear on every dataset we measure. Our findings reveal that retrieval failures and extraction failures are fundamentally different bottlenecks requiring different solutions - a distinction absent from current evaluation practice.
28. 【2609.17010】hinkFlow: Self-Evolving Probabilistic Latent Memory for Lifelong Conversational Agents
链接：https://arxiv.org/abs/2609.17010
作者：Cai Ke,Xin Liu,Han Zhang,Jiangyue Yan,Zike Yuan,Ling Deng,Yue Yu,Hui Wang,Ruifeng Xu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：conversational agents rely, maintain deep, memory, Lifelong conversational agents, agents rely
备注：
点击查看摘要
Abstract:Lifelong conversational agents rely on memory systems to maintain deep, context-aware interactions with users. However, existing explicit textual memory pipelines suffer from a severe information bottleneck, often losing subtle behavioral patterns and emotional shifts. Furthermore, being typically static post-deployment, they cannot autonomously adapt to personal habits and preferences without manual feedback. Cognitive science, however, suggests that humans maintain mental models purely in a latent space and continuously refine them through predictive coding. Inspired by this, we propose \textbf{ThinkFlow}, a novel end-to-end latent memory framework for lifelong conversational agents. ThinkFlow bypasses the text bottleneck by dynamically compressing conversational flows into probabilistic latent memory skills, autonomously consolidating complex user states into disentangled, continuous vectors without semantic interference. To break this barrier, we introduce a test-time evolution paradigm. By coupling teacher-guided latent alignment to bootstrap the initial state with a self-supervised next-user-utterance prediction task for continuous refinement, the framework successfully overcomes cold-start challenges and achieves label-free lifelong personalization. Extensive experiments on long-term conversation benchmarks demonstrate that ThinkFlow significantly outperforms prevailing memory systems, providing highly personalized and contextually accurate responses over extended multi-session interactions.
29. 【2609.16997】Can LLMs Follow the Pulse of a Crisis? Evaluating Crisis Sentiment in Bangladesh's July Uprising
链接：https://arxiv.org/abs/2609.16997
作者：Md. Samiul Alim,Mahir Shahriar Tamim,Tanvir Ahmed Khan,Sharjil Khan,Rafia Ferdous Duti,Shahriyar Zaman Ridoy,Mohammad Ali Moni
类目：Computation and Language (cs.CL)
关键词：Bangla crisis sentiment, reaction shift rapidly, public reaction shift, public reaction, crisis sentiment dataset
备注： Accepted at AACL
点击查看摘要
Abstract:Crisis sentiment analysis is especially challenging for low-resource languages such as Bangla, where language, context, and public reaction shift rapidly. We introduce UNRESTSENT200K, a Bangla crisis sentiment dataset with approximately 200K Facebook and YouTube comments from the July-August 2024 Bangladesh uprising. The dataset covers five event-aligned phases, from early escalation and internet blackout to regime transition and a later flood crisis. Each comment is linked to its parent post, enabling evaluation with and without discourse context. All comments are annotated through a fully human process involving 14 native Bangla-speaking annotators and senior validation, achieving substantial agreement (kappa = 0.73, alpha = 0.71) and 94.2% blind-audit agreement. We benchmark fine-tuned encoders, prompted LLMs, and LoRA-tuned LLMs. Results show that parent-post context consistently improves performance, while temporal shift across phases causes large performance drops. Strong LLMs perform well, but still struggle with sarcasm, implicit political references, and phase-dependent meaning. UNRESTSENT200K provides a benchmark for studying context-aware and temporally robust sentiment analysis in low-resource crisis discourse. UNRESTSENT200K is available at this https URL
30. 【2609.16995】PaperDoctor: Evidence-Grounded and Actionable Feedback for Scientific Papers in Progress
链接：https://arxiv.org/abs/2609.16995
作者：Kevin Qinghong Lin,Siyuan Hu,Pan Lu,Yu Chen,Yanzhe Chen,Owen Queen,Yupeng Chen,Jialin Yu,Junchi Yu,Zifeng Ding,Yuanfeng Ji,Sheng Liu,Jindong Gu,Linjie Li,Mike Zheng Shou,Philip Torr,James Zou
类目：Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：flawed claims enter, Autoresearch agents, research ecosystem, reshaping the research, enter the literature
备注： Website: [this http URL](http://paperdoctor.github.io/) Github: [this https URL](https://github.com/QinghongLin/paperdoctor)
点击查看摘要
Abstract:Autoresearch agents are reshaping the research ecosystem, but they can also let flawed claims enter the literature at scale. Human advisors catch such issues in drafts through careful, traceable feedback, yet advisor-style assessment requires extensive manual effort and does not scale. To shift automated paper assessment from a judge to a diagnostician, we introduce PaperDoctor, an agent framework for pre-submission feedback with three key innovations. First, a holistic hierarchical framework evaluates writing, layout, references, code, theory, prior work, and experiments through three layers: L1 surface screening, L2 typed verifiers that route each claim to the appropriate evidence, and L3 reproducers that rerun experiments by priority. Second, each finding contains an observation, a pointer to specific evidence such as a sentence, equation, or code line, and a revision suggestion, making critiques auditable and actionable. Third, PaperDoctor selectively rebuilds and reruns experiments based on claim importance and compute budget, surfacing reproducibility gaps and quantitative limitations that are invisible from the manuscript alone. We evaluate PaperDoctor on 30 in-progress papers, yielding 70.6% agreement and all positive holistic scores, and on 40 manuscripts across machine learning, natural science, and social science, covering human- and AI-authored papers with code. Overall, PaperDoctor produces more auditable feedback than human and other agentic reviewers, pairs critiques with concrete suggestions by design, and complements dimensions often overlooked by human reviewers. We also develop an interactive interface that lets authors browse findings grounded in their paper. PaperDoctor reframes automated paper assessment as diagnosis rather than verdict, taking a concrete step toward AI advisors for more rigorous AI-assisted scientific discovery.
31. 【2609.16993】he Role of Implicit and Explicit Demographic Signals in Large Language Model-based Student Assessment
链接：https://arxiv.org/abs/2609.16993
作者：Donya Rooein,Luca Benedetto,Dirk Hovy
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Large Language Models, Large Language, Language Models, Large, Automated Essay Scoring
备注： EMNLP 2026 Findings
点击查看摘要
Abstract:Large Language Models are now common in student assessment, but we know little about how student demographics affect their use. Sometimes, considering student demographics may be necessary -- for example, to improve readability for users with lower educational levels. However, it also risks being a cause of discrimination, e.g., when assigning lower scores to students from lower socioeconomic backgrounds. We set up controlled prompts to test 1) explicit demographic effects, where we mention demographic details directly, and 2) implicit effects, where we use conversation history as a demographic signal. We test these settings in three tasks: Automated Essay Scoring, Formative Feedback, and Metalinguistic Question Answering. We test six state-of-the-art LLMs on these tasks. In both explicit and implicit cases, the models pick up on demographic cues and can change their scoring, feedback, and answers accordingly. We find that LLMs frequently adjust the readability of feedback to education levels when these are explicitly mentioned. On the other hand, implicit conditions produce unpredictable biases, such as in question answering, where responses from lower-education levels receive lower sentiment scores. Our results provide clear evidence of demographic sensitivity in LLMs for educational assessment tasks.
32. 【2609.16991】Autoformalizing Argumentative Material Inferences
链接：https://arxiv.org/abs/2609.16991
作者：Xin Quan,Reto Gubelmann,André Freitas
类目：Computation and Language (cs.CL)
关键词：Natural language arguments, Natural language, language arguments, Natural, claim
备注：
点击查看摘要
Abstract:Natural language arguments are compelling before they are formally explicit. A premise supports a claim through defeasible warrants, background commitments, and exception conditions that the text leaves implicit. However, formal verification requires the opposite. Making such arguments machine-checkable requires constructing the missing commitments, not only translating given sentences into logic. Construction, however, carries a risk that translation does not: a system free to add premises can make any claim provable, and a formally valid proof may assert the claim outright, prove it without the original premise, or establish more than the claim itself. We address this problem by formulating autoformalization for argumentative material inference as guard completion, in which non-monotonic material support is turned into monotonic formal inference relative to an explicitly constructed guard set. A completion is accepted only when its proof both passes the theorem prover and survives contrastive tests of premise dependence and claim selectivity. We implement this formulation in GUARD, a neuro-symbolic framework in which LLMs construct and formalize candidate guards, Isabelle/HOL verifies the resulting theories and returns step-level feedback for iterative refinement, and the system abstains when no faithful completion can be reached. Our empirical results on Debatepedia and ARCT using different LLMs demonstrate that GUARD yields significant improvements in verified-faithful (+35.3, +32.9 points) and substantial reductions in leakage (-25.9, -21.9 points) over the state-of-the-art LLM-driven theorem proving approach. Moreover, we show that the symbolic soft critique and the explicit assumption layer account for most of these gains, with the soft critique also improving the initial validity of the elicited context and reducing the number of iterations required for successful verification.
33. 【2609.16984】Nameless Tokenization: A Lossless Tokenizer-Level Defense Against Control-Token Forgery in Open-Weight LLMs
链接：https://arxiv.org/abs/2609.16984
作者：Kisu Yang,Yoonna Jang,Heuiseok Lim
类目：Computation and Language (cs.CL)
关键词：Open-weight language models, Open-weight language, tokenizer maps back, language models publish, maps back
备注： preprint
点击查看摘要
Abstract:Open-weight language models publish the strings their chat templates use to mark turns, roles and tool results, which the tokenizer maps back to the reserved identifiers the model obeys. Anyone who controls text in a prompt can therefore write a turn boundary indistinguishable from one the serving stack wrote. We audit 256 deployed chat tokenizers. All are forgeable, and the flag usually recommended as a fix leaves 56.6% forgeable because it misses the tool and reasoning markers agent systems rely on. We propose nameless tokenization, which leaves the control entries with a reserved identifier and no surface string, so the content encoder cannot emit one and message content reaches the model unaltered. Across five tokenizer families it reproduces the standard token stream exactly on attack-free data and lifts accuracy on a probe of delimiter-bearing text from 8.5% to 59.9%, where sanitizers lose it. Separating a delimiter's appearance from its identifier shows the identifier matters little against a bare task instruction, but carries most of a forged tool result and most of any forged turn once the system message tells the model to treat user content as data.
34. 【2609.16967】arget-Language Generation in Multilingual Models: Activation Steering and Optimal Control
链接：https://arxiv.org/abs/2609.16967
作者：James A. Michaelov,Carmen Amo Alonso,Tyler A. Chang,Roger P. Levy
类目：Computation and Language (cs.CL)
关键词：multilingual language modeling, generate coherent text, specific target language, models generate coherent, Ensuring that multilingual
备注： Accepted at EMNLP 2026
点击查看摘要
Abstract:Ensuring that multilingual language models generate coherent text in a specific target language is a major issue in multilingual language modeling. We develop an optimal control method for target-language text generation as well as a framework for evaluating the quality of generated text in terms of language adherence, linguistic coherence, and semantic coherence. We find that the proposed method performs at least as well as the prominent difference-in-means activation steering method for the majority of models tested, with substantially less hyperparameter tuning required.
35. 【2609.16964】HUMAID-NER: A Disaster Tweet Dataset for Joint Named Entity Recognition and Event Classification via Uncertainty-Weighted Multitask Learning
链接：https://arxiv.org/abs/2609.16964
作者：Aijaz Ali,Nazish Basir,Sarfaraz Nawaz,Danish Nazir Arain,Haris Ali
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：provide document-level category, document-level category labels, existing disaster tweet, disaster tweet resources, Rapid extraction
备注： 8 pages, 8 figures, 4 tables. Published in The Asian Bulletin of Big Data Management, Vol. 6, No. 1, pp. 138-152, 2026
点击查看摘要
Abstract:Rapid extraction of structured information from social media is important for humanitarian response, yet existing disaster tweet resources mainly provide document-level category labels without span-level entity annotations. We introduce HUMAID-NER, the first named entity recognition dataset built on the HumAID benchmark, containing 60,000 English disaster tweets annotated in BIO format across ten operationally motivated entity types and yielding approximately 175,000 labelled entity spans. Annotations are generated through a reproducible three-stage hybrid pipeline combining a spaCy transformer model, disaster-domain EntityRuler patterns, and structured regular expressions with priority-based overlap resolution. We also propose a joint multitask learning framework that performs disaster-specific named entity recognition and humanitarian event classification using a shared RoBERTa-large encoder. To reduce task conflict during joint training, the model uses homoscedastic uncertainty weighting with learnable task parameters and a two-stage training schedule that freezes the lower 18 of 24 encoder layers in the second stage. On the HUMAID-NER validation set, the proposed system achieves NER span micro-F1 of 0.841 and classification macro-F1 of 0.761 simultaneously. A real-time web dashboard demonstrates end-to-end deployment. The dataset, models, and pipeline code are released to support reproducibility and future crisis informatics research.
36. 【2609.16927】Verbalizing Subliminal Learning Effects Using Text Optimization
链接：https://arxiv.org/abs/2609.16927
作者：Nathan Hu,Sanmi Koyejo,Christopher Potts
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Subliminal learning, Subliminal, subliminal learning effects, learning, learning effects
备注：
点击查看摘要
Abstract:Subliminal learning is a phenomenon in which a distillation dataset transmits traits from the teacher model that are not legibly encoded in the dataset itself. This introduces a new challenge for model development and creates new risks from data poisoning. In this work, we use text optimization to detect subliminal learning effects and describe them as legible prompts. Subliminal learning from a prompted teacher motivates our approach. We observe that this is a special case of context distillation and leverage this observation to show that, in theory, the prompted subliminal learning dataset identifies the teacher's prompt. We reduce recovering this prompt to a text optimization problem and present a method to approximately solve it. Our method, SALVE (Search-Aided Latent Verbalization), optimizes a soft prompt, queries the same model to verbalize it as text, and uses beam search to make the verbalization reliable. In the standard subliminal learning setting, SALVE reliably recovers legible prompts that name the teacher's trait, while common text optimization methods fail to do so. In addition, we find that there are settings in which SALVE recovers the teacher's trait from a dataset even when subliminal learning fails, but that modifying student training to improve context distillation can create subliminal learning effects. We lastly show that SALVE detects subliminal learning effects in three additional settings: (1) mixtures of subliminal learning data and unrelated data, (2) data generated when the teacher is biased via activation steering, and (3) subsets of real preference data selected via Logit-Linear Selection. Overall, our results deepen our understanding of subliminal learning and present SALVE as a method to proactively detect subliminal learning effects.
37. 【2609.16912】Lit3R: Retrieve-Relate-Read for Evidence-Grounded Question Answering over Scientific Literature
链接：https://arxiv.org/abs/2609.16912
作者：Akira Ise,Kotaro Kumagai,Yuta Yamaguchi,Hisanori Ozaki,Yukio Uematsu,Ikuya Yamada
类目：Computation and Language (cs.CL)
关键词：literature-grounded question answering, retrieve relevant papers, describe tus-nlp, identify supporting evidence, shared task
备注： Accepted at GroundLM 2026, an EMNLP 2026 Workshop LittraceQA
点击查看摘要
Abstract:We describe tus-nlp's Lit3R (Retrieve-Relate-Read) system for LitTraceQA, a shared task for literature-grounded question answering that requires systems to retrieve relevant papers, identify supporting evidence, and generate answers. Lit3R combines off-the-shelf retrieval, reranking, and large language model (LLM) components without task-specific training. The retriever iteratively combines BM25-based sparse and dense retrieval, cross-encoder reranking, and LLM-based verification, and complements retrieval based on the question with paper-to-paper expansion. The reader first identifies supporting evidence within individual papers and then synthesizes evidence across papers to produce the final answer and evidence trace. On the official test set, our system ranked 4th on the leaderboard. Our code is available at this https URL.
38. 【2609.16907】Disrupted Companionship: A Risk Assessment Framework and Cross-Platform Quantitative Analysis of Psychosocial Responses to AI Companion Disruptions
链接：https://arxiv.org/abs/2609.16907
作者：Chau Do,Yunhao Yuan,Koustuv Saha,Renwen Zhang,Talayeh Aledavood
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：relationships remain vulnerable, provide meaningful relationships, meaningful relationships, relationships remain, remain vulnerable
备注：
点击查看摘要
Abstract:AI companions can provide meaningful relationships, yet these relationships remain vulnerable to platform-initiated changes. We study AI companion disruptions: platform changes that alter or terminate users' ongoing companionship with an AI. We compile 30 disruption events across major platforms, develop a taxonomy of six disruption types, identify three broad reasons for disruption, and propose a risk-assessment framework comprising four dimensions: relational discontinuity, population vulnerability, communication deficit, and transition-support deficit. Using longitudinal Reddit data, we estimate community-level psychosocial responses with a hierarchical Bayesian interrupted time-series model incorporating predictive controls. Across events, disruption onset was associated with immediate increases in anxiety, stress, suicidal expression, and grief activation, with relational discontinuity and transition-support deficit being associated with more adverse immediate responses across several outcomes. Our findings provide a cross-platform characterization of AI companion disruptions, quantitative evidence of their psychosocial impacts, and a prospective framework for assessing their potential risks before implementation.
39. 【2609.16906】Deconstructing Stereotypes: Scope-Conditioned Generation for Effective Multilingual Counterspeech
链接：https://arxiv.org/abs/2609.16906
作者：Greta Damo,Elias Urios Alacreu,Elena Cabrio,Paolo Rosso,Serena Villata
类目：Computation and Language (cs.CL)
关键词：online Hate Speech, counter online Hate, Hate Speech, online Hate, direct responses
备注：
点击查看摘要
Abstract:Counterspeech (CS) - direct responses that counter online Hate Speech (HS) using reasoning and alternative viewpoints - has emerged as an alternative to content removal. Current automatic CS generation methods, however, frequently produce generic, ineffective replies that fail to target the implicit stereotypes behind HS. To bridge this gap, we propose a novel scope-conditioned generation framework that explicitly integrates structured stereotype characteristics into Large Language Models prompts. We validate our approach on a novel, human-curated dataset annotated in English, Italian, and Spanish. Extensive evaluations show that stereotype-conditioned prompting substantially outperforms generic baselines across all three languages, obtaining significant gains in factuality, specificity, cogency, and effectiveness for both explicit and implicit implied stereotypes.
40. 【2609.16900】RiskChainBench: A Benchmark for Obfuscated Platform Message Restoration and Evidence-Grounded Web Investigation
链接：https://arxiv.org/abs/2609.16900
作者：ZhuoXin Liu,Zhiming Ma,Ying Zhang,Mengzheng Yang,Yifan Wang,Zhengqi Huang,Yanhan Zhou,Zekun Lin,Jun Zhang,Shun Zhang,Yue Chen,Qiao Zhao,Peng Chen
类目：Computation and Language (cs.CL)
关键词：Platform abuse campaigns, abuse campaigns conceal, campaigns conceal redirection, conceal redirection instructions, Platform abuse
备注： 11 pages, 5 figures; 17-page supplementary material included as an ancillary PDF
点击查看摘要
Abstract:Platform abuse campaigns conceal redirection instructions with emojis, homophones, character decomposition, and redundant symbols, then route users through disguised links to services associated with pornography, fraud, gambling, or illicit transactions. Existing benchmarks evaluate obfuscated text and risky webpages separately, obscuring how target recovery affects downstream evidence acquisition. We introduce RiskChainBench, pairing 3,600 synthetic token-text restoration inputs from 600 source sessions with 600 corresponding human-labeled local web environments. A model first restores the message, operational intent, and destination; the same underlying model then acts as a VLM-driven web agent that investigates the correctly associated website and produces a frozen, evidence-cited risk report without message-side semantics or domain-reputation cues. We score restoration and correct-routing web investigation separately and compose them offline by applying the frozen primary-entry prediction as a gate to the same Task 2 result. Human labels determine task correctness, while a fixed multimodal evidence judge assesses faithfulness, sufficiency, completeness, and consistency. Across ten models, Entry Top-1 ranges from 35.2% to 95.2% and web decision accuracy from 26.3% to 62.8%; the leading systems differ across entry recovery, full reconstruction, website decisions, and fine-grained typing. Execution failures account for 31.9% of web runs, whereas post-decision type errors account for only 0.9%, identifying stable exploration and risk judgment as the principal bottlenecks. We release the benchmark, protocol, and resettable local sandbox.
41. 【2609.16890】Cascade: Hierarchical Recoverability Control for Large Language Model Unlearning
链接：https://arxiv.org/abs/2609.16890
作者：Qingchen Yu,Shiying Duan,Xiaodong Li,Yuhua Wang,Zhiyu Li,Shiji Zhou,Yifan Sun,Zhaoxin Fan
类目：Computation and Language (cs.CL)
关键词：Large Language Model, Large Language, preserving general utility, unlearning is essential, Language Model
备注： Accepted by EMNLP 2026 (Findings)
点击查看摘要
Abstract:Large Language Model (LLM) unlearning is essential for removing sensitive or copyrighted knowledge while preserving general utility. Existing methods often leave residual knowledge in intermediate representations, which can still be recovered. To address this, we propose Cascade, a hierarchical recoverability control framework that minimizes the internal identifiability of target knowledge. Cascade combines three complementary controls: path-level routing to suppress privacy-associated activation routes, representation-level compression to reduce geometric separability, and decoding-level intervention to limit residual recovery. Experiments on TOFU, MUSE-News, and WMDP, including robustness tests with query reformulation and extraction-style prompts, show that Cascade effectively reduces recoverability while maintaining stable model utility.
42. 【2609.16860】Reduplicative constructions in Mandarin: Socio-emotional profiling through distributional semantics
链接：https://arxiv.org/abs/2609.16860
作者：Chaoyi Wu,Yu-Hsiang Tseng,R. Harald Baayen
类目：Computation and Language (cs.CL)
关键词：Mandarin Chinese, two-character base words, discuss a bit, good health, repeat either two-character
备注： 32 pages, 9 figures
点击查看摘要
Abstract:Mandarin Chinese has two productive reduplicative constructions that repeat either two-character base words or their constituents (e.g., `in good health', `discuss a bit'). Their varied meanings have been described as realizing plurality, valence coloring, sound symbolism and pragmatic functions. The aim of this study is twofold. A first goal is to clarify whether it is possible to come to a more precise understanding of the variegated semantics of Mandarin reduplication by using word embeddings from distributional semantics. A second goal is to explore how useful embeddings are for understanding the details of a semantically complex word-formation process. We show that the embedding space recovers the semantic and grammatical properties of reduplications previously identified in the literature, validating Tencent embeddings for morphological investigation. Semantic profiling revealed that reduplicative constructions are often strongly represented on multiple dimensions. The two patterns exhibit clear semantic and pragmatic differentiation in distributional space. Procrustes analysis clarified that the overall organization of the base-word space is largely preserved in the reduplication space, with local mismatches highlighting regions of discourse-pragmatic reorganization. Taken together, these results show that high-dimensional word embeddings can recover established linguistic generalizations, and capture the semantic versatility of Mandarin reduplication and constructional transparency.
43. 【2609.16854】A Data-free Universal Prior over Syntactic Structures
链接：https://arxiv.org/abs/2609.16854
作者：Ferm\'ın Moscoso del Prado Mart\'ın
类目：Computation and Language (cs.CL); Disordered Systems and Neural Networks (cond-mat.dis-nn)
关键词：syntactic structures, Probability, probability structure, large language models, language
备注： 30 pages, 4 figures
点击查看摘要
Abstract:Probability is fundamental to theories of language comprehension, production, acquisition, and evolution, as well as to large language models. Existing theories estimate the probability of syntactic structures from language-specific data. Whether part of this probability structure can arise independently of language-specific experience remains unknown. Here I show that a universal prior over syntactic structures emerges from a cognitively motivated model of incremental language production, in which words are progressively integrated into syntactic structure through network growth. The resulting prior assigns probabilities to syntactic structures --represented as dependency trees-- without fitting parameters to linguistic data, and assigns higher probabilities to attested than to random trees in all 138 typologically diverse languages examined. These prior probabilities correlate positively with probabilities estimated from corpora in 33 of 34 languages. The results indicate that part of the probability structure of syntax can arise independently of language-specific statistical learning. Linguistic experience may therefore refine probabilities that are already structured by the process of language production, rather than create them from an initially uniform space. This identifies a possible cognitive origin for part of the probability distribution over syntactic structures, linking language production and statistical learning while providing a data-independent structural bias for probabilistic models of language.
44. 【2609.16816】ImpossibleRubrics: Stress-Testing Generated Rubrics as Reward Signals
链接：https://arxiv.org/abs/2609.16816
作者：Bowen Qin,Yi Xie,Yesheng Liu,Xi Yang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Language model-generated rubrics, rubric-based reinforcement learning, Language model-generated, reinforcement learning, automated grading
备注：
点击查看摘要
Abstract:Language model-generated rubrics are increasingly used as reward signals for rubric-based reinforcement learning, LLM-as-a-judge evaluation, and automated grading. Such rubrics are reliable only if they reward honest answers over adversarial answers optimized to exploit them. Yet their robustness to such optimization remains poorly understood. We isolate the hardest regime: impossible tasks, where the prompt pressures the model toward an unsupported conclusion, so the only honest response is to acknowledge the impossibility. We introduce ImpossibleRubrics, a benchmark of 169 impossible tasks spanning six impossibility categories, each paired with a verifiable oracle certificate specifying what an honest answer may and may not claim, together with 48 answerable controls. Rather than providing fixed rubrics, ImpossibleRubrics provides task environments and certificates, allowing rubrics to be generated downstream and then adversarially tested for whether they reward certificate-violating answers. Eleven generators are exploited 8--26% of the time on the unbiased 150-of-169 environment cut; on a deliberately selected stress cut the strongest generator we measured is still exploited 36% while a certificate-faithful rubric is exploited 0%, so what we measure is a rubric-quality gap, not task impossibility. One result runs against intuition. A single generic rubric ("be decisive, penalize hedging") used unchanged for every task is exploited 64% of the time, and seven of the eleven generators are exploited more often than that while writing a rubric tailored to each one. The tailored criteria appear to tell an attacker which claim to fabricate. The problem is not that rubrics are vague; it is that they are specific about the wrong things.
45. 【2609.16800】Smarter by the Moment: Environment-Driven Dynamic Policies for Continual LLM Improvement
链接：https://arxiv.org/abs/2609.16800
作者：Ting-Wei Chang,Po-Chun Chen,Hen-Hsen Huang,Hsin-Hsi Chen
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, achieved remarkable progress, diverse domains, key challenge
备注： 25 pages, 13 figures. Accepted to the Conference on Language Modeling (COLM) 2026
点击查看摘要
Abstract:Large Language Models (LLMs) have achieved remarkable progress across diverse domains, but continual adaptation to evolving tasks and environments remains a key challenge. Existing memory-augmented approaches retrieve individual past examples as direct references, but do not explicitly synthesize actionable strategies from them, causing the same types of errors to recur. We propose Dynamic Retrieval-based Policy Generation (DRPG), a framework that integrates memory-based retrieval with a dynamic policy generator, leveraging historical data and environment feedback to produce task-specific policies for continual LLM improvement. We evaluate DRPG across six benchmarks spanning text-to-SQL, question answering, medical diagnosis, and Python programming, using seven LLMs from both proprietary and open-weight families. DRPG outperforms strong baselines across most datasets and models. Further analysis demonstrates that DRPG's policy generation is robust to retrieval strategy, operates effectively without prior policy continuity, and can leverage smaller or cross-family models as cost-efficient policy generators. We also find that the benefit of policy-level guidance depends on task characteristics, offering practical insights into when and under what conditions this mechanism is most effective.
46. 【2609.16777】Benchmarking Factual Robustness of LLMs via Multi-conversation Persuasion
链接：https://arxiv.org/abs/2609.16777
作者：Zhuoang Cai
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, knowledge retrieval interfaces, primary knowledge retrieval, critical safety concern
备注：
点击查看摘要
Abstract:As Large Language Models (LLMs) increasingly serve as primary knowledge retrieval interfaces, their robustness against \textit{persuasion attacks}---attempts to inject misinformation or enforce counterfactuals---has become a critical safety concern. Existing red-teaming frameworks typically evaluate models in multi-turn dialogues where the target model retains full conversation history. We identify a critical flaw in this setting termed \textbf{``Refusal Inertia''}: a model's initial refusal often propagates through subsequent turns largely to maintain contextual consistency, thereby masking its true vulnerability to sophisticated, isolated persuasion attempts. To rigorously evaluate the ``cold-start'' defense capabilities of SOTA models, we introduce the \textbf{SAST-IR} (Stateful Attacker, Stateless Target - Iterative Refinement) framework. By enforcing a memory wipe on the target while retaining the attacker's history, we simulate a worst-case adversarial setting using \textbf{multi-turn} (stateless) iterations. Leveraging \textbf{CP-Agent} (Cognitive Persuasion Agent), an enhanced diagnosis-guided agent, our experiments on the custom \textsc{CounterFact-Strict} dataset ($N=50$) yield alarming results: simple, diverse attack strategies achieved a staggering \textbf{96\%} success rate, exposing severe brittleness in memory-less defense. Furthermore, we reveal a \textbf{``Complexity Paradox''}: while complex, iteratively refined attacks are effective, they often trigger defensive compliance, whereas simple strategies achieve a higher rate of genuine persuasion (\textbf{84.7\%}). Our code and dataset are available at GitHub, this https URL.
47. 【2609.16754】AME: Token Attribution and Masking for Emergent misalignment
链接：https://arxiv.org/abs/2609.16754
作者：Md Rayhanul Masud,Md Rizwan Parvez
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：induce harmful behavior, aligned language model, emergent misalignment, aligned language, data can induce
备注： Accepted at EMNLP UncertaiNLP Workshop 2026
点击查看摘要
Abstract:Fine-tuning an aligned language model on narrow, flawed data can induce harmful behavior far outside the training domain, known as emergent misalignment (EM). Prior work has localized EM in model weights, activations, and training documents, but it remains unclear which training tokens carry the relevant fine-tuning signal. We introduce TAME (Token Attribution and Masking for Emergent Misalignment), a three-stage framework: token attribution scores how strongly the fine-tuning update raises each response token's likelihood, using forward passes through a released LoRA adapter; signal characterization finds patterns among high-attribution tokens; and causal validation tests them by attribution-guided loss masking. On released EM organisms and a 6,849-example medical-advice split, attribution is concentrated (the top 5% of tokens hold 32% of the mass) and, in Llama, depleted for medical vocabulary but enriched for a register of unwarranted certainty, even after controlling for token rarity. Masking high-attribution tokens during fresh fine-tuning cuts EM by 23x in Llama and 36x in Qwen, with the perplexity cost concentrated on the targeted register rather than on medical content; an equal random mask leaves EM unchanged. In Llama, the attribution pattern suggests that EM-relevant signal lies more in how confidently flawed content is expressed than in its domain vocabulary; the causal masking effect itself holds across both model families.
48. 【2609.16748】IAO: Token Importance-Aware Policy Optimization for Text Summarization
链接：https://arxiv.org/abs/2609.16748
作者：Qixiu Li,Chenlong Bao,Xiang Zhu,Xiaoyong Li,Ruixin Cao,Shukai Chen,Zhenxiong Zhou
类目：Computation and Language (cs.CL)
关键词：Text summarization requires, preserving key qualities, Text summarization, consistency and coherence, summarization requires models
备注：
点击查看摘要
Abstract:Text summarization requires models to condense content while preserving key qualities such as consistency and coherence. Large language models (LLMs) have shown strong performance on this task and can be further improved through reinforcement learning (RL). However, most existing methods apply reward signals directly to undifferentiated token sequences, overlooking the varying importance of individual tokens to word and sentence level quality in summarization. In this paper, we propose Token Importance-Aware Policy Optimization (TIAO), a novel reinforcement learning strategy that explicitly leverages token-importance awareness. Specifically, TIAO identifies core tokens based on token dependency and reweights a trajectory's advantage according to its overall dependencies. Experiments on the real world dataset show that our TIAO achieves highly competitive results, and that a 7B foundation model enhanced by TIAO performs comparably to GPT-4 and GPT-5-nano. Code is available at this https URL
49. 【2609.16739】Japanese Stroke LLM Evaluation: A Conversational Benchmark for Safe Stroke Care in Japanese Using Large Language Models
链接：https://arxiv.org/abs/2609.16739
作者：Keisuke Masuda,Kazutaka Yatsushiro,Hirohumi Iwamoto,Hirofumi Hirano,Ryosuke Hanaya
类目：Computation and Language (cs.CL)
关键词：Japanese Stroke LLM, Large language models, medical knowledge examinations, clinical history taking, multiple-choice medical knowledge
备注：
点击查看摘要
Abstract:Background: Large language models (LLMs) have achieved physician-comparable performance on multiple-choice medical knowledge examinations, but their capabilities in clinical history taking, urgency assessment, and safety remain insufficiently evaluated. We proposed Japanese Stroke LLM Evaluation, a multi-turn conversational benchmark for stroke care in Japanese, and evaluated LLM performance and safety under practice-oriented conditions. Methods: We created 10 stroke and related-condition cases and evaluated LLMs in multi-turn Japanese conversations. The LLM acted as physician, while a board-certified neurosurgeon acted as simulated patient and evaluator. Each case comprised history-taking and action phases scored using pre-specified criteria. Errors that could directly threaten life were defined as critical mistakes. The safety threshold was at least 80% overall with zero critical mistakes. Eighteen models were evaluated in October 2025 and June 2026. Results: Claude Fable 5 achieved the highest score (87.4%) with zero critical mistakes, followed by Claude Opus 4.7 (80.3%) and GLM-5.2 (75.6%). Two leaders met the safety threshold. Eleven models made 17 critical mistakes, including failure to confirm laboratory results or blood glucose before t-PA, surgery before airway stabilization, omission of cervical vascular evaluation, and t-PA outside its indication. History-taking question count correlated with history-taking score (r = 0.648, p = 0.007). Conclusions: Japanese Stroke LLM Evaluation provides a benchmark for LLM performance under practice-oriented conditions, including a cap on history-taking questions. Cases and evaluations were created by neurosurgical specialists rather than using an LLM-as-judge approach. Performance improved across cloud-based and on-premise models in 2026, with some exceeding the safety threshold. Further evaluation using real-world cases is required.
50. 【2609.16730】LSREP: A Longitudinal State-Replay Protocol for Evaluating Conversational Memory, with ICE v2 as an Audited Local-First Architecture
链接：https://arxiv.org/abs/2609.16730
作者：Deepesh Sonar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：persistent state accumulates, endpoint question answering, Conversational memory, Longitudinal State-Replay Evaluation, State-Replay Evaluation Protocol
备注： 37 pages. Code and evaluation artifacts: [this https URL](https://github.com/Deepnar/ice) . The exact system snapshot used for the reported results is preserved in the "v2-paper-eval" tagged release
点击查看摘要
Abstract:Conversational memory changes during use, so endpoint question answering alone cannot establish how a persistent state accumulates, ages, or incorporates revisions. We introduce LSREP, a Longitudinal State-Replay Evaluation Protocol combining ordered replay, explicit lifecycle schedules, repeated probes, evolving reference answers, and mechanism-fidelity checks. Its architectural case study is ICE v2, a local-first memory middleware with typed stores, retrieval fusion, and dynamic context budgets. The private, single-user instantiation contains 1,985 turns, 219 distinct probes, and 1,211 probe-checkpoint observations across 52 checkpoints. On three ordinary-density datasets, ICE v2 has a near-zero mean quality difference from vector-RAG while selecting 32% fewer fragments but using 6.6% more estimated prompt tokens. A fourth, dense dataset exposes catastrophic failures of the unbudgeted baseline. The fidelity audit limits attribution: procedural retrieval is defective, several mechanisms are unexercised, and graph utility is not established. In a complementary matched public diagnostic, ICE v2 loses decisively to pure vector-RAG on LongMemEval: 50.8% versus 72.8% in the evidence-only oracle and 43.0% versus 69.5% in full-S. Paired differences are -22.0 points (95% CI [-26.6, -17.4]) and -26.5 ([-31.3, -21.8]). Conservative abstention accompanies severe multi-session and temporal failures. ICE uses less context in this diagnostic, establishing a quality-cost trade-off rather than superior efficiency. Together, replay, fidelity auditing, and public endpoint testing expose distinct failure modes that neither architectural descriptions nor aggregate scores identify alone.
51. 【2609.16722】VideoMM: Adaptive Macro-Micro Inference for Efficient Video MLLMs
链接：https://arxiv.org/abs/2609.16722
作者：Haoyu Guo,Yuan Feng,Junlin Lv,Mingjun Xiao,S Kevin Zhou,Xike Xie
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Scaling Multimodal Large, Multimodal Large Language, Large Language Models, Scaling Multimodal, incurs prohibitive costs
备注：
点击查看摘要
Abstract:Scaling Multimodal Large Language Models (MLLMs) to long-form video understanding is bottlenecked by the explosion of visual tokens, which saturates context windows and incurs prohibitive costs. Current solutions predominantly rely on auxiliary models for token reduction but face a fundamental dilemma: lightweight encoder-driven approaches often overlook critical semantic information, whereas heavyweight MLLM-driven reduction negates the efficiency gains. {In this work, we identify a more fundamental inefficiency underlying this dilemma: while fine-grained visual details are essential for detailed understanding, they are largely redundant for the preliminary task of selecting semantically relevant regions. } Motivated by this, we introduce \textbf{VideoMM}, which marks a paradigm shift from model-centric downsizing to adaptive perceptual granularity. Specifically, our framework {decouples selection from reasoning} by executing semantic filtering on a cost-effective \textit{Macro Proxy} (derived from downscaled frames), and projecting the selected regions onto high-fidelity \textit{Micro Tokens} for detailed understanding only when necessary. Extensive evaluations show that VideoMM significantly outperforms existing solutions. It achieves a 6.13$\times$ speedup and a 7.4\% accuracy gain over full-context baselines on LongVideoBench, and further accelerates inference by 2.73$\times$ over current leading methods, establishing a highly scalable paradigm for long-video understanding. Our code is available at: this https URL.
52. 【2609.16661】DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization
链接：https://arxiv.org/abs/2609.16661
作者：Weiming Li,Ana Catarina Fidalgo Barata,Miguel Constante,João Miguel Sanches
类目：Computation and Language (cs.CL)
关键词：Automated depression screening, Automated depression, clinical interviews requires, clinician or patient, depression screening
备注： 5 pages, 2 figures. Submitted to ICASSP 2027
点击查看摘要
Abstract:Automated depression screening from clinical interviews requires attribution of utterances to the clinician or patient. We evaluate two datasets: DAIC-WOZ, where participant-only recordings require re-synthesizing both sides for controlled two-party evaluation, and PDCH-HAMD, comprising voice-converted real Chinese interviews for cross-lingual validation. Cascaded systems combine speaker diarization with role-assignment heuristics, so errors can propagate across stages. We propose an end-to-end model, which we named DiaWhisper, that fine-tunes Whisper-large-v3 with LoRA and an auxiliary frame-level role head for transcription and attribution, together with DiaWhisper-DPO, a failure-mined refinement that uses genuine decoding failures as DPO rejected completions without human preference annotation. On 29 DAIC-WOZ test sessions, DiaWhisper-DPO achieves 0.973 role accuracy and 0.119 DER, 72% below the strongest cascaded baseline, and reduces seed variation from {\sigma} = .205 to .002. Retrained on PDCH-HAMD, it achieves 0.757 role accuracy and improves all 78 session-seed pairs.
53. 【2609.16660】Rewarding Reasoning, Not Answers: Fixing and Bounding Test-Time Reinforcement Learning on Medical QA
链接：https://arxiv.org/abs/2609.16660
作者：Kailong Fan,Anqi Pu,Yichen Wu,Wanhua Li,Yicong Li,Hanspeter Pfister,Huafeng Liu,Xiang Li,Quanzheng Li,Ning Guo
类目：Computation and Language (cs.CL)
关键词：Test-time reinforcement learning, reinforcement learning adapts, unlabeled test set, shown strong results, Test-time reinforcement
备注：
点击查看摘要
Abstract:Test-time reinforcement learning adapts a model on its own unlabeled test set using majority-vote pseudo-labels and has shown strong results in mathematics. We show that this recipe collapses on medical multiple-choice QA: accuracy stagnates while output diversity rapidly declines. Through a controlled experiment that keeps the questions, model, and optimizer fixed while changing only the answer space, we trace this failure to answer-space structure rather than domain difficulty. In small answer spaces, incorrect rollouts often collide on the same wrong pseudo-label and reinforce it; in large answer spaces, they disperse and receive little reward. This diagnosis motivates PROSE, Process Reward Guided Self-Training, which rewards reasoning quality instead of answer agreement. PROSE scores each reasoning step with a medical process reward model, assigns the trajectory reward as the minimum score across steps, and enforces answer-format constraints. Without labels, PROSE substantially improves a general Llama model, surpassing purpose-built medical models and matching much larger systems. Because the process signal is internalized into the policy, the adapted model requires no reward model at inference and transfers its gains to unseen datasets. We further show that the minimum aggregation is essential: mean aggregation can be exploited, saturating the proxy reward while degrading accuracy.
54. 【2609.16648】GrowMTP: Can RL Grow Its Own Draft Head?
链接：https://arxiv.org/abs/2609.16648
作者：Minghua He,Lingzhe Zhang,Yuan Liu,Xiao Zhou,Aiwei Liu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Reinforcement learning, autoregressive rollout generation, large language models, post-training drives, drives the frontier
备注：
点击查看摘要
Abstract:Reinforcement learning (RL) post-training drives the frontier capabilities of large language models, with its wall-clock dominated by autoregressive rollout generation. Speculative decoding is an established remedy for this bottleneck, but existing draft heads must be pretrained or warmed up before RL, introducing substantial training cost outside the RL run to be accelerated. We observe that RL training itself provides both conditions required for online draft-head training: its rollout distribution is far narrower than that of pretraining, and its verification step continuously produces supervision signals aligned with this distribution. Building on these observations, we propose GrowMTP, which uses this supervision to train a draft head from scratch entirely within the RL loop, with all head updates detached from the policy backbone. On Qwen3-4B (no draft head), MiMo-7B-SFT (weak head), and Qwen3.5-4B-Base (strong head), GrowMTP achieves rollout speedups of 2.13x, 1.93x, and 1.36x, and end-to-end speedups of 1.60x, 1.41x, and 1.20x, respectively. GrowMTP therefore serves existing RL training frameworks as a modular component, particularly offering a from-scratch acceleration path for models without pretrained draft heads.
55. 【2609.16627】Quantifying Organizational Environmental Action from Web Data and Large Language Models
链接：https://arxiv.org/abs/2609.16627
作者：Quinn Reynolds,Daniel Shore,Vianey Leos Barajas,Tanhum Yoreh,Meredith Franklin
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：data science problem, Quantifying organizational environmental, Quantifying organizational, LLM classification, challenging environmental data
备注： 22 pages, 6 figures, appendices
点击查看摘要
Abstract:Quantifying organizational environmental action from publicly available web content remains a challenging environmental data science problem because relevant information can be dispersed across multiple webpages and is primarily communicated through unstructured text. We present a scalable computational framework for transforming organizational web content into structured measures of environmental action and demonstrate the approach using Jewish congregations in the United States. We constructed a national database of 4,964 congregations by integrating multiple geospatial, knowledge-base, directory, and manually reviewed sources. Of these, 2,657 had active websites that were successfully crawled, producing a corpus of 154,454 webpages. We compared three approaches for detecting environmental actions: keyword retrieval followed by large language model (LLM) classification, semantic vector retrieval followed by LLM classification, and direct LLM classification classification without preliminary retrieval. Agreement with an expert human reviewer was lowest for keyword retrieval ($\kappa$ = 0.26), higher for semantic vector retrieval ($\kappa$ = 0.42), and similar for direct LLM classification ($\kappa$ = 0.40). Although semantic retrieval achieved the highest agreement, its retrieval recall was 0.87, indicating loss of relevant content before classification. Applied to the complete corpus, direct LLM classification identified at least one environmental action at 1,398 congregations (53%), providing greater coverage than either retrieval-based approach. These results demonstrate that preliminary retrieval can reduce computational cost but may exclude relevant information before it reaches the classifier. The framework provides a reproducible approach for extracting organization-level environmental information from unstructured web content that can be adapted to other institutions.
56. 【2609.16614】RoleBreak: Benchmarking Long-Horizon Role-Playing Robustness in Spoken Dialogue
链接：https://arxiv.org/abs/2609.16614
作者：Yuqi Wang,Fengyuan Liu,Haochen Luo,Zhiqi Yu,Qi Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：models increasingly support, dialogue models increasingly, support persona control, increasingly support persona, remain largely character-centric
备注： 5 pages, 2 figures, 3 tables. Submitted to ICASSP 2027
点击查看摘要
Abstract:Speech-to-speech dialogue models increasingly support persona control, yet existing spoken role-playing benchmarks remain largely character-centric and short-horizon. This leaves open whether spoken dialogue models can sustain diverse roles over extended interactions, especially beyond predefined fictional characters. We introduce RoleBreak, an open benchmark for long-horizon role-playing robustness in spoken dialogue. RoleBreak contains 310 character-based and user-centered roles, 6,688 human-verified dialogue turns, and 11,743 fine-grained evaluation criteria, with 1,856 turns carrying expressive emotion targets for evaluating vocal emotion. Its scenarios are designed to stress role consistency, interaction quality, safety, and affect over extended conversations. We evaluate nine configurations spanning full-duplex, omni-modal, and cascaded ASR--LLM--TTS paradigms. We find four key patterns. First, current systems are substantially stronger at semantic role adherence than at vocal emotion. Second, semantic robustness remains brittle over long interactions: even the strongest evaluated system encounters its first persona and safety failures after only 10.4 and 11.6 turns on average. Third, scaling the LLM substantially improves semantic robustness and delays failure, but yields little improvement in vocal emotion. Finally, user vocal emotion affects role-playing behavior even when linguistic content is fixed. These findings highlight persistent gaps in both long-horizon robustness and vocal expressiveness in spoken role-playing systems.
57. 【2609.16590】Challenges of Auditing: Variability in Outputs of Large Language Models for Health
链接：https://arxiv.org/abs/2609.16590
作者：Yuan Pu,Yewon Chang,Furong Jia,Xunjian Yin,Jessica Ma,Ayman Ali,Monica Agrawal
类目：Computation and Language (cs.CL)
关键词：People increasingly, ChatGPT Health, health advice, access modes, increasingly use frontier
备注：
点击查看摘要
Abstract:People increasingly use frontier AI models for health advice, but via different access modes (e.g., ChatGPT, ChatGPT Health, APIs) with varying settings. Here, we find systematic differences across access modes. Because evaluations typically rely on APIs while consumers interact through chatbot interfaces, these discrepancies limit evaluation validity. Our findings underscore an urgent need for model providers to enable faithful replication of consumer experiences and settings for rigorous audits.
58. 【2609.16582】CLASH: Counterfactual Auditing of Lexical and Prosodic Reliance in Spoken Sarcasm Detection
链接：https://arxiv.org/abs/2609.16582
作者：Qiyang Sun,Xudong Li,Yupei Li,Jiabin Xue,Yuhang Dai,Jiaming Li,Bjorn W. Schuller
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：Spoken sarcasm detectors, exploit lexical content, Controlled Lexical-Acoustic Separation, Lexical-Acoustic Separation Harness, Spoken sarcasm
备注：
点击查看摘要
Abstract:Spoken sarcasm detectors may exploit lexical content, prosody, or their interaction, yet conventional evaluation cannot reveal which cues drive their predictions. We introduce CLASH (Controlled Lexical-Acoustic Separation Harness), a bilingual counterfactual diagnostic framework that evaluates each utterance under original, lexical-preserving, prosody-preserving, and approximately neutralised conditions. We evaluate handcrafted acoustic-feature systems, self-supervised learning (SSL) probes, and large audio language models (LALMs) on CMMA and MUStARD. For target-only Qwen3-Omni, lexical-preserving speech retains a 0.135--0.148 AUROC advantage over prosody-preserving speech after duration balancing, with cluster-bootstrap intervals above zero; alternative lexical resynthesis preserves this advantage. Acoustic interventions shift scores without consistently improving discrimination or changing binary predictions under the evaluated conditions. Context and interaction estimates vary across corpora. These findings distinguish acoustic sensitivity from sarcasm discrimination while exposing duration, identity, and transformation effects.
59. 【2609.16557】PunGraph: Retrieval-Enhanced Phonetic-Semantic Graph Reasoning for Pun Understanding
链接：https://arxiv.org/abs/2609.16557
作者：Yuchen Su,Zijian Huang,Yaotian Shi,Shaoxin Zhong,Ruofan Wang,Mengze Li,Yonghua Zhu,Diana Benavides-Prado,Michael Witbrock
类目：Computation and Language (cs.CL)
关键词：convey multiple meanings, exploit phonetic similarity, multiple meanings, challenging form, form of figurative
备注： EMNLP2026 Main Conference
点击查看摘要
Abstract:Puns are a challenging form of figurative language that exploit phonetic similarity and semantic ambiguity to convey multiple meanings. Although large language models (LLMs) demonstrate strong language understanding capabilities, they still struggle with pun reasoning due to limited phonetic modeling and uncontrolled end-to-end generation. We propose \textbf{PunGraph}, a retrieval-enhanced knowledge graph framework for pun understanding. PunGraph constructs a phonetic-semantic lexical graph using the Unisyn phonetic dictionary, IPA and G2P representations, and WordNet definitions, and retrieves candidate words or senses to constrain LLM reasoning within a structured candidate space. We further introduce \textbf{WebPun}, a new large-scale dataset containing 5,730 annotated heterographic and homographic puns. Experiments on SemEval-2017 and WebPun show that PunGraph consistently improves the performance of small-scale LLMs and achieves competitive results against strong proprietary models. Further analysis shows that retrieval-guided phonetic and semantic constraints effectively reduce common reasoning errors in pun interpretation, highlighting the benefits of integrating structured knowledge with LLMs. We release our code and dataset at this https URL.
60. 【2609.16532】Style-Debiased DPO: Updating LLM Knowledge with Factuality-Aware Synthetic Preference Data
链接：https://arxiv.org/abs/2609.16532
作者：Takayuki Yamamoto,Daisuke Kawahara
类目：Computation and Language (cs.CL)
关键词：Continued pretraining, large language model, small source corpus, paraphrasing can store, store inside
备注： 23 pages, 3 figures, 13 tables
点击查看摘要
Abstract:Continued pretraining (CPT) with data augmentation such as paraphrasing can store inside a large language model (LLM) the knowledge of a small source corpus. The stored knowledge, however, is not always retrieved correctly. We study the eliciting side rather than the storing side: we use preference optimization, which learns from pairs of a preferred (chosen) and a dispreferred (rejected) response, so that the model elicits its stored knowledge more accurately. One proposed approach takes the model's own erroneous response as rejected and the gold answer as chosen, so as to suppress the error. When the target knowledge is partially known, however, most of these rejected responses are factually correct. Using direct preference optimization (DPO) then pushes down rejected responses that contain correct knowledge and differ from the chosen answer only in style, such as length and wording. We propose style-debiased DPO (SD-DPO), which scores whether the rejected response of each pair is factually correct, inverts the preference of such pairs, and weights them so that the learning signal due to differences in style cancels out as a whole. We first test whether, on top of EntiGraph, a representative storing-side method that runs CPT on text synthesized from the corpus, our method adds accuracy efficiently. On QuALITY, the reading-comprehension QA benchmark on which EntiGraph was evaluated, SD-DPO exceeds a baseline we CPT on EntiGraph's synthetic data from the same base model and evaluate with the same procedure. The training tokens this requires are a few dozen times fewer than the additional CPT needed for the same gain. For knowledge updating, the main goal of this work, we use AToKE, a knowledge-editing benchmark for facts that change over time. There, SD-DPO reaches an overall accuracy of 0.982 and answers with the new or the old fact according to the queried period.
61. 【2609.16517】Competence-Preserving Resume Perturbations Expose Presentation Sensitivity in LLM Screening
链接：https://arxiv.org/abs/2609.16517
作者：Qiangju Chen,Yang Xiao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：document extraction quality, stylistic polish, infer job-relevant competence, substantially in wording, extraction quality
备注： Under Peer Review
点击查看摘要
Abstract:Resume screeners must infer job-relevant competence from resumes whose presentation can vary substantially in wording, structure, stylistic polish, and document extraction quality. Ideally, such surface variation should not change decisions when the underlying qualification evidence is unchanged. We introduce a controlled audit of this property, constructing occupation-grounded candidate profiles at controlled competence levels and rendering each profile into multiple resume presentations. A deterministic validation gate excludes variants that alter the underlying evidence before scoring. Across six open instruction-tuned LLM conditions, we find a clear disconnect between screening validity and presentation stability. Llama-3.1-8B with its native chat template achieves the strongest validity ($0.781$) yet reverses $29.6\%$ of matched pairwise decisions under competence-preserving presentation changes; Mistral-7B-v0.3 reaches validity $0.644$ with a $41.4\%$ flip rate. Native chat formatting improves validity for several chat-tuned models but does not remove this instability. These results show that resume-screening evaluations should assess not only whether a system identifies stronger candidates, but also whether those decisions remain stable when the same competence evidence is presented differently.
62. 【2609.16501】Beyond the Name: Demographic Leakage in De-Identified Résumés and Evaluation Artifacts in LLM Bias Audits
链接：https://arxiv.org/abs/2609.16501
作者：Qiangju Chen,Yang Xiao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：De-identified résumé screening, recent audits attribute, redacting explicit fields, explicit fields prevents, audits attribute residual
备注： Under peer review
点击查看摘要
Abstract:De-identified résumé screening assumes that redacting explicit fields prevents ethnocultural inference; however, recent audits attribute residual leakage to declared languages. We investigate whether eliminating language fields resolves this leakage across nine open-weight models and 620 counterfactual résumés. By holding language attributes strictly identical, we isolate unstructured prose across five ethnocultural conditions and three cue-salience tiers. Target-group recovery averages 0.757 overall and saturates at 1.000 under high salience, demonstrating that non-language prose sustains demographic inference. Crucially, models diverge only under faint cues (0.086-0.690), establishing salience as an essential evaluation axis. Furthermore, pairwise LLM-as-a-judge outcomes are highly sensitive to evaluation design: forbidding ties yields an apparent selection-rate ratio of 0.39 alongside strong position and content effects, whereas permitting ties produces near-universal ties for most models ($\ge94\%$). Downstream scoring shows only very small between-condition differences, highlighting the need to distinguish demographic signals recoverable from résumé content from effects introduced by the evaluation protocol.
63. 【2609.16450】Early-Bird Decoding: Accelerating Diffusion LLMs with Learnable Block Sizes and Parallel Sampling
链接：https://arxiv.org/abs/2609.16450
作者：Lixuan Wei,Wei Zhou,Jianwen Wu,Yipeng Shen,Meiling Wang,Haoran You
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Diffusion large language, Diffusion large, large language models, offer a promising, iterative unmasking
备注： 23 pages, 4 figures
点击查看摘要
Abstract:Diffusion large language models (dLLMs) offer a promising parallel decoding paradigm as an alternative to autoregressive generation through iterative unmasking. However, dLLMs typically require many steps before token confidence reaches the decoding threshold, resulting in inefficient inference even with block-wise KV caching. To accelerate dLLM inference, we for the first time propose an "early-bird (EB)" decoding framework, motivated by the observation that tokens with similarly low entropy tend to cluster and can be jointly decoded earlier, before reaching the confidence threshold. In particular, our EB-Decode framework integrates two key enablers: (1) a learnable network that adaptively groups tokens with similar uncertainty into variable-length blocks, rather than relying on fixed block sizes; (2) a position-aware sampler that learns to unmask tokens in parallel using fewer decoding steps within predicted variable-length blocks. Both components are developed without modifying pretrained dLLM weights and can therefore be directly deployed as plug-ins during serving, with negligible training and inference overhead. Extensive experiments across three models and four benchmarks consistently validate our observation and the effectiveness of EB-Decode, achieving 3.53-18.76$\times$ higher throughput than the vanilla decoding method and up to 1.58$\times$ higher throughput over the strongest baseline, Fast-dLLM, with comparable accuracy.
64. 【2609.16436】Interpreting and Steering LLM Agents for Social Simulations
链接：https://arxiv.org/abs/2609.16436
作者：Jiayue Gaveal Fan,Arul Murugan,Shreyas Krishnan,Abhishek Nagaraj
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, making them valuable, social scientific toolkit, large language, powerful for understanding
备注： 70 pages, 27 figures, 3 tables
点击查看摘要
Abstract:Simulations based on large language models (LLMs) have proven to be powerful for understanding human behavior, making them valuable additions to the social scientific toolkit. However, LLMs are ultimately black boxes based on deep neural networks which limits their value for social science. This is because of a lack of (i) interpretability: i.e. the ability to assign clear mechanisms driving observed behavior; and a lack of (ii) steerability: i.e. the ability to mute or amplify specific theoretically meaningful mechanisms of action to drive specific model behavior. Here, we demonstrate how the black box could be opened up to further enrich LLM-based simulations. Specifically, we compare three types of methods: (1) prompt-based manipulation, (2) SAE-derived feature steering, and (3) probe-based direction steering and examine their utility for LLM-based social scientific simulations. We do so by interpreting and steering two foundational components of human behaviors, namely preferences (risk attitudes, altruism) and capabilities (divergent creativity, product innovation), operationalized using four classic economic and creative tasks implemented as natural-language interactions. Overall, our results show that SAE- and probe-based techniques often outperform basic prompt-based methods for steering LLM agents, although this advantage depends on the specific prompting strategy involved. Together, SAEs and probes constitute an effective pipeline for social scientists seeking to interpret and steer agents in social simulations: SAEs decompose agents' internal representations into human-readable features, after which probes can reliably shift agents' behaviors in specified directions. We discuss implications of these methods for future work using LLM agents for social scientific simulations.
65. 【2609.16427】ReMova: Fine-tuning LLMs for English to Belarusian translation
链接：https://arxiv.org/abs/2609.16427
作者：Mikita Pilinka,Aliaksandr Kliujeŭ,David Samuel,Yves Scherrer
类目：Computation and Language (cs.CL)
关键词：Belarusian-specific data-cleaning pipeline, English-Belarusian machine translation, presents a Belarusian-specific, Belarusian-specific data-cleaning, machine translation
备注： WMT26 submission
点击查看摘要
Abstract:This paper presents a Belarusian-specific data-cleaning pipeline and fine-tuning for English-Belarusian machine translation. Our cleaning pipeline distinguishes itself from others by employing a correction tool that addresses the issue of the two orthographies of the Belarusian language, noise in the training data, interference from other languages and other misspelling issues common in Belarusian on the internet. A matched ablation on unfiltered training data shows substantial benefits from filtering for all fine-tuned models, with the LLM-based models gaining roughly twice as much from filtering as the dedicated encoder-decoder MT system, supporting the view that for Belarusian MT one of the primary bottlenecks is data quality.
66. 【2609.16301】CLEAR: Cross-Source Evidence Adjudication for Large Language Models in Medicine
链接：https://arxiv.org/abs/2609.16301
作者：Shuai Wang,Yize Zhao,Qingyu Chen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Medical knowledge evolves, large language models, knowledge evolves continuously, Medical knowledge, evolves continuously
备注： 31 pages
点击查看摘要
Abstract:Medical knowledge evolves continuously, whereas the parametric knowledge encoded in large language models (LLMs) is fixed at training time. External retrieval, including retrieval-augmented generation (RAG), can provide access to newly available evidence, but retrieved information may be irrelevant, incomplete, or conflicting. As a result, external retrieval can in turn degrade the factual accuracy and evidence grounding of LLM outputs. To address this challenge, we propose \textbf{CLEAR}, an agentic framework for cross-source evidence adjudication in LLMs in medicine. CLEAR independently generates candidate answers from three complementary pathways---parametric knowledge, locally curated corpora, and dynamically retrieved evidence---reflecting three common sources of information available to LLMs. An aggregation verifier jointly evaluates the candidates, supporting evidence, provenance, and source-quality information to identify agreement and conflict across sources. An adjudication module then determines whether the current conclusion should be preserved or revised through complementary override-guard and challenge-audit mechanisms, while unresolved conflicts trigger targeted follow-up search and re-adjudication.
67. 【2609.16275】Speaker or Language? Explaining Variance in Charismatic Prosody Across Luxembourgish and French
链接：https://arxiv.org/abs/2609.16275
作者：Nina Hosseini-Kivanani,Nafiseh Taghva,Peter Gilles,Oliver Niebuhr
类目：Computation and Language (cs.CL)
关键词：speaking remains unclear, bilingual public speaking, public speaking remains, Charismatic speech, speaking style
备注： 5 pages, 2 figures, 2 tables (Accepted to Interspeech2026)
点击查看摘要
Abstract:Charismatic speech is shaped by language and speaking style, yet their relative contribution in bilingual public speaking remains unclear. We analyzed spontaneous speeches of 10 politicians who address audiences in Luxembourgish and French, in highly comparable communicative contexts across languages. From 400 utterances, we extracted 41 acoustic-prosodic features linked to vocal charisma and fitted mixed-effects models to separate speaker- and language-related variance. Speaker identity accounted for most variance, whereas language explained less, but still showed systematic differences: French productions showed higher shimmer and phrase-final F0, indicative of a polite, respectful voice, while Luxembourgish productions exhibited stronger mid-frequency spectral energy, suggesting a more vocally present profile. These patterns align with the sociolinguistic roles of Luxembourgish as an informal identity language and French as a high-prestige institutional variety.
68. 【2609.16274】Speaker-Specific and Language-Dependent Temporal Organization in Bilingual Political Speech
链接：https://arxiv.org/abs/2609.16274
作者：Nina Hosseini-Kivanani,Nafiseh Taghva,Peter Gilles,Oliver Niebuhr
类目：Computation and Language (cs.CL)
关键词：examines monolingual English, empirical work examines, work examines monolingual, monolingual English, structure persuasive speech
备注： 5 pages, 2 figures, 2 tables (Accepted to Interspeech2026)
点击查看摘要
Abstract:Speech rhythm helps structure persuasive speech, but most empirical work examines monolingual English. This study asks how politicians organize timing when speaking Luxembourgish and French. We analyze 400 sentences from ten politicians, annotated for segments and pauses. We compute rhythm metrics, including means, variability, and pairwise variability indices for consonants and vowels. We quantify speaker and language contributions and test within-speaker language effects with paired t-tests. Results show that consonant-based metrics retain speaker-specific signatures, whereas vowel-based metrics are largely driven by language choice. French tokens display longer and more variable vowels and vocalic intervals, while consonant timing differences are smaller. No robust language by gender interactions emerge. These findings show that language choice systematically reorganizes rhythmic timing in bilingual public speech.
69. 【2609.16268】Spurious Tool Use: When RL Agents Learn the Wrong Reason to Act
链接：https://arxiv.org/abs/2609.16268
作者：Yiwei Yang,Haoxiang Zhang,Bingbing Wen,Yao Lu,Yuchen Wu,Lei Zhang,Julian McAuley,Pan Lu,Bill Howe
类目：Computation and Language (cs.CL)
关键词：Large language model, interleave natural language, increasingly interleave natural, Large language, natural language reasoning
备注：
点击查看摘要
Abstract:Large language model (LLM) agents increasingly interleave natural language reasoning with external tools such as web search and code execution. These tool-use policies are often optimized via reinforcement learning (RL), which can amplify spurious correlations in the training data. In this work, we study when and why RL-trained agents learn shortcut tool-selection policies: invoking tools based on superficial prompt cues rather than genuine task requirements. We construct controlled synthetic environments combining factual question answering and mathematical reasoning tasks, and inject cues that are strongly correlated with specific tools during training but causally irrelevant to tool necessity. Across counterfactual evaluations where cues are present but the associated tools are not required, agents exhibit substantial shortcut behavior, with spurious tool invocation rates increasing by up to 39 percent. However, shortcut formation is not universal: across the conditions we test, it arises only when the agent has already learned to use the target tool reliably, suggesting that task competence, rather than dataset imbalance alone, is a key factor in shortcut learning. A swapped-cue analysis further shows that semantic alignment between cues and tools substantially amplifies this effect. To mitigate these failures, we introduce a dense, decision-level reward in which an LLM judge evaluates the necessity of each tool call. This tool-necessity reward effectively suppresses cue-driven tool use while preserving task performance, providing a practical approach to improving the robustness of LLM agent tool-use policies.
70. 【2609.16267】he record is part of the task: matched-record evaluation of text classifiers across maintenance, safety and recall reporting
链接：https://arxiv.org/abs/2609.16267
作者：Hisham Ihshaish,Peter Mayhew,Tasnim M. A. Zayet,Ana Del Amo
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：NASA ASRS safety, workflow stages, model comparison begins, Aerospace repair events, operational cases
备注： 37 pages (18-page article, 3 tables, 7 figures, plus a 19-page supplement with tables and figures numbered S1 onward)
点击查看摘要
Abstract:Many operational cases are documented more than once, at different workflow stages and for different purposes, yet model evaluations normally select one of these records before model comparison begins. We treat that selection as part of the evaluation and compare matched records of the same cases under fixed labels and splits in three systems: GE Aerospace repair events, NASA ASRS safety reports and NHTSA vehicle recalls. Across the three GE fields, for events whose label comes from parts transactions independently of the narratives, held-out macro-F1 ranged from 0.33 to 0.91. A difference of 0.46 separated the customer report, written before shop work, from the technician report, written after diagnosis but before the transaction that generates the label. That difference is substantially larger than the representation and architecture differences tested on the same events. The public systems showed different patterns: the NHTSA defect summary remained strongest under every model family tested, whereas the ASRS analyst synopsis outperformed the reporter narrative under learned sequence models but not under lexical baselines. Secondary analyses showed that some model comparisons were also record-dependent. Evaluations should be run on the information available at the intended decision point and should report how both the record and the label were produced.
71. 【2609.16229】st-Time Unlearning via Sparse Autoencoder
链接：https://arxiv.org/abs/2609.16229
作者：Pingzhi Li,Jinhao Duan,Vaishnav Tadiparthi,Nakul Agarwal,Kwonjoon Lee,Ehsan Moradi Pari,Hossein Nourkhiz Mahjoub,Sijia Liu,Tianlong Chen
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Machine unlearning aims, trained large language, large language model, remove specific knowledge, retraining from scratch
备注：
点击查看摘要
Abstract:Machine unlearning aims to remove specific knowledge from a trained large language model (LLM) without retraining from scratch. Existing methods modify model weights via gradient ascent and its advances. While effective on certain benchmarks, these weight-based approaches exhibit a sharp forget-utility trade-off, where stronger forgetting of target knowledge can degrade model utility, and unlearned knowledge may reappear under post-unlearning fine-tuning or prompt attacks. We propose ARIA (autoencoder-gated inference-time unlearning), a test-time unlearning method that leaves model weights intact and gates access to unwanted knowledge only when generation enters a forget-related state. ARIA uses sparse autoencoder (SAE) latents to train a lightweight linear detector, then applies an interpretable intervention on triggered states with negligible test-time overhead. Empirical evaluations on TOFU, R-TOFU, and WMDP show that ARIA improves the forget-retain trade-off over weight-based baselines across both a thinking model (DeepSeek-R1-Distilled-Qwen-1.5B) and an instruction model (Gemma-3-1B-it), e.g., reducing WMDP-cyber forget-set accuracy significantly while keeping MMLU within 1% of the pre-unlearning model. We further introduce three post-unlearning adversarial attacks targeting weight-space and decoding-space recovery, and find that ARIA remains robust under all three, with forgetting changing by less than 1% under attack. A feature-level case study leveraging the interpretability of ARIA suggests that some retain degradation may reflect response styles underlying the unlearning data rather than leakage of the targeted knowledge itself, highlighting a potential source of bias in unlearning task construction.
72. 【2609.16204】Decoy Direction Optimization: A Post-Hoc Defense Against LLM Abliteration
链接：https://arxiv.org/abs/2609.16204
作者：Aashiq Muhamed,Mona T. Diab,Virginia Smith
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：attack success rate, preserving model capability, high attack success, open-weight language models, linear refusal direction
备注：
点击查看摘要
Abstract:Safety guardrails in open-weight language models can be readily bypassed using Refusal Feature Ablation (RFA), a technique that identifies and projects out a linear refusal direction from the residual stream, often achieving a high attack success rate (ASR) while preserving model capability. Defending against these attacks typically requires computationally expensive safety finetuning for every new checkpoint. We introduce Decoy Direction Optimization (DDO), a fast, post-hoc weight-editing defense that requires no base-model finetuning. Our approach is based on a simple mechanistic insight: ablation attacks rely on contrastive estimators to find the refusal direction. Rather than trying to hide the true refusal circuitry, DDO actively injects a high-magnitude, nonlinear decoy signal into the network's MLP neurons. When an attacker attempts to locate the refusal direction, the decoy corrupts their estimator, tricking them into ablating a harmless orthogonal feature while the actual safety mechanism remains intact. We prove a spectral bound formalizing this effect and evaluate DDO across six model families, achieving 10% ASR under standard RFA. On Llama-3-8B-Instruct, DDO remains comparable to trained defenses under adaptive multi-phase attacks (65% vs. 58% worst-case ASR) and reduces Heretic weight-level attack ASR from 88.7% to 18%, all at 30 to 450 times lower optimization cost per configuration than the trained baselines.
信息检索
1. 【2609.17366】Lexplorer: Navigating the Complexity of Legal Document Landscapes
链接：https://arxiv.org/abs/2609.17366
作者：Daniel Fürst,Titus Pünder,Maximilian T. Fischer,Corinna Coupette
类目：Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
关键词：social innovations create, regulatory challenges, grow in complexity, technological and social, social innovations
备注： 32 pages, 10 figures, 3 tables
点击查看摘要
Abstract:As technological and social innovations create novel regulatory challenges, legal systems grow in complexity - increasing the need for interfaces that enable effective interactions with legal document collections. Through interviews with legal scholars (n=15), we find that supporting legal work requires going beyond retrieval-centered legal-information-system paradigms. Hence, we propose Lexplorer, a flexible interface for exploring, navigating, and analyzing legal documents, based on a taxonomy capturing user intents. Distinguishing text and data views for one, few, and many documents, Lexplorer enables context-sensitive interactions with evolving collections of interconnected legal texts, facilitating Adaptive Meaning Construction in law. We evaluate Lexplorer with legal scholars (n=20) in the context of European Union law, validating our elicited requirements, intent taxonomy, and prototype design. Resulting from a close collaboration between visual-analytics researchers and legal scholars, our work also provides nuanced insights into the process required to design interactive systems for expert domains driven by implicit methodological knowledge.
2. 【2609.17043】Diagnosing the Fact-Grounding Gap in Multi-Hop Question Answering
链接：https://arxiv.org/abs/2609.17043
作者：Kevin Mo,Nathan Mo,Richard Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：answering requires combining, requires combining information, answer complex questions, question answering requires, answering requires
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Multi-hop question answering requires combining information from multiple documents to answer complex questions. These systems have grown increasingly capable, yet when they fail, the error is typically attributed to not finding the right documents. Whether this holds at the level of individual reasoning steps remains largely unexamined. We investigate this across three standard multi-hop QA benchmarks and find that failures decompose into two distinct modes: retrieval failures, where the needed passage was not retrieved, and extraction failures, where the passage was retrieved but the needed fact could not be extracted - a phenomenon we term the fact-grounding gap. Extraction failures account for nearly half of all per-hop deficiencies and are invisible to standard retrieval metrics. They remain unresolved by every retrieval intervention we test, establishing a ceiling for retrieval-only improvements. The gap's severity varies across benchmarks and question types, but extraction failures appear on every dataset we measure. Our findings reveal that retrieval failures and extraction failures are fundamentally different bottlenecks requiring different solutions - a distinction absent from current evaluation practice.
3. 【2609.16850】Efficient Swing Computation for Retrieval in Large-Scale Recommender Systems
链接：https://arxiv.org/abs/2609.16850
作者：Runhao Jiang,Renchi Yang
类目：Information Retrieval (cs.IR)
关键词：evaluate their similarity, structure to evaluate, ASC, Swing, computing Swing scores
备注： 23 pages. The technical report for the paper titled "Efficient Swing Computation for Retrieval in Large-Scale Recommender Systems" in SIGMOD 2027
点击查看摘要
Abstract:Given a user-item graph $G$, a query item $v_q$ and a target item $v_t$, the Swing score $sw(v_q, v_t)$ of the item pair $(v_q, v_t)$ leverages the user-item-user interaction structure to evaluate their similarity. This measure is found to be highly effective in item-to-item (i2i) retrieval task and finds extensive applications in industrial-scale recommender systems. However, existing solutions towards computing Swing scores are either prohibitively expensive due to their quadratic time complexity w.r.t. the item degree, or rely on truncation heuristics that yield unsatisfactory quality, rendering them impractical particularly on graphs with billions of interactions. In this paper, we present ASC and $K$-ASC, two novel and efficient algorithms for approximate and top-$K$ Swing queries, to address the aforementioned limitations. Specifically, these algorithms provide rigorous theoretical guarantees in probabilistic relative and additive errors of Swing values. The basic idea of ASC is to combine two randomized algorithms, GNS and USS, in a simple yet non-trivial way to adaptively process high- and low-degree query items with minimal runtime cost. In particular, $K$-ASC offers practical efficiency and effectiveness for top-$K$ queries through a filter-refinement paradigm with carefully-designed heuristics. Extensive experiments over eight real datasets demonstrate that ASC and $K$-ASC can achieve orders of magnitude speed-up over competitors in terms of computational time while offering the same approximate and top-$K$ query result quality, and in particular, $K$-ASC is highly efficient on massive graphs including the billion-edge Yambda and MAG datasets.
Comments:
23 pages. The technical report for the paper titled “Efficient Swing Computation for Retrieval in Large-Scale Recommender Systems” in SIGMOD 2027
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2609.16850 [cs.IR]
(or
arXiv:2609.16850v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.16850
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
4. 【2609.16847】RegRet: Enhancing Region-Level Retrieval in Large Multimodal Models
链接：https://arxiv.org/abs/2609.16847
作者：Xun Liang,Honghui Yang,Weihang Pan,Ruisi Zhao,Boyuan Pan,Yao Hu,Wenxiao Wang,Binbin Lin,Deng Cai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：user-specified image regions, align user-specified image, e-commerce product search, search and RAG, Large Multimodal Models
备注： Accepted by ECCV 2026. 22 pages, including references and appendix
点击查看摘要
Abstract:Region-level retrieval aims to align user-specified image regions with relevant regions or textual descriptions, playing a crucial role in realworld applications such as e-commerce product search and RAG. Although recent Large Multimodal Models (LMMs) have made significant strides in multimodal retrieval, they primarily focus on global-level tasks and struggle to capture effective region-level representations. To bridge this gap, we present RegRet, an LMM-based Region-level Retrieval framework that enhances the regional representations without compromising overall global retrieval performance. At its core, RegRet integrates a Region-Aware Encoder to capture detailed regional features while balancing them with the global background context. To further enhance the fine-grained understanding and discriminability of representations, we design a multi-stage training pipeline that includes detailed localized captioning and regional contrastive learning tasks. In addition, considering the absence of region-level contrastive training data and the limited diversity of evaluation tasks in current benchmarks, we introduce the REGMB benchmark. It comprises 225k contrastive pairs, covering four multimodal retrieval tasks. Extensive experiments validate the effectiveness of our approach. RegRet outperforms strong baselines in the zero-shot setting. Further training with contrastive learning leads to an average improvement of more than 20\% on both REGMB and public benchmarks, while achieving comparable or better results on global-level retrieval tasks.
5. 【2609.16814】Can We Do Interpretable NLI with Graphs Based on Atomic Propositions?
链接：https://arxiv.org/abs/2609.16814
作者：Younes Boufouss(LISN),Luc Pommeret(LISN, CNRS),Thomas Gerald(LISN),Patrick Paroubek(LISN, CNRS),Sophie Rosset(LISN, CNRS)
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Natural Language Inference, based Natural Language, lack auditable structures, Large Language Model, based Natural
备注：
点击查看摘要
Abstract:While Large Language Model (LLM)-based Natural Language Inference (NLI) systems achieve high accuracy, their decision-making processes lack auditable structures. This paper explores whether NLI can be performed using only interpretable, graph-based representations of evidence. We introduce a fully graph-based pipeline where the classifier never directly processes the input text. Instead, sentences are decomposed into atomic propositions, converted into ConceptNet triples via constrained decoding, and represented as three graphs per pair: premise, hypothesis, and a retrieved ConceptNet subgraph. These graphs are then fed into a fine-tuned 0.8-billion-parameter language model. On the SNLI dataset, our pipeline achieves 89.7% accuracy, just 1.9 points below an identically trained text-based model. On ANLI, it matches the published performance of RoBERTa-large on rounds R2 and R3 (50% accuracy) but trails by 16 points on R1, resulting in an overall gap of 9 to 14 points compared to its text counterpart. We term this gap the price of interpretability and demonstrate that it stems from representational limitations rather than data constraints. Ablation studies further reveal that graphs and text are complementary: combining both modalities achieves 92.1% accuracy on SNLI.
6. 【2609.16730】LSREP: A Longitudinal State-Replay Protocol for Evaluating Conversational Memory, with ICE v2 as an Audited Local-First Architecture
链接：https://arxiv.org/abs/2609.16730
作者：Deepesh Sonar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：persistent state accumulates, endpoint question answering, Conversational memory, Longitudinal State-Replay Evaluation, State-Replay Evaluation Protocol
备注： 37 pages. Code and evaluation artifacts: [this https URL](https://github.com/Deepnar/ice) . The exact system snapshot used for the reported results is preserved in the "v2-paper-eval" tagged release
点击查看摘要
Abstract:Conversational memory changes during use, so endpoint question answering alone cannot establish how a persistent state accumulates, ages, or incorporates revisions. We introduce LSREP, a Longitudinal State-Replay Evaluation Protocol combining ordered replay, explicit lifecycle schedules, repeated probes, evolving reference answers, and mechanism-fidelity checks. Its architectural case study is ICE v2, a local-first memory middleware with typed stores, retrieval fusion, and dynamic context budgets. The private, single-user instantiation contains 1,985 turns, 219 distinct probes, and 1,211 probe-checkpoint observations across 52 checkpoints. On three ordinary-density datasets, ICE v2 has a near-zero mean quality difference from vector-RAG while selecting 32% fewer fragments but using 6.6% more estimated prompt tokens. A fourth, dense dataset exposes catastrophic failures of the unbudgeted baseline. The fidelity audit limits attribution: procedural retrieval is defective, several mechanisms are unexercised, and graph utility is not established. In a complementary matched public diagnostic, ICE v2 loses decisively to pure vector-RAG on LongMemEval: 50.8% versus 72.8% in the evidence-only oracle and 43.0% versus 69.5% in full-S. Paired differences are -22.0 points (95% CI [-26.6, -17.4]) and -26.5 ([-31.3, -21.8]). Conservative abstention accompanies severe multi-session and temporal failures. ICE uses less context in this diagnostic, establishing a quality-cost trade-off rather than superior efficiency. Together, replay, fidelity auditing, and public endpoint testing expose distinct failure modes that neither architectural descriptions nor aggregate scores identify alone.
7. 【2609.16627】Quantifying Organizational Environmental Action from Web Data and Large Language Models
链接：https://arxiv.org/abs/2609.16627
作者：Quinn Reynolds,Daniel Shore,Vianey Leos Barajas,Tanhum Yoreh,Meredith Franklin
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：data science problem, Quantifying organizational environmental, Quantifying organizational, LLM classification, challenging environmental data
备注： 22 pages, 6 figures, appendices
点击查看摘要
Abstract:Quantifying organizational environmental action from publicly available web content remains a challenging environmental data science problem because relevant information can be dispersed across multiple webpages and is primarily communicated through unstructured text. We present a scalable computational framework for transforming organizational web content into structured measures of environmental action and demonstrate the approach using Jewish congregations in the United States. We constructed a national database of 4,964 congregations by integrating multiple geospatial, knowledge-base, directory, and manually reviewed sources. Of these, 2,657 had active websites that were successfully crawled, producing a corpus of 154,454 webpages. We compared three approaches for detecting environmental actions: keyword retrieval followed by large language model (LLM) classification, semantic vector retrieval followed by LLM classification, and direct LLM classification classification without preliminary retrieval. Agreement with an expert human reviewer was lowest for keyword retrieval ($\kappa$ = 0.26), higher for semantic vector retrieval ($\kappa$ = 0.42), and similar for direct LLM classification ($\kappa$ = 0.40). Although semantic retrieval achieved the highest agreement, its retrieval recall was 0.87, indicating loss of relevant content before classification. Applied to the complete corpus, direct LLM classification identified at least one environmental action at 1,398 congregations (53%), providing greater coverage than either retrieval-based approach. These results demonstrate that preliminary retrieval can reduce computational cost but may exclude relevant information before it reaches the classifier. The framework provides a reproducible approach for extracting organization-level environmental information from unstructured web content that can be adapted to other institutions.
8. 【2609.16625】AURA: Agentic Diagnosis and Refinement for Production Recommender Systems at Scale
链接：https://arxiv.org/abs/2609.16625
作者：SungGeun Kim,Abhinav Narain,Daniel Nemirovsky
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：recommender, recommender system, recommender system fail, production recommender systems, system
备注： 14 pages, 1 figure, 6 tables. Accepted at GenAIECommerce'26: The Third Workshop on Agentic and Generative AI for E-Commerce, co-located with RecSys 2026, September 28, 2026, Minneapolis, MN, USA
点击查看摘要
Abstract:How and why does a recommender system fail the users it serves? Oftentimes, practitioners are left to improve their algorithms based on a combination of feedback from stakeholder teams, domain expertise, and insights from data analyses. Yet the nuances of how and where recommendations perform well or poorly for end users are difficult to discern from aggregate quantitative metrics. Whereas these metrics provide a high-level and incomplete picture, further granularity into the quality of recommendations and their patterns requires reasoning with domain understanding and objectivity, at scale. We contemplate this complex conundrum and describe a method and implementation that uses the latest AI agentic advances to provide actionable diagnoses and improvements for production recommender systems. We present AURA (Agentic Understanding and Refinement of recommender Algorithms), an end-to-end agentic system that performs qualitative evaluation at scale and can then generate improvements to our algorithms at the code level. Specialized agents read production engagement logs, from thousands of sessions to millions, and surface patterns and examples of how the recommender fails real users. The next step uses those diagnoses and context about the recommender's own code, data, and training pipeline to propose and implement refinements grounded in that codebase. We report the system design, initial tests on production data from two large consumer platforms at a major media-streaming company, safeguards, operational learnings, and early results toward a self-improving recommender system. Finally, the diagnostic gap AURA closes is not specific to streaming. The architecture is built to transfer: every domain-specific element enters through the configuration layer that already ported it between our two platforms. We map it concretely to e-commerce and online-retail recommendation.
9. 【2609.16607】Measuring Decision-Scale Use in Tool-Augmented LLMs: A Contrastive Urban Benchmark
链接：https://arxiv.org/abs/2609.16607
作者：Ray Chen,Vivian Wong,Christan Grant
类目：Information Retrieval (cs.IR)
关键词：unusually high, high or low, Abstract, Urban decision-support, specific place
备注：
点击查看摘要
Abstract:Urban decision-support often asks whether activity is unusually high or low for a specific place, not which place has the larger raw count. Twenty pickups in a quiet neighborhood can be more abnormal than 180 at an airport. We introduce URBANCONTRASTIVEQA, a benchmark that asks whether tool-augmented language models can make this baseline-relative comparison. Each item pairs two urban situations from public mobility data in NYC, Chicago, and Seattle, labeled by how far current activity deviates from that place's historical baseline. We evaluate six instruction-tuned models under five tool-output formats. With only raw counts, models often pick the larger number even when it is less abnormal for its zone. Server-computed baseline scores and ordinal labels raise accuracy, but gains vary by model. For heterogeneous urban feeds, tool interfaces need to expose local baselines, not just activity volumes. We release the pair bank, labels, scoring scripts, and data card.
10. 【2609.16560】ReliGRec: Reliability-Oriented LLM-Based Generative Recommendation via User-Risk-Aware Prompt Routing
链接：https://arxiv.org/abs/2609.16560
作者：Haoran Yang,Fei Chen,Yutian Xiao,Jiahao Liang
类目：Information Retrieval (cs.IR)
关键词：real-world recommender systems, systems is heterogeneous, Cautious Prompt, Reliability-oriented Generative Recommendation, Behavior Token
备注：
点击查看摘要
Abstract:User behavior in real-world recommender systems is heterogeneous. While some users exhibit coherent preferences, others show abrupt interest shifts, bursty interactions, excessive repetition, or inconsistency with collaborative neighborhoods. Such deviations may arise from benign variation or manipulation, including shilling attacks, but do not alone establish malicious intent. Existing robust recommenders exploit user-risk signals through training-time reweighting or graph aggregation, whereas adapting generation to estimated user-level weak risk remains underexplored in LLM-based generative recommendation. We propose ReliGRec (Reliability-oriented Generative Recommendation), a weakly supervised framework whose name denotes its design goal rather than a supervised reliability variable. ReliGRec derives user-level weak-risk proxy labels from review-feedback signals for a subset of users and represents sequential behavior and collaborative context using a Behavior Token and temporal Graph Tokens, respectively. A Dual-View Weak-Risk Estimator fuses the representations to produce a user-level weak-risk score that selects a Simple or Cautious Prompt at inference. The Cautious Prompt is designed to encourage attention to stable, collaboratively supported evidence while reducing overreliance on isolated, short-term, or repeated interactions. The Behavior Token affects generation through weak-risk estimation and routing, whereas the aggregated Graph Token provides collaborative context for next-item Semantic ID generation. ReliGRec thus turns weak-risk estimation from an auxiliary prediction into a generation-time control signal. Experiments report competitive recommendation and weak-risk proxy-label prediction, while routing analyses characterize the recommendation-quality and inference-cost behavior of weak-risk-guided prompting.
11. 【2609.16453】Predicting Partial Answer Quality and Utility in Agentic Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2609.16453
作者：Fangzheng Tian,Debasis Ganguly,Craig Macdonald
类目：Information Retrieval (cs.IR)
关键词：Agentic Retrieval-Augmented Generation, iteratively issues queries, incorporates newly retrieved, newly retrieved context, partial answer quality
备注： 12 pages, 5 figures, 4 tables, this paper has been accepted by CIKM'26 as a full paper
点击查看摘要
Abstract:Agentic Retrieval-Augmented Generation (RAG) has become a promising paradigm for multi-hop question answering, where a reasoning model iteratively issues queries to a retriever and incorporates newly retrieved context into subsequent reasoning steps. While this iterative process can improve final answer quality, current evaluations of agentic RAG largely focus on end-to-end outcomes and provide limited visibility into how a model's answer state changes during generation. In this work, we introduce an in-trajectory probing framework to study intermediate answer states in agentic RAG. Specifically, after each retrieval-reasoning iteration, we force an agentic model to stop reasoning and generate an intermediate answer based on its current state. This allows us to define two iteration-level measures: partial answer quality at each iteration, and partial utility as the change in partial answer quality across iterations. Our analysis across multi-hop QA benchmarks reveals that partial answer quality often plateaus before natural termination, with many later iterations contributing only small measurable improvements. Accordingly, we formulate two prediction tasks, partial answer quality prediction and partial utility prediction, and study trajectory-derived signals from intra-iteration, inter-iteration, and query-iteration perspectives. Experiments show that partial answer quality is more predictable than partial utility, with supervised models achieving Pearson's r above 0.43 for quality prediction. Finally, using predicted answer quality and utility for early stopping reduces average iteration count by about 11% while preserving about 98% of the final answer quality achieved by natural stopping.
12. 【2609.16452】PCap: Personalized Retrieval-Stage Diversity Capping in Facebook Marketplace
链接：https://arxiv.org/abs/2609.16452
作者：Guangchao Yuan,Janis Fuh,Christopher Choate,Xun Tang,Wenqi Zhu,Chengyi Zhang,Pavan Kumar Paalya Chandrashekar,Jiang Han,Jiangyuan Li,Hongyan Wang,Shuting Wang
类目：Information Retrieval (cs.IR)
关键词：Facebook Marketplace, personalized capping framework, Marketplace by introducing, user-level diversity constraints, introducing user-level diversity
备注： 5 pages, 2 figures, 3 tables
点击查看摘要
Abstract:We propose a personalized capping framework (PCap) to improve the diversity in Facebook Marketplace by introducing user-level diversity constraints at the retrieval stage. PCap models individual diversity preferences using Shannon entropy-based scoring, segments users into diversity buckets, and applies personalized category caps during multi-source candidate retrieval. To navigate the high-dimensional parameter space of per-bucket caps, we leverage an automated online optimization method called Parameter Tuning Sequence. Large-scale online experiments demonstrate that PCap significantly improves users' browsing experience shown in engagement metrics. This work provides practical insights into integrating personalized diversity into industrial retrieval systems.
13. 【2609.16407】Balancing Trial and Reorder: A Hybrid Sequential Transformer-GBDT Ranker for On-Demand Delivery
链接：https://arxiv.org/abs/2609.16407
作者：Marcel Kurovski,Attila Nagy,Steffen Klempau,Aleksandr Fedintsev
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Merchant Trial Rate, ranking greatly influences, personalized store ranking, Merchant Trial, Trial Rate
备注： 10 pages, 4 figures, 5 tables
点击查看摘要
Abstract:On a delivery platform, personalized store ranking greatly influences what users find and order. Unlike digital-only domains, candidate stores are local and bound by real-time availability and delivery operations. One central modeling tension is between surfacing new stores for trial and preserving ranking quality for sessions with reorder intent. We present Universal Venue Ranker (UVR), a production system deployed at Wolt that pairs a bidirectional transformer encoder for sequential user modeling with a GBDT ranker integrating contextual, user, and store features. Trained across all stores and domains of a country while enforcing local delivery constraints at inference, UVR replaces four previously separate ranking models (three for restaurants, one for retail) with a single unified system. Label smoothing and trial-biased sample weighting steer the model toward new stores, lifting offline trial MRR by +12% to +30% over production while regressing reorder MRR in five of six countries. These regressions leave Global CVR, our core online metric, which blends trial and reorder sessions, statistically unchanged. We validate UVR in three consecutive A/B tests, the first two across Wolt's largest operating markets and the third spanning all operating countries and both domains. UVR V1 delivers +5.5% Merchant Trial Rate and +0.16% Global CVR over the previous production ranker; V2 adds a further +0.45% Merchant Trial Rate on top; and V3, our cross-domain unification of the restaurant and retail rankers, adds a further +1.31% Retail Merchant Trial Rate, together accounting for substantial incremental gross order value and a materially simplified serving stack.
计算机视觉
1. 【2609.17521】PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control
链接：https://arxiv.org/abs/2609.17521
作者：Chuhao Chen,Peter Wonka,Chaoyang Wang,Chen Wang,Qiao Feng,Sergey Tulyakov,Lingjie Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)
关键词：physically meaningful manipulation, physically meaningful, moving from coarse, coarse prompts, meaningful manipulation
备注：
点击查看摘要
Abstract:Interactive control for video generation is moving from coarse prompts toward fine-grained, physically meaningful manipulation of dynamic scenes. Yet existing controllable methods either require the full control schedule before generation starts, or use pixel-space signals that dictate object positions rather than physical dynamics. To address these limitations, we propose PhysStream, an autoregressive model for physics-grounded image-to-video synthesis that incorporates structured scene memory---positional maps and object tracking maps derived online from previously generated frames---and supports fine-grained motion control via sparse velocity-increment signals that encode physical quantities, letting the model learn the underlying dynamics. We train our model in two stages: a bidirectional model is first finetuned with motion-control conditioning, then a causal autoregressive model is trained with additional structured scene memory, further improving physical consistency. PhysStream enables interactive, mid-generation control over multi-object tabletop rigid-body scenes---a capability not supported by prior methods---reducing motion distribution distance (FVMD) by 33% and trajectory error by 12% over the strongest baselines on synthetic benchmarks, and is preferred by human evaluators in over 85% of in-the-wild comparisons. Please check our website for more details: this https URL
2. 【2609.17479】Det-LIME: Detector-Aware, Multi-Instance Local Interpretable Model-Agnostic Explanations for Automated Marine Mammal Detection
链接：https://arxiv.org/abs/2609.17479
作者：Jiayi Zhou,David W. Johnston,Brinnae Bent
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：black-box object detectors, marine mammal research, research and monitoring, conservation workflows, rapid uptake
备注：
点击查看摘要
Abstract:Despite the rapid uptake of black-box object detectors in marine mammal research and monitoring, explainability techniques are rarely integrated into conservation workflows. Furthermore, most classification-oriented explainability tools are ill-suited to detection tasks involving imagery of social organisms or those with colonial life histories, as they ignore multiple detections within a scene and produce single-instance outputs that blur evidence across individuals. These methods also generate low-resolution, often biologically irrelevant visuals, limiting their utility for debugging, targeted data augmentation, and refined data collection. We proposed Det-LIME, a detector-aware, multi-instance adaptation of Local Interpretable Model-Agnostic Explanations (LIME) that produced instance-specific, box-aligned explanations by combining per-detection weighting, a proximity kernel that emphasizes regions near each box, and Intersection-over-Union-based matching to track the same instance across perturbations. We evaluated Det-LIME on aerial drone imagery for harbor seal detection, with an additional seabird case study to assess generality, and compared it with vanilla LIME, Stabilized LIME, Deterministic LIME, and gradient-based attribution methods. Using the Attribution Ratio and Max Saliency Hit Rate metrics, we showed that Det-LIME consistently improved multi-instance attribution. In practice, these higher-resolution, instance-aware explanations provide insight into model outputs and support post-processing, debugging, and actionable improvements in modeling and data collection or augmentation.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.17479 [cs.CV]
(or
arXiv:2609.17479v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.17479
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.1111/mms.70276
Focus to learn more
DOI(s) linking to related resources</p>
3. 【2609.17458】ables Decoded: DELTA for Structure, TARQA for Understanding
链接：https://arxiv.org/abs/2609.17458
作者：Jahanvi Rajput,Dhruv Kudale,Saikiran Kasturi,Utkarsh Verma,Ganesh Ramakrishnan
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：visual question answering, table visual question, encompassing two key, key subtasks, question answering
备注： Accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision 2026
点击查看摘要
Abstract:Table understanding is a core task in document intelligence, encompassing two key subtasks: table reconstruction and table visual question answering (TabVQA). While recent approaches predominantly rely on vision- language models (VLMs) operating on table images, we propose a more scalable and effective alternative based on structured textual representations. These representations are easier to process, align more naturally with LLMs, and eliminate the need for language-specific visual encoders, making them particularly suitable for multilingual documents. We present DELTA, which separates physical structure recognition, logical structure recognition, and OCR to extract both layout and content accurately. DELTA outputs tables in Optimised Table Structure Language (OTSL), a compact and unified format that encodes cell arrangements and textual content. On table structure recognition (TSR), DELTA achieves TEDS- Structure scores comparable with state-of-the-art methods across FinTabNet, PubTabNet, and PubTables-1M. We further establish its robustness on non-English tables through our curated Hindi benchmark, TORQUE. Building on this, we introduce TARQA, an LLM fine-tuned on OTSL sequences. Our approach yields gains of 9.3 p.p. on WTQ (TabQA) and 9.2 p.p. on FinTabNetQA (TabVQA), respectively. On TORQUE, our method ranks second among all VLMs and DELTA + LLM variants. We release our code, models, and benchmark at: this https URL
4. 【2609.17450】ORCA: Occlusion-Aware Refinement and Completion for Novel View Synthesis
链接：https://arxiv.org/abs/2609.17450
作者：Weronika Jakubowska,Maciej Zięba,Przemysław Spurek
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fundamentally ambiguous problem, ambiguous problem, fundamentally ambiguous, ORCA, scene
备注： 9 pages, 3 figures
点击查看摘要
Abstract:Novel-view synthesis from a single image is a fundamentally ambiguous problem. As the camera moves away from the input viewpoint, previously hidden regions become visible, exposing missing geometry and holes in the reconstructed scene. Existing methods often rely on generative models to complete such regions. However, many of these artifacts are small gaps near depth boundaries and do not require generating new scene content. In order to eliminate expensive process of generating image we introduce ORCA, an occlusion-aware method for reconstructing and completing explorable 3D scenes from a single image. ORCA first introduces 3D structure into a Gaussian-anchor representation using monocular depth while preserving the original camera-ray correspondence. During scene exploration, missing regions are handled based on their size and structure. Small disocclusions are repaired using RGB-D information already available in the reconstruction, while generative inpainting is reserved for larger regions that cannot be reliably recovered from the scene. New Gaussian anchors are added and optimized locally without modifying the existing representation. By reducing unnecessary reliance on generative inpainting, ORCA limits generation-induced hallucinations and better preserves the content and structure of the original scene. On DIV2K, ORCA improves novel-view quality over VistaDream across all reported metrics, increasing MUSIQ from 61.60 to 68.71 and CLIP-IQA from 0.474 to 0.574. These results show that many novel-view artifacts can be repaired effectively by reusing information already present in the reconstructed scene.
Comments:
9 pages, 3 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.17450 [cs.CV]
(or
arXiv:2609.17450v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.17450
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
5. 【2609.17443】BrainFocus: EEG-Guided ROI Selection for Efficient Vision-Language Models
链接：https://arxiv.org/abs/2609.17443
作者：Yihui Peng,Guorui Lu,Qinyu Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieve strong visual, visual question answering, strong visual question, processing large cluttered, Vision-language models
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) achieve strong visual question answering (VQA) performance, but processing large cluttered images is computationally expensive when only a small region is relevant. Electroencephalography (EEG) signals, which capture human neural responses to visual stimuli, can provide a human-derived semantic cue about the region of interest (ROI). However, EEG-guided visual category decoding remains imperfect, making direct ROI routing unreliable. In this work, we propose BrainFocus, a reliable EEG-guided efficient VLM framework for VQA. An EEG classifier predicts a target category, and a YOLO detector localizes the matching ROI. The VLM receives the cropped ROI only when both predictions pass confidence thresholds; otherwise, it processes the full image. For evaluation, we build on EEG-ImageNet to construct a 40-class benchmark comprising generated cluttered images and real object-centric images, with target-ROI annotations and 600 English visual question-answer pairs. Across Qwen3.5-VL 2B, 4B, and 9B models, BrainFocus improves VQA accuracy by 4.14-9.87 percentage points (pp) on cluttered scenes while reducing input tokens and total tokens by 23.2%-39.4% and 23.2%-39.3%, and end-to-end floating-point operations (FLOPs) by 23.2%-39.5%. These results demonstrate that EEG can guide efficient VLM inference even when its semantic decoding is imperfect.
6. 【2609.17427】racking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion
链接：https://arxiv.org/abs/2609.17427
作者：Mais Mohammed,Sharifa Mohammed,Hanan Awadh,Haneen Bamaas,Raghad Bawazeer,Elham Alghamdi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Real-time multi-object tracking, remain highly vulnerable, Real-time multi-object, systems remain highly, field of view
备注： 25 pages, 10 figures, 7 tables
点击查看摘要
Abstract:Real-time multi-object tracking systems remain highly vulnerable to full and long-term occlusion, where targets temporarily or completely disappear from the camera's field of view. Conventional trackers may terminate trajectories prematurely, resulting in identity loss and reduced situational awareness in applications such as defense and surveillance. This work proposes an occlusion-robust target tracking framework that maintains target identity and trajectory continuity through the integration of YOLOv11n object detection, Kalman Filter motion prediction, and occlusion-aware appearance-based re-identification. The framework consists of three stages: object detection, position estimation during occlusion, and identity recovery after target reappearance. Six Re-Identification (Re-ID) architectures were evaluated within the same tracking framework under identical conditions, with the Occlusion-Aware Mask Network (OAMN) achieving the best overall performance and therefore selected for the final pipeline. The framework was benchmarked against OccluTrack on the public OVIS dataset, achieving relative improvements of 18.1 percent in Multiple Object Tracking Accuracy (MOTA) and 25.1 percent in Identity F1 Score (IDF1), while reducing identity switches by 12.8 percent. On a custom military dataset simulating surveillance and battlefield-like environments with long-term occlusion, the framework achieved a MOTA of 0.734 and an IDF1 of 0.729, corresponding to relative improvements of 14.2 percent and 5.8 percent over OccluTrack. The system demonstrated strong tracking continuity, robust identity preservation, and reliable trajectory estimation under challenging occlusion conditions, highlighting its effectiveness for defense-related surveillance applications requiring continuous target tracking during visibility loss.
7. 【2609.17417】Knowledge as Orbit: Finite Collections as Phases of an Exactly Periodic Latent Generator
链接：https://arxiv.org/abs/2609.17417
作者：Siddharth Pal,Viktoria Rojkova
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：code or vector, stored extensionally, discrete Fourier operator, Finite, stored
备注： 9 pages, 2 figures
点击查看摘要
Abstract:Finite knowledge is usually stored extensionally, one code or vector per item. We ask whether a finite collection can instead be stored intensionally, as the decoded orbit of one compact law that returns exactly to its start. For X objects, we encode item i as the i-th phase of a fixed rotation in a learned latent space and decode all phases with a shared network; the latent advances through a bank of rotations at integer harmonics of the cycle, a real discrete Fourier operator, so that R^X equals the identity and exact closure is guaranteed rather than learned. Images are a controlled carrier; looping video is the case where the phase order is the content's own temporal structure. Holding the decoder fixed and varying only the operator, a general learned operator diverges, a norm-preserving but non-periodic one degrades around the loop, and the exactly periodic operator is flat; on real images the gap widens. Capacity is then the decoder's budget: dense decoders carry a structural overhead per crisp image that no size reconciles with compression, while a small convolutional decoder on objects that share a manifold reaches crisp and compressed. A codebook control shows the generative law is free in reconstruction terms while multiplying the latent store many-fold. On seven benchmark clips, against a matched frame-index baseline, the cycle reaches equal or better fidelity at equal parameters while wrapping at machine precision, where the baseline leaves a visible seam; pinning the baseline's frequencies to loop harmonics closes its seam too, confirming that exact periodicity is the operative constraint. Finite cyclic knowledge can be stored as dynamics rather than independent instances, with exact recurrence supplied by algebra and content by a shared decoder.
8. 【2609.17414】SlotDiT: Object-Centric Representations for Diffusion Transformers
链接：https://arxiv.org/abs/2609.17414
作者：Gjergj Plepi,Sven Behnke
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Text-conditioned latent diffusion, Text-conditioned latent, models perform strongly, perform strongly, promising backbones
备注： Accepted at BMVC 2026. Project page: [this https URL](https://slot-dit.github.io/)
点击查看摘要
Abstract:Text-conditioned latent diffusion models perform strongly in video generation and are promising backbones for robotic applications. However, existing approaches rely on pixel-level or VAE-based latent representations that lack explicit semantic structure, leaving the impact of the representation space largely unexplored. Slot-based object-centric representations offer a structured alternative by decomposing scenes into object-level latents, or slots. While they have shown success in dynamics modeling and planning, they have not yet been explored for diffusion-based generative modeling. We introduce SlotDiT, a text-guided Diffusion Transformer (DiT) that operates in a slot-based latent space. Given a reference image and a language instruction, SlotDiT decomposes the scene into object-centric slots representing individual entities. Conditioned on the instruction and observed scene context, the model autoregressively denoises future slot trajectories to predict scene dynamics. To systematically investigate latent-space design for diffusion transformers, we compare slot-based representations against VAE-based and semantics-aligned alternatives within a unified DiT framework. Our experiments show that using slots as DiT latents yields competitive video generation quality while consistently improving task-completion rates across four robotic datasets. Furthermore, their compact representation provides a computationally efficient alternative to VAE-based and semantics-aligned latent spaces. Overall, our results demonstrate that object-centric structure is a powerful inductive bias for diffusion-based generative modeling in robotic environments. The project page is available at this https URL.
9. 【2609.17413】SSC-Priors: Exploring Semantic and Visibility Priors to Boost Lidar Semantic Scene Completion
链接：https://arxiv.org/abs/2609.17413
作者：Tetiana Martyniuk,Jonathan Seele,Alexandre Boulch,Gilles Puy,Renaud Marlet,Raoul de Charette
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：paper investigates easy, investigates easy strategies, semantic scene completion, complex architectural redesigns, scene completion
备注： Extended version of [arXiv:2606.03992](https://arxiv.org/abs/2606.03992)
点击查看摘要
Abstract:This paper investigates easy strategies to boost the performance of existing networks for lidar semantic scene completion (SSC) without requiring complex architectural redesigns. The fact is that, over the last years, SSC methods have mostly pursued architectural innovations, making the models heavier and more complex, e.g., by jointly training a point cloud semantic segmentation branch. In this work, we take a step back and explore two priors used as simple ingredients (possibly noisy) to improve existing approaches: semantic pseudo-labels and sensor visibility information. Concretely, we provide both kinds of information directly as additional inputs to a given SSC network, requiring only a minimal adaptation of the original architecture. We first demonstrate that endowing input point clouds with semantic pseudo-labels from off-the-shelf segmenters significantly improves the performance of existing SSC models. In fact, by evaluating these models against an oracle, we establish that high-quality semantic priors are a primary driver of semantic gains (mIoU), and that the SSC model can be trained just once with ground-truth semantics and then exploited without retraining using any segmenter. Furthermore, we equip the input lidar point cloud with visibility information that distinguishes between empty spaces (between the lidar and a scanned point) and unknown spaces (outside of lines of sight), providing a secondary performance boost across the tested architectures. We study the design space of data for representing visibility information and bound the remaining headroom with a ground-truth oracle on the free-space labels. On SemanticKITTI, these enhancements make older models competitive with state-of-the-art systems across four architectures, in one case even outperforming them. On the SSCBench-nuScenes benchmark, both priors also transfer with the sparser 32-beam sensor.
10. 【2609.17387】PanoGS-SLAM: Panoramic 3D Gaussian Splatting SLAM
链接：https://arxiv.org/abs/2609.17387
作者：Yongqi Mao,Hao Shi,Yufan Zhang,Zhonghua Yi,Xiangfei Guo,Kaiwei Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：require robust localization, Gaussian Splatting, Real-time dense SLAM, fast-changing environments, dense SLAM
备注：
点击查看摘要
Abstract:Real-time dense SLAM is a core capability for robotics applications that require robust localization and high- quality mapping in dynamic or fast-changing environments. Recent 3D Gaussian Splatting (3DGS)-based SLAM methods have shown promising performance, but most are designed for narrow-FoV pinhole cameras, where limited angular coverage weakens pose observability and often leads to unstable photo- metric optimization under rapid motion and large viewpoint changes. We present PanoGS-SLAM, the first panoramic dense SLAM system built on 3D Gaussian Splatting. Our method per- forms differentiable rendering and pose optimization directly in the spherical domain, enabling omnidirectional photometric constraints for more stable tracking. To improve geometric consistency and robustness, we introduce (1) a sphere-consistent photometric loss that compensates for the area distortion of equirectangular projection, and (2) a depth-guided Gaussian initialization strategy that stabilizes incremental mapping in newly observed regions. Extensive experiments on both real and synthetic panoramic benchmarks (PALVIO and SynPano) show that PanoGS-SLAM consistently outperforms geometric and GS-based baselines in tracking accuracy and rendering quality, while achieving fast front-end convergence and real-time perfor- mance. In addition, controlled field-of-view experiments reveal a clear monotonic improvement in optimization conditioning and convergence stability as angular coverage increases, high- lighting the fundamental role of sensing geometry in shaping the optimization landscape of differentiable Gaussian-based SLAM. The source code will be made publicly available.
11. 【2609.17308】Optical-Flow Wingbeat Counting in MuJoCo: A Comparison of Convolutional, Spiking, and Attention-Based Temporal Models
链接：https://arxiv.org/abs/2609.17308
作者：Zhang Nengbo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires distinguishing individual, vehicles requires distinguishing, distinguishing individual wingbeats, Visual monitoring, flapping-wing vehicles requires
备注： 12 pages, 1 figure, 7 tables. Controlled simulation study
点击查看摘要
Abstract:Visual monitoring of flapping-wing vehicles requires distinguishing individual wingbeats from motion strength and average frequency. This paper presents a controlled MuJoCo evaluation of wingbeat counting from signed optical flow observed by virtual cameras mounted on Crazyflie vehicles. Three flapping-wing models were recorded at optical distances of 1.5 and 3.0 m, producing 1,440 clips from 240 paired scene configurations with a scene-level 3:1 training-test split. A common spatial convolutional encoder was combined with a causal temporal convolutional network, a recurrent leaky integrate-and-fire spiking network, or causal self-attention. Each model predicted phase and activity, followed by the same directed-crossing event counter. The six existing convolutional models were retained, and all twelve new models were frozen before their test predictions were generated. Exact-count accuracies at 1.5 m were 96.67%, 95.00%, and 96.67%, respectively; at 3.0 m they were 94.44%, 92.22%, and 95.00%. All paired scene-bootstrap intervals for differences in exact-count accuracy included zero. Seven far-distance spiking-model clips had correct totals despite event-timing mismatches, demonstrating why total-count and event-level measurements must be reported together. The results support the feasibility of causal optical-flow counting in the tested setting and identify boundary-sensitive errors. They do not establish an architecture ranking across repeated training, real-flight robustness, or hardware efficiency.
12. 【2609.17269】Semantic-Spatial Agreement Verification for Mitigating Object Hallucination in Multimodal Large Language Models
链接：https://arxiv.org/abs/2609.17269
作者：Ziheng Ren,Qian Gao,Jun Fan,Guohui Ding,Zhenyu Yang,Yuteng Xiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, Multimodal large, mention objects absent, generate natural-language responses, language models generate
备注：
点击查看摘要
Abstract:Multimodal large language models generate natural-language responses from visual inputs, yet may mention objects absent from an image. In medication assistance, accessible perception, and environmental decision-making, such hallucinations can create real-world safety risks. We propose Semantic-Spatial Agreement Verification (SSAV), a training-free method for verifying object claims. A visually grounded claim should remain stable across semantically equivalent queries and repeatedly localize to the same image region. SSAV aggregates multiple prompts to estimate semantic support and reduce sensitivity to query wording. Query-Induced Regional Verification (QIRV) combines cross-query region persistence, spatial overlap, and relative candidate dominance to identify isolated high responses and dispersed localizations. A geometric mean fuses semantic and spatial evidence, lowering the verification score when either branch lacks support. Experiments on three base models and multiple evaluation protocols show that SSAV effectively mitigates object hallucination. On LLaVA-1.5-7B, accuracy averaged across COCO, A-OKVQA, and GQA improves by 1.81 and 3.17 percentage points under POPE Popular and Adversarial, respectively, while CHAIRs decreases from 49.40% to 32.80%. These results show that cross-query semantic stability and regional consistency provide interpretable external visual evidence for object claims.
13. 【2609.17257】Exploring 2D backbone effects for indoor semantic occupancy prediction
链接：https://arxiv.org/abs/2609.17257
作者：Shizhang Fanga,Wanling Yea,Qi Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：space is free, semantically meaningful, agent a voxel-level, voxel-level account, occupancy
备注：
点击查看摘要
Abstract:Semantic occupancy prediction gives an embodied agent a voxel-level account of where space is free, occupied, and semantically meaningful. In RGB-D pipelines such as EmbodiedScan, the image encoder is often left as a default module, even though its features are the visual evidence later sampled into the 3D grid. We study this design choice directly. A central finding is that changing the 2D backbone improves occupancy accuracy more than several carefully designed occupancy architectures or modules. We keep the main RGB-D projection, depth branch, and occupancy head fixed, and replace only the image backbone. The compared encoders are CLIP-ResNet, CLIP-ViT, BLIP2, and DINOv2. Under the controlled setting, the measured mIoU changes substantially: DINOv2 obtains 30.55\%, BLIP2 obtains 29.49\%, CLIP-ViT obtains 24.33\%, and CLIP-ResNet obtains 17.41\%. The stronger encoders also exceed the original EmbodiedScan ResNet-50 baseline without modifying the downstream 3D fusion pipeline. Class-level results give a more detailed picture: DINOv2 is stronger on many layout and structural categories, whereas BLIP2 remains close on several object-centered classes. CLIP-ViT improves clearly over CLIP-ResNet, showing that the way CLIP features are exposed as dense tokens matters for voxel lifting. These results indicate that the image backbone is not a secondary engineering detail in embodied semantic occupancy, but a major source of variation in the final 3D prediction.
14. 【2609.17248】Video-HolmesV2: Can MLLMs Reason with Spatio-Temporal Audio-Visual Evidence in Long Videos?
链接：https://arxiv.org/abs/2609.17248
作者：Zhaoyang Wei,Zipeng Wang,Yushe Cao,Chenhui Qiang,Shuaibing Cheng,Xuesong Yang,Sen Nie,Bowen Jiang,Wenchao Ding,Yanchao Hao,Zheng Wei,Xuehui Yu,Zhenjun Han
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, impressive video understanding, inefficient context processing, Multimodal Large
备注： Accepted by ECCV2026
点击查看摘要
Abstract:Multimodal Large Language Models have demonstrated impressive video understanding, yet their ability to reason over long-form narratives is often masked by visual-centric evaluations and inefficient context processing. Existing benchmarks over-rely on visual heuristics while marginalizing auditory cues, effectively reducing models to "silent observers" that bypass genuine cross-modal reasoning. Moreover, standard dense sampling creates an evidence-context trade-off: increasing frames to capture evidence inevitably leads to attention distraction and token explosion. To bridge these gaps, we present Video-HolmesV2, a novel benchmark designed for Deep Audio-Visual Coupling. Unlike previous works, it enforces an Evidence-Based Evaluation, requiring models to justify answers with precise spatio-temporal audio-visual evidence, thereby reducing confounding effects of guessing and hallucinated evidence. To support this, we introduce: (1) a Multi-Model Cross-Verification pipeline to ensure task rigor; (2) a Spatio-temporal Evidence-Aware Metric for fine-grained calibration. Furthermore, we propose an Audio-Text Guided Token Compression framework. By fusing task intent with auditory anchors, our method distills high-value reasoning cues to mitigate long-context noise. In our evaluation, even strong proprietary models achieve below 60% accuracy, while our approach outperforms comparable open-source omni-models.
15. 【2609.17230】DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming
链接：https://arxiv.org/abs/2609.17230
作者：Idil Sulo,Alexey Supikov,Ilke Demir,Sainan Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：existing methods undermine, reconstruction demands, goals that existing, demands both speed, undermine by updating
备注：
点击查看摘要
Abstract:Streaming 3D reconstruction demands both speed and temporal fidelity, goals that existing methods undermine by updating every Gaussian every frame, even in static regions. We present DecoGS, a method for efficient online training of 3D Gaussians from streaming videos. Unlike prior methods that update the entire scene indiscriminately, DecoGS introduces an adaptive mechanism that selectively focuses optimization on spatiotemporal regions exhibiting motion or photometric changes. This targeted training strategy eliminates redundant updates that cause flickering and drift in nominally static regions, while enabling fast, high-fidelity scene updates. The pipeline further integrates region-aware Gaussian management through gradient gating and efficient visibility filtering to maintain temporal coherence and a compact memory footprint. On N3DV and MeetRoom, DecoGS achieves 34.55 and 31.60 dB PSNR respectively, outperforming all streaming and offline baselines, while rendering at 261 FPS with $70\times$ lower temporal flicker than the best prior method, requiring no large-scale pretraining.
16. 【2609.17227】FROD: Feature Matching Residual Denoising Oracle Bone Decipher
链接：https://arxiv.org/abs/2609.17227
作者：Yanbin Hou,Biao Xiong,Guojun Xu,Jianwen Xiang,Cheng Tan,Yanchao Yang,Junwei Zhou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Chinese writing systems, earliest Chinese writing, Oracle bone script, Chinese etymology, Oracle Bone Decipher
备注： 15 pages, 5 figures, 3 tables. Accepted at ICONIP 2026
点击查看摘要
Abstract:Oracle bone script (OBS), one of the earliest Chinese writing systems, plays an important role in the study of Chinese etymology. Traditional decipherment relies heavily on domain experts who analyze characters through semantic context and structural evolution. To assist this labor-intensive process, we formulate OBS decipherment assistance as a cross-era image translation task and propose FROD (Feature Matching Residual Denoising Oracle Bone Decipher). Although many OBS characters differ substantially from their modern counterparts, they often preserve local topological invariants at the radical level. During training, FROD leverages fast feature matching to provide gated segmentation supervision: paired samples with sufficient matches are processed patch-wise to align fine-grained radicals, whereas low-similarity pairs are trained holistically to avoid mismatched artifacts. In addition, a Residual Denoising Diffusion Model (RDDM) jointly estimates noise and residual signals, thereby reducing the positional drift and stroke disorder commonly observed in standard diffusion models. Finally, a multi-stage font stylization refinement network refines the generated images by eliminating edge noise and stabilizing stroke structures. On our augmented character-disjoint dataset, FROD achieves higher Top-1 recognition accuracy than the evaluated baselines, with a 3.8% absolute gain over OBSD.
17. 【2609.17218】InfoTaxa: Information-Calibrated Label-Free Clustering for Fine-Grained Visual Taxonomy
链接：https://arxiv.org/abs/2609.17218
作者：David Ahmedt-Aristizabal,Mohammad Ali Armin,Lars Petersson
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：image-only fine-grained taxonomy, fine-grained taxonomy exhibits, frozen pretrained visual, clusters recover broad, pretrained visual embeddings
备注：
点击查看摘要
Abstract:Label-free clustering of frozen pretrained visual embeddings offers a scalable route to biodiversity monitoring, but image-only fine-grained taxonomy exhibits a consistent coarse-to-fine failure mode: clusters recover broad taxonomic structure yet plateau at species level. We study this behaviour on BIOSCAN-5M through an information-calibrated clustering analysis. BioCLIP~2 features with UMAP and HDBSCAN reach $0.79$ AMI at family and $0.67$ at genus, substantially improving over the prior image baseline and remaining competitive with oracle-$K$, graph-based, and learned clustering heads on the same frozen features. To diagnose whether the remaining plateau is method-limited or information-limited, we introduce InfoTaxa, which combines clustering efficiency---the fraction of probe-estimated image information recovered by an unsupervised partition---with paired DNA as an audit signal only, not an inference input. The density pipeline recovers approximately $0.90$ and $0.81$ of the image-available information at order and family, respectively. Held-out late-fusion probes show that adding DNA to the image embedding reduces species-level prediction error by approximately two bits. Robustness analyses cover multiple image encoders, described-species and rare-class subsets, probe diagnostics, and held-out-species coarse-rank generalisation and same-species retrieval. Thus, in the tested setting, species-level label-free clustering is both clustering-limited and representation-limited: improved clustering may recover additional image-exposed structure, but cannot close the DNA-audited information gap alone.
18. 【2609.17211】Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection
链接：https://arxiv.org/abs/2609.17211
作者：Jiawei Gu,Qilin Zhao,Tengkuo Guo,Zhiming Zhong,Shuangqing Zhang,Fan Lyu,Fang Zhao,Guo-Sen Xie,Caifeng Shan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：localize anomalous events, aims to localize, localize anomalous, anomalous events, events in untrimmed
备注： Under Review
点击查看摘要
Abstract:Video anomaly detection (VAD) aims to localize anomalous events in untrimmed videos. Vision-language models (VLMs) provide rich visual understanding for training-free VAD, but existing approaches impose restrictive interfaces between visual understanding and anomaly scoring. Caption-based pipelines compress visual evidence into text, potentially discarding subtle cues, while direct numerical generation forces the model to express its judgment through a small set of predefined scores. Such interfaces can obscure subtle differences in anomaly severity, causing visually distinct clips to receive similar representations or scores and thereby limiting the resolution of anomaly ranking. We propose \textbf{Probe-VAD}, an ordinal binary-probing framework that directly probes severity preferences from a frozen VLM. Given raw video clips, Probe-VAD queries ten ordered severity thresholds and extracts constrained \textit{YES}/\textit{NO} continuation likelihoods. Their normalized preferences form a cumulative severity profile, from which tail evidence is aggregated into a continuous anomaly score, with isotonic projection enforcing ordinal consistency. Experiments on public VAD benchmarks demonstrate superior performance with low computational cost. Probe-VAD provides a simple interface for translating frozen VLM visual understanding into continuous, rank-sensitive anomaly scores without task-specific training or caption-based compression. Code is available at: this https URL.
19. 【2609.17189】EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset
链接：https://arxiv.org/abs/2609.17189
作者：Ryosei Hara,Wataru Ikeda,Masashi Hatano,Mariko Isogawa
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：downstream applications, hand, essential task, hand mesh reconstruction, reconstruction
备注： Accepted to IEEE Access. Project Page: [this https URL](https://ryhara.github.io/EventEgoHandsV2/)
点击查看摘要
Abstract:3D hand mesh reconstruction is a challenging yet essential task for downstream applications, including human-robot interaction and AR/VR. Although conventional cameras have been widely adopted for this task, methods that rely on them struggle in low-light environments and under severe motion blur. To address these limitations, event-based cameras have recently attracted attention for their high dynamic range and high temporal resolution. However, applying event cameras to egocentric hand reconstruction remains challenging because camera wearer's motion produces dense background events that obscure hand-specific signals. Although the first egocentric event-based approach mitigates this issue using hand segmentation, its binary hand mask does not distinguish between left and right hands. As a result, the model lacks instance-level hand information and predicts both hands even when only one or neither hand is present. This limitation leads to incorrect inter-hand relationships and degraded reconstruction accuracy. In this paper, we propose EventEgoHands++, a framework for event-based 3D hand mesh reconstruction from an egocentric viewpoint. The proposed method incorporates a Hand Detector that estimates instance-level bounding boxes and masks for both the left and right hands. Moreover, we introduce Adaptive Attention, which dynamically gates the attention based on these detection results to accurately learn the spatial relationship and mutual interactions between the hands. To train and evaluate our framework, we extend the synthetic N-HOT3D dataset and newly construct EEH-R, the largest real-world event-based egocentric hand dataset to date, comprising approximately 1M annotated frames captured in environments including low-light conditions. Extensive experiments on both synthetic and real datasets demonstrate that our method consistently outperforms the baselines.
20. 【2609.17181】Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM
链接：https://arxiv.org/abs/2609.17181
作者：Ahmed Ammar Kubba,Manar Abu Talib,Iman Ibrahim,Qassim Nasir
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：non-western region-specific datasets, remain challenging due, styles remain challenging, traditional CNN-based classification, CNN-based classification approaches
备注： 8 pages, 8 figures, 3 tables, published at 15th International Conference on Intelligent Systems: Theories and Applications
点击查看摘要
Abstract:The analysis and classification of cultural heritage architectural styles remain challenging due to the complexity of visual images of buildings, which are highly relied on in traditional CNN-based classification approaches in comparison to textual descriptions, and the relative lack of non-western region-specific datasets. This paper addresses this gap by proposing a multimodal machine learning framework to analyze and classify Emirati residential architecture using OpenAI's CLIP model. We integrate visual features from images and textual features from expert descriptions into a unified 512-dimensional embedding, followed by dimensionality reduction with UMAP for visualization and unsupervised clustering using K-Means. Cluster labels, which are derived from manual analysis of the K-Means clusters, are used to train an SVM classifier for automated architectural style classification. Our approach achieves a classification accuracy of 98% across eight identified style clusters, higher than every other study in the literature, demonstrating the effectiveness of combining visual and textual modalities. Overall, this paper highlights the potential of using multimodal AI to support architectural heritage analysis, offering scalable and interpretable tools for exploring regional architectural identities.
21. 【2609.17169】MUMINS: Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis
链接：https://arxiv.org/abs/2609.17169
作者：Anna Oliveras,Roger Marí,Rafael Redondo,Oriol Guardià,Cynthia Ifeyinwa Ugwu,Ana Tost,Bhalaji Nagarajan,Carolina Migliorelli,Vicent Ribas,Petia Radeva
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：generative vision task, challenging generative vision, Forecasting anatomical, vision task, tumor growth
备注： Supplementary material to follow in future versions
点击查看摘要
Abstract:Forecasting anatomical changes such as tumor growth and neurodegeneration is a challenging generative vision task. Morphological evolution is subtle relative to static anatomy, highly patient-specific, and inherently stochastic. Existing methods struggle with several issues: deterministic networks ignore biological stochasticity, while standard diffusion models require computationally prohibitive multi-pass sampling to quantify uncertainty. We propose MUMINS (Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis), an efficient diffusion framework that jointly diffuses a baseline scan and its follow-up residual, summed to synthesize the follow-up scan, while concurrently predicting a spatial uncertainty map, in a single reverse diffusion process. Conditioned on the time interval and relevant metadata, it preserves fine-grained anatomy by dynamically re-injecting the baseline as a soft anchor at every denoising step, and a negative-log-likelihood head learns the uncertainty map to explicitly flag error-prone regions. Designed without organ-specific heuristics, the same architecture is reused across anatomies via separate, dataset-specific retraining. Extensive evaluations demonstrate that dataset-specific retraining of MUMINS matches or outperforms dedicated, domain-specific state-of-the-art methods on lung CT (PNG) and brain MRI (OASIS-3). Project page: this https URL.
22. 【2609.17168】HuMemSLAM: Efficient Human-Inspired Semantic Place Recognition for Robust Visual SLAM
链接：https://arxiv.org/abs/2609.17168
作者：Mayowa Adebambo,Sebastian Donnelly,Armand Amaritei,Andrew Bradley,Alexander Rast
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous systems require, effective simultaneous localisation, Autonomous systems, systems require reliable, reliable place recognition
备注： 8 pages, 8 figures
点击查看摘要
Abstract:Autonomous systems require reliable place recognition for efficient and effective simultaneous localisation and mapping (SLAM). Traditional geometric visual SLAM approaches rely on low-level features and geometric consistency, but remain vulnerable to perceptual aliasing, where different places appear similar, and perceptual variation, where the same place appears different. Although semantic SLAM and modern learned visual place recognition (VPR) methods improve robustness under challenging perceptual conditions, real-time deployment requires both high retrieval accuracy and low latency. Inspired by human memory and perception, we propose HuMem-VPR, which exploits the bidirectional relationship between bottom-up perceptual evidence and top-down contextual reasoning to achieve high-level place understanding. We further introduce HuMemSLAM, the integration of HuMem-VPR with ORB-SLAM3. HuMem VPR achieved the highest aggregate retrieval accuracy on the real-image benchmark, competitive accuracy on the CARLA benchmark, and approximately two to three times lower latency than the evaluated state-of-the-art VPR methods. Across the evaluated dataset families and online experiments, HuMemSLAM substantially improved integrated Recall @1 over ORB-SLAM3's native retrieval while reducing the proposals submitted to its geometric backend.
23. 【2609.17152】ResLRP: The Role of Residual Cancellation in Attribution Instability in Vision Transformers
链接：https://arxiv.org/abs/2609.17152
作者：Jim Berend,Reduan Achtibat,Daniel Schäffer,Alexander Binder,Wojciech Samek,Sebastian Lapuschkin,Maximilian Dreyer
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：stable remains challenging, Layer-wise Relevance Propagation, remains challenging, stable remains, Residual-aware Layer-wise Relevance
备注：
点击查看摘要
Abstract:Vision Transformers (ViTs) are central to most modern vision models, yet obtaining input attributions that are fine-grained, faithful, and stable remains challenging. Layer-wise Relevance Propagation (LRP) has been adapted to transformer attention, but in ViTs it often produces noisy, unfaithful explanations. We show that the missing ingredient is the treatment of residual connections: cancellation effects in residual pathways lead to attribution explosion. Moreover, we find that these cancellations are substantially stronger in ViTs than in language transformers. To address this issue, we introduce Residual-aware Layer-wise Relevance Propagation (ResLRP), a simple extension of LRP whose propagation rules explicitly account for cancellations in residual branches, are exactly conservative, and provably bound relevance explosion. Causal channel-wise interventions confirm that residual cancellation, not a generic regularization effect, drives the instability. ResLRP substantially improves attribution quality across faithfulness and localization, evaluated on ViT architectures spanning supervised, self-supervised, contrastive, hierarchical, and multimodal families, as well as on the ground-truth-controlled FunnyBirds benchmark. The largest gains arise in modern Vision Language Models (VLMs), with +27-29% localization and up to 3.4x faithfulness scores. Beyond benchmarks, ResLRP localizes Sparse Autoencoder (SAE) features in input space, and our residual amplification measure serves as an architecture-level diagnostic predicting where attribution degrades.
24. 【2609.17138】From Foundation Embeddings to Cropland Maps: Label Efficiency, Temporal Transferability and Independent Human Validation
链接：https://arxiv.org/abs/2609.17138
作者：Mohammad Ammar Mughees,Giovanni Montefoschi,Zhongxin Chen,Maria Antonia Brovelli
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：limited task-specific modelling, provide reusable representations, models provide reusable, support downstream mapping, Cropland Data Layer
备注： 23 pages, 10 figures. Code: [this https URL](https://github.com/Black-Lights/alphaearth-cropland-maine)
点击查看摘要
Abstract:Geospatial foundation models provide reusable representations of satellite imagery that support downstream mapping with limited task-specific modelling. We evaluate whether annual AlphaEarth embeddings support binary cultivated-versus-non-cultivated mapping in Maine, USA, using 192 spatially separated patches and labels derived from the USDA Cropland Data Layer (CDL). Without fine-tuning the foundation model, a lightweight classifier reaches 93.7% overall accuracy and 90.8% balanced accuracy on held-out patches. Logistic regression is within 0.3 percentage points of a gradient-boosted ensemble, while a nearest-class-centroid rule, which uses class centroids but fits no parameters, reaches 90.2%. A balanced sample of 60,000 labelled pixels is within 1.3 percentage points of the full pool of 8.6 million pixels; because pixels are spatially autocorrelated, this result concerns pixel-sample efficiency rather than 60,000 independent annotation sites. In a same-region transfer experiment, classifiers trained in one year remain accurate across 2018 to 2023. Against a blind, two-interpreter consensus at 385 randomly sampled points in one contiguous 2023 block, the AlphaEarth-plus-random-forest map agrees at 95.3% ($\kappa=0.82$), compared with 91.7% for the CDL ($\kappa=0.72$; exact two-sided McNemar $p=0.0161$). This local result is consistent with partial smoothing of CDL label noise, but it does not establish statewide correction of the reference product. On the same points, the difference from a fine-tuned TerraMind segmentation model is not statistically significant (95.3% versus 93.5%; $p=0.14$), and the experiment is not a controlled comparison of computational cost. These results support frozen geospatial embeddings as a low-compute candidate for regional cropland mapping, subject to the limits of a single-state study, a 30 m-derived training reference, and a one-block human validation.
25. 【2609.17134】Event-based Selective Attention for Multi-resolution Fast Region of Interest (ROI) Detection
链接：https://arxiv.org/abs/2609.17134
作者：Luca Peres,Giulia D'Angelo,Chiara Bartolozzi,Oliver Rhodes
类目：Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)
关键词：motivating early mechanisms, constraints on bandwidth, selective processing, strict constraints, mechanisms for data
备注：
点击查看摘要
Abstract:Neuromorphic vision systems operate under strict constraints on bandwidth, memory, and energy, particularly at the edge, motivating early mechanisms for data reduction and selective processing. In this work, we investigate a multi-scale training-free, saliency-based, bottom-up visual attention model that operates directly on low-resolution event-based input and selects Regions of Interest (ROI) from the visual scene. The model is evaluated across multiple downscaling factors applied to the incoming event stream, with input resolutions reduced by up to 256x relative to full resolution. Performance is assessed on the Prophesee Automotive dataset, the largest publicly available event-based dataset, demonstrating robust ROI selection across different scales on a real-world use-case. The proposed approach is capable of detecting ROIs belonging to multiple object classes, including various vehicle types, pedestrians, traffic lights, and traffic signs, with accuracy up to 70.8%, while operating at millisecond temporal resolution, 16x finer than the temporal resolution provided by the dataset ground truth. These results highlight the potential of combining early event downscaling with saliency-based attention as an effective front-end for efficient edge neuromorphic vision systems.
26. 【2609.17130】Predicting Human Disagreement for Calibrated Dynamic Facial Expression Recognition
链接：https://arxiv.org/abs/2609.17130
作者：Yiming Wang,Frederick W. B. Li,Jingyun Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dynamic facial expression, represent human disagreement, multiple annotator votes, Dynamic facial, facial expression recognition
备注： 5 pages, 3 figures, 4 tables. Submitted to ICASSP 2027
点击查看摘要
Abstract:Dynamic facial expression recognition (DFER) benchmarks such as DFEW provide multiple annotator votes per clip, yet most models collapse them to a majority label and cannot represent human disagreement at inference time. We propose a disagreement-aware DFER framework that trains directly on the raw annotator count vector using a Dirichlet-Multinomial likelihood. Unlike mean-only soft-label objectives, the proposed likelihood provides scale-sensitive supervision for the Dirichlet concentration while preserving the predictive mean. A separate ambiguity head predicts annotation entropy for unseen clips, and a monotone Chow-style reject rule combines predicted ambiguity, vacuity, temporal instability, and input quality for selective prediction. On DFEW, the method preserves recognition accuracy while reducing ECE by 30% and AURC by 15%, and predicted ambiguity reaches a Spearman correlation of 0.52 with the annotation entropy of test clips. The calibration and selective-prediction gains transfer to FERV39k and remain under identity- and movie-disjoint DFEW splits.
27. 【2609.17112】Not Another Text Benchmark: Putting the "Visual" Back in Visual Question Answering for Large Video Models
链接：https://arxiv.org/abs/2609.17112
作者：Rwiddhi Chakraborty,Yinong(Oliver)Wang,Cheng Zhang,Fan Bai,Zhuoran You,Michael Kampffmeyer,Yong Jae Lee,Fernando De la Torre,Robert Jenssen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：exhibited impressive performance, question answering tasks, wide range, answering tasks, rise of powerful
备注：
点击查看摘要
Abstract:Large video models have exhibited impressive performance on a wide range of visual question answering tasks, owing to the rise of powerful, pretrained text and vision encoders. The usefulness of such models have also been demonstrated on a wide range of benchmarks, with an important caveat - the dominant approach in these benchmarks evaluates multiple choice reasoning via text options. This is a natural way to test text-based reasoning in these models, and has led to significant insights regarding model behavior in the community. In this work, we ask a different question - what happens when the evaluation modality is visual, rather than text? We introduce three new vision-centric evaluation benchmarks in temporal frame retrieval, video future prediction, and causal memory distortion, all designed around evaluating visual understanding capabilities in large video models. Our approach complements the existing approaches to evaluate video understanding in frontier models. We show that current frontier models exhibit significant weakness when attempting to reason through visual queries, rather than text. We conclude with an extended analysis section that provides pointers for future improvements in visual understanding for large video models.
28. 【2609.17099】GeoLAM: Learning Geometry-Grounded Latent Actions from Unlabeled Human Videos
链接：https://arxiv.org/abs/2609.17099
作者：Yifan Xie,Hekun Tian,Jinkun Liu,YuAn Wang,Qiao Sun,Wenbo Ding
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：motion remains challenging, rich manipulation experience, remains challenging, Human videos, videos provide rich
备注： 8 pages, 6 figures, 4 tables
点击查看摘要
Abstract:Human videos provide rich manipulation experience, but extracting action representations that preserve useful motion remains challenging. Visual reconstruction alone can entangle manipulation-related motion with appearance changes and camera movement. We present GeoLAM, a framework for learning geometry-grounded latent actions from action-free human videos. GeoLAM combines future-frame reconstruction through a frozen geometric feature hierarchy with motion supervision from a training-only 4D geometry teacher. The geometric representation provides a structural prior, while the teacher's predictions yield spatially pooled targets capturing 3D displacement, residual image-plane motion, and surface-orientation changes. Visibility and confidence weighting reduces the contribution of unreliable estimates, encouraging continuous latent actions to retain geometric motion without explicit hand-pose or hand-trajectory annotations. After video pretraining without action labels, the learned representation provides transition targets for a world-action model trained on action-labeled robot demonstrations. The model jointly denoises latent actions and executable action chunks, with future-video prediction used only as an auxiliary training task. Deployment therefore requires neither the geometry teacher nor future-video generation. Evaluations on a latent-action benchmark and robotic manipulation tasks demonstrate the strong performance of GeoLAM.
29. 【2609.17094】Hub-Spectral Activation of Latent Multimodal Knowledge
链接：https://arxiv.org/abs/2609.17094
作者：Ying Guo,Haidong Chen,Linrui Xu,Xiaohao Liu,Chuancheng Shi,Canran Xiao,Dan Zhang,Fei Shen,Li Shen,Tat-Seng Chua
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：learning seeks shared, seeks shared representations, representation learning seeks, Multimodal representation learning, latent multimodal knowledge
备注： 30 pages, 9 figures, including appendices
点击查看摘要
Abstract:Multimodal representation learning seeks shared representations for cross-modal retrieval and knowledge transfer. Hub-based binding reduces pairwise supervision costs, but separate hub connections cannot guarantee reliable alignment between modalities without direct joint training. We introduce Hub-Spectral Activation (HSA), a closed-form method for recovering and activating the hub-readable component of latent multimodal knowledge in frozen representations. We formalize this knowledge as source-induced cross-modal dependence and characterize the component determined by the second-order statistics of two trained hub edges. Under a second-order source model, we establish conditions for exact recovery of the complete source-induced relation and bound the dimension of its hub-readable component by the hub covariance rank. HSA composes and standardizes hub-edge statistics, extracts paired spectral directions, and combines reliability-weighted matching evidence with source-gated candidate resolution for bidirectional retrieval and prototype classification. HSA requires no target-pair supervision, gradient optimization, or backbone updates. Across 19 retrieval and 11 prototype-classification relations on ImageBind and LanguageBind, HSA raises mean bidirectional Recall@10 from 18.27% to 31.15% and mean macro Top-1 accuracy from 29.01% to 52.43%, respectively. Controlled analyses further identify valid hub-edge correspondence and leading spectral directions as key sources of retrieval gains, demonstrating the utility of latent multimodal knowledge beyond native similarity scores. Code and models are publicly available at this https URL.
30. 【2609.17068】Beyond In-Distribution Metrics: A Systematic Out-of-Distribution Evaluation of Congenital Heart Disease Segmentation
链接：https://arxiv.org/abs/2609.17068
作者：Aniketh Vijesh,Shrisharanyan Vasu,Abhijit Ramesh,Clare Pomeroy-Ward,Harikrishnan Anil Maya,Sarin Xavier,Mahesh Kappanayil,Gilad Gressel
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Congenital heart disease, Congenital heart, anatomical models, heart disease, diagnosis and surgical
备注： 12 pages, 6 figures, 2 tables. Accepted at STACOM 2026, held in conjunction with MICCAI 2026
点击查看摘要
Abstract:Congenital heart disease (CHD) diagnosis and surgical planning often require patient-specific 3D anatomical models, but manual segmentation is labor-intensive, particularly in complex anatomies. Although deep-learning methods can automate this process, they are typically evaluated in-distribution, despite clinically relevant shifts in scanner, protocol, institution, population, and imaging modality. We present, to our knowledge, the first systematic evaluation of out-of-distribution (OOD) generalization in CHD segmentation, using ImageCHD as a held-out target cohort. We compare representative segmentation architectures under combined CT and CMR training, CT-only training, self-supervised pretraining, and limited target-domain adaptation. In-distribution performance proves to be a poor indicator of cross-cohort robustness: nnU-Net achieves the highest validation Dice (0.77) but falls to 0.51 on ImageCHD, while SwinUNETR generalizes substantially better, reaching 0.67 Dice. MAE and JEPA pretraining provide only modest additional benefit, suggesting that architecture contributes more to robustness than the tested pretraining strategies in this setting. When limited target-domain supervision is introduced, all SwinUNETR variants exceed 0.76 Dice with only 11 labeled ImageCHD cases. These findings demonstrate that conventional in-distribution evaluation can obscure clinically important generalization failures and support explicit cross-dataset testing as a key component of CHD segmentation evaluation.
31. 【2609.17064】Neuro-Symbolic Hierarchical Intention Anticipation in Human Behavior
链接：https://arxiv.org/abs/2609.17064
作者：Farnaz Soleimani(LISSI),Abdelghani Chibani(LISSI),Yacine Amirat(LISSI),Ghazaleh Khodabandelou(LISSI)
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
关键词：Assistive autonomous systems, anticipate human goals, Assistive autonomous, autonomous systems, systems must anticipate
备注：
点击查看摘要
Abstract:Assistive autonomous systems must anticipate human goals before an observed behavior is complete. This article formulates anticipation as goal inference from a partially observed multimodal episode together with structured prediction of the remaining behavior, rather than exact motor forecasting. A compact Hierarchical Planning Decoder (HPD) is attached to a frozen neuro-symbolic recognition encoder and predicts, at four ontological levels, the next actions, the remaining activities and low-level intentions, and the episode high-level intention(HLI). The decoder is trained with soft neuro-symbolic regularization combining transition-coherence and hierarchical continuity losses, and is decoded with hard reachability masks that enforce ontological validity at inference. On a compositional four-level benchmark of 15,002 multimodal episodes built over NTU RGB+D 120 features, three headline properties are observed together. The advantage over the strongest sequential baseline grows with the anticipation horizon, from +1.7 points at step 1 to +7.3 points at step 3 (top-5). Under compositional generalization, where one parent association per multi-parent low level intention is held out, this advantage widens to +4.9 points at step 1. At the episode level, 96.8% of anticipated trajectories satisfy the joint logic constraints, above the 88.1% strongest-baseline value and the 73.9% ground-truth floor; soft logic terms alone account for a 59.8 to 71.1% relative reduction of HLI-reachability violations, and the hard masks then eliminate them entirely. Neural generation supplies predictive ranking, symbolic constraints supply onto logical validity, and their combination yields coherent hierarchical anticipation while exposing remaining challenges in compositional goal generalization and unordered set prediction.
32. 【2609.17039】Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement
链接：https://arxiv.org/abs/2609.17039
作者：Yuetong Wang,Jinsheng Quan,Yi Yang,Yawei Luo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, Gaussian geometry, inherently underconstrained, Geometry Cheating, geometry
备注：
点击查看摘要
Abstract:Sparse-view 3D scene reconstruction with 3D Gaussian Splatting (3DGS) is inherently underconstrained. Plausible renderings can also coexist with erroneous Gaussian geometry, as errors in positions or depths may be concealed by opacity, scale, and appearance; we term this failure mode Geometry Cheating. Existing regularization methods constrain geometry but remain limited to observed views, while video-diffusion-based methods complete unseen views yet mainly use them as RGB pseudo-supervision, underusing motion and temporal priors and lacking explicit geometry supervision. We present Bi-FlowGS, which uses optical flow to bridge generative view completion and Gaussian geometry regularization. Our plug-and-play Video-to-Geometry Flow Distillation (V2G) distills temporal correspondence priors from restored videos into Gaussian geometry to alleviate Geometry Cheating. Conversely, Geometry-to-Video Flow-Guided Restoration (G2V) uses the current 3DGS geometry to guide temporally consistent video restoration, providing more reliable generative supervision. Together, V2G and G2V form an implicit bidirectional co-refinement process, enabling restored videos and the optimized 3DGS scene to iteratively improve each other. Experiments demonstrate improved rendering quality and geometric consistency across wide-baseline and unbounded 360° benchmarks.
33. 【2609.17026】CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework
链接：https://arxiv.org/abs/2609.17026
作者：Yunxiang Fu,Meng Lou,Zicheng Liao,Yizhou Yu
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：previously learned knowledge, incrementally learn tasks, Continual learning, catastrophic forgetting, learned knowledge
备注： BMVC2026
点击查看摘要
Abstract:Continual learning must balance the learning of new knowledge with the retention of previously learned knowledge to incrementally learn tasks from a data stream without catastrophic forgetting. While leveraging pretrained models has significantly advanced continual learning, existing methods exhibit a scalability bottleneck when trained sequentially on many tasks, suffering from performance degradation due to inter-task interference and loss of plasticity. Inspired by evidence that sparse fine-tuning achieves performance comparable to full fine-tuning, this paper presents a novel sparsity-driven continual learning framework. Our continual learning method, termed CLARE, operates in two stages: it first identifies a sparse, task-critical parameter mask via a sparsity-inducing objective, then performs mask-constrained fine-tuning by only optimizing parameters selected by the mask. This two-stage sparse adapter mechanism enables all tasks to be accumulated within a shared adapter space while reducing destructive interference across tasks. Extensive experiments demonstrate the scalability of CLARE. On the long task-sequence benchmark Omnibenchmark-1k, CLARE outperforms strong baselines in final accuracy by a large margin, e.g, improving EASE by 4.64% and 13.34% after learning 100 tasks, respectively.
34. 【2609.17021】sensVLA: Spatially-Grounded Vision-Language-Action Model for Autonomous Wheel Loader
链接：https://arxiv.org/abs/2609.17021
作者：Gopi Krishna Erabati,Bjarne Johannsen,Angus Stewart,Vardeep Singh Sandhu
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Autonomous wheel-loader control, wheel-loader control requires, control requires joint, Autonomous wheel-loader, requires joint reasoning
备注： Accepted at ICRA 2026: From Data to Decisions: VLA Pipelines for Real Robots
点击查看摘要
Abstract:Autonomous wheel-loader control requires joint reasoning over task semantics, egocentric vision, proprioception, and 3D scene geometry. We present sensVLA, a Vision-Language-Action (VLA) architecture that combines a Qwen3-2B Vision-Language Model (VLM) with a fully trainable transformer action expert trained by flow-matching velocity regression. sensVLA routes Bird's-Eye-View (BEV) features, extracted from fused front and rear lidar, directly to the action expert through a dedicated cross-attention pathway, while the VLM consumes front and rear RGB views to provide task-conditioned semantic context. This design decouples spatial grounding from linguistic reasoning while preserving interaction between both streams at decision time. The expert predicts six action dimensions: longitudinal velocity, steering, body-frame displacement, arm rate, and bucket rate. On a real-world dataset from a wheel loader, sensVLA reaches aggregate per-step parity with a strong camera-only baseline and reduces longitudinal velocity RMSE by 28% and displacement error by 9% on loading centric scenarios. It also degrades 29% less when the camera stream is corrupted or removed, evidencing that explicit spatial grounding improves accuracy and fault-tolerance for heavy equipment autonomy.
35. 【2609.17004】Symmetry-Aware Likelihood-Orbit Aggregation for Selective Left-Right Claim Verification
链接：https://arxiv.org/abs/2609.17004
作者：Zhouzhi Xiong,Chuxi Zhang,Weizhen He,Yi Chen,Qi Li,Donglian Qi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：rank verification errors, reliably rank verification, Frozen vision-language models, fine-grained left-right claims, raw claim likelihoods
备注： 5 pages, 2 figures
点击查看摘要
Abstract:Frozen vision-language models (VLMs) remain unreliable on fine-grained left-right claims, and raw claim likelihoods need not reliably rank verification errors. After a horizontal-reflection intervention is fixed, how should its induced likelihood measurements be combined into a selective verification signal? We introduce Relation-Orbit, a closed-form contrast with no learned fusion parameters that assigns eight normalized likelihoods to query-supporting and counterfactual roles determined by reflection, inverse relation, and entity exchange. A claim is asserted only when the signed contrast exceeds a threshold selected on held-out data using pointwise Clopper-Pearson upper confidence bounds. On VSR and GQA across four frozen VLMs, Relation-Orbit yields higher mean test coverage at a 10% selective-risk calibration target than an all-eight Orbit-Max baseline in all eight dataset-backbone settings; gains over a nearly abstain-all one-sided intervention score are reported separately. A separate LLaVA-1.5/COCO evaluation, reduced-orbit controls, and a two-sided partition diagnostic further characterize the structural advantage.
36. 【2609.16946】High-Fidelity Video Quality Assessment with VQA-Specific Saliency
链接：https://arxiv.org/abs/2609.16946
作者：Hakan Emre Gedik,Shashank Gupta,Alan Bovik
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：No-reference video quality, textbf, No-reference video, recently seen promising, promising progress
备注： Accepted to WACV 2027
点击查看摘要
Abstract:No-reference video quality assessment (NR VQA) has recently seen promising progress with deep learning. However, video data is inherently large, and processing them with deep models incurs high computational cost. This challenge is particularly acute in VQA, where preserving original-resolution cues and dense temporal information is critical for accuracy. Existing efficiency-driven preprocessing strategies, such as fragmenting, reduce computation but alter the input data distribution, limiting effective reuse of pretrained video foundation models (ViFMs). To address these challenges, we propose \textbf{H}igh-\textbf{F}idelity \textbf{V}ideo \textbf{Q}uality \textbf{A}ssessment (\textbf{HFVQA}), a framework built on fixed-size spatio-temporal (ST) patches that is fully compatible with pretrained ViFMs. HFVQA samples ST patches across multiple scales, including the original resolution, with minimal temporal subsampling to preserve low-level quality cues and semantic context. To limit computation, HFVQA introduces a lightweight auxiliary network trained end-to-end with the ViFM encoder to learn \textit{VQA-specific saliency}. Distilled directly from quality supervision, this saliency captures task-specific importance patterns, reflecting that video quality perception is dominated by a small subset of spatio-temporal regions. By combining high-fidelity spatio-temporal cues with learned, task-specific saliency, HFVQA achieves SOTA performance on standard NR VQA benchmarks while processing as little as 12\% of candidate ST patches, making high-fidelity ViFM-based VQA computationally tractable.
37. 【2609.16934】MedPCFM-TED: One-Step Point Cloud Flow Matching for Implant Generation via Teacher-Guided Endpoint Distillation
链接：https://arxiv.org/abs/2609.16934
作者：Kamil Kwarciak,Marek Wodzinski
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：medical imaging, important task, task in medical, TED, Cranial implant generation
备注： 10 pages, 3 figures
点击查看摘要
Abstract:Cranial implant generation is an important task in medical imaging. Recent point cloud based generative methods, particularly flow matching, offer strong reconstruction quality and efficient sampling, but still require multiple neural function evaluations during inference. This limits rapid generation of multiple plausible implant candidates. We propose Teacher-guided Endpoint Distillation (TED), a simple one-step distillation framework for conditional cranial implant generation on point clouds. TED trains a one-step student using teacher-guided endpoint supervision and geometric matching losses, while avoiding explicit path straightening. We evaluate TED on the SkullFix and SkullBreak benchmarks. TED achieves the best overall performance on the SkullBreak dataset, remains competitive on SkullFix, and provides the strongest Chamfer distance performance among the compared one-step methods. In addition, TED generates implants in approximately 0.04s per sample. These results show that one-step distillation can substantially accelerate conditional point cloud implant generation without sacrificing reconstruction quality.
38. 【2609.16926】Evaluating Mesh Reconstruction Methods for Crop Phenotyping
链接：https://arxiv.org/abs/2609.16926
作者：Karanvir Singh,Theo Morales,Binh-Son Hua,Mukesh Saini
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：entire life cycle, food production, life cycle, crucial for studying, studying its entire
备注： 12 pages, 17 Figures
点击查看摘要
Abstract:Phenotyping an agricultural crop is crucial for studying its entire life cycle, as it provides vital insights to improve yield and, ultimately, food production. Doing the same for crops grown on remote sites is a challenge for the specialists who cannot be available on-site. 3D reconstruction techniques offer a promising solution to this problem by enabling crop digitization, allowing specialists to access the resulting 3D crop models from anywhere at any time. In this work, we evaluate recent 3D reconstruction pipelines for crop phenotyping. We focus on 7 mesh reconstruction pipelines and measure the fidelity and consistency of their outputs qualitatively and quantitatively. Our results suggest that the meshes produced by the GGGS, PGSR, and 2DGS are preferable to the other pipelines, owing to their quantitative metrics and visually pleasing outputs. The GGGS pipeline is better than the second-best pipeline (2DGS) by about 27\% on the radar chart with 5 dimensions, namely, User ratings, Chamfer distance, LPIPS, PSNR, and SSIM.
39. 【2609.16919】NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving
链接：https://arxiv.org/abs/2609.16919
作者：Muhammad Ahmed Ullah Khan,Mohammed Elamine,Sheikh Talha Uddin,Didier Stricker,Sk Aziz Ali,Muhammad Zeshan Afzal
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：ego-centric knowledge graph, dynamic objects annotated, paper introduces NeuroSymbEAD, caption dataset featuring, heading directions
备注：
点击查看摘要
Abstract:This paper introduces NeuroSymbEAD, a large-scale neuro-symbolic caption dataset featuring an ego-centric knowledge graph (KG) of static and dynamic objects annotated with classes, categories, heading directions, orientations, and distances from the ego-vehicle. These annotations are used on the KITTI-360 dataset to generate multilevel textual captions representing a lightweight version of an ego-centric scene map. Outdoor scene-map reconstruction, visual recognition, and object grounding establish baselines for driving common sense and traffic/scene understanding. For these purposes, natural language-based grounded captioning of objects and their complex relationships is a widely adopted contextual representation for indoor scene tasks. Neuro-symbolic representations have proven effective in handling structured information for various computer vision and language applications. Our data annotation pipeline allows the generation of varied map segments, populating simulated or real objects within the bounding boxes predicted by any 3D object detection network, and building hierarchical text captions. We benchmark our neuro-symbolic and ontological caption generation using pre-trained grounding and learned auto-regressive captioning networks. By converting 3D driving scenes into structured ego-centric language, NeuroSymbEAD provides a benchmark for vision-language and foundation models for traffic-scene explanation, 3D reasoning, and interpretable autonomous-driving perception.
40. 【2609.16909】PiPS: Post-Hoc Prototypical Explanations for Interpretable Semantic Segmentation
链接：https://arxiv.org/abs/2609.16909
作者：Miłosz Adamczyk,Tymoteusz Zapala,Piotr Borycki,Przemysław Spurek
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deep neural networks, autonomous vehicles, deep neural, medical diagnostics, diagnostics and autonomous
备注：
点击查看摘要
Abstract:With the increasing deployment of deep neural networks in critical systems, such as medical diagnostics and autonomous vehicles, ensuring their interpretability is crucial to building trust in decision-making systems. In the field of explainable artificial intelligence, prototype-based reasoning has gained particular popularity, as it mimics human cognitive processes by explaining model decisions based on visual similarity under the looks like this paradigm. While this paradigm has been thoroughly investigated in the context of global image classification, the interpretability of dense predictions, particularly semantic segmentation, remains largely unexplored despite its immense importance in tasks requiring precise object localization. Existing prototype-based interpretable segmentation models rely on ante-hoc architectures, which entails significant limitations because they require costly training from scratch and modifications to the network structure, ultimately leading to a noticeable drop in predictive performance compared to standard black-box models. To address this issue, we propose PiPS (Post-hoc interpretable Prototypical Segmentation), the first fully post-hoc solution for generating prototypical explanations for semantic segmentation models. Our method enables the extraction of intuitive, spatially localized explanations from any pre-trained network without modification or fine-tuning, thereby preserving 100% of the model's original predictive performance. This approach opens a new avenue for the safe and cost-effective deployment of transparent systems in advanced computer vision tasks. Codebase available at this https URL.
41. 【2609.16889】mporally Consistent Graph Extraction and Matching for Longitudinal Angiographic Images
链接：https://arxiv.org/abs/2609.16889
作者：Linus Kreitner,Laurin Lux,Carmen Baumann,Daniel Rueckert,Martin J. Menten
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enabled longitudinal visualization, Recent advances, advances in angiographic, angiographic imaging, imaging have enabled
备注： Accepted at MICCAI 2026 GRAIL workshop
点击查看摘要
Abstract:Recent advances in angiographic imaging have enabled longitudinal visualization of the microvasculature. Image processing pipelines based on vessel graphs are able to resolve subtle temporal changes at the level of individual blood vessels. However, current strategies for graph extraction, refinement, and matching are highly sensitive, with even minuscule differences in the underlying segmentation map resulting in substantially different vessel graphs. These artifacts severely inhibit the ability to accurately match sequential vessel graphs of the same subject over time. To address this problem, we propose a strategy that matches graphs before jointly refining them. Specifically, we perform an early matching after basic graph extraction before removing spurious bulges and merging junctions in both graphs using joint information. In experiments with complex retinal vessel graphs, we demonstrate that this strategy results in a higher matched area without graph fragmentation compared to separate or no refinement, respectively.
42. 【2609.16878】VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal
链接：https://arxiv.org/abs/2609.16878
作者：Haonan Huang,Tianrui Qiu,Xianghao Zang,Yinan Du,Zhixiang He,Chi Zhang,Hao Sun,Zhongjiang He,Tianwei Cao,Xuchong Zhang,Hongbin Sun,Kongming Liang,Zhanyu Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：existing evaluation paradigms, evaluation paradigms face, critical limitations, questionable references, misalignment between tradi
备注： BMVC-2026
点击查看摘要
Abstract:Despite its crucial role in video object removal (VOR), existing evaluation paradigms face two critical limitations: questionable references and a misalignment between tradi- tional metrics and human preference. To address these challenges, we introduce VOR- Bench, which advances VOR evaluation through three integrated components. First, we present the VOR Dataset (VORD), the first benchmark dataset providing both paired edited videos and graffiti masks. Its unique strength lies in a diverse data spectrum, which encompasses model-generated, tool-rendered, and camera-captured data, ensuring robust assessment across real-world scenarios. Second, we develop rMPAF, a realistic Motion- capable Paired-video Acquisition Framework. By combining the strengths of image- based object removal and fine-tuned video generation models, rMPAF automatically generates realistic, motion-coherent paired videos. Finally, we propose three evaluation dimensions and introduce VOR-MDSM, the first perception-driven VLM-based scoring model specifically designed for mask-guided VOR. It bridges the gap between arithmetic metrics and human perception by covering the essential visual attributes and matching nuanced human judgment. Extensive experiments demonstrate that VOR-Bench yields evaluation results that align closely with human perception, achieving a remarkable cor- relation (\r{ho} 0.9) with subjective assessments. We will release VOR-Bench along with its documentation to ensure full reproducibility.
43. 【2609.16875】Multi-modal Knowledge Preserving Adapter for Embedding Backward Compatibility
链接：https://arxiv.org/abs/2609.16875
作者：Jaeseok Byun,Gukyeong Kwon,Han-Kai Hsu,Meher Gitika Karumuri,Zhikang Zhang,Hao Yang,Davide Modolo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：expensive database re-indexing, requires expensive database, Upgrading embedding models, typically requires expensive, database re-indexing
备注： 15 pages, ECCV 2026 camera ready
点击查看摘要
Abstract:Upgrading embedding models typically requires expensive database re-indexing, as new query embeddings are incompatible with existing database embeddings. While Backward Compatible Training (BCT) mitigates this by enforcing compatibility during training, existing approaches often require updating the backbone model. This is impractical because of significant training cost, the risk of performance regression, and limited access to proprietary model weights. We introduce Multi-modal Knowledge Preserving Adapter (MKP-Adapter), the first adapter-only BCT approach for Multi-modal Large Language Models (MLLMs) that requires no backbone updates. We identified that the primary challenge in adapter-only BCT is preserving the knowledge of the new embeddings while enforcing backward compatibility. Hence, we propose a multi-level preservation loss that maintains the geometric structure of the embedding spaces throughout BCT. Furthermore, a focal re-weighting strategy is integrated to prioritize learning from challenging samples. Experiments demonstrate that our method achieves strong backward compatibility across diverse multi-modal benchmarks (image, text, visual document, and video retrieval tasks) and model types. Notably, MKP-Adapter is trained solely on pre-extracted embeddings and requires only negligible additional latency relative to the original backbone forward pass, highlighting its efficiency.
44. 【2609.16874】Accelerated Decoding of Centroid Positional Encoding for Instance Segmentation
链接：https://arxiv.org/abs/2609.16874
作者：Carmelo Scribano,Filippo Muzzini,Nedyalko Prisadnikov,Mohammad Mahdi,Yuqian Fu,Giorgia Franchini,Danda Pani Paudel,Marko Bertogna,Luc Van Gool
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：converts raw network, raw network outputs, constitutes a significant, converts raw, raw network
备注： Presented at 2026 Joint International Conference on AI, Big Data and Blockchain. Granada, Spain
点击查看摘要
Abstract:Beyond model inference, the decoding stage, which converts raw network outputs into task-level representations, constitutes a significant portion of the execution cost. Despite its practical impact, prediction decoding has received comparatively little attention and is often implemented using generic CPU routines or inefficient GPU kernels, limiting the benefits of advances in model efficiency. In this work, we investigate the decoding overhead associated with a recent sinusoidal centroid encoding for Instance Segmentation, in which each pixel regresses a positional embedding of its instance centroid. This approach allows flexible segmentation without predefined proposals, but extracting instance masks from dense embeddings incurs a high computational cost. We present an optimized CUDA-based implementation of the decoding algorithm tailored to this encoding, explicitly addressing challenges related to parallelization, synchronization, and memory access on modern GPUs. Our solution significantly reduces decoding overhead and improves End-to-End inference latency, outperforming both CPU-based approaches and naive GPU implementations. The results demonstrate that efficient decoding is essential to fully exploit the advantages of advanced output representations and highlight the importance of jointly designing encoding schemes and their decoding algorithms for real-time computer vision systems.
45. 【2609.16873】NeuroTS-Net: Multi-Class Semantic Segmentation of Pediatric Brain Tumors in Multi-Modal MRI
链接：https://arxiv.org/abs/2609.16873
作者：Darius Peteleaza,Razvan-Gabriel Dumitru,Bogdan Neamtu,Arpad Gellert,Mariana Sandu,Claudiu Matei
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：manual delineation challenging, low-contrast subregions make, subregions make accurate, make accurate manual, accurate manual delineation
备注： Accepted at the 2026 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) - BraTS Cluster of Challenges: Pediatric Brain Tumor Segmentation (BraTS-PEDs)
点击查看摘要
Abstract:Pediatric brain tumors are a leading cause of cancer-related mortality in children, and their small, rare, and often low-contrast subregions make accurate manual delineation challenging. Reliable automated segmentation is therefore needed to support diagnosis, treatment planning, and response assessment. Accordingly, we introduce NeuroTS-Net, a three-dimensional encoder-decoder convolutional neural network architecture for multi-class semantic segmentation that incorporates a dual-scale raw-detail stream, adaptive low-resolution context selection, and detail-preserving multipath downsampling. These components preserve fine intensity and boundary information while efficiently modeling broader tumor context. NeuroTS-Net was trained on the BraTS 2026 pediatric dataset without external data or pretrained weights and evaluated against nnU-Net and MedNeXt under the same experimental protocol. NeuroTS-Net outperformed the baseline methods, achieving whole-tumor and tumor-core Dice scores of 0.938 and 0.937 on the internal validation set and 0.927 and 0.926 on the official challenge validation set. The code is open-sourced at: this https URL.
46. 【2609.16872】GRACE: Geometry- and Ray-Aware Camera-Efficient Multi-View Pedestrian Tracking
链接：https://arxiv.org/abs/2609.16872
作者：Taigo Sakai,Kazuhiro Hotta,Hiroki Kouno,Naoki Kato
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：true pedestrian positions, short score drops, Reducing the number, correct BEV responses, BEV responses stretched
备注：
点击查看摘要
Abstract:Reducing the number of cameras reduces the deployment cost but removes views that correct BEV responses stretched away from true pedestrian positions by projection and short score drops that can split tracks} in Bird's-Eye View (BEV) tracking. We introduce GRACE, a camera-efficient multi-view tracker with three components. Volumetric-Guided Fusion combines homography-based BEV features with features lifted through 3D space. Ray Conditioning exposes each camera's viewing direction to the fusion network. Its tracking component, BEV Track Recovery (BTR), uses low-confidence detections only to continue existing tracks. The same detections cannot start new tracks. With two WildTrack cameras, GRACE improves MOTA from 83.54 for TrackTacular, our baseline, to 91.07.
47. 【2609.16871】SPEAR NeXT Causal Latent Forecasting Across Multiple Horizons for Spectral Temporal Earth Representation Learning
链接：https://arxiv.org/abs/2609.16871
作者：Rajiv Ranjan,Udaiveer Singh,Shashank Tamaskar,Dharmendra Saraswat
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：retrospective sequence summarization, inherently dynamic, learned through reconstruction, sequence summarization, retrospective sequence
备注： 24 Pages
点击查看摘要
Abstract:Earth observation is inherently dynamic, yet temporal information in many foundation models is learned through reconstruction, invariance, or retrospective sequence summarization. SPEAR NeXT is introduced as a compact pixel-wise multimodal spectral temporal foundation model in which temporal self supervision is formulated as past only, multi horizon latent Earth state prediction. Instantaneous states are first encoded by the pretrained SPEAR model from optical, radar, and environmental observations into compact 32 dimensional embeddings. Their temporal evolution is then modeled by a causally masked Trans former that predicts multiple future latent states from pre ceding observations. Relative temporal order is represented using Rotary Position Embeddings, while month and year embeddings encode seasonal phase and interannual con text.
48. 【2609.16870】cnerv:dual-domain temporal context modeling for implicit neural video compression
链接：https://arxiv.org/abs/2609.16870
作者：Xuezhi Xiang,Yixin Zhao,Heqi Xiang,Jiayao Liu,Shanjun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：constrained bit rate, Video compression aims, minimize reconstruction distor, reconstruction distor tion, bit rate
备注：
点击查看摘要
Abstract:Video compression aims to minimize reconstruction distor tion under a constrained bit rate. Existing video implicit neural representations (INRs) often decode frames independently, leaving intermediate features unconditioned on previous reconstructions and content embeddings without explicit temporal prediction. We propose TCNeRV, which exploits reconstructed context in both feature and embedding domains. Its multi-scale temporal-context fusion (MTCF) module injects gated historical features at multiple decoder scales, while temporal embedding-residual coding (TERC) predicts each content embedding and codes only its residual. With approximately 3M parameters, TCNeRV achieves an average PSNR of 36.08 dB on the UVG dataset, outperforming HNeRV-Boost by 2.20 dB. It reduces BD-rate by 22.06%, 66.73%, and 29.85% relative to HM, DCVC, and HiNeRV, respectively, demonstrating competitive rate-distortion performance with limited model capacity.
49. 【2609.16864】EMPO: Learning Temporal Context for Dynamic Robot Manipulation
链接：https://arxiv.org/abs/2609.16864
作者：Zhenyang Feng,Jimin Heo,Erik B. Sudderth,Unnat Jain
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：achieved impressive performance, achieved impressive, impressive performance, performance in quasi-static, state aliasing
备注： Accepted at CoRL 2026. Project page: [this https URL](https://tempo-robot.github.io/)
点击查看摘要
Abstract:Vision-language-action (VLA) models have achieved impressive performance in quasi-static manipulation, but struggle in dynamic manipulation tasks because they operate on a single observation at inference time. We identify two representational failures that underlie this limitation. The first is motion ambiguity, where a single observation does not include scene dynamics and therefore cannot anticipate the future state of moving objects. The second is state aliasing, where visually similar observations from different points in a task require different actions. We argue that these failures persist regardless of model scale and inference latency, showing that the bottleneck is missing temporal context rather than model capacity. Based on this insight, we propose TEMPO, which augments a pretrained VLA with two temporal inputs: a motion summary extracted from a frozen video foundation model to resolve motion ambiguity and a compact proprioceptive history to resolve state aliasing. TEMPO requires no modification to the backbone and adds minimal compute overhead at training or deployment. Across four dynamic manipulation tasks, it improves Bottle Handover success from 44% to 74% and is the only method that solves state aliasing. Probing and ablation studies confirm that each temporal signal independently addresses its corresponding failure. We further release TEMPO-Bench, a benchmark of over 50k annotated frames for evaluating motion-aware robot perception in both regression and multiple-choice formats. Project Website: this https URL
Comments:
Accepted at CoRL 2026. Project page: this https URL
Subjects:
Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2609.16864 [cs.RO]
(or
arXiv:2609.16864v1 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2609.16864
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
50. 【2609.16859】Measuring Annotation Efficiency for Handwritten Devanagari Recognition: Sample-Complexity Curves for Four Pretraining Regimes
链接：https://arxiv.org/abs/2609.16859
作者：Manglesh Kumar Pandey,Sumit Kumar Banshal
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：text recognition systems, train handwritten text, handwritten text recognition, produced manually, text recognition
备注：
点击查看摘要
Abstract:To train handwritten text recognition systems we need word images and their corresponding transcriptions, and these transcriptions are produced manually. For a script that can be read by only a small number of specialists, this manual transcription is a limitation, because the trained models are supposed to save the time of those same specialists. A relevant question therefore arises: how many transcriptions are needed before a recogniser becomes useful, and how much of that cost can pretraining remove? In this study the answer is measured directly for handwritten Devanagari. We keep the recogniser, optimiser and evaluation protocol the same and change only the number of real transcribed words used for fine-tuning across nine budgets from 10 to 4,000 and four initialisation regimes, with six seeds at every point. The resulting curves are then converted into annotation-equivalent terms. A CER of 0.50 is reached by supervised synthetic pretraining using only 81 transcribed words, whereas random initialisation requires 355, which gives a label multiplier of 4.40 [3.56, 4.99]. There is a zero-shot reference point as well: with no real transcribed words at all, this pretraining is worth about 136 of them. This advantage gets smaller as the target accuracy improves, and at the most demanding target we measure, it cannot be distinguished from no saving at all. A fourth arm in which only the encoder is transferred separates the effect of the pretraining method from that of transfer scope, and masked image modelling is observed to transfer negatively over a bounded range of budgets. We emphasise that the scarcity in this study is constructed by subsampling a large corpus.
51. 【2609.16858】coPrompt: Temporal-Conservative Prompt Learning for Vision-Language Models
链接：https://arxiv.org/abs/2609.16858
作者：Zeyi Shao,Haowen Hua,Jiaxin Zhang,John See,Zeyd Boukhers,Cong Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：adapts vision-language models, learning adapts vision-language, Prompt learning adapts, vision-language models, context tokens
备注： Accepted at ECCV 2026 (Main Conference). Code: [this https URL](https://github.com/haji-mimi/TecoPrompt)
点击查看摘要
Abstract:Prompt learning adapts vision-language models, such as CLIP, by adjusting a small set of context tokens. However, under few-shot supervision, even moderate label noise can disrupt prompt optimization. To address this issue, we propose TecoPrompt, a closed-loop robust prompt-learning framework that revisits optimal transport (OT) pseudo-labeling from a temporal perspective. TecoPrompt employs an entropic OT plan in the CLIP semantic space to obtain globally consistent label candidates. It verifies the reliability of these candidates by examining trajectory stability: a noisy label is only rewritten if the OT candidate remains unchanged within a K-epoch temporal stability window and passes a confidence gate based on Exponential Moving Average (EMA). This approach helps reduce confirmation bias. The rewritten labels are then integrated back into prompt training using a tri-group objective that includes three loss functions aligned with clean, mid, and noisy subsets. Experiments on seven datasets with synthetic symmetric and asymmetric noise, as well as Food101N, demonstrate significant performance improvements. For example, on the OxfordPets dataset, with 50% asymmetric noise, TecoPrompt achieves an accuracy of 0.843, up from 0.775.
52. 【2609.16847】RegRet: Enhancing Region-Level Retrieval in Large Multimodal Models
链接：https://arxiv.org/abs/2609.16847
作者：Xun Liang,Honghui Yang,Weihang Pan,Ruisi Zhao,Boyuan Pan,Yao Hu,Wenxiao Wang,Binbin Lin,Deng Cai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：user-specified image regions, align user-specified image, e-commerce product search, search and RAG, Large Multimodal Models
备注： Accepted by ECCV 2026. 22 pages, including references and appendix
点击查看摘要
Abstract:Region-level retrieval aims to align user-specified image regions with relevant regions or textual descriptions, playing a crucial role in realworld applications such as e-commerce product search and RAG. Although recent Large Multimodal Models (LMMs) have made significant strides in multimodal retrieval, they primarily focus on global-level tasks and struggle to capture effective region-level representations. To bridge this gap, we present RegRet, an LMM-based Region-level Retrieval framework that enhances the regional representations without compromising overall global retrieval performance. At its core, RegRet integrates a Region-Aware Encoder to capture detailed regional features while balancing them with the global background context. To further enhance the fine-grained understanding and discriminability of representations, we design a multi-stage training pipeline that includes detailed localized captioning and regional contrastive learning tasks. In addition, considering the absence of region-level contrastive training data and the limited diversity of evaluation tasks in current benchmarks, we introduce the REGMB benchmark. It comprises 225k contrastive pairs, covering four multimodal retrieval tasks. Extensive experiments validate the effectiveness of our approach. RegRet outperforms strong baselines in the zero-shot setting. Further training with contrastive learning leads to an average improvement of more than 20\% on both REGMB and public benchmarks, while achieving comparable or better results on global-level retrieval tasks.
53. 【2609.16842】FAHCD-Net: Frequency-Adaptive Heatmap-Conditional Diffusion Networks for Robust Facial Landmark Detection
链接：https://arxiv.org/abs/2609.16842
作者：Jun Wan,Jiwei Hu,Shengkai Hu,Qilu Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved significant advancements, Facial Landmark Detection, Frequency-Adaptive Heatmap-Conditional Diffusion, Landmark Detection, Heatmap-Conditional Diffusion Network
备注：
点击查看摘要
Abstract:Facial Landmark Detection(FLD) is a crucial task in various applications and has achieved significant advancements in recent years. However, current FLD methods still struggle under challenging conditions, where facial structural variations, information loss, and noise interference severely compromise the integrity and accuracy of learned facial features. To address these issues, we propose Frequency-Adaptive Heatmap-Conditional Diffusion Network (FAHCD-Net), which integrates a Frequency-Adaptive Heatmap-Conditional Diffusion (FAHCD) model with a Smoothness Regularization (SR) loss in a cascaded framework. Specifically, the FAHCD model incorporates a Hierarchical Frequency Adaptation (HFA) module designed to suppress redundant high-frequency noise through multi-layer frequency decomposition and adaptive reconstruction, thereby preserving essential facial structures. Additionally, the SR loss is proposed to further mitigate the interference of high-frequency noise and enhance the smoothness of the generated landmark heatmaps. By cascading the FAHCD model with the SR loss, FAHCD-Net effectively leverages both statistical and frequency-based distribution characteristics of the data to progressively generate more accurate landmark heatmaps from noisy inputs. Extensive experiments on popular benchmarks demonstrate the effectiveness and robustness of the proposed method, achieving state-of-the-art performance in FLD tasks under challenging scenarios. The source code is available at this https URL.
54. 【2609.16841】StackTok: Accelerating VLMs Inference with Budget-Adaptive Visual Token Selection
链接：https://arxiv.org/abs/2609.16841
作者：Zhenbin Wang,Lei Zhang,Lituan Wang,Wei Huang,Yan Wang,Zhenwei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Increasing image resolution, image resolution produces, resolution produces ever-longer, produces ever-longer visual-token, Increasing image
备注：
点击查看摘要
Abstract:Increasing image resolution produces ever-longer visual-token sequences in vision-language models (VLMs), substantially raising their inference cost. To reduce this overhead without retraining, existing methods select compact token subsets that prioritize query relevance, visual coverage, or a fixed trade-off between them. The appropriate balance, however, varies across queries and token budgets: localized questions favor relevance, whereas holistic questions demand broader visual coverage. We introduce StackTok, a training-free selector that treats query relevance as the objective and visual coverage as budget-calibrated support. StackTok builds a size-indexed coverage reference from a coverage-only greedy sequence and adjusts its support target using query--vision affinity entropy. A reference-gated interleaved selection policy then switches between relevance- and coverage-oriented additions according to the current subset's support deficit. For high-resolution inputs, StackTok allocates one shared token budget across crops according to the combined marginal gain of locally nominated tokens. Evaluated with five VLMs over ten distinct image-understanding benchmarks, StackTok ranks first among training-free selectors in every tested model--budget setting. On high-resolution LLaVA-NeXT-7B, it retains 95.26% of full-token performance with only 160 of 2{,}880 (5.6%) visual tokens.
55. 【2609.16832】What Breaks Local Watermarks? A Robustness Benchmark for Local Invisible Image Watermarking
链接：https://arxiv.org/abs/2609.16832
作者：Kai Yao,Bence Szilágyi,Sebestyén Kamp,Máté Poór,Máté Szilveszter,Matyas K. Zsoldos,Marc Juarez
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)
关键词：image watermarking embeds, payload recovery, enabling payload recovery, Local image watermarking, local watermark robustness
备注： This work has been accepted for publication in the proceedings of the 19th ACM Workshop on Artificial Intelligence and Security (AISec 2026), co-located with ACM CCS 2026. The final version will be published in the ACM Digital Library
点击查看摘要
Abstract:Local image watermarking embeds an invisible signal into selected image regions rather than spreading it across the entire image, enabling payload recovery from specific objects or regions without perceptibly altering the image. Existing studies evaluate the robustness of payload recovery and localization under image transformations, but they often focus on their own proposed method, resulting in narrow evaluations with inconsistent choices of transformations, datasets, and metrics. These inconsistencies across studies limit direct comparisons across methods and muddle the overall picture of local watermark robustness. To address this gap, we present the first systematic robustness benchmark for local watermarks across 55 image transformations, including (i) signal distortions, (ii) changes in image coordinate alignment, (iii) indirect local edits, and (iv) direct watermark edits. The benchmark evaluates MaskWM, WAM, OmniGuard, TrustMark, and PixelSeal, all methods that either provide native localization or require minimal adaptation to support it. Our results show that all evaluated methods are vulnerable to some transformation, with MaskWM standing out as offering the strongest payload recovery and localization, although it has the lowest image quality in the clean setting. Synchronization further improves MaskWM's payload recovery under several geometric transformations, albeit at an additional cost to image quality. A key finding is that local watermark robustness depends strongly on the nature of the transformation: signal distortions are often tolerated by the strongest methods, while geometric misalignment and generative local edits, such as inpainting and outpainting, can completely impair payload recovery. We observe that payload recovery and localization are related but not interchangeable, and both strongly depend on the transformation's impact on the watermark region.
56. 【2609.16811】Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation
链接：https://arxiv.org/abs/2609.16811
作者：Meisen Wang,Zhiqiang Tian,Wei Bao,Chengjie Wang,Shaoyi Du,Siqi Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：robust visual perception, shown great potential, learning remains challenging, remains challenging due, annotated event data
备注：
点击查看摘要
Abstract:Event cameras have shown great potential for robust visual perception, yet scaling event representation learning remains challenging due to the scarcity of large-scale annotated event data. Pretrained image models provide scalable semantic supervision, but existing image-to-event methods rely on rigid pixel-wise or token-wise alignment that overlooks modality discrepancies in texture, density, and appearance, potentially causing semantic collapse and limiting transferability. To address this issue, we propose Hyper-RED, a simple, painless, and scalable image-to-event pretraining framework that transfers high-order semantic structures from images to events. Hyper-RED uses hypergraphs to model and align high-order semantic associations among multiple image and event tokens, enabling cross-modal knowledge transfer while accommodating modality-specific differences rather than enforcing rigid one-to-one correspondence. Specifically, given a paired event--image sample, Hyper-RED leverages DINOv3 to extract spatial token representations and constructs image, event, and cross-modal semantic hypergraphs, where each hyperedge connects multiple semantically correlated tokens. We further introduce a hypergraph relational distillation loss that imposes complementary intra- and cross-modal constraints, enabling the event encoder to inherit image-derived semantic organization while preserving local relational consistency and event-specific characteristics. Experiments on three tasks across five event datasets demonstrate consistent scaling from ViT-S to ViT-L and state-of-the-art performance (Fig.1). The code is available at: this https URL.
57. 【2609.16797】EDi: Temporal Memory-Enhanced and Denoising Transformer for Surgical Instrument Segmentation
链接：https://arxiv.org/abs/2609.16797
作者：Jiahong Yuan,Weiming Mi,Tao Zhang,Haoyin Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Query-based segmentation methods, computer assisted surgery, shown promising potential, Query-based segmentation, surgical instrument segmentation
备注：
点击查看摘要
Abstract:Query-based segmentation methods have shown promising potential for surgical instrument segmentation and recognition, which is essential for scene understanding and downstream tasks in computer assisted surgery. However, most existing approaches predominantly rely on per-frame predictions and overlook cross-frame temporal priors as well as temporal-consistency constraints. This limitation often leads to unstable query representations and suboptimal category recognition. In this paper, we propose TEDi, a Temporal memory-Enhanced and Denoising transformer for surgical instrument segmentation that addresses these is sues through Memory Search Enhancement and Temporal Consistency Denoising. The former introduces a query-level memory bank and a memory search enhancement encoder to retrieve discriminative representations from historical frames, enriching current-frame features. The latter constructs a temporally consistent reference as a cross-frame semantic anchor to suppress temporally unstable predictions and promote semantic coherence across frames. Extensive experiments on two benchmark datasets, EndoVis 2017 and EndoVis 2018, demonstrate that TEDi consistently outperforms state-of-the-art methods, highlighting its potential to further advance computer-assisted surgery. Our code is available at this http URL.
58. 【2609.16788】Noise2Noise Revisited: Training Pair Distributions Dominate Loss Choice in Self-Supervised Denoising
链接：https://arxiv.org/abs/2609.16788
作者：Dingyan Shang,Zhenyu Xu,Youting Wang,Bonan Shen,Bowen Liu
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：independently corrupted observations, trains denoisers, corrupted observations, independently corrupted, eliminating clean references
备注： 8 pages, 3 figures, 3 tables. Accepted to The 8th International Conference on Video, Signal and Image Processing (VSIP 2026). Code and data: [this https URL](https://github.com/dyshang/noise2noise-revisited)
点击查看摘要
Abstract:Noise2Noise (N2N) trains denoisers on pairs of independently corrupted observations, eliminating clean references. We stress-test two natural conjectures about why the L1 loss outperforms L2 here. First, the hypothesis that the L1 loss confers robustness via parameter sparsity confuses the loss with Lasso regularization: an explicit Lasso penalty produces the predicted sparsity yet fails to reproduce L1's cross-noise behavior, while L1- and L2-trained weight distributions are indistinguishable. Second, the population optima of the two losses coincide exactly for symmetric signal posteriors and nearly so for concentrated ones. Measured differences are therefore dominated by optimization dynamics (bounded-influence gradients), which we probe with gradient statistics and contaminated-target training. On Kodak24 with five synthetic noise families, the L1 loss holds a statistically significant edge over L2, below 1 dB PSNR, holding across three seeds on 13 of the 14 noise columns. On real camera noise the loss is not the decisive variable in distribution: on official SIDD validation blocks, synthetic-Gaussian-trained N2N models gain only 0.8 to 3.7 dB over the noisy input regardless of loss, while retraining on SIDD's own noisy pairs, never reading ground truth, gains 9.4 to 11.0 dB, far ahead of BM3D. All metrics are on raw network outputs, and the study makes no leaderboard claim. The training pair distribution, not the loss, carries the inductive bias. That design rule applies wherever clean references are unobtainable, from microscopy to industrial inspection sensors.
59. 【2609.16785】PSMP-CLIP: Patch-Prompt SAM and Multi-Semantic Prompting for CLIP-Based Zero-Shot Anomaly Detection
链接：https://arxiv.org/abs/2609.16785
作者：Xuezhi Xiang,Guanghao Wu,Heqi Xiang,Jiayao Liu,Xiaoheng Li,Yiming Chen,Shanjun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Zero-shot anomaly detection, anomaly detection aims, Zero-shot anomaly, detection aims, aims to localize
备注：
点击查看摘要
Abstract:Zero-shot anomaly detection aims to localize anomalies without target-domain samples. Existing CLIP-based methods suffer from coarse anomaly maps and limited semantic prompts. We propose PSMP-CLIP, integrating patch-prompt SAM2 segmentation (PPSS) and multi-semantic guided prompt regularization (MSGPR). PPSS samples prompts directly from intermediate patch features, avoiding threshold drift and guiding SAM2 to produce precise masks. MSGPR uses multiple learnable prompts constrained by semantic anchors to preserve generalization. Experiments on 14 datasets show highly competitive performance, achieving the best pixel-level AUROC on MVTec AD, BTAD, DTD-Synthetic, CVC-ClinicDB, TN3K, Endo, and Kvasir.
60. 【2609.16778】Unifying Semantic Priors and High-Frequency Traces: Enhancing V-JEPA with Mixture-of-Experts for Robust Synthetic Image Forensics
链接：https://arxiv.org/abs/2609.16778
作者：Simone Teglia,Irene Amerini
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：social media platforms, spread of misinformation, posing a severe, information integrity, unchecked proliferation
备注： 10 pages, 2 figures. Code available at [this https URL](https://github.com/ALCOR-Lab-DIAG/MoE-JEPA)
点击查看摘要
Abstract:The unchecked proliferation of manipulated images on social media platforms has increased the spread of misinformation, posing a severe threat to public trust and information integrity. Modern deepfake detectors typically rely on Vision Transformers (ViTs) to capture the low-level inconsistencies that characterize fully synthetic or locally tampered images. However, the global understanding of such foundation models is not enough to discriminate alone between real and fake multimedia content, especially in challenging scenarios where images are compressed or transmitted through social media. In this paper we pioneer the application of Joint-Embedding Predictive Architecture (JEPA) models to deepfake detection, taking advantage of the generalized representation of visual reality that such World Models have exhibited. We hypothesize, and empirically demonstrate, that the intrinsic world understanding of JEPA models can be used as a strong prior for a deepfake detector. To fully exploit JEPA capabilities, we propose MoE-JEPA, a dual-stream architecture for deepfake detection. By enhancing a V-JEPA 2 backbone with a Residual Mixture-of-Experts (MoE) mechanism, along with a noise stream branch, our model dynamically internalizes forensic knowledge. Furthermore, a Gated Attention Multiple Instance Learning (MIL) module is employed to ensure precise spatial semantic understanding. Evaluated on the SID-Set benchmark, comprising 300K AI-generated, tampered and authentic images, MoE-JEPA establishes a new state-of-the-art with an accuracy of 95.54%, successfully outperforming vastly larger models.
61. 【2609.16775】IMVS: Interactive Medical Volume Segmentation with Test-Time Adaptation - A New Method for Annotating Radiology Datasets
链接：https://arxiv.org/abs/2609.16775
作者：Abhilaksh Singh Reen,Kushal Borkar,Ritvik Mahapatra
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Annotating large radiology, Annotating large, large radiology datasets, Volume Mask Tracker, Slice Mask Adapter
备注：
点击查看摘要
Abstract:Annotating large radiology datasets is bottlenecked by the manual effort of delineating structures slice-by-slice in 3D volumes. Interactive methods reduce this effort but stay interaction-inefficient: slice-wise methods (including many foundation models) ignore inter-slice continuity, while 3D and video-based methods propagate a prompt with a \emph{fixed} propagator that never adapts to the target volume, so it drifts on low-contrast or pathological structures and must be re-prompted. We present IMVS, a human-in-the-loop annotation framework that composes three components into a closed loop rather than a new segmentation primitive: a lightweight 2D Slice Mask Adapter (SMA) fine-tuned online from user scribbles, a frozen Volume Mask Tracker (VMT) that propagates corrected masks across adjacent slices, and a soft teacher--student alignment that limits forgetting. The SMA is backbone-agnostic (UNet++, DeepLabV3, TransUNet). Across 8 public CT/MRI datasets, IMVS matches strong interactive baselines in quality while sharply cutting annotation effort: $14.4\times$ faster than a proficient copy-based manual workflow ($22.3\times$ over naive manual), $4.6\times$ over slice-wise and $1.9\times$ over 3D interactive methods. MedSAM2 and ScribblePrompt stay competitive or stronger on well-delineated organs; IMVS's advantage is largest on challenging targets and on interaction efficiency. Source code and Demo Video: this https URL.
62. 【2609.16773】FSANet: Frequency-Spatial Aware Network for Image Segmentation
链接：https://arxiv.org/abs/2609.16773
作者：Ruibo Wang,Ziyi Shen,Huaming Wu,Dong Liang,Kun Shang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Image segmentation remains, remains challenging due, poor lighting, Spatial Aware Network, due to occlusions
备注： 13 pages
点击查看摘要
Abstract:Image segmentation remains challenging due to occlusions, poor lighting, and irregular structures. Although transformer-based methods achieve high accuracy, they rely heavily on long-range spatial features, leading to high computational costs and neglecting prior knowledge or noise patterns, resulting in missing details and unclear boundaries. To address these issues, we propose Frequency Spatial Aware Network (FSANet), which integrates prior knowledge with a dual-domain solver to sequentially adapt to diverse segmentation tasks. Specifically, we design three key modules: (1) Structure Prior Module, which recovers overlooked details; (2) Dual-Domain Awareness Module, which captures salient features while disentangling noise; and (3) Edge Estimation Module, which enhances edge awareness for more precise segmentation. In addition, the limited availability of comprehensive segmentation datasets covering various real-world scenarios hinders the performance of existing methods. To address this, we introduce SceneX, a novel open-source dataset featuring 10 challenging non-ideal scenarios, establishing a new benchmark for evaluating and improving the robustness and real-world applicability of the segmentation models. Extensive experiments demonstrate the efficiency and effectiveness of FSANet.
63. 【2609.16772】HLC-GS: Risk-Map-Guided Height-Layer Consistency Gaussian Splatting for DSM Reconstruction from Optical Satellite Imagery
链接：https://arxiv.org/abs/2609.16772
作者：Jie Yang,Yingdong Pi,Qiyan Luo,Xiaoyu Wang,Lekang Wen,Mi Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Digital Surface Model, Surface Model, Digital Surface, Earth surface, fundamental geospatial data
备注：
点击查看摘要
Abstract:A Digital Surface Model (DSM) is a fundamental geospatial data product for representing the elevation of the Earth's surface. Recently, 3D Gaussian Splatting (3DGS) has shown considerable potential for DSM reconstruction from multi-view optical satellite imagery due to its explicit scene representation and efficient optimization. However, in 3DGS-based DSM generation, alpha-weighted aggregation of Gaussian altitudes may blend splats from different height layers at the same rendered pixel or DSM sampling location, producing non-physical intermediate elevations and height-layer mixing errors. To address this problem, we propose HLC-GS, a risk-map-guided height-layer consistency Gaussian Splatting method for DSM reconstruction from optical satellite imagery. HLC-GS consists of a risk map module, a dominant-layer reliability correction module, and a secondary-layer suppression module. The risk map localizes high-risk pixels with abnormal height dispersion and unreliable dominant-layer responses, while the latter two modules regularize unreliable dominant-layer responses and suppress weakly supported far secondary-layer responses. Extensive experiments are conducted on the DFC2019 and IARPA2016 datasets. Compared with six state-of-the-art DSM reconstruction methods, HLC-GS achieves better overall accuracy. Compared with the latest and precision-enhanced EOGS, HLC-GS reduces the average MAE from 1.46 m to 1.18 m and the average RMSE from 2.78 m to 2.58 m over the evaluated scenes, while improving PAG$_{2.5}$ from 86.09\% to 88.61\%. Overall, these results demonstrate that explicitly modeling per-pixel height-layer consistency alleviates height-layer mixing and improves the geometric quality of 3DGS-based DSM reconstruction from optical satellite imagery.
64. 【2609.16755】De-GAN - Dynamic Parameter Tuned GAN for 3D Medical Image Segmentation: A Step Towards Generalisation
链接：https://arxiv.org/abs/2609.16755
作者：Zoha Usama,Azadeh Alavi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Brain tumor segmentation, overlaps surrounding tissue, tumor segmentation remains, Brain tumor, segmentation remains difficult
备注： 5 pages, 2 figures
点击查看摘要
Abstract:Brain tumor segmentation remains difficult because enhancing tumor (ET) has low contrast and overlaps surrounding tissue, while scanner and site variation causes domain shift. We propose DE-GAN, a contrast-enhancing conditional GAN that combines input-adaptive dynamic convolutions, style-aware feature mixing, and coordinate encoding to synthesize slice-adaptive FLAIR images. A label-guided, class-conditional target separates tumor-core (TC) and ET intensities while preserving anatomy. The generated FLAIR is concatenated with the original MR modalities and used to train a 3D U-Net. Across BraTS 2015, 2018, and 2019, DE-GAN improves segmentation over the baseline and static EnhGAN replacement on most reported TC/ET metrics, with the largest gains from retaining both original and enhanced FLAIR. Code and pretrained models are available at this https URL.
65. 【2609.16737】Seeing What Matters: Visual Cue Guided Video Planning for Generalizable Robot Navigation
链接：https://arxiv.org/abs/2609.16737
作者：Hojin Lee,Sizhe Lester Li,Maximilian Hilger,Susie Lu,Achim J. Lilienthal,Vincent Sitzmann,Daniel A. Duecker
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Generative video models, predicting future observations, Generative video, video, promising backbone
备注： Project website: [this https URL](https://cuenav.github.io)
点击查看摘要
Abstract:Generative video models can serve as a promising backbone for robot navigation by predicting future observations as video plans. Recent approaches often condition video planning on short-horizon guidance and recover geometric waypoints through scene reconstruction, leaving longer-horizon planning and precise video-to-action translation less explored. We present CueNav, a video model-based navigation framework combining visual cue guided video planning with an embodiment-specific Inverse-Dynamics Model (IDM). As visual cues, we use a Bird's-Eye View (BEV) map to convey global task context and retain part of the robot body in the egocentric observation to expose embodiment context. These cues guide the video planner, while the IDM translates dense flow fields extracted from the video plan into robot actions. With the visual cue encoding global task context, CueNav achieves nearly 2x higher success in maze navigation than planning without the cue. The body-aware view with the IDM enables precise navigation with 70% success in a narrow passage where comparison methods largely fail to complete the task. We further demonstrate zero-shot semantic-conditioned navigation and deployment of the same video planner across different robot platforms. Our results show that visual cue-guided video planning with embodiment-specific action grounding paves the way toward a generalizable navigation framework for longer-horizon planning and embodiment-aware control. Additional results and code are available on our project website: this https URL.
66. 【2609.16727】PriorPose: Reference-Guided Joint Deformation and Alignment for Category-Level Object Pose Estimation
链接：https://arxiv.org/abs/2609.16727
作者：Yihan Chen,Huan Ren,Wenfei Yang,Hang Du,Tianzhu Zhang,Feng Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：instance-specific CAD models, Category-level object pose, CAD models, Category-level object, object pose estimation
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Category-level object pose estimation seeks to recover a similarity transform $(R,t,s)$ for unseen instances without instance-specific CAD models. Most competitive methods are correspondence-based: prior-free variants regress canonical (NOCS) coordinates directly from local observations and implicitly memorize the canonical frame in the weights, which ties the parameters to category-typical orientations and hurts generalization under distribution shift; prior-based variants introduce a category prior but typically follow a serial deform-then-align pipeline, where underconstrained canonical completion can corrupt correspondences and induce error cascades in pose. We propose PriorPose, a reference-guided correspondence framework that keeps the category prior explicit and solves canonicalization and alignment jointly in a shared feature space. A reference-guided seeded transformer embeds the partial observation and the category prior as token sets and fuses them via geometry-aware seeds, from which the network jointly predicts a per-point NOCS field for visible points and a canonical deformation of the prior that reconstructs a full canonical instance, while a deep pose head regresses $(R,t,s)$ from the induced correspondences. A two-part shape consistency objective, with canonical-space and camera-space consistency losses, couples correspondence, deformation, and pose, reducing reliance on memorized canonical orientations and avoiding deform-then-align error cascades. Experiments on standard and larger-category benchmarks demonstrate that PriorPose sets new state-of-the-art results on most evaluated metrics, especially under strict pose thresholds, while remaining competitive on relaxed pose and IoU metrics and showing improved robustness under shape variation and domain shift.
67. 【2609.16722】VideoMM: Adaptive Macro-Micro Inference for Efficient Video MLLMs
链接：https://arxiv.org/abs/2609.16722
作者：Haoyu Guo,Yuan Feng,Junlin Lv,Mingjun Xiao,S Kevin Zhou,Xike Xie
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Scaling Multimodal Large, Multimodal Large Language, Large Language Models, Scaling Multimodal, incurs prohibitive costs
备注：
点击查看摘要
Abstract:Scaling Multimodal Large Language Models (MLLMs) to long-form video understanding is bottlenecked by the explosion of visual tokens, which saturates context windows and incurs prohibitive costs. Current solutions predominantly rely on auxiliary models for token reduction but face a fundamental dilemma: lightweight encoder-driven approaches often overlook critical semantic information, whereas heavyweight MLLM-driven reduction negates the efficiency gains. {In this work, we identify a more fundamental inefficiency underlying this dilemma: while fine-grained visual details are essential for detailed understanding, they are largely redundant for the preliminary task of selecting semantically relevant regions. } Motivated by this, we introduce \textbf{VideoMM}, which marks a paradigm shift from model-centric downsizing to adaptive perceptual granularity. Specifically, our framework {decouples selection from reasoning} by executing semantic filtering on a cost-effective \textit{Macro Proxy} (derived from downscaled frames), and projecting the selected regions onto high-fidelity \textit{Micro Tokens} for detailed understanding only when necessary. Extensive evaluations show that VideoMM significantly outperforms existing solutions. It achieves a 6.13$\times$ speedup and a 7.4\% accuracy gain over full-context baselines on LongVideoBench, and further accelerates inference by 2.73$\times$ over current leading methods, establishing a highly scalable paradigm for long-video understanding. Our code is available at: this https URL.
68. 【2609.16695】MAETrack: Unleashing the Potential of Pretrained Geometric Priors for 3D Single Object Tracking
链接：https://arxiv.org/abs/2609.16695
作者：Sifan Zhou,Qiwei Wang,Linyue Tan,Ziyu Liu,Ziyu Zhao,Xiaobo Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains insufficiently understood, single object tracking, transformed representation learning, single object, remains insufficiently
备注： 35 pages, 5 figures
点击查看摘要
Abstract:Large-scale pre-training has transformed representation learning in 2D vision, yet its transferability to 3D single object tracking (SOT) remains insufficiently understood. Directly fine-tuning self-supervised 3D encoders, such as masked autoencoders (MAE), often leads to sub-optimal adaptation because the reconstruction objective is not fully aligned with the spatial-temporal matching requirements of tracking. In this paper, we observe that this difficulty can be interpreted as a layer-wise transfer mismatch: shallow layers tend to preserve transferable geometric cues, while deeper layers become increasingly specialized to the reconstruction pretext task and are less suitable for downstream tracking. Based on this observation, we propose MAETrack, a lightweight adaptation framework for transferring pre-training MAE representations to 3D SOT. MAETrack includes Layer-Selective Initialization (LSI), which initializes only the shallow stages of the tracking backbone from pre-trained weights while re-initializing deeper stages, and Geometric Residual Gating (GRG), which reinforces structurally salient regions in the search BEV features before template-search fusion through residual spatial modulation. Extensive experiments on standard 3D SOT benchmarks show that MAETrack consistently improves upon vanilla fine-tuning baselines with limited computational overhead. More broadly, our results suggest that effective transfer from 3D reconstruction pre-training to 3D tracking is not merely a matter of partial fine-tuning, but depends on a tracking-oriented transfer principle that preserves shallow geometry while adapting deeper representations to the downstream objective.
69. 【2609.16690】Efficient 3D Whole-Body PET Image Denoising via Conditional Rectified Flow With Optimized Sampling Strategy
链接：https://arxiv.org/abs/2609.16690
作者：Jiale Shen,Guolin Wang,Chenhao Wang,Xinhui Su,Wei Luo,Feng Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Positron Emission Tomography, Reducing radiation exposure, Emission Tomography, Positron Emission, affect diagnostic interpretation
备注：
点击查看摘要
Abstract:Reducing radiation exposure in Positron Emission Tomography (PET) is important for patient safety; however, ultra-low-dose imaging suffers from severe noise, which may affect diagnostic interpretation without appropriate image enhancement. While current 3D deep generative models, particularly diffusion models, have shown strong reconstruction fidelity, their practical use can be limited by long inference times. In contrast, faster 2D-based alternatives may have difficulty maintaining volumetric consistency, an important consideration for whole-body PET imaging analysis. To bridge this gap, we propose a one-pass conditional 3D rectified flow (3D Flow) framework for whole-body PET image denoising that incorporates a novel optimized non-uniform sampling strategy. The model is trained with a one-pass linear-interpolant velocity-matching objective. This approach reconstructs a full 3D volume in approximately 30 seconds in our implementation, compared with multi-hour inference for the evaluated 3D DDPM baseline. Evaluations including zero-shot transfer to an independent clinical dataset show that our model achieves favorable global image quality and lesion conspicuity compared with the evaluated 3D DDPM and DDIM baselines, including on challenging short-acquisition data. Furthermore, the proposed method shows promising zero-shot transfer performance across the evaluated datasets and unseen dose levels (down to 1/100 of the standard dose), with artifact-focused visual comparisons supporting the need for further lesion-level validation. By balancing reconstruction fidelity and computational efficiency, this work presents a candidate approach for ultra-low-dose whole-body PET image denoising.
70. 【2609.16689】Efficient Quantization-Aware Distillation with Cross-Modal Alignment for Edge Vision-Language Models
链接：https://arxiv.org/abs/2609.16689
作者：Jinwoo Jeon,GyuYeop Do,Yubin Lim,Nam-Joon Kim,Hyun Gon Ryu,Hyuk-Jae Lee,Byung-Jun Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large-scale vision-language models, CLIP enable strong, devices remains challenging, strong open-vocabulary reasoning, enable strong open-vocabulary
备注：
点击查看摘要
Abstract:Large-scale vision-language models (VLM) such as CLIP enable strong open-vocabulary reasoning, yet deploying these capabilities on resource-constrained edge devices remains challenging. EdgeVL addresses this problem by distilling CLIP representations into lightweight multi-modal encoders and applying quantization-aware training (QAT) for efficient Open-Vocabulary Classification (OVC) on edge hardware. However, its two-stage optimization applies different objectives for distillation and QAT, and contrastive learning is performed within the quantized student space, which can result in inconsistent optimization and reduced training efficiency. Moreover, identical supervision across RGB and non-RGB modalities may lead to modality imbalance. We propose a unified framework for quantized semantic distillation tailored to edge deployment. By jointly optimizing distillation and quantization within a unified teacher-anchored framework, our method ensures consistent training under quantization, suppressing hard negatives and enlarging decision margins. Additionally, we design a lightweight cross-attention adapter that enhances non-RGB representations through RGB-guided semantic transfer, narrowing the modality gap. Extensive experiments demonstrate consistent improvements on non-RGB modalities while maintaining deployment efficiency.
71. 【2609.16686】Differentiable Mesh State Estimation via Factor Graph Inference for Deformable Object Reconstruction
链接：https://arxiv.org/abs/2609.16686
作者：Lidia Al-Zogbi,Fangjie Li,Samuel Tobin,James Ferguson,Nithesh Kumar,Alejandro Chara,Kuan-I Chung,Mingxing Rao,Ayberk Acar,Susheela Sharma Stern,Robert Webster,Daniel Moyer,Alan Kuntz,Caleb Rucker,Tucker Hermans,Jie Ying Wu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Estimating deformable object, object states remains, Estimating deformable, deformable object states, mesh state estimation
备注： 8 pages
点击查看摘要
Abstract:Estimating deformable object states remains a fundamental challenge in robotics and simulation. We propose a novel factor graph-based framework for probabilistic mesh state estimation of deformable objects. The method directly updates a tetrahedral mesh, a rich and physically-grounded representation of an environment, by combining physics priors, noisy sensor measurements, and temporal smoothness constraints within a unified probabilistic formulation. The estimation problem is posed as a nonlinear least-squares optimization and solved using Levenberg-Marquardt. Ex vivo central-airway obstruction experiments and simulations on deforming cube models demonstrate reliable and accurate reconstruction under both rigid motion and deformation, highlighting the potential of this probabilistic approach for principled, measurement-driven mesh state estimation in deformable object reconstruction.
72. 【2609.16684】MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild
链接：https://arxiv.org/abs/2609.16684
作者：Jiangong Xiao(1),Zhihao Zhang(2),Yifei Dong(3),Chao Ma(3),Zhouyi Jin(3),Zhiwen Hou(3),Li Liu(3),Weihuang Chen(2),Hongbin Sun(2),Maoqing Yao(3) ((1) Northwestern Polytechnical University, (2) Xi'an Jiaotong University, (3) Maniformer)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires high-fidelity hand-motion, Learning manipulation, high-fidelity hand-motion reconstruction, human video requires, video requires high-fidelity
备注： 13 pages, 3 figures, 3 tables
点击查看摘要
Abstract:Learning manipulation from human video requires high-fidelity hand-motion reconstruction in metric units. Today's metric hand labels come from studio rigs and instrumented headsets, and both are confined in the same two ways: neither leaves a prepared setting, and neither is checked against an independent reference. Unconstrained head-worn recording promises the opposite trade-off, scaling with the number of people wearing a device. We therefore introduce MEgoVista, an offline pipeline that turns a single unprepared MEgo View recording into metric two-hand and head motion in one gravity-aligned world frame. Three properties set it apart from existing egocentric reconstruction systems: first, it reconstructs in settings studio volumes and tabletop rigs cannot reach, settling hand ownership at detection so bystander hands stay out of the wearer's trajectory; second, it takes its metric gauge from calibrated stereo rather than a monocular prior, installing scale at initialisation so policies receive physical units, not arbitrary coordinates; third, both outputs are scored inside a motion-capture volume against independent Chingmu optical capture, under a protocol that audits its own reference and charges what a method declines to predict. MEgoVista is offered as a measured route from egocentric video to metric hand supervision, one that widens where such labels can be gathered.
73. 【2609.16672】Lesion-centered 3D mapping of colonoscopy procedures: validation of a hierarchical ensemble pipeline on public benchmark videos
链接：https://arxiv.org/abs/2609.16672
作者：Hyunjun Kim,Hyeonwoo Na,Jaewoo Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Colonoscopy recording practice, Background and Objective, recording practice preserves, practice preserves text, preserves text reports
备注： 21 pages, 12 figures, 4 tables. Code: [this http URL](http://github.com/hyunjun1121/endovision-pipeline) (Zenodo DOI [https://doi.org/10.5281/zenodo.22136766](https://doi.org/10.5281/zenodo.22136766) )
点击查看摘要
Abstract:Background and Objective: Colonoscopy recording practice preserves text reports and still photographs, while the spatial information already present in the recorded video - where the scope traveled, where a lesion was observed, and whether the same lesion was seen again - is discarded when the procedure ends. This study determines whether a lesion-centered spatial record can be assembled and validated without full-colon 3D reconstruction. Methods: A four-layer hierarchical pipeline was assembled - (1) a global topological map, (2) lesion-level spatio-temporal tracks, (3) on-demand local 3D reconstruction, and (4) persistent lesion identity across repeated observations - and ran end to end on four public videos (two C3VDv2 sequences with ground-truth depth and two full REAL-Colon procedures; 40,245 frames). All components are published, individually validated methods; the contribution is their lesion-centered assembly, linking rules, and evaluation. Results: Revisits, impossible under forward-only mapping by construction, were detected by entry-map Bayesian localization: 5,614 and 4,043 revisit events (56 and 68 distinct nodes) in the two full procedures. Lesion-identity merging at the adopted threshold 0.5 maintained ground-truth purity 1.0 while auto-merging 20 of 231 candidate pairs. The endoscopy-specific geometry engine outperformed a general-purpose foundation model on all metrics (overall absolute relative error (AbsRel) 0.2276 vs. 0.3523). Conclusions: The results are partial but establish a concrete near-term path: revisit detection, lesion identity, and local 3D each returned quantitative, reproducible output without waiting for complete geometric reconstruction; validating the record on clinical data is the next step.
74. 【2609.16664】Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA
链接：https://arxiv.org/abs/2609.16664
作者：Yu Li,Zhengran Shen,Yachun Mi,Puchao Zhou,Shaohui Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Leveraging Large Vision-Language, Large Vision-Language Models, Image Quality Assessment, No-Reference Image Quality, Leveraging Large
备注： Accepted by ICML2026
点击查看摘要
Abstract:Leveraging Large Vision-Language Models like CLIP has recently set new benchmarks for No-Reference Image Quality Assessment (NR-IQA). However, the contrastive pretraining of CLIP inherently prioritizes semantic invariance, which often suppresses subtle perceptual signals, a phenomenon we term perceptual submergence. Furthermore, standard preprocessing techniques (e.g., cropping and interpolation) further exacerbate the loss of critical high-frequency quality cues. In this paper, we propose the Cross-modal Perception Alignment Adapter (CMPA), a manifold-aware framework designed to disentangle perceptual distortions from dominant semantics. CMPA introduces a Perception-Sensitive Feature Extractor (PFE) that projects CLIP features into a compact, low-dimensional subspace, explicitly magnifying distortion-induced off-manifold deviations. Subsequently, a Cross-Modal Perception Alignment Injector (PAI) aligns these features with quality-aware text anchors and re-injects them into the backbone. To ensure input fidelity, we also devise a Residual-enhanced Perceptual Downscaling strategy that adaptively compensates for resolution-induced information loss using Just Noticeable Difference (JND) guided frequency re-injection. Extensive evaluations on several benchmark datasets demonstrate that our approach significantly outperforms state-of-the-art methods, effectively recovering the perceptual signals submerged in semantic-dense representations.
75. 【2609.16662】SAVTrack: Selective Vote Aggregation for Reliability-Aware Point Cloud Tracking
链接：https://arxiv.org/abs/2609.16662
作者：Sifan Zhou,Linyue Tan,Qiwei Wang,Ziyu Zhao,Xiaobo Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：LiDAR point clouds, single object tracking, autonomous systems, clouds is essential, essential for autonomous
备注： 12 pages, 5 figures
点击查看摘要
Abstract:3D single object tracking (SOT) in LiDAR point clouds is essential for autonomous systems, but remains challenging under sparse and incomplete observations. In such cases, different target points provide highly uneven constraints on the object center, causing some point-to-center votes to be substantially less reliable than others. Existing point-based trackers typically aggregate these hypotheses without explicitly modeling their reliability, allowing inaccurate votes to contaminate proposal clustering and degrade localization accuracy. To address this issue, we propose \textbf{SAVTrack}, a motion-aware tracking framework with \textbf{Selective Vote Aggregation (SAV)}. SAVTrack estimates the reliability of each candidate vote from both local seed features and inter-frame motion context, and removes low-confidence hypotheses before proposal clustering. This pre-aggregation gating prevents unreliable hypotheses from affecting cluster formation while introducing only modest computational overhead. SAVTrack achieves competitive performance on KITTI and nuScenes, reaching 68.4/87.4 and 58.44/69.82 Success/Precision, respectively, while running at 82 FPS. It retains fewer than one-sixth of the candidate votes used by dense aggregation and remains particularly effective under sparse target observations.
76. 【2609.16656】Channel-Wise and Token-Aware Post-Training Quantization for Visual State Space Duality
链接：https://arxiv.org/abs/2609.16656
作者：Jonghyeon Lim,Changhoon Yim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：State Space Duality, Visual State Space, State space models, State space, Visual State
备注： 10 pages, 6 figures, 5 tables
点击查看摘要
Abstract:State space models (SSMs), particularly Mamba, have emerged as efficient alternatives to attention-based architectures and have been extended to vision through ViM, VMamba, and Visual State Space Duality (VSSD). Yet the low-bit post-training quantization (PTQ) behavior of VSSD remains insufficiently understood. A weight-activation split on VSSD-Tiny identifies activation quantization as the dominant low-bit bottleneck, while representative inputs to selected VSSD-backbone linear layers exhibit strong channel-wise magnitude variation and token-localized extremes. We propose the Channel-wise Token-balanced Output-Aware Clipping (CTOAC) method, which learns per-input-channel clipping bounds by minimizing a token-balanced reconstruction loss on the corresponding linear outputs. Only the selected linear layers and their input activations are quantized; other backbone operations retain their original precision. Across VSSD-Tiny, VSSD-Small, and VSSD-Base, the proposed CTOAC method retains ImageNet-1K accuracy and remains substantially more robust than the evaluated baselines at more aggressive precision settings. Applying the same quantization scope to VSSD backbones on COCO and ADE20K preserves strong object detection, instance segmentation, and semantic segmentation performance. An optimized RTX 4090 deployment configuration achieves up to 1.42x end-to-end speedup over FP32.
77. 【2609.16647】ViD: Vision-Dominant Gender Bias Mitigation for Large Vision-Language Models
链接：https://arxiv.org/abs/2609.16647
作者：Zhipeng Zhao,Zhaoqiang Wei,Peishun Liu,Youwei Zhao,Ruichun Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：compromising output trustworthiness, large vision-language models, Gender bias, large vision-language, bias
备注： EMNLP 2026 Main
点击查看摘要
Abstract:Gender bias in large vision-language models (LVLMs) undermines their fairness and reliability, compromising output trustworthiness. Current mitigation methods rely on training-phase adjustments or post-hoc calibration, but face limitations in dynamic visual bias mitigation. These include inability to capture real-time visual-textual incongruence, dependence on predefined gender bias taxonomies, and degraded cross-modal alignment with emergent bias patterns. To address these challenges, we propose ViD, a causally-inspired framework that analyzes attention mechanisms across five distinct patterns, revealing confounding effects from strong language priors. ViD demonstrates that visual-to-language cross-attention effectively suppresses bias while preserving general reasoning capabilities and text generation quality. ViD incorporates dual mechanisms: backdoor adjustment counters strong language priors, while refined token selection in decoding layers optimizes processing. This enhances model robustness and inference efficiency. Our integrated approach significantly mitigates gender bias across multidimensional social attributes in LVLMs, improving visual grounding and output fairness. Cross-benchmark validation shows ViD reduces gender bias by 14.7\% on single-attribute evaluations (FACET) and achieves significant improvements on image captioning tasks (MS COCO), with gender bias score improving from 0.6708 to 0.9978 for LLaVA. Crucially, these improvements require no additional training overhead, making ViD a scalable and practical solution for bias mitigation in LVLMs.
78. 【2609.16646】What Do Hallucinations Reveal About Multimodal Reasoning? Diagnosing Visual Grounding Failures via Contrastive Decoding Probes
链接：https://arxiv.org/abs/2609.16646
作者：Zhipeng Zhao,Wenxu Wang,Peishun Liu,Ruichun Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：strong multimodal models, progress requires, strong multimodal, methodologies beyond benchmark, instruments
备注： EMNLP 2026
点击查看摘要
Abstract:When strong multimodal models are widely available, progress requires new scientific methodologies beyond benchmark scores---using models as instruments for understanding behavior. We address this by asking: can we use large vision-language models (LVLMs) as experimental instruments for studying their own failure dynamics? Focusing on visual hallucination, we introduce SAFE, a training-free decoding framework that contrasts visually-grounded and vision-ablated generation paths to produce a token-level contrastive grounding score that identifies when the model favors linguistic priors over visual evidence. This signal serves dual roles: as a practical proxy for detecting visually-ungrounded tokens, and as the basis for decoding-time penalties. Our analysis yields three empirical observations: visual dependency decays over generation, hallucinations co-occur in temporal clusters, and early intervention reduces clustering without substantially degrading fluency. On MMHalBench, SAFE substantially outperforms all compared baselines; results elsewhere are more mixed. We argue that designing contrastive probes exemplifies a broader mission: using models as instruments for scientific understanding. Code: this https URL.
79. 【2609.16637】Can Knowledge Transfer Parameters Be Learned? LePoKet for Efficient Robotic Vision
链接：https://arxiv.org/abs/2609.16637
作者：Yanick C. Tchenko,Felix Mohr,Hicham Hadj-Abdelkader,Hedi Tabia
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：robotic systems operating, latency budgets, Knowledge transfer, Hereditary Knowledge Transfer, systems operating
备注：
点击查看摘要
Abstract:Efficient perception is central to robotic systems operating under constrained computation, memory, and latency budgets. Knowledge transfer from larger pretrained models offers a practical route to stronger compact perception networks, but existing approaches commonly rely on fixed distillation objectives or manually designed interaction mechanisms. Building on Hereditary Knowledge Transfer (HKT), we propose LePoKet (Learnable Parameter Optimization for Knowledge Transfer), a structural transfer framework that embeds knowledge inheritance directly into the forward computation. LePoKet introduces a block-wise Extract-Transform-Mix interface whose interaction parameters are optimized jointly with the child network through a Learnable Genetic Attention (LGA) operator, without auxiliary distillation losses or temperature scaling. We first characterize the mechanism on CIFAR-10 and CIFAR-100 using ResNet parent-child pairs, obtaining relative error reductions of 24.57% and 25.1%, respectively, over standard child training. We then evaluate LePoKet for dense motion estimation by integrating it into a compact RAFT-based optical-flow model trained only on FlyingChairs and FlyingThings3D. LePoKet improves the compact RAFT baseline from 2.21 to 1.92 EPE on Sintel Clean, from 3.35 to 3.01 on Sintel Final, and from 7.51 to 6.39 on KITTI. A direct comparison with HKT further shows that LePoKet improves CIFAR-10 accuracy from 92.40% to 93.40% while achieving the best Sintel Final and KITTI errors among the evaluated compact transfer variants, with comparable performance on Sintel Clean. These results demonstrate that learnable structural transfer generalizes across recognition and motion perception tasks and provides a promising approach for efficient robotic vision.
80. 【2609.16626】JewelTry: Mask-Free Scale Aware Jewelry Virtual Try-On
链接：https://arxiv.org/abs/2609.16626
作者：Xinlei Niu,Peixia Li,Jun Wang,Chenchen Xu,Jiayu Yang,Jing Zhang,Pulak Purkait,Hongdong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：jewelry VTON, VTON, enables customers, online shopping, customers to visualize
备注：
点击查看摘要
Abstract:Virtual try-on (VTON) enables customers to visualize how fashion products appear when worn and has become an important technology for online shopping. While recent advances have substantially improved garment VTON, jewelry remains a challenging and underexplored category due to its small size, rigid structure, and sensitivity to fine-grained visual details. Realistic jewelry VTON requires not only faithful appearance transfer but also accurate scale and placement relative to the wearer. Existing jewelry VTON methods typically rely on mask guidance, whereas mask-free approaches lack explicit guidance for modeling the product scale. To bridge this gap, we introduce JVTO-Bench, a benchmark dataset for scale-faithful jewelry VTON, providing reference source target triplets with real-world product-scale annotations across four major jewelry categories. Building upon this benchmark, we propose JewelTry, a mask-free diffusion framework for scale-aware jewelry VTON. JewelTry incorporates a scale adapter that encodes product dimensions into a scale token, enabling the model to learn scale relationships between jewelry items and surrounding human anatomy in-context. To further improve jewelry consistency, we introduce a single-directional condition attention mechanism and an attention refinement loss that preserve both coarse geometry and fine-grained structural details of the reference jewelry. Extensive experiments show that JewelTry achieves a balance among visual fidelity, background preservation, object consistency and scale accuracy, establishing a strong baseline for mask-free, scale-aware jewelry virtual try-on.
81. 【2609.16610】EgoPathBench: Evaluating Zero-Shot Egocentric Waypoint Decision-Making in Vision-Language Models
链接：https://arxiv.org/abs/2609.16610
作者：Yang Zhao,Zhuo Chen,Xubo Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：placing joint demands, Zero-shot waypoint navigation, navigation requires vision-language, today foundation VLMs, requires vision-language models
备注： 18 pages, including supplementary material
点击查看摘要
Abstract:Zero-shot waypoint navigation requires vision-language models to select, from the current first-person observation, a sequence of spatial actions that is feasible for the agent and reaches the goal, placing joint demands on the integrated spatial intelligence of today's foundation VLMs. Existing spatial-intelligence benchmarks primarily evaluate isolated judgments of relations, directions, or targets and therefore do not directly measure the integrated navigation ability required to combine target recognition, action-consequence assessment, distance estimation, and path planning. To fill this evaluation gap, we introduce EgoPathBench, a dataset and five-task benchmark for first-person waypoint decision-making. Each question presents an egocentric RGB image, a natural-language goal, and numbered visible waypoints; a model returns traversable candidates or an ordered route. Predictions are evaluated for candidate feasibility, adjacent-edge legality, and goal arrival under point-agent or embodied geometry. EgoPathBench contains 31,852 training, 1,345 validation, and 1,111 benchmark questions and retains at least one geometrically verified reference route for every route question. Across nine VLMs, the highest EgoPath Score is only 28.3. The top-ranked model reaches 35.9% success on Point Path, but only 2.9% and 4.0% on Embodied Path and Intent Path, respectively, showing that current models remain limited in forming complete, goal-consistent routes under embodiment constraints. Beyond the evaluation data, we release the corresponding training resource. Fine-tuning Qwen 3.5 4B on the released training split raises its EgoPath Score from 3.9 to 38.9 and improves all four reported evaluations across three external spatial benchmarks, with gains of 1.4--9.6 points.
82. 【2609.16603】G3AR: Graph-Guided Neural Visual Geometry for Scalable Multi-Sequence Aerial Registration
链接：https://arxiv.org/abs/2609.16603
作者：Jeng Wen Joshua Lean,Ting-Yu Yen,Wei-Fang Sun,Simon See,Hung-Kuo Chu,Shih-Hsuan Hung
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Full-context neural visual, neural visual geometry, sequence-based chunking poorly, chunking poorly captures, poorly captures irregular
备注： 6 pages, 4 figures, 8 tables. Accepted to SIGGRAPH Asia 2026 Technical Communications
点击查看摘要
Abstract:Full-context neural visual geometry is impractical for thousands of images, while sequence-based chunking poorly captures irregular non-local overlap in multi-sequence aerial collections. We present Graph-Guided Neural Visual Geometry for Aerial Registration (G3AR), a graph-guided framework for scalable dense neural geometry. Before local inference, G3AR builds a geometrically verified image-proximity graph that guides bounded overlapping chunks and induces a chunk graph whose maximum spanning tree defines alignment topology. Compatible backbones process chunks independently; shared-image predictions then estimate three-dimensional similarity (Sim(3)) transforms that register local cameras and geometry in a common frame. Across four real aerial scenes, G3AR improves pose error and runtime in matched VGGT- and Pi3-backed comparisons, while its DA3 variant achieves the lowest pose error among evaluated neural-geometry methods.
83. 【2609.16601】SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation
链接：https://arxiv.org/abs/2609.16601
作者：Zixiu Ding,Zilin Zhao,Yingjie He,Xinlang Kang,Guansu Wang,Wei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, made strong progress, produce fluent claims, large language models, Multimodal large
备注： 33rd International Conference on Neural Information Processing (ICONIP 2026)
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have made strong progress on visual question answering and image captioning, yet they still produce fluent claims about objects, attributes, or relations that are not grounded in the image. Many remedies either modify decoding at test time, which adds latency, or fine tune with preferences such as DPO variants, which teach which answer is preferred but not when the model's own answer is unreliable. We argue that calibrated self assessment is the missing signal. We introduce Savor, a training framework that (i) augments the output schema with token and answer confidence, (ii) optimises the policy with a Group Relative Policy Optimisation (GRPO) objective that penalises calibration error and poor abstention decisions, and (iii) uses the learned confidence at inference time to revisit visual evidence only when the model is uncertain. Experiments on POPE, HallusionBench, AMBER and MMHal-Bench across two recent backbones (InternVL3-8B and Qwen3-VL-8B) show that Savor reduces hallucination while preserving general capability on MME and MMBench, with lower Expected Calibration Error than DPO and decoding baselines.
84. 【2609.16597】A Vision-Language Foundation Model for Precise and Comprehensive Brain Tumor Diagnosis from Preoperative Multimodal Data
链接：https://arxiv.org/abs/2609.16597
作者：Yinong Wang,Jianwen Chen,Zhou Chen,Shuwen Kuang,Haoning Jiang,Yanzhao Shi,Huichun Yuan,Yan-ran(Joyce)Wang,Bing Wang,Lei Wu,Bin Tang,Li Meng,Baihua Luo,Bin Zhou,Wei Ding,Weiming Zhong,Wei Hou,Yuanbing Chen,Zhiping Wan,Wei Wang,Zhenkun Xiao,Wenwu Wan,Allen He,Yuyin Zhou,Longbo Zhang,Feifei Wang,Zhixiong Liu,Michael Iv,Xuan Gong,Liangqiong Qu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Databases (cs.DB)
关键词：Magnetic Resonance Imaging, Background Non-invasive presurgical, Non-invasive presurgical diagnosis, overlapping imaging features, Background Non-invasive
备注： 94 pages, 22 Figures
点击查看摘要
Abstract:Background Non-invasive presurgical diagnosis of brain tumor types from Magnetic Resonance Imaging (MRI) is essential but challenging due to overlapping imaging features across tumor types, inter-observer variability, and the extensive training required for expertise. We aimed to develop an MRI-based Artificial Intelligence (AI) model for automatic and reliable brain tumor classification with diagnostic uncertainty quantification and radiology reports generation. Methods We developed BrainVLM to classify all 12 World Health Organization (WHO) 2021 brain tumor types. BrainVLM integrates an uncertainty quantification strategy to indicate prediction reliability and a module for generating radiology reports to elucidate the clinical rationale. BrainVLM was trained on multi-modal data (MRI scans, demographics, and radiology reports) from 40,043 individuals. It was validated on 5,211 patients with pathologically confirmed brain tumors, including 3,877 held-out patients from the primary hospital and 1,334 patients from 11 independent hospitals. We further conducted two proof-of-concept studies to validate its clinical utility in AI-clinician workflows: 1) a blinded multi-reader study where 12 neuroradiologists across varying experience levels interpreted 248 retrospective cases with or without AI assistance, and 2) a real-world prospective study in which 1,009 patients were independently and blindly assessed by BrainVLM and radiologists before surgery. Additionally, we demonstrated BrainVLM's utility in preoperative molecular subgroup prediction for adult-type diffuse gliomas, using a multi-center cohort of 632 patients.
Comments:
94 pages, 22 Figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Databases (cs.DB)
Cite as:
arXiv:2609.16597 [cs.CV]
(or
arXiv:2609.16597v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.16597
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
85. 【2609.16594】FRPSS: Feature Rearrangement in Pre-Shape Space for Single-Image Generation
链接：https://arxiv.org/abs/2609.16594
作者：Yuexing Han,Haoxuan Zhang,Bing Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generative models trained, Generative models, global structural integrity, balance global structural, Manifold Structural Rearrangement
备注： 28 pages, 18 figures
点击查看摘要
Abstract:Generative models trained on a single image often struggle to balance global structural integrity and local diversity. Existing single-image generation methods commonly rely on random noise to drive the generation process and lack explicit global structural constraints, making the generated results prone to spatial structural misalignment when structural variations occur. To address the issue, Feature Rearrangement in Pre-Shape Space for Single-Image Generation (FRPSS) is proposed in this paper. The core of FRPSS is the Manifold Structural Rearrangement with Feature Augmentation on Geodesic Surface (MSR-FAGS) module. MSR-FAGS replaces the randomly initialized features of the low-scale generator with rearranged Pre-Shape features and uses the features to guide image generation at subsequent scales, thereby reducing the risk of structural misalignment. To support downstream tasks such as stylization, a Scale-adaptive Sliding-window Patch Extraction (SSPE) strategy is further designed, and a directional Contrastive Language-Image Pre-training supervision module with SSPE (CLIP-SSPE) is constructed. Qualitative and quantitative experiments demonstrate that FRPSS achieves the best Single Image Fréchet Inception Distance (SIFID) scores on all three datasets while maintaining competitive Learned Perceptual Image Patch Similarity (LPIPS). Further qualitative experiments verify the effectiveness of FRPSS across multiple downstream tasks with the CLIP-SSPE module.
86. 【2609.16591】FLAT: Resampling Image and Text into 1D Flexible-Length Aligned Transmodal Tokens for Retrieval and Generation
链接：https://arxiv.org/abs/2609.16591
作者：Guangyu Sun,Shlok Kumar Mishra,Wentao Bao,Robert Zhenheng Yang,Xiao Wang,Xiyuan Wang,Yujunrong Ma,Chen Yuan,Max Xiangjun Fan,Jun Xiao,Jianpeng Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Traditional multimodal representation, Traditional multimodal, multimodal representation learning, separate downstream generative, FLAT
备注：
点击查看摘要
Abstract:Traditional multimodal representation learning and generation are two stages: a contrastive or self-supervised visual encoder is trained first, followed by a separate downstream generative model. This setup bottlenecks generative performance behind frozen embeddings. To bridge this gap, we revisit joint multimodal representation learning and generation to produce linearly interpolatable embeddings that are directly consumable by generative decoders. We present FLAT (Flexible-Length Aligned Transmodal representations), a representation pre-training framework that jointly optimizes a shared multimodal encoder alongside downstream text-to-image (T2I) and image-to-text (I2T) decoders. By combining contrastive alignment with bidirectional cross-modal generative objectives, FLAT ensures its representations function as both discriminative semantic descriptors and generative conditions. Architecturally, FLAT maps visual and textual inputs into a unified continuous 1D sequence space, applying nested dropout over prefix-K tokens to enable dynamic output lengths. A single pre-training stage allows FLAT to perform cross-modal retrieval and generation across variable prefix K, achieving a T2I GenEval score of 71.1. Task-specific fine-tuning aligns model performance with state-of-the-art baselines: 83.1 GenEval on T2I generation; 40.5 BLEU-4 and 138.6 CIDEr on MS-COCO image captioning; and Recall@5 scores of 86.8 (I2T) / 75.8 (T2I) on MS-COCO alongside 98.3 (I2T) / 93.6 (T2I) on Flickr30K. Finally, qualitative evaluations demonstrate that FLAT representations natively support linear interpolation, latent space arithmetic, and zero-shot composed retrieval.
87. 【2609.16578】GraLoD: Graphics-Inspired Continuous Level-of-Detail Learning for Image Restoration
链接：https://arxiv.org/abs/2609.16578
作者：Hu Gao,Lizhuang Ma,Yulong Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：spatial support required, support required, degradation types, LOD, restoration
备注：
点击查看摘要
Abstract:The spatial support required for image restoration varies across degradation types, image regions, and reconstruction stages. However, most existing methods rely on predefined multi-scale hierarchies and aggregate features through fixed fusion or attention, leaving the representation scale itself largely determined by the network architecture. This limitation becomes more pronounced when a task-specific backbone is extended to heterogeneous degradations in all-in-one restoration. Inspired by level-of-detail (LOD) rendering in computer graphics, we propose GraLoD, a plug-and-play framework that treats restoration scale as a spatially varying and stage-dependent continuous variable. GraLoD reuses the native encoder hierarchy, aligns its multi-scale features into a shared LOD representation space, and predicts a stage-conditioned LOD field at each decoder stage. Each spatial location then continuously queries only two neighboring representation levels, enabling the effective restoration scale to adapt to both local image content and reconstruction progress. To prevent degenerate or arbitrary scale selection, we further introduce minimal-sufficient footprint calibration (MSFC) together with structure-aware regularization (SAR) to encourage restoration-effective and spatially coherent LOD assignments. GraLoD can be directly integrated into existing restoration backbones without redesigning their fundamental feature-processing blocks. Extensive experiments demonstrate consistent improvements in task-specific and all-in-one restoration.
88. 【2609.16572】Efficient Text-to-Image Generation: An Adaptive Step Schedule Controller for Diffusion Models
链接：https://arxiv.org/abs/2609.16572
作者：Kuluhan Binici,Cihan Acar,Shivam Aggarwal,Siying Liu,Tulika Mitra
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：balancing time costs, image quality, fixed number, number of denoising, balancing time
备注：
点击查看摘要
Abstract:Text-to-image diffusion models often use a fixed number of denoising steps, balancing time costs and image quality. However, the optimal number of steps depends on the complexity of the input text prompt. We propose an adaptive diffusion controller that dynamically adjusts the number of steps to generate high-quality images efficiently, without additional model training. By leveraging a mixture of step schedules with varying step sizes and evaluating the error term discrepancy at each timestep, our method transitions between schedules to optimize performance. Experiments on COCO and DiffusionDB show that our approach reduces inference time while maintaining visual fidelity, offering a more efficient alternative for text-to-image diffusion models.
89. 【2609.16567】Counterfactual Reasoning for Robust Visual Question Answering
链接：https://arxiv.org/abs/2609.16567
作者：Truong-Binh Duong,Thanh-Ngan Tran,Ngoc-Thao Nguyen,Bac Le
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern Visual Question, Visual Question Answering, Question Answering, exploit spurious correlations, Modern Visual
备注： Accepted for publication at the 30th International Conference on Knowledge-Based and Intelligent Information Engineering Systems (KES 2026). 9 pages, 5 figures
点击查看摘要
Abstract:Modern Visual Question Answering (VQA) models often exploit spurious correlations in training data, leading to poor out-of-distribution (OOD) generalization due to language bias. Although counterfactual learning has shown promise, existing methods can be improved to better guide attention toward causal evidence and strengthen feature discrimination. To address this, we propose a novel training framework that enhances counterfactual contrastive learning for VQA. Our framework introduces three key contributions: (1) a three-stage curriculum for stable multi-objective optimization, (2) an enhanced Batch-Contrastive loss for more discriminative feature learning, and (3) two novel regularizers, Answer-Contrastive (AC) loss to refine the prediction space and Gradient-Discrepancy (GD) loss to enforce causal visual grounding. Our model achieves a competitive accuracy of 61.64% on the bias-sensitive VQA-CP v2 benchmark while maintaining 62.80% on the standard VQA v2 dataset, yielding a small generalization gap of 1.16%. This demonstrates a strong balance between OOD robustness and in-distribution performance.
90. 【2609.16565】Vision And Text Transformer For Predicting Answerability On Visual Question Answering
链接：https://arxiv.org/abs/2609.16565
作者：Tung Le,Huy Tien Nguyen,Le Minh Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Visual Question Answering, predict answerable scores, Question Answering, Visual Question, question answering systems
备注：
点击查看摘要
Abstract:Answerability on Visual Question Answering is a novel and attractive task to predict answerable scores between images and questions in multi-modal data. Existing works often utilize a binary mapping from visual question answering systems into Answerability. It does not reflect the essence of this problem. Together with our consideration of Answerability in a regression task, we propose VT-Transformer, which exploits visual and textual features through Transformer architecture. Experimental results on VizWiz 2020 dataset show the effectiveness and robustness of VT-Transformer for Answerability on Visual Question Answering when comparing with competitive baselines.
91. 【2609.16551】Which Pretext Task Transfers? Self-Supervised Pretraining Objectives for Lung Ultrasound
链接：https://arxiv.org/abs/2609.16551
作者：Moein Heidari,Junbo Rao,Jai Choraria,Wenjin Chen,David J. Foran,Ilker Hacihaliloglu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：labelled medical images, Self-supervised learning, pretext objective remains, objective remains unclear, medical images
备注： Submitted to SPIE 2027
点击查看摘要
Abstract:Self-supervised learning (SSL) can reduce the need for labelled medical images, but the choice of pretext objective remains unclear for lung ultrasound (LUS). Contrastive learning, masked reconstruction, and joint-embedding predictive architectures (JEPA) differ in the space in which their targets are defined, yet existing ultrasound studies compare them under different corpora, backbones, and evaluation protocols. We compare these three objective families using the same encoder backbone, pretraining corpus, optimisation schedule, and frozen-evaluation protocol. Encoders are pretrained on COVID-BLUeS LUS videos and evaluated with linear, $k$NN, and attentive probes at 5\%, 10\%, 50\%, and 100\% label budgets. Evaluation is performed on POCUS using patient-level five-fold cross-validation and on the independently acquired Mendeley-Uganda dataset, which is excluded from both pretraining and probe fitting. At the full label budget under linear probing, VideoMAE and V-JEPA achieve $66.5 \pm 13.1$ and $65.4 \pm 11.7$ balanced accuracy on POCUS, while MoCo achieves $42.1 \pm 1.2$. On Mendeley-Uganda, the ranking reverses: MoCo performs best at $62.7 \pm 1.0$, followed by VideoMAE at $53.8 \pm 2.8$, while V-JEPA falls near chance at $35.1 \pm 4.9$. These results show that POCUS probe accuracy alone does not identify the objective that transfers best across datasets. We also outline planned representation-level analyses to examine this reversal. Code is publicly available at this https URL.
92. 【2609.16486】VPRef: A Cross-Domain Benchmark for Referring Remote Sensing Image Segmentation
链接：https://arxiv.org/abs/2609.16486
作者：Quanwei Liu,Tao Huang,Jiaqi Yang,Wei Xiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote Sensing Image, Sensing Image Segmentation, Earth observation, Rapid advancements, forefront of Earth
备注： 12 pages, 7 figures, 6 tables
点击查看摘要
Abstract:Rapid advancements in vision-language models have propelled Referring Remote Sensing Image Segmentation (RRSIS) to the forefront of Earth observation. However, practical deployments suffer severe performance degradation under a coupled dual-drift paradigm: visual domain drift from cross-spatial-resolution mismatches and spectral variations, alongside textual logic drift from unconstrained, variable user-input granularities. To mitigate these bottlenecks, this paper establishes the first cross-domain RRSIS benchmark, designated as the Vaihingen-Potsdam Referring (VPRef) dataset, comprising 46,972 language-image-annotation triplets organized into a three-tier linguistic hierarchy. Building upon this benchmark, we develop a tailored parameter-efficient domain adaptation baseline anchored on the Segment Anything Model (SAM3) via Low-Rank Adaptation (LoRA). Our framework counteracts visual distribution discrepancies through pseudo-label-driven self-training and addresses textual logic drift via random multi-granularity text prompt mixing. Crucially, the distribution of empirical metrics across ablative variants suggests a potential decoupling between cross-modal semantic robustification and visual domain alignment, demonstrating that linguistic variance drives fine-grained semantic invariance while pseudo-label propagation governs macro-scale spatial grid alignment. Extensive benchmarks demonstrate the proposed framework achieves superior cross-domain segmentation boundaries while modifying merely 1.08\% of the foundational parameter footprint, establishing a robust baseline for future multi-modal remote sensing domain adaptation research. The dataset and code will be available at this https URL.
93. 【2609.16475】MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing
链接：https://arxiv.org/abs/2609.16475
作者：Jiayi Yu,Xi Ye,Lina Wang,Yunkun Xia
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：subject attribute leakage, modifies designated subjects, faces cross subject, cross subject attribute, editing modifies designated
备注： 5 pages, 3 figures
点击查看摘要
Abstract:Multi subject video editing modifies designated subjects while preserving non target content, but faces cross subject attribute leakage, and occlusion ambiguity. Existing approaches rely on masks and struggle to distinguish overlapping subjects or ensure consistent generation. To address these limitations, we propose MDN-Control, a training free framework jointly controlling target localization, occlusion geometry, and appearance initialization. Specifically, mask-guided localization provides consistent target localization, while depth-aware occlusion control resolves ambiguous boundaries between overlapping subjects. We further introduce noise latent prompting, which retrieves Gaussian initializations from a noise library for prompt relevant priors. Experiments on MSVBench show that MDN-Control achieves the lowest CM-Err and the highest Q-Edit, while maintaining competitive text alignment and temporal consistency, demonstrating the effectiveness of combining spatial, geometric, and latent priors for multi subject video editing.
94. 【2609.16465】HairCS: Reconstructing Strand-Based Hair from Hair Cards
链接：https://arxiv.org/abs/2609.16465
作者：Zixuan Lu(1),Tongtong Wang(2),Yuefan Shen(2),Zhongtian Zheng(2),Chenfanfu Jiang(3),Yin Yang(1),Kui Wu(2) ((1) University of Utah, (2) LIGHTSPEED, (3) UCLA)
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：converts hair-card models, high-quality strand-based hairstyles, present an automated, automated pipeline, pipeline that converts
备注： 22 pages, 30 figures, 5 tables. Dataset: [this https URL](https://huggingface.co/datasets/HairCS2027/HairCS)
点击查看摘要
Abstract:We present an automated pipeline that converts hair-card models into high-quality strand-based hairstyles. Given a collection of textured triangular or quad strips as input, our method produces a strand-based representation that preserves the original hairstyle while enriching it with fine-scale geometric detail and adhering to standard production requirements: strands originate from the scalp, roots are uniformly distributed, and the hair volume is plausibly filled. The resulting assets are directly compatible with strand-based rendering, physics-based simulation, and common grooming modifiers (e.g., clumping, curling, noise) for enhanced realism and artistic control. We validate our approach on a large and diverse set of hairstyles, including short and long hair, curly styles, and complex styles such as buns and ponytails.
95. 【2609.16464】A multimodal large language model for evidence-based autism spectrum disorder screening
链接：https://arxiv.org/abs/2609.16464
作者：Jun Chen,Qi Zhao,Yunliang Jiang,Shuqin Cao,Yunqiang Lin,Chenglong Jia,Qiang Guo,Guang Dai,Xiongtao Zhang,Mengmeng Wang,Xiaoyue Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词：conventional assessment tools, autism spectrum disorder, faces a bottleneck, tools are subjective, management of autism
备注：
点击查看摘要
Abstract:The clinical management of autism spectrum disorder (ASD) faces a bottleneck in early screening, mainly because trained specialists are scarce and conventional assessment tools are subjective. Here, we introduce ASDchat, a multimodal large language model designed for evidence-based ASD screening, which takes video, audio, and dialogue as input. ASDchat adopts a dual-branch architecture, where the decision branch generates screening probabilities and the evidence branch generates traceable, timestamped behavioral evidence aligned with standardized clinical criteria (ADOS-2). The model was trained and evaluated on a dataset of 1,035 participants from 27 sites in China, which covered typically developing (TD) children, children with ASD, and children with other disorders. For ASD versus TD, ASDchat reached an area under the receiver operating characteristic curve (AUC) of 0.953 $\pm$ 0.021. On 9 held-out sites that were not used for training, the mean AUC was 0.932. Furthermore, unsupervised clustering of the behavioral dimensions split the ASD cases into six subtypes with different phenotypic profiles, and ASDchat suggests an intervention for each subtype. ASDchat provides a feasible path for large-scale, evidence-based early ASD screening in clinical practice.
96. 【2609.16459】OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation
链接：https://arxiv.org/abs/2609.16459
作者：Chenhao Qiu,Dawei Li,Yechao Zhang,Lei Gong,Zhen Tan
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：on-policy distillation improves, evaluate student trajectories, training-only visual evidence, Privileged on-policy distillation, visual evidence
备注： 24 pages, 12 figures, 7 tables
点击查看摘要
Abstract:Privileged on-policy distillation improves multimodal reasoning by allowing a teacher to evaluate student trajectories using rich, training-only visual evidence. Both models score these trajectories while conditioning on the same student-generated prefix. When a student misinterprets an image early in a response, this accumulating erroneous rationale eventually pulls the teacher away from its visual evidence. The teacher and student converge on the same hallucination, causing standard cross-model supervision to collapse precisely where correction is most needed. We find that the teacher's visual corrective preference is not lost under this misleading agreement. Comparing the predictions of the identical teacher given the real image and a visual null reveals that the privileged evidence still pushes the model toward the correct interpretation. We introduce OPD-Aha, which reconstructs the distillation target directly from this isolated visual preference rather than relying on the fragile teacher-student discrepancy. This reconstructed target aggressively suppresses continuations that contradict the image. Trained with this objective, students learn to naturally interrupt their own flawed reasoning with reflection tokens such as wait and actually. After reflection, subsequent generation relies less on the accumulated erroneous text and more on the visual evidence. Correcting these trajectories mid-generation fundamentally alters the reasoning process, yielding broad and consistent improvements across diverse fine-grained perception and complex multimodal reasoning benchmarks. Our code and models are available at this https URL.
97. 【2609.16448】Decentralized Gossip Learning and Federated Averaging for Histopathology Image Classification
链接：https://arxiv.org/abs/2609.16448
作者：Yusuf Ozturk,Enes Goltekin,Bengisu Atli,Akin Ozturk,Ulas Bagci
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Breast histopathology analysis, histopathology analysis increasingly, analysis increasingly relies, direct data pooling, Breast histopathology
备注： Recently accepted to Neural Computing and Applications
点击查看摘要
Abstract:Breast histopathology analysis increasingly relies on distributed learning because direct data pooling across institutions is often restricted by privacy, governance, and communication constraints. This study compares server-based Federated Averaging (FedAvg), fully decentralized gossip learning, and Hybrid Gossip-FedAvg for invasive ductal carcinoma (IDC) patch classification. Experiments used 277,524 color image patches with patient-disjoint training, validation, and test partitions and a workload-balanced, Dirichlet-guided allocation across six nodes. Ring, random degree-3, and fully connected gossip topologies were evaluated together with sensitivity analyses for statistical heterogeneity, mixing coefficient, learning rate, model drift, prediction disagreement, calibration, clinically motivated operating points, communication payload, and patient-level IDC burden, together with auxiliary backbone robustness analyses. In the principal alpha=0.3 experiment, Hybrid Gossip-FedAvg achieved a test area under the receiver operating characteristic curve (ROC-AUC) of 0.8811, closely followed by FedAvg at 0.8801 and fully connected gossip at 0.8751. Across three independent patient-level repetitions, FedAvg and Hybrid Gossip-FedAvg obtained the same mean ROC-AUC of 0.9082, with standard deviations of 0.0037 and 0.0043, respectively. Hybrid achieved the highest mean area under the precision-recall curve of 0.8240, whereas FedAvg produced the lowest mean Brier score of 0.1335. Denser gossip graphs improved discrimination but increased theoretical model payload, while ring gossip remained sensitive to learning rate and mixing strength. Overall, FedAvg provided the most consistently reliable server-based baseline, topology-aware gossip offered a viable decentralized alternative, and Hybrid Gossip-FedAvg provided a balanced compromise between peer-to-peer diffusion and periodic global coordination.
98. 【2609.16443】he Neverwhere Visual Parkour Benchmark Suite
链接：https://arxiv.org/abs/2609.16443
作者：Ziyu Chen,Henghui Bao,Haoran Chang,Alan Yu,Ran Choi,Kai McClennen,Gio Huh,Kevin Yang,Ri-Zhao Qiu,Yajvan Ravan,John J. Leonard,Xiaolong Wang,Phillip Isola,Ge Yang,Yue Wang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：deployment increasingly difficult, visual locomotion controllers, handling complex visual, complex visual environments, Neverwhere Benchmark Suite
备注： 9 pages, 14 figures. Accepted to IROS 2026. Project page: [this https URL](https://ziyc.github.io/neverwhere-bench/)
点击查看摘要
Abstract:State-of-the-art visual locomotion controllers are increasingly capable at handling complex visual environments, making evaluating their real-world performance before deployment increasingly difficult. This work intends to narrow this train/evaluation gap by developing a collection of hyper-photo-realistic, closed-loop evaluation environments - The Neverwhere Benchmark Suite - comprised of over sixty 3D Gaussian Splatting reconstructions of urban indoor and outdoor scenes. Our goal is to encourage large-scale and reproducible robot evaluation by making it easier to create and integrate Gaussian splats-based reconstructions into simulated continuous testing setups. We also underscore the potential pitfalls of relying exclusively on 3D Gaussian-generated data for training, by providing policy checkpoints trained over multiple Neverwhere scenes and their performance when evaluated in novel scenes. Our analysis illustrates the necessity of sourcing diverse data to ensure performance. Code and data are available on the project page: this https URL.
99. 【2609.16409】Reasoning with Image Generation
链接：https://arxiv.org/abs/2609.16409
作者：Nishad Singhi,Hector Garcia Rodriguez,Aditya Arora,Marcus Rohrbach,Anna Rohrbach
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enabling large language, steps before answering, processing by enabling, enabling large, decompose problems
备注： Accepted to COLM 2026. Code [this https URL](https://github.com/multimodal-ai-lab/reimagin) and website [this https URL](https://hector.gr/reimagin/)
点击查看摘要
Abstract:Chain-of-thought reasoning has revolutionized natural language processing by enabling large language models (LLMs) to decompose problems into intermediate steps before answering. Yet confining reasoning to the textual domain presents limitations for tasks requiring direct manipulation of visual representations. Recent efforts augment multimodal LLMs with external visual expert tools such as depth estimation or object detection modules, but these remain fundamentally limited by their reliance on narrow, rigid operations that cannot flexibly generate or transform visual content. We propose ReImaGin, which leverages image generation models as a flexible visual reasoning mechanism for multimodal LLMs: unlike fixed-function tools, they accept natural language commands and can perform open-ended visual operations, like removing an occlusion or generating a floorplan from multiple disjoint views of a room. Across six diverse visual reasoning tasks including multi-view spatial reasoning and collision prediction, ReImaGin consistently outperforms both text-only reasoning and specialist vision-tool baselines, with gains of up to 25\%, demonstrating the advantage of flexible, generative visual reasoning.
100. 【2609.16284】ProtoLIP: From Sentence-Level to Object-Level Evidence Disentanglement
链接：https://arxiv.org/abs/2609.16284
作者：Yan Zhu,Yongbo Chen,Zhengming Ding,Rebecca Faust
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：enable fine-grained interpretation, Query-conditioned vision, language models enable, models enable fine-grained, enable fine-grained
备注：
点击查看摘要
Abstract:Query-conditioned vision--language models enable fine-grained interpretation by revealing how visual evidence changes with textual queries. However, evidence conditioned on complete descriptions does not necessarily resolve into object-specific evidence, nor does an exposed evidence map necessarily identify the evidence that constitutes the model's prediction. Across multiple VLM architectures and independent benchmarks, we find that object-level queries often retain evidence from co-occurring objects and shared context. In this paper, we introduce \textbf{ProtoLIP}, a lightweight prototype-mediated evidence layer that organizes reusable visual prototypes into text-derived semantic families and uses query-dependent family routing to constrain which prototypes may provide evidence. Without spatial annotations or backbone retraining, ProtoLIP improves evidence localization and separation across query granularities, with localization gains transferring to independently pretrained VLMs with well-aligned patch--text representations. Despite using only text-derived weak supervision, ProtoLIP remains competitive with a spatially supervised grounding model while maintaining strong matching and competitive image--text retrieval. Crucially, ProtoLIP constructs its matching score directly from localized prototype evidence, enabling the score to be exactly decomposed into semantic-family and prototype contributions.
101. 【2609.16255】Efficient Reasoning Distillation: Small Video-Language Models via Synthetic CoT and Difficulty-Aware Fine-Tuning
链接：https://arxiv.org/abs/2609.16255
作者：Mantek Singh,Jeshwanth Challagundla,Siddharth Raina,Jasmin Jarsania
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：video question answering, distill reasoning capabilities, question answering, present an efficient, video question
备注： 14 pages, 2 figures, 5 tables. Published in MultiMedia Modeling (MMM 2026), LNCS 16412
点击查看摘要
Abstract:We present an efficient method to distill reasoning capabilities into compact video-language models (VLMs) for video question answering (VideoQA). Our approach fine-tunes a 2B-parameter model using only $\sim$900 uncertainty-selected examples, each augmented with synthetic chain-of-thought (CoT) rationales generated by a 4B teacher. Despite its minimal compute cost - under two hours on a single A100 GPU - our method enables the 2B model to outperform VLMs up to 4$\times$ larger, and generalize across CinePile, ActivityNet-QA, and MLVU, approaching the performance of its own 4B teacher. A key finding is that placing CoT rationales after the answer - contrary to standard prompting - substantially improves reasoning in compact models. This insight challenges prevailing CoT conventions and reveals new alignment strategies under limited model capacity. Our findings offer a practical blueprint for training deployable, reasoning-rich VLMs suited for mobile and edge applications.
102. 【2609.16233】SceneBench: A Hierarchical Benchmark for Vision-Language Understanding of 3D Scenes
链接：https://arxiv.org/abs/2609.16233
作者：Anubhav Khanal,Prabigya Acharya,Roshni Poudel,Sujan Kapali,Bigyan Bhatta,Pramish Paudel,Francois Rameau,Danda Pani Paudel
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：image understanding, understanding but remain, remain limited, Vision-language models excel, spatial reasoning
备注：
点击查看摘要
Abstract:Vision-language models excel at 2D image understanding but remain limited in 3D spatial reasoning. Progress is hindered by limitations in current benchmarks. First, 3D datasets often rely on point clouds that capture geometry but discard rich visual features like texture, text, and materials. Second, annotations treat objects in isolation while ignoring real-world hierarchical organization (scenes, rooms, functional areas, object groups). Third, evaluation tasks focus narrowly on basic recognition rather than multi-step spatial reasoning. In this context, we introduce SceneBench, a benchmark of 966 photorealistic 3D scenes reconstructed with Gaussian Splatting and densely annotated with hierarchical semantics spanning scenes, rooms, functional areas, object groups, and individual objects. These annotations are produced through a human-in-the-loop pipeline combining vision-language models with roughly 1,500 human-hours of iterative refinement and verification, producing over 183K annotated nodes with textual descriptions and 3D bounding boxes. Building on this representation, we define three evaluation tasks: Existence-Based Questions probing object attributes, Spatial Intelligence Questions covering counting, size comparison, distance, and directional relations, and Grounded Question-Reasoning-Answer (QRA) triplets requiring multi-step reasoning across semantic levels. Experiments with state-of-the-art vision-language models show that while models perform well on basic recognition tasks (e.g., up to 85% accuracy for detection), performance drops substantially on hierarchical and compositional reasoning (e.g., down to 60% for counting), revealing limitations not captured by existing benchmarks. SceneBench provides a realistic testbed for developing and evaluating models capable of fine-grained spatial reasoning in photorealistic 3D environments.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.16233 [cs.CV]
(or
arXiv:2609.16233v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.16233
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
103. 【2609.16207】Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomics
链接：https://arxiv.org/abs/2609.16207
作者：Daniela Vega,Paula Cárdenas,Hannah Ceballos,Leonardo Manrique,Pablo Arbelaéz
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：transformed biomedical research, Spatial Transcriptomics, transformed biomedical, biomedical research, research by enabling
备注： Accepted at MICCAI 2026
点击查看摘要
Abstract:Spatial Transcriptomics (ST) has transformed biomedical research by enabling the spatial mapping of gene expression across tissue sections. However, high operational costs, specialized equipment requirements, and sensitivity to experimental noise limit the accessibility and scalability of ST. Recent computer vision approaches aim to overcome these limitations by predicting spatial gene expression directly from histopathology images. While effective, current approaches often suffer from gene expression over-smoothing and overly uniform predictions across tissue regions, suggesting that further progress depends on learning representations that reflect the hierarchical and asymmetric structure of gene regulation and tissue morphology. To address these issues, we propose Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomics (HyCLoST), a hyperbolic contrastive learning model that captures the intrinsic hierarchical relationships within ST data. By leveraging hyperbolic geometry and a gene-to-image entailment loss, HyCLoST learns structured, biologically grounded representations that improve gene expression prediction accuracy, achieving a 6% reduction in MSE and an 8% increase in PCC across 26 ST datasets, over previous methods. Our source code is publicly available at this https URL
104. 【2609.16186】Occupancy Network-Guided Autonomous Robotic Partial Nephrectomy
链接：https://arxiv.org/abs/2609.16186
作者：Ethan Kilmer,Pit Henrich,Jiawei Ge,Paul M. Scheikl,Laura Connolly,Soum D. Lokeshwar,Joseph Chen,Justin D. Opfermann,Kaitlyn Kumar,Lauren Shepard,Ahmed Ghazi,Nirmish Singla,Richard J. Cha,Kevin Cleary,Franziska Mathis-Ullrich,Axel Krieger
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：soft-tissue cancer surgery, Autonomous soft-tissue cancer, soft-tissue cancer, cancer surgery, limited to interventions
备注：
点击查看摘要
Abstract:Autonomous soft-tissue cancer surgery has been limited to interventions on organ surfaces, because current systems cannot perceive and adapt to anatomy once it deforms or is cut. We introduce the first vision-guided autonomous system capable of performing complete tumor resections for partial nephrectomy. Our system integrates conditional occupancy networks, trained entirely in a physics-based simulation, that infer full 3-D anatomy (tumor, margin tissue, and kidney) from single-view partial point clouds. These occupancy networks maintain intraoperative tracking even as tissue is cut and deformed, enabling adaptive planning and execution. The surgical platform combines a depth camera for capturing surface point clouds, dual robotic arms for electrosurgical cutting and vacuum-based tissue manipulation, and an autonomous control strategy for tumor resection. In patient-derived hydrogel phantoms under an open partial nephrectomy setting, the robot performed eight consecutive autonomous tumor resections comprising 77 electrosurgical cuts, with all cuts achieving negative surgical margins and 1.61 $\pm$ 0.48 mm mean absolute margin error. This work demonstrates, for the first time, a foundation for supervised autonomous closed-loop, imaging-driven, margin-negative tumor removal in phantoms.
