本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新632篇论文，其中：
- 自然语言处理102篇
- 信息检索41篇
- 计算机视觉136篇
自然语言处理
1. 【2609.02859】User Feedback Provides a Unique Signal that LLMs Can not Detect
链接：https://arxiv.org/abs/2609.02859
作者：Shachar Don-Yehiya,Leshem Choshen,Omri Abend
类目：Computation and Language (cs.CL)
关键词：Harnessing naturally occurring, Large Language Models, Large Language, Harnessing naturally, promising learning signal
备注：
点击查看摘要
Abstract:Harnessing naturally occurring feedback from user interactions offers a promising learning signal for Large Language Models (LLMs). However, recent studies suggest this feedback is inherently noisy and difficult to leverage effectively. We challenge this conception by demonstrating that user feedback is a highly actionable signal for improvement, and that its perceived ineffectiveness stems from a systematic bias in current evaluation paradigms. To isolate the usefulness of feedback, we construct synthetic data with a definitive ground truth, alongside naturalistic data to validate that our findings hold in real-world scenarios. By comparing model revisions generated with and without access to feedback across both settings, we show that feedback-informed revisions resolve targeted issues at significantly higher rates than baseline revisions. Finally, we expose the root of the evaluation bias: when a model successfully fixes an issue exclusively due to feedback, LLM judges frequently fail to identify the genuinely corrected response, systematically preferring inferior baseline outputs instead.
2. 【2609.02849】Post-Training Language Models for Gold-Medal Performance in Coding Competitions
链接：https://arxiv.org/abs/2609.02849
作者：Aleksander Ficek,Sean Narenthiran,Mehrzad Samadi,Somshubra Majumdar,Boris Ginsburg
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Software Engineering (cs.SE)
关键词：large language model, language model reasoning, Competitive programming, ICPC representing, challenging settings
备注：
点击查看摘要
Abstract:Competitive programming has become a key test of large language model reasoning, with international competitions such as IOI and ICPC representing its most challenging settings. We present an end-to-end specialization pipeline combining large-scale problem curation, synthetic reasoning traces, supervised fine-tuning (SFT), and reinforcement learning (RL). Using 22,000 curated problems, we train Nemotron-3-Nano-CC (30B-A3B) with SFT and RL and Nemotron-3-Ultra-CC (550B-A55B) with SFT alone. We further introduce GenCorrect, a feedback-driven test-time compute strategy that iteratively generates, evaluates, and refines diverse solutions. On IOI 2025, Nano-CC improves from 130 points to 291 after post-training and to 468 with GenCorrect, exceeding the gold threshold of 438.3 while Ultra-CC reaches 502. Guided by these results, we develop a competition-specific Ultra-CC system and evaluate it prospectively during IOI 2026. Under the same time, internet-access, and submission constraints as human contestants, it scores 535.4 out of 600, exceeding both the gold threshold of 361.12 and the top human score of 498.27. To our knowledge, this is the first AI system to outscore the highest-scoring human contestant on an IOI problem set.
3. 【2609.02796】DiscoSign: Discourse-Aware Text to Sign Language Gloss Translation
链接：https://arxiv.org/abs/2609.02796
作者：Vasileios Baltatzis,Mert Inan,Connor Gillis,Raja Kushalnagar,Lorna Quandt,Leah Findlater,Colin Lea
类目：Computation and Language (cs.CL)
关键词：sign language comprehension, Sign language, sign language gloss, American Sign Language, ignoring critical discourse
备注： Accepted at EMNLP 2026 Main Conference
点击查看摘要
Abstract:Sign language processing systems have traditionally operated at the sentence level, ignoring critical discourse phenomena fundamental to sign language comprehension. We introduce DiscoSign, a computational approach for discourse-aware text to sign language gloss translation grounded in linguistic research. We address three key phenomena within our modular Large Language Model (LLM)-based translation framework: (i) spatial coreference resolution, where entities maintain consistent spatial locations throughout discourse; (ii) Question-Answer Clauses (QACs), pseudocleft structures serving specific discourse functions; and (iii) concept-gloss consistency, ensuring stable mappings between English concepts and American Sign Language (ASL) signs. Traditional translation metrics fail to capture discourse-level quality, so we introduce a suite of novel evaluation metrics designed to assess each dimension of discourse coherence addressed by our framework. Experiments on sentence-level and discourse-level datasets show that our approach for discourse-aware processing significantly improves spatial consistency and entity tracking relative to sentence-only translation, while maintaining competitive single-sentence gloss translation quality. Our work establishes the first systematic framework for discourse-level text to sign language gloss translation with corresponding evaluation methodology.
4. 【2609.02783】EarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction
链接：https://arxiv.org/abs/2609.02783
作者：Yuling Shi,Zhensu Sun,Junsen Dong,Chengcheng Wan,David Lo,Xiaodong Gu
类目：Computation and Language (cs.CL)
关键词：Evaluating LLM agents, iterative development cycles, grown prohibitively expensive, Evaluating LLM, price paid repeatedly
备注： Code and data available at [this https URL](https://github.com/inphotoo/earlyeval)
点击查看摘要
Abstract:Evaluating LLM agents is essential for guiding their development, yet it has grown prohibitively expensive: a single pass of a frontier model over an agentic benchmark can cost hundreds to thousands of dollars, a price paid repeatedly across iterative development cycles. Prior efforts, centered on benchmark distillation, reduce the number of evaluation tasks but leave the cost of executing each retained task untouched. In this work, we introduce early outcome prediction, a complementary axis of efficiency that instead cuts cost within each task. Our key insight is that an agent's final outcome is often evident from its intermediate behavior well before execution completes. We instantiate this idea in EarlyEval, a lightweight framework that trains a pair of LightGBM success and failure classifiers over behavioral, textual, and reference-solution features, and halts an agent run the moment either classifier crosses a calibrated confidence threshold, adding negligible per-step overhead. Across three benchmarks, SWE-bench Verified, TerminalBench, and Toolathlon, EarlyEval can eliminate 13%-26% of agent steps and up to 44.1% input tokens and 29.4% output tokens at 89%-97% prediction accuracy, while perturbing per-agent resolve rates by only one to two percentage points on average.
5. 【2609.02780】ShallowStream: Index Shallow then Answer Deep for Streaming Video Understanding
链接：https://arxiv.org/abs/2609.02780
作者：Jitai Hao,Ke Yang,Qiang Huang,Jun Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：including embodied intelligence, Streaming video understanding, autonomous driving, industrial monitoring, real-world applications
备注： Work in Progress
点击查看摘要
Abstract:Streaming video understanding is a critical capability for real-world applications, including embodied intelligence, autonomous driving, industrial monitoring, surveillance and early warning, and wearable assistants. However, processing continuous video streams with multimodal large language models (MLLMs) is computationally expensive. Existing efforts have explored reducing streaming overhead through visual token pruning, token merging, quantization, on-demand frame retrieval, and context offloading. However, most existing methods overlook the dimension of model depth. Repeatedly executing full-depth MLLM prefill over incoming frames is prohibitively expensive, incurring substantial computational overhead and causing the KV cache to grow at a rate directly proportional to the prefill depth. To address these challenges, we propose ShallowStream, a novel framework that leverages the shallow layers of an MLLM to simultaneously perform frame encoding and retrieval index building. During stream processing, ShallowStream maintains an always-on lightweight index using the KV cache of shallow layers. During query-time answering, we leverage the attention scores generated by the shallow layers to score context frames and employ a diversity-aware selection strategy to retrieve precise and comprehensive evidence. ShallowStream achieves performance on par with the strongest existing streaming methods, while reducing per-frame prefill latency and 10-second end-to-end latency by up to 52.1x and 11.9x, respectively. Our code is available at this https URL.
6. 【2609.02772】HyperStyler: Low-resource Authorship Style Transfer via Context-aware Style Navigation and Hypernetworks
链接：https://arxiv.org/abs/2609.02772
作者：Jongkyung Shin,Minguk Jeon,Chanwoo Park,Chiehyeon Lim
类目：Computation and Language (cs.CL)
关键词：Low-resource authorship style, arbitrary target author, Low-resource authorship, authorship style transfer, aims to rewrite
备注： Accepted to EMNLP 2026 (Main)
点击查看摘要
Abstract:Low-resource authorship style transfer (LAST) aims to rewrite text into the style of an arbitrary target author using only a few reference examples while preserving the original meaning. Existing methods often struggle to achieve both high style fidelity and semantic preservation because they compress diverse references into a single static author embedding, which averages out context-dependent stylistic variation, and rely on hidden representations for style control, which entangle style with content. We propose HyperStyler, a novel architecture that decouples LAST into style selection and style realization. Stylo-navigator predicts style coordinates by jointly modeling the source context and target-author references, and Stylo-hypernet realizes them via dynamic parameter modulation instead of hidden-state injection. Our experiments on Reddit, Blog, and News datasets demonstrate that HyperStyler consistently outperforms prior methods including LLM-based approaches and generalizes robustly across domains. Notably, HyperStyler achieves superior performance with as few as 2.4% additional parameters over T5-large, while being over 1.8x faster than LLMs at inference.
7. 【2609.02771】From Reweighting to Rewriting: Unlocking the Intervention Effects of Influential Samples in Training Data Attribution
链接：https://arxiv.org/abs/2609.02771
作者：Yuzhang Luo,Chenpeng Wang,Jianhui Chen,Liangming Pan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Training data attribution, shape model behavior, Training data, data attribution, shape model
备注：
点击查看摘要
Abstract:Training data attribution (TDA) aims to identify training examples that shape model behavior, but its intervention value depends on both which examples are selected and how they are modified. Influence functions (IF) estimate behavioral changes under infinitesimal reweighting, yet IF-selected examples often show limited advantages over random selection under conventional weight-based interventions. This raises the question of whether influential examples lack intervention value or whether reweighting fails to realize their behavioral this http URL introduce influence-guided response rewriting, which uses IF to identify intervention targets and replaces their responses with behavior-aligned or behavior-opposed supervision while keeping instructions fixed. Across four open-weight LLMs, we compare rewriting and reweighting on the same influence-selected examples using epistemic abstention as our primary testbed. Response rewriting produces stronger, more persistent, and bidirectional behavioral shifts, while reweighting the same examples yields weak and inconsistent effects. Further analyses show that influence-selected examples provide greater rewriting leverage than alternative selectors, with changes remaining concentrated on target-relevant behaviors. The same qualitative contrast extends to safety refusal. These results distinguish the local reweighting effects captured by influence estimates from the broader intervention leverage of the examples they identify, motivating intervention-aware evaluation of TDA methods.
8. 【2609.02754】Untangling the Mechanisms of Misleading Context in Medical Question Answering
链接：https://arxiv.org/abs/2609.02754
作者：Robin Linzmayer,Noémie Elhadad
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large language models, Large language, misleading context, expert-level performance, misleading
备注： 25 pages, 10 figures. Submitted to ML4H 2026
点击查看摘要
Abstract:Large language models now answer medical questions with expert-level performance. However, the context these systems act on can be misleading, and misleading context can corrupt a model's medical judgment. To understand how misleading context corrupts this judgment, we examine the model's susceptibility to the context, disclosure of it, mechanism of corrupted reasoning, and monitorability of the decision. On the medical reasoning subset of MedMisBench, a clinician-reviewed question-answering benchmark of 8,627 questions, we inject two types of misleading context cues, fabricated evidence and a bare assertion. We test three reasoning models, two that expose their full reasoning trace and one frontier model that exposes only its response. All three are more susceptible to the assertion than to the fabricated evidence, adopting the asserted answer 10 to 27 points more often. The misleading cues are disclosed in 81 to 98% of traces but only 7 to 90% of responses, and the assertion is disclosed less often than evidence based cues. Resampling from reasoning traces without disclosure shows the two cues corrupt reasoning differently, evidence entering early and accumulating while the assertion redirects the conclusion near its end. An LLM monitor catches 78% of corrupted decisions at 5% false positives when reading an open model's trace with guidance, against at most 32% from any response. The misleading context that models are most susceptible to is disclosed least, and was caught reliably only from an open reasoning trace, which frontier providers withhold.
9. 【2609.02749】Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills
链接：https://arxiv.org/abs/2609.02749
作者：Jianlyu Chen,Yuyang Hu,Hongjin Qian,Jiawei Liu,Wenqing Wei,Xiaolong Chen,Defu Lian,Zhicheng Dou,Chaozhuo Li,Qiwei Ye,Zheng Liu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Autonomous agents, carry out machine-learning, beginning to carry, Autonomous, end
备注： 48 pages, 3 figures
点击查看摘要
Abstract:Autonomous agents are beginning to carry out machine-learning (ML) research end to end. These agents combine a model backbone with a harness for planning, execution, memory, and verification, but this architecture still leaves domain-specific know-how outside the agent. We call this missing layer operational knowledge, the know-how that separates knowing a method from making it work. That knowledge is not absent from the field. It appears in repositories and papers, but in forms written for human readers and too large to load during a task. Once distilled into compact, verified skills, this knowledge can be reused across tasks rather than rediscovered during each run. We present DisCo, a skill-powered research agent that creates skills and uses them during research. Its distillation runs in two complementary forms: task-agnostic, condensing the field's widely used repositories into reusable skills, and task-oriented, producing the skills a concrete task calls for. The former, applied across the open ecosystem, yields the AREX-Skill Library, with 5,000+ verified skills distilled from 1,000 widely used ML repositories and organized into 20 areas and 178 capability families. With the GPT-5.5 backbone, research harness, and downstream execution budget held fixed, the skill-equipped research agent scores 134.3% higher on MLE-bench, 34.4% higher on PaperBench, 9.2% higher on FrontierCS, and 14.0% higher on PassNet than the same agent without skills. These gains come from adding distilled operating context under that fixed setup.
Comments:
48 pages, 3 figures
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2609.02749 [cs.AI]
(or
arXiv:2609.02749v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.02749
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
10. 【2609.02745】Incremental Pooled LLM Evaluation for Cost-Effective Retrieval Model Selection
链接：https://arxiv.org/abs/2609.02745
作者：Max Nelson,Hanoz Bhathena,Aviral Joshi,Saket Sharma
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：RAG system requires, requires reliable comparative, obtaining relevance judgments, production RAG system, reliable comparative evaluation
备注： 10 pages, 1 figure
点击查看摘要
Abstract:Selecting a retrieval model for a production RAG system requires reliable comparative evaluation, but obtaining relevance judgments at scale is expensive and difficult to repeat as new candidate systems arrive. We study pooled LLM evaluation, in which an LLM judges the union of documents retrieved by the current set of candidate systems, and the pool is then expanded incrementally as new systems are introduced by judging only the new documents they contribute. These judgments are reused to evaluate all systems on a common basis. We validate this approach on four retrieval benchmarks with 11 systems spanning dense, sparse, and hybrid configurations, and deploy it to compare 62 retrieval configurations for a financial news QA system. Pooled LLM rankings correlate strongly with gold-standard evaluation across datasets, and 97% of pairwise system orderings are preserved once bootstrap uncertainty in the qrels is taken into account. In production, document overlap yields 65-80% judgment reuse and up to 4.9x lower evaluation cost, allowing teams to benchmark new retrieval candidates without re-judging previously assessed documents. These results suggest pooled LLM evaluation is a practical and cost-effective workflow for incremental retrieval model selection in deployed systems.
11. 【2609.02737】Language Models Can Control Their Own Attention
链接：https://arxiv.org/abs/2609.02737
作者：Namgyu Ho,Huzama Ahmad,Woosung Koh,Se-Young Yun,Tal Schuster,Cicero Nogueira dos Santos
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Language models spend, Language models, small fraction, Language, global attention layers
备注：
点击查看摘要
Abstract:Language models spend most of their attention on a small fraction of context, yet they read the entire KV cache to find the few tokens that matter. If the user asks about a previous detail in a 1M-token conversation, global attention layers must scan the full context to generate each token of the reply. A prominent approach mitigates this cost by pre-selecting relevant tokens via lightweight proxy scores, but this extrinsic scoring still incurs O(N) per step. We take an intrinsic approach motivated by the simple question: wouldn't the model already know which parts of the context are relevant? To this end, we introduce Declarative Attention (DA), a protocol that elicits the model to declare where it needs to attend within its chain-of-thought, partitioning generation into three modes: global (full context), focus (a specific region), and local (recent output only). The inference engine parses these declarations like tool calls and skips most of the KV cache read. Under zero-shot evaluation across 15 long-context tasks, DA on off-the-shelf models (Gemma-4-31B, Qwen-3.6-27B) significantly reduces total attended tokens during decoding (52.0%, 31.1%) with modest accuracy drops (1.27pp, 2.75pp) that shrink with model scale. DA unlocks a new axis of sparse attention, with further potential under training-based methods that future work can explore.
12. 【2609.02735】Choosing a PEFT Variant for Per-Patient Dysarthric ASR: A Single-Speaker Case Study on Two ASR Bases
链接：https://arxiv.org/abs/2609.02735
作者：Bernard Muller,László Tóth,LaVonne Roberts
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：automatic speech recognition, dysarthric automatic speech, preferred production architecture, speech recognition, architecture for dysarthric
备注： 2 figures. Submitted to Speech Communication (Elsevier)
点击查看摘要
Abstract:Per-patient adapters are the preferred production architecture for dysarthric automatic speech recognition (ASR), yet parameter-efficient fine-tuning (PEFT) variants have not been compared in the speaker-dependent, per-patient regime. We present a single-speaker case study comparing seven LoRA-family methods (LoRA, QLoRA, AdaLoRA, DoRA, LoHA, VeRA, VB-LoRA) on two production bases (Whisper-large-v3 with Hungarian fine-tuning, and a multilingual Qwen3-ASR-1.7B checkpoint) for one post-stroke Hungarian male speaker (S1, 409 utterances; severe dysarthria on auditory-perceptual clinical assessment). Attention-projection adapters substantially improve CER on both bases. Across three seeds, a paired bootstrap detects no significant LoRA-DoRA difference (p0.5; 13.86/13.90 % CER on Whisper, 28.10/28.33 % on Qwen3-ASR), so we adopt the simpler, cheaper LoRA. Real 4-bit (NF4) QLoRA is worse on every seed and both bases (14.56/30.09 % CER) with no memory saving at this scale, and LoHA, VeRA, VB-LoRA and AdaLoRA do not reach the LoRA family, though LoHA still gives an 18.6 % relative CER reduction on Whisper. On the same base, full fine-tuning is more accurate (11.43 % CER), but a 115 MB LoRA that also adapts the feed-forward blocks reaches within 0.66 pp of it at approximately 3.7 % of the per-patient storage. A 6-point enrollment grid shows about 5 min of patient audio captures 45.6 % of the zero-shot-to-30-min CER reduction, with further gains at 10 and 30 min (caveat: one speaker, one language, severe post-stroke dysarthria). Training scripts and recipes will be released, source-available under a research-use licence, on publication.
13. 【2609.02730】CORAL: An LLM-Native Harness for Production Recommender Systems
链接：https://arxiv.org/abs/2609.02730
作者：Muhammad Rafay Azhar,Yuhang Zhou,Gilbert Jiang,Yuchen Wang,Rahul Sharma,Matthew DeSousa,Jiayi Liu,Xin Guo,Lizhu Zhang,Xiangjun Fan
类目：Computation and Language (cs.CL)
关键词：choices governing retrieval, Production recommender systems, upstream models shift, recommender systems shape, Production recommender
备注： Accepted by RecSys '26 OARS Workshop
点击查看摘要
Abstract:Production recommender systems shape what billions of people see, and sustaining their performance requires continual optimization: as content, user behavior, and upstream models shift, the choices governing retrieval, ranking, and serving must be revisited. Traditionally, human engineers test such changes through online experiments--a slow, reactive process limited by engineering effort, leaving parts of the system unrevised as conditions change. Although large language models have been applied to ranking, user modeling, and offline model development, few systems place an agent in a continual closed loop that acts on a live recommender and learns from the measured effects of its decisions. We present CORAL (Constraint-Optimized Recommender via an Agentic Loop), an LLM-native harness that closes this loop: each cycle, the agent observes operating signals, reasons over a memory of past decisions and outcomes, and invokes tools--including a numerical optimizer that keeps changes within a fixed operating budget--to reconfigure the recommender, with measured outcomes informing the next cycle. We formulate this as a partially observed, non-stationary, constrained optimization problem in which the policy improves in context, without parameter updates, from its prior actions. Across two large-scale social platforms, evaluated with A/B experiments, the same harness improves engagement at no additional serving cost on one and reduces serving cost without degrading engagement on the other, spanning the engagement-efficiency frontier. Performance improves as the loop iterates, suggesting that a single agentic loop can automate continual optimization work traditionally performed by human algorithm engineers under explicit guardrails.
14. 【2609.02707】Door-in-the-Face Requests and Refusal Behaviour in Large Language Models
链接：https://arxiv.org/abs/2609.02707
作者：Til Jordan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large request, request, models, model, refused large request
备注： 28 pages (9 pages of content plus references and appendix), 5 figures, 9 tables. Preprint, under review
点击查看摘要
Abstract:Does the door-in-the-face technique work on language models? In humans, a large request that is refused makes a smaller follow-up request more likely to be granted. We test this on nine production models from three providers: each model refuses a large request, then receives a smaller version of the same request, and we compare its compliance with asking directly. The answer depends on the model. On Anthropic's frontier models the technique works: Opus 5 answers the smaller request 65.8% of the time after refusing the larger one, against 29.3% when asked directly. On the frontier models of OpenAI and Google, and on Haiku 4.5, it backfires, lowering compliance by 15.5 to 23.0 points. A control locates the effect: a refused large request on an unrelated topic does less than the related one on all nine models, so the concession itself matters everywhere, while the reaction to having just refused something differs by model family. The technique does not transfer to refusals drawn from public benchmarks. What decides whether a retreat can work is what the request asks for: rewriting 265 refused requests for usable instructions into requests for explanations of the same topic removed the refusal in 263 cases. Human influence techniques port to language models one model family at a time.
15. 【2609.02702】race as State: Reasoning Traces as Conditional States for Long-Context Transformers
链接：https://arxiv.org/abs/2609.02702
作者：Xu Zou,Jie Tang
类目：Computation and Language (cs.CL)
关键词：process information causally, state, task state discovered, Trace, task state
备注： preprint
点击查看摘要
Abstract:Transformers process information causally, but long-context reasoning may depend on task state discovered only later. We formalize this mismatch through conditional state update tasks. For causal state update processors, providing the condition first can require exponentially less memory in the worst case than providing it last. Motivated by this principle, we introduce Trace as State. We use collected reasoning traces as a textual proxy for task state and place it before the long-context block on a fresh pass, allowing information derived previously to guide rereading. We conduct extensive experiments on Trace as State and Trace Append, a matched control that uses the same task state proxy but put it after the context. Across three models and three long-context datasets, Trace as State outperforms Trace Append in 26 of 27 reported combinations of model, task, and metric. On GraphWalks Parents, exact match lifts DeepSeek V4 Pro Preview from 29.2% on the initial pass and 43.0% with Trace Appendto 81.8% with Trace as State, and from 66.4% and 83.2% to 100.0% for GLM-5.2. These results show that placing traces before the context can improve long-context reasoning while retaining the causal transformer structure.
Comments:
preprint
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.02702 [cs.CL]
(or
arXiv:2609.02702v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.02702
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
16. 【2609.02685】DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Models
链接：https://arxiv.org/abs/2609.02685
作者：Kushagra Bhushan,Meghanadh Pulivarthi,Sai Krishna Reddy Sathi,Gaurav Pandey,Sonam Gupta,Vineet Kumar,Jaydeep Sen,Yatin Nandwani,Sachindra Joshi,Dinesh Raghu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Instruct LLM, LLM, Instruct, Instruct LLM instruction-following, knowledge
备注： 20 pages, 4 figures, 15 tables
点击查看摘要
Abstract:RAG has become the de facto method for incorporating new, corpus-specific knowledge into an instruction following LLM (Instruct LLM). Although RAG-based prompting improves factual grounding, it fails when retrieval is incorrect or incomplete, leading to hallucinations. Finetuning methods such as RAFT and PA-RAG enhance RAG by injecting new knowledge into the model's parameters, but require generating a massive amount of synthetic QA that covers the entire corpus. Extended Pre-Training (EPT) on the text corpus avoids the need for comprehensive synthetic data generation but compromises an Instruct LLM's instruction-following capabilities, necessitating instruction fine-tuning (IFT) after pre-training. However, IFT is costly and may be infeasible due to the unavailability of an instruction-tuning corpus. In this work, we propose DKL-Decoupled Knowledge Learning for Instruction-Tuned Language Models. Instead of doing EPT on the Instruct LLM, DKL performs EPT on its corresponding base LLM to infuse new knowledge. These knowledge infused weights are then merged with the Instruct LLM, imparting new knowledge without affecting their instruction-following capabilities. DKL is a lightweight method that avoids expensive instruction fine-tuning and relies on model merging to infuse the new knowledge into the Instruct LLM without destroying its instruction following capabilities. Empirical results show that DKL improves RAG accuracy from 54.17 to 79.26 on retrieval failure cases, while outperforming prior approaches with substantially less training data.
17. 【2609.02679】From Tokens to Semantics: Leveraging Complementary Signals for Hallucination Detection in Black-Box LLMs
链接：https://arxiv.org/abs/2609.02679
作者：Urja Pawar,Rajitha Ramanayake,Owen O'Neill,Nabeel Kemal,Abhishek Mandal,Houssem Chatbri,Christopher Martin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：limited human-review capacity, LLMs support public-facing, false alarms consume, alarms consume limited, consume limited human-review
备注：
点击查看摘要
Abstract:When LLMs support public-facing or high-stakes workflows, missed fabrications can harm users and institutions, while false alarms consume limited human-review capacity. When no trusted context or reference document is available, we study two signals accessible through black-box model APIs: semantic entropy, which measures disagreement among sampled response meanings, and uncertainty derived from token log-probabilities. Their failure modes can be complementary: semantic entropy becomes uninformative when responses form one semantic cluster, while token uncertainty can miss consistently confident errors. We extend token-based uncertainty detection by aggregating token-level signals across sampled responses through our TopK method, evaluate the hybrid CoCoA method, which combines target-response uncertainty with semantic dissimilarity, and propose and study two supervised methods: Gated, which routes single-cluster cases to an aggregated-token-feature classifier, and Stacked, which learns jointly from semantic uncertainty and broader token features. We evaluate seven benchmarks, including five public benchmarks (four text datasets and multimodal handwritten-cheque extraction) and two constructed benchmarks (Financial Summaries and Long-Text QA), using four language models. In our evaluation across models and datasets, Stacked gave the best performance in nearly half of the cases, while TopK and CoCoA remain competitive without supervised training labels, although their thresholds require careful calibration. No method is universally strongest. We therefore evaluate performance at false-positive-rate budgets from 1% to 15%, assess their sensitivity to generation and calibration choices, and examine variation across dataset characteristics.
18. 【2609.02672】oHC: Orthogonal Hyper-Connections on SO(4) via Quaternions
链接：https://arxiv.org/abs/2609.02672
作者：Haoqiang Guo,Xuyi Chen,Bo Ke,Yishu Lei,Ziyang Xu,Shikun Feng,Ximen,Wenhan Luo
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：single residual stream, residual matrix, residual streams, residual, mixing step
备注：
点击查看摘要
Abstract:Hyper-Connections (HC) replace the single residual stream of a Transformer with $n$ parallel ones, mixing them at every layer with a learned $n \times n$ residual matrix. Leaving that matrix unconstrained places no limit on the factor by which the mixing step rescales the residual streams, and that factor compounds across layers, which destabilizes training. Manifold-constrained Hyper-Connections (mHC) address this by restricting the matrix to the doubly stochastic matrices. That caps the factor at one, so the mixing can no longer amplify any direction, but nothing bounds it from below. We prove that inside this set the mixing step can reduce the norm of the residual streams only by shrinking the differences between the streams, while their mean is left unchanged; and since the reduction accumulates over layers, the streams grow more alike and their diversity is spent with depth. We therefore propose Orthogonal Hyper-Connections (oHC), restricting the residual matrix to the rotation group $SO(n)$, so that the mixing step can neither amplify nor attenuate the residual streams in any direction, which keeps training stable and no longer forces the differences between the streams to contract. Specifically, at the four streams used by recent HC models we parameterize the group in closed form by a pair of unit quaternions, which adds no parameters, replaces the iterative projection with a fixed pattern of signed additions, and can be constructed faster than mHC. We evaluate oHC across a comprehensive set of downstream tasks, where it outperforms the single-stream residual baseline, mHC and iHC, which fixes the residual matrix to the identity.
19. 【2609.02651】WinoQueer-NL: Assessing Bias in Dutch Language Models toward LGBTQ+ Identities
链接：https://arxiv.org/abs/2609.02651
作者：Jiska Beuk,Gerasimos Spanakis
类目：Computation and Language (cs.CL)
关键词：models remain understudied, Dutch models remain, remain understudied, English WinoQueer benchmark, widely examined
备注： under review, dataset available via [this https URL](https://github.com/jerryspan/WinoQueer-NL/)
点击查看摘要
Abstract:While English language models have been widely examined for anti-queer bias, Dutch models remain understudied. To address this gap, we developed a culturally and linguistically adapted Dutch dataset based on the English WinoQueer benchmark, containing pairs of stereotypical and counter-stereotypical sentences. To validate and expand it, we conducted an online survey with 43 Dutch queer participants, confirming 145 of 171 stereotypes as culturally relevant and identifying 22 new biases through free-text responses. The final released dataset, comprising 42,906 sentences, was evaluated using a range of Dutch-specific and multilingual models, including both masked language models (MLMs) and autoregressive language models (ARLMs), with bias measured via a score comparing log-likelihoods of stereotypical versus counter-stereotypical sentences. While the mean bias score across models appeared neutral (~50%), closer analysis revealed significant disparities: some models favored stereotypical sentences up to 97% of the time for transgender identities, but only 6% of the time for gay-related pairs, with transgender and non-binary identities consistently receiving the highest bias scores. Our findings highlight the importance of culturally grounded datasets for evaluating and mitigating biases that disproportionately impact marginalized groups in Dutch language models.
20. 【2609.02649】Loom: Weaving Diagnostic Strands into Free-Text Consensus via Embedding-Space Reweighting
链接：https://arxiv.org/abs/2609.02649
作者：Ron Begleiter,Katya Egert Berg,Gilad Saban,Gil Shabat
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：deploying NLP systems, Aggregating noisy, Large Language Model, real-world industrial settings, deploying NLP
备注： Accepted to EMNLP 2026
点击查看摘要
Abstract:Aggregating noisy, conflicting textual hypotheses into a reliable consensus is a fundamental challenge when deploying NLP systems in real-world industrial settings. While monolithic Large Language Model (LLM) agents offer unbounded expressivity for tasks like Root Cause Analysis (RCA), they suffer from context limits, compounding hallucinations, and prohibitive inference latency. Traditional weak supervision offers statistical rigor but is mathematically restricted to discrete classes. We present Loom, a generative consensus framework deployed for real-world RCA that bridges these paradigms. Loom aggregates open-form hypotheses emitted by modular heuristics (diagnostic templates dynamically populated with episode-specific entities, times, and metrics) by projecting them into a continuous embedding space, and resolves conflicting signals with an iterative centroid-based reweighting algorithm. The resulting consensus weights ground a single lightweight LLM synthesis step. Evaluated on the OpenRCA benchmark, Loom occupies the accuracy--efficiency Pareto frontier: it matches a state-of-the-art autonomous agent on Bank and Market-2 and trails on Market-1 and Telecom, while using a single LLM call per incident on all four datasets ($\sim$26$\times$ faster; $\sim$33$\times$ with an 8B-parameter synthesizer). We discuss our deployment experience, highlighting lessons learned regarding the trade-offs between agentic depth and inference latency, negative results in redundancy detection, and how deterministic consensus fosters trust among Subject Matter Experts~(SMEs).
21. 【2609.02639】aRA: Training-Aware Low-Rank Adaptation Initialization
链接：https://arxiv.org/abs/2609.02639
作者：Taehyeon Kim,Eunhyeok Park
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：information bottleneck imposed, Training-aware Low-Rank Adaptation, Low-Rank Adaptation Initialization, facto standard, standard for parameter-efficient
备注： Accepted to the EMNLP 2026 Main Conference
点击查看摘要
Abstract:Low-Rank Adaptation (LoRA) has become a de facto standard for parameter-efficient fine-tuning (PEFT), yet its performance is highly sensitive to initialization due to the information bottleneck imposed by low-rank decomposition. Existing approaches attempt to construct high-quality LoRA initializations by exploiting principal components of pretrained weights, activations, or gradients. However, these methods do not directly account for the training dynamics of the full-rank model. In this paper, we propose Training-aware Low-Rank Adaptation Initialization (TaRA), a method that initializes LoRA such that the gradients induced by the low-rank factors closely approximate the gradient of the corresponding full-rank weight matrix. Derived from a mathematical formulation, TaRA improves gradient fidelity at the start of training while introducing negligible computational overhead. Across diverse and challenging fine-tuning tasks, TaRA consistently outperforms prior state-of-the-art methods, establishing a simple, robust, and scalable solution for effective LoRA initialization.
22. 【2609.02623】Scalable Direction-Following TTS via Voice Impression-Guided Pseudo Triplet Construction
链接：https://arxiv.org/abs/2609.02623
作者：Kenichi Fujita,Yusuke Ijima
类目：ound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Voice actors, actors often re-read, script while modifying, modifying their delivery, delivery in response
备注： 5 pages,4 figures, Accepted to INTERSPEECH 2026
点击查看摘要
Abstract:Voice actors often re-read the same script while modifying their delivery in response to performance directions. We study this setting as direction-following TTS, where a system generates a new utterance that reflects a given direction relative to a reference utterance while preserving speaker identity and linguistic content. A key challenge is the lack of training data capturing such relative modifications. To address this, we propose a scalable pseudo-triplet construction pipeline that generates~(reference utterance, direction text, modified utterance) triplets. It generates controlled style variations using an impression-controllable TTS model and uses an LLM to produce natural language directions from estimated impression differences. Experimental results demonstrate that pseudo-triplets alone enable stable speaker-preserving modification, and that combining pseudo and recorded data further improves direction alignment while maintaining speaker similarity. Audio examples are available on our demo page this https URL
23. 【2609.02606】Predictors of Loneliness in Older Adults Using Multimodal Analysis of Speech and Language
链接：https://arxiv.org/abs/2609.02606
作者：Vinmay Khandode,Sai Karthik Kosuri,Neil K. R. Sehgal,Adam Greene,Elif Alpoge,Elana Duffy,Matthew Lee Smith,Thomas K.M. Cudjoe,Sharath Chandra Guntuku
类目：Computation and Language (cs.CL)
关键词：critical public health, public health issue, cognitive decline, risks of depression, critical public
备注：
点击查看摘要
Abstract:Loneliness is a critical public health issue among older adults, linked to higher risks of depression, cognitive decline, and mortality. Scalable, objective methods for its detection remain limited, particularly in natural conversational contexts. We analyzed speech and language markers of loneliness in 310 older adults using semi-structured telephone interviews to help understand how they process feeling lonely and how their language differs at different levels of feeling loneliness. Our multimodal framework combined linguistic features (psycholinguistic dictionaries, n-grams, and topic models) with acoustic features (pitch, tone, loudness) to examine associations with self-reported loneliness scores. Both predefined and data-driven methods captured patterns in verbal content and vocal delivery. Higher loneliness was associated with negations(r = 0.11), negative tone(r = 0.12), and conflict-related language. Lower loneliness was linked to social references(r = -0.18), motivational drives(r = -0.11), and emotional richness in speech(r = -0.12). We also found that the multimodal model (r = 0.298) outperforms the text-only and audio-only models. Findings suggest that loneliness manifests through both linguistic and acoustic cues, supporting the potential of speech-based analysis in psychological assessments and as an early indicator of emotional loneliness when used alongside existing assessments, rather than as standalone diagnostic tools.
24. 【2609.02526】When Persona Attributes Improve Population Alignment in Large Language Models
链接：https://arxiv.org/abs/2609.02526
作者：Leon Fröhling,Jens Rupprecht,Markus Strohmaier,Claudia Wagner
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Large Language Models, Language Models, pretrained language models, large pretrained language, persona prompting
备注： 45 pages, 15 figures
点击查看摘要
Abstract:Large Language Models (LLMs) are increasingly used to predict the responses of human participants in survey panels. Towards that goal, persona prompting has recently emerged as a technique to inform and align large pretrained language models. Persona prompting refers to the practice of using short textual descriptions of 'personas' in prompts to steer the LLM's generations. Personas describe individuals through different attributes such as their socio-demographics, attitudes, or behaviors, with the aim of aligning LLMs to produce responses that correlate with the corresponding human responses. Yet, recent work has produced mixed and partly conflicting results of persona prompting without clear patterns of success and failure. Among the few consistent findings is that the selection of persona attributes matters, and that using more attributes does not necessarily lead to better performance. It remains unclear how different attribute selection methods perform and how to choose among them. In this paper, we propose that observed human response variation of a survey question is a potential explanation for the mixed performance observed so far. In addition, we compare the performance of persona prompting associated with different methods for selecting persona attributes. We evaluate these methods on four different (general) social surveys across two countries, six LLMs, and twenty prediction tasks per survey. Our work helps to identify when persona prompting can be expected to be useful in survey prediction tasks, and provides new insights on the effectiveness of different attribute selection methods for LLM-based survey prediction using persona prompting.
25. 【2609.02496】Debias-SparseGPT: Bias-Aware Pruning for Large Language Models
链接：https://arxiv.org/abs/2609.02496
作者：Irina Proskurina,Guillaume Metzler,Antoine Gourru,Julien Velcin
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, acceleration of Large, Model compression techniques, Language Models
备注： Accepted to EMNLP 2026, Code: [this https URL](https://github.com/upunaprosk/debias-llm-compressor)
点击查看摘要
Abstract:Model compression techniques such as pruning and quantization facilitate the efficient deployment and acceleration of Large Language Models (LLMs). However, recent studies show that weight sparsification methods, such as SparseGPT, can amplify existing biases in models, with outputs varying significantly depending on persona cues in the prompt. In this paper, we introduce Debias-SparseGPT, a post-training pruning method incorporating representational debiasing using a second-order term defined over demographically contrasting inputs. We perform empirical validation of our method over a wide range of generative LLMs. Across models and sparsity regimes (25%, 50%, and structured 2:4 sparsity), Debias-SparseGPT consistently reduces pruning-induced bias compared to SparseGPT while preserving model perplexity and zero-shot accuracy. Under the most restrictive 2:4 structured sparsity pattern, which most aggressively degrades model quality, augmenting the calibration set with long-context, content-rich examples further improves both downstream performance and fairness. Overall, Debias-SparseGPT advances the bias-performance trade-off while preserving the computational efficiency of sparse models.
26. 【2609.02486】ViSAR: Training-Free Adaptive-$k$ Retrieval for Visual Document Question Answering
链接：https://arxiv.org/abs/2609.02486
作者：Adrien Mialland,Marc Plantevit,Julien Gallois,Céline Robardet
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Vision-Language Model, Visual Question Answering, Question Answering, leverages Retrieval-Augmented Generation, Document Visual Question
备注： 13 pages, 5 figures, 4 tables
点击查看摘要
Abstract:Document Visual Question Answering (DocVQA) often leverages Retrieval-Augmented Generation (RAG), where late-interaction encoders are commonly used to identify document pages relevant to a user query, before answer generation by a Large Vision-Language Model (LVLM). Existing approaches typically retrieve a fixed top-$k$ number of pages regardless of query complexity, which increases LVLM latency and may degrade answer accuracy. We introduce ViSAR (Visual Semantic Activation Retrieval), a training-free adaptive-$k$ retrieval method for late-interaction visual document retrieval. ViSAR operates directly in the embedding space to construct a query-conditioned page-level similarity matrix that highlights query-relevant semantics and dynamically determines the number of pages to retrieve. Across multiple encoders and LVLMs, ViSAR retrieves compact, query-adapted page sets that reduce RAG latency by up to 58.7\%, while maintaining or improving answer accuracy compared with fixed top-$k$ and adaptive retrieval heuristics. Furthermore, we show that the similarity matrix structure correlates with answer accuracy, suggesting future directions for retrieval quality-aware document understanding.
27. 【2609.02482】How LLMs Build Fictional Worlds: Setting and Narrative Space in AI-Generated Creative Storytelling
链接：https://arxiv.org/abs/2609.02482
作者：Katrin Rohrbacher,Björn Nieth,Emmanuelle Salin,Bjoern Eskofier,Michaela Mahlberg
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, analyze how Large, Language Models, storyworld construction
备注：
点击查看摘要
Abstract:In this paper, we analyze how Large Language Models (LLMs) employ worldbuilding strategies, focusing on setting as one measurable dimension of storyworld construction. We compare 1,000 AI-generated stories per model in English and German with human-authored fiction from Project Gutenberg. Building on prior work, we operationalize setting through five types of narrative space: "action", "perceived," "visual," "descriptive" and "no space", identified using fine-tuned BERT classifiers for German and English. We generate narratives using GPT 4.1, LlaMA 3.3, Mistral 3.2, and Gemma 3 and compare their spatial distributions to a human-authored baseline. We find that human-authored texts predominantly employ "action space," grounding narratives in embodied character-environment interaction, whereas LLMs systematically overproduce "perceived space," emphasizing atmosphere and affect. This divergence remains stable across narrative time. Overall, our findings show that LLMs exhibit worldbuilding patterns that differ consistently from human-authored fiction in ways that are both model-specific and language-sensitive.
28. 【2609.02480】PragAlign: Feedback-Guided Pragmatic Alignment for Controlled Synthetic Dialogue Generation
链接：https://arxiv.org/abs/2609.02480
作者：Smitha Muthya Sudheendra,Jaideep Srivastava
类目：Computation and Language (cs.CL)
关键词：privacy-restricted service settings, Synthetic dialogue generation, Synthetic dialogue, research in privacy-restricted, conversations must preserve
备注：
点击查看摘要
Abstract:Synthetic dialogue generation can support research in privacy-restricted service settings, but generated conversations must preserve communicative intent, affective meaning, and natural dialogue flow. We introduce PragAlign, a feedback-guided framework for controlled synthetic dialogue generation conditioned on service context, target intent, and target emotion, with auxiliary trait-style controls. PragAlign uses a generate--evaluate--revise loop in which an LLM-based evaluator scores intent alignment, emotion alignment, coherence, fluency, and aggregate quality, then provides criterion-specific feedback for up to three refinement rounds. On 800 matched dialogue specifications, PragAlign achieves 99.50\% evaluator-defined acceptance, compared with 72.25\% for one-shot generation and 95.88\% for repeated generation without structured feedback. This indicates that repeated attempts account for much of the gain over one-shot generation, while structured feedback primarily improves last-mile multi-constraint satisfaction rather than broad average quality. Refinement gains are concentrated in emotion alignment, which is also the dominant failure mode in ablations. A separate human evaluation of 1,200 generated dialogues shows that intent expression and dialogue flow are highly recognizable to annotators, while emotion appropriateness is less stable and more subjective. These results support PragAlign as a quality-control framework for improving evaluator-defined communicative constraint satisfaction, while showing that affective realization and independent human-perceived quality remain open challenges.
29. 【2609.02473】Learning to Fuse LLMs with Ontology Rankers for Rare-Disease Diagnosis
链接：https://arxiv.org/abs/2609.02473
作者：Zhaoyang Jiang,Zhizhong Fu,Yunsoo Kim,Zicheng Li,Xuanqi Peng,Fei Teng,Jiacong Mi,Honghan Wu
类目：Computation and Language (cs.CL)
关键词：matched patient phenotypes, Ontology rankers remain, rare-disease diagnosis, traced to matched, patient phenotypes
备注：
点击查看摘要
Abstract:Ontology rankers remain useful for rare-disease diagnosis because each candidate can be traced to matched patient phenotypes. Large language models (LLMs) can generate differential diagnoses from the same patient description, but their predictions lack an equally clear evidence trail. Rather than asking which system should replace the other, we ask whether an LLM can improve the ranker without giving up its evidence. Our behavior-based fusion model examines the two ranked lists, their agreement, and the ontology support behind each candidate, and learns how much to rely on each system for the individual case. Before comparison, we remove a documented test-set leakage pathway caused by benchmark cases and ontology annotations being derived from the same publications. Across eight open LLMs, fusion improves Phenomizer Recall@1 by 7.86 percentage points on Phenopacket Store and 20.18 points on RAMEDIS. When paired with DeepSeek-V4-Flash through an API, a fusion model trained only on the other LLMs improves Recall@1 from 0.1657 to 0.2176, a 5.19-point gain, without retraining. For 90.8% of correct fused diagnoses, the disease retains candidate-level ontology evidence that can be inspected. These results show that LLMs can strengthen an established diagnostic tool without discarding the structured evidence that makes it useful.
30. 【2609.02451】Scalable Kronecker-Fisher Approximation: Efficient Hessian Analysis for Billion-Parameter Language Models Compression
链接：https://arxiv.org/abs/2609.02451
作者：Viacheslav Yusupov,Daria Cherniuk,Evgeny Frolov
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：entire Fisher matrix, enabling practical Hessian, scalable Kronecker-based approximation, practical Hessian analysis, captures cross-layer interactions
备注：
点击查看摘要
Abstract:In this paper, we propose a scalable Kronecker-based approximation that captures cross-layer interactions without storing the entire Fisher matrix, enabling practical Hessian analysis for billion-parameter networks where full computation is infeasible. Our approach reveals consistent vulnerability patterns: value projection layers exhibit the highest sensitivity and strongest cross-layer correlations across multiple model families, while other components exhibit architecture-specific behaviors. Through extensive experiments on quantization, sparsification, inter-layer corruption, and post-corruption fine-tuning, we demonstrate that our approximation strongly correlates with both performance degradation and recovery. Our framework provides a practical, theoretically grounded tool for identifying fragile components in large models, opening new avenues for guided compression and optimization strategies, such as mixed-precision allocation, layer-wise sparsity, and adaptive low-rank decomposition across layers and even individual weight groups.
31. 【2609.02438】When Decodability Is Not Enough: Logical Validity Representations, Behavioral Dissociation, and Causal Tests in Language Models
链接：https://arxiv.org/abs/2609.02438
作者：Smitha Muthya Sudheendra,Jaideep Srivastava
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, model represents internally, represents internally, Large
备注：
点击查看摘要
Abstract:Large language models can look capable of logical reasoning, but correct or incorrect answers alone tell us little about what the model represents internally. We study logical verification in five open-weight transformer models using matched valid--invalid premise--claim pairs that vary across inference families, semantic domains, templates, and difficulty levels. Despite near-chance behavioral performance, logical validity is often almost perfectly decodable from hidden states and remains strongly decodable under held-out templates, domains, and inference families. Validity also remains highly decodable on behaviorally incorrect examples in the conditions where correctness-conditioned evaluation is well defined. At the same time, exhaustive leave-one-out tests reveal clear limits to this generalization, and interventions along probe-derived validity directions have only weak, nonspecific effects compared with random controls. Our results suggest that representing validity, expressing it in behavior, and using it causally are distinct. Validity related information can be strongly decodable from a model's hidden states without being reliably expressed in its output.
32. 【2609.02421】UTP-Bench: Uncertainty-aware Travel Planning Benchmark
链接：https://arxiv.org/abs/2609.02421
作者：Etcharla Revanth Rao,Priyanshu Karmakar,Shubhojit Mallick,Manish Gupta,Shreya Ghosh,Abhik Jana
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, recently demonstrated strong, demonstrated strong capabilities, travel itinerary generation
备注： 34 pages, 12 figures, 16 Tables, EMNLP 2026
点击查看摘要
Abstract:Large Language Models (LLMs) have recently demonstrated strong capabilities in automated travel itinerary generation. However, real- world travel planning is inherently uncertain: transportation delays, crowd fluctuations, and unexpected stochastic delays frequently inval- idate otherwise feasible schedules. Existing benchmarks like TravelPlanner and TripCraft assume deterministic environments, evaluating only static constraint satisfaction and ignoring whether generated plans remain robust when such uncertainties arise. To address this limitation, we introduce UTP-Bench1 , a large-scale benchmark for uncertainty-aware travel planning. The dataset integrates real-world travel data spanning 504 cities of India, including attractions, restau- rants, accommodations, and multi-modal trans- portation networks. To model realistic disrup- tions, UTP-Bench incorporates empirical delay distributions and crowd-density patterns col- lected from major cities, enabling evaluation of travel plans under stochastic conditions. We further propose three evaluation metrics, namely Buffer Adequacy Score (BAS), Crowd- Aware Timing Score (CATS), and Transport Delay Absorption Score (TDAS), which quan- tify the ability of generated itineraries to main- tain robustness against transit delays and crowd variability. Experiments with state-of-the-art LLMs like GPT-5, Qwen3, Mistral and Phi-4 re- veal substantial gaps between model-generated and human-authored plans, particularly in tem- poral buffering, delay-aware transportation scheduling, and crowd-sensitive planning.
33. 【2609.02414】Before the Script, Set the Stage: How Worldview Simulation Amplifies Psychologically Grounded Persuasion in Multi-Turn Jailbreaking
链接：https://arxiv.org/abs/2609.02414
作者：Siyu Chen,Haoran Wang,Xiaojian Li,Yao Huang,Yinpeng Dong,Wei Xu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：jailbreak attacks demonstrate, existing methods obscure, conversational mechanisms drive, Multi-turn jailbreak attacks, mechanisms drive vulnerability
备注： 19 pages, 7 figures. Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Multi-turn jailbreak attacks demonstrate that harmful intent can be distributed across dialogue, yet existing methods obscure what conversational mechanisms drive vulnerability. We introduce BLUEPRINT, a safety-evaluation framework separating a factorized social-influence strategy space from WORLDVIEWSIM, a cross-turn situational context module. Monte Carlo Tree Search optimizes turn-level combinations of 18 theory-grounded influence factors across a four-turn trajectory. Across six frontier models, BLUEPRINT achieves near-ceiling ASR on major open-weight and proprietary models, while requiring the fewest average queries (2.46). The resulting trajectories further reveal model-specific vulnerability among resistant targets: each responds to distinct influence factors and strategy transitions, yet all share a common recovery pathway-shifting toward concrete, executable task framing consistently escapes hard-refusal states. Ablations confirm operational cues matter most: making requests actionable has the largest impact, gain framing is unusually potent, and some legitimacy appeals can backfire. These findings suggest robust multi-turn safety requires monitoring not only harmful content, but also how dialogue state makes unsafe requests appear concrete and locally executable.
34. 【2609.02396】Improving Health Literacy through Lay Summarization of Radiological Reports: An Evaluation of BioNER and Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2609.02396
作者：Egecan Çelik Evgin,İlknur Karadeniz,Olcay Taner Yıldız
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Radiology reports, primarily for clinicians, written primarily, specialized terminology
备注：
点击查看摘要
Abstract:Radiology reports are written primarily for clinicians, and their specialized terminology often makes them difficult for patients to interpret. As a result, many patients turn to publicly available Large Language Models (LLMs) to help explain their reports, despite well-documented risks of factual inaccuracies and hallucinations. Automated lay-summary generation has emerged as a promising alternative, yet the effectiveness of retrieval-enhanced and clinically informed approaches for radiology-specific communication remains underexplored. This study investigates the extent to which Retrieval-Augmented Generation (RAG) and Named Entity Recognition (NER) improve the quality, factual consistency, and readability of automatically generated lay summaries compared with standard LLM-based generation. We develop a framework combining NER-based extraction of clinically relevant findings with a RAG mechanism for contextual grounding, evaluated across few-shot and fine-tuned variants of two models (Qwen, BioBART). Results show that NER consistently improves readability and overall quality, while RAG alone offers no benefit and can introduce hallucinations from irrelevant retrieved terms. Combining RAG with NER degrades performance in few-shot settings but improves readability when fine-tuned. Fine-tuned BioBART with NER achieves the best overall performance, highlighting entity-aware extraction as the primary driver of improved patient-friendly summaries.
35. 【2609.02391】PolERo: Studying Political Evasion in Romanian
链接：https://arxiv.org/abs/2609.02391
作者：Gabriel Stefan,Sergiu Nisioi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Political evasion refers, requested information, question while withholding, withholding the requested, Recent NLP work
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Political evasion refers to responses that engage with a question while withholding the requested information. Recent NLP work frames political evasion as a classification task using a two-level taxonomy of response clarity and fine-grained evasion strategies. Existing work on response clarity and evasion classification is limited to English, leaving open whether the taxonomy and model behavior transfer across languages and political contexts. We introduce PolERo, a dataset of 3,574 human-annotated question-answer pairs extracted from official transcripts of five Romanian presidents. We evaluate multiple classification approaches on both datasets under matched conditions, including TF-IDF baselines, fine-tuned encoder models, a proposed sliding-window encoder, and zero/few-shot LLM prompting. We study cross-lingual transfer through joint bilingual training and machine-translation-based data augmentation. Our results indicate that fine-tuned encoders are competitive, cross-lingual transfer is asymmetric, and ambivalent evasion categories involving pragmatic cues remain the main challenge across all model families.
36. 【2609.02379】MultiGhostBench: A Multilingual Benchmark for Long-Form LLM-Generated Text Attribution under Distribution Shifts
链接：https://arxiv.org/abs/2609.02379
作者：Matteo Greco,Anudeex Shetty,Andrea Tagarelli,Jey Han Lau
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词：LLM authorship attribution, focusing on English, benchmarks remain limited, authorship attribution, made progress
备注：
点击查看摘要
Abstract:While existing work on LLM authorship attribution (AA) has made progress, available benchmarks remain limited, often focusing on English, controlled settings, or relatively outdated models, with the few multilingual studies considering only relatively short texts. We introduce MultiGhostBench, a multilingual benchmark comprising 928 books generated by five recent LLMs across six languages and three scripts, with an average length of approximately 59K words per book. The benchmark supports evaluation under domain, author, and language shifts. Evaluation of representative AA methods shows that no single method consistently performs best across settings, and performance generally degrades under distribution shifts. Transformer-based detectors can retain generator-related information across languages, although transfer effectiveness varies by language pair, whereas statistical and fingerprint-based detectors are more language-dependent. We envision MultiGhostBench as a valuable resource for the development and evaluation of robust AA methods. The dataset and code can be found at this https URL.
37. 【2609.02366】NE-R1: Enhancing Named Entity Recognition Model via Reinforcement Learning
链接：https://arxiv.org/abs/2609.02366
作者：Meixuan Chen,Hehan Li,Ruizhi Zhao,Xin Lu,peizhi xu,Liwei Qian,LI Meifang,shuanglong li,Hanmeng Liu,Xin Pei,Yanbiao Ma
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Named Entity Recognition, Named Entity, achieved substantial progress, Entity Recognition, large language models
备注： EMNLP2026
点击查看摘要
Abstract:Named Entity Recognition (NER) has achieved substantial progress since the advent of large language models (LLMs). Nevertheless, the recognition of long-tail and domain-specific entities remains challenging due to the deficiency in parametric knowledge. Retrieval-augmented generation (RAG) offers a promising remedy by injecting external knowledge, but it also introduces noise and unnecessary cost when dealing with familiar cases. In this paper, we propose NE-R1, a novel framework for adaptive retrieval-augmented NER. We design a "retrieval-on-demand" mechanism for NER. Then we integrate it into models by a two-stage training method: (1) multi-task instruction tuning initialization; (2) end-to-end RL optimization with CoT. To achieve reasonable selection between parameterized and external knowledge, we design a multi-dimensional reward considering both accuracy and retrieval benefit. NE-R1 achieves state-of-the-art performance on various benchmarks, with an average F1 score gain of 2.52% in in-domain evaluation and 1.18% in zero-shot cross-domain evaluation.
38. 【2609.02343】SonicCaps: Large-Scale Diverse and Fine-Grained Captioning for Improved Audio-Retrieval
链接：https://arxiv.org/abs/2609.02343
作者：Zineb Lahrichi,Marc Ferras,Gaël Richard,Geoffroy Peeters
类目：ound (cs.SD); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
关键词：Recent advances, large-scale audio captioning, advances in audio-language, audio-language modeling, captioning datasets
备注：
点击查看摘要
Abstract:Recent advances in audio-language modeling have been driven by large-scale audio captioning datasets. However, existing datasets remain limited by low semantic diversity, generic descriptions lacking acoustic details, and one-to-one audio-caption mappings that poorly reflect the inherent ambiguity of auditory perception. We introduce SonicCaps, a large-scale audio captioning dataset comprising ~15M captions paired with ~700k audio clips, generated using a multi-modal large language model (Qwen3-Omni) conditioned on both audio and text. To explicitly promote diversity, we generate around 24 captions per audio via structured prompt engineering and few- shot generation, spanning main descriptions, rephrased variants (verbosity, style) and semantic tags. Human evaluation shows that SonicCaps is rated significantly higher than existing captioning datasets, with fine-grained analyses indicating that our captions are perceived as more descriptive and precise, which strongly correlates with quality judgments. Finally, training CLAP models on SonicCaps with a multi-caption sampling strategy consistently improves audio retrieval and zero-shot classification, with stronger generalization across public and commercial benchmarks. We release both SonicCaps and two specialized CLAP models on hugging face: this https URL.
39. 【2609.02336】SALA: Semantic-Aware Logical Alignment for Complex Reasoning in In-Context Learning
链接：https://arxiv.org/abs/2609.02336
作者：Zhao Ji,Wenqing Chen,Zhixuan Chu,Jianxing Yu,Jingping Liu,Shanhe Zhao,Zibin Zheng
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Effective in-context learning, Effective in-context, complex reasoning relies, in-context learning, relies on selecting
备注： Accepted for publication in Findings of EMNLP 2026
点击查看摘要
Abstract:Effective in-context learning (ICL) for complex reasoning relies on selecting the right demonstrations. Traditional retrieval methods based on surface similarity fail to capture the underlying problem-solving logic. Recent logic-based methods address this by matching predefined reasoning steps, but the rigid rules and exact-match criteria is improper to handle flexible or diverse reasoning processes. To address the problem, we propose SALA, a Semantic-Aware Logical Alignment framework. Instead of relying on a fixed inventory, SALA automatically learns task-specific reasoning operations. It then embeds these operations into a continuous semantic space and uses dynamic time warping (DTW) to align the reasoning sequences. This approach allows for soft, flexible matching of reasoning logic while remaining highly interpretable. Experiments across four reasoning benchmarks and three LLMs demonstrate that SALA outperforms existing demonstration selection methods. Further analysis confirms the roles of the operation induction and the logical semantic alignment.
40. 【2609.02316】Counter-GEO-Bench: Evaluating Defenses Against Information-Distorting Generative Engine Optimization
链接：https://arxiv.org/abs/2609.02316
作者：Bing Zheng,Zongyao Zhao,Wenming Yang
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Generative engine optimization, generative search engines, large language models, adversaries publish ordinary-looking, publish ordinary-looking GEO-optimized
备注： Accepted to EMNLP 2026 (Main Conference). 17 pages, 5 figures
点击查看摘要
Abstract:Generative engine optimization (GEO) enables content producers to increase the visibility of their web pages in generative search engines, but the same techniques can deliver targeted misinformation when adversaries publish ordinary-looking GEO-optimized documents that victim large language models (LLMs) retrieve and synthesize into distorted answers. No existing benchmark evaluates defenses against this threat under controlled conditions. Therefore, we present Counter-GEO-Bench, a defense benchmark that pairs 247 human-verified, quality-gated queries with information-preserving and information-distorting GEO rewrites, and evaluates defenses on attack success rate (ASR), false positive rate, and answer quality across three victim LLMs. Under Counter-GEO-Bench, three off-the-shelf defenses (Granite Guardian, Llama Guard 3, and NeMo Self-Check Fact-Checking) reduce ASR by at most 5.7% relative, while Granite Guardian's reduction is not statistically significant. Safety-taxonomy guardrails target policy violations, while GEO misinformation passes through them as fluent informational content. To this end, a lightweight benchmark baseline, C-GEO Guard, is proposed, reducing ASR by 47.6% relative with near-zero utility loss, which proves threat tractable.
41. 【2609.02315】DiffIE: Diffusion-based Open Information Extraction
链接：https://arxiv.org/abs/2609.02315
作者：Konstantin Fedorov,Valentin Malykh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：makes Open Information, Open Information Extraction, Open Information, makes Open, Information Extraction
备注：
点击查看摘要
Abstract:A single sentence often expresses multiple valid relational triplets, which makes Open Information Extraction (OpenIE) fundamentally a multi-output task. Existing neural systems handle this by autoregressive generation, which is flexible but slow and prone to redundancy, or by fixed-slot prediction, which is efficient but couples the extraction budget to training. We introduce DIFFIE which instead treats the stochasticity of conditional discrete diffusion as the extraction mechanism itself: independent reverse-diffusion trajectories over per-token role tags produce a pool of candidate triplets, which are clustered under lenient matching and ranked to form the output. Both the pool size and the number of returned extractions are inference-time choices, decoupling the extraction budget from training and exposing test-time compute as a tunable axis. DIFFIE achieves the new state of the art in CaRB (1-1) both F1 and AUC, and outperforms the strongest rule-based system (ClausIE) in BenchIE; it also remains competitive in standard CaRB and WiRe57 evaluations, giving the best average score among systems that report all four benchmarks. Ablations show that uniform discrete diffusion outperforms absorbing state diffusion in our setting, and that a matched non-diffusion stochastic tagger does not reproduce its gains. Our results indicate that diffusion stochasticity is an effective mechanism for structured prediction tasks with multiple valid outputs.
42. 【2609.02309】Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization
链接：https://arxiv.org/abs/2609.02309
作者：Bizhe Bai,Jiakang Yuan,Hongming Wu,Xinyue Wang,Jie Ren,Siyao Chen,Yuchen Ya,Fan Bai,Pai Peng,Huafeng Qin,Tao Chen
类目：Computation and Language (cs.CL)
关键词：agents increasingly operate, GUI agents increasingly, reports progress primarily, mobile apps, operate across websites
备注： Accept at Grounding Language Models: Learning Faithfully and Efficiently @ EMNLP 2026
点击查看摘要
Abstract:GUI agents increasingly operate across websites, mobile apps, and desktop environments, yet the field still reports progress primarily through task success. We argue that practical deployment depends equally on efficiency: how much context, computation, action budget, and runtime overhead an agent consumes while succeeding. This survey studies efficient GUI agents through an end-to-end systems lens that preserves the current technical axes of observation efficiency, context and memory efficiency, action efficiency, and planner-side/system efficiency. For each subsection, we expand the seed literature through targeted search plus backward and forward citation chaining, then synthesize the dominant mechanisms, reported efficiency signals, and new overheads they introduce. Across the literature, recent progress converges on a small set of recurring ideas: selective reading instead of full-context ingestion, global-to-local visual allocation, recoverable memory rather than raw history replay, verification-aware control, and hybrid runtimes that can switch between GUI and non-GUI execution. We conclude by identifying the main open problems, including honest accounting of verifier cost, cross-benchmark comparability, and co-design of observation, memory, and execution layers under real latency and privacy constraints.
43. 【2609.02302】Improving Evaluation Realism with Inference-Time Compute and Deployment Scaffolds
链接：https://arxiv.org/abs/2609.02302
作者：Axel Ahlqvist,Richard Guan,Juan-Pablo Rivera,Adeline Kassler,Dmitrii Troitskii,Alexandra Souly,Kai Fronsdal,Robert Kirk,John Hughes
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：weakening the conclusions, core obstacle, conclusions a safety, alignment evaluations, simulated alignment evaluations
备注： 70 pages, 43 figures, 4 tables (13 figures in the main text). Under review at NeurIPS 2026. Code: [this https URL](https://github.com/meridianlabs-ai/petri_dish) and [this https URL](https://github.com/AxelAhlqvist1995/petri-bon) ; reproduction assets: [this https URL](https://github.com/AxelAhlqvist1995/petri-realism-reproduction)
点击查看摘要
Abstract:A core obstacle to alignment evaluation is evaluation awareness: capable models can tell when they are being tested rather than deployed, weakening the conclusions a safety evaluation can support. We present two techniques that make simulated alignment evaluations harder to distinguish from real deployments. Our first technique, critique refinement, spends additional inference-time compute on each simulator action: the simulator generates multiple candidate actions, refines them using feedback from an instance of the target model on how to make them more realistic, and continues the evaluation with the most deployment-like candidate. Our second technique, DISH (Deployment-Imitating SWE-Agent Harness), wraps the target in an agent harness, reducing the gap between simulated and real deployment environments in coding settings. We test the techniques on multiple target models and find that they compose: applying both yields larger realism gains than either alone. Our results show that automated approaches can improve the realism of alignment evaluations, and that these improvements use additional compute more effectively than making the audits longer.
44. 【2609.02292】SCX Router: Streaming Zero-Shot Model Selection with a Decoder-KV Classifier and a Real-World Task Ontology
链接：https://arxiv.org/abs/2609.02292
作者：Ihor Stepanov,Aleksandr Smechov,Mykhailo Shtopko,Dmytro Vodianytskyi,Oleksandr Lukashov
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：unique optimization opportunity, large language models, optimization opportunity, rapid proliferation, proliferation of large
备注： 20 pages, 10 tables, 6 figures
点击查看摘要
Abstract:The rapid proliferation of large language models (LLMs) and the growing diversity of their applications presents a unique optimization opportunity: selecting the right model for the task, while optimizing for speed, cost, and quality at a per-task level. However, inference endpoints can vary widely in quality, price, latency, context support, tool use, domain expertise, and reasoning behavior. This heterogeneity makes manual heuristics difficult to maintain and unlikely to achieve consistently favorable speed--cost--quality trade-offs on their own. We introduce \router{}, a lightweight GLiClass-based router that assigns a suitability score to each inference-time model label without autoregressive generation. The released 0.6B-parameter checkpoint combines a Qwen3 decoder with a shallow bidirectional scorer. Its decoder-KV execution path preserves a text-only key--value cache across a session, encodes only new dialogue turns, and evaluates transient candidate-label tokens without adding them to the persistent cache. The same checkpoint also predicts task type, difficulty, reasoning mode, and expected output length, and supports custom zero-shot labels. For task generation, we construct a task ontology with 23 families, 115 task types, 345 routable subtypes, 1,173 synthetic examples, and an orthogonal axis of 30 domains. Using this structure, we generate 150,000 verifier-scored tasks and 15,000 open-ended tasks. We then train the Qwen3 decoder on these tasks, while explicitly separating learned request prediction from per-task policies for attributes such as eligibility, cost, cache reuse, safety, and sovereignty. Across six LiveBench subsets, the router outperforms the mean candidate; on the selected 1,000-task subset, it achieves an aggregate top-1 score of 0.707 versus 0.696 for the strongest fixed model, with benchmark-dependent gains.
45. 【2609.02285】Entangled Representations Amplify Collateral Damage in Unlearning
链接：https://arxiv.org/abs/2609.02285
作者：Evžen Wybitul,Tim G. J. Rudner,Christian Schroeder de Witt
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：makes unlearning harder, Selective Gradient Masking, neural network, sharing of structure, long-held intuition
备注：
点击查看摘要
Abstract:A long-held intuition in interpretability research is that representational entanglement, the sharing of structure between knowledge domains in a neural network, makes unlearning harder. While the intuition is widespread, it has never been directly tested in a controlled experiment. We present a way to do so: by repurposing Selective Gradient Masking (SGTM), we train a suite of six 254M-parameter language models on English Wikipedia with graded levels of disentanglement between biology and non-biology knowledge. Applying three standard unlearning methods to every model in the suite, we find that more disentangled models consistently achieve better retain-forget trade-offs: at a fixed level of forgetting, the most disentangled models incur roughly $4\times$ lower retain cost under two of the three methods, and $1.3\times$ lower under the third. Because our intervention changes only the model, not the data or the unlearning algorithm, this is direct evidence that representational entanglement is one of the causes of collateral damage in unlearning, as interpretability researchers have long suspected. A similar design could be used to test other structural claims from interpretability.
46. 【2609.02275】Do Large Language Models Capture the Diversity in their Training Data?
链接：https://arxiv.org/abs/2609.02275
作者：Youqi Wu,Farzan Farnia
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：remains inadequately understood, training data, plausible outputs present, Large language models, Large language
备注：
点击查看摘要
Abstract:Large language models are trained to model conditional distributions over text, yet it remains inadequately understood whether they capture the full diversity of plausible outputs present in their training data. We study this question through an information-theoretic lens by comparing the conditional entropy of model-generated outputs with that of the corresponding training data. Given paired input-output samples, we use conditional entropy and its matrix-based analogue based on von Neumann entropy to measure output variability beyond what is explained by the conditioning input, without requiring multiple reference outputs for the same prompt. Across LLM families with publicly available training data, including OLMo, Pythia, and GPT-Neo, we consistently find that model-generated outputs exhibit lower conditional entropy than their training data, across different model scales, sequence lengths, and decoding strategies. We observe a similar conditional diversity gap beyond language modeling, including class-conditioned ImageNet generators and text-conditioned models trained on MS-COCO. To address this gap, we propose a post-hoc correction mechanism that generates multiple outputs for each input and reweights them through a matrix-entropy projection, increasing conditional diversity while remaining close to the original model distribution. We prove the concavity of the matrix-based conditional entropy functional, which makes the resulting entropy-constrained projection a convex optimization problem, and develop a scalable mirror-descent algorithm for its implementation. Our results reveal a systematic conditional diversity gap between modern generative models and their training data, and provide an information-theoretic framework for measuring and mitigating this gap.
47. 【2609.02273】CoMerge: Conflict-Driven Preference Optimization for Multi-Task Model Merging
链接：https://arxiv.org/abs/2609.02273
作者：Mingjie Zheng,Zihao Chen,Wenqing Chen,Weile Yuan,Zhixuan Chu,Jianxing Yu,Zibin Zheng
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：constructing multi-task large, multi-task large language, full model retraining, large language models, efficient paradigm
备注： Accepted for publication at the EMNLP 2026 Main Conference
点击查看摘要
Abstract:Model merging provides an efficient paradigm for constructing multi-task large language models (LLMs) without full model retraining, yet it remains challenged by parameter interference. While existing methods aim to preserve the capabilities of individual expert models and mitigate interference, they generally do not directly learn from the potentially degraded behaviors exposed by naive merging. In this paper, we propose a conflict-driven preference optimization framework for model merging (CoMerge), which reformulates model merging as a preference optimization problem. The approach utilizes a self-supervised, conflict-driven strategy that leverages the defects of naive merging methods (e.g., task arithmetic) as hard negative samples to construct preference pairs without external annotations. By applying preference optimization to refine lightweight, tensor-wise merging coefficients, CoMerge enables the model to mitigate parameter-space conflicts while preserving task-specific capabilities. Extensive experiments show that CoMerge achieves an average normalized performance of 0.9968 on MergeBench, outperforming all evaluated data-free and data-driven model-merging baselines. Furthermore, on Llama-3.1-8B-Instruct, CoMerge yields marked improvements on conflict-sensitive tasks such as instruction following and safety, while remaining highly competitive with full-parameter fine-tuning despite optimizing only 1,445 scalar coefficients.
48. 【2609.02272】PaperCompiler: Faithful Paper-to-Code Generation via Repository-Level Specification Compilation
链接：https://arxiv.org/abs/2609.02272
作者：Yunhao Liu,Hong Phuc Pham,Jaehong Yoon
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)
关键词：Faithfully translating research, preserve method logic, require generated repositories, leave implementation assumptions, implementation assumptions implicit
备注： 9 pages
点击查看摘要
Abstract:Faithfully translating research papers into repository-level implementations remains challenging because papers often describe methods at a high level, leave implementation assumptions implicit, and require generated repositories to preserve method logic, evaluation protocols, and cross-file consistency. Despite recent advances in paper-to-code agents, their intermediate outputs are often presented as free-form plans or summaries that downstream coding agents may ignore, reinterpret, or compress, leading to algorithmic simplification and inconsistent repository structure. To address these challenges, we introduce PaperCompiler, a paper-to-code generation framework that compiles paper-grounded evidence into explicit repository-level implementation specifications. PaperCompiler grounds implementation-relevant evidence while preserving source provenance and distinguishing paper-supported, inferred, externally delegated, and unresolved information. The resulting specifications encode non-degradation requirements, ownership assignments, cross-file dependencies, and file-level constraints. Repository generation proceeds under these compiled specifications while retaining flexibility over local engineering choices not fixed by the paper. PaperCompiler outperforms strong baselines on Paper2CodeBench, achieving a 13.8% relative improvement in reference-based fidelity (from 3.64 to 4.15) and reducing high-severity evaluator critiques (from 13.2% to 6.1%).
49. 【2609.02262】From Detection to Characterization: A Large-Scale Study of Ragebait on Japanese X
链接：https://arxiv.org/abs/2609.02262
作者：Zhiyang Qi,Kazuhiro Ito,Jinghui Chen,Hibiki Nakamura,Zhangxuan Chen,Erina Murata,Masaki Chujyo,Fujio Toriumi
类目：ocial and Information Networks (cs.SI); Computation and Language (cs.CL)
关键词：content intentionally designed, online content intentionally, attention and engagement, intentionally designed, designed to provoke
备注： Accepted at WI-IAT 2026. This is the pre-camera-ready version
点击查看摘要
Abstract:Ragebait refers to online content intentionally designed to provoke anger or outrage and thereby increase attention and engagement. However, reliable large-scale detection and systematic analysis of ragebait remain limited, hindering efforts to understand its prevalence, impact, and mitigation. This study aims to develop an effective ragebait detection framework and to clarify the characteristics of ragebait at scale, providing a basis for understanding and mitigating emotionally provocative content online. We constructed a labeled dataset with the assistance of a large language model (LLM) and trained several Japanese language models for ragebait detection. The resulting ensemble classifier was then applied to a large-scale dataset of Japanese-language posts on X. Our analysis shows that ragebait is more prevalent in politically and socially contentious topics, including politics, discrimination, public health, and interpersonal conflict. Ragebait posts also spread faster and receive more negative reactions than non-ragebait posts, particularly anger, fear, disgust, sadness, and surprise. These findings demonstrate the utility of the proposed detector and provide a large-scale characterization of ragebait in Japanese online discourse.
50. 【2609.02253】APEx: Distillation of Agent Procedural Experience for Adaptive Deep Research Question Answering
链接：https://arxiv.org/abs/2609.02253
作者：Jie Ding,Rui Sun,Xinyuan Zhang,Zeyu Zhang,Xin Liu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Deep research agents, research agents augment, agents augment large, augment large language, large language models
备注：
点击查看摘要
Abstract:Deep research agents augment large language models with external tools to answer complex, long-horizon questions through multi-turn reasoning. Learning from prior experience is crucial for continual improvement, yet existing methods either retrieve verbose task-specific traces that burden decision-making, or distill procedural skills that remain decoupled from downstream policy adaptation. We propose APEx, a hierarchical experience utilization framework that organizes interaction history into instance-level trajectory memories and category-level procedural skills, and couples them through a closed-loop architecture of Executor, Distiller, and Planner. The three modules are optimized via a three-stage alternating GRPO training paradigm, enabling reward-guided skill distillation rather than fixed-prompt generation. At test time, distilled skills serve as procedural priors for online Planner adaptation through skill-guided test-time reinforcement learning, allowing ground-truth-free self-improvement with skill-alignment regularization to prevent policy drift. Experiments on 7 benchmarks demonstrate that APEx achieves state-of-the-art performance, surpassing GPT-5.4 by 14.7 points and the strongest memory-augmented baseline by 3.0 points.
51. 【2609.02250】RideSkill: A Hierarchical Algorithm for Generalized Ride Sharing with LLM-Driven Automatic Evolution
链接：https://arxiv.org/abs/2609.02250
作者：Zijian Zhao,Sen Li,Xialiang Tong,Mingxuan Yuan
类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL); Emerging Technologies (cs.ET); Machine Learning (cs.LG)
关键词：challenging operational problem, pairs to share, multiple passengers, share a single, challenging operational
备注：
点击查看摘要
Abstract:Ride-sharing, which allows multiple passengers with different origin-destination (OD) pairs to share a single vehicle, is a challenging operational problem, as it requires orders with different OD pairs to be efficiently bundled and assigned to vehicles under uncertain and varying scenarios. Although multi-agent reinforcement learning (MARL) solutions have achieved promising performance, they suffer from limited generalization (adapting to different environmental scenarios), low transferability (adapting to different platform objectives), and training difficulties in large-scale systems, such as the curse of dimensionality. Recently, motivated by the scaling of large language models (LLMs), several works have incorporated LLMs into ride-hailing systems, either by employing LLMs directly as decision-making agents or using them for automatic algorithm design. However, none of these approaches support vehicle sharing, which complicates the problem by expanding both the state and action spaces exponentially. Moreover, most of them require frequent LLM calls at inference time, making them infeasible for real-time deployment. To address these issues, we propose RideSkill, a hierarchical method for ride-sharing that leverages LLM-assisted automatic algorithmic design. RideSkill consists of a combiner that assigns appropriate skills to each vehicle from a learned skill repository, enabling adaptive dispatch under varying scenarios and objectives, and a repositioner that sequentially relocates idle vehicles to emerging regions, avoiding conflicts among vehicles. Crucially, the skill repository, combiner, and repositioner are all trained by an LLM-based automatic evolutionary method, eliminating the need for LLM calls during deployment and thus ensuring high real-time performance.
52. 【2609.02207】LeakageBench: Document-Level Leakage Risk for Redacting Personally Identifiable Information in Document Images
链接：https://arxiv.org/abs/2609.02207
作者：Vishnu Prasad Vijaya Kumar,Santhosh Venkatesh,Ivan P. Yamshchikov
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Real-world personally identifiable, personally identifiable information, visual noise determine, PDF renderings, Real-world personally
备注：
点击查看摘要
Abstract:Real-world personally identifiable information (PII) redaction often operates on document images---scans, screenshots, and PDF renderings---where OCR errors, layout structure, and visual noise determine whether sensitive information is actually removed. Existing PII benchmarks are mostly text-centric and do not measure document-level redaction risk: a page remains unsafe if even one identifier is missed. We introduce LeakageBench, a challenge set of 500 document images with 11,954 GDPR-aligned PII annotations spanning direct identifiers, linkage keys, and contextual re-identification surfaces. We evaluate generic OCR pipelines, commercial and task-adapted OCR-dependent detectors, and OCR-free vision-language models using entity-level F1, group-wise leakage, and document-level leakage metrics. Code Interpreter raises GPT-5.5 localization F1 from 0.090 to 0.249, but critical page-level leakage remains 0.968. These results show that stronger detection and tool assistance improve localization without making most pages safe for release. LeakageBench provides a diagnostic benchmark for high-recall, spatially grounded PII redaction in document images.
53. 【2609.02172】Breadth Beats Depth: Improving GCG-Based Jailbreak Optimization with Breadth-Oriented Suffix Search
链接：https://arxiv.org/abs/2609.02172
作者：Shiliang Xiao,Jingsong Wei,Yuzhi Liang,Yufan Zheng,Xia Li,Qiliang Lin
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Greedy Coordinate Gradient, Coordinate Gradient, achieve strong effectiveness, Greedy Coordinate, white-box source models
备注：
点击查看摘要
Abstract:Optimization-based jailbreak attacks such as Greedy Coordinate Gradient (GCG) achieve strong effectiveness and transferability by optimizing adversarial suffixes on white-box source models. However, existing GCG-based methods rely on averaged adversarial loss and deep greedy search, which can over-emphasize easy-to-jailbreak behaviors and overlook promising regions of the suffix space. We propose BOSS, a plug-and-play framework that improves GCG-based jailbreak optimization through breadth-oriented suffix search. BOSS uses Tail-Focused Adversarial Loss (TFAL), standard source loss, and behavior coverage to select terminal suffixes, then explores multiple short trajectories and selectively continues promising suffixes. Experiments on public benchmarks show that BOSS improves attack success rates across multiple GCG-based methods while reducing optimization time.
54. 【2609.02163】Do Cantonese-Adapted Language Models Better Predict Cantonese Reading? A Cross-Model Eye-Tracking Evaluation
链接：https://arxiv.org/abs/2609.02163
作者：Ziqi Zhang,Emmanuele Chersoni,Mohammad Momenian
类目：Computation and Language (cs.CL)
关键词：shape human reading, alignment remains unclear, psycholinguistic alignment remains, human reading, remains unclear
备注：
点击查看摘要
Abstract:Information-theoretic measures derived from autoregressive language models are widely used to characterize the expectations that shape human reading, but whether language-variety-specific training improves such psycholinguistic alignment remains unclear. This question is still open for Cantonese, where recent NLP evaluations reported mixed benefits from Cantonese-specific training relative to Mandarin-oriented or general-purpose models. Using naturalistic Cantonese eye-tracking data, we compare two within-family adaptation contrasts: CKIP GPT-2 Tiny versus its lightly Cantonese-adapted JED351 derivative, and Qwen2.5-7B versus CantoneseLLM-7B, which underwent substantially more extensive Cantonese continued pretraining and instruction tuning. From each model, we derive lexical surprisal, POS surprisal, entropy before the target, and entropy reduction. Lexical surprisal and the joint four-metric model consistently favor CantoneseLLM-7B, followed by Qwen2.5-7B, CKIP, and JED351, whereas entropy reduction favors CKIP. These results suggest that more extensive Cantonese-specific training can be associated with stronger predictive fit, while model rankings also depend on the information-theoretic measure being evaluated.
55. 【2609.02158】OBJECTION! Lawyer Agents Mitigate Guilty Bias in Legal Judgment Prediction
链接：https://arxiv.org/abs/2609.02158
作者：Jaehoon Jeong,Jay-Yoon Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Legal Judgment Prediction, Judgment Prediction, prosecutorial perspective, Legal Judgment, typically trained
备注： Accepted to EMNLP 2026 Main Conference. Dataset: [this https URL](https://huggingface.co/datasets/Kcsp0042/natural-innocent)
点击查看摘要
Abstract:Legal Judgment Prediction (LJP) models are typically trained on documents that describe facts from a prosecutorial perspective. Existing datasets further exhibit severe label imbalance toward guilty outcomes. Consequently, these models suffer from "Guilty Bias", blindly accepting the prosecution's narrative as objective truth. Previous studies employing three-step reasoning structures or training on synthetically generated innocence data improve overall accuracy, but they still fail to mitigate bias at inference time. In this paper, we introduce OBJECTION, an inference-time pipeline that integrates an Adversarial Lawyer Agent into each 3-step reasoning of offense, unlawfulness, and culpability. Unlike generic critics, our agent actively challenges the model's presumptions of guilt by injecting legal defense arguments at each reasoning stage. To thoroughly evaluate this, we present a new "Natural Innocent" dataset including 3.4k real-world cases, overcoming the limitations of synthetic innocence benchmarks. Test results show that OBJECTION drastically reduces the False Guilty Rate (FGR) from 82.93% (SOTA baseline) to 16.69%, proving its capability to perform substantive legal reasoning. This work denotes a key progress toward aligning Legal AI with the presumption of innocence.
Comments:
Accepted to EMNLP 2026 Main Conference. Dataset: this https URL
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.02158 [cs.CL]
(or
arXiv:2609.02158v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.02158
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
56. 【2609.02153】A Layered Taxonomy for Chinese Learner Grammatical Error Annotation
链接：https://arxiv.org/abs/2609.02153
作者：Mengyang Qiu,Jungyeul Park
类目：Computation and Language (cs.CL)
关键词：Chinese learner writing, learner writing requires, Chinese grammatical error, computational Chinese grammatical, Grammatical error annotation
备注：
点击查看摘要
Abstract:Grammatical error annotation in Chinese learner writing requires labels that are both consistent and linguistically meaningful. This paper proposes a layered scheme linking computational Chinese grammatical error correction (CGEC) with pedagogical error analysis. The scheme first identifies character- and punctuation-level orthographic errors, labeling them by edit operation and subtype. Other errors receive a three-layer core label combining edit operation, linguistic domain, and part of speech, with optional Chinese-specific extensions for aspect, modality, comparison, argument structure, and complements. Drawing on CGEC resources, learner-error taxonomies, and Mandarin grammar, the taxonomy is evaluated through a coverage analysis of automatically extracted MuCGEC edits and a preliminary consistency study in which five large language models apply it to a sample. The results support the layered approach while identifying category boundaries requiring further refinement.
57. 【2609.02133】EmoStance: Response-Side Affective-Orientation Control for Empathetic Response Generation via Emoji Weak Supervision
链接：https://arxiv.org/abs/2609.02133
作者：Ziyuan Jin,Yuxuan Ge,Zheng Tian
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Empathetic response generation, response generation requires, generation requires models, Empathetic response, speaker affective situation
备注： Accepted to the Main Conference of EMNLP 2026
点击查看摘要
Abstract:Empathetic response generation requires models to decide not only what to say, but also how to respond to the previous speaker's affective situation. We formulate this as response-side affective-orientation control and use multi-annotator emoji distributions as weak affective--attitudinal evidence, rather than as output symbols or gold labels, to induce a latent control space that operationally approximates listener stance. We construct EmojiDialogue, an utterance-level extension of EmpatheticDialogues with emoji votes and confidence scores, and propose EmoStance, which models source-side affective expression, predicts a soft response-side orientation from dialogue context and speaker roles, and steers a frozen instruction-tuned LLM through continuous prefix embeddings. In blind pairwise evaluation with 20 annotators and 800 judgments, EmoStance achieves a 62.2% decisive win rate, with the clearest gains in contextual specificity and perceived responsiveness, while remaining complementary to external-knowledge methods. Code, annotation metadata, and reconstruction scripts are available in our GitHub repository: this https URL.
58. 【2609.02131】C$^{3}$T: Counterfactual Causal Reasoning for Sentiment Shifts in Social-Media Conversation Trees
链接：https://arxiv.org/abs/2609.02131
作者：S M Rafiuddin,Atriya Sen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：branching reply tree, vary across posts, react to claims, users react, Causal Conversation Transformer
备注： 23 pages, 3 figures, 7 tables; accepted to the EMNLP 2026 Main Conference
点击查看摘要
Abstract:Sentiment in social-media threads does not only vary across posts; it shifts as users react to claims, corrections, evidence, and hostility within a branching reply tree. We study why sentiment changes in rumor-centric conversation trees by treating discourse moves (e.g., denial/correction, evidence/link, toxicity/attack) as candidate interventions and asking (i) what sentiment a reply expresses, (ii) whether the sentiment shifts relative to its parent, and (iii) which prior message most plausibly drove the reply's sentiment. To support this setting, we introduce CaSiRe, a causal sentiment reasoning layer over public rumor conversation datasets that adds post-level sentiment labels, induced parent-child shift labels, calibrated multi-label intervention tags, and explicitly annotated causal-source labels. We then propose C$^{3}$T (Counterfactual Causal Conversation Transformer), a thread-structured temporal model that jointly predicts node sentiment and shifts, learns sparse ancestor attribution, and supports counterfactual queries by forcing conversational intervention embeddings on or off to estimate potential outcomes. Under an event-level split, C$^{3}$T improves out-of-event robustness and attribution over text-only, graph-based, and temporal baselines, and yields interpretable model-based effects: denials/corrections and evidence reduce downstream negativity, while toxicity increases it. We also benchmark open-weight LLM prompting baselines and find that added conversational context helps, but attribution remains less reliable, motivating structure-aware counterfactual modeling for social-media analysis.
59. 【2609.02122】AI agents reshape consensus formation in human groups
链接：https://arxiv.org/abs/2609.02122
作者：Lin Chen,Ziyi Liu,Xia Hu,Yong Li
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Social and Information Networks (cs.SI)
关键词：large language model, growing presence reshapes, presence reshapes consensus, reshapes consensus formation, language model
备注：
点击查看摘要
Abstract:As large language model (LLM) agents shift from tools to participants in human groups, a fundamental question for collective behavior is how their growing presence reshapes consensus formation. Here we study mixed human-AI groups in a collaborative description game, in which shared conventions emerge through repeated rounds of random pairwise communication. Varying the proportions of LLM agents, we identify three distinct regimes of consensus formation: low agent proportions facilitate human-led consensus, intermediate proportions disrupt convergence, and high proportions restore strong consensus while shifting it toward agent-led conventions. Crucially, these regimes differ not only in the strength of convergence, but also in the semantic grounding and communicative form of the resulting consensus: human-led consensus is more concrete, holistic, and grounded in shared real-world analogies, whereas agent-led consensus is more abstract, less information-dense, and more geometrically segmented. Mechanistically, agent influence arises from a shared linguistic prior that places agents near one another in the expression space, combined with relatively stable expression choices across rounds; humans initially resist adopting expressions from partners perceived as AI but gradually yield to conformity pressure. These findings provide evidence that AI composition can shape the emergence, content, and perceived legitimacy of group norms, making agent proportion and transparency important design variables for human-AI systems.
60. 【2609.02115】xt2ql: Multi-Target Natural Language Querying via a Language-Agnostic Intermediate Representation
链接：https://arxiv.org/abs/2609.02115
作者：Ritesh Kumar
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB)
关键词：Natural language interfaces, large language model, Natural language, language-agnostic Intermediate Representation, exclusive targeting
备注：
点击查看摘要
Abstract:Natural language interfaces to databases have traditionally suffered from three structural limitations: exclusive targeting of relational SQL, unconditional dependence on large language model (LLM) inference at query time, and absence of any runtime signal when generated queries are semantically incorrect. This paper presents text2ql, an open-source Python framework that addresses all three limitations through a language-agnostic Intermediate Representation (QueryIR) and a pluggable renderer architecture. A single seven-stage detection pipeline serves both SQL and GraphQL targets; a zero-LLM deterministic mode delivers 100% execution accuracy at a median latency of 3.2 ms with no API cost; and every generated query carries a runtime confidence score in [0.15, 0.97] computed from an additive signal model. Evaluated on 50-query random samples from the Spider and BIRD benchmarks (indicative results; full-set evaluation is planned), the LLM-backed mode achieves 62-70% exact match and 84-91% execution accuracy; the deterministic mode achieves 100% execution accuracy with zero parse errors across all 100 test cases. An ablation study isolates schema-aware prompting as the dominant accuracy lever, contributing +18.4 percentage points of exact-match gain over the schema-free baseline on both benchmarks. text2ql is publicly available at this https URL under the Apache 2.0 license.
61. 【2609.02108】Predict, Don't Iterate: Efficient Adaptive-Length Infilling for Diffusion Language Models
链接：https://arxiv.org/abs/2609.02108
作者：Haobo Xu,Sirui Chen,Yuanchen Bei,Lingjie Chen,Yuchen Yan,Dongqi Fu,Jingrui He,Hanghang Tong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Diffusion language models, Diffusion language, language models, auto-regressive paradigm, promising alternative
备注： Accepted at EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Diffusion language models (DLMs) have emerged as a promising alternative to the auto-regressive paradigm. With bidirectional attention and any-order generation, DLMs naturally fit infilling tasks, which require generating a middle span conditioned on both the prefix and the suffix. However, infilling is sensitive to the length of the span, while DLMs require the length to be fixed before generation. Although prior studies extend DLMs to dynamic lengths, they still suffer from two limitations. (i) Sensitivity to initial length. These methods require a preset length to initialize the search and are highly sensitive to this initial length, often yielding suboptimal results. (ii) Inference inefficiency. They either insert length-changing operations during generation or repeatedly search for an appropriate length using multi-step denoising confidence, both of which introduce substantial extra forward passes and computational cost. Therefore, we propose PILL (Probing-based InfiLling with preset-Length-free decoding), an efficient infilling method for DLMs that requires no preset initial length and adds far fewer extra forward passes than baselines, substantially reducing inference time. Experiments show that, across five DLMs spanning different families, architectures, and training recipes on eight infilling benchmarks, PILL improves over the strongest baseline by +4.8 average pass rate on code and +6.0 BLEU-2 on text, while running 1.82x faster than that baseline. The code is available at this https URL.
62. 【2609.02094】MASkills: Continual Skills Optimization for Multi-Agent LLM Systems
链接：https://arxiv.org/abs/2609.02094
作者：Huaiyuan Yao,Xiaoou Liu,Charles Fleming,Tianlong Chen,Hua Wei
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：shown strong performance, experience remains challenging, interaction experience remains, remains challenging, LLM-based multi-agent systems
备注： 14 pages, 4 figures
点击查看摘要
Abstract:LLM-based multi-agent systems have shown strong performance on complex tasks, yet continual improvement from interaction experience remains challenging. Existing self-reflection methods build experience memories, but memories are mostly hard to invoke, refine, or scale, while agent skills offer a more actionable unit: structured procedural knowledge that specifies when to act, how to act, and which resources or tools to use. We introduce MASkills, a continual learning framework that optimizes multi-agent LLM systems through agent skills. MASkills presents a new agent-optimization pipeline that integrates skill-conditioned credit assignment, hierarchical credit aggregation, and momentum-smoothed optimization, enabling agent skill libraries to evolve through refinement, induction, consolidation, and pruning. Experiments on HotpotQA, LoCoMo, and GAIA demonstrate the effectiveness of MASkills across multiple agentic tasks. Our code is available at this https URL
63. 【2609.02091】Selective Knowledge Edit Reversal via Gated Singular Vector Shrinkage
链接：https://arxiv.org/abs/2609.02091
作者：Weifeng Jiang,Ruirui Chen,Qianren Mao,Junnan Liu,Qili Zhang,Kwok-Yan Lam
类目：Computation and Language (cs.CL)
关键词：update factual knowledge, update factual, large language models, edited, factual knowledge
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:Knowledge editing provides an efficient way to update factual knowledge in large language models. However, malicious edits may introduce safety risks, making it necessary to reverse undesirable editing effects. Existing reversal methods for parameter-modifying edits mainly focus on global removal, which may also erase beneficial edits that should be preserved. In this paper, we study selective reversal of edited knowledge, where the goal is to reverse targeted edited facts while preserving the remaining edited facts. Based on the hypothesis that each edit is sparsely encoded within the dominant subspace of the edited matrix, we propose a spectral-based reversal framework that locates edit-sensitive components within the dominant singular subspace of edited weights. Experiments across multiple settings demonstrate the effectiveness of our method in reversing selected edits while preserving unrelated edited facts. These results suggest that different edits are sparsely encoded within dominant singular components and can be separable when the number of edits is moderate, making selective spectral reversal a promising direction for locating edit-specific components and repairing edited language models.
64. 【2609.02089】IDEEA: training-free Input-Dependent stEEring via Activation cluster matching
链接：https://arxiv.org/abs/2609.02089
作者：Zheng Wang,Muchen Li,Renjie Liao,Yan Leng
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：aligns large language, large language models, reinforcement learning, Steering aligns large, large language
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:Steering aligns large language models (LLMs) by injecting a bias into selected activations at inference time, offering a far cheaper alternative to weight-update methods such as supervised fine-tuning or reinforcement learning. However, most existing training-free steering methods are input-independent: a single direction is fitted once and shared across all inputs. This is fundamentally limiting as different inputs occupy different regions of the activation space and admit different optimal steering directions toward the same target concept, much as the gradient with respect to a fixed loss varies from input to input. We close this gap with IDEEA (Input-Dependent stEEring via Activation cluster matching), a training-free framework for input-dependent steering. IDEEA clusters the positive and negative activation supports per attention head, and solves an optimal-matching problem to construct a set of cluster-conditional directions, all about the target concept. At inference time, it picks from this pool of directions and uses the one that best matches the input's own activation for steering. IDEEA aligns the model toward the target concept while preserving the input's original representation, evidence that activations encoding a concept occupy several distinct sub-regions of the representation space rather than a single one. IDEEA improves the truth $\times$ info rate in TruthfulQA by an average of 9.9% (up to 23.5%) over the best input-independent baseline.
65. 【2609.02083】XMerge: Cross-Axis Selection and Reconstructive Layer Merging for LLM Depth Compression
链接：https://arxiv.org/abs/2609.02083
作者：Jundong Hu,Shekar Ramachandran
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Removing complete transformer, standard serving architecture, lose substantial quality, complete transformer layers, transformer layers preserves
备注： Preprint. Under review at a NeurIPS 2026 workshop. 21 pages total, 5 figures, 25 tables
点击查看摘要
Abstract:Removing complete transformer layers preserves a standard serving architecture, but existing depth-compression methods can lose substantial quality, and the loss varies unpredictably across models. We introduce XMerge, a post-training method with two components. Cross-axis selection identifies a block with low relative-magnitude and angular hidden-state change, and local boundary reconstruction re-fits the adjacent surviving block to match the original two-block output. XMerge uses no task labels or end-to-end fine-tuning, and it introduces neither architectural changes nor additional inference-time parameters. Across seven Llama and Qwen backbones (0.5B-8B), five published baselines, and three layer-reduction levels, its advantage over baselines is largest at the most aggressive removal: at k=4 it ranks first on six of seven backbones on CORE (a 22-task aggregate) and, separately, on six of seven on MMLU (five of seven on both at once), while avoiding the large perplexity increases of several competing operators. In a task-level bootstrap, the 95% confidence intervals for the three largest CORE margins exclude zero; the remaining margins are consistent with ties. Across the 14 (model, regime) cells it is also the only evaluated operator that never collapses, ranking top-2 in both zero-shot and in-context regimes; on a first calibration probe (one backbone) it is the best-calibrated operator. Ablations show that local reconstruction provides most of the gain, while cross-axis fusion helps when the two selection axes disagree. The additional construction cost is recovered through per-token decode savings after roughly tens of thousands of requests.
66. 【2609.02082】ransfer Safety Awareness for Cross-Modal Safety Drift in Multimodal Large Language Models
链接：https://arxiv.org/abs/2609.02082
作者：Tianqi Xiao,Shiyao Cui,Minghao Zhang,Junxiao Yang,Renmiao Chen
类目：Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Visual modality enhances, multimodal large language, benign textual query, convey harmful intent, visual image
备注： EMNLP Findings
点击查看摘要
Abstract:Visual modality enhances the capabilities of multimodal large language models (MLLMs) but also introduces a safety concern: a benign textual query may convey harmful intent when grounded in a visual image. We term this cross-modal safety drift and our pilot studies show that the safety response rate for such requests is substantially lower than that for requests containing explicitly unsafe text. This paper aims to systematically study this issue. First, we conduct an empirical analysis to identify representative unsafe response patterns. Building on these, we interpret model representations and attentions, revealing that visually risky cues receive limited attention and weakly trigger refusal. Motivated by the observation that safety signals from unsafe text processing can be transferred, we propose safety-awareness representation transfer (SRT), a lightweight direction-refinement method that mitigates cross-modal safety drift with a frozen MLLM backbone. Experiments across multiple benchmarks and models show that SRT effectively improves safety in diverse cross-modal settings while preserving utility. Code is available at this https URL.
67. 【2609.02056】HyGRAIL: Cost-Aware and Evidence-Grounded Scientific Hypothesis Discovery over Knowledge Graphs
链接：https://arxiv.org/abs/2609.02056
作者：Yihang Sun,Zhihan Zhu,Zhiyuan Jiang,Jingyi Ge,Zixuan Li,Jiaxuan You
类目：Computation and Language (cs.CL)
关键词：remain inherently incomplete, graphs organize entities, inherently incomplete, organize entities, entities and relations
备注：
点击查看摘要
Abstract:Scientific knowledge graphs organize entities and relations extracted from scientific literature, but they remain inherently incomplete. Missing typed links in such graphs can therefore represent plausible scientific hypotheses, such as unexplored associations between materials and applications. However, scientific hypothesis discovery is challenging because true discoveries are extremely sparse among typed candidate pairs: graph neural networks (GNNs) are efficient but unreliable for ambiguous cases, while large language models (LLMs) are knowledgeable but too costly to apply exhaustively and are not naturally grounded in graph structures. We propose HyGRAIL, a cost-aware and evidence-grounded framework that combines heterogeneous GNN triage with LLM-based hypothesis review. HyGRAIL first uses a GNN to score candidate hypotheses and identify a validation-calibrated ambiguous region, routing only graph-uncertain cases to LLM review. For each routed hypothesis, HyGRAIL retrieves node-level associations and multi-hop relational paths from the knowledge graph (KG), then converts this structured evidence into natural language through template-based or LLM-based naturalization. An LLM review agent finally judges each hard hypothesis using the naturalized evidence and validation-selected decision criteria. On MatKG, HyGRAIL achieves the best F1 score of 0.429, improving over the strongest prior baseline by 0.242 F1 points and over the GNN-only baseline by 0.322. Meanwhile, GNN triage reduces the LLM call rate by 54.36% on average. Ablation studies further show that retrieved graph evidence is crucial for reliable hypothesis verification and that compact, two-sided evidence is more effective than simply increasing retrieval quantity.
68. 【2609.02055】Privacy Washing: Detecting Internal Contradictions in Privacy Policies
链接：https://arxiv.org/abs/2609.02055
作者：Thomas Brackin
类目：Computers and Society (cs.CY); Computation and Language (cs.CL)
关键词：commitments are undermined, undermined by practices, practices documented, Privacy policies, website privacy policies
备注：
点击查看摘要
Abstract:Privacy policies may contain internal contradictions in which commitments are undermined by practices documented elsewhere in the same policy. We operationalize this phenomenon, privacy washing, through a four-stage pipeline: statement extraction, compatibility filtering and natural language inference screening, multi-model judge verification, and thematic analysis, with contradictions confirmed by majority vote of a three-model LLM panel. Applied to two corpora of website privacy policies, 123 collected in 2026 (OPPT) and 115 collected in 2015 (OPP-115), the pipeline finds the same category patterns recurring across the 11-year gap, with third-party sharing contradictions the majority of confirmed cases in each primary run, consistent with structural factors in policy composition rather than necessarily intentional deception. At least one panel-confirmed contradiction appears in 12.2% of OPPT companies (15/123; 9.8% excluding legacy pairs) and 36.5% of OPP-115 companies (42/115). A stability re-run seven months later, with a fully separated configuration (new extraction models, judges from three Chinese providers absent from both corpora, matched filters, no judge-submission similarity threshold), reproduces the OPPT prevalence under the original protocol (13.0% vs. 12.2%), finds sub-threshold pairs confirm at rates of the same order as those above (raising prevalence to 20.3% and 40.9%), and shows the third-party majority is panel-sensitive while the recurrence of the same category pairs is not. Two caveats govern all figures: panel verdicts are not validated against human expert judgment, so precision is unknown and prevalence figures are lower bounds; and the two primary runs used different filter configurations, so their prevalence difference is not interpretable as a corpus or era effect (the matched re-run reduces the gap to roughly twofold but does not eliminate it).
69. 【2609.02054】A Tri-Agent Framework for Evaluating and Aligning Question Clarification Capabilities of Large Language Models
链接：https://arxiv.org/abs/2609.02054
作者：Yikai Zhao,Saurabh Pandey,Pradeep Kumar Misra
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, Language Models, precisely is paramount, increasingly deployed
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) are increasingly deployed in interactive systems where understanding user intent precisely is paramount. A key capability for such systems is effective question clarification, especially when user queries are ambiguous or underspecified. This paper introduces a novel tri-agent framework for the robust evaluation of an LLM's ability to engage in clarifying dialogue. Our framework comprises three distinct LLM-based agents: (1) a Question Clarifying Agent (QCA), the system under evaluation, tasked with identifying ambiguities and posing clarifying questions; (2) a Respondent Agent (RA), designed to simulate human user responses, potentially including irrelevant or challenging replies; and (3) an Evaluator Agent (EA), an LLM-as-a-judge, which assesses the quality of the dialogue based on a comprehensive set of metrics. We detail a methodology for synthetic data generation in the supply chain domain as an example. We propose metrics evaluating ambiguity handling, question quality, dialogue efficiency, language appropriateness, and final intent alignment. We also briefly discuss the validation of the EA against human judgments. This work provides a structured approach to benchmark, validate, and improve the clarification capabilities of conversational LLM applications.
70. 【2609.02049】he Dynamics of Continuous Mixture Collapse in Language Models
链接：https://arxiv.org/abs/2609.02049
作者：Ali Backour
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：LLMs latent-state reasoning, discrete intermediate tokens, latent-state reasoning methods, reasoning methods replace, methods replace discrete
备注：
点击查看摘要
Abstract:LLMs latent-state reasoning methods replace discrete intermediate tokens with continuous states, such as weighted mixtures of token embeddings, to retain multiple possible reasoning directions rather than committing to one. Yet pretrained language models often fail to preserve these mixtures. We study why through a combination of theoretical analysis and controlled empirical investigations on a variety of models. We identify three independent, distinct sources of failure. First, transformer architectures already distort mixture geometry, and training substantially amplifies this effect. Moreover, the failure can occur even if the model transports mixtures perfectly linearly: the softmax readout and autoregressive feedback form a dynamical system that either amplifies small differences until one component of the mixture dominates or contracts different mixtures until they become indistinguishable. We verify this theoretical prediction empirically: the observed transition between contraction and amplification occurs near the theoretical threshold derived by our analysis, and pretrained-model rollouts lie predominantly on the amplifying side. Finally, we generalize to mixtures of many components and show that exact preservation generally requires context-dependent correction, whose required dimensionality can grow with the number of components.
71. 【2609.02015】How Output Format Confounds Data Quality and Capability in Instruction Tuning
链接：https://arxiv.org/abs/2609.02015
作者：Chengguang Gan,Hanjun Wei,Yunhao Liang,Qinghao Zhang,Shiwen Ni,Zhixi Cai
类目：Computation and Language (cs.CL)
关键词：judged by benchmarks, answer is written, Instruction-tuning data, judgments pass, judged
备注：
点击查看摘要
Abstract:Instruction-tuning data are judged by quality metrics, and tuned models are judged by benchmarks, but both judgments pass through an output interface: the surface format in which an answer is written. Using gradient signatures across 12 tasks, four semantically equivalent interfaces, three model families, and controlled corruptions, we show that this interface confounds both measurements. Spectral statistics such as effective rank are provably invariant to interface rotation and empirically blind to semantic corruption, while the direction of the update carries the quality signal. The interface-varying residual is not noise: it identifies each unit's own target task perfectly across all three families. Capability itself is stored relative to the training interface: a skill that raises accuracy by more than 40 points under the training format can be nearly invisible under every other, and correcting a single generation budget flips the measured effect of fine-tuning on GSM8K from a gain into a large loss. Pre-registered interventions delimit where this geometry stops short of control. Data quality and model capability are interface-conditioned quantities, and current practice often reports the interface instead of the content.
72. 【2609.02006】rain What You Deploy: Closing the MLP Reachability Gap in Low-Rank Clone Distillation
链接：https://arxiv.org/abs/2609.02006
作者：Wenhui Chen,Zhifeng Li,Jie Zhou,Navan Preet Singh,Madalina Ciobanu,Chenghua Wang,Qingqing Mao,Ritankar Das
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：full-width student MLP, compressed student, student MLP, weight family, student
备注：
点击查看摘要
Abstract:A compressed student has two shapes that need not agree: the weight it deploys at inference and the weight family its training can reach. We show that a state-of-the-art weight-inheritance distiller, Low-Rank Clone (LRC), deploys a full-width student MLP but ties training to a teacher-induced slice, leaving 62.5-81.4% of each deployed matrix's independent linear degrees of freedom unreachable-paid for at inference, never trainable. Our principle is one line: train what you deploy. From the identical LRC warm start, we make the training object the entire deployed matrix, with no change in deployed shape, deployed parameter count, or inference FLOPs, via two mergeable realizations (Dense-LRC and CORE-LRC) that both collapse to one deployed weight. This recovers stranded capacity: taking the stronger realization per teacher, +2.36/+2.71/+10.45 Avg9 over matched-budget plain-LRC baselines across three teachers (Llama3.2-3B, Llama3.1-8B, Qwen2.5-3B), with the largest gain on the widest teacher (Qwen), where it reaches the original recipe's approx. 20B-token accuracy at 10B tokens (2x token efficiency); there the strictly same-lineage arm still recovers +6.39, the fully controlled figure. Controls strongly support attributing the gain to the enlarged reachable set, rather than to added parameters or the recipe. From approx. 10B distillation tokens plus a short SFT, a half-parameter 1.5B student matches its approx. 9T-token teacher's 9-task macro-average, within evaluation noise and with a residual MMLU deficit, and a 2.7B student beats Meta's own official compression of Llama3.1-8B at ~900x fewer compression tokens (a token count under unmatched recipes, not a compute claim). All results are from single-seed runs on the LRC backbone.
73. 【2609.01971】NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysis
链接：https://arxiv.org/abs/2609.01971
作者：Wuche Liu,Yiran Qiao,Linlin Hou,Rui Yang,Shusen Pu,Song Wang,Jing Ma
类目：Computation and Language (cs.CL)
关键词：significant interdisciplinary barriers, rapidly advancing neuroscience, interdisciplinary barriers, rapidly advancing, laboratories fail
备注： Accepted to Findings of EMNLP 2026. 20 pages, 9 figures, 7 tables
点击查看摘要
Abstract:AI is rapidly advancing neuroscience, yet many laboratories fail to fully unleash its potential due to significant interdisciplinary barriers. While pre-trained neural models for physiological data are progressing quickly, their heterogeneous architectures and modality-specific constraints hinder systematic integration, selection, and evaluation. Despite recent advances in large language model (LLM)-based agent systems for intelligent scientific applications, existing approaches often still lack the domain expertise required to effectively select and coordinate diverse neuroscience pre-trained models and handle unique data types in this domain. We present NS-Copilot, an LLM-driven multi-agent system for neuroscience analysis that autonomously supports end-to-end workflows for diverse professional tasks. It unifies domain-specific pre-trained models and supports key neuroscience modalities, including EEG and extracellular spike data, through a natural-language interface. Given raw data and a task description, NS-Copilot orchestrates agents with specialized roles for planning, adaptive control, code generation, and result synthesis, enabling analysis without dataset-specific heuristics. We evaluate NS-Copilot on neuroscience benchmarks spanning Alzheimer's disease, Parkinson's disease, and working memory spike decoding. Across 8 trials per task, the system consistently outperforms strong baselines on the primary metric, demonstrating the ability of NS-Copilot for effective and scalable neuroscience analysis.
74. 【2609.01936】Sparse Readout Prism: Explaining Logit-Lens Scores in Features Instead of Tokens
链接：https://arxiv.org/abs/2609.01936
作者：Matteo He,William F. Shen,Xinchi Qiu,Nicholas D. Lane
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：language model prediction, decoding intermediate hidden, intermediate hidden states, lens methods track, readout
备注： 55 pages, 33 figures, 42 tables. Under review. Code: [this https URL](https://github.com/hematteo/sparse-readout-prism) Dictionaries: [this https URL](https://huggingface.co/hematteo/sparse-readout-prism)
点击查看摘要
Abstract:A language model's prediction of its next token develops across layers, and lens methods track this process by decoding intermediate hidden states into tokens. But a lens reading reflects both the hidden state and the readout (the unembedding matrix) used to decode it. Many lenses are fit on a corpus, and we show that two lenses differing only in their fitting corpus can report different tokens for the same hidden states. We call this dependence corpus conditionality. To examine readout structure independently of the fitting corpus, we introduce Sparse Readout Prism (SRP), which decomposes the readout using only its weights and expresses any token logit or logit difference as a sum of contributions from sparse readout features. This reveals readout features as a new unit of analysis for lens readings, exposing structure that token identities can obscure and enabling comparisons across tokens, contexts, layers, and lenses. Replacing the original readout with SRP's sparse approximation reconstructs 8.9-17.3 percentage points more of the tested logit differences than the strongest of six baselines built on geometric relations among readout rows. Ablating features shifts logit differences in proportion to their SRP contributions. Although token readings vary with the fitting corpus, the dominant readout feature remains stable. Because SRP uses no corpus in its construction, it provides a control independent of the fitting corpus for lens analyses.
75. 【2609.01925】CRISP: Cliff-awaRe Input-adaptive Sparse Prefilling with Structural-Mass-Motivated Routing
链接：https://arxiv.org/abs/2609.01925
作者：Huu Huy Nguyen,Chien Van Nguyen,Franck Dernoncourt,Ryan A. Rossi,Linh Ngo Van,Jieyang Chen,Thien Huu Nguyen
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：long-context LLM inference, LLM inference scales, inference scales quadratically, severe computational bottleneck, long-context LLM
备注： Accepted to EMNLP 2026 (Main Conference). 16 pages, 7 figures, 12 tables
点击查看摘要
Abstract:The attention prefilling phase of long-context LLM inference scales quadratically, making self-attention a severe computational bottleneck. Traditional sparse attention methods mitigate this through fixed patterns or offline profiling, but lack the flexibility to adapt to input-dependent attention structure. Recent dynamic methods address this by routing heads to sparse patterns in real-time, but rely on indirect routing proxies with overhead and budget allocation mechanisms that overlook the post-softmax mass hierarchy. We present CRISP (Cliff-awaRe Input-adaptive Sparse Prefilling), which identifies and addresses two structural challenges in this dynamic routing paradigm. First, we show that the routing decision can be read directly off the structure of the proxy attention map. We replace the Jensen-Shannon Divergence (JSD) routing with C_struct, a structural proxy that measures mass at Vertical-Slash compatible positions and reproduces JSD's routing decisions while eliminating both the pooled matmul and subsequent KL divergence overhead. Second, we formalize the post-softmax mass cliff and demonstrate theoretically that strictly cumulative coverage thresholds accumulate O(n) background noise at long contexts. CRISP navigates this via a sink-aware threshold grounded in the noise floor. Empirically, across InfiniteBench, RULER and LongBench on two model families, CRISP is the strongest sparse method overall and matches or exceeds exact dense attention on retrieval-heavy benchmarks, recovering up to +28.0 pp on retrieval tasks over baselines and achieving up to a 5.30x attention speedup at 512k tokens, driven primarily by our O(n) noise elimination during selection while preserving structural integrity.
76. 【2609.01918】Grounded, Compute-Efficient LLM Policy Agents for Energy-Poverty Equity in Physically-Constrained Peer-to-Peer Energy Markets
链接：https://arxiv.org/abs/2609.01918
作者：Kunal Jadhav,Siddhesh More
类目：Computation and Language (cs.CL)
关键词：carbon-intensive cloud LLMs, Dynamic Operating Envelopes, LLM policy agent, open-weight LLM policy, computational irony
备注： 9 pages, 2 figures, 4 tables. Accepted to the 5th Workshop on NLP for Positive Impact (NLP4PI) at EMNLP 2026
点击查看摘要
Abstract:Energy poverty is nearly absent from NLP-for-social-good, and the little existing work is either static retrieval/QA or relies on carbon-intensive cloud LLMs, a self-defeating "computational irony" for a humanitarian setting. We present EqGrid, a closed-loop simulation in which a low-frequency, open-weight LLM policy agent sets price and carbon bounds and targeted subsidies over a community of empirically-grounded household personas, while high-frequency multi-agent RL traders clear a continuous double auction constrained by a physical distribution grid (IEEE-33-bus with Dynamic Operating Envelopes). Our contribution is threefold and directly addresses how to measure the social impact of AI: (i) grounded personas (region-matched socio-demographics) whose load curves are checked for shape and level realism against real smart-meter data; (ii) formal energy-poverty equity metrics (Energy Burden, Gini of EB, LIHC) showing the intervention reduces burden inequality without raising net grid cost; and (iii) a compute-efficiency frontier that measures how much equity performance survives compressing the policy agent from a 235B teacher down to a sub-1B model deployable on a laptop, in estimated energy/carbon per decision. A decoupled-safety design (the LLM sets bounds; a validate-and-project grid gate executes) yields zero grid-constraint violations versus 55 under direct LLM control. On energy-poverty equity, the LLM policy lowers the Gini of energy burden to 0.305 (from 0.351) and mean burden by 28% while cutting cost (outperforming a tuned rule baseline), and a 3B-active model retains 95% of the benefit at roughly 9x lower inference energy than the teacher, with even a 0.8B on-device model retaining 92% at roughly 24x lower energy. We will release code and configs.
77. 【2609.01902】Accurate in space, unreliable in time: how LLMs represent national cultural change
链接：https://arxiv.org/abs/2609.01902
作者：Yalda Daryani,Miranda Bogen,Madeleine I. G. Daepp
类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, development and improvement, improvement of large, large language, cultural
备注： 38 pages, 12 figures, 36 tables; includes Supplementary Materials
点击查看摘要
Abstract:Assessments of cultural alignment have become an important part of the development and improvement of large language models (LLMs). However, the majority of the evaluations treat culture as a single snapshot, investigating only whether a model represents a society accurately at the current time. Research in cultural psychology shows that cultural values change at different rates and directions over time. Therefore, a "culturally aware" model should capture not only where a culture is today but also how it has changed over time. We examine this missing dimension of cultural awareness using more than two decades of the World Values Survey data. We compare the cultural trajectories of 40 countries with the trajectories produced by four state-of-the-art (SOTA) LLMs on the Inglehart-Welzel cultural map. Our findings show that while models generally place countries close to their most recent surveyed positions, these representations tend to lag several years behind that position. They also capture only part of the magnitude of the observed change, introduce movement where little occurred, and rarely reproduce reversals in countries' trajectories. These findings point to temporal flattening and suggest that snapshot accuracy can give an incomplete picture of cultural awareness in LLMs and have implications for model evaluation, representational harms, and the governance of culturally aware AI systems.
78. 【2609.01878】GAPS: Dimension-Level Gates for Conditional Activation Steering
链接：https://arxiv.org/abs/2609.01878
作者：Moghis Fereidouni,Muhammad Umair Haider,Hassan Sajjad,A.B. Siddique
类目：Computation and Language (cs.CL)
关键词：suppresses undesired behaviors, Activation steering suppresses, state during generation, Gated Activation steering, behaviors in language
备注：
点击查看摘要
Abstract:Activation steering suppresses undesired behaviors in language models by adding a steering vector to the hidden state during generation. Recent conditional methods such as CAST and DSAS improve the behavior-capability trade-off by deciding when to intervene, but once active, they apply the full dense vector to all hidden dimensions, regardless of whether a neuron carries concept information or already lies in the desired regime. We introduce dimension-level conditioning as a complementary axis of selectivity that also decides which neurons to intervene on. Our method, GAPS (Gated Activation steering via Posterior and Separability), combines two training-free gates: a static separability gate that restricts steering to neurons with statistically reliable concept information (via AUROC), and a dynamic posterior gate that steers a neuron only when its current activation is better explained by the undesired concept under a Gaussian model. The gates add O(D) overhead per token, and they plug into existing conditional methods. On toxicity mitigation (RealToxicityPrompts) and concept removal (OneSeC) with Gemma-3 (4B) and Qwen-3 (1.7B), GAPS consistently matches or improves the Pareto front of its token-level counterparts; under a fixed capability budget, DSAS+GAPS reduces Gemma-3's toxicity rate from 6.52% to 0.48%, versus 3.52% for DSAS alone. Ablations attribute most of the gain to the posterior gate.
79. 【2609.01867】hinking effort aligns between humans and reasoning models in abductive reasoning
链接：https://arxiv.org/abs/2609.01867
作者：Henry Arthur
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：cognitive modeling concerns, large language models, major question, question in cognitive, cognitive modeling
备注： 14 pages, 5 figures. To appear in Findings of EMNLP 2026
点击查看摘要
Abstract:A major question in cognitive modeling concerns the behavioral alignment between large language models and humans across linguistic and non-linguistic tasks. Unlike standard LLMs, large reasoning models (LRMs) are optimized with reinforcement learning from verifiable rewards, encouraging correct solutions to reasoning tasks rather than preference-aligned responses. Recent work (de Varda et al., 2025) investigates the cost of thinking in humans and LRMs by comparing human reaction times with model reasoning traces across a range of reasoning tasks. We isolate this alignment by turning to abductive reasoning: unlike deductive tasks, its difficulty cannot be inferred from formal structure and offers no shortcuts a model could exploit to mimic effort without genuine search, providing firmer ground for empirical claims of shared effort. We find further evidence of alignment between LRM and human reasoning effort, as well as evidence that models and humans tend to make similar errors. Finally, we show that decoding methods that let models explore multiple reasoning paths increase alignment in reasoning cost between humans and LRMs across the three models tested.
80. 【2609.01865】ExecRetrieval: Measuring the Functional-Correctness Gap in Code-Embedding Retrieval
链接：https://arxiv.org/abs/2609.01865
作者：Aaryan Kapoor,Md Abdullah Al Hafiz Khan
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Embedding-based code retrieval, retrieving lexically similar, retrieval-augmented code generation, lexically similar code, retrieving correct code
备注： Accepted to EMNLP 2026 (Main Conference). Camera-ready version. 17 pages, 6 figures, 8 tables
点击查看摘要
Abstract:Embedding-based code retrieval is a core component of coding agents and retrieval-augmented code generation, where retrieving correct code matters more than retrieving lexically similar code. Existing code-retrieval benchmarks do not plant controlled, execution-verified single-edit variants of each query's canonical implementation in the search pool, leaving the question of whether embeddings can functionally discriminate correct from near-clone-but-incorrect code unanswered in a retrieval setting. Resolving this requires a benchmark whose search pool itself contains the relevant counterfactuals -- execution-verified buggy variants near-identical to each canonical -- so that a retriever's rank ordering can be directly tested for functional discrimination rather than topical or identity overlap. We introduce ExecRetrieval, 939 Python tasks each paired with one execution-verified canonical implementation and up to four execution-verified buggy distractors, each generated by a mechanical mutation making a single targeted edit, and evaluate 23 dense embedding configurations plus BM25 under provider-native invocation with paired McNemar tests and query-level bootstrap intervals. With near-clone counterfactuals in the pool, the top hosted system reaches exec@10 = 1.00 but only exec@1 = 0.331; rank-1 misses are paired buggy variants 91.5-99.4% of the time across the four leading systems, and the canonical scores below at least one of its four paired distractors in 67-78% of queries on the leading systems. The full dataset, execution oracle, embedding matrices, environment snapshot, and pairwise statistical tests are released at the URL in Appendix D.
81. 【2609.01852】he Memory Trust Gap: Capability-Dependent Failures in Persistent-Memory Agents
链接：https://arxiv.org/abs/2609.01852
作者：Jundong Hu,Shekar Ramachandran
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Persistent memory supports, supports personalized agents, memory supports personalized, Persistent memory, personalized agents
备注： Preprint. Under review at a NeurIPS 2026 workshop. 14 pages, 7 figures, 11 tables
点击查看摘要
Abstract:Persistent memory supports personalized agents, but a stale stored fact can override current authoritative evidence without warning. We study when this harm begins as model capability changes. We evaluate a frozen, closed-set, action-scored benchmark with 2 suites that represent 2 different meanings of "no memory" (a Benefit suite, unsolvable without the stored fact, and a Safety suite, in which an authoritative tool always holds the correct value), on a same-family model-size series (Qwen3 0.6/1.7/4/8B). The Memory Trust Gap reflects over-trust rather than confusion. In the Benefit suite, models answer with the stale value 0.92-1.00 of the time at every scale. In the Safety suite, harm below the no-memory baseline under the trap conditions ($\Delta_{\mathrm{mem}}$) is capability-gated, with the larger models collapsing most once a stale note is made to look current. In a $2\times2\times2\times2$ factorial, which feature triggers over-trust depends on both the feature and model scale. Removing a label amplifies over-trust at every size, and a recency feature (stale dated newer) fools the larger models harder. Source authority is weak and scale-flat, and position changes from positive to negative across the Qwen3 model-size series. We confirm these scale interactions with direct cross-size contrast tests rather than overlapping per-model intervals. Mitigation is likewise capability-dependent: exposing metadata improves accuracy for the capable models, but only pre-resolving the conflict restores accuracy for the 2 smaller checkpoints. The same pattern appears on the capable models in an independent Llama-Instruct model-size series and on 2 external datasets (RGB, MisBench). A framing control finds no consistent advantage for the memory label: at the 3 smaller scales, models trust a stale document more than a stale memory; at 8B, the difference is not significant.
82. 【2609.01846】Cite or Decline: A Strict Course-Grounded Chatbot for STEM Lecture Videos
链接：https://arxiv.org/abs/2609.01846
作者：S M Masrur Ahmed,Jaspal Subhlok
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：Recorded lecture videos, standard study resource, Recorded lecture, enhanced with search, search and summarization
备注： To appear in the Proceedings of the 2026 Conference on EMNLP 2026, Industry Track
点击查看摘要
Abstract:Recorded lecture videos, often enhanced with search and summarization features, are a standard study resource. However, students cannot easily ask course specific questions or verify answers against an instructor's lecture. We report a semester-long deployment of VideoPoints platform with a retrieval-augmented chatbot that answers from course lecture materials and returns timestamped citations. The chatbot retrieves only from the active course, uses chapter summaries to guide transcript ranking, and returns clickable timestamped citations. Students used it for quick lookups and exam review. Across 833 messages, 70.5% included citations, none crossed a course boundary, and when no lecture evidence matched, the chatbot usually declined rather than answering. Among the users, citations were the most consistently useful feature, while practice-question generation was the strongest unmet request. We also evaluated the design on the real-world test split of EduVidQA, a public multimodal benchmark for lecture-video question answering. Our design improved correct-lecture retrieval by 6.3 percentage points over dense-only retrieval. Together, the results show that effective deployment depends on course isolation, supported citations, and alignment with students' study practices.
83. 【2609.01833】Candidate Generation and Definition-Guided Verification for Sentence-Level Depression Symptom Recognition
链接：https://arxiv.org/abs/2609.01833
作者：Weiming Li,Catarina Barata,Miguel Constante,Joao Sanches
类目：Computation and Language (cs.CL)
关键词：Sentence-level recognition, challenging because similar, similar expressions, expressions can differ, language-model inference
备注：
点击查看摘要
Abstract:Sentence-level recognition of depression symptoms is challenging because similar expressions can differ in symptom relevance, and language-model inference is insufficiently grounded in diagnostic definitions. This study proposes a two-stage framework separating symptom-candidate generation from definition-grounded verification. A contrastively fine-tuned sentence encoder generates a symptom candidate per sentence, and a fine-tuned language model verifies whether the candidate is present or absent using the sentence, its context, and a candidate-specific diagnostic definition, checking its judgment against that definition before answering. Evaluated against encoder, inference-based, medical, and general LLM baselines and a matched single-stage supervised classifier, the proposed pipeline attains the best accuracy and F1 scores of all methods, with rationales matching expert-authored annotations. A preliminary clinical audit indicates moderate alignment with diagnostic definitions, with explanation quality strongly dependent on prediction correctness. The results support decomposing symptom recognition into candidate generation and definition-grounded verification, though performance remains limited for rare categories.
84. 【2609.01832】Interpretable Symptom Vectors for Depression in a Large Language Model
链接：https://arxiv.org/abs/2609.01832
作者：Fangyi Zhu,Ajay Subramanian,Allison Constant,Camille Wang,Ravish Gupta,Corey J. Keller
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)
关键词：practice routinely reduces, diverse symptom profiles, clinical practice routinely, single severity score, present with diverse
备注： 26 pages, 6 figures
点击查看摘要
Abstract:Patients with depression present with diverse symptom profiles, yet clinical practice routinely reduces this variation to a single severity score. Large language models (LLMs) can potentially capture various symptoms and their severity from patient speech. However, how depressive symptoms are represented inside LLMs remains poorly understood, limiting clinical trust. To examine whether internal model activations match clinician judgment, we analyzed the residual stream of Gemma-3-27B-PT using mechanistic interpretability techniques. Recording activations across symptom descriptions drawn from validated clinical instruments, we found that symptom groups geometrically separated the most at layer 21 across multiple distance metrics. Using Semantic Projection, we then projected held-out naturalistic text onto Symptom Vectors constructed from these instruments. The resulting per-symptom coefficients preserved clinician-annotated rank ordering across mood, somatic, and suicidality axes. Furthermore, a single depression vector in Layer 21 separates held-out depressive from non-depressive text (AUC = 0.789), which can be used as an emotional valence gate that restricts symptom projection to depressive speech. These results reveal a decorrelated, clinician-aligned symptom signal readable directly from internal activations, offering a mechanistic foundation for interpretable depression-assessment tools.
85. 【2609.01828】AVERT: Audio-Verified Adjudication for Spoken Dialogue State Tracking
链接：https://arxiv.org/abs/2609.01828
作者：Chunggi Lee,Hanspeter Pfister
类目：Computation and Language (cs.CL)
关键词：ASR errors concentrate, dialogue state tracking, state tracking recovers, tracking recovers slot-value, recovers slot-value pairs
备注：
点击查看摘要
Abstract:Spoken dialogue state tracking recovers slot-value pairs from speech, where ASR errors concentrate in entity values and persist across turns, making it both a generation and an editing problem. A strong per-turn text editor corrects much of this but, operating on the transcript alone, leaves three recoverable errors: a value predicted inconsistently across turns, an omitted slot, and a value the audio does not support. We present AVERT, which scores each candidate value by combining cross-turn agreement with a trained audio-conditioned verifier and resolves the three error types with three operators, vote, add, and swap, each restricted to the slots where its error is common. On SpokenWOZ, a base speech-LLM reaches 33.04 JGA, a text editor 38.34, and AVERT 40.13, without retraining either. This is in the range of a 1B end-to-end system that consumes the full spoken history (39.32), though AVERT uses two 1B decoders rather than one. The audio verifier contributes a statistically significant gain, and restricting each operator to a selected slot subset matters: removing it lets unrestricted voting overwrite correct categorical values and fall below the editor.
86. 【2609.01810】alkFa: A Unified Benchmark for Farsi Dialogue Generation and Understanding
链接：https://arxiv.org/abs/2609.01810
作者：Neda Jamshidi,Kamyar Zeinalipour,Fahimeh Akbari,Monica Bianchini,Marco Maggini,Marco Gori
类目：Computation and Language (cs.CL)
关键词：million people, lacks a comprehensive, dialogue generation, native Farsi speakers, dialogue
备注：
点击查看摘要
Abstract:Farsi, spoken by more than 120 million people, lacks a comprehensive benchmark for dialogue generation and understanding. We introduce TALKFA, a unified benchmark comprising three complementary datasets: (1) WIKI-FADIAL, 4.2K Wikipedia-grounded dialogues for knowledge-grounded generation; (2) DAILYDIALOG-FA, 6.6K dialogues annotated for dialogue acts and emotions; and (3) PLAYDIAL-FA, 2.1K theatrical dialogues with sentiment labels. While LLMs assist data construction, every dialogue undergoes multi-stage review and revision by native Farsi speakers, and only the final human-approved dialogues are released. Experiments with six LLAMA and MISTRAL models show that LoRA substantially improves dialogue generation while requiring only 25-50% of the training data to recover over 90% of the final performance gains. Across classification tasks, FABERT achieves the best dialogue-act performance, LORA-MISTRAL-7B performs best on emotion recognition, and MISTRAL-24B achieves the highest sentiment score. Human evaluation and independent external validation demonstrate the reliability of the benchmark, while comparisons with GPT-4.1 as an LLM judge reveal that automatic metrics substantially overestimate dialogue quality. Zero-shot evaluation with frontier LLMs further shows that TalkFa remains a challenging benchmark. We will release all datasets, annotation guidelines, code, and checkpoints.
87. 【2609.01798】How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?
链接：https://arxiv.org/abs/2609.01798
作者：Wei Hu,Xiaolong Tu,Dawei Chen,Yitao Chen,Kyungtae Han,Haoxin Wang
类目：Computation and Language (cs.CL)
关键词：Large language models, key deployment constraint, Large language, design remains underexplored, making energy efficiency
备注： Accepted to the EMNLP 2026 Main Conference; camera-ready version
点击查看摘要
Abstract:Large language models (LLMs) are increasingly deployed on mobile devices, making energy efficiency a key deployment constraint, yet the energy impact of prompt design remains underexplored. This paper aims to understand how two prompt properties, cognitive load and phrasing pattern, shape the energy behavior of on-device LLM inference. We conduct a broad empirical study covering prompt properties, datasets, models, and devices, with phase-level profiling that separates prefill and decode energy. We find that cognitive load primarily affects the energy cost per token, while phrasing pattern affects energy largely through token usage. Our energy-quality analysis further shows that prompt design reshapes the attainable frontier differently across models, highlighting the need for model-aware prompt design in energy-efficient on-device LLM inference. Code, datasets, and scripts are available at this https URL.
88. 【2609.01794】Disentangling Statistical Preemption from Entrenchment in Language Models' Avoidance of Overgeneralization
链接：https://arxiv.org/abs/2609.01794
作者：Yixuan Wang,Freda Shi,Kanishka Misra
类目：Computation and Language (cs.CL)
关键词：Tom laughed, explicit negative evidence, negative evidence, evidence, indirect negative evidence
备注： Accepted to EMNLP 2026 Main
点击查看摘要
Abstract:How do learners avoid overgeneralizations such as Tom laughed me without explicit negative evidence? Constructionists have posited two proposals that describe indirect negative evidence against overgeneralizations: preemption (which privileges exposure to near-synonymous construction---e.g., she made him laugh) vs. entrenchment (all exposures to a verb's grammatical usages, including cases like He laughed). We disentangle these hypotheses by running controlled rearing experiments on LMs trained on child-caregiver conversations, where we systematically remove preemptive vs. non-preemptive evidence. We find that while LMs avoid overgeneralizations, they do not show preemption at a verb-specific level, instead showing weak but non-zero evidence of abstract preemption. Combined with results from analyzing the LMs' training dynamics, we find that LMs treat competing structures as indirect positive---as opposed to negative---evidence in the verb-specific condition. Insofar as preemption is the more plausible route to avoiding overgeneralizations in humans, our results point the need for there to be sensitivities to indirect negative evidence in neural network learners, and suggest new human experiments to test abstract preemption.
89. 【2609.01788】VakyArth: Evaluating Pragmatic Competence in LLMs across Indic Languages
链接：https://arxiv.org/abs/2609.01788
作者：Usneek Singh,Poorvaja Veera Balaji Kumar,Parth Nanda,Anand Madhusoodanan,Geyang Guo,Wei Xu,Junyi Jessy L
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Real-world communication, requires pragmatic reasoning, interpreting meanings implied, stated literally, communication often requires
备注： Findings of EMNLP 2026
点击查看摘要
Abstract:Real-world communication often requires pragmatic reasoning: interpreting meanings implied through context and cultural convention rather than stated literally. Existing pragmatic evaluation remains largely limited to English and high-resource languages, leaving Indic languages unexplored despite their linguistic and cultural diversity. We introduce VakyArth, the first pragmatic benchmark for Indic languages, designed as a diagnostic evaluation covering Hindi, Punjabi, Tamil, and Malayalam. VakyArth evaluates models across five phenomena: deixis, speech acts, implicature, social pragmatics, and coherence; through multiple-choice questions, natural language inference, and translation, with all items authored by native speakers. Across multilingual large language models (LLMs) of varying families and sizes, we find consistent failures on pragmatic meanings rooted in Indic linguistic and cultural conventions. Our analysis shows systematic differences across languages and tasks: MCQ accuracy exceeds NLI accuracy in all model-language combinations, translation performance does not reliably track pragmatic understanding, and Indo-Aryan languages show a translation advantage over Dravidian languages. We further show that automatic translation metrics can miss fluent but pragmatically unfaithful outputs, especially for implicature and deixis.
90. 【2609.01772】MemeCULT-1K: Benchmarking South Asian Cultural Context and Humor Understanding of Multimodal Models
链接：https://arxiv.org/abs/2609.01772
作者：Tawsif Tashwar Dipto,Mehedi Ahamed,Radib Bin Kabir,Mueeze Al Mushabbir,Mohammed Saidul Islam,Mir Rayat Imtiaz Hossain,Md Tahmid Rahman Laskar,Sabbir Ahmed
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：recognizing visual content, South Asian memes, requires implicit cultural, literal text, implicit cultural knowledge
备注： Accepted by EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Meme understanding goes beyond recognizing visual content or literal text; it requires implicit cultural knowledge and pragmatic inference that most vision-language models still lack. We introduce MemeCULT-1K, a multilingual benchmark of 1,000 South Asian memes in Bengali, English, and Hindi, where each meme is paired with a cultural context note and three human-written explanations, along with a supplementary set of 54 Bengali regional dialect memes. We evaluate thirteen popular Vision Language Models (VLMs) under two settings: meme-only and context-aware. Providing minimal cultural context yields consistent gains across all models and languages: mean SBERT similarity improves from 44.6 to 56.4 (+11.8), BLEURT from 37.3 to 42.3 (+5.0), and LLM-as-a-Judge scores from 2.57 to 3.43 out of 5 (+0.86). Fine-grained error analysis reveals that closed-source models fail mainly on entity and reference misidentification, while open-source models are bottlenecked by broader cultural knowledge gaps, with linguistic and phonological failures proving the most context-resistant across both. These results highlight the difficulty of culturally grounded meme understanding and motivate future work on explicit cultural knowledge integration. Our dataset and code are publicly available at TawsifDipto17/MemeCULT-1K.
91. 【2609.01741】When Can a Machine Trust a Statute? A Survival Certificate for Machine-Extracted Legal Logic
链接：https://arxiv.org/abs/2609.01741
作者：Surya Saka
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：independently written extractors, written extractors diverge, parsers disagree, increasingly parsed, parsed by machines
备注： 18 pages, 9 figures, 13 tables (6 main text, 7 appendix). Code, data products, and preregistration to be released on GitHub
点击查看摘要
Abstract:Statutes are increasingly parsed by machines before people read them, and the parsers disagree: on Missouri's statutes, two independently written extractors diverge on numeric-threshold presence at a false-negative rate of 0.43. We ask what formal logic survives such noise. We build a passive survival certificate for the Duquenne-Guigues implication basis of machine-extracted statutory contexts: per-attribute inter-extractor disagreement is measured, replayed against the basis in 1,000 Monte Carlo trials, and an implication is certified only when a one-sided Wilson 95% lower bound on survival reaches 0.95; every certified implication carries premise spans and a minimal counterexample. On 29,365 Missouri sections and 502 Indian central-Act sections, the preregistered held-out gate passes (10 statute families across 7 Titles exact; 16 across 11 with 5% tolerance), yet under one globally deployed error model 93.2% of held-out chapters fall below the informativeness floor, and a 2x2 factorial assigns that to calibration-rate transfer, not selection. The certificate is usable but fragile: deploy it per-chapter-calibrated or error-tolerant. Code, data products, and the audit trail, including one retracted claim, are released.
92. 【2609.01737】SpeakPay: Domain-Adaptive LoRA Fine-Tuning of Whisper for Low-Resource Nepali Financial Speech Recognition
链接：https://arxiv.org/abs/2609.01737
作者：Biraj Subedi
类目：Computation and Language (cs.CL)
关键词：visually impaired users, Mobile payment applications, Mobile payment, Nepal are graphically, impaired users
备注： 12 pages, 2 figures. Code, dataset, and model weights: [this https URL](https://github.com/subedibiraj/speakpay)
点击查看摘要
Abstract:Mobile payment applications in Nepal are graphically mediated and largely inaccessible to visually impaired users. This paper presents SpeakPay, a voice-first digital wallet, and documents the central technical contribution: a controlled study of domain adaptation for low-resource financial speech recognition. We introduce NepFinSpeech-403, a 403-utterance dataset of Nepali financial voice commands (send, load, and balance operations spanning 237 unique numerals), and fine-tune Whisper large-v2 with LoRA. On the held-out test set, the domain-adapted model reduces Word Error Rate from 129.95% (zero-shot baseline) to 42.58% --- a 67.2% relative reduction --- and improves Devanagari numeral recognition accuracy from 0.0% to 73.9%. We find that word-level metrics understate the practical task-level impact: domain adaptation improves the Transaction Success Rate from 1.67% to 33.33%, a roughly 20x gain. The improvement is consistent at the individual-utterance level (sign test, $p 10^{-17}$) and across all command types. A data efficiency analysis shows that as few as 100 domain-specific utterances are sufficient to halve the zero-shot WER, with performance plateauing around 300 examples. Error analysis reveals systematic numeral confusion patterns (zero insertion/deletion, prefix hallucination) that account for the majority of remaining transaction failures. The trained system is deployed as a publicly accessible voice-first web application. All code, dataset, model weights, and this paper are released at this https URL.
93. 【2609.01736】Harness Engineering in LLM Tool Use via Agent-Native Reusable Tool Primitives
链接：https://arxiv.org/abs/2609.01736
作者：Haibo Jin,Suijin Wang,Xucheng Yu,Haojing Luo,Haohan Wang
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：demonstrated remarkable capability, textbf, Tool Primitives, large tool catalogues, tool
备注： 21 pages
点击查看摘要
Abstract:Large language models (LLMs) augmented with external tools have demonstrated remarkable capability in solving complex real-world tasks. However, existing approaches suffer from two key challenges: brittle multi-step and multi-turn reasoning caused by incompatible tool output types and API schemas, and performance degradation under large tool catalogues. To address these, we introduce \textbf{Tool Primitives}, a design that replaces rigid API schema-based invocation with natural language as the interface for tool calling, where each tool is wrapped with an LLM interface that handles schema resolution and execution internally, enabling natural inter-tool communication for nested and multi-turn tool calling. Building on Tool Primitives, we host \textbf{ToolFace}, a centralized repository of 25,519 functions from which LLMs dynamically retrieve only the relevant tools at inference time, eliminating the need to enumerate raw API schemas in context. To orchestrate Tool Primitives and ToolFace reliably in complex settings, we further propose \textbf{HEART}, a \textbf{H}arness \textbf{E}ngineering framework via \textbf{A}gent-native, \textbf{R}eusable \textbf{T}ool Primitives, comprising a Planner, Router, and Verifier that jointly support dynamic tool invocation planning, multi-step execution, and feedback-driven recovery. Experiments on five benchmarks demonstrate that HEART outperforms SFT-based models by $10\%$ on average and surpasses GPT-5.4, Claude-4.6-Sonnet, and Gemini-3.1-Pro by $6\%$ on average while reducing API cost by up to $85\%$. On 50 real-world tasks, HEART achieves $84\%$ task completion, $3.8\times$ the average of three frontier commercial models ($22\%$).
Comments:
21 pages
Subjects:
Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
Cite as:
arXiv:2609.01736 [cs.SE]
(or
arXiv:2609.01736v1 [cs.SE] for this version)
https://doi.org/10.48550/arXiv.2609.01736
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
94. 【2609.01687】Learning Evidence Sufficiency Boundaries for Selective Answering in Grounded Multi-Hop QA
链接：https://arxiv.org/abs/2609.01687
作者：Haruto Sato,Yuki Tanaka,Ren Nakamura,Aoi Kobayashi,Mei Ito
类目：Computation and Language (cs.CL)
关键词：supplied evidence supports, Evidence Sufficiency Boundary, Sufficiency Boundary Training, evidence sufficiency, evidence
备注：
点击查看摘要
Abstract:Grounded question answering systems should answer only when the supplied evidence supports the answer. In multi-hop QA, this requirement is difficult because partial evidence can make an unsupported answer appear plausible. We study selective answering through evidence sufficiency boundaries: for the same question, a model should abstain under unsupported or partially supported context, answer when the context first becomes sufficient, and keep the answer stable when redundant evidence is added. We introduce Evidence Sufficiency Boundary Training, a generation-native training framework that constructs ordered evidence chains and supervises the abstain-to-answer transition directly. The method combines level supervision, a boundary flip margin, post-boundary stability, and answer recall protection. We build evidence chains from HotpotQA, 2WikiMultiHopQA, and MuSiQue, then evaluate models with chain metrics, raw QA utility, and unsupported-answer rates on external non-answerable sets. With Qwen2.5-3B-Instruct and LoRA adaptation, Evidence Sufficiency Boundary Training gives the strongest boundary localization among the tested systems, with flip accuracy of 0.807 compared with 0.781 for a token-level abstention baseline. It also achieves the lowest overall unsupported-answer rate on external non-answerable evaluation, 0.095 compared with 0.101 for the same baseline, while retaining competitive raw QA F1. The results show that grounded selective answering improves when training marks the evidence level where refusal should give way to answering.
95. 【2609.01671】Ranked by the Matcher: A Reproducibility Audit of Knowledge Graph Extraction from Threat Reports
链接：https://arxiv.org/abs/2609.01671
作者：Safayat Bin Hakim,Houbing Herbert Song
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：researchers choose knowledge-graph, Security teams, choose knowledge-graph extraction, knowledge-graph extraction tooling, strength of published
备注： Code and configurations are available at [this https URL](https://github.com/sbhakim/CTIForge)
点击查看摘要
Abstract:Security teams and researchers choose knowledge-graph extraction tooling for threat reports on the strength of published triple-F1 scores, yet those scores depend on how predicted triples are matched to gold annotations. We could reimplement the stated matching rule for only five of twelve inspected systems. Re-scoring ten system outputs on shared documents under eight protocols reverses eleven of forty-five pairwise orderings; one fixed prediction set spans 0.16-0.70 F1. On GRID's external 378-item calibration set, no mechanical matcher (lexical, embedding, or entailment) agrees with multi-reviewer adjudication above 71%, whereas an LLM judge reaches 86%. To separate component effects from matcher rewards, we build CTIForge, whose deterministic validation layer can vary while extraction is held byte-identical. Across seven tested deployment configurations, validation raises precision for all four hosted backbones and lowers it for all three offline backbones. Because backbone, decoding, and backend-specific prompting covary, this is a descriptive split rather than an isolated serving effect. It coincides with a roughly 2.8-fold increase in actions explicitly disputing entity type, consistent with hand-written rules encoding the conventions of the extractor against which they were developed. We release the pipeline, protocol suite, and per-triple audit records.
96. 【2609.01659】Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving
链接：https://arxiv.org/abs/2609.01659
作者：Zhengxu Tang,Xiaozhou Zhang,Guofeng Cui,Ziyu Gong,Zi Wang,Yunfei Shi,Ruifeng Deng,Chengzhi Qi,Ke Chen,Sachin Patil,Tianjun Xiao,Langechuan Liu,Pichao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：powers generative models, reasoning powers generative, eliciting intermediate steps, powers generative, generative models
备注： Accepted by EMNLP 2026
点击查看摘要
Abstract:Chain-of-thought (CoT) reasoning powers generative models by eliciting intermediate steps before producing an answer. In autonomous driving, the answer is a continuous action. Thus its reasoning must share the same spatiotemporal structure as the physical world. This survey studies the resulting shift from textual CoT to action-grounded reasoning. Surveying 171 papers, including 130 method papers and 41 benchmarks, datasets, surveys, and analysis papers, we propose a representation-centered taxonomy that treats the form of the intermediate state as the organizing axis. We systematize the 130 methods into four categories: language-based, visual-spatial, latent-dynamic, and externalized reasoning, further divided into 13 subtypes tied to distinct regions of interests. Our synthesis shows that the open frontier of reasoning in driving agents lies in intermediate representations that can be grounded in the real world, coupled to real-time action, and verified under safety-critical systems. Project page: this https URL.
97. 【2609.01658】PRO-Step: Step-level Process Reward Optimization for Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2609.01658
作者：MinKeon Kim,Namjun Lee,Jaekwang Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Generation enhances Large, enhances Large Language, Retrieval-Augmented Generation enhances, Large Language Models, Large Language
备注： 22 pages, 7 figures, 23 tables. Accepted to EMNLP 2026
点击查看摘要
Abstract:Retrieval-Augmented Generation enhances Large Language Models by grounding responses in external knowledge, but multi-hop reasoning remains vulnerable to error propagation, where early retrieval failures confound subsequent steps. Standard outcome-based optimization only rewards the final answer, leaving intermediate retrieval and reasoning errors undetected. While existing process-based methods introduce step-level signals, they still score each step against the final answer, rewarding spurious successes where flawed retrieval coincidentally produces the correct answer. Step-level supervision in RAG requires evaluating both logical validity and evidential grounding at each step. We introduce PRO-STEP: we train a generative PRM that evaluates both dimensions, employ PRM-guided value tree search to construct preference pairs contrasting valid steps against flawed ones, and optimize the policy via step-level Direct Preference Optimization. Experiments on single and multi-hop QA datasets demonstrate that PRO-STEP achieves the best average EM and F1 across five benchmarks. Code, models, and training data are publicly available at this https URL.
98. 【2609.01625】Whose Judgments Count? Representation Gaps in Crowdsourced Content Moderation Produce Unequal Protection from Perceived Toxicity
链接：https://arxiv.org/abs/2609.01625
作者：Zhaodi Chen,Byungkyu Lee
类目：ocial and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：shared online spaces, digital governance, central form, form of digital, people disagree
备注：
点击查看摘要
Abstract:Content moderation is a central form of digital governance, yet people disagree over what content should be removed from shared online spaces. While platforms aggregate human judgments to build moderation systems, it remains unclear how this process shapes which users are protected from content they perceive as toxic. We address this gap by combining large-scale judgment data with counterfactual simulations that trace how the demographic composition of moderator pools shapes the distribution of protection across users. Applying this framework to removal judgments from 16,221 U.S. respondents evaluating 102,463 comments from Twitter, Reddit, and 4chan, we find demographic heterogeneities in moderation demand. We further reveal a consistent pattern of in-group protection: reductions in perceived toxicity accrue disproportionately to users who share the demographic identities of the moderator pool. Crucially, moderator pools that mirror the demographic composition of self-identified moderators on Prolific widen these disparities relative to a nationally representative baseline, while even fully representative pools fail to ensure equal protection: Black and LGB users remain underprotected unless they are represented well beyond their population share. These findings show that unequal protection from perceived toxicity can arise structurally from the aggregation of stratified removal standards, making the demographic composition of moderation inputs a key determinant of who is protected online.
99. 【2609.01612】MESSY STREETS: A Benchmark for Geocoding Real-World Addresses
链接：https://arxiv.org/abs/2609.01612
作者：Edward Gaere,Florian von Wangenheim
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：introduce MESSY STREETS, MESSY STREETS, introduce MESSY, verbatim web addresses, surface-form divergence
备注：
点击查看摘要
Abstract:We introduce MESSY STREETS, a benchmark for evaluating geocoders on verbatim web addresses, with existence verification and controlled measurement of surface-form divergence. Unlike conventional benchmarks based on clean or synthetically perturbed addresses, MESSY STREETS contains addresses whose surface forms diverge from canonical representations and whose components may be missing, repeated, malformed, or incomplete. The benchmark is constructed from the December 2024 Web Data Commons corpus, with reference locations established from OpenAddresses or OpenStreetMap. The strongest commercial geocoders outperform open-source systems by up to 49 percentage points in recall. This gap is driven primarily by differences in candidate return rates on non-canonical addresses; once a candidate is returned, positional accuracy is broadly comparable across systems. Non-canonical surface form alone accounts for up to 25 percentage points of recall loss. Examining Nominatim's query-processing pipeline, we show that its conjunctive matching lets a single unrecognised token zero an otherwise valid query. The results demonstrate that geocoder choice is a consequential design decision for applications processing noisy address data, and that normalisation and preprocessing could substantially narrow the gap between open-source and commercial geocoders.
Subjects:
Information Retrieval (cs.IR); Computation and Language (cs.CL)
Cite as:
arXiv:2609.01612 [cs.IR]
(or
arXiv:2609.01612v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.01612
Focus to learn more
arXiv-issued DOI via DataCite</p>
100. 【2609.01611】EvalDetectBench: A Benchmark for Measuring Evaluation Awareness in Frontier Language Models
链接：https://arxiv.org/abs/2609.01611
作者：Xinning Li,Kemunto Ochwang'i,Aryasomayajula Ram Bharadwaj,Alexandra Souly,Robert Kirk
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, Frontier large language, large language, language models, Frontier large
备注： 24 pages, 12 figures, 10 tables. Code: [this https URL](https://github.com/freeze-lasr/aware_bench) Data: [this https URL](https://huggingface.co/datasets/el7982/aware-bench)
点击查看摘要
Abstract:Frontier large language models can often recognize when they are being evaluated, a capability known as evaluation awareness. If models behave differently in evaluations than in deployment, this undermines the validity of evaluation results, which are a crucial component of current AI safety frameworks. We introduce EvalDetectBench, an open pipeline and benchmark for measuring evaluation awareness that works with any Inspect-compatible evaluation, allowing practitioners to test against current and future benchmarks. EvalDetectBench ships with a newly curated transcript suite covering current frontier system-card evaluations and diverse deployment sources. The benchmark serves two purposes: measuring how reliably frontier LLMs recognize that they are being evaluated, and assessing how detectable individual benchmarks are as evaluations. We identify two methodological choices in the existing literature that introduce systematic bias: the identity of the model that generated the deployment transcripts accounts for 11.25% of measurement variance and can reorder model rankings; and elicitation prompts selected for high performance on one model can perform near chance on others. EvalDetectBench corrects for both via per-model probe calibration and a stratified generator-harmonisation procedure.
101. 【2608.30485】wo Centuries of Sexism in British Parliament: A Computational Analysis of Women's Representation in the Hansard Corpus
链接：https://arxiv.org/abs/2608.30485
作者：Mohammad Omar Khursheed,Mandira Sawkar,Ashiqur R. KhudaBukhsh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：encodes systematic patterns, Ambivalent Sexism Inventory, encodes systematic, systematic patterns, Ambivalent Sexism
备注： Accepted at EMNLP 2026 (Main Conference Track)
点击查看摘要
Abstract:The language a legislature uses to debate women's rights, even in favour of them, encodes systematic patterns of sexism that persist across two centuries. In this work, we analyse 6,531 speeches over 200 years of UK parliamentary debate (Hansard, 1803-2005) by using large language models to classify a speaker's perspective towards women's suffrage and political representation, as well as analyse sexist speech in parliament from the lens of the Ambivalent Sexism Inventory. We also release this parliamentary dataset, an organized and metadata-enriched version of the publicly available Hansard Corpus optimized for computational social science research, with 6.7 million speeches across 1.2 million debates, with 89% gender-matching for speeches by MPs from the House of Commons. We find that 54% of speeches opposing women's representation contain sexist content, compared to 21% of speeches that are for the cause, and that the two sides use fundamentally different types of sexism: anti-suffrage rhetoric combines hostile and benevolent framing, while pro-suffrage sexism is overwhelmingly benevolent. Female MPs support women's political rights at 93% compared to 70% for male MPs, a gap that closes only after enfranchisement. Our findings are evidence that benevolent and hostile sexism are used in different rhetorical contexts in a manner consistent with the theory of Ambivalent Sexism.
102. 【2609.02797】Dutch Books for Language Models
链接：https://arxiv.org/abs/2609.02797
作者：Isaiah Andrews,Suproteem Sarkar
类目：General Economics (econ.GN); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：People increasingly, support life decisions, People, language models, language
备注： 14 pages, 6 figures
点击查看摘要
Abstract:People increasingly use language models to support life decisions. Many such decisions involve a probabilistic forecast: How likely is a major life event, a natural disaster, or an economic outcome? Users of language models may implicitly trust that these forecasts fall out of a coherent world model. In this paper, we evaluate the coherence of language model probabilistic forecasts through a procedure that builds on a theorem due to de Finetti. We elicit forecasts from language models across events generated from stock returns data. We then use linear programs to compute the largest Dutch-book profit - the profit an arbitrageur could guarantee by betting against model-generated probabilities - which we use as a measure of incoherence. Our procedure does not require outcome labels, so we can evaluate coherence even in settings where outcomes are not observed or have not yet resolved. We find substantial evidence of incoherence in language model forecasts. Such incoherence increases when there are richer logical relationships between events, and irrelevant contextual details can increase incoherence by an order of magnitude. We conclude by discussing how alternative training strategies may improve probabilistic coherence.
信息检索
1. 【2609.02745】Incremental Pooled LLM Evaluation for Cost-Effective Retrieval Model Selection
链接：https://arxiv.org/abs/2609.02745
作者：Max Nelson,Hanoz Bhathena,Aviral Joshi,Saket Sharma
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：RAG system requires, requires reliable comparative, obtaining relevance judgments, production RAG system, reliable comparative evaluation
备注： 10 pages, 1 figure
点击查看摘要
Abstract:Selecting a retrieval model for a production RAG system requires reliable comparative evaluation, but obtaining relevance judgments at scale is expensive and difficult to repeat as new candidate systems arrive. We study pooled LLM evaluation, in which an LLM judges the union of documents retrieved by the current set of candidate systems, and the pool is then expanded incrementally as new systems are introduced by judging only the new documents they contribute. These judgments are reused to evaluate all systems on a common basis. We validate this approach on four retrieval benchmarks with 11 systems spanning dense, sparse, and hybrid configurations, and deploy it to compare 62 retrieval configurations for a financial news QA system. Pooled LLM rankings correlate strongly with gold-standard evaluation across datasets, and 97% of pairwise system orderings are preserved once bootstrap uncertainty in the qrels is taken into account. In production, document overlap yields 65-80% judgment reuse and up to 4.9x lower evaluation cost, allowing teams to benchmark new retrieval candidates without re-judging previously assessed documents. These results suggest pooled LLM evaluation is a practical and cost-effective workflow for incremental retrieval model selection in deployed systems.
2. 【2609.02671】Recommender System as Slow and Fast Thinkers
链接：https://arxiv.org/abs/2609.02671
作者：Zichen Yuan,Xiaoxuan Dong,Linkun Dai,Jinwei Yang,Jining Luan,Dexu Yu,Chunxiao Li,Joemon M. Jose,Youhua Li,Hanwen Du,Junchen Fu
类目：Information Retrieval (cs.IR)
关键词：modern personalized services, effectiveness varies substantially, heterogeneous user environments, personalized services, models are foundational
备注： 12 pages, 4 figures
点击查看摘要
Abstract:Sequential recommendation models are foundational to modern personalized services, yet their effectiveness varies substantially across heterogeneous user environments. In particular, static one-pass recommenders often perform well on common behavior patterns but degrade on operationally challenging user groups, such as users with longer histories or less mainstream item profiles. To address this limitation, we propose \textsc{DS-Frame}, an adaptive fast--slow inference framework for sequential recommendation. \textsc{DS-Frame} combines a Fast System for efficient routine prediction, a Slow System for iterative latent refinement, and a learned selector that routes each sample under a controllable computation budget. Experiments on five real-world datasets show that \textsc{DS-Frame} consistently improves representative sequential recommendation backbones, with larger gains on challenging groups and effective accuracy--efficiency trade-offs. This highlights the potential of adaptive inference for more efficient and robust recommendation. Code is available at \href{this https URL}{this link}.
3. 【2609.02499】raining seeds and model-selection stability in recommender-system evaluation
链接：https://arxiv.org/abs/2609.02499
作者：Juan Manuel Rodriguez,Oleg Lesota,Antonela Tommasel
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Recommender-system experiments, single random training, stochasticity has limited, experiments often rely, single random
备注： Accepted RecSys 2026 (ResearchPractice Notes)
点击查看摘要
Abstract:Recommender-system experiments often rely on a single random training seed, assuming that run-to-run stochasticity has limited impact on evaluation conclusions. This assumption is risky, as a training seed may influence several algorithm-dependent mechanisms, including parameter initialization, mini-batch ordering, dropout, masking, latent sampling, and training-time negative sampling. We examine this assumption by fixing the data partition and varying the training seed across hyperparameter configurations. We analyze seed effects at three levels: user-level metric sensitivity, validation-based model selection and recommendation-list agreement. Results show that seed variation is often detectable. Its impact depends on whether configurations are clearly separated, whether validation results transfer to test, and whether similar scores lead to similar top-$k$ lists. Findings suggest that reporting single-seed results can overstate the stability of recommender system evaluation, and that training seeds should be treated as part of the evaluation protocol rather than as incidental implementation noise.
4. 【2609.02486】ViSAR: Training-Free Adaptive-$k$ Retrieval for Visual Document Question Answering
链接：https://arxiv.org/abs/2609.02486
作者：Adrien Mialland,Marc Plantevit,Julien Gallois,Céline Robardet
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Vision-Language Model, Visual Question Answering, Question Answering, leverages Retrieval-Augmented Generation, Document Visual Question
备注： 13 pages, 5 figures, 4 tables
点击查看摘要
Abstract:Document Visual Question Answering (DocVQA) often leverages Retrieval-Augmented Generation (RAG), where late-interaction encoders are commonly used to identify document pages relevant to a user query, before answer generation by a Large Vision-Language Model (LVLM). Existing approaches typically retrieve a fixed top-$k$ number of pages regardless of query complexity, which increases LVLM latency and may degrade answer accuracy. We introduce ViSAR (Visual Semantic Activation Retrieval), a training-free adaptive-$k$ retrieval method for late-interaction visual document retrieval. ViSAR operates directly in the embedding space to construct a query-conditioned page-level similarity matrix that highlights query-relevant semantics and dynamically determines the number of pages to retrieve. Across multiple encoders and LVLMs, ViSAR retrieves compact, query-adapted page sets that reduce RAG latency by up to 58.7\%, while maintaining or improving answer accuracy compared with fixed top-$k$ and adaptive retrieval heuristics. Furthermore, we show that the similarity matrix structure correlates with answer accuracy, suggesting future directions for retrieval quality-aware document understanding.
5. 【2609.02379】MultiGhostBench: A Multilingual Benchmark for Long-Form LLM-Generated Text Attribution under Distribution Shifts
链接：https://arxiv.org/abs/2609.02379
作者：Matteo Greco,Anudeex Shetty,Andrea Tagarelli,Jey Han Lau
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词：LLM authorship attribution, focusing on English, benchmarks remain limited, authorship attribution, made progress
备注：
点击查看摘要
Abstract:While existing work on LLM authorship attribution (AA) has made progress, available benchmarks remain limited, often focusing on English, controlled settings, or relatively outdated models, with the few multilingual studies considering only relatively short texts. We introduce MultiGhostBench, a multilingual benchmark comprising 928 books generated by five recent LLMs across six languages and three scripts, with an average length of approximately 59K words per book. The benchmark supports evaluation under domain, author, and language shifts. Evaluation of representative AA methods shows that no single method consistently performs best across settings, and performance generally degrades under distribution shifts. Transformer-based detectors can retain generator-related information across languages, although transfer effectiveness varies by language pair, whereas statistical and fingerprint-based detectors are more language-dependent. We envision MultiGhostBench as a valuable resource for the development and evaluation of robust AA methods. The dataset and code can be found at this https URL.
6. 【2609.02324】Adaptive Test-Time Inference for Text2Cypher with Trace Budgeting and Selective Refinement
链接：https://arxiv.org/abs/2609.02324
作者：Makbule Gulcin Ozsoy
类目：Information Retrieval (cs.IR)
关键词：violate database schemas, Large language models, enabled natural language, natural language interfaces, Large language
备注：
点击查看摘要
Abstract:Large language models have enabled natural language interfaces for structured databases, but generated queries may still contain syntactic errors, violate database schemas, or fail during execution. Test-time inference strategies improve generation reliability without additional training, but existing approaches often use fixed inference budgets and uniform refinement strategies, leading to unnecessary computation across questions with different complexity levels. In this work, we investigate adaptive test-time inference for Text2Cypher and introduce two strategies: adaptive trace budgeting, which dynamically adjusts the candidate generation budget based on question difficulty, and selective execution-guided refinement, which applies correction only when additional inference is expected to be beneficial. Experiments on Gemma-2-9B and Qwen-2.5-7B show that adaptive trace budgeting reduces the average generation budget by 30.7% and wall-clock inference time by 21-25% while maintaining comparable generation quality. Selective refinement preserves nearly all execution success gains of full refinement, reducing execution success by only 0.2-0.5% while avoiding unnecessary refinement for simpler questions. Experiments show that a single correction model (Gemma-4) effectively refines outputs from a different model family, suggesting refinement transfers across families.
7. 【2609.02316】Counter-GEO-Bench: Evaluating Defenses Against Information-Distorting Generative Engine Optimization
链接：https://arxiv.org/abs/2609.02316
作者：Bing Zheng,Zongyao Zhao,Wenming Yang
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Generative engine optimization, generative search engines, large language models, adversaries publish ordinary-looking, publish ordinary-looking GEO-optimized
备注： Accepted to EMNLP 2026 (Main Conference). 17 pages, 5 figures
点击查看摘要
Abstract:Generative engine optimization (GEO) enables content producers to increase the visibility of their web pages in generative search engines, but the same techniques can deliver targeted misinformation when adversaries publish ordinary-looking GEO-optimized documents that victim large language models (LLMs) retrieve and synthesize into distorted answers. No existing benchmark evaluates defenses against this threat under controlled conditions. Therefore, we present Counter-GEO-Bench, a defense benchmark that pairs 247 human-verified, quality-gated queries with information-preserving and information-distorting GEO rewrites, and evaluates defenses on attack success rate (ASR), false positive rate, and answer quality across three victim LLMs. Under Counter-GEO-Bench, three off-the-shelf defenses (Granite Guardian, Llama Guard 3, and NeMo Self-Check Fact-Checking) reduce ASR by at most 5.7% relative, while Granite Guardian's reduction is not statistically significant. Safety-taxonomy guardrails target policy violations, while GEO misinformation passes through them as fluent informational content. To this end, a lightweight benchmark baseline, C-GEO Guard, is proposed, reducing ASR by 47.6% relative with near-zero utility loss, which proves threat tractable.
8. 【2609.02303】Genuine Information Needs of Social Scientists Looking for Data
链接：https://arxiv.org/abs/2609.02303
作者：Andrea Papenmeier,Thomas Krämer,Tanja Friedrich,Daniel Hienert,Dagmar Kern
类目：Information Retrieval (cs.IR)
关键词：Publishing research data, Publishing research, data, research, research data
备注：
点击查看摘要
Abstract:Publishing research data is widely expected to increase its reuse and to inspire new research. In the social sciences, data from surveys, interviews, polls, and statistics are primary resources for research. There is a long tradition to collect and offer research data in data archives and online repositories. Researchers use these systems to identify data relevant to their research. However, especially in data search, users' complex information needs seem to collide with the capabilities of data search systems. The search capabilities, in turn, depend to a high degree upon the metadata schemes used to describe the data. In this research, we conducted an online survey with 72 social science researchers who expressed their individual information needs for research data like they would do when asking a colleague for help. We analyzed these information needs and attributed their different components to the categories: topic, metadata, and intention. We compared these categories and their content to existing metadata models of research data and the search and filter opportunities offered in existing data search systems. We found a mismatch between what users have as a requirement for their data and what is offered on metadata level and search system possibilities.
9. 【2609.02188】Group-Aware Adaptive Retrieval for Evidence Navigation
链接：https://arxiv.org/abs/2609.02188
作者：June Park,Jun Kwon,Jonghyo Kim,Jongwuk Lee
类目：Information Retrieval (cs.IR)
关键词：Reasoning-intensive retrieval addresses, requiring multi-step reasoning, retrieval addresses queries, Reasoning-intensive retrieval, surface-level matching
备注： Accepted to EMNLP 2026; 20 pages, 11 figures, 13 tables
点击查看摘要
Abstract:Reasoning-intensive retrieval addresses queries whose relevance cannot be identified by surface-level matching, thereby requiring multi-step reasoning. Because relevant documents rarely appear in the initial candidate set, retrieval systems suffer from the bounded recall problem. Existing methods iteratively expand a candidate pool at the document level over a corpus graph, examining each neighbor in isolation and drifting toward a narrow region of the corpus. To address this problem, we propose Group-Aware Adaptive Retrieval for Evidence Navigation (GAREN), which explores the corpus graph through group-level expansion. GAREN organizes documents into semantically coherent and distinguishable groups based on their connections in the corpus graph. The information in each group indicates what can be accessed by expanding through it, providing guidance beyond individual document-level signals. At each iteration, GAREN uses a group-level navigator to identify promising expansion directions, retrieves documents from the selected groups, and applies a document-level reranker to evaluate the updated candidate set. Extensive experiments show that GAREN achieves up to 8.0% improvement over the strongest baseline on BRIGHT. The source code is available at this https URL
10. 【2609.02162】GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation
链接：https://arxiv.org/abs/2609.02162
作者：Qianqian Wang,Yunshan Li,Jiawen Zeng,Wenwu Gong,Lili Yang
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：distribution shift, shift is crucial, crucial for balancing, balancing utility, utility and risk
备注： 19 pages, 8 figures, 7 tables
点击查看摘要
Abstract:Serving useful recommendations under distribution shift is crucial for balancing utility and risk in out-of-distribution (OOD) recommendation. However, most existing OOD methods improve ranking or construct counterfactual candidates without controlling the proxy-label false discovery rate (FDR) of the served set. In this work, we formulate OOD serving as the $\alpha$-Valid Counterfactual Recommendation ($\alpha$-VCR) problem to retain candidate support learned from counterfactual supervision while controlling proxy-label FDR, and propose GenCAR, which couples preference-grounded counterfactual supervision with calibrated set selection. In particular, GenCAR fixes the stable-preference representation while intervening on the environmental factor, grounds offline large language model proposals through preference anchors and trust-radius filtering, and uses conformal $p$-values for Benjamini--Hochberg selection. We theoretically bound conditional counterfactual approximation error and prove finite-sample, distribution-free control of proxy-label FDR under exchangeability and positive regression dependence, with a Benjamini--Yekutieli guarantee under arbitrary dependence. Extensive experiments audit realized proxy false discovery proportions and demonstrate that GenCAR consistently enhances OOD candidate recovery across diverse benchmarks.
11. 【2609.02152】Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation
链接：https://arxiv.org/abs/2609.02152
作者：Jialin Liu,Zhaorui Zhang,Ray C. C. Cheung
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Multimodal Recommender Systems, Recommender Systems, collaborative interaction patterns, users' collaborative interaction, Multimodal Recommender
备注： Accepted to ACM Multimedia 2026 (ACM MM 2026)
点击查看摘要
Abstract:Multimodal Recommender Systems (MRSs) typically rely on a flawed "modality harmony" assumption, presuming that multimodal features are inherently beneficial and strictly aligned with users' collaborative interaction patterns. However, modality-topology conflicts are ubiquitous in real-world scenarios due to deceptive visual clickbaits and mismatched semantics. Blindly integrating these noisy modalities inevitably pollutes the pristine collaborative space, causing severe representation distortion. To address this, we propose Orthogonal purification and topology-guided MoE for conflict-aware multimodal Recommendation (OrthoRec). At its core, OrthoRec introduces Collaborative-Guided Orthogonal Purification (CGOP), which geometrically decouples multimodal features into directions parallel and orthogonal to a pure collaborative anchor. By adaptively truncating the orthogonal noise with an energy-preserving normalization, CGOP rectifies deceptive semantic directions while preserving the modality's intrinsic representation capacity. Furthermore, we design a Topology-Aware Routing Mixture-of-Experts (TAR-MoE). Guided by the collaborative topology, TAR-MoE employs decoupled sigmoid gating to break the zero-sum bottleneck of traditional softmax attention, autonomously determining the injection scale for each purified modality. Finally, a safe-SSL objective is introduced to dynamically penalize the forced contrastive alignment of contradictory pairs. Experiments on three real-world Amazon datasets show that OrthoRec consistently outperforms competitive recent baselines and exhibits improved robustness under modality noise and item sparsity.
12. 【2609.02143】A Power Law in Logarithm's Clothing: On the Scalability of Graph-Based Vector Search
链接：https://arxiv.org/abs/2609.02143
作者：Sajad Faghfoor Maghrebi,Navid Eslami,Niv Dayan
类目：Databases (cs.DB); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：HNSW and Vamana, approximate nearest neighbor, Sublinear Power Law, notably HNSW, nearest neighbor search
备注： 17 pages, 10 figures
点击查看摘要
Abstract:Most vector databases rely on graph-based indexes, notably HNSW and Vamana, for approximate nearest neighbor search. With embedding models widely adopted, the datasets these databases store grow rapidly. At a fixed accuracy, how does search cost scale with dataset size? The prevailing answer is poly-logarithmic growth. Yet the claim is proven only under special conditions and asserted without proof for the indexes used in practice. It is also largely untested: standard benchmarks measure cost at one dataset size, not across sizes. We put the claim to the test. The answer depends on the scale itself. While the dataset size $N$ is small relative to the data's intrinsic dimensionality, search cost grows as $N^c$ for a constant $0c1$. We call this scaling the Sublinear Power Law. Once $N$ is large enough, growth slows to subpolynomial, consistent with the poly-logarithmic claim. The Sublinear Power Law appears on every dataset, mostly up to its full size, at every recall target, query hardness level, and index configuration we test. The transition to subpolynomial growth appears on the two datasets that grow large enough relative to their intrinsic dimensionality. One mechanism underlies both behaviors: a dataset's intrinsic dimensionality grows with its size until the data resolves its underlying distribution. Higher intrinsic dimensionality packs more vectors into the query neighborhood the search must examine. We present a unifying theory of beam-search cost that explains our observations. For exact and bounded-degree constructions, we prove the Sublinear Power Law and the eventual transition to poly-logarithmic scaling, and derive the scale at which it occurs. We also develop models that predict the power-law exponents for any recall target and index configuration. These models give a principled way to navigate trade-offs among search cost, insertion cost, and recall as data grows.
13. 【2609.02129】Beyond Context Windows: Persistent Discovery Context for Data-Centric Agents
链接：https://arxiv.org/abs/2609.02129
作者：Jalal Mahmud
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：data objects relevant, agents repeatedly perform, planning or execution, repeatedly perform, step before planning
备注：
点击查看摘要
Abstract:Data-centric agents repeatedly perform a discovery step before planning or execution: identifying the data objects relevant to a task. Yet successful discovery outcomes are typically discarded rather than reused. We introduce persistent discovery context, a lightweight memory layer that stores prior intent-to-object mappings and reuses them to augment future retrieval. Across three structured data environments, persistent discovery context consistently improves retrieval quality over metadata-only search, remains effective with automatically generated memories, and exposes a reproducible interference failure mode. In lexically sparse domains, memory-only retrieval can even outperform metadata-based retrieval. These findings suggest that discovery outcomes constitute a useful form of reusable context for data-centric agents.
14. 【2609.02062】SPAR: Enhancing Industrial-Scale Generative POI Recommendation via Real-World Spatial Perception
链接：https://arxiv.org/abs/2609.02062
作者：Fangye Wang,Yunjin Gu,Haowen Lin,Yifang Yuan,Song Yang,Xiaojiang Zhou,Pengjie Wang
类目：Information Retrieval (cs.IR)
关键词：holds great promise, target POI semantic, urban spatial knowledge, autoregressively generating, holds great
备注：
点击查看摘要
Abstract:Generative Point-of-Interest (POI) recommendation, autoregressively generating a target POI's semantic ID (SID), holds great promise for Location-Based Services, where a recommendation helps only if the user can reach it. Yet, existing methods operate within an interest space defined by behavior sequences and collaborative signals, where geography enters only as a textual attribute of the SID, leaving no explicit mechanism to learn or preserve how urban places are related by distance, direction, and reachability; their predictions are thus behaviorally plausible yet far from the user's real-time location. We argue that such services require injecting real urban spatial knowledge into the interest space, rather than inferring geography from behavior alone. Hence, we propose SPAR, a unified framework whose three synergistic stages jointly construct, cultivate, and preserve urban spatial knowledge: (1) at the tokenization level, Spatially-Intrinsic SID (SI-SID) explicitly encodes longitude--latitude coordinates into a sinusoidal geospatial embedding and fuses it with the textual semantic embedding, producing identifiers via RQ-Kmeans that are simultaneously semantically and geographically consistent; (2) at the cognition level, Multi-Granular Geospatial CPT (MG-CPT) continually pre-trains the base LLM on 25 curated geospatial datasets organized into three tiers of basic attributes, pairwise relations, and city-scale navigation, so that scattered POIs cohere into a connected urban space; and (3) at the adaptation level, Task-Vector Anchored SFT (TV-SFT) anchors the acquired spatial knowledge as a frozen parameter-space task vector to prevent its catastrophic forgetting during behavioral fine-tuning, thereby fusing the two spaces. Extensive quantitative and visualization experiments on two public and four industrial-scale datasets demonstrate the effectiveness of SPAR.
15. 【2609.02012】GeoStore: Finding Small Storefronts in Large Scenes -- A Fine-Grained POI Localization Benchmark with Global-to-Local Asymmetric Matching
链接：https://arxiv.org/abs/2609.02012
作者：Lu Han,Xiting Sun,Hao Wang,Zhiqiang Cao,Ruihuan Du,Ziquan Zeng,Chunlong Lv
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：geo-tagged street-view imagery, large-scale geo-tagged street-view, user close-up storefront, close-up storefront photograph, underpins map construction
备注： 6 pages, 3 figures. Submitted to ICASSP 2027
点击查看摘要
Abstract:Point-of-interest (POI) localization -- matching a user's close-up storefront photograph against large-scale geo-tagged street-view imagery -- underpins map construction, POI verification, and location-based services. Its closest existing paradigm, visual place recognition (VPR), assumes symmetric, whole-image matching of the same scene at a comparable scale; POI localization instead must match a close-up query, in which the target fills the frame, against wide references in which the same POI occupies only a small, off-center region among visually similar shops, under a substantial capture-domain gap. We introduce GeoStore, to our knowledge the first benchmark dedicated to this asymmetric, fine-grained, open-set formulation, and show that global-descriptor methods tuned for symmetric VPR are systematically limited on it, since a single global vector dilutes the small target. We further propose GLAM (Global-to-Local Asymmetric Matching), which couples a retrieval-anchoring global descriptor with an asymmetric local pathway: each reference is kept as a compact set of pooled region tokens and matched against a single query probe through a learnable soft late interaction; at inference, the same tokens enable a lightweight mutual-nearest-neighbor re-ranking. GLAM surpasses strong global and two-stage baselines on Recall@1/5/10 and mAP, with ~5x smaller re-ranking features and ~two orders of magnitude lower per-pair matching cost than prior local re-ranking. The benchmark and code will be publicly released.
16. 【2609.02011】Seed-Anchored Budget-Bounded Graph Rendering for Question Answering on Industry-Standard Power-Grid Information and Exchange Models
链接：https://arxiv.org/abs/2609.02011
作者：Jayakumar Manoharan,Yamini Sehgal
类目：ystems and Control (eess.SY); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large language model, Large language, context budget, fixed context budget, Model Exchange Standard
备注： Submitted to Engineering Applications of Artificial Intelligence
点击查看摘要
Abstract:Large language model question answering over power-grid models must respect a fixed context budget. We introduce seed-anchored graph rendering, a deterministic method that prioritizes query-local graph evidence without adding method-specific tuned or learned parameters beyond the shared hop bound and context budget. The method provides a checkable condition under which predefined seed-local answer-bearing render units are preserved in a greedy bounded-context prefix. We evaluate the approach on Common Information Model (CIM) network models exchanged through the Common Grid Model Exchange Standard (CGMES). On two budget-binding CGMES encodings, naive descriptions-first rendering retains local evidence for every single-hop item but only 0.12 and 0.00 of multi-hop items, whereas seed-anchored rendering retains all such evidence. On a preregistered fresh 100-item bank from the SmallGrid topology family, accuracy rises from 0.450 to 0.970 under a fixed 8,000-character context budget. Under a common retrieval and rendering pipeline, the standards-native seed-anchored graph matches or exceeds extracted graph representations produced by LightRAG, Microsoft GraphRAG, and HippoRAG, while avoiding LLM graph-construction tokens. The results are specific to the evaluated CIM/CGMES models, reader, and context budget; they concern budget-bounded retrieval rather than general question answering.
17. 【2609.01913】MERGED: Multimodal Entity Resolution via Generated Expert Reasoning Distillation
链接：https://arxiv.org/abs/2609.01913
作者：You-Lin Chen,Kyoungjun Park,Bin Xu,Prithviraj Sen,Pedro Herrero-Vidal
类目：Information Retrieval (cs.IR)
关键词：traditionally requires slow, change traditionally requires, product entity resolution, definitions constantly evolve, costly human annotation
备注： 8 pages, 3 figures, 4 tables
点击查看摘要
Abstract:In product entity resolution, relationship definitions constantly evolve with business needs, yet adapting to each change traditionally requires slow, costly human annotation that is often noisy and carries no reasoning. Large vision-language models (VLMs) prompted zero-shot can adapt to a new definition immediately and supply the reasoning that human labels lack, but their cost and latency are prohibitive at production scale. We present MERGED, a distillation framework that transfers not just labels but structured reasoning from large teacher VLMs into a compact 7B-parameter student, requiring no human annotation. Multiple teachers label each product pair and articulate the reasoning behind their decision: agreement pairs supply supervised fine-tuning, while disagreements are resolved by a meta-judge into preference pairs for Direct Preference Optimization. Evaluated against human-labeled ground truth on a multilingual e-commerce dataset, the resulting student improves PR-AUC by 13.79% over the same backbone trained on human labels and surpasses the larger Qwen2.5-32B-VL baseline by 6.32% at 6x lower cost, while also yielding tighter label-reasoning alignment (over 10% above Qwen2.5-32B-VL). Moreover, re-applying MERGED from an existing checkpoint adapts to a new relationship definition with only 10K samples, improving PR-AUC by 6.97% over zero-shot and outperforming from-scratch training. MERGED enables rapid adaptation to evolving relationship definitions, supporting a new one in days rather than months, at a cost and latency suitable for large-scale industrial deployment.
18. 【2609.01865】ExecRetrieval: Measuring the Functional-Correctness Gap in Code-Embedding Retrieval
链接：https://arxiv.org/abs/2609.01865
作者：Aaryan Kapoor,Md Abdullah Al Hafiz Khan
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Embedding-based code retrieval, retrieving lexically similar, retrieval-augmented code generation, lexically similar code, retrieving correct code
备注： Accepted to EMNLP 2026 (Main Conference). Camera-ready version. 17 pages, 6 figures, 8 tables
点击查看摘要
Abstract:Embedding-based code retrieval is a core component of coding agents and retrieval-augmented code generation, where retrieving correct code matters more than retrieving lexically similar code. Existing code-retrieval benchmarks do not plant controlled, execution-verified single-edit variants of each query's canonical implementation in the search pool, leaving the question of whether embeddings can functionally discriminate correct from near-clone-but-incorrect code unanswered in a retrieval setting. Resolving this requires a benchmark whose search pool itself contains the relevant counterfactuals -- execution-verified buggy variants near-identical to each canonical -- so that a retriever's rank ordering can be directly tested for functional discrimination rather than topical or identity overlap. We introduce ExecRetrieval, 939 Python tasks each paired with one execution-verified canonical implementation and up to four execution-verified buggy distractors, each generated by a mechanical mutation making a single targeted edit, and evaluate 23 dense embedding configurations plus BM25 under provider-native invocation with paired McNemar tests and query-level bootstrap intervals. With near-clone counterfactuals in the pool, the top hosted system reaches exec@10 = 1.00 but only exec@1 = 0.331; rank-1 misses are paired buggy variants 91.5-99.4% of the time across the four leading systems, and the canonical scores below at least one of its four paired distractors in 67-78% of queries on the leading systems. The full dataset, execution oracle, embedding matrices, environment snapshot, and pairwise statistical tests are released at the URL in Appendix D.
19. 【2609.01846】Cite or Decline: A Strict Course-Grounded Chatbot for STEM Lecture Videos
链接：https://arxiv.org/abs/2609.01846
作者：S M Masrur Ahmed,Jaspal Subhlok
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：Recorded lecture videos, standard study resource, Recorded lecture, enhanced with search, search and summarization
备注： To appear in the Proceedings of the 2026 Conference on EMNLP 2026, Industry Track
点击查看摘要
Abstract:Recorded lecture videos, often enhanced with search and summarization features, are a standard study resource. However, students cannot easily ask course specific questions or verify answers against an instructor's lecture. We report a semester-long deployment of VideoPoints platform with a retrieval-augmented chatbot that answers from course lecture materials and returns timestamped citations. The chatbot retrieves only from the active course, uses chapter summaries to guide transcript ranking, and returns clickable timestamped citations. Students used it for quick lookups and exam review. Across 833 messages, 70.5% included citations, none crossed a course boundary, and when no lecture evidence matched, the chatbot usually declined rather than answering. Among the users, citations were the most consistently useful feature, while practice-question generation was the strongest unmet request. We also evaluated the design on the real-world test split of EduVidQA, a public multimodal benchmark for lecture-video question answering. Our design improved correct-lecture retrieval by 6.3 percentage points over dense-only retrieval. Together, the results show that effective deployment depends on course isolation, supported citations, and alignment with students' study practices.
20. 【2609.01820】Index-Free Dynamic Edge Retrieval with Energy-Tail-Aware Partial Scans
链接：https://arxiv.org/abs/2609.01820
作者：Mohammad Arif Rasyidi,Omar Alhussein
类目：Information Retrieval (cs.IR)
关键词：maximum inner-product search, Dynamic maximum inner-product, largest dot products, inner-product search, change through insertions
备注： Accepted for presentation at the 2026 IEEE 12th World Forum on Internet of Things (WF-IoT)
点击查看摘要
Abstract:Dynamic maximum inner-product search (MIPS) returns the $K$ stored vectors with the largest dot products with a query while allowing the dataset to change through insertions, replacements, and deletions. For edge retrieval, the challenge is to achieve high recall and fast queries without making updates expensive. Full-vector scanning keeps updates simple but compares each query with every stored vector, while indexed methods reduce query cost at the expense of maintaining additional structures during updates. We propose ETAR, an index-free method that reduces query work while preserving simple updates. ETAR keeps the query coordinates with the largest squared values until they cover most of its total squared magnitude and treats the rest as a low-magnitude tail. It estimates similarity from the retained coordinates using a compact lower-precision representation, corrects for skipped coordinates, and reranks a fixed number of candidates using full-precision vectors. Across five runs on nine static datasets, ETAR averages 99.2% Recall@10, the fraction of exact top-10 results recovered, while running over 4$\times$ faster than exact scanning at a representative setting. This speedup also extends to an ARM-based mobile device, where ETAR is up to 6.9$\times$ faster across four synthetic distributions. Under five streaming workloads, it maintains 100% Recall@10 at every measured point without index rebuilds. Overall, ETAR offers a practical middle ground for dynamic MIPS by reducing query cost while retaining simple, index-free updates. Code is available at this https URL.
21. 【2609.01807】hLLM: Single Pass Decoding for Generative Reranking
链接：https://arxiv.org/abs/2609.01807
作者：Emil Laftchiev,Prachi Agrawal,Moe Kayali,Bixing Yan,Qi Xu,Zijie Lei,Chen Qiu,Zhi Hua,Ke Li,Luke Simon
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large language models, autoregressive decoding spends, Large language, sequential forward pass, language models
备注： 10 pages
点击查看摘要
Abstract:Large language models (LLMs) achieve state-of-the-art generative ranking quality, but the ranking they produce must be decoded, and autoregressive decoding spends one sequential forward pass per emitted token. We observe that the only tokens a ranker must emit are the $N$ ordinal values naming the items in ranked order, and that this narrow, permutation-structured output format admits decoding strategies which are much more efficient than left-to-right generation. We introduce hLLM (Hungarian LLM), a format-specialized decoding strategy that decodes all $N$ ordinals in $O(1)$ forward passes. hLLM reads an $N \times K$ item-position score matrix off the LLM's prefill hidden states with a lightweight self-attention head, then decodes the ordinals as the optimal bipartite assignment of that matrix via the Hungarian algorithm, yielding a valid permutation by construction rather than by repair. Through a systematic study of training signals and backbone adaptation, we show that LoRA-based fine-tuning combined with teacher ranking distillation reaches 28 ms end-to-end inference, a speed-up of $64\times$ while maintaining ranking quality on par with the teacher. We provide a complete ablation decomposing the contributions of architecture, training signal, and backbone adaptation. Our framework connects generative ranking to combinatorial optimization, opening a path toward other $O(1)$-decode mechanisms for real-time ranking.
22. 【2609.01780】KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigation
链接：https://arxiv.org/abs/2609.01780
作者：Essam Wisam,Chengkai Li
类目：Information Retrieval (cs.IR)
关键词：Knowledge Graph Question, Graph Question Answering, RDF graphs remains, curated text-SPARQL pairs, Question Answering
备注： 9 pages, 8 figures, 4 tables
点击查看摘要
Abstract:Knowledge Graph Question Answering (KGQA) over RDF graphs remains challenging in domain-specific settings, where formal ontologies and curated text-SPARQL pairs are often unavailable. We present KGVoyager, a KG-agnostic agentic architecture that generates SPARQL queries from natural language questions by dynamically discovering graph structure and semantics, requiring only a query endpoint of the underlying graph. Using a think-act-observe loop with search, exploration, and execution tools, KGVoyager maps terms to graph IRIs, uncovers structure, and refines queries through execution feedback - all without pre-existing ontologies or examples. Unlike the prior state of the art, KGVoyager requires only a lightweight class index which renders it applicable for far more real-world endpoints. Across four benchmarks, KGVoyager improves F1 by ~8 points while cutting cost and runtime by ~22% each.
23. 【2609.01657】NeoMME: A Single-Tower Multimodal-Native Multilingual Foundation Encoder for Efficient Fine-Tuning and Inference
链接：https://arxiv.org/abs/2609.01657
作者：Aurélien Lac,Tony Wu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：generative vision-language modeling, typically combining separately, causal language models, combining separately pretrained, vision-language modeling
备注：
点击查看摘要
Abstract:Multimodal models often build on architectures designed for generative vision-language modeling, typically combining separately pretrained vision encoders with causal language models. Visual document retrievers such as ColPali repurpose these models as encoders, carrying over the parameter and compute overhead of a VLM for a non-generative task. We introduce NeoMME, a family of 260M and 800M-parameter Multimodal and Multilingual bidirectional Encoders that process multilingual text and raw image patches in a single bidirectional Transformer encoder. Both models are pretrained from scratch with a masked discrete-diffusion text objective, conditioned on visible image patches for multimodal examples. Both support a 16,384-token context, enough to encode up to two standard 4K UHD images. To demonstrate its downstream capabilities, we fine-tune NeoMME with jointly trained dense and late-interaction heads. On the ViDoRe v3 benchmark, the resulting NeoMME-Retriever 260M outperforms all evaluated models strictly below 800M parameters with 0.523 nDCG@10, while NeoMME-Retriever 800M reaches 0.556. At a matched 2048x2048 image input size on an NVIDIA L40S, NeoMME-260M encodes pages with about 2x the throughput of ColModernVBERT. Hierarchical token pooling and asymmetric quantization compress late-interaction multimodal document embeddings by 255x while preserving over 95% of baseline nDCG@10. We contribute NeoMME to Hugging Face Transformers and release the pretrained backbone and retrieval-compatible checkpoints under Apache 2.0 at this https URL.
Subjects:
Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.01657 [cs.IR]
(or
arXiv:2609.01657v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.01657
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
24. 【2609.01655】From Feature Interaction to Feature Transport - A Unified Block for Scalable Recommendation Models
链接：https://arxiv.org/abs/2609.01655
作者：Zichen Luo,Jiachen Guo,Keming Gu,Jie Zhang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：sequential user behaviors, existing interaction-centric designs, mixing heterogeneous tokens, recommendation models aim, Unified recommendation models
备注： 13 pages, 8 figures, accept to KDDCUP2026 Workshop
点击查看摘要
Abstract:Unified recommendation models aim to jointly model non-sequential multi-field features and sequential user behaviors, but existing interaction-centric designs mainly focus on mixing heterogeneous tokens within each layer. We argue that scalable unified recommendation also requires controlling how intent information is carried, filtered, and preserved across stacked blocks. Inspired by flow-based representation dynamics, we introduce feature transport, a view that treats deep unified recommendation as a discrete context-conditioned representation evolution process. We propose CRAFT, a Contextual Residual Adaptive Feature Transport block, which summarizes non-sequential features into a reliability-aware contextual field and uses it to generate residual displacement and memory-preserving signals for intent and sequence representations. In this way, non-sequential context acts as an active controller of representation evolution rather than a passive object of interaction. In the TAAC2026 advertising recommendation competition, CRAFT achieves a test AUC of 0.838090, surpassing the previous leaderboard-best score of 0.83798. Scaling experiments further show that CRAFT benefits from both depth and width expansion: stacking CRAFT to six blocks improves test AUC to 0.838148, while increasing the hidden dimension reaches 0.838106. These results demonstrate the effectiveness, scalability, and generalization potential of the feature transport paradigm. Source code: this https URL
25. 【2609.01654】MELON: A Large-Scale Dataset for Multi-Event Text-to-Long-Video Retrieval
链接：https://arxiv.org/abs/2609.01654
作者：Chan Hur,SeungWoo Song,Jeong-hun Hong,Won Jun Oh,Hyeyoung Park,KyungTae Lim
类目：Information Retrieval (cs.IR)
关键词：Existing text-video retrieval, Existing text-video, datasets primarily consist, single dominant event, primarily consist
备注：
点击查看摘要
Abstract:Existing text-video retrieval datasets primarily consist of short-form clips containing a single dominant event. While suitable for measuring basic vision-language alignment, they are limited in capturing real-world retrieval scenarios, where long-form videos naturally contain multiple semantically distinct events and a single text query may correspond to several non-contiguous temporal segments. To bridge this gap, we introduce MELON, the first large-scale dataset designed to extend text-video retrieval to long-form videos featuring complex, multi-event structures. MELON explicitly annotates multiple event intervals per video along with their corresponding textual descriptions, enabling both training and evaluation of multi-event understanding in long, untrimmed videos. In addition, we propose a multi-event aware loss that encourages models to differentiate between full-event and partial-event matches, yielding substantial improvements in retrieval accuracy. Together, the MELON dataset and our proposed loss establish a robust foundation for expanding text-to-video retrieval to complex long-form scenarios and provide a more realistic evaluation setting for future research in the field.
26. 【2609.01652】Not All Matches Are Equally Valuable: An Online Experiment of Retention-Focused Recommendation in a Job-Matching Platform
链接：https://arxiv.org/abs/2609.01652
作者：Tatsuya Ute,Chiaki Ichimura,Yuta Saito
类目：Information Retrieval (cs.IR)
关键词：Recommender systems, two-sided matching platforms, systems in two-sided, commonly optimized, engagement signals
备注： RecSys in HR '26: The 6th Workshop on Recommender Systems for Human Resources, in conjunction with the 20th ACM Conference on Recommender Systems, September 28--October 2, 2026, Minneapolis, MN, United States
点击查看摘要
Abstract:Recommender systems in two-sided matching platforms are commonly optimized for immediate engagement signals such as click-through rate, reply rate, or the total number of successful matches. However, in real-world marketplaces, maximizing matches alone may be misaligned with business goals such as user churn rate and platform revenue, especially when users with fewer matches are at substantially higher risk of churn. In this paper, we study a real job matching platform and show that users with very few recent matches are indeed much more likely to leave the platform, while additional matches for already successful users provide limited marginal value for retention. Motivated by this empirical finding, we formulate a retention-aware recommendation problem and implement a simple post-processing method that adjusts the baseline match-focused ranking to prevent user churn. Specifically, the implemented method gives a score boost to churn-risk users with the goal of increasing their likelihood of obtaining matches and improving retention. We evaluate this practical approach in an online experiment on a real job-matching platform. The treatment group showed directionally lower user churn than the control group, although the estimated effect was not statistically significant at conventional levels, while company-side churn showed no evidence of deterioration. To our knowledge, this is among the first online experimental studies to investigate retention-focused recommendation in a real reciprocal job-matching platform.
27. 【2609.01645】he Vocabulary Gap Is an Equity Gap: Register Mismatch in Retrieval Systems for Public-Benefits Access
链接：https://arxiv.org/abs/2609.01645
作者：Krish Sapru
类目：Information Retrieval (cs.IR)
关键词：Retrieval-augmented question answering, navigate public-benefits eligibility, people navigate public-benefits, Retrieval-augmented question, non-native English
备注： 6 pages, 3 figures, 2 tables
点击查看摘要
Abstract:Retrieval-augmented question answering is increasingly used to help people navigate public-benefits eligibility, yet the documents these systems retrieve from are written in agency register while intended users often ask questions in plain, informal, or non-native English. We show that this register mismatch can turn a high-performing retrieval system into an inequitable one. We construct a controlled benchmark of 51 publicly documented federal benefit-eligibility rules and 25 information needs, each phrased in both agency register and plain user register while keeping the gold passage fixed. Across BM25, TF-IDF, and a term-graph retriever, formal-register evaluation is nearly perfect (Recall@5 96-100%), but plain-register retrieval collapses (Recall@5 36-44%). For BM25, Recall@1 falls from 84% to 16% and Recall@5 from 100% to 44%, a 56-point equity gap on identical information needs. We trace the mechanism to a measurable vocabulary gap: formal queries share 0.63 of their content terms with the gold passage, while plain queries share only 0.11, a 5.9x reduction. A deliberately simple, auditable plain-to-formal lexicon bridge recovers much of the failure, lifting plain-query BM25 Recall@5 from 44% to 80%. The contribution is not a new retriever; it is an evaluation protocol, benchmark, mechanistic diagnosis, and transparent mitigation for a high-stakes social-impact failure mode that standard retrieval evaluation hides.
28. 【2609.01642】Imagine Before Retrieval: Prospective Skill Retrieval for LLM Agents
链接：https://arxiv.org/abs/2609.01642
作者：Shuo Liu,Yutong Yang,Haohao Xiao,Mouxing Yang,Xi Peng
类目：Information Retrieval (cs.IR)
关键词：equipping large language, large language model, Skill retrieval, recently emerged, promising paradigm
备注：
点击查看摘要
Abstract:Skill retrieval has recently emerged as a promising paradigm for identifying the desirable execution guidelines from the skill gallery, thus equipping large language model (LLM) agents with the procedural knowledge to accomplish the specified task. To this end, most existing methods customize the retrieval model or reconfigure the retrieval pipeline to prioritize skills that are most semantically relevant to the task query. However, we empirically reveal that task queries and skills are naturally formulated from different perspectives, namely, objective-oriented and procedural-oriented, leading to an under-explored problem termed Query--Skill Misalignment (QSM). Clearly, it is daunting and even impossible to associate the desirable skills in the context of QSM, thus hindering the agent from correctly executing the task. As a remedy, inspired by human prospective cognition, we propose SkillDreamer, a novel framework to alleviate the negative impact of QSM problem. In brief, SkillDreamer first infers the capabilities necessary for task execution, then imagines how to realize these capabilities by generating pseudo skills, and finally leverages such prospective information to bridge the gap between objective-oriented task queries and execution-oriented skills. Extensive experiments on SkillRet and SkillUsage not only verify the effectiveness of SkillDreamer in both skill retrieval and end-to-end task execution, but also demonstrate its generalizability across diverse retrieval models and pipelines. The code will be released upon acceptance.
29. 【2609.01636】GRAND-HC: Graph-Refined Author Name Disambiguation
链接：https://arxiv.org/abs/2609.01636
作者：Yuanhao Sun,Zhouyang Jin,Yi Xu,Luoyi Fu,Jiaxin Ding,Xiaoying Gan,Xinbing Wang,Chenghu Zhou
类目：Information Retrieval (cs.IR)
关键词：From-Scratch Name Disambiguation, groups papers sharing, distinct real-world authors, sharing an ambiguous, distinct real-world
备注：
点击查看摘要
Abstract:From-Scratch Name Disambiguation (SND) groups papers sharing an ambiguous name into clusters of distinct real-world authors. Existing methods suffer from two critical limitations: (1) inherent long-tailed author distribution biases representation learning, causing over-merging of tail authors; (2) existing cluster number estimation methods are unreliable for long paper sequences, hindering large-scale deployment. We propose \textbf{GRAND-HC}, a complete end-to-end SND framework. We construct a heterogeneous paper graph via co-author, co-organization, and co-venue relations, using a graph attention network as the embedding backbone. \textbf{Harmony Contrastive Learning (HCL)} dynamically reweights training loss to suppress overfitting to prolific authors, learning discriminative embeddings. A \textbf{Graph-Refined Distance Matrix (GRDM)} leverages graph topology to optimize pairwise distances, further preventing tail author over-merging. Meanwhile, a lightweight \textbf{Paper Compression Module (PCM)} achieves accurate cluster number estimation across varying scales. Finally, Hierarchical Agglomerative Clustering outputs the final clusters. Extensive experiments demonstrate state-of-the-art macro F1 performance. GRAND-HC has been deployed in a billion-scale academic database. Source code: this https URL.
30. 【2609.01631】Graph Neural Team Recommendation: An Integrated Approach
链接：https://arxiv.org/abs/2609.01631
作者：Md Jamil Ahmed,Mahdis Saeedi,Hossein Fani
类目：ocial and Information Networks (cs.SI); Information Retrieval (cs.IR)
关键词：surely successful collaborative, successful collaborative team, optimal subset, Team recommendation aims, expert collaboration graph
备注：
点击查看摘要
Abstract:Team recommendation aims to select an optimal subset of experts who can form an almost surely successful collaborative team for a given set of required skills. State-of-the-art methods are neural multi-label classifiers that transfer dense vector representations of skills into a sparse occurrence vector representing the optimal subset of experts. Such methods, however, overlook experts' relational and structural information encoded in the expert collaboration graph and, thus, fall short of capturing complex inter-dependencies among experts and their associated skills within teams. Moreover, the skills' dense vectors are pretrained disjointly and independently of the underlying neural classifier, hence, preventing end-to-end optimization. In this paper, we propose to reformulate the team recommendation problem into end-to-end link predictions in the expert collaboration graph to consume multi-hop intra-team and cross-team collaborations among experts while eschewing the unnecessary complexities of the disjoint two-phase training procedure. Our experiments on two large-scale datasets from various domains with distinct distributions of skills in teams demonstrate the superiority of the end-to-end approach and establish a new state of the art. Our code is available at this https URL.
31. 【2609.01628】Marginal Expected Revenue for Jointly Ranking Auction and Fixed-Price Listings in E-Commerce Sponsored Search
链接：https://arxiv.org/abs/2609.01628
作者：Greg Kocher,Sanjana Arun
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：balance multiple objectives, allocating impression slots, ABIN listings, E-commerce search ranking, balance multiple
备注： Accepted at the SIGIR eCom'26 Workshop, July 24, 2026, Melbourne, Australia
点击查看摘要
Abstract:E-commerce search ranking must balance multiple objectives--relevance, user engagement, and platform revenue--when allocating impression slots to competing listings. Estimating the expected revenue component is well understood for fixed-price items, but becomes challenging when marketplace inventory includes mixed listing formats such as pure auctions and hybrid "Auction with Buy It Now" (ABIN) items, where prices evolve dynamically and the final transaction value is unknown at ranking time. Yet auction and ABIN listings account for a meaningful share of inventory and transaction volume on platforms such as eBay, and are a popular format for individual sellers and for unique items with unclear value. We extend the standard Expected Cost-per-Mille (eCPM) framework to auction and ABIN listings by deriving a marginal eCPM (meCPM) that captures the incremental value of showing one more impression of an item whose price is still evolving. The resulting formulation extends the familiar fixed-price eCPM--which is already inherently marginal--to auction dynamics, allowing unified ranking of fixed-price, auction, and ABIN listings under a single objective. We then describe a practical production implementation that approximates this objective, addressing cold-start challenges by bootstrapping from existing engagement models. Online A/B tests at a large e-commerce platform showed positive revenue gains and statistically significant improvements to user metrics, and the system was deployed to production.
32. 【2609.01627】he Utility of LLMs in Recommender Systems Explanation Evaluation
链接：https://arxiv.org/abs/2609.01627
作者：Kathrin Wardatzky,Oana Inel,Luca Rossetto,Abraham Bernstein
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：trustworthy recommender systems, creating trustworthy recommender, method presents challenges, recommender systems, presents challenges
备注： 10 pages, 5 figures, Accepted at ACM RecSys 2026
点击查看摘要
Abstract:Explanations play a crucial role in creating trustworthy recommender systems (RS), yet choosing a good explanation method presents challenges. Many explanation methods exist, but little guidance exists on which is best for which setting. Existing explanation generation methods often produce abstract outputs that require further formatting to become user-friendly, with a seemingly endless pool of options. Running user-based evaluations of all possible options is usually unfeasible, while automated evaluation metrics often either assess only the explainer's abstract output or require comparison with a ground truth, which is generally unavailable. Recent studies have shown that large language models (LLMs) can serve as ``judges'' for explanation evaluation, but their reliability has not yet been thoroughly explored. This paper studies the utility of LLMs in selecting an effective explanation method for a given application. We first explore their ability to generate explanation prototypes given varying information about the RS and the user. Specifically, we generate 18 distinct explanation prototypes, which are subsequently evaluated by 14 LLMs of varying sizes across two temperature settings. We compare these against human ratings derived from a user study. Our results show that while LLMs exhibit human-like rating patterns and achieve moderate rank correlation with human raters, their absolute rating agreement is low and varies substantially by model size and evaluation construct. We derive four practical recommendations: keep explanation-generation prompts concise, prefer larger models for evaluation, pre-test evaluation constructs, and audit explanations for factual accuracy, as neither humans nor LLMs reliably detect non-factual content.
33. 【2609.01622】RecEvolve: A Knowledge-Driven Autonomous Agent System for Recommender Systems
链接：https://arxiv.org/abs/2609.01622
作者：Weidi Pan,He Ma,Shuhao Ye,Palaksh Rungta,David McPeek,Junyi Jiao,Arnab Bhadury,Mingyan Gao,Onkar Dalal
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：production recommender models, opening new frontiers, rise of agentic, catalyzed a shift, shift toward self-iterating
备注： 8 pages, 4 figures, target conference: RecSys '26
点击查看摘要
Abstract:The rise of agentic AI has catalyzed a shift toward self-iterating systems, opening new frontiers for the autonomous optimization of production recommender models. This paper presents the empirical validation of a knowledge-driven autonomous agent system, deployed directly on a production large-scale Two-Tower retrieval model. By delegating the entire research lifecycle, spanning idea generation, code implementation, offline training, and metric evaluation, to a continuous closed-loop autonomous framework, the agent system executed over 40 completed autonomous training runs from scratch. Executing these runs under rigorous production-scale evaluations, the system systematically navigated hidden architectural bottlenecks on the latest production model to achieve a breakthrough ~20% relative improvement in NDCG, a gain that translated directly to a +3.77% increase in user satisfaction in live production traffic. Furthermore, the deployment exposed critical vulnerabilities in standard evaluation protocols, as the agent system autonomously discovered reward-hacking shortcuts. These findings prove that an autonomous pipeline can dramatically accelerate the pace of machine learning research and stress-test the rigorousness of underlying experimental infrastructure, while also exposing novel challenges such as reward hacking and redundant exploration of failed hypotheses.
34. 【2609.01621】When Literature Data Mislead Artificial Intelligence in Materials Discovery
链接：https://arxiv.org/abs/2609.01621
作者：Qian Wang,Ying Li,Ryuhei Sato,Hidemi Kato,Shin-ichi Orimo,Hao Li,Eric Jianfeng Cheng
类目：Information Retrieval (cs.IR); Materials Science (cond-mat.mtrl-sci); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG)
关键词：training predictive models, Artificial intelligence, increasingly treats scientific, treats scientific literature, increasingly treats
备注： 3 main figures, 2 supplementary tables, research article on data reliability for AI-driven materials discovery
点击查看摘要
Abstract:Artificial intelligence (AI) increasingly treats scientific literature as a data source for building databases, training predictive models, and guiding discovery. Yet literature-derived datasets often assume that reported experimental values are internally consistent and directly reusable. Here, we analyze this assumption using solid electrolyte (SE) conductivity data as a representative materials-science case. By tracing values from source articles to curated datasets, we identify recurrent text-figure mismatches, ambiguous axis annotations, unit inconsistencies, and missing measurement context. These discrepancies are often numerically plausible and therefore difficult to detect through routine preprocessing, but they can propagate as structured label noise during database construction and machine-learning reuse. A cross-database example shows how ambiguous reporting can create a 100-fold conductivity error. Our analysis reframes data accuracy as an infrastructure requirement for artificial-intelligence-driven discovery and motivates traceable reporting, curation, and validation practices for reusable scientific data. Keywords: AI for science; Data reliability; Scientific databases; Structured label noise; Literature-derived data; Materials informatics; Solid electrolytes
Comments:
3 main figures, 2 supplementary tables, research article on data reliability for AI-driven materials discovery
Subjects:
Information Retrieval (cs.IR); Materials Science (cond-mat.mtrl-sci); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG)
ACMclasses:
I.2.6; H.2.8; J.2
Cite as:
arXiv:2609.01621 [cs.IR]
(or
arXiv:2609.01621v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.01621
Focus to learn more
arXiv-issued DOI via DataCite</p>
35. 【2609.01619】MGDiff: Multi-Interest Sequence Recommendation with Masking GNN-Guided Diffusion
链接：https://arxiv.org/abs/2609.01619
作者：Wenjing Xiao,Hao Ding
类目：Information Retrieval (cs.IR)
关键词：Multi-Interest Sequence Recommendation, Sequence Recommendation Framework, bias-free user interest, Multi-Interest Sequence, underline
备注： 8 pages, 4 figures
点击查看摘要
Abstract:We propose a novel Multi-Interest Sequence Recommendation Framework with \underline{M}asking \underline{G}NN-Guided \underline{Diff}usion Model (MGDiff), designed to generate accurate, bias-free user interest information during the diffusion process. First, we propose a semantics-enhanced Dual-layer Semantic Guidance (DSG) framework, which decomposes guidance into two synergistic stages: extracting latent item semantics and decoupling multidimensional user intent. We design a Weight-adaptive Masking Graph Neural Network reconstructs missing links to uncover deep item relationships beyond superficial co-occurrence, while a Dynamic Multi-Expert Network projects user preferences into distinct semantic subspaces to suppress irrelevant interference. This hierarchical design yields structured guidance that significantly improves the generation accuracy of diffusion models. Second, We propose a Popularity-Aware Guidance (PAG) mechanism that performs spatial geometric adjustments on the outputs of diffusion models: by using item popularity as a differentiable adjustment signal to recalibrate similarity metrics, we enable DMs to generate diverse recommendations free from popularity bias. Finally, we compare MGDiff with multiple baseline models across four widely used datasets, demonstrating its superior performance and validating its effectiveness.
36. 【2609.01618】Multi-Agent Retrieval-Augmented Generation for Efficient Cloud Knowledge Base Search in Telecom SNOC Environment
链接：https://arxiv.org/abs/2609.01618
作者：Harish Saragadam,Sudhanshu Sharma,Ipsha Routray
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Standard Operating Procedures, Network Operations Centers, including Standard Operating, uninterrupted network operations, maintain uninterrupted network
备注：
点击查看摘要
Abstract:Telecom Service and Network Operations Centers (SNOCs) rely on large collections of cloud documents, including Standard Operating Procedures (SOPs), vendor technical manuals, incident reports, and configuration guides, to maintain uninterrupted network operations. During critical incidents, engineers must quickly retrieve accurate information, yet traditional keyword based and single stage retrieval approaches often struggle to provide precise results. This paper presents Athena for Cloud Knowledge Base, a fully offline, multi agent Retrieval Augmented Generation (RAG) framework designed for enterprise cloud document search in Vodafone Idea's SNOC environment. The system integrates dense retrieval using E5 Large V2 embeddings, BM25 sparse retrieval, and Knowledge Graph expansion within a LangGraph based orchestration framework. Retrieved candidates are fused using Weighted CombSUM, followed by cross encoder reranking and Maximal Marginal Relevance (MMR) to obtain a diverse and relevant evidence set. To improve answer reliability, the framework performs per chunk LLM evaluation with explicit attribution verification, assessing each MMR selected chunk independently before generating a response. Unsupported or weak evidence is discarded, and if no chunk satisfies the verification criteria, the system automatically evaluates multiple chunks together as a fallback. Experiments on a corpus of 4200 SNOC cloud documents containing 312000 indexed chunks show that the proposed approach achieves an MRR at 10 of 0.910 and an Exact Match (EM) score of 78.4 percent, outperforming single stage dense retrieval by 14.6 percentage points. The entire pipeline operates in a fully offline environment, satisfying enterprise data sovereignty requirements while delivering accurate and grounded responses for cloud document search.
Subjects:
Information Retrieval (cs.IR); Machine Learning (cs.LG)
Cite as:
arXiv:2609.01618 [cs.IR]
(or
arXiv:2609.01618v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.01618
Focus to learn more
arXiv-issued DOI via DataCite</p>
37. 【2609.01617】Hybrid Retrieval-Augmented Generation with Knowledge Graph Expansion, RRF Fusion, and Per-Chunk Grounded Evaluation for Enterprise Document Search
链接：https://arxiv.org/abs/2609.01617
作者：Harish Saragadam,Sudhanshu Sharma,Meghana Pujari
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：large enterprise document, enterprise document repositories, Knowledge Graph, Reciprocal Rank Fusion, document repositories
备注：
点击查看摘要
Abstract:Getting accurate, grounded answers out of large enterprise document repositories is a difficult problem. Dense vector retrieval alone frequently performs poorly on queries that mix technical terminology, vendor-specific acronyms, or require reasoning across several non-adjacent sections. DocuSearch was built to address exactly this gap - an offline, multi-agent document intelligence system developed and evaluated in a production telecom network operations environment. Rather than relying on a single retrieval signal, DocuSearch pulls together three complementary sources of evidence: semantic search over a Qdrant vector store using BGE-Large embeddings, BM25 full text search over an SQLite FTS5 index, and Knowledge Graph neighbour expansion from a structured edge table. These three ranked lists are merged through Reciprocal Rank Fusion with signal weights of 0.50 for vector search, 0.35 for BM25, and 0.15 for the knowledge graph, using a smoothing constant of 60 to stabilize scores. A cross-encoder then reranks the fused list, and Maximal Marginal Relevance with a balance factor of 0.65 prunes results for relevance and diversity. What makes DocuSearch distinctive is a per-chunk evaluation loop treating each chunk as its own mini-retrieval problem: an LLM decides whether the chunk needs more context, whether it fully answers the query, and whether the answer is grounded in retrieved text. Ungrounded answers are not returned; the system falls back to a multi-chunk merge instead. On a telecom corpus, DocuSearch reaches Precision@10 of 0.69, Recall@10 of 0.79, and a grounding rate of 89.6% - gains of 15, 16, and 18.4 percentage points over a dense-only RAG baseline. Index Terms: retrieval-augmented generation, knowledge graph, reciprocal rank fusion, enterprise document search, agentic evaluation, BM25, cross-encoder reranking, on-premise deployment, LangGraph, telecom AI.
38. 【2609.01616】Incident Memory: Training-Free Operational Memory through Sequential Pattern Mining and Velocity-Stratified Retrieval
链接：https://arxiv.org/abs/2609.01616
作者：Adarsh Agrawal,Rahul Suresh Babu
类目：Information Retrieval (cs.IR)
关键词：teams accumulate tickets, wiki pages, provenance intact, rarely stored, memory problem
备注： 14 pages, 5 figures, 8 tables (main text); includes appendix
点击查看摘要
Abstract:Incident response is a memory problem: teams accumulate tickets, traces, postmortems, and wiki pages, but the knowledge needed for the next incident is rarely stored with its order, freshness, and provenance intact. We present Incident Memory, a deterministic system that accumulates operational knowledge without model training. It combines (i) velocity-stratified retrieval, which ages structural, behavioral, contextual, and ephemeral facts at different rates; (ii) fingerprint-conditioned PrefixSpan mining, which extracts ordered playbooks from successful investigations; and (iii) provenance-aware metric definitions, which detect conflicting definitions through executable checks. On the UCI ITSM event log, containing 141,712 events across 24,918 incidents, Incident Memory extracts 23,110 ordered traces, mines 39 playbooks, and covers 84.3% of 6,934 held-out incidents. On controlled benchmarks with known ground truth, it achieves 99.2% ordered playbook precision (controlled), an architectural staleness guarantee versus 36% stale returns for a flat baseline, and conflict-detection F1 of 0.876. A direct Claude Haiku baseline on 19 fingerprint groups reaches 0.661 ordered precision, compared with 0.985 for PrefixSpan. The central result is not that language models are weak at incident response; it is that repeated incident histories are low-entropy once conditioned on fingerprint and previous action. In that regime, exact memory is a stronger primitive than open-ended generation.
39. 【2609.01613】Skim and Skip: Hierarchical Adaptive Inference for Efficient Multimodal Retrieval
链接：https://arxiv.org/abs/2609.01613
作者：Meng Gao,Yizhen Zhang,Yang Ding,Ziqi Dai,Shuoshuo Zhang,Junjie Wang,Taiqiang Wu,Chufan Shi,Lei Ji,Jian Jiao,Linfeng Zhang,Yeyun Gong,Yujiu Yang
类目：Information Retrieval (cs.IR)
关键词：Universal multimodal retrieval, large language models, increasingly adopts multimodal, unified embedding backbones, substantial inference cost
备注：
点击查看摘要
Abstract:Universal multimodal retrieval (UMR) increasingly adopts multimodal large language models (MLLMs) as unified embedding backbones, but their strong retrieval performance comes at substantial inference cost. Existing methods typically rely on uniformly dense inference, where all input tokens are processed through the entire model and matched using the final-layer [EOS] representation. However, this paradigm overlooks two key forms of heterogeneity in multimodal retrieval: token contributions to the final retrieval embedding are highly uneven, and different queries require markedly different amounts of inference depth. To address this, we propose Skim and Skip (SAS), a hierarchical adaptive inference framework for efficient multimodal retrieval. SAS first performs token-level evidence selection to preserve only the input information most relevant to the final retrieval embedding, and then performs depth-adaptive inference to determine whether the current representation is already sufficient for reliable matching. Experiments on 12 MMEB retrieval tasks show that SAS retains about 99% of the dense baseline's average retrieval performance while achieving up to 1.64 times end-to-end speedup and up to 66.3% FLOPs reduction.
40. 【2609.01612】MESSY STREETS: A Benchmark for Geocoding Real-World Addresses
链接：https://arxiv.org/abs/2609.01612
作者：Edward Gaere,Florian von Wangenheim
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：introduce MESSY STREETS, MESSY STREETS, introduce MESSY, verbatim web addresses, surface-form divergence
备注：
点击查看摘要
Abstract:We introduce MESSY STREETS, a benchmark for evaluating geocoders on verbatim web addresses, with existence verification and controlled measurement of surface-form divergence. Unlike conventional benchmarks based on clean or synthetically perturbed addresses, MESSY STREETS contains addresses whose surface forms diverge from canonical representations and whose components may be missing, repeated, malformed, or incomplete. The benchmark is constructed from the December 2024 Web Data Commons corpus, with reference locations established from OpenAddresses or OpenStreetMap. The strongest commercial geocoders outperform open-source systems by up to 49 percentage points in recall. This gap is driven primarily by differences in candidate return rates on non-canonical addresses; once a candidate is returned, positional accuracy is broadly comparable across systems. Non-canonical surface form alone accounts for up to 25 percentage points of recall loss. Examining Nominatim's query-processing pipeline, we show that its conjunctive matching lets a single unrecognised token zero an otherwise valid query. The results demonstrate that geocoder choice is a consequential design decision for applications processing noisy address data, and that normalisation and preprocessing could substantially narrow the gap between open-source and commercial geocoders.
Subjects:
Information Retrieval (cs.IR); Computation and Language (cs.CL)
Cite as:
arXiv:2609.01612 [cs.IR]
(or
arXiv:2609.01612v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.01612
Focus to learn more
arXiv-issued DOI via DataCite</p>
41. 【2609.01610】Making Revisions Understandable: A Survey of Edit Intentions, Methods, and Applications
链接：https://arxiv.org/abs/2609.01610
作者：Fangping Lan,Qi Zhang,Eduard Dragut
类目：Information Retrieval (cs.IR)
关键词：authors iteratively refine, improve written content, capturing how authors, iteratively refine, written content
备注： 17 pages, 6 figures, 4 tables, accepted by Findings of ACL 2026
点击查看摘要
Abstract:Text revision is a core process in document creation, capturing how authors iteratively refine, reorganize, and improve written content. With the increasing availability of large-scale revision histories from platforms such as Wikipedia and arXiv, NLP research has begun to move beyond modeling what changes are made to understanding why they are made, i.e., the underlying edit intentions. To our knowledge, this is the first survey that synthesizes text revision research through the lens of edit intentions, providing a unified view of datasets, taxonomies, identification methods, and applications. We review prior work across the full revision workflow, including revision corpus construction, edit intention taxonomy design, and edit intention identification. We further categorize representative datasets and methods, summarize downstream applications such as writing assistance and document edit summarization, and highlight key open research directions.
计算机视觉
1. 【2609.02886】SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models
链接：https://arxiv.org/abs/2609.02886
作者：Junchao Huang,Guian Fang,Shengju Qian,Xianghao Kong,Zhuoran Zhao,Wei Huang,Yihua Du,Zixin Zhang,Justin Cui,Yuchao Gu,Yukang Chen,Xinting Hu,Tianyu He,Shaoshuai Shi,Zhuotao Tian,Xin Wang,Mike Zheng Shou,Li Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fully open foundation, video world models, building interactive video, interactive video world, fully open
备注： [this https URL](https://junchao-cs.github.io/SolarWM-Web/)
点击查看摘要
Abstract:We introduce SolarWM, a fully open foundation for building interactive video world models from data preparation through long-horizon inference. Training across heterogeneous data sources and video backbones is challenging: datasets differ in temporal scale, camera geometry, visual quality, motion, and captioning styles, while video generators use distinct representations and architectures. Naive data mixing and model-specific implementations therefore produce inconsistent supervision and make results difficult to reproduce and compare. SolarWM addresses this coupling with a reconfigurable multi-source data engine and a backbone-native adaptation framework. The engine converts 1.43 million canonical clips from 10 datasets into a unified, frame-aligned contract covering visual observations, metric camera geometry, captions, quality metadata, selection decisions, and provenance, while decoupling source processing from mixture construction. Under shared camera-conditioning, training, and inference interfaces, we instantiate four 5B--33B models based on Wan2.2, LTX-2.5, and MiniMax-H3 while preserving their native representations and objectives. A unified three-stage recipe combines bidirectional adaptation, teacher-forced autoregressive initialization, and distribution matching distillation. The resulting causal models enable real-time interaction over rollouts ranging from minutes to hours after being trained on only 5s sequences. By releasing the resulting data, pipeline, recipes, weights, and framework, SolarWM provides a reproducible and extensible foundation for interactive world-model research.
2. 【2609.02864】hinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation
链接：https://arxiv.org/abs/2609.02864
作者：Yutong Liu,Nan Huang,Xu Cao,James M. Rehg
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved unprecedented results, Recent advancements, perception and synthesis, advancements in unified, achieved unprecedented
备注：
点击查看摘要
Abstract:Recent advancements in unified generative models (UGMs) and world simulators have achieved unprecedented results in visual perception and synthesis. However, these models primarily rely on surface-level event alignment, leaving the capacity for high-level visual reasoning underexplored. True visual generative intelligence demands "Reasoning-to-Generation", an ability to infer latent rules from visual inputs and manifest solutions through precise, logically constrained visual outcomes. We introduce RIG-BENCH, a novel comprehensive benchmark that systematically evaluates Reasoning-driven Image Generation (RIG) across four cognitively demanding domains: Concept-based, Transformation-based, Pattern Structure, and Scenario-based. Featuring 2000 curated samples, RIG-BENCH serves as a rigorous stress test for RIG. Our extensive evaluations of state-of-the-art UGMs and image/video generation models reveal a significant reasoning-generation gap, wherein models frequently produce locally plausible but globally illogical outputs. RIG-BENCH provides a vital diagnostic framework to guide the development of next-generation, logically grounded UGMs and world simulators.
3. 【2609.02860】PlantC2USeg: Cross-Scale Consistent Pre-Training for Few-Shot Unified Plant Point Cloud Segmentation
链接：https://arxiv.org/abs/2609.02860
作者：Yu Tian,Xintong Jiang,Jan Franklin Adamowski,Shiv O. Prasher,Shangpeng Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern crop breeding, point cloud segmentation, crop breeding demands, breeding demands precise, demands precise organ-level
备注： 27 pages, 20 figures
点击查看摘要
Abstract:Modern crop breeding demands precise organ-level analysis for trait quantification, making plant point cloud segmentation (PPCS) increasingly important. However, conventional deep learning approaches rely heavily on densely annotated datasets that are labor-intensive to acquire. Unified PPCS adaptation from distribution-shifted examples with minimal additional training remains challenging. To address this, we propose PlantC2USeg, a deep transfer learning framework featuring cross-scale consistency learning to explicitly align features across spatial scales and an information-restricted decoding strategy that prevents reconstruction shortcuts and promotes robust adaptation. The resulting pre-training enables stable few-shot generalization across species and sensing conditions, while unified fine-tuning with inherited thresholds further reduces adaptation overhead. Under full supervision on Soybean3D, PlantC2USeg achieves the highest semantic IoU and instance mWCov among compared methods, at 91.91% and 94.62%. With 20 labeled samples, it leads both metrics at 89.78% and 90.27%; with only 10 samples, it retains the highest mWCov of 83.23% while achieving 83.19% IoU. Across HR3D, 10-shot transfer to tobacco, tomato, and sorghum averages 78.41% IoU and 79.42% mWCov, while 22-shot transfer to SYAU-Maize achieves the highest IoU and mRec at 92.75% and 93.51%. Furthermore, a leading category-averaged mIoU of 85.0% on ShapeNet Part demonstrates the framework's capability to handle diverse shape variations beyond agricultural domains. These results demonstrate that PlantC2USeg reduces overall adaptation effort under distribution shifts, enabling scalable plant phenotyping and transferable 3D representation learning beyond agriculture.
4. 【2609.02854】MuyBridge: Mobile Human Center-of-Mass Estimation from Monocular Video via Sparse Fusion
链接：https://arxiv.org/abs/2609.02854
作者：Aidan Bradshaw,Marco Giordano,David Rode,Andreas Habersack,Elif Basokur,Annika Kruse,Markus Tilp,Michele Magno,Peter Wolf,Luca Benini,Christoph Leitner
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multi-view triangulation methods, mesh recovery, analysis of sport, methods either optimize, keypoint accuracy
备注：
点击查看摘要
Abstract:The 3D center of mass (CoM) is a primary quantity in the biomechanical analysis of sport, rehabilitation, and clinical movement, yet existing 3D pose tracking, mesh recovery, and multi-view triangulation methods either optimize 3D keypoint accuracy without anatomical constraints or carry compute and capture infrastructure too heavy to deploy where CoM tracking is most useful. As a result, the metric CoM remains difficult for coaches and movement analysts to measure from a single camera where athletes train and compete. In this work, we introduce MuyBridge, an on-device system that estimates the athlete's segmental center of mass trajectory from a single phone camera video stream. MuyBridge couples a compact 2D pose network and a distilled single-step monocular depth network through an analytic metric fusion that uses anatomical and physical priors to anchor the metric CoM, requiring no 3D or task-specific supervision. Evaluated on the athletic movements of AthletePose3D (running, track and field, and figure skating), MuyBridge achieves 33-41 mm vertical CoM error and 2.3-6.6% absolute-relative range error (AbsRel) under a one-time calibration, and produces CoM estimates at the 63 FPS pose-estimation rate using asynchronous 2.86 Hz depth updates on iPhone 15. Code is available at: this https URL
5. 【2609.02847】RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation
链接：https://arxiv.org/abs/2609.02847
作者：Xiaolei Lang,Ze Kang,Zehao Huang,Naiyan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：motivating recent hybrid, unobserved regions, motivating recent, recent hybrid methods, generative priors
备注：
点击查看摘要
Abstract:Novel view synthesis from sparse inputs requires both geometric grounding from the observed views and generative priors of unobserved regions, motivating recent hybrid methods that combine reconstruction and generation. However, existing methods bridge the two with rendered images or explicit 3D representations such as point maps or 3D Gaussians. Generation is thus conditioned on a lossy and imperfect projection of the scene, inheriting its errors, and reconstruction receives no signal from generation to correct them. We present RoGe, an end-to-end unified reconstruction and generation framework that removes this explicit bridge. It targets roaming within a scene anchored by sparse views: given a few posed images and a camera trajectory, it synthesizes a temporally coherent video along that trajectory. From the sparse input views, RoGe builds an implicit scene representation with a feed-forward reconstruction model, and queries it with target camera rays to obtain per-view geometric features. These features are injected into a video diffusion model as conditioning, without any 3D intermediate. Both modules are trained jointly, so the generation objective directly shapes its own geometric conditioning. We conduct experiments on DL3DV, where RoGe outperforms reconstruction-based, generation-based, and hybrid baselines on image-level metrics and video-level temporal consistency. Ablations confirm that ray-queried implicit features outperform both raw reconstruction tokens and rendered RGB as conditioning, and that joint training brings further gains.
6. 【2609.02839】Efficient All-in-One Weather Restoration using Spectral Harmonization
链接：https://arxiv.org/abs/2609.02839
作者：Paula Garrido-Mellado,Daniel Feijoo,Yuning Cui,Alvaro Garcia,Marcos V. Conde
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Adverse weather conditions, snow significantly degrade, significantly degrade image, Adverse weather, posing challenges
备注： Technical Report
点击查看摘要
Abstract:Adverse weather conditions such as rain, haze, and snow significantly degrade image quality, posing challenges for both human perception and physical AI. Existing restoration methods require large computational budgets, struggling to process high-resolution images and handle different degradations. In this paper, we present Frequency Reconstruction via Spectral Harmonization, a novel lightweight all-in-one restoration method that explicitly decomposes feature representations into high- and low-frequency components at each scale of a hierarchical encoder-decoder architecture. By combining spectral decomposition with spatial processing through Fourier-based skip connections, FReSH-IR captures complementary frequency information without sacrificing spatial detail. Our approach achieves similar restoration quality with 80% fewer parameters and operations than transformer-based models. Extensive experiments demonstrate that our method offers a great efficiency-performance trade-off, highlighting its practical applications in constrained-resource systems.
7. 【2609.02831】Benchmarking RAW and RGB Restoration in Image Signal Processors
链接：https://arxiv.org/abs/2609.02831
作者：Zihao Lu,Radu Timofte,Marcos V. Conde
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern cameras transform, cameras transform RAW, transform RAW sensor, RAW sensor measurements, Modern cameras
备注： Accepted BMVC 2026: The 37th British Machine Vision Conference
点击查看摘要
Abstract:Modern cameras transform RAW sensor measurements into sRGB images through an image signal processor (ISP). We benchmark two placements for blind restoration around a fixed ISP: (A) pre-ISP restoration in the RAW domain and (B) post-ISP restoration in the sRGB domain. The benchmark covers four smartphone device groups, two learned ISPs, three degradation regimes--noise, blur, and joint noise and blur--, and several representative RAW and RGB restoration models. Our results show that placement alone does not determine performance. The RAW restoration strategy outperforms the best generic RGB restoration models. However, RGB restoration models trained considering the ISP transformations, achieve the best overall performance. Our novel benchmark demonstrates that the image reconstruction performance strongly depends on the alignment between the restoration model and the target imaging pipeline. We consequently recommend reporting restoration placement and ISP-aware supervision as key experimental factors. Our code is available at this https URL
8. 【2609.02813】GDB-Reward: From Evaluation Metrics to Training Rewards for Graphic Design
链接：https://arxiv.org/abs/2609.02813
作者：Adrienne Deganutti,Purvanshi Mehta,Simon Hadfield,Andrew Gilbert
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：satisfying precise constraints, natural image synthesis, constraints on typography, visual communication, excel at natural
备注：
点击查看摘要
Abstract:Text-to-image models excel at natural image synthesis but struggle with graphic design, where success depends on satisfying precise constraints on typography, layout, color, and visual communication. While prompt optimization offers an attractive alternative to expensive diffusion model fine-tuning, learning prompts for frozen image generators requires informative reward functions despite the entirely non-differentiable generation process. Reinforcement learning does not require differentiable objectives; it requires only scalar rewards capable of ranking candidate outputs. This raises a simple question: can design evaluation metrics themselves become reinforcement learning rewards? Our central contribution is GDB-Reward, a framework that systematically transforms heterogeneous graphic design evaluation metrics into a unified reinforcement learning reward. Experiments demonstrate that GDB-Reward provides an effective optimization objective, substantially improving adherence to the design specification in perceptual quality, rendering fidelity, and spatial accuracy while keeping the image generator entirely frozen. More broadly, our results demonstrate that heterogeneous, non-differentiable evaluation metrics can move beyond passive benchmarking to become effective optimization objectives for reinforcement learning in domains where differentiable supervision is unavailable.
9. 【2609.02798】AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels
链接：https://arxiv.org/abs/2609.02798
作者：Javier Tirado-Garín,Alan Savio Paul,Shuai Chen,Axel Barroso-Laguna,Tommaso Cavallari,Daniyar Turmukhambetov,Victor Adrian Prisacariu,Eric Brachmann
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Neural map matchers, map matchers estimate, Neural map, map matchers, training neural map
备注： ECCV 2026
点击查看摘要
Abstract:Neural map matchers estimate an image's 3-DoF pose relative to a 2D map. These models are trained on large-scale datasets of geo-referenced images, whose position and heading labels often contain noise that affects the trained models. To address this, we present AutoCompass, a supervision approach for training neural map matchers from inaccurate absolute pose labels. First, we show that heading labels are unnecessary: trained from raw GPS labels, models learn to predict accurate headings, automatically. Second, defining a tolerance region around raw GPS improves positional accuracy. Third, if available, our supervision uses relative poses between training images, obtained via SLAM or SfM, which provide a more accurate training signal. Across driving and egocentric benchmarks, AutoCompass consistently outperforms counterparts trained with the usual strong reliance on absolute pose labels.
10. 【2609.02780】ShallowStream: Index Shallow then Answer Deep for Streaming Video Understanding
链接：https://arxiv.org/abs/2609.02780
作者：Jitai Hao,Ke Yang,Qiang Huang,Jun Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：including embodied intelligence, Streaming video understanding, autonomous driving, industrial monitoring, real-world applications
备注： Work in Progress
点击查看摘要
Abstract:Streaming video understanding is a critical capability for real-world applications, including embodied intelligence, autonomous driving, industrial monitoring, surveillance and early warning, and wearable assistants. However, processing continuous video streams with multimodal large language models (MLLMs) is computationally expensive. Existing efforts have explored reducing streaming overhead through visual token pruning, token merging, quantization, on-demand frame retrieval, and context offloading. However, most existing methods overlook the dimension of model depth. Repeatedly executing full-depth MLLM prefill over incoming frames is prohibitively expensive, incurring substantial computational overhead and causing the KV cache to grow at a rate directly proportional to the prefill depth. To address these challenges, we propose ShallowStream, a novel framework that leverages the shallow layers of an MLLM to simultaneously perform frame encoding and retrieval index building. During stream processing, ShallowStream maintains an always-on lightweight index using the KV cache of shallow layers. During query-time answering, we leverage the attention scores generated by the shallow layers to score context frames and employ a diversity-aware selection strategy to retrieve precise and comprehensive evidence. ShallowStream achieves performance on par with the strongest existing streaming methods, while reducing per-frame prefill latency and 10-second end-to-end latency by up to 52.1x and 11.9x, respectively. Our code is available at this https URL.
11. 【2609.02776】Video-Based Palm-Vein Authentication under Challenging Conditions
链接：https://arxiv.org/abs/2609.02776
作者：Xiaofeng Yan,Kechen Liu,Abhilash Venkatesh,Cathy Zhang,Xia Zhou,Salvatore Stolfo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Columbia University Palm-vein, contactless authentication, biometrics are increasingly, Palm-vein biometrics, University Palm-vein
备注：
点击查看摘要
Abstract:Palm-vein biometrics are increasingly used for secure, contactless authentication. Yet real-world deployment exposes them to surface noise (sweat, dirt), illumination and motion variation, and temperature-driven changes in vascular visibility, which remain underexplored for lack of data captured under such conditions. To study these effects, we introduce the Columbia University Palm-vein (CUP) dataset, to our knowledge the first public video-based palm-vein dataset. CUP records every palm under four surface conditions (a clean baseline, warm, wet, and dirty) and pairs each subject with physiological and demographic metadata. On it we benchmark twenty-one recognizers spanning static, video, and multi-frame aggregation architectures. Models that verify reliably on clean palms lose most of their accuracy on dirty ones, and the mean equal error rate (EER) roughly quadruples. We recover much of that robustness along both axes of the capture. Temporally, a consensus over the few frames the sensor already returns cancels transient corruption; spatially, a test-time matcher that adds no learned parameters fuses the global cosine with a saliency-steered region-level optimal transport that routes the comparison around corrupted regions. The full design leads on every surface of CUP in EER, TAR@FAR=0.01, and Rank-1, at 4.3M parameters and 3.1 GFLOPs, a fraction of the video models' cost. Attached to four frozen state-of-the-art backbones it cuts their mean EER by 29-37% without retraining, and on four public single-image datasets the regional matching alone still helps. A preliminary audit across ten demographic and physiological traits finds two warm-condition gaps, along body water and gender, that survive multiple-comparison correction. CUP will be released for non-commercial research use at this https URL upon publication.
12. 【2609.02751】Multi-Tool Image Editing Attribution in Facial Forgery
链接：https://arxiv.org/abs/2609.02751
作者：Sheng Liu,Qiang Sheng,Danding Wang,Yu Li,Chenming Zhou,Juan Cao
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：easily edit portrait, edit portrait images, image editing attribution, editing, editing tools
备注： Accepted to ACM Multimedia 2026 (MM 2026)
点击查看摘要
Abstract:As generative AI tools become increasingly powerful and easy to use, people can easily edit portrait images with a prompt, necessitating the task of image editing attribution, which predicts the involved editing tools from the given image. Existing attribution methods hold the single-tool assumption and can only attribute a specific editing tool, but struggle to handle the more complex and increasingly common multi-tool editing scenarios, where artifacts left by different editing tools are composite and overlapped. To address this gap, we explore Multi-Tool Image Editing Attribution (MIEA), which aims to identify multiple editing tools involved in a multi-tool edited facial image. To simulate the real-life editing operations on facial images, we then construct a new dataset, MultiEdit, which contains 500k+ edited facial images and covers six types of editing tools that support face swapping (Deepfake) and various facial enhancements. Inspired by the findings from data analysis, we design DPEC, a multi-tool attribution method that can capture distinguishable, locality-aware editing tool traces from both spatial and frequency domains with the support of an error-based curriculum learning strategy. Experiments show \Method\ outperforms nine methods for facial images edited in at most five steps.
13. 【2609.02748】Balancing Frequencies and Pixels in Flow Matching
链接：https://arxiv.org/abs/2609.02748
作者：Lucas Degeorge,Paul Couairon,Arijit Ghosh,Alexei A. Efros,David Picard,Vicky Kalogeiton
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Natural images follow, perceptually important structures, edges occupy sparse, Natural images, sparse high-frequency bands
备注：
点击查看摘要
Abstract:Natural images follow a $1/f^2$ spectral distribution: most signal energy lies in the low spatial frequencies, while the perceptually important structures such as textures and edges occupy sparse high-frequency bands. Pixel-space reconstruction objectives, however, treat all spatial errors uniformly, causing low frequencies to dominate the optimization signal and delaying the learning of fine-scale details. In this work, we identify this objective-level spectral imbalance as a key inefficiency in training pixel-space flow models. To address it, we propose a Focal Log-Frequency Loss (f-loss), a spectrally balanced objective that equalizes the learning signal across frequencies, emphasizing high-frequency components that are otherwise underrepresented in pixel-space objectives. Building on this, we introduce a simple training strategy that combines frequency and pixel supervision: we first emphasize frequency-domain learning early to capture all frequencies, and then transition to standard pixel-space v-loss for spatial refinement. This balancing mitigates the low-frequency bias of pixel losses and aligns the training signal with the evolving needs of the model. Our approach is conceptually simple, requires no architectural changes, and acts as a drop-in replacement for flow matching losses. Across multiple model scales, it accelerates convergence by up to 40% while consistently improving FID and perceptual fidelity. We will release code and models.
14. 【2609.02747】InceptionGS: Generative Bootstrapping for Large-Scale Gaussian Splatting under Unstructured View Sampling
链接：https://arxiv.org/abs/2609.02747
作者：Tianheng Lu,Guangyu Wang,Ruqi Huang,Lu Fang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：digitization necessitates consistent, visually pleasing rendering, Achieving truly immersive, scene digitization necessitates, immersive large-scale scene
备注：
点击查看摘要
Abstract:Achieving truly immersive large-scale scene digitization necessitates consistent and visually pleasing rendering across all possible viewing perspectives. However, collecting multi-view images covering every fine detail of a large-scale scene is prohibitive due to scene complexity, capture cost, negligence, or accessibility constraints. As a result, the sampled views tend to be highly unstructured -- the majority of the scene is well covered yet certain regions inevitably lack sufficient observations. Existing reconstruction based methods are vulnerable to view scarcity while generation based approaches suffer from generalization, controllability, and 3D consistency issues. To address this challenge, we propose InceptionGS, which bootstraps Gaussian splatting by subtly balancing reconstruction and generation. Starting from an initial Gaussian splatting, InceptionGS reasonably rethinks and repairs problematic regions caused by view scarcity while preserving the quality elsewhere, by softly incorporating scene- and view-adaptive generative priors. Extensive experiments on real-world large-scale scenes demonstrate the superiority and broad applicability of our approach in handling unstructured imagery and boosting high-fidelity Gaussian splatting. Please refer to the supplementary video for better visual demonstrations.
15. 【2609.02731】RVSD: Retrieval Vision Sparse Decoding for Mitigating Visual Hallucinations in Large Vision-Language Models
链接：https://arxiv.org/abs/2609.02731
作者：Canjie Liu,Jiawen Kang,Jinbo Wen,Zishao Zhong
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large vision-language models, achieved remarkable success, Large vision-language, vision-language tasks, vision-language models
备注：
点击查看摘要
Abstract:Large vision-language models have achieved remarkable success in vision-language tasks. However, they remain prone to Visual Hallucinations (VHs), undermining their reliability in real-world applications. Existing solutions typically require curated datasets, additional training, or multi-round decoding, resulting in considerable computational overhead. In this paper, we propose \textbf{RVSD} (\underline{R}etrieval \underline{V}ision \underline{S}parse \underline{D}ecoding), a training-free and plug-and-play decoding framework that, for the first time, unifies token sparsification and \textbf{Semantic-Space Visual Retrieval} (SSVR) within a single decoding pass. Within RVSD, we introduce a \textbf{semantics-directed token selection} strategy that selectively sparsifies redundant tokens while preserving critical visual information. We further propose the SSVR mechanism, which reformulates visual compensation as an on-demand cross-modal retrieval process within a shared semantic space. Extensive experiments demonstrate that RVSD achieves state-of-the-art performance in mitigating VHs while maintaining robust suppression capabilities under long-context generation settings. Our code is available here.\footnote{this https URL}
16. 【2609.02717】MV-dVRK: A Multi-Viewpoint Benchmark for Spatial Surgical Perception
链接：https://arxiv.org/abs/2609.02717
作者：Guido Caccianiga,Sergey Prokudin,Yutong Chen,Bernard Javot,Rachael L'Orsa,Omer Burak Aladağ,Yarden Sharon,Jens Rolinger,Ivan Capobianco,Anton Deguet,Siyu Tang,Katherine J. Kuchenbecker
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：refined optimization techniques, greatly improved sparse, Large-scale training, improved sparse multi-view, training and refined
备注：
点击查看摘要
Abstract:Large-scale training and refined optimization techniques have greatly improved sparse multi-view 3D reconstruction. Despite their relevance to surgery, such methods have never before been rigorously evaluated on real endoscopic images. Current clinical telerobots deploy a single stereo camera inside the patient, making multi-viewpoint data extremely rare. This paper presents MV-dVRK, the first ex-vivo surgical dataset to combine multiple exposure-synchronized stereo viewpoints with accurate surface geometry and camera poses. The static subset of the benchmark provides dense SfM reference geometry, validated against an industrial 3D scanner, together with ground-truth camera poses and sparse-view test sets. We use MV-dVRK to systematically compare zero-shot monocular, stereo, multi-stereo, and multi-view 3D reconstruction methods as the number of viewpoints increases. With two endoscopes, multi-stereo reconstruction achieves the highest coverage. With a third viewpoint, optimization-based multi-view methods perform best, covering 67% of ground-truth surface points within a 1 mm tolerance and recovering highly accurate relative camera poses. By contrast, feed-forward foundation models cover only 43% of the ground-truth surface in the same setting. MV-dVRK also includes ten dynamic sequences spanning multiple surgical tasks, with increasing kinematic complexity and tissue deformation, providing a basis for future research in multi-viewpoint surgical perception. The project is available at: this https URL.
17. 【2609.02705】A Top-Down Framework for Metric-Scale Athlete Localization from Single Broadcast Frames
链接：https://arxiv.org/abs/2609.02705
作者：Thanh-Khoi Nguyen,Hoang-Phuc Nguyen,Linh-Huynh,Minh-Triet Tran
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Accurate world-coordinate localization, single-frame broadcast footage, inherently challenging due, Accurate world-coordinate, Boundary-Aware Adaptive Tiling
备注：
点击查看摘要
Abstract:Accurate world-coordinate localization of athletes from single-frame broadcast footage is inherently challenging due to extreme scale disparities in ultra-high-resolution imagery. In this paper, we propose a top-down framework for metric-scale athlete localization from a single calibrated frame. Our approach centers on three key contributions. First, we propose Boundary-Aware Adaptive Tiling, a semantics-guided extension of standard sliced inference. By iteratively expanding tile boundaries based on coarse bounding-box predictions, it systematically ensures full object containment, effectively mitigating boundary-splitting artifacts through a lightweight pipeline adaptation without architectural modifications. By substantially mitigating recall degradation under extreme scale variance, Boundary-Aware Adaptive Tiling enables us to isolate perspective distortion as the primary source of residual localization error. Second, we adapt the RTMPose-X architecture into a specialized two-keypoint estimator (pelvis and ground projection), employing a reformulated Gated Attention Unit optimized for this geometrically coupled point pair, and then deterministically lift the 2D ground projections into world coordinates via camera-calibrated ray casting. On the public test set, our method achieves a LocSim score of 97.44 and an mAP of 0.9128, outperforming the baseline by over 21 \% and establishing a robust solution for high-resolution scale variance.
18. 【2609.02697】Generating Medical Image Counterfactuals using Causal Explanations
链接：https://arxiv.org/abs/2609.02697
作者：David A. Kelly,Tom Yaacov,Nathan Blake,Sander Beckers,Hana Chockler
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning models, achieved impressive performance, clinical settings remains, settings remains constrained, Deep learning
备注：
点击查看摘要
Abstract:Deep learning models have achieved impressive performance in medical image diagnosis, yet their deployment in clinical settings remains constrained by limited explainability. Counterfactual images provide one means of auditing model behavior by showing how an image would need to change for a classifier to produce a different prediction. Existing approaches typically generate such explanations using auxiliary models, including generative adversarial networks and diffusion models. While often capable of producing visually realistic images, these methods explain one black-box model using another, making it difficult to separate the classifier's decision-making process from the inductive biases of the generator. We propose a novel counterfactual-generation framework that requires no generative model. Instead, counterfactuals are constructed directly from causal evidence extracted from the classifier. The resulting approach is deterministic, requires no additional model training, and enables controllable edits within user-specified regions of interest. Experiments on real-world medical imaging datasets demonstrate that the proposed method successfully changes classifier predictions while remaining closer to the original image than generative baselines, providing a more direct and transparent view of the classifier's decision boundary.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.02697 [cs.CV]
(or
arXiv:2609.02697v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.02697
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
19. 【2609.02689】GaLe: memory-efficient Global Approximate and Local Exact features
链接：https://arxiv.org/abs/2609.02689
作者：Alberto Ancilotto,Elisabetta Farella
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Embedded devices typically, high computational overhead, devices typically lack, Embedded devices, GPU-equipped machines
备注：
点击查看摘要
Abstract:Embedded devices typically lack the resources of GPU-equipped machines, and existing inference methods suffer from either high computational overhead (patch-based) or accuracy loss (approximation-based). We propose GaLe, a memory-efficient technique that enables the deployment of pretrained networks on constrained devices without retraining. GaLe partitions feature maps into two components: a local exact (Le) representation that preserves fine details and a global approximate (Ga) representation that retains long-range dependencies. Unlike standard tiling, GaLe supports global operations and attention mechanisms found in hybrid CNN-transformer models. Validated on ImageNet, our method matches exact-inference performance while achieving up to 65% speedup and 90% RAM reduction on a Cortex-M33 compared to patch-based inference. We further demonstrate GaLe's versatility across classification, detection, and generation tasks, highlighting its potential as a foundation for resource-efficient architecture design.
20. 【2609.02683】Genesis: A Generative Engine for Hierarchical Satellite Image Synthesis
链接：https://arxiv.org/abs/2609.02683
作者：Subash Khanal,Yangzhi Cui,Daniel Cher,Eric Xing,Brian Wei,Srikumar Sastry,Nathan Jacobs
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：nest fine detail, span varied resolutions, Earth observation, geospatial tasks span, tasks span varied
备注： Accepted to SIGSPATIAL 2026: Application Track (Oral)
点击查看摘要
Abstract:Earth observation is fundamentally multi-scale; geospatial tasks span varied resolutions, and satellite imagery is organized into cascading tile pyramids that nest fine detail within wide coverage. Current generative models of satellite imagery, however, operate along a single axis: they either zoom to enhance a single tile's resolution or pan to extend imagery at a fixed scale. As a result, no existing method produces a complete pyramid that stays consistent across both scale and space, where a high-zoom tile must agree with the coarse context it refines and with the neighbors it meets. Motivated by this gap, we introduce a new task, multi-scale tile completion: given a sparse set of seed tiles at arbitrary zoom levels and positions, synthesize a complete, uniform quadtree that is globally consistent across both scale and space. We approach this task with Genesis, a generative engine that brings both axes together by composing two specialized operators over the quadtree: a vertical super-resolution model and a horizontal mask-based outpainting model, producing pyramids that are consistent across zoom levels and seamless across neighboring tiles. Each operator achieves state-of-the-art results on its subtask, and the engine propagates sparse seeds into seamless, multi-resolution maps from any initial configuration. To evaluate the task and benchmark Genesis, we introduce dense500, a fully observed multi-scale pyramid dataset spanning diverse geographic regions, together with a suite of pyramid-level metrics. Code, models, and our dataset are available at this https URL.
21. 【2609.02664】Query Rewriting for Complex Object Segmentation in 4D Gaussian Representations
链接：https://arxiv.org/abs/2609.02664
作者：Thanh-Khoi Nguyen,Thien-Phuc Tran,Minh-Triet Tran
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：dynamic scene understanding, language-guided dynamic scene, demonstrated strong performance, Gaussian representation frameworks, scene understanding
备注：
点击查看摘要
Abstract:Recent 4D Gaussian representation frameworks have demonstrated strong performance in language-guided dynamic scene understanding. However, these methods remain highly sensitive to verbose and narrative-style queries that contain noisy contextual information. In this paper, we investigate the impact of query rewriting for complex object segmentation in 4D Gaussian representations. Inspired by recent findings in retrieval-augmented language models and keyword-guided query reformulation, we propose a training-free reinterpretation strategy that transforms long descriptive queries into concise keyword-grounded forms. Our approach progressively reduces linguistic noise while preserving semantic anchors relevant to object-centric representations. Experiments on HyperNeRF and Neu3D demonstrate that concise rewritten queries significantly improve both temporal localization and spatial segmentation performance. In particular, our method improves average temporal accuracy from 60.92% to 92.21% and average vIoU from 20.08% to 76.94% without any additional fine-tuning. Extensive ablation studies further reveal that shorter, keyword-focused queries consistently yield stable video-feature similarity distributions and better alignment with object-centric Gaussian representations
22. 【2609.02663】Characterizing Text Branch Sensitivity in Medical Vision-Language Segmentation via Evidence Decoupling
链接：https://arxiv.org/abs/2609.02663
作者：Ziquan Liu,Zhewei Zhu,Xuyang Shi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Pretrained vision-language models, Pretrained vision-language, shown promising performance, medical image segmentation, incorporating clinical text
备注： 16 pages, 3 figures
点击查看摘要
Abstract:Pretrained vision-language models (VLMs) have shown promising performance in medical image segmentation by incorporating clinical text. However, it remains unclear how much textual information actually contributes to pixel-level predictions. In this work, we systematically investigate the role of text in multimodal medical image segmentation. We first analyze several commonly used fusion strategies and find that segmentation performance is largely insensitive to the choice of fusion module. To further understand modality interactions, we propose an Evidence Decoupling Decoder (EDD) based on evidential deep learning and deep supervision. EDD serves as an internal representation analysis tool that decomposes image evidence and text-modulated evidence throughout the decoding process while maintaining competitive segmentation performance. Experimental results show that the sensitivity to text perturbation varies substantially across datasets. On BUSI and BTMRI, removing text causes catastrophic performance drops, indicating strong model reliance on textual input. On ISIC and Kvasir-SEG, text exerts relatively marginal influence. We further find that text affects predictions mainly through global semantic modulation rather than independent spatial localization, and that the specific semantic components driving text sensitivity differ across datasets. These findings provide a deeper understanding of modality interaction in multimodal medical image segmentation and offer practical insights for future model design.
23. 【2609.02654】Physics-Driven Independent Pair Generation for Iterative Self-Supervised Low-Dose CT Denoising
链接：https://arxiv.org/abs/2609.02654
作者：Xianlei Han,Shaoyu Wang,Jiancheng Fang,Weiwen Wu,Qiegen Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Low-dose computed tomography, mixed Poisson-Gaussian noise, computed tomography, mixed Poisson-Gaussian, LDCT
备注： 10 pages, 11 figures, 3 tables. Includes a 1-page appendix. Submitted to IEEE Transactions on Circuits and Systems for Video Technology
点击查看摘要
Abstract:Low-dose computed tomography (LDCT) measurements contain mixed Poisson-Gaussian noise. However, most self-supervised methods rely on generic image statistics and do not explicitly model this noise, which may limit their ability to effectively suppress realistic LDCT noise. To address this issue, we propose a physics-driven framework with cross-domain iteration for self-supervised LDCT denoising. The proposed framework proceeds in three main steps. First, a learned sinogram prior and the LDCT noise model guide posterior inference of photon counts, enabling separation of the Poisson and Gaussian components. Second, the separated Poisson and Gaussian components are respectively processed by binomial thinning and Gaussian data thinning to construct two branches, and residual scaling matches each branch's noise level to that of the observation, yielding a training pair with approximately independent noise realizations from one low-dose measurement. Finally, the pair is used to train an image-domain network whose forward-projected outputs update the prior. Through cross-domain iteration, the prior and the training pair are progressively refined while maintaining consistency with CT acquisition physics. Experiments on simulated data from AAPM, LIDC-IDRI, and LoDoPaB-CT and on real LDCT data show consistent gains over the evaluated self-supervised baselines across dose levels, with performance comparable to the evaluated supervised baseline.
24. 【2609.02644】Learning to Attract and Repel: Dual Quality Margin Learning for Face Recognition (DQM-Face)
链接：https://arxiv.org/abs/2609.02644
作者：El Ouanas Belabbaci,Bhavesh Wani,Philipp Terhörst
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unconstrained environments remains, extreme variations encountered, environments remains highly, real-world scenarios, unconstrained environments
备注： ECCV 2026. Code: [this https URL](https://github.com/RAIB-group/DQM-Face)
点击查看摘要
Abstract:Face recognition in unconstrained environments remains highly challenging due to diverse and extreme variations encountered in real-world scenarios. To mitigate these effects, existing margin-based approaches model sample quality through feature magnitude. However, magnitude-based modeling alone is susceptible to identity-agnostic noise, which can degrade the reliability and discriminative power of learned representations. In this paper, we propose Dual Quality Margin Learning for Face Recognition (DQM-Face), a novel framework that enables refined attraction and repulsion dynamics during representation learning. Our approach unifies conventional magnitude-based quality estimation with a newly introduced semantic quality learning mechanism, realized via squeeze-and-excitation semantic attention. By jointly leveraging magnitude and semantic cues, we construct enhanced quality-aware margins that adaptively strengthen intra-class compactness through improved attraction during learning. To further enhance inter-class discrimination, we introduce a repulsion margin formulation that explicitly enlarges inter-class separation. The unified integration of semantic quality modeling with dual attraction-repulsion margin optimization results in a more structured and discriminative feature geometry. Extensive experiments on multiple challenging benchmarks demonstrate that DQM-Face consistently outperforms state-of-the-art face recognition methods. Moreover, we show that the quality learned for margin optimization is highly effective for face image quality assessment within the proposed framework, demonstrating that the learned quality signal is intrinsically aligned with the recognition objective. The code is publicly available: this https URL
25. 【2609.02640】From Detection to Localization: A Unified Forensics Framework for Fully Synthetic and Tampered Images
链接：https://arxiv.org/abs/2609.02640
作者：Annalisa Gallina,Marco Fiorucci,Marco Brigo,Federica Battisti,Lamberto Ballan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：highly realistic forgeries, producing highly realistic, manipulated image detection, realistic forgeries, reinforcing the importance
备注： Accepted at the DFF Workshop, ACM Multimedia 2026
点击查看摘要
Abstract:The rapid advancement of generative models has significantly worsened the problem of manipulated image detection, as these methods are capable of producing highly realistic forgeries, reinforcing the importance of multimedia forensics. Conventional approaches typically frame image manipulation detection as a binary classification task (real vs. generated), which limits the capability to distinguish and localize different forms of manipulation. To address these constraints, this work extends an existing detector by introducing a unified multiclass framework (real vs. fully generated vs. tampered). In addition to classifying image authenticity, the framework incorporates a segmentation branch to enable pixel-level localization of tampered regions. The proposed approach outperforms selected recent benchmarks, offering an efficient solution with improved classification accuracy and higher IoU scores for the localization task. Find the code at this https URL.
26. 【2609.02616】AffectDelta: Beyond Emotion Labels for Image Editing
链接：https://arxiv.org/abs/2609.02616
作者：Xingzu Zhan,Lin Gu,Ruogu Fang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Emotion-driven image editing, modifying emotion-relevant visual, emotion-relevant visual cues, Emotion-driven image, image editing aims
备注： 12pages, 6 figures
点击查看摘要
Abstract:Emotion-driven image editing aims to evoke a specified target emotion by modifying emotion-relevant visual cues in a source image, while preserving the overall composition and semantic-structural coherence of the original scene. Existing scene-level editors typically specify the target with a single emotion category and often learn visual transformations from operation-level text instructions. A category collapses a mixed affective endpoint into one dominant label, while language cannot precisely quantify how coexisting emotions should increase, decrease, or remain stable. We introduce AffectDelta, a source-aware editor that treats editing as a transition between eight-dimensional emotion distributions. A frozen Emotion Distribution Predictor estimates the source state, and the signed source-to-target difference encodes the direction and magnitude of the requested transition. Within AffectDelta, an internal transition encoder and a source-aware diffusion backbone jointly translate this signal into context-dependent semantic and appearance changes. To train this formulation, we construct AffectPair-249K, comprising 248,841 source-target pairs with predicted eight-dimensional distributions and spanning both cross-category and within-category transitions. Experiments against six baselines, combining quantitative evaluation with qualitative comparisons, demonstrate improved affective alignment and content preservation, while ablations validate our design choices. Code and dataset will be made publicly available upon acceptance.
27. 【2609.02600】Generalizable Brain Tumor Segmentation with Self-Training and Tumor-Aware Deformations
链接：https://arxiv.org/abs/2609.02600
作者：Henrique Zan Grande,Jeovane Honorio Alves,Rayson Laroca,Andre Gustavo Hochuli
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：heterogeneous patient population, brain tumor sub-regions, patient population, work presents, presents an approach
备注： Accepted for presentation at the 2026 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) - BraTS Cluster of Challenges
点击查看摘要
Abstract:This work presents an approach to the Generalizability Across Tumors (BraTS-GoAT) task of the BraTS 2026 Challenge, which focuses on robust segmentation of brain tumor sub-regions across a heterogeneous patient population. The proposed method employs the nnU-Net framework with a large residual encoder architecture, integrating a semi-supervised learning technique with pseudo-labels generated from the unlabeled training data and a tumor-aware deformable augmentation that locally deforms the lesion while preserving the surrounding anatomy. We evaluate the individual contributions of each component, as well as their combination, using varying proportions of the most confident pseudo-labeled cases. The submitted configuration for the generalization task achieves Dice and NSD scores of 0.881 and 0.473 for Whole Tumor, 0.817 and 0.490 for Tumor Core, and 0.775 and 0.533 for Enhancing Tumor on the BraTS-GoAT validation set, improving over the labeled-only baselines across all tumor regions and confirming that self-training and the proposed augmentation are complementary. Our source code is publicly available at this https URL.
28. 【2609.02573】Deeply Interleaved Text-Image Contexts for Multimodal LLMs Assessment
链接：https://arxiv.org/abs/2609.02573
作者：Zihao Wang,Xi Xiang,Yuwen Sun,Yingyu Li,Yabo Zhang,Yihan Zeng,Fan Li,Wangmeng Zuo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Current evaluations, largely overlooking interleaved, models predominantly focus, largely overlooking, multi-image tasks
备注：
点击查看摘要
Abstract:Current evaluations and training of multimodal models predominantly focus on multi-image tasks, largely overlooking interleaved text-image scenarios. In such multi-image tasks, text typically serves merely as task instructions, lacking deep semantic interaction with the visual content. In contrast, realworld applications like text-image co-creation, character tracking, and spatial reconstruction require constant interaction between text and images. Consequently, models must possess a deep understanding of these interleaved contexts. To bridge this gap, we introduce a novel benchmark, TIC-Bench (deeply interleaved Text-Image Contexts), designed to evaluate the capability of models to integrate text-image clues and recover the ground truth facts within deeply interleaved contexts. This benchmark encompasses three core domains: Logical, Temporal, and Spatial Association, which are further categorized into eight specific types, comprising a total of 2,280 questions. We evaluated 10 state-of-the-art MLLMs and observed a substantial performance gap compared to human experts, together with persistent difficulties in integrating evidence distributed across interleaved visual and textual inputs. Ultimately, this benchmark provides a valuable analytical tool for assessing and advancing the ability of multimodal models to effectively integrate text and image information in deeply interleaved contexts. TIC-Bench is publicly available at this https URL
29. 【2609.02565】MARS: What Retrieval Signals Are Hidden in Multimodal Large Language Models for Text-Video Retrieval?
链接：https://arxiv.org/abs/2609.02565
作者：Uicheol Jung,Juyoung Hong,Geuntaek Lim,Yukyung Choi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：similar scenes, temporal patterns, Text-video retrieval requires, Text-video retrieval, retrieval requires representations
备注： 16 pages, 6 figures. Accepted to the Main Conference of EMNLP 2026
点击查看摘要
Abstract:Text-video retrieval requires representations that can distinguish videos with similar scenes, actions, and temporal patterns. Recent multimodal large language models have been adapted as embedding models, but they often represent each input using a single token from the final layer. This can compress diverse video-text cues into a single vector and limit fine-grained retrieval. To address this limitation, we propose MARS, a multi-layer and multi-slot embedding framework for text-video retrieval. MARS constructs multiple adaptive representation slots by combining hidden states from different decoder layers, compares corresponding text and video slots, and aggregates their similarities for retrieval. To better handle confusing candidates, we further introduce a hard-negative-aware slot specialization objective that encourages the slots to capture discriminative matching cues. Experiments on four text-video retrieval benchmarks show that MARS achieves state-of-the-art results in both direct similarity-based retrieval and reranking settings. Ablation studies and analyses demonstrate that multi-layer fusion, multiple slots, and hard-negative-aware slot specialization provide complementary gains. Code is available at this https URL.
30. 【2609.02560】Stereo 4D Radar for 3D Object Detection: Integrating Geometric Alignment and Absolute Velocity Estimation
链接：https://arxiv.org/abs/2609.02560
作者：Seung-Hyun Song,Dong-Hee Paek,Woong-Chan Byun,Seung-Hyun Kong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Doppler-based motion information, providing Doppler-based motion, powerful sensing modality, sensing modality capable, diverse weather conditions
备注：
点击查看摘要
Abstract:Four-dimensional (4D) Radar is a powerful sensing modality capable of detecting surrounding three-dimensional (3D) objects under diverse weather conditions and providing Doppler-based motion information. However, raw 4D Radar signals contain significant clutter from road surfaces, guardrails, and surrounding vehicles, along with multipath-induced ghost reflections and the receiver's inherent noise floor. Consequently, preprocessing algorithms designed to remove such invalid measurements often make the Radar data excessively sparse. Moreover, the Doppler measurements provided by 4D Radar describe only the radial component of an object's velocity, limiting their ability to recover the full motion state. In this paper, we introduce a stereo 4D Radar-based 3D object detection framework that exploits the geometric disparity between left and right Radars to estimate the absolute velocity of objects and achieve more robust perception through the fusion of their complementary features. The effectiveness of the proposed framework is validated on our in-house stereo 4D Radar dataset, demonstrating performance gains of 8.82 points in AP 3D and 9.0 points in AP BEV over state-of-the-art mono 4D Radar baselines. These results demonstrate that absolute velocity estimation combined with stereo geometry-aware feature fusion leads to substantial improvements in 3D object detection.
31. 【2609.02556】RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains
链接：https://arxiv.org/abs/2609.02556
作者：Thijs A. Eker,Ella P. Fokkinga,Jan Erik van Woerden,Elfi I.S. Hofmeijer,Sebastiaan P. Snel,Klamer Schutte,Friso G. Heslinga
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：crucial for developing, developing vision, abundant UAV RGB, UAV RGB imagery, data
备注： Submitted to SPIE Sensors + Imaging 2026
点击查看摘要
Abstract:Synthetic training data is crucial for developing vision AI when real-world data is scarce, as in thermal infrared (IR) aerial vehicle detection. While abundant UAV RGB imagery motivates RGB-to-IR translation for data augmentation, unobservable thermal traits (e.g., engine heat) make learning transferable mappings challenging. This work investigates whether modern generative translators can overcome this cross-modal gap to improve infrared vehicle detection on unseen UAV target domains. Translators are trained on paired RGB-IR source datasets and applied to RGB training images from held-out target datasets to generate synthetic IR data. Evaluated methods include supervised GANs, ControlNet-based diffusion models, and foundation-model editing via LoRA. The resulting synthetic IR imagery is used to train RF-DETR vehicle detectors, which are evaluated on unseen IR target test splits across five aerial datasets, with Kust4K and VTUAV serving as target domains. Synthetic IR consistently outperforms RGB and grayscale baselines. Stable Diffusion 3.5 with ControlNet yields the best results, improving mAP from 50.8 to 60.1 on Kust4K and from 25.6 to 38.4 on VTUAV compared to models trained only on source-domain IR data. Increasing output diversity via multiple seeds (+1.1 mAP) and prompt variations (+3.3 mAP) provides additional gains on VTUAV. Although a performance gap to real target IR data remains, generative RGB-to-IR translation effectively mitigates IR data scarcity and improves cross-domain aerial vehicle detection.
32. 【2609.02531】Spatially Aware World Action Model via Geometric Latent Diffusion
链接：https://arxiv.org/abs/2609.02531
作者：Javier Alejandro Lopetegui Gonzalez,Paul Pacaud,Cordelia Schmid
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：inheriting rich visual, jointly predict future, predict future observations, Aware World Action, World Action Models
备注：
点击查看摘要
Abstract:World Action Models (WAMs) leverage the capabilities of large-scale pretrained video diffusion models to jointly predict future observations and actions, inheriting rich visual and physical priors from internet-scale video. This has made them a promising paradigm for robot policy learning, yet the prevailing models operate exclusively on RGB observations and do not leverage 3D information. To bridge this gap, we introduce a Spatially Aware World Action Model (SA-WAM), which repurposes a pretrained video model for joint action, RGB, and depth prediction, enabling 3D-aware world modeling and action prediction within a single diffusion backbone. We use a nonlinear encoding that maps the unbounded depth signal into the bounded input domain expected by the frozen VAE tokenizer. This allows us to reuse the tokenizer without 3D-specific fine-tuning, incorporating geometric information without sacrificing the pretrained priors. SA-WAM achieves state-of-the-art results on the RoboCasa and LIBERO-Plus benchmarks, while simultaneously improving future-state predictions. Furthermore, SA-WAM outperforms strong baselines in real-world evaluation using a UR5 robotic arm, with strong gains in randomized environments. We analyze the correlation between world model prediction quality and rollout success, providing insights into WAM performance and avenues for its improvement.
33. 【2609.02529】Fine-Grained Anomaly Perception in Wild UGC-Enhanced Images: A Comprehensive Dataset and Difference-Fusion Framework
链接：https://arxiv.org/abs/2609.02529
作者：Yan Zhong,Gefei Chen,Qiufang Ma,Zhen Wang,Zhiwei Fan,Lei Shi,Tingting Jiang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：standard back-end operations, social media platforms, UGC visual experience, boost UGC visual, UGC image Enhancement
备注：
点击查看摘要
Abstract:Image enhancement and restoration have become standard back-end operations on short-video and social media platforms to boost UGC visual experience. Yet these processes inevitably introduce visual anomalies--especially in faces, texts, and textures--that directly undermine perceptual fidelity and viewer trust. While existing IQA methods perform well on classic distortions, they target holistic quality assessment and fail to capture the specific, localized anomalies caused by enhancement algorithms in real-world UGC. To bridge this gap, we formally define a new task-quality Anomaly Perception for UGC image Enhancement (UEAP), and contribute the first UEAP benchmark dataset, named UEAP-4k, curated from the real business scenarios. It provides fine-grained annotations for anomaly categories, localization and severity levels. Furthermore, we propose a Difference-Fusion Anomaly Perception Method (DFAP-UGC) for wild UGC-enhanced images, which leverages explicit problem-reference difference fusion with dense spatial querying, regional verification, and quality-aware ranking, enabling robust anomaly identification in challenging scenarios. To handle the inherent coupling of subtasks in this new task, we propose a Locality-Aware Dynamic Task Prioritization (LADTP) training strategy that enables effective end-to-end learning and eliminates multi-stage overhead. Extensive experiments show that our method outperforms baselines adapted from classical approaches for this task, validating the value of this dataset and the superior of DFAP-UGC for robust UGC-enhanced image anomaly perception. Code and data will be public.
34. 【2609.02528】Doppio: A Dataset for Contactless Weight Estimation of Falling Particles
链接：https://arxiv.org/abs/2609.02528
作者：Simon Kiefhaber,Jan-Martin O. Steitz,Julia Grabinski,Christoph Reich,Paul Wagner,Max Zimmermann,Simone Schaub-Meyer,Stefan Roth
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：including falling particles, common task, task in industrial, industrial applications, including falling
备注：
点击查看摘要
Abstract:Measuring the mass of powder, including falling particles, is a common task in industrial applications. While scales are effective for static measurements, many applications require contactless sensing, where existing solutions are often costly, application-specific, and technically complex. In this work, we investigate computer vision as a practical alternative for contactless mass estimation. As an accessible real-world case study, we focus on coffee grinding and introduce \emph{Doppio}, a novel video dataset capturing videos of falling ground coffee, paired with precise, per-frame ground-truth weight measurements. To demonstrate contactless measuring, we evaluate deep learning-based approaches ranging from purely spatial feed-forward networks to recurrent spatio-temporal models. These models are analyzed with respect to their predictive accuracy and computational trade-offs. We demonstrate that deep learning-based computer vision models accurately estimate the cumulative weight of falling particles, establishing a solid foundation for future vision-based contactless measurement solutions.
35. 【2609.02512】Beauty is in the AI of the beholder: MLLMs systematically overrate facial attractiveness
链接：https://arxiv.org/abs/2609.02512
作者：Santiago Grandas,Juan Sebastian Cely-Acosta,Mohit Mendiratta,Shafee Hassan,Macken Murphy
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, assessments from Multimodal
备注：
点击查看摘要
Abstract:Beauty assessments from Multimodal Large Language Models (MLLMs) are increasingly popular amongst users, companies, and aestheticians. This raises the question of whether these AI models can accurately reflect human judgments of attractiveness. In a pre- registered exploratory study, we compared the attractiveness ratings of 2,513 human participants to four widely used commercial AI models: Claude, Gemini, GPT, and Grok. Results showed that MLLMs systematically rate faces more favourably and within a narrower range than humans and, at the time of study, do not reproduce human ratings in absolute terms. However, MLLMs exhibit strong correlations with human attractiveness judgments, accurately tracking the rank-ordering of faces. MLLMs may judge faces by different cues than humans; only face age was a predictor of facial attractiveness in both humans and MLLMs, with inconsistent patterns across models for ethnicity and gender. AI models strongly agree with one another, except for Grok, which also showed the lowest agreement with humans. Our findings suggest that while they may be able to approximate rank-orderings of human attractiveness, current off-the-shelf commercial MLLMs systematically overrate the beauty of human faces.
36. 【2609.02510】Orthogonal Ensembles and Tested Explanations for Performer-Independent Body-Motion Emotion Recognition
链接：https://arxiv.org/abs/2609.02510
作者：Naoto Nishida,Yoshio Ishiguro
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词：protocol-matched reproduced STGCN, reproduced STGCN, underdetermined setting, study body-only, acted-emotion classification
备注： 8 pages, 3 figures, 3 tables. Accepted to ACII2026 workshop
点击查看摘要
Abstract:We study body-only, 12-class acted-emotion classification from skeleton motion under leave-performer-out (LPO) evaluation, a hard, underdetermined setting: chance is 8.3%, and a protocol-matched reproduced STGCN++ baseline reaches only 25.73 +/- 4.03% Macro-F1. We show that reliable gains come not from a new architecture but from combining eleven models with orthogonal error modes: under 10-fold LPO cross-validation on the labeled training performers, an equal-weight logit-mean ensemble reaches 36.80 +/- 4.00% per-fold Macro-F1, a protocol-matched +11.07 pp (+43% relative) over the same-split reproduced baseline. Our central contribution is a tested explanation suite: for a strong ensemble member, part-masking and counterfactual edits show (rather than assert) that its decisions depend on motion-grounded body-region evidence, and this region saliency aligns with rule-based Laban Movement Analysis (LMA) attributes far more than with classical kinematics: region-level saliency-LMA Spearman rho = +0.500 versus +0.033, roughly 15x, and the alignment holds for the submitted 11-way ensemble itself at rho = +0.517; the audit is post hoc and needs no retraining. The same suite faithfully reports a negative: within-window temporal saliency is diffuse rather than localized.
37. 【2609.02504】SR-Edit: Region-Aware Image Editing via Self-Refinement
链接：https://arxiv.org/abs/2609.02504
作者：Andong Wang,Zehua Chen,Yuxuan Jiang,Jun Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：made remarkable advances, recent rapid progress, achieving faithful edits, remarkable advances, recent rapid
备注：
点击查看摘要
Abstract:With the recent rapid progress in generative models, image editing has made remarkable advances, yet achieving faithful edits that precisely modify only the target regions while strictly preserving all other regions remains challenging. Since externally provided region annotations are often difficult to obtain in practice, a growing body of work seeks to improve preservation by automatically inferring edit and non-edit regions, and then enforcing consistency on the latter. However, these approaches still suffer from inaccurate region estimation and heuristic correction strategies that distort the native inference process, making methods designed for fidelity themselves a new source of artifacts. We propose SR-Edit, an image editing framework that overcomes these issues via iterative self-refinement. Specifically, at each iteration, SR-Edit first (i) extracts progressively precise and self-consistent region separation from the model's own predictions by lightweight post-processing, and then (ii) enforces preservation in non-edit areas through correction updates that remain aligned with the original sampling dynamics. Extensive experiments demonstrate that SR-Edit achieves superior preservation and overall image quality compared to existing editing techniques.
38. 【2609.02502】Blending Concepts: Benchmarking Visual Metaphor Generation in Text-to-Image Models
链接：https://arxiv.org/abs/2609.02502
作者：Chuer Chen,Zichen Wang,Yi He,Zhengxi Yu,Nan Cao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remains largely unexamined, convey abstract ideas, achieved remarkable success, produce visual metaphors, objects and attributes
备注：
点击查看摘要
Abstract:Text-to-image (T2I) models have achieved remarkable success at faithfully rendering specified objects and attributes, yet their ability to produce visual metaphors, images that convey abstract ideas by combining elements from two distinct domains, remains largely unexamined. To bridge this gap, we introduce VMetaphor-Bench, the first benchmark for evaluating visual metaphor generation in T2I models. It comprises 1,500 visual metaphors curated from real-world creative imagery, organized into three levels and ten categories, with each sample paired with two prompts of differing specificity. For evaluation, we develop a hybrid framework within an MLLM-as-judge paradigm, combining a multiple-choice question (MCQ) based protocol of 9,594 questions across four levels of metaphorical fidelity with a dimension-based scoring protocol along three perceptual dimensions. Extensive evaluation of 11 representative T2I models reveals that even the strongest proprietary models struggle with compositional structuring and cross-domain mapping, key aspects of metaphorical expression, highlighting visual metaphor generation as an important frontier for future T2I research.
39. 【2609.02486】ViSAR: Training-Free Adaptive-$k$ Retrieval for Visual Document Question Answering
链接：https://arxiv.org/abs/2609.02486
作者：Adrien Mialland,Marc Plantevit,Julien Gallois,Céline Robardet
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Vision-Language Model, Visual Question Answering, Question Answering, leverages Retrieval-Augmented Generation, Document Visual Question
备注： 13 pages, 5 figures, 4 tables
点击查看摘要
Abstract:Document Visual Question Answering (DocVQA) often leverages Retrieval-Augmented Generation (RAG), where late-interaction encoders are commonly used to identify document pages relevant to a user query, before answer generation by a Large Vision-Language Model (LVLM). Existing approaches typically retrieve a fixed top-$k$ number of pages regardless of query complexity, which increases LVLM latency and may degrade answer accuracy. We introduce ViSAR (Visual Semantic Activation Retrieval), a training-free adaptive-$k$ retrieval method for late-interaction visual document retrieval. ViSAR operates directly in the embedding space to construct a query-conditioned page-level similarity matrix that highlights query-relevant semantics and dynamically determines the number of pages to retrieve. Across multiple encoders and LVLMs, ViSAR retrieves compact, query-adapted page sets that reduce RAG latency by up to 58.7\%, while maintaining or improving answer accuracy compared with fixed top-$k$ and adaptive retrieval heuristics. Furthermore, we show that the similarity matrix structure correlates with answer accuracy, suggesting future directions for retrieval quality-aware document understanding.
40. 【2609.02476】UnCapsTSR: An Unsupervised Transformer-based Image Super-Resolution Approach for Capsule Endoscopy Images
链接：https://arxiv.org/abs/2609.02476
作者：Anjali Sarvaiya,Shubh Kawa,Lalit Agrawal,Jagrit Joshi,Kishor Upla,Kiran Raja
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：patient Gastrointestinal, Wireless Capsule Endoscopy, Generative Adversarial Network, captures and streams, examine its irregularities
备注： Accepted manuscript of the article published in Neurocomputing, Volume 665, Article 132161, 2026
点击查看摘要
Abstract:Wireless Capsule Endoscopy (WCE) captures and streams video while passing through a patient's Gastrointestinal (GI) tract and is used to examine its irregularities. Although advantageous over conventional endoscopy, WCE suffers from limitations related to capsule size and wireless transmission, resulting in images with coarser resolution. This work presents UnCapsTSR, an unsupervised transformer-based Generative Adversarial Network (GAN) framework for improving the spatial resolution of Low-Resolution (LR) WCE images. The proposed method accomplishes SR without explicit degradation estimation of real-world LR data and eliminates the need for true LR-HR pairs. UnCapsTSR employs a Bilateral Total Variation (BTV) loss to ensure spatial continuity in SR images. A newly curated dataset from the Kvasir Capsule dataset is also presented for training WCE SR models. Generalizability is validated on KID and GIANA datasets that are not used during training. A new non-reference metric, Endoscopy Quality Metric (EndoQM), is introduced for quantitative evaluation of domain-specific WCE data. Experiments demonstrate consistent improvement over state-of-the-art unsupervised SR approaches using NIQE, BRISQUE, PIQE, and EndoQM. Statistical evaluation shows 40 to 80 percent improvement in EndoQM from LR to SR across the evaluated datasets.
41. 【2609.02471】Learning to Track from Privileged Target Appearances
链接：https://arxiv.org/abs/2609.02471
作者：Xin Chen,Jiao Xu,Dong Wang,Huchuan Lu,Kede Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual tracker searches, initial ground-truth template, Target templates define, initial ground-truth, cropped from uncertain
备注： 13 pages, 2 figures
点击查看摘要
Abstract:Target templates define what a visual tracker searches for, yet the templates available at inference trade off localization certainty with appearance freshness: the initial ground-truth template is exact but becomes stale, whereas recent templates better reflect the current appearance but are cropped from uncertain predictions. We quantify this bottleneck with a non-deployable oracle that supplies an exact current-frame target crop, improving AUC on LaSOT by 15.2 percentage points. This gap reveals a training-only opportunity: frame-level ground truths provide exact current- and future-frame target crops, although such crops are unavailable at deployment. We introduce Privileged Appearance Transfer for Tracking (PATT), a teacher-student training framework that transfers these privileged appearances to a deployable tracker through multi-level representation prediction. The privileged teacher observes exact target crops from past, current, and future frames, whereas the student receives only past-frame templates and learns to predict the teacher's search representations. To avoid transferring unreliable teacher signals, PATT weights this transfer by the teacher's relative localization advantage over the student and its absolute localization accuracy. After training, the teacher, latent predictor, reliability weights, and privileged crops are removed, leaving standard student-only inference. Across seven benchmarks at two model scales, PATT achieves consistent gains under both long- and short-term tracking protocols.
42. 【2609.02462】VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation
链接：https://arxiv.org/abs/2609.02462
作者：Hoonhee Cho,Jae-Young Kang,Giwon Lee,Hyemin Yang,Heejun Park,Kuk-Jin Yoon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：urban environments requires, complex multi-agent interactions, partial observability, observability and complex, complex multi-agent
备注： Accepted by ECCV 2026 Spotlight
点击查看摘要
Abstract:End-to-end autonomous driving in urban environments requires robust decision-making under partial observability and complex multi-agent interactions. Severe occlusions and dense traffic at intersections limit the perception capability of single-agent systems, motivating recent efforts on Vehicle-to-Infrastructure (V2I) cooperation for perception and planning. However, existing evaluation protocols face a fundamental trade-off: open-loop evaluation fails to capture error accumulation and recovery from deviations, while closed-loop evaluation is costly, difficult to scale, and often relies on simulated environments that may suffer from domain gaps. To bridge this gap, we propose VIPS, a benchmark for cooperative autonomous driving in V2I settings based on pseudo-simulation. VIPS extends pseudo-simulation by integrating vehicle and infrastructure observations. This enables scalable yet realistic evaluation of robustness and error propagation without full simulation. We further present CoS-V2X, a cooperative planning framework based on sparse representations. CoS-V2X models vehicle-infrastructure interactions using compact features for efficient communication and robust decision-making under heterogeneous observations. Code and dataset are available at this https URL.
43. 【2609.02452】WiFlow: Estimating Optical Flow using WiFi Channel State Information
链接：https://arxiv.org/abs/2609.02452
作者：Thomas Weigel,Simon Kiefhaber,Fabian Portner,Matthias Hollick,Simone Schaub-Meyer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fast objects, objects are moving, scene is important, Knowing, optical flow estimators
备注：
点击查看摘要
Abstract:Knowing where and how fast objects are moving within a scene is important across various domains. Usually, cameras are used to capture the data necessary for this task, but adding cameras often raises privacy concerns, and the quality of captured frames is heavily influenced by lighting conditions. In this work, we explore using WiFi channel state information (CSI) instead of camera frames for optical flow estimation. We propose WiFlow, a CSI based flow estimator, a preprocessor evaluation for CSI, and three model architectures that offer different trade-offs between accuracy and complexity. Further, we create the first dataset for training and evaluating CSI-based optical flow estimators, and our experiments provide insights into key design elements for this task. Code and data are available at this https URL.
44. 【2609.02448】Adapting a Foundation Model for Lunar Surface Height Estimation
链接：https://arxiv.org/abs/2609.02448
作者：Patrick Bauer,Marius Schwinning,Melanie Siegel,Andreas Weinmann,Hichem Snoussi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Digital elevation models, European Space Agency, Digital elevation, lunar surface, making it invaluable
备注：
点击查看摘要
Abstract:Digital elevation models (DEMs) can provide accurate height information, making it invaluable for analyzing the lunar surface. As the European Space Agency (ESA) prepares for future lunar missions that aim to land on the Moon, a precise method for height estimation will be essential for hazardous terrain that could endanger the landing approach. Traditional approaches to generate DEMs from imagery, such as shape from shading (SfS) and stereophotogrammetry (SPG) have been proven highly valuable for this task. However, due to advancements in machine learning, especially computer vision, the focus has shifted towards monocular depth estimation via deep learning. The lunar surface is covered by rocks and craters, and classic hazard detection methods rely solely on 2D image data. Our goal is to address this issue by developing a relative lunar surface height estimator that can provide additional information for hazard localization. In this letter, we present a methodology that builds on the well-known zero-shot relative depth estimation model Depth Anything V2 (DAV2). Other works have been using it as a state-of-the-art comparison for their proposed lunar DEM estimation method, but without adaptations to the target domain. Thus, it may underperform. Therefore, we propose a fine-tuning strategy with publicly available SPG-derived DEM data of the lunar surface. Our results demonstrate a significant improvement in performance compared to the zero-shot model, effectively transforming DAV2 into a reliable relative depth estimator of the lunar surface.
45. 【2609.02434】Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network
链接：https://arxiv.org/abs/2609.02434
作者：Zheke Jin,Yuning Cui,Tianle Jin,Alois Knoll,Hu Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Restoring images degraded, adverse weather remains, weather remains challenging, remains challenging due, Restoring images
备注：
点击查看摘要
Abstract:Restoring images degraded by adverse weather remains challenging due to spatially heterogeneous degradations. Many existing weather-specific restoration models rely on weather-agnostic global aggregation, naive cross-scale fusion, and deterministic objectives, which struggle to handle heterogeneous degradations in all-in-one adverse-weather settings. To address these limitations, we propose an Uncertainty-guided Adverse-weather Restoration Network (UAR-Net), a weather-specific AiO framework that integrates a gated transformer with balanced multi-scale skip connections. Specifically, we employ Gated Dual-scale Transformer Blocks (GDTB) to jointly model selective global interactions and multi-scale local structures, a progressive Balanced Multi-scale Skip Connection (BMSC) for balanced multi-scale feature integration, and an Uncertainty-Aware Refinement Head (URH) that performs artifact removal, detail enhancement, and predictive uncertainty estimation. The model is supervised by a Brightness-Aware Energy Loss (BAE-Loss) to encourage accurate reconstruction with well-calibrated uncertainty. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple adverse-weather benchmarks. The codes will open source upon acceptance.
46. 【2609.02411】he Diagnosis a Reporter Leaves Unspoken: Surfacing Frozen Tumor Features for Brain-Tumor MRI Reporting
链接：https://arxiv.org/abs/2609.02411
作者：Khawaja Murad ul Hassan,Ruqiyya Adil,Adil Qayyum,Rida Hassan,Asad Mansoor Khan,Muhammad Usman Akram,Mehran Ebrahimi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：capable brain-MRI report, brain-MRI report generator, diagnostically silent, capable brain-MRI, brain-MRI report
备注： 10 pages, 2 figures, 3 tables. Accepted at MLCN 2026, a workshop held in conjunction with MICCAI 2026; to appear in Springer LNCS
点击查看摘要
Abstract:A capable brain-MRI report generator can still be, in effect, diagnostically silent. When a multi-chain chain-of-thought (CoT) reporter built on a medical Mistral-7B backbone is evaluated on held-out cohorts, it names most meningiomas and almost all metastases "glioma" (diagnosis recall 0.44/0.07). Yet the answer is not absent from the model: a supervised linear probe applied to its frozen segmentation features recovers the three tumour cohorts at 0.82 macro-F$_1$ (5-fold cross-validation; chance $\approx$0.33). We introduce NeuroFusion, an assistive reporter that surfaces this latent signal rather than overriding it: discriminative field-classifier heads over per-lesion features condition a fast, single-pass draft-then-review decoder on their committed outputs. Built on the identical Mistral backbone, this restores the diagnosis (meningioma 0.92, metastasis 0.75) and wins 8 of 9 prose-content comparisons across three held-out cohorts (RaTEScore, RadGraph-F$_1$, GREEN; Holm-corrected paired BCa), with no significant loss on the ninth, at 5-6x lower latency ($\approx$80 vs. 457 s/case). A controlled negative result sharpens the mechanism: a learned diagnosis pin that overrides the decoder instead of merely informing it collapses out-of-distribution metastasis recall to 0.03. Grammar-constrained decoding keeps 92.3% of records schema-valid, making every sentence entailment-checkable (7.5% contradicted vs. 36.8% for the direct baseline). In a blinded nine-case pilot, two board-certified neurologists independently rated NeuroFusion highest in every tumour type, the only system with zero critical errors, and gave it the top-rated sign-off in eight of nine cases (six outright, two ties).
47. 【2609.02401】CA-OPD: Confidence-Aware On-Policy Distillation for Structured Visual Prediction
链接：https://arxiv.org/abs/2609.02401
作者：Menghao Li,Linjie Mu,Yin Wang,Haotian Hu,Yannian Gu,Lujiayi Xue,Fanyi Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autoregressive vision language, vision language models, language models unify, models unify heterogeneous, unify heterogeneous perception
备注：
点击查看摘要
Abstract:Autoregressive vision language models unify heterogeneous perception tasks but are highly susceptible to compounding errors. On-policy distillation (OPD) bridges the training-inference mismatch by training students on their own rollouts. However, unreliable student predictions, especially early in training, can derail the trajectory and degrade the quality of teacher supervision. While recent interleaved distillation methods allow the teacher to verify and replace student tokens, they primarily rely on rigid ranking metrics rather than exact teacher confidence, and they overlook how intervention decisions can inform token-level supervision. To address this, we introduce Confidence-Aware On-Policy Distillation (CA-OPD), a framework that couples reliable rollout construction with adaptive supervision. CA-OPD utilizes teacher confidence to selectively correct unreliable student transitions, gradually transferring rollout control to the student via a strict-to-relaxed schedule. Crucially, CA-OPD aligns knowledge transfer with these intervention decisions: corrected positions receive direct cross-entropy supervision from the teacher's prediction, while retained positions benefit from the teacher's full predictive distribution. Evaluated in a multi-teacher setting for GUI grounding and optical character recognition, CA-OPD substantially improves the Qwen3.5-0.8B baseline across all six target benchmarks, including gains of $9.50$ points on ScreenSpot-Pro and $6.72$ points on OCRBench-v2 English. Controlled studies further show that the gains depend on intervention placement, progressive rollout control, and intervention-aligned supervision, rather than intervention frequency alone.
48. 【2609.02377】ProSR: Semantic-Prototype-Guided Discrete Modeling for Physically Consistent SAR Super-Resolution
链接：https://arxiv.org/abs/2609.02377
作者：Byoungwoo Kim,Munchurl Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：High-resolution Synthetic Aperture, Synthetic Aperture Radar, High-resolution Synthetic, Aperture Radar, Synthetic Aperture
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:High-resolution Synthetic Aperture Radar (SAR) imagery is critical for precision analysis such as automatic target recognition, yet its acquisition is costly. Although generative image super-resolution (ISR) models offer a promising alternative, current smooth-approximation based diffusion frameworks often struggle to preserve the coherent scattering statistics, causing stochastic structural distortions that are less consistent with real SAR physics. To address this, we propose Semantic Prototype-Guided Super-Resolution (ProSR), reformulating SAR ISR as a semantically-guided discrete token prediction task within a quantized latent space. By mapping signal features to discrete scattering primitives, ProSR preserves the impulsive nature of SAR without over-smoothing. Furthermore, we integrate a Self-Supervised Learning backbone into SAR ISR to extract label-free semantic priors, overcoming label scarcity. Guided by these priors, we introduce Semantic-Aligned Detail Encoding to decouple high-frequency signals into discrete scattering primitives. In parallel, the Semantic Prototype Map Generator explicitly constructs semantic prototype maps, allowing Prototype-Map-Guided Attention to route the information flows within identical categories and mitigate inter-class interference. To validate our approach, we present a large-scale 0.25m resolution benchmark from the Umbra Open Dataset. Experimental results show ProSR achieves superior visual quality while preserving essential scattering characteristics required for practical SAR applications.
49. 【2609.02369】Information Density Imbalance in Visual Object Detection
链接：https://arxiv.org/abs/2609.02369
作者：Ziwei Zhao,Yanxi Lu,Yuwei Hu,Shiyang Su,Mingxuan Wang,Chenyue Zhou,Jiayi Chen,Hehan Li,Xiaoshuai Hao,Andi Zhang,Yanbiao Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：long-tailed distribution, implicitly assuming, information density, perform poorly, poorly on categories
备注： 12 pages, 6 figures
点击查看摘要
Abstract:In object detection, the number of instances is typically used to determine whether a dataset exhibits a long-tailed distribution, implicitly assuming that the model will perform poorly on categories with fewer instances. This assumption has led to extensive research on category bias in datasets with imbalanced instance numbers. However, even in datasets where instance numbers are relatively balanced, models still exhibit category bias, indicating that instance count alone cannot explain this phenomenon. In this work, we first introduce the concept and measurement of information density. We then observe a significant negative correlation between a category's information density and its accuracy, and we investigate how the training process impacts this relationship. Empirical studies suggest that information density imbalance may be a potential source of category bias. To preliminarily validate the potential of information density, we made simple improvements to three advanced object detection loss functions using this concept. Experiments on the Pascal VOC, COCO-LT, and LVIS datasets demonstrate that information density can significantly reduce model bias while effectively enhancing the overall performance of existing loss functions. This study provides a new perspective for understanding the generalized bias phenomenon in object detection models and offers new tools for designing fairer loss functions and training strategies.
50. 【2609.02367】he Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation
链接：https://arxiv.org/abs/2609.02367
作者：Yichen Liu,Quanwei Zhang,Haozhe Wang,Donghao Zhou,Xiaojie Li,Yang Shi,Jiaming Liu,Ruihua Huang,Yingtian Zou,Daquan Zhou
类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)
关键词：made substantial progress, audio-video generation models, Joint audio-video generation, models have made, made substantial
备注：
点击查看摘要
Abstract:Joint audio-video generation models have made substantial progress in visual quality and audio-visual synchronization. However, they still provide limited control over when shot transitions occur and dialogue is spoken. This limitation constrains their application in script-driven content creation, where timing errors can undermine narrative coherence and the viewing experience. Current joint generators align video and audio representations on a shared temporal axis, yet the precise timing of shots and dialogue specified in a structured prompt is encoded only in the prompt's text representation and remains unaligned with the temporal coordinates of either modality. Consequently, video and audio may remain synchronized with each other while both fail to follow the script timeline. This mismatch motivates us to extend temporal alignment beyond video and audio to include the structured script. We therefore introduce Temporal Context Routing (TCR), which maps the script timing onto the shared temporal axis of video and audio generation and routes each prompt's guidance to the corresponding positions in both modalities. Compared with the baseline on 200 test scripts, TCR reduces Shot Boundary MAE by 96%, from 1.11 s to 0.042 s, and raises Dialogue Acc@0.5 s from 28.3% to 84.1%. TCR achieves these improvements while maintaining visual quality and audio-visual synchronization comparable to those of the baselines. A user study further shows that participants prefer TCR on all five evaluated dimensions.
51. 【2609.02359】mpoGround: State-Aware Streaming Visual Grounding with Vision-Language Models
链接：https://arxiv.org/abs/2609.02359
作者：Leqian Ding,Junning Qiu,Manwen Yang,Yu Guo,Fei Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：maps language referents, grounding maps language, Visual grounding, Visual grounding maps, Streaming Grounding Reinforcement
备注：
点击查看摘要
Abstract:Visual grounding maps language referents to spatial targets and is central to open-vocabulary perception with vision-language models. Existing methods have made substantial progress on single-frame and video-based visual grounding, yet under streaming inputs they still suffer from identity drift, cross-frame inconsistency, and fragile localization under partial occlusion. To address these issues, we present TempoGround, a VLM-native framework that detects cross-frame object correspondence and explicitly models object presence states, thereby enabling accurate and consistent visual grounding under streaming inputs. The key is a curriculum prediction mechanism guided by state-aware cross-frame correspondence: TempoGround resolves 2D instance association, predicts whether each object newly enters, continues in, or leaves the view, decodes the 2D box, and then lifts it to a camera-frame 3D box. As token-level supervision alone cannot capture the geometric objectives of streaming grounding, we further introduce Streaming Grounding Reinforcement (SGR), which optimizes TempoGround with verifiable Grounding, Identity, and Consistency rewards, jointly reinforcing persistent localization and temporally consistent predictions. We carefully design a three-stage training strategy and train TempoGround on large-scale data. We evaluate visual grounding under causally streaming inputs on multiple challenging benchmarks: TempoGround improves F1_2D@0.5 and F1_2D@0.95 by 4.4 and 0.5 on average, and F1_3D@0.25 and AP_3D by 6.2 and 7.5, respectively. These results demonstrate that TempoGround provides a practical foundation for visual grounding under streaming inputs.
52. 【2609.02350】LookStep: Efficient Vision-Language Navigation with Linguistic Foresight and Event Driven Memory
链接：https://arxiv.org/abs/2609.02350
作者：Kun-Yang Yu,Yingzhe Li,Hongyu Xu,Shi-Yu Tian,Zhi Zhou,Yang Chen,Ming Yang,Sheng Wang,Qing Yu,Lan-Zhe Guo,Yu-Feng Li
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：follow natural-language instructions, Multimodal Large Language, unseen environments, embodied agent, natural-language instructions
备注： 19 Pages, 7 Figures. Accepted in EMNLP 2026 Main
点击查看摘要
Abstract:Vision-Language Navigation (VLN) requires an embodied agent to follow natural-language instructions in unseen environments. Recent progress has been largely driven by Multimodal Large Language Models (MLLMs). Existing methods follow a next-step action prediction paradigm, supervising only the expert action, which requires a high quantity of data for training. They also rely on cognitive maps, accumulated historical frames, or external 3D tools to maintain states, leading to high computational and memory overhead. To realize resource efficiency VLN, we propose LookStep, a unified end-to-end framework that combines Language Centric Future State Modeling and Event Driven Rolling Memory that uses language labels to generate coarse-grained navigation progress and future states for each candidate action, while autonomously deciding whether to write each observation into a bounded rolling memory with a semantic role. We validate LookStep empirically. On VLN-CE tasks, LookStep outperforms existing methods under the same training settings, achieving a 49.7\% success rate on R2R-CE Val-Unseen with better memory efficiency and less data usage. Code and model is available at this https URL.
53. 【2609.02349】GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors
链接：https://arxiv.org/abs/2609.02349
作者：Qiang Xiang,Shuang Sun,Binglei Li,Yibo Chen,Xu Tang,Yao Hu,Junping Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：text remains difficult, Rendering accurate text, accurate text remains, remain insufficiently accurate, text rendering
备注：
点击查看摘要
Abstract:Rendering accurate text remains difficult for image generation and editing models, especially when the target contains long, complex, and densely arranged text or rare characters. Existing approaches either improve native text rendering through stronger backbones and data-centric training without explicit glyph priors, or incorporate glyph priors through specialized designs that remain insufficiently accurate and robust under challenging scenarios. We introduce GlyphAnchor, a novel text-rendering enhancement method for both text-to-image and image-editing diffusion transformer models. GlyphAnchor enhances the backbone with lightweight glyph patch conditions whose positions are anchored to the target image through the model's native positional encoding. We train this capability with staged supervised finetuning and further refine it with text-aware post-training to improve robustness. We also introduce InfoTextBench, a benchmark for evaluating text-rich visual text rendering in both generation and editing settings. Experiments across multiple backbones and benchmarks, including long, complex, and densely arranged text and rare character scenarios, show that GlyphAnchor consistently improves text fidelity while preserving overall image quality.
54. 【2609.02348】Structured-Prior-Guided Diffusion Inpainting with Physical Consistency for Traffic Sign Augmentation
链接：https://arxiv.org/abs/2609.02348
作者：Luo Li,Chongchong Huang,Jun Jia,Qiang Gao,Xinlong Liu,Gui Yang,Liang Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：long-tailed data distribution, Traffic sign detection, Traffic sign, faces a long-tailed, sign detection faces
备注：
点击查看摘要
Abstract:Traffic sign detection faces a long-tailed data distribution. Many rare signs matter as much as common ones from a regulatory standpoint, yet they have very few samples. Generative data augmentation is one way out. General-purpose inpainting models, however, distort digits, deform geometry and perspective, and shift colours when applied directly to sign regions. We trace this to a single gap: the conditioning signal is too abstract for the physical composition of a sign. We propose a structured-prior-guided diffusion inpainting framework with physical consistency. It injects the semantic, appearance and geometric priors of a sign through three orthogonal pathways: a JSON-formatted text prompt, a front-view vector template rendered with measured dominant colours (via IP-Adapter), and an affine-aligned vector template (via ControlNet). Two physical consistency losses constrain colour with a CIELAB chromaticity $L_1$ term and edge structure with a Sobel gradient term. We train by self-supervised reconstruction on a large set of images collected in-house at AMAP, then evaluate zero-shot on the public TT100K-2021 dataset, a different source. Our method uses a Stable Diffusion 1.5 backbone of about 1.4B parameters. It beats seven representative competitors on every metric of reconstruction fidelity, physical consistency and semantic controllability. Its OCR exact-match rate reaches 91.1\%, against 44.2\% for the 12B industrial model FLUX.1 Fill [dev], and it needs only $1/14$ of that model's inference time. Leave-one-out ablations confirm that each of the three prior pathways and both loss terms contribute on their own. In downstream detection, the synthetic data raises the group-pooled AP50 of rare classes by $1.23\times$ to $7.40\times$ over a real-data-only baseline. Code and pre-trained models are available at this https URL.
55. 【2609.02341】owards Zero-Shot Transfer Across Embodiments For Driving VLAs
链接：https://arxiv.org/abs/2609.02341
作者：Caio Azevedo,Stefano Sabatini,Sascha Hornauer,Fabien Moutarde
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：leveraging multimodal pretraining, shown strong potential, visual reasoning, autonomous driving, strong potential
备注：
点击查看摘要
Abstract:Vision-Language-Action models (VLAs) have shown strong potential in autonomous driving by leveraging multimodal pretraining for instruction following, visual reasoning, and scene-level generalization. In robotic manipulation, scaling VLA fine-tuning across multiple robot setups--especially when unifying representations across embodiments--has been shown to improve in-dataset performance and cross-embodiment generalization; in autonomous driving, however, VLAs remain largely trained on individual datasets and are rarely evaluated for zero-shot transfer to unseen datasets and camera rigs; furthermore naively adding more datasets to the training data does not necessarily lead to better performance within seen embodiments. To address these problems, we study multi-dataset training for the driving task and BEV-Forcing, an auxiliary objective that transfers ground-plane object-layout information from a specialized Bird's-Eye-View model into the VLA backbone. By encouraging the model to represent object position through a shared BEV spatial interface, we show that an auxiliary task such as BEV-Forcing can improve both in-distribution and out-of-distribution performance when training on a small number of camera rigs. As the number of training embodiments increases, however, the benefits of the auxiliary task are reduced; we present this as evidence that new techniques in the literature may see their benefits diminish when simply scaling up training diversity, which motivates presenting results taking into account data scaling.
56. 【2609.02333】ORB-SVM : An Innovative Hybrid Framework for Efficient Brain Tumor Detection from MRI Scans
链接：https://arxiv.org/abs/2609.02333
作者：Amirhosein Azarpour
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Brain cancer remains, early stage diagnosis, Magnetic Resonance Imaging, Brain cancer, modern medicine
备注： 6 pages , 7 figures
点击查看摘要
Abstract:Brain cancer remains one of the most significant challenges in modern medicine, where the accuracy of early stage diagnosis is a decisive factor in patient survival and treatment efficacy. Although Magnetic Resonance Imaging (MRI) is the established gold standard for visualizing neurological structures, the interpretation of these high dimensional scans is often complicated by subjective variability among practitioners and the inherent noise present in complex medical images. While contemporary approaches frequently rely on high parameter deep learning architectures, such models often involve significant computational costs and require extensive data for effective training. This study introduces a hybrid framework that utilizes the Oriented FAST and Rotated BRIEF (ORB) algorithm for precise feature extraction and a Support Vector Machine (SVM) for classification [1], [2]. The proposed approach achieves a sub- stantial data reduction of approximately 99.5%, which effectively minimizes the influence of non informative background data while preserving critical diagnostic patterns essential for tumor identification. By balancing feature sparsity with a robust kernel based classifier, this methodology addresses the limitations of over parameterized systems while maintaining high diagnostic integrity. Experimental evaluations conducted on the Br35H dataset demonstrate that the framework attains a classification accuracy of 97.5%. The findings suggest that the integration of localized feature representation and optimized classification provides a reliable and resource efficient alternative for medical image analysis, offering a structured solution that maintains per- formance without the need for extensive computational overhead.
57. 【2609.02318】YesTrack: Referring Multi-Object Tracking via MLLM-based Yes/No Verification
链接：https://arxiv.org/abs/2609.02318
作者：Quansheng Hu,Qin Sun,Qiansen Dai,Jin Ding,Wan Zhang,Xue Zhou,Jianxiao Zou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：aims to track, track every instance, video that matches, language expression, Referring multi-object tracking
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Referring multi-object tracking (RMOT) aims to track every instance in a video that matches a given language expression. Despite the recent integration of multimodal large language models (MLLMs) to enhance generalization, existing methods predominantly relegate them to the role of caption generators, necessitating external modules for final decision-making. This paradigm not only introduces extra latency but also severely underutilizes the inherent vision-language alignment capabilities of MLLMs. To address these limitations, we propose YesTrack, a novel two-stage RMOT method that reformulates referring as a discriminative task, directly leveraging MLLMs for Yes/No verification without explicit text generation. To further enhance the reliability and efficiency of this MLLM-based verification, we introduce two lightweight temporal consistency constraints: Temporal Confidence Prior (TCP) and Temporal Reference Propagation (TRP). We further validate the generality of this discriminative paradigm by proposing YesTrack-MOT, a straightforward yet highly effective instantiation for generic multi-object tracking (MOT). Experiments on Refer-KITTI and Refer-KITTI-V2 show that YesTrack significantly outperforms existing state-of-the-art methods while maintaining high efficiency, even when implemented with the smallest variant of Qwen3-VL. Code is released at this https URL.
58. 【2609.02299】Domain shift-robust object detection with GenAI image editing
链接：https://arxiv.org/abs/2609.02299
作者：Isabel D. Stein,Thijs A. Eker,Sebastiaan P. Snel,Ella P. Fokkinga,Klamer Schutte,Luca Ambrogioni,Friso G. Heslinga
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Object detectors, Object, domain, data, shifts alter object
备注： Submitted to SPIE Sensors + Imaging 2026
点击查看摘要
Abstract:Object detectors often degrade under domain shifts such as changes in lighting, weather, or occlusion. These shifts alter object appearance and expose a reliance on visual shortcuts learned from the training distribution that do not generalize across domains. Acquiring sufficient real-world samples to capture such domain variation is particularly difficult in specialized, low-data settings. Recent advances in diffusion-based generative image editing have shown promise for improving the in-domain performance of object detectors through synthetic data augmentation. However, their potential to improve out-of-domain robustness remains largely unexplored. We hypothesize that generative image editing can simulate a controlled domain shift in training data, effectively bridging the gap between source and target domains. To test this, we studied camouflaged military vehicle detection as a challenging domain shift scenario. Detectors trained on uncamouflaged data demonstrate substantial degradation on real test imagery containing foliage, netting, and multi-spectral camouflage across 15 vehicle classes in close-up, ground-level imagery. We used two diffusion-based editing models, Qwen Image Edit 2509 and Flux.2 Dev, to synthetically add camouflage to the training data, alongside a LoRA fine-tuned version of Qwen. A non-generative black-bar occlusion baseline served as a lower bound on augmentation quality. Using a GroundingDINO detector trained on real and synthetic data, generative camouflage augmentation yielded substantial mAP improvements for foliage (+20.1) and netting (+14.4) camouflage. Generating multi-spectral camouflage proved more challenging, but LoRA fine-tuning improved performance by 4.4 mAP over the uncamouflaged baseline.
59. 【2609.02291】VoRTeC: Taming Foundation Flow for One-step Real time Video Compression
链接：https://arxiv.org/abs/2609.02291
作者：Yichong Xia,Qinhong Wu,Qinhong Wu,Jinpeng Wang,Zeyuan Chen,Haoqian Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Ultra-low bitrate video, faces critical challenges, introduces blurring artifacts, compression inevitably introduces, inevitably introduces blurring
备注：
点击查看摘要
Abstract:Ultra-low bitrate video compression still faces critical challenges: traditional neural video compression inevitably introduces blurring artifacts, while diffusion-based generative video compression suffers from excessive decoding latency and poor temporal consistency. To address these issues, we propose $\mathtt{VoRTeC}$, a Video Compression framework built upon a foundational flow model (Wan2.1). By compactly encoding latent video representations, predicting the positions of compressed representations along flow trajectories, and integrating multi-scale priors, $\mathtt{VoRTeC}$ enables the compressor to harness generative video flow priors effectively. Without accessing the parameters or gradients of flow matching networks, our framework achieves one-step decoding and reconstructions with high perceptual fidelity. Meanwhile, we maintain consistency across frame groups via tail-frame reuse and prior caching. Extensive experiments demonstrate that our method reduces bit consumption by 58\% compared to prior diffusion-based approaches, with decoding speed boosted by 3 to 197 times: $\mathtt{VoRTeC}$ achieves a decoding speed of 13 FPS at 720p and 32 FPS at 480p.
60. 【2609.02289】If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detection
链接：https://arxiv.org/abs/2609.02289
作者：Yinghao Sun,Shuguang Li,Jinliang Shao,Tieshan Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：training taxonomy, trained on closed-set, category-independent Doppler motion, Doppler motion cues, Detectors trained
备注： 8 pages, 5 figures, 4 tables, submitted to 2027 ICRA
点击查看摘要
Abstract:Detectors trained on closed-set annotations can miss rare moving objects outside the training taxonomy. Automotive radar provides category-independent Doppler motion cues and is less affected by adverse illumination and weather, but sparse, noisy returns hinder class-aware 3D box detection. Surface location and velocity remain useful for motion reasoning and collision avoidance when full box geometry is difficult to recover. We present the Physics-Aware Radar Transformer (PART), a fully sparse radar-only detector that predicts existence confidence, a representative surface point, and 2D ground-plane velocity for each moving-object hypothesis. Doppler-Aware Query Initialization (DAQI) replaces scene-independent learned queries with input-dependent proposals by clustering radar returns in position and velocity, easing query-object assignment in sparse scenes. Physics-Guided Cross-Attention (PGCA) incorporates radial-Doppler consistency and radar cross section (RCS) into query-point association. Uncertainty-aware supervision randomly masks ground-truth objects and assigns soft existence targets to ambiguous radar-supported queries, reducing reliance on exhaustive annotations. With only 1.1 million parameters, PART achieves a class-agnostic average precision (CA-AP) of 0.8827, a mean average surface translation error (mASTE) of 0.3188 m, and a mean average velocity error (mAVE) of 0.8084 m/s on nuScenes. It attains 0.9203 recall on rare and safety-relevant categories excluded from the standard evaluation and remains effective at night, in rain, and under severe occlusion. Inspection of apparent false positives shows that some predictions correspond to moving objects absent from the nuScenes annotations. Code and pretrained model weights will be publicly available at this https URL.
61. 【2609.02288】Diffusion-Encoding Gaussian Field for Joint k-q dMRI Reconstruction
链接：https://arxiv.org/abs/2609.02288
作者：Zhibo Chen,Yajuan Huang,Yu Guan,Qiuyun Fan,Dong Liang,Qiegen Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：MRI requires repeated, making acquisition time, acquisition time dependent, Diffusion MRI requires, MRI requires
备注： 11 pages, 8 figures. Preprint submitted to IEEE Journal of Biomedical and Health Informatics
点击查看摘要
Abstract:Diffusion MRI requires repeated k-space acquisitions over multiple diffusion-encoding directions, making acquisition time dependent on both spatial and angular sampling. Existing joint k-q methods either associate directional parameters with fixed voxels or separate spatial reconstruction from angular completion. However, diffusion-weighted images acquired under different directions share the same anatomical organization, while their local signal intensities vary with diffusion encoding. Existing formulations do not fully exploit the complementarity between shared anatomy and direction-dependent signal variation. Consequently, residual spatial errors may be misinterpreted as genuine angular variation and propagated to unobserved directions. We propose a subject-specific spatial-angular Gaussian field for self-supervised joint k-q dMRI reconstruction. Shared 3D Gaussian primitives provide local spatial support, with each primitive carrying a continuous q-conditioned tensor-residual response. The signal at each location is synthesized from multiple overlapping primitive responses, coupling neighboring spatial regions and diffusion directions. The field is progressively optimized from undersampled k-space measurements of observed directions, without fully sampled targets or held-out-direction supervision. Experiments on three HCP diffusion shells under multiple acceleration settings demonstrated consistent improvements in missing-direction DWI reconstruction, tensor-derived metrics, and principal diffusion orientation estimation.
Comments:
11 pages, 8 figures. Preprint submitted to IEEE Journal of Biomedical and Health Informatics
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.02288 [cs.CV]
(or
arXiv:2609.02288v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.02288
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
62. 【2609.02282】RouteGraph-Mona: Confusion-Aware Routing Fine-Tuning for Mineral Image Classification
链接：https://arxiv.org/abs/2609.02282
作者：Jierui Li,Zhiyuan Qi,Hao Zhu,Yufan Liu,Jixian Liu,Shaojie Jiang,Jianda Wang,Yaqi Liu,Xiaotong Li,Wei Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：substantial intra-class variations, inter-class visual similarity, high inter-class visual, resource development, remains challenging due
备注：
点击查看摘要
Abstract:Mineral image classification is important for geological exploration and resource development, but it remains challenging due to substantial intra-class variations in appearance and high inter-class visual similarity. Multi-cognitive Visual Adapter (Mona) is a vision-oriented parameter-efficient adapter that adapts pre-trained visual models by tuning only a few parameters. However, Mona statically aggregates responses from multiple scales, limiting its ability to accommodate sample-specific scale preferences and model confusion among visually similar mineral categories. To address this issue, we propose \textbf{RouteGraph-Mona}, a lightweight route-space regularization method built on Mona. Specifically, we replace Mona's static multi-scale aggregation with sample-adaptive routing. The resulting branch-selection behavior defines a compact routing space that captures each image's scale preferences. We then regularize the resulting routing signatures with class-wise route anchors and confusion-weighted margins. The route anchors encourage class-consistent routing patterns, while the margins promote greater separation between visually similar categories in the routing space. Experiments on three public mineral image datasets with two visual backbones show that RouteGraph-Mona consistently outperforms Mona in mean accuracy and remains competitive with representative fine-tuning methods and mineral image classification baselines.
63. 【2609.02268】Retrosynthesis of Synthetic Media for Explainable AI Provenance Forensics
链接：https://arxiv.org/abs/2609.02268
作者：Yijie Lin,Ching-Chun Chang,Isao Echizen,Hui Li,Chin-Chen Chang
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Machine Learning, modifying generator architectures, major challenge, rapid proliferation, synthetic media
备注： 12 pages, 10 figures. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible
点击查看摘要
Abstract:With the rapid proliferation of generative models on Machine Learning as a Service (MLaaS) platforms, reliably tracing the provenance of synthetic media without modifying generator architectures or parameters remains a major challenge. In this work, we propose a self-referential retrosynthesis framework for explainable AI provenance forensics under a fixed-generator setting. The framework leverages a jointly optimized encoder-decoder pair to implement a self-embedding mechanism that enables round-trip consistency verification. During inference, client inputs are first encoded and then processed by the generator to produce outputs with high visual fidelity. For forensic verification, the consistency between the resynthesized image and the query image is analyzed to determine whether the image originates from the target generative model. Our approach eliminates the need for watermark embedding or modifications to the generation process. Experimental results show that images generated from encoded inputs maintain visual quality comparable to original generator outputs, while decoded images reliably trace back to their corresponding source inputs. Furthermore, the framework provides interpretable evidence for generative content provenance, establishing a practical tool for explainable generative AI forensics.
64. 【2609.02266】MAOL: Morphology-Aware Ordinal Learning for Fine-Grained Industrial Defect Severity Grading
链接：https://arxiv.org/abs/2609.02266
作者：Zhaoyang Wang,Haiyong Chen,Binyi Su,Kun Liu,Kun Wang,Xianen Zhou,Atik Shahariar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, defect severity grading, clean annotated instances, severity grading, Fine-grained defect severity
备注： Accepted at IEEE ICME 2026
点击查看摘要
Abstract:Fine-grained defect severity grading is essential for industrial inspection, yet remains challenging due to the ordinal nature of severity labels, the strong dependence on morphology-related cues, and the train-test discrepancy between clean annotated instances and noisy predicted instances in two-stage pipelines. We propose MAOL, a Morphology-Aware Ordinal Learning framework for fine-grained industrial defect severity grading. MAOL formulates severity grading as an instance-level ordinal learning task, incorporates explicit morphological features to enhance representation learning, introduces class-conditional adaptive ordinal thresholds to model defect-specific grading boundaries, and employs prediction-aware training via localization perturbation to improve robustness to imperfect predicted instances. Extensive experiments under both clean-ROI and predicted-instance settings demonstrate that MAOL consistently outperforms rule-based methods, nominal classification models, and existing ordinal baselines, especially in the predicted-instance setting. The proposed approach ranked third in the IDA 2026 Challenge on Fine-Grained Severity Grading for High-Precision Manufacturing.
65. 【2609.02255】2LSC-Bench: Benchmarking Localized Semantic Control in Text-to-Image Generation
链接：https://arxiv.org/abs/2609.02255
作者：Yan Wang,Xinyi Hou,Weiguo Lin,Junjun Si,Siwei Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Semantic Leakage Rate, semantic leakage, reliable localized text, localized text control, text control requires
备注：
点击查看摘要
Abstract:Recent text-to-image models have become increasingly capable of rendering explicit text, but reliable localized text control requires more than generating the correct string. In applications such as product labeling, signage, and interface design, target text should be rendered within a designated text-bearing region without altering the predefined subject identity or surrounding scene semantics. We refer to violations of this requirement as target-text-associated semantic leakage, in which target-text semantics are expressed through non-textual visual content beyond the designated anchor. Existing visual-text benchmarks primarily evaluate readability, spelling accuracy, and layout, leaving this form of semantic leakage largely unexamined. We introduce T2LSC-Bench, a controlled diagnostic benchmark comprising 50 seed subjects and 1,200 prompt cases per model, yielding 7,160 evaluated images across six models. Its factorized design varies semantic relation, scene openness, prompt mode, and language. A dual-branch protocol combines OCR-VLM text verification with structured VLM semantic judgments to measure Text-at-Anchor Accuracy (TAA), Semantic Subject Preservation (SSP), Semantic Leakage Rate (SLR), and Conditional Semantic Leakage Rate (cSLR). Under stress-test conditions, SLR increases from 1.2% to 18.1% and cSLR from 1.3% to 18.2%, whereas TAA decreases only from 91.4% to 90.9%. Anti-leakage prompting reduces SLR from 16.6% to 8.4% without degrading rendering accuracy. Human validation on 420 images shows strong agreement between automatic and adjudicated annotations. These results show that accurate text rendering does not guarantee local containment of target-text semantics.
66. 【2609.02251】Handwriting Trajectory Recovery via Autoregressive Ordered Stroke Instance Prediction
链接：https://arxiv.org/abs/2609.02251
作者：En-Guang Wang,Yan-Ming Zhang,Fei Yin,Cheng-Lin Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：static handwritten image, dynamic writing process, writing process hidden, handwritten image, writing process
备注： 24 pages, 6 figures, 7 tables
点击查看摘要
Abstract:Handwriting trajectory recovery aims to infer the dynamic writing process hidden behind a static handwritten image. Since offline handwriting preserves only the final spatial ink pattern, temporal information such as stroke order, writing direction, and pen-tip motion is lost, making recovery inherently ambiguous. Existing learning-based methods often directly predict the complete character trajectory without explicitly exploiting the stroke-level organization of handwriting. We argue that recovering the writing process should follow the writing process itself. Accordingly, we propose a two-stage framework that first recovers ordered stroke instances and then reconstructs continuous within-stroke motion. The first stage integrates stroke extraction and stroke-order recovery through autoregressive ordered stroke prediction, while direction-related structural cues further support within-stroke trajectory generation. Experiments on Chinese handwriting show that the proposed ordered prediction is more effective than post-hoc stroke ordering. Even without trajectory simplification, our full-point model achieves numerically better results than those reported by all compared baselines, while a controlled analysis shows that trajectory sampling density substantially affects measured recovery performance. Additional experiments demonstrate generalization to unseen Chinese character categories and cross-language extensibility to English and Tamil handwriting.
67. 【2609.02247】SAUF-Net: Structure--Appearance Representation Learning with Uncertainty Feedback for Semi-Supervised Medical Image Segmentation
链接：https://arxiv.org/abs/2609.02247
作者：Qin Lu,Zheyang Jing,Yujie Yang,Jianwang Li,Chen Yi,Shaofeng Jiang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：shown great potential, reducing annotation costs, medical image segmentation, shown great, great potential
备注：
点击查看摘要
Abstract:Semi-supervised learning has shown great potential for reducing annotation costs in medical image segmentation. However, most existing methods mainly exploit unlabeled data through prediction-level consistency, while the reliability of internal feature representations is often overlooked. In medical images, target-related structural cues are easily entangled with unstable appearance variations, which may lead to unreliable pseudo labels and error accumulation during training. To address these issues, we propose SAUF-Net, a Structure--Appearance Representation Learning with Uncertainty Feedback Network for semi-supervised medical image segmentation. SAUF-Net uses the Structure--Appearance Decomposition Module (SADM) to separate bottleneck features into structural and appearance representations. The Disentangled Guidance Module (DGM) injects these representations into the decoding process to enhance structure-aware segmentation. Meanwhile, the Auxiliary Decoder produces branch-specific predictions for reliability estimation and a fused prediction for appearance-swapped consistency. Furthermore, we introduce an Appearance-Swapped Consistency branch to encourage structural representations to remain stable under appearance variations. We also introduce a reliability-map-guided dual-head discriminator with a Validity Head and an Uncertainty Head to provide feature-level uncertainty feedback. Extensive experiments on ISIC-2016 and Kvasir-SEG demonstrate that SAUF-Net outperforms state-of-the-art semi-supervised methods, especially under low-label settings.
68. 【2609.02233】InfraPatch: Cross-Task Targeted Grayscale Patch Attacks on Infrared-Adapted Vision-Language Models
链接：https://arxiv.org/abs/2609.02233
作者：Chengyin Hu,Dingyi Lu,Jiaju Han,Xiang Chen,Weiwen Shi,Jiahuan Long,Yiwei Wei,Jiujiang Guo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remains poorly understood, low-visibility conditions, poorly understood, promising paradigm, perception under low-visibility
备注：
点击查看摘要
Abstract:Infrared vision-language models (IR-VLMs) have emerged as a promising paradigm for multimodal perception under low-visibility conditions, yet their robustness to targeted adversarial attacks remains poorly understood. Existing adversarial patch methods mainly study RGB-based models or a single downstream task and do not characterize whether localized perturbations can induce an intended semantic target in IR-VLMs. We propose InfraPatch, a white-box, per-instance framework for targeted digital grayscale patch attacks against IR-VLMs. InfraPatch optimizes a compact single-channel patch within an approximately 5% local-area budget, combines proxy-guided placement with task-adaptive semantic objectives, and induces target behaviors in image classification, image captioning, and binary visual question answering. We evaluate ten infrared-adapted model variants on 300 synthetic infrared-style images generated by applying DiffV2IR to a fixed 30-category COCO subset, using clean-conditioned targeted success criteria. InfraPatch achieves targeted attack success rates from 86.00% to 100% across the ten variants. On CLIP and BLIP-2, proxy location search improves success by 6.67 and 10.33 percentage points over optimized random placement, respectively; LLaVA-1.5 remains saturated near 100% under both settings. Patch-area and objective ablations further expose substantial differences in vulnerability across architectures and task formats. These results show that small grayscale patches can inject chosen target semantics across IR-VLM families under a controlled digital threat model, motivating stronger robustness evaluation for infrared multimodal systems.
69. 【2609.02224】Signal or Noise? Auditing Rotation-Induced Saliency Drift in Medical and Aerial Imaging
链接：https://arxiv.org/abs/2609.02224
作者：Khawaja Murad ul Hassan,Mehran Ebrahimi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Post-hoc saliency maps, vision model made, deployed vision model, Post-hoc saliency, made a decision
备注： 11 pages, 3 figures, 6 tables. Code at [this https URL](https://github.com/Khawaja-Murad/EquiGrad-CAM)
点击查看摘要
Abstract:Post-hoc saliency maps such as Grad-CAM are increasingly used to audit why a deployed vision model made a decision, yet the heatmap drifts when the input is rotated, even when the prediction is unchanged. In domains with no canonical orientation, such as histopathology and aerial imagery, this undermines using saliency as evidence. We ask whether that drift is faithful signal or noise introduced by the CAM operator, and answer it by measuring equivariance at every stage of the operator rather than inferring it from the network's output. The instability is not where one would guess: the channel weights are the most rotation-stable stage, and on ResNet-50 exactly stable, because a GAP+linear head makes the class gradient field spatially constant. What moves is the spatial activation tensor, and the classifier's own pooling discards that movement. A causal test confirms the consequence: occluding the pixels whose saliency drifts costs the model less than occluding random pixels, at either orientation. The drift is carried by degrees of freedom the classifier throws away, which is what makes removing it faithful rather than destructive. EquiGrad-CAM is a training-free wrapper that takes T rotated views, inverse-rotates each view's saliency into a common canonical frame, and averages. On the full ImageNet-1K validation set it raises equivariance over single-view Grad-CAM by +36.0% (ResNet-50), +87.5% (VGG-16) and +247% (ViT-B/16); a scale-matched ablation isolates alignment before averaging, not the locus of aggregation, as the driver. It beats rotation-augmented training without retraining, lifts zero-shot CLIP by +145%, and yields rotation-consistent explanations on PatchCamelyon and RESISC45. Its by-product PEUM ranks explanations by how reproducible they are, at no cost beyond the views already taken. Code: this https URL
70. 【2609.02219】Hardware-Accelerated Instance Segmentation for Resource-Constrained Space Robotics with Criticality Analysis
链接：https://arxiv.org/abs/2609.02219
作者：Siddhant Shete,Hilmi Dogu Kücüker,Udo Frese,Frank Kirchner
类目：Robotics (cs.RO); Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Autonomous lunar missions, missions require real-time, limited onboard compute, extreme low-light conditions, radiation-induced hardware faults
备注：
点击查看摘要
Abstract:Autonomous lunar missions require real-time per- ception under three coupled constraints: extreme low-light conditions, limited onboard compute, and radiation-induced hardware faults that can silently corrupt inference. We present a deployment-oriented instance segmentation framework for resource-constrained lunar robotics that jointly addresses quan- tization calibration and system-level fault exposure under strict compute constraints. First, we introduce Activation Variance Informative Sampling (AVIS), a label-free calibration strategy that deterministically selects calibration samples based on activation variance statistics. Second, we deploy a YOLO-based segmentation model on a Deep Learning Processor Unit (DPU) with architectural modifications that reduce CPU fallback paths and enable statically compiled execution with bounded latency in low-lighting conditions. We further introduce a software-level criticality analysis to estimate fault exposure and guide mitigation under radiation-constrained operation. On a lunar micro-rover platform, AVIS with bias correction recovers 69.8% of quantization-induced accuracy loss while achieving 309 ms inference latency and 5.7 W power consumption. Targeted mitigation reduces global criticality by 31.7%. The results demonstrate an integrated approach and a blueprint for a reliable and safe AI perception framework under space deployment constraints.
71. 【2609.02212】FuDU: A Fuzzy Dual-dimensional Uncertainty Framework for Streaming Active Learning in Industrial Defect Detection
链接：https://arxiv.org/abs/2609.02212
作者：Zhaoyang Wang,Haiyong Chen,Binyi Su,Xinwei Lyu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deep learning models, Ensuring the reliability, high-stakes quality inspection, Global Uncertainty Quantification, models in real-time
备注： Accepted at ECCV 2026
点击查看摘要
Abstract:Ensuring the reliability of deep learning models in real-time industrial defect detection is critical for high-stakes quality inspection. To mine uncertain samples within continuous industrial media streams, thereby enhancing the reliability of the detection system, this paper proposes a streaming active learning method based on the Fuzzy Dual-dimensional Uncertainty (FuDU) framework. Specifically, we first design a Prototype-based Global Uncertainty Quantification (PGUQ) module on the backbone to evaluate image-level uncertainty via normal/defective feature prototypes. A Dual-entropy defect Uncertainty Evaluator (DeUE) is then integrated into the detection head to quantify box-level uncertainty. Finally, by modeling uncertainty as systematic error, we propose a fuzzy dual-dimensional uncertainty-aware strategy that leverages fuzzy inference to fuse dual-dimensional uncertainties, enabling expert knowledge-driven adaptive sampling decisions. Comprehensive experiments demonstrate that FuDU is efficient and flexible, making it well-suited for challenging industrial inspection tasks such as the detection of nuclear fuel rod defects. Our code is publicly available at: this https URL.
72. 【2609.02210】Asymmetric Paired-Annotation Learning for Multi-Structure ULF Pediatric Brain MRI Segmentation
链接：https://arxiv.org/abs/2609.02210
作者：Ha-Hieu Pham,Dang P.M. Cao,Minh Hoang Pham,Khanh Nguyen Vo Ngoc,Thanh-Huy Nguyen,Ulas Bagci,Huy-Hieu Pham
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：MRI can expand, visible ULF anatomy, pediatric neuroimaging, weakly delineated, small structures
备注： Accepted at LISA Challenge, MICCAI 2026
点击查看摘要
Abstract:Portable ultra-low-field (ULF) MRI can expand access to pediatric neuroimaging, but segmentation at 0.064 T remains challenging because anatomical boundaries are weakly delineated, small structures may be only partially visible, and high-field references can be locally misregistered. The LISA 2026 Challenge provides two non-equivalent annotations reflecting different sources of anatomical evidence: a highfield-derived (HF) mask defining the scored target and a low-field-edited (LF) mask aligned with visible ULF anatomy. In this challenge report, we describe AURA, an nnU-Net-based asymmetric supervision strategy that treats these annotations as distinct observations rather than interchangeable ground truths. AURA anchors training to the HF mask and incorporates the LF mask through a bounded reliability gate based on label disagreement, boundaries, predictive uncertainty, class reliability, and training stage. On a 16-case development split, the HF-supervised baseline, AURA, and their ensemble achieved Dice scores of 0.7984, 0.7950, and 0.7988, respectively, while the ensemble achieved an HD95 of 1.8892 and an ASSD of 0.7855. These results provide a preliminary evaluation of AURA within the LISA 2026 Challenge and motivate further assessment on the hidden test set and external ULF cohorts. Our code and pretrained models are available at this https URL A-nnU-Net-based-asymmetric-supervision-strategy.
73. 【2609.02207】LeakageBench: Document-Level Leakage Risk for Redacting Personally Identifiable Information in Document Images
链接：https://arxiv.org/abs/2609.02207
作者：Vishnu Prasad Vijaya Kumar,Santhosh Venkatesh,Ivan P. Yamshchikov
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Real-world personally identifiable, personally identifiable information, visual noise determine, PDF renderings, Real-world personally
备注：
点击查看摘要
Abstract:Real-world personally identifiable information (PII) redaction often operates on document images---scans, screenshots, and PDF renderings---where OCR errors, layout structure, and visual noise determine whether sensitive information is actually removed. Existing PII benchmarks are mostly text-centric and do not measure document-level redaction risk: a page remains unsafe if even one identifier is missed. We introduce LeakageBench, a challenge set of 500 document images with 11,954 GDPR-aligned PII annotations spanning direct identifiers, linkage keys, and contextual re-identification surfaces. We evaluate generic OCR pipelines, commercial and task-adapted OCR-dependent detectors, and OCR-free vision-language models using entity-level F1, group-wise leakage, and document-level leakage metrics. Code Interpreter raises GPT-5.5 localization F1 from 0.090 to 0.249, but critical page-level leakage remains 0.968. These results show that stronger detection and tool assistance improve localization without making most pages safe for release. LeakageBench provides a diagnostic benchmark for high-recall, spatially grounded PII redaction in document images.
74. 【2609.02204】AME: Temporal-Aware Mixture-of-Experts for Text-Video Retrieval
链接：https://arxiv.org/abs/2609.02204
作者：Uicheol Jung,Juyoung Hong,Hojung Kwon,Yukyung Choi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：extending image-text models, Text-Video Retrieval, natural-language query, match a natural-language, extending image-text
备注： 17 pages, 6 figures
点击查看摘要
Abstract:Text-Video Retrieval (TVR) retrieves videos that match a natural-language query, but extending image-text models such as CLIP to videos is fundamentally limited by the lack of temporal modeling. Videos exhibit frame-wise heterogeneity in appearance and motion, and compressing all frames into a single representation often obscures temporal structure and semantic transitions. To address this, we propose Temporal-Aware Mixture-of-Experts for Text-Video Retrieval (TAME), a CLIP-based framework that jointly models frame-level structure and temporal relations. First, we integrate sparse Mixture-of-Experts (MoE) layers into both CLIP encoders and apply frame-consistent routing on the vision branch so that experts specialize according to frame-level visual patterns while preserving the original vision-language alignment. Second, we introduce Frame-Temporal (FT) tokens that aggregate global cross-frame information and feed it back to each frame, enabling the visual encoder to capture long-range temporal dependencies without harming local details. Third, we design a Cross-Temporal Interaction and Aggregation (CTIA) module that refines frame-wise sentence-video similarities through staged temporal filtering and fusion. Experiments on standard TVR benchmarks show that TAME consistently improves over CLIP-based baselines. On MSR-VTT, it improves R@1 by 4.0 over CLIP4Clip, and also achieves consistent gains on DiDeMo, MSVD, LSMDC, and ActivityNet. The code is available at this https URL.
75. 【2609.02187】Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understanding
链接：https://arxiv.org/abs/2609.02187
作者：Shanji Liu,Kelu Yao,Junxiao Xue,Chenghui Lv,Xiangyang Miao,Yekai Huang,Yaying Chen,Chao Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：support strong visual, support strong, strong visual recognition, General-purpose vision-language models, General-purpose vision-language
备注： 18 pages, 7 figures, 17 tables
点击查看摘要
Abstract:General-purpose vision-language models (VLMs) now support strong visual recognition, instruction following, and generation. However, most pretrained visual encoders are built around three-channel natural images and do not directly accommodate observations such as native multispectral measurements or synthetic aperture radar (SAR). Adapting VLMs to these sensors typically requires dedicated encoders and domain pretraining, slowing the reuse of stronger general-purpose checkpoints. We show that the multi-image interface of general-purpose VLMs offers a lightweight alternative. Our protocol renders each observation as five optical views and one SAR view, names them in the prompt, and adapts the language network and selected visual transformer blocks with LoRA. This exposes band composites, spectral indices, and radar backscatter through an existing visual interface. For land-cover recognition, structured supervision couples predicted classes with sensor evidence. We further construct preference pairs in which a true label is omitted while its supporting evidence is retained, encouraging complete predictions that remain consistent with the observations. On a balanced six-class land-cover benchmark derived from BigEarthNet-v2, the adapted Qwen3-VL reaches 0.8275 micro F1. The same input and adaptation protocol improves all four tested VLM architectures and transfers to Sen1Floods11 flood verification and this http URL captioning. Image removal and mismatch controls show that the adapted models use the supplied sensor observations. Together, these results demonstrate that VLMs can be repurposed for multispectral and SAR tasks through rendered inputs and compact LoRA adaptation, without training a new foundation model.
76. 【2609.02184】CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splatting
链接：https://arxiv.org/abs/2609.02184
作者：Kyungdae Park,Chae Eun Rhee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dynamic four-dimensional, high-quality view synthesis, Splatting has emerged, Gaussian Splatting, powerful explicit representation
备注： 16 pages, 8 figures, and 9 tables. Published in IEEE Transactions on Visualization and Computer Graphics. Code is available at [this https URL](https://github.com/KyungdaePark/CC-4DGS)
点击查看摘要
Abstract:Dynamic four-dimensional (4D) Gaussian Splatting has emerged as a powerful explicit representation for high-quality view synthesis, yet existing methods still require tens to hundreds of megabytes per scene due to their heavy reliance on large multi-resolution hash tables and high-dimensional Gaussian attributes. This paper presents CC-4DGS, a storage-efficient and scalable framework that rethinks both deformation modeling and canonical attribute storage. First, we introduce a computational deformation field (CDF) that replaces large multi-resolution learnable hash tables with deterministic dense hash encoding and compact neural decoders, enabling on-the-fly synthesis of deformation features while reducing deformation storage to only 1--3 MB per scene. Second, we propose a compression of canonical point-cloud attributes (CCA) pipeline that compresses high-dimensional spherical harmonic appearance terms and auxiliary Gaussian attributes via conditional autoencoding, selective quantization, and residual codebooks, achieving 3--5$\times$ point-cloud reduction with negligible quality loss. Together, these components yield a unified representation that preserves real-time rendering performance while reducing total storage to 20--30 MB. Extensive experiments across the N3DV and Technicolor Light Field datasets demonstrate that CC-4DGS achieves reconstruction accuracy comparable to state-of-the-art methods such as Swift4D, while offering significantly improved storage efficiency and favorable runtime-memory trade-offs.
77. 【2609.02171】Progressive Pseudo-Label Optimization for Point-Supervised Change Detection
链接：https://arxiv.org/abs/2609.02171
作者：Hailong Ning,Hao Wang,Yimeng Wang,Tao Lei,Renwei Dian,Asoke K. Nandi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Point-supervised change detection, sparsely annotated points, identify pixel-level changes, Point-supervised change, aims to identify
备注： 9 pages,4 figures
点击查看摘要
Abstract:Point-supervised change detection (PS-CD) aims to identify pixel-level changes between bi-temporal images using only sparsely annotated points. Although point annotations substantially reduce labeling costs, their limited spatial coverage often results in incomplete and noisy pseudo-labels. To address this issue, we propose a two-stage framework that introduces SAM2 priors into PS-CD and progressively adapts them to the target task. In Stage I, SAM2 generates object-aware candidate masks from point annotations on the bi-temporal images, and a bi-temporal mask selection strategy is designed to convert generic segmentation responses into more reliable change pseudo-labels. Subsequently, a lightweight CNN refinement module with an uncertainty-aware loss is employed to improve boundary quality and local structural consistency. In Stage II, we construct a teacher-student self-training framework in which the teacher is updated by exponential moving average and periodically refreshes the pseudo-labels. This design establishes a closed-loop optimization process that alternates between pseudo-label refinement and model re-optimization. Experiments on three benchmark datasets, including WHU-CD, LEVIR-CD, and SYSU-CD, demonstrate that the proposed method outperforms previous weakly supervised approaches on most benchmarks and remains competitive with several fully supervised methods.
78. 【2609.02159】World-Coherent Decoding: Self-Verifying Test-Time Planning for World Action Models
链接：https://arxiv.org/abs/2609.02159
作者：Chuhan Zhang,Seiji Ito,Kenta Hoshino,Satoshi Ikehata,Ikuro Sato
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：World Action Models, stochastically generating visual, World Action, aim to control, control robots
备注：
点击查看摘要
Abstract:World Action Models (WAMs) aim to control robots by stochastically generating visual futures and then decoding actions, but empirical observations indicate that the results can strongly depend on which future is selected. We propose World-Coherent-Decoding (WCD), a self-verifying test-time planning framework that treats WAM rollouts as falsifiable future--action hypotheses. At each decision step, WCD samples multiple candidates from a frozen WAM and ranks them using internal generative signals: flow-based video surprisal for visual plausibility and action path effort for action-generation stability. After execution, the realized observation audits the selected imagination, yielding an imagination--reality mismatch that trains a lightweight online predictor for future candidate selection. Thus, WCD converts delayed self-verification into pre-execution reliability estimation without updating the backbone model. On RoboTwin 2.0, WCD improves Hard success under limited randomized-scene supervision from $55.80\%$ to $60.90\%$, with a $+16.43$ gains on Horizon-3 tasks, and shows qualitative robustness on real Franka visual-shift tests. These results highlight a simple principle: test-time scaling for WAMs depends less on sampling more futures than on selecting reliable ones.
79. 【2609.02118】Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathology
链接：https://arxiv.org/abs/2609.02118
作者：Mingxin Liu,Chengfei Cai,Anwen Lu,Pengbo Xu,Jun Li,Jinze Li,Depin Chen,Jun Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：developing omni-modal self-supervised, clinical reports enables, reports enables transferable, Phi, enables transferable representation
备注： 11 pages, 3 figures. Early accepted by MICCAI 2026 (Oral Presentation)
点击查看摘要
Abstract:In computational pathology (CPath), developing omni-modal self-supervised learning (SSL) models that integrate histology, genomics, and clinical reports enables transferable representation learning for whole slide images (WSIs). Existing approaches implicitly force heterogeneous modalities into a uniform latent space by contrastive alignment, causing modality collapse where unique, synergistic diagnostic signals (termed as $\mathrm{\Phi}$) are discarded in favor of trivial redundancy. We hypothesize that the strongest task-agnostic SSL training signal stems from distilling the synergistic interactions over merely aligning shared redundancy. To this end, we introduce \textsc{$\mathrm{\Phi}$-Omni}, a synergistic information disentanglement framework grounded in Partial Information Decomposition (PID) theory for slide representation learning. Unlike standard contrastive approaches, \textsc{$\mathrm{\Phi}$-Omni} employs a Synergistic Information Bottleneck (SIB) regulated by the proposed $\mathrm{\Phi}\text{ID}$ objective, which explicitly suppresses marginal redundancy while maximizing irreducible synergy, thereby distilling high-order cross-modal interactions. Following pretraining on breast ($n$=1031) and lung ($n$=919) cohorts, \textsc{$\mathrm{\Phi}$-Omni} demonstrates superior few-shot performance across five independent external datasets spanning eight tasks compared to supervised and SSL baselines. Source code is available here.
80. 【2609.02111】Disease Burden over Skin Tone: Decomposing the Dermatology-AI Generalization Gap
链接：https://arxiv.org/abs/2609.02111
作者：Nirajan Kunwor,Sanjaya Poudel,Quoc-Huy Trinh,Jahidul Arafat,Sunil Kumar Gaire
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：cancer-focused image collections, Dermatology artificial intelligence, artificial intelligence, trained on light-skinned, confounded axes
备注：
点击查看摘要
Abstract:Dermatology artificial intelligence (AI) models are predominantly trained on light-skinned, cancer-focused image collections, yet they are increasingly proposed for deployment in resource-constrained settings where patients differ from training populations along two confounded axes: skin tone and disease distribution. We investigate whether poor generalization is primarily caused by skin-tone underrepresentation or disease-distribution shift. We evaluate a cancer-trained baseline (ResNet-50 fine-tuned on HAM10000 and ISIC 2019), two dermatology foundation models (DermLIP and MONET), and a general-purpose vision model (DINOv3) as frozen feature extractors. Models are evaluated on a tone-stratified disease-matched dataset (Diverse Dermatology Images, DDI) and a disease-shifted tone-diverse dataset (Skin Condition Image Network, SCIN). Our results show that disease-distribution shift contributes more than skin tone in the evaluated settings. The cancer baseline decreases from 0.62 to 0.21 balanced accuracy when transferred to unfamiliar clinical conditions, while the within-disease skin-tone gap is smaller (0.10-0.18) and inconsistent. Label-free representation analysis shows that this failure reflects a representational limitation rather than only missing output labels: cancer-specialized features poorly cluster unfamiliar conditions (kNN purity lift +0.06 over chance), whereas dermatology-pretrained features retain stronger transferable structure (+0.23). Finally, we show that representation quality predicts recoverable performance under lightweight adaptation. Starting from dermatology foundation models, approximately ten labeled examples per clinical category recover most attainable performance. We release the evaluation protocol and code to support reproducible auditing of dermatology AI generalization.
81. 【2609.02107】A Unified Rate-Distortion Perspective on Vector, Product, and Scalar Quantization
链接：https://arxiv.org/abs/2609.02107
作者：Xianghong Fang,Wenlong Mou,Yuan Yuan,Dehan Kong,Tim G. J. Rudner
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Discrete visual tokenization, Discrete visual, understanding quantization tradeoffs, modern discrete visual, predominantly driven
备注： 26 pages, 2 figure, 8 tables
点击查看摘要
Abstract:Discrete visual tokenization, predominantly driven by vector, scalar, and product quantization, lacks a unified conceptual framework for understanding quantization tradeoffs. In this paper, we propose a unified rate--distortion perspective on modern discrete visual tokenization. By viewing quantization as lossy compression, we characterize the nominal fixed-length coding rate through token count and codebook size, and quantization error as the distortion. Within this framework, we resolve three central questions. First, we theoretically and empirically show that minimizing distortion, rather than maximizing codebook utilization, is the primary intrinsic objective for reconstruction fidelity, with a direct connection to the STE-induced gradient discrepancy. Second, we establish two critical fairness conditions for intrinsic quantization comparison: controlling latent feature statistics and enforcing identical coding rates. Third, under these conditions, we recover the VQ--PQ--SQ distortion hierarchy in modern visual tokenization and show empirically that modern VQ methods achieve the lowest distortion. This work provides a foundational rate--distortion reframing of modern discrete visual tokenization, resolves ambiguities in quantizer evaluation, and provides a controlled framework for isolating intrinsic quantization effectiveness under fixed-rate constraints.
82. 【2609.02101】Federated LoRA Adaptation of BiomedCLIP Across Four International Chest X-Ray Cohorts
链接：https://arxiv.org/abs/2609.02101
作者：Sanjaya Poudel,Nirajan Kunwor,Manish Dhakal,Debesh Jha,Sunil Kumar Gaire
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：makes this practical, train a shared, practical at scale, scale by communicating, communicating only compact
备注：
点击查看摘要
Abstract:Federated learning (FL) lets institutions train a shared model without exchanging data, and Low-Rank Adaptation (LoRA) makes this practical at scale by communicating only compact low-rank updates. Biomedical imaging is a compelling setting for this combination: patient data are archived behind privacy regulations, and institutions differ widely in scanners, protocols, and compute. Such heterogeneity raises the question of how federated LoRA updates should be aggregated, increasingly pressing as multimodal vision-language models become central to medical image analysis. We benchmark federated Parameter-efficient fine-tuning (PEFT) of BiomedCLIP for chest radiograph classification across four public cohorts on three continents (USA, Vietnam, Spain). Federated LoRA adaptation improves shared-class AUC on all four cohorts over the unadapted BiomedCLIP backbone (mean 0.687 to 0.802), showing that the gains come from federated adaptation rather than from the pretrained model's zero-shot ability. Relative to isolated single-cohort training, federation improves the weaker cohorts while largely preserving the strongest and approaches a centralized reference (0.812) that pools all data. The singular value decomposition (SVD)-based product-space aggregation introduced by FlexLoRA is essential to this gain (naive factor averaging drops mean AUC by 0.097), whereas a drift-correcting optimizer (FedProx) shows no benefit over FedAvg in our single-seed runs, consistent with LoRA's low-rank updates already limiting client drift. Biomedical vision-language models can thus be adapted collaboratively across heterogeneous, geographically distributed institutions without centralizing data.
83. 【2609.02097】Evidence-Guided Detection, Localization and Explanation for Text-Centric Image Forensics
链接：https://arxiv.org/abs/2609.02097
作者：Peifeng Liu,Bin Li,Qingsong Zhang,Yangxin Yu,Leqing Chen,Xiaoye Qiu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：manipulation increasingly accessible, made text-centric image, text-centric image manipulation, image manipulation increasingly, progress of AIGC
备注：
点击查看摘要
Abstract:The rapid progress of AIGC has made text-centric image manipulation increasingly accessible, creating new forensic challenges that require not only authenticity detection but also spatial grounding and evidence-based explanation. This paper presents our solution to the GenText-Forensics Challenge at ACM Multimedia 2026. We propose an evidence-guided detector-localizer-reasoner system, where an image-level detector provides a global authenticity prior, a dedicated localizer extracts tampered regions as spatial grounding evidence, and an MLLM-based reasoner generates structured forensic reports grounded in this expert forensic evidence. These modules are connected through a cascaded evidence flow: the detector gates the subsequent localization and prompting process, the localizer converts tamper responses into grounding boxes, and the reasoner is trained to synthesize the detector decision and localized evidence into the final report. As a key part of our method, we introduce iterative difficulty-aware mining to improve localization quality and apply report-mask consistency post-processing to align report grounding with predicted masks. On the official hidden test set, our system achieves a final score of 0.638 and ranks second in the challenge, validating the effectiveness of the proposed evidence-guided system. The code is available at this https URL.
84. 【2609.02088】Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development
链接：https://arxiv.org/abs/2609.02088
作者：Yilong Guo,Hanqi Chen,Zixiao Ye,Guanzhong Wang,Chen Yu,Zeyu Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, front-end web development, achieved remarkable progress, Multimodal large, large language models
备注：
点击查看摘要
Abstract:Multimodal large language models have achieved remarkable progress in front-end web development, generating interactive webpages from multimodal references such as screenshots and interaction videos. However, existing work largely emphasizes visual metrics such as aesthetics and layout similarity, while overlooking the more critical validation of interactive functionality. We present RILA, an execution-driven agent that puts browser rendering in the loop, iteratively editing generated code from runtime interaction feedback. RILA introduces an Action Interaction Verification (AIV) module that replays the reference interaction trajectory on the generated webpage to collect grounded execution-aware observations, and an Execution-aware Rendering Score (ERS) that jointly measures interaction correctness and visual fidelity to guide iterative optimization. We further build an execution-verified data synthesis pipeline that produces diverse, high-quality training data, offering gains complementary to inference-time optimization. On IWR-Bench, RILA consistently improves both interaction and visual fidelity across foundation models. Notably, with our training pipeline, RILA lifts the compact Qwen3.5-9B backbone from 40.40% to 57.52%, surpassing far larger one-shot generators, including the 1T-parameter Kimi-K2.6 (55.61%) and the proprietary GPT-5.5 (55.74%).
85. 【2609.02085】C-Next: Zero-Shot Multimodal Cyclone Forecasting
链接：https://arxiv.org/abs/2609.02085
作者：Zhe Wang,Sijie Chen,Yiming Luo,Daehyun Kim,Chien-Yi Chang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：infrared satellite imagery, GridSat infrared satellite, forecasts tropical cyclone, multimodal deep learning, tropical cyclone track
备注： 11 pages
点击查看摘要
Abstract:We present TropicalCycloneNext (TC-Next), a multimodal deep learning model that forecasts tropical cyclone track and intensity at $6$-$24$ h leads by leveraging a foundation model's forecast fields of atmospheric kinematic and thermodynamic fields and GridSat infrared satellite imagery. Trained only on GraphCast forecasts over the Western Pacific (WP), yet reliant only on generic atmospheric variables, TC-Next on GraphCast lowers track error by $15$-$44\%$ and intensity error by a factor of $3$-$6$ relative to a conventional, rule-based tracker, TempestExtremes; applied without retraining to the forecast fields of Pangu-Weather and IFS HRES, it stays ahead of TempestExtremes on both. Applied zero-shot to the generic weather fields of WeatherNext Cyclones on the 2025 WP season, TC-Next attains lower intensity error at every lead time, and lower or comparable track error, compared to that model's specialized direct tracker in a deterministic comparison. Our ablation studies show that our multimodal model is able to utilize the additional modality to improve performance in tracking errors at every lead time and in intensity prediction at longer lead times.
86. 【2609.02077】KSG-Net: Key-Sparse and Global-Context Learning for Maritime 3D Ship Detection
链接：https://arxiv.org/abs/2609.02077
作者：Zhouyuan Huai,Meiqi Wan,Yan Yang,Minshi Chen,Xin Yuan,Wei Wang,Xiao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：severe sea-clutter interference, remains challenging due, sparse point clouds, large-scale vessel variations, autonomous navigation
备注： Accepted by PRICAI 2026
点击查看摘要
Abstract:Accurate 3D ship detection in maritime environments is critical for autonomous navigation, yet remains challenging due to large-scale vessel variations, sparse point clouds of small vessels, and severe sea-clutter interference. Existing methods, primarily based on 2D features or dense representations, struggle to balance detection accuracy and computational efficiency, while sparse 3D detectors designed for road scenes generalize poorly to maritime scenarios. This paper focuses on two key challenges in maritime LiDAR perception: weak feature representation for small and sparse vessels, and insufficient global structural modeling for large vessels due to the limited receptive field of local sparse convolutions. To address these issues, we propose KSG-Net, a Key-Sparse and Global-Context learning network for maritime 3D ship detection. The core idea is to jointly enhance local discriminative features and global structural awareness within a unified fully sparse detection framework. Specifically, a Key Sparse Multi-scale Aggregation (KSMA) module is designed to enhance the representation of small and sparse vessels by selecting informative key voxels and aggregating cross-scale neighborhood features. Furthermore, a Global Context Aggregation (GCA) module is introduced to capture long-range geometric dependencies through scene-level context modeling with gated residual interactions, thereby improving the representation of large vessels. Extensive experiments on the Thames River vessel dataset and simulated datasets demonstrate that KSG-Net consistently outperforms existing methods in multi-scale vessel detection and exhibits strong robustness in complex maritime environments.
87. 【2609.02075】DPA: Decoupling Product-Agnostic Anomaly Representations for Zero-shot Anomaly Generation
链接：https://arxiv.org/abs/2609.02075
作者：Hang Yao,Yansheng Fu,Ming Liu,Zifei Yan,Yanli Ji,Hongzhi Zhang,Wangmeng Zuo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Industrial anomaly detection, newly deployed products, deployed products typically, products typically provide, anomaly
备注：
点击查看摘要
Abstract:Industrial anomaly detection benefits from anomaly samples, yet newly deployed products typically provide only normal images, making anomaly samples difficult to collect. Zero-shot anomaly generation offers a promising solution which avoids collection of target-product anomalies. However, existing methods mainly rely on texture images or text descriptions as anomaly sources, which often produce unrealistic anomalies. Observing that similar anomalies can recur across different products, we propose anomaly transfer-based zero-shot generation, which reuses real anomalies from existing source products, making target-product anomalies no longer necessary to generate realistic anomalious samples for unseen target products. Since not every anomaly type suits the target product, an anomaly type filtering mechanism first selects plausible source types. To transfer selected anomaly, we propose DPA, a diffusion-based framework that decouples product-agnostic anomaly representations. Instead of directly extracting anomaly representations, DPA learns product-irrelevant anomaly embeddings through training with the mismatched data pair, enabling transferable anomaly concept learning across products. Furthermore, we design an adaptive mask-guided pipeline that leverages adaptive masks to control the positional and geometric plausibility of generated anomalies during generation. A training-free anomaly labeling module is further introduced to produce pixel-level annotations aligned with generated anomalies. Extensive experiments on MVTec-AD, VisA, and a dedicated anomaly-transfer benchmark demonstrate that the proposed setting and DPA generate more realistic anomalies and significantly improve downstream anomaly detection performance under both zero-shot and few-shot settings. Source code and models will be released.
88. 【2609.02063】LaST-SR: Laplace-Inspired Steady-Transient Complex-Frequency Decomposition for Single Image Super-Resolution
链接：https://arxiv.org/abs/2609.02063
作者：Linhao Li,Zhaojie Pan,Langkun Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：structurally consistent reconstruction, requires global context, Single-image super-resolution, global context modeling, consistent reconstruction
备注： 16 pages, 3 figures, 3 tables
点击查看摘要
Abstract:Single-image super-resolution (SISR) requires global context modeling for structurally consistent reconstruction. Fourier operators are increasingly adopted for global feature modeling. However, their periodic spectral bases constrain the representation of localized aperiodic variations, limiting the recovery of irregular structures and fine details. In dynamical systems, the Laplace neural operator extends Fourier modes to complex frequencies and decomposes the output signal into complementary steady-state and transient responses to jointly model periodic and aperiodic information. We derive, for the first time, an approximate steady-transient decomposition for two-dimensional feature maps, providing an analytical basis for the proposed complex-frequency decomposition. Accordingly, we propose LaST-SR, centered on a Complex-Frequency Decomposition module that couples a global full-spectrum Fourier branch for image-wide dependencies and long-range structural consistency with a window-conditioned local complex-frequency branch for localized, content-dependent aperiodic variations. To fuse the resulting features, we further design a Steady-Transient Collaborative Aggregation module for cross-branch interaction and joint aggregation. Experiments on five benchmarks show that LaST-SR achieves the best PSNR/SSIM among the compared methods for $\times2$ and $\times4$ SISR. Ablation studies further validate the effectiveness of the proposed architecture and its key modeling mechanisms.
89. 【2609.02059】DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents
链接：https://arxiv.org/abs/2609.02059
作者：Zhuoran Yu,Le Thien Phuc Nguyen,Jaden Park,Xinyi Gu,Zexue He,Soochahn Lee,Rogerio Feris,Yong Jae Lee
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, structured visual understanding
备注： Accepted by ICML 2026
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) have achieved strong performance on structured visual understanding tasks such as chart and document question answering. However, existing benchmarks typically evaluate these domains in isolation, leaving underexplored a key capability: whether models can use textual context to determine how chart evidence should be selected, interpreted, and aggregated. We introduce DocHop, a benchmark for integrated chart--context reasoning in document-style images. In DocHop, the document narrative specifies multi-step compositional constraints, while charts provide the corresponding data values. Questions are grounded on a semantic reference label defined in the narrative, requiring models to resolve target entities from context before aggregating evidence across multiple charts. To enable systematic evaluation, we construct DocHop via a stochastic logic-first generation pipeline with controllable reasoning depth and visual density, covering 2,074 examples across six task categories. Experiments on a wide range of proprietary and open-source MLLMs show a substantial gap to human performance: annotators achieve over 90% accuracy, while the best model reaches only 62.83%. Reasoning-enhanced models consistently show improved results, but performance degrades as reasoning complexity increases. Overall, DocHop provides a controlled testbed for challenging multi-hop document reasoning.
90. 【2609.02039】st-Time Logit Prompting for Source-Free Missing Modality Adaptation
链接：https://arxiv.org/abs/2609.02039
作者：Taixi Chen,Nancy Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large-scale image-text pairs, leveraging complementary information, achieved remarkable performance, image-text pairs, source training data
备注： 9 pages
点击查看摘要
Abstract:Vision-language models (VLMs) have achieved remarkable performance by leveraging complementary information from large-scale image-text pairs. However, missing-modality inputs are commonly encountered during real-world deployment, often leading to significant performance degradation. Existing methods primarily enhance model robustness by learning modality compensation strategies from source training data. However, their reliance on source training data makes them difficult to apply when original data are unavailable due to privacy, storage, or accessibility constraints, such as clinical applications and personalized AI services. This raises an important yet underexplored question: can VLMs be efficiently adapted at test time for visual recognition with missing modalities without accessing source training data? To this end, we propose Test-Time Logit Prompting (TLP), a lightweight source-free test-time adaptation framework for visual recognition with missing modalities. To address missing-induced prediction shifts, TLP optimizes logit prompts with uncertainty-aware adjustment and modality-complete consistency regularization, adaptively adjusting prediction confidence while preserving semantic consistency. Extensive experiments across diverse vision-language benchmarks demonstrate that TLP consistently enhances recognition performance under missing-modality scenarios, achieving up to 8\% improvements while requiring only hundreds of tunable parameters and a few test-time optimization steps.
91. 【2609.02036】SelfLift: Accelerating Few-Step Diffusion via Self-Recovering Resolution Transition
链接：https://arxiv.org/abs/2609.02036
作者：Tingyan Wen,Chenqian Yan,Xurui Peng,Xiazhang Fang,Shuai Wang,Xueqian Wang,Songwei Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：substantially compress temporal, increasingly dominant source, compress temporal computation, models substantially compress, making the spatial
备注： Project page: [this https URL](https://happygirlty.github.io/SelfLift_res/)
点击查看摘要
Abstract:Few-step diffusion models substantially compress temporal computation, making the spatial cost of each model evaluation an increasingly dominant source of inference latency. Progressive-resolution inference reduces this cost by performing early denoising at low resolution and reserving high-resolution computation for refinement. However, existing methods typically lift intermediate latents directly and rely on subsequent steps to absorb the induced distribution mismatch. In the few-step regime, the limited recovery budget leaves these errors as visible artifacts, constraining how late the transition can occur and, consequently, how efficiently it can be performed. We introduce SelfLift, a self-recovering progressive-resolution framework that derives both transition-repair signals and trajectory-aligned supervision from the generative model itself. SelfLift-zero proposes a training-free Artifact-Aware Consistency Lift, using disagreement between direct latent lifting and pixel-VAE re-encoding as both a localized artifact-risk signal and a model-native correction direction. It enables reliable late transitions without external super-resolution, extra denoiser evaluations, or sampling-schedule modifications. Building on this robust transition, SelfLift-rich performs On-Policy Self Recovery on student-visited states, transferring dense high-resolution guidance from an internal self-teacher while remaining aligned with the altered progressive-resolution dynamics. Across FLUX.2-Klein and Z-Image-Turbo, SelfLift reduces end-to-end latency by 41.5% and 44.1%, respectively. Combined with timestep distillation, it delivers overall speedups of 29.61x and 19.21x over the corresponding 50-step models while preserving competitive generation quality, establishing a stronger speed-quality frontier for few-step diffusion.
92. 【2609.02028】Detecting Object Hallucinations in Large Vision-Language Models via Cross-Modal Attention Drifts and Mask-Based Verification
链接：https://arxiv.org/abs/2609.02028
作者：Xuanbing Wen,Boxu Chen,Le Yang,Jiakai Wang,Zhengyu Zhao,Chenhao Lin,Chao Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large vision-language models, object hallucination remains, vision-language models, reliable deployment, recent advances
备注：
点击查看摘要
Abstract:Despite recent advances in large vision-language models (LVLMs), object hallucination remains a major barrier to their reliable deployment. Existing detection methods often characterize visual grounding using attention from individual layers, leaving its evolution across layers underexplored. We propose CADMP, a lightweight object hallucination detection framework that combines adjacent-layer cross-modal attention drift with prediction sensitivity to targeted visual masking. During decoding, CADMP quantifies distributional changes between consecutive cross-modal attention maps to capture abrupt transitions in visual grounding. It then selects the transition with the largest drift, locates the corresponding visually relevant regions, and measures the change in prediction probability after masking these regions. These two signals provide complementary evidence: attention drift characterizes the stability of internal visual grounding, while probability variation verifies whether a prediction truly depends on the identified visual evidence. A lightweight detector integrates both signals to identify hallucinated predictions. Experiments on multiple benchmarks and representative open-source LVLMs demonstrate that CADMP achieves consistently competitive detection performance. Ablation studies further confirm the complementary contributions of adjacent-layer drift modeling and mask-based grounding verification.
93. 【2609.02018】Source-Free Class Relearning: Diagnosing Forgetting in Class Unlearning
链接：https://arxiv.org/abs/2609.02018
作者：Zahra Dehghani,Pablo Piantanida,Mohammadhadi Shateri
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：recognize designated forget, Class unlearning aims, designated forget classes, aims to remove, ability to recognize
备注：
点击查看摘要
Abstract:Class unlearning aims to remove a model's ability to recognize designated forget classes while preserving performance on retain classes. However, low forget accuracy after unlearning does not necessarily mean the class structure has been erased. Approximate unlearning methods can alter classifier decision boundaries while leaving recoverable structure in the representation. Prior work has shown that forget classes can be recovered, but existing approaches require real forget or retain samples, auxiliary data, or reference checkpoints. We study class relearning in a strictly source-free setting, asking whether a forget class can be recovered through a classifier-head update using only the unlearned model. Our approach rests on a theoretical analysis establishing a sufficient alignment condition under which a single gradient step on a synthetic probe set increases the expected logit margin of the forget class. Building on this, we propose a white-box Source-Free Relearning Audit (SFRA), which generates candidate embeddings in representation space and uses model-guided confidence filtering to construct high-confidence retain probes and low-confidence boundary-adjacent probes that are relabelled as the forget class. Gaussian sampling and Softmax confidence are used by default, while ablations with alternative proposal distributions and uncertainty criteria show that recoverability is not specific to these choices. To quantify recoverability, we introduce the Relearning Score (RS), which jointly measures forget-class recovery and retain-accuracy preservation, and report class-matched $\Delta$RS relative to a retrained reference. Experiments on CIFAR-10, CIFAR-100, and TinyImageNet with ResNet-18, ViT-B/16, and Swin-T show that several unlearning methods exhibit substantial source-free recoverability, and that for a subset of methods this recoverability exceeds the matched retrained reference.
94. 【2609.02012】GeoStore: Finding Small Storefronts in Large Scenes -- A Fine-Grained POI Localization Benchmark with Global-to-Local Asymmetric Matching
链接：https://arxiv.org/abs/2609.02012
作者：Lu Han,Xiting Sun,Hao Wang,Zhiqiang Cao,Ruihuan Du,Ziquan Zeng,Chunlong Lv
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：geo-tagged street-view imagery, large-scale geo-tagged street-view, user close-up storefront, close-up storefront photograph, underpins map construction
备注： 6 pages, 3 figures. Submitted to ICASSP 2027
点击查看摘要
Abstract:Point-of-interest (POI) localization -- matching a user's close-up storefront photograph against large-scale geo-tagged street-view imagery -- underpins map construction, POI verification, and location-based services. Its closest existing paradigm, visual place recognition (VPR), assumes symmetric, whole-image matching of the same scene at a comparable scale; POI localization instead must match a close-up query, in which the target fills the frame, against wide references in which the same POI occupies only a small, off-center region among visually similar shops, under a substantial capture-domain gap. We introduce GeoStore, to our knowledge the first benchmark dedicated to this asymmetric, fine-grained, open-set formulation, and show that global-descriptor methods tuned for symmetric VPR are systematically limited on it, since a single global vector dilutes the small target. We further propose GLAM (Global-to-Local Asymmetric Matching), which couples a retrieval-anchoring global descriptor with an asymmetric local pathway: each reference is kept as a compact set of pooled region tokens and matched against a single query probe through a learnable soft late interaction; at inference, the same tokens enable a lightweight mutual-nearest-neighbor re-ranking. GLAM surpasses strong global and two-stage baselines on Recall@1/5/10 and mAP, with ~5x smaller re-ranking features and ~two orders of magnitude lower per-pair matching cost than prior local re-ranking. The benchmark and code will be publicly released.
95. 【2609.02004】InstEditSeg: Instruction-Driven Image Editing for Polyp and Skin Lesion Segmentation
链接：https://arxiv.org/abs/2609.02004
作者：Ziquan Liu,Zhewei Zhu,Xuyang Shi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：existing methods struggle, Accurate segmentation, ambiguous boundaries, clinical diagnosis, low contrast
备注： 21 pages, 11 figures
点击查看摘要
Abstract:Accurate segmentation of polyps and skin lesions is pivotal for clinical diagnosis, yet existing methods struggle with low contrast, ambiguous boundaries, and cross-domain distribution discrepancies. Discriminative networks and most diffusion-based segmentation approaches predict standalone binary masks, leaving the visual priors of large-scale pretrained generative models largely unexploited. We propose InstEditSeg, a unified generative framework that reformulates medical segmentation as an instruction-driven image editing problem. Instead of emitting a mask, the model renders a color-coded overlay on the original image, conditioned on a textual instruction, so that the edited output aligns with the natural image distribution learned by latent diffusion models and mitigates the domain gap between natural and medical imagery. To recover fine anatomical structures, we introduce DINOv3 as an auxiliary visual encoder and a DINO Feature Guidance Block that builds a multi-scale feature pyramid. The pyramid is fused into the diffusion U-Net by channel concatenation and zero-initialized convolution so that hierarchical discriminative priors can be injected without perturbing the pretrained weights. A dual-branch classifier-free guidance strategy requiring only two forward passes per denoising step reduces inference cost. On polyp and skin lesion benchmarks the framework achieves accuracy competitive with strong discriminative baselines, and it further demonstrates concrete advantages of the generative formulation: notably better cross-domain generalization on unseen data, more complete multi-lesion segmentation, instruction-conditioned task control, and sampling flexibility. We also analyze the strengths and limitations of the paradigm, including its color sensitivity and unsupported attribute-conditioned selection. Code is available at: this https URL.
96. 【2609.02002】InsightSeg: Reusing Correction Insights for Guideline-Consistent Segmentation
链接：https://arxiv.org/abs/2609.02002
作者：Vanshika Vats,Ashwani Rathee,James Davis
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：policies demand fine-grained, real-world labeling policies, labeling policies demand, semantic segmentation requires, task-specific decisions
备注：
点击查看摘要
Abstract:Guideline-consistent semantic segmentation requires more than category recognition, as real-world labeling policies demand fine-grained, task-specific decisions. Recent multi-agent refinement systems improve compliance with such textual guidelines by detecting and correcting errors. However, they are stateless: feedback from the critiquing agent is discarded, causing the same guideline-specific mistakes to be repeatedly rediscovered and corrected across the dataset at the cost of additional refinement. We introduce InsightSeg, an episodic memory mechanism that converts successful correction episodes into reusable, visually grounded insights. A meta-analyzer distills each qualifying episode into directive natural-language insights and anchors them to the local image regions that caused the error using patch-level visual concept vectors. On subsequent images, these concepts are matched against dense patch embeddings to retrieve relevant insights, which condition the segmenting agent before making its first prediction. This shifts the system from correcting recurring errors to preventing them, improving segmentation quality before any refinement occurs. Across Waymo and Cityscapes, InsightSeg improves both first-pass and final guideline-consistent segmentation performance while requiring fewer refinement steps, demonstrating that multi-agent refinement can become more accurate and efficient by drawing on past correction experience.
97. 【2609.02000】Who Drives the Probability Game of VLMs? A Temporal Causal Drive Evaluation Framework
链接：https://arxiv.org/abs/2609.02000
作者：Shuyao Xiao,Shengling Wang,Haoyu Niu,Ke Chao,Changwei Xu,Xinran Duan,Chaoyong Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video understanding tasks, primarily assess final-answer, assess final-answer quality, information sources shape, Question Causal Drive
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) are increasingly evaluated on complex image and video understanding tasks, yet conventional metrics primarily assess final-answer quality and reveal little about how different information sources shape the generation process. We propose a causal and temporal evaluation framework that traces the evolving roles of visual input, question text, and generated prefixes during autoregressive decoding. Grounded in a Structural Causal Model, we use interventions and backdoor adjustment to derive three step-indexed causal-drive metrics---Visual Causal Drive (VCD), Question Causal Drive (QCD), and Prefix Causal Drive (PCD)---for characterizing source-specific generation patterns without requiring reference answers. Experiments on Qwen3-VL-8B-Instruct across MAVIS, LLaVA-Video-178K, and MiraData, together with cross-model validation on InternVL2-8B, reveal a consistent transition from stronger early question and visual guidance toward increasing reliance on generated prefixes. Randomized-intervention validation shows that QCD and PCD reduce recovery error over observational PMI baselines by 34.8\% and 47.1\%, respectively. On VLMBias, the prefix--visual imbalance score achieves 0.767 AUROC and 0.873 AUPRC for distinguishing prior-driven from visually grounded generations. These results show that causal-drive trajectories provide complementary source-level diagnostics for multimodal generation.
98. 【2609.01997】Linear Fusion MultiDiffusion for Fast Training-Free Spherical Panorama Generation
链接：https://arxiv.org/abs/2609.01997
作者：Akio Hayakawa,Yusuke Mukuta,Tatsuya Harada
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：support linear projections, reference image spaces, extends MultiDiffusion, MultiDiffusion to support, support linear
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:We propose LF-MultiDiffusion, a training-free panorama generation method that extends MultiDiffusion to support linear projections between target and reference image spaces. Our key idea is to reformulate latent aggregation as a regularized least-squares problem and solve it efficiently with a Krylov-based iterative solver inside the denoising loop. This formulation enables denser and more natural mappings than prior training-free methods, yielding more stable generation with far fewer perspective views. As a result, LF-MultiDiffusion reduces the number of image generator evaluations during denoising and significantly improves inference efficiency. Experiments show that LF-MultiDiffusion achieves better visual quality, text alignment, and panoramic consistency than the strongest training-free baseline, while providing a 15.36$\times$ speedup. Our project page is available at: this https URL.
99. 【2609.01987】Morphology signal in whole slide image foundation models can automatically triage slides
链接：https://arxiv.org/abs/2609.01987
作者：Ayushi Sinha,Shashank Yadav,Benjamin Holmes,Pravat Das,Aaron W. Bogan,James S. Lewis Jr.,Santiago Romero-Brufau,Andrew Y. K. Foong,Scott H. Kaufmann,Kathryn M. Van Abel,David M. Routman,Michael R. Lucas
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：staging process typically, process typically generate, cancer diagnosis, diagnosis and staging, staging process
备注： 12 pages, 3 figures, 4 tables
点击查看摘要
Abstract:Patient exams in the cancer diagnosis and staging process typically generate several whole slide images (WSIs). One of the initial steps in training models on WSI data is identifying one or a few slides containing tumor or other diagnostic biomarkers necessary for downstream prediction tasks such as estimating recurrence risk or progression-free survival. This step requires tedious manual curation by experienced pathologists. Many published datasets make the artificial assumption of 1 slide per patient. Alternatively, all slides per patient may be used for model training, which may dilute the signal from the few slides containing tumor or other relevant information. In this paper, we present a pipeline to overcome these challenges using publicly available WSI foundation models (FMs). Our evaluations show that ranking WSIs based on predictions from zero-shot classification using WSI FMs accurately identifies slides with the most tumor, indicating that WSI FMs contain sufficient morphology signal to automatically triage slides. We also present a formulation for ranked evaluation to benchmark FM performance in slide triage. We show, on multiple datasets, that tumor slides are identified in the top-2 ranked slides for patients with up to 43 slides.
100. 【2609.01963】Aggregating Neighbor Embedding Projection and Rank-Based Manifold Learning for Image Retrieval
链接：https://arxiv.org/abs/2609.01963
作者：Vinicius Atsushi Sato Kawai,Gustavo Rosseto Leticio,Lucas Pascotti Valem,Daniel Carlos Guimarães Pedronette
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high-level concepts persists, effectively ranking similar, Content-based image retrieval, ranking similar images, Content-based image
备注：
点击查看摘要
Abstract:Content-based image retrieval (CBIR) has advanced significantly with deep learning, yet effectively ranking similar images remains challenging, particularly in high-dimensional feature spaces, where pairwise distances often fail to capture contextual relationships and the semantic gap between visual features and high-level concepts persists. Manifold learning and rank-based refinement methods have emerged as complementary strategies, respectively improving feature representations and exploiting contextual information embedded in ranked lists, such as neighborhood relationships among images. However, combining these projection-based and rank-based strategies to exploit their complementary properties remains a challenging research problem. To address this, we propose a framework that combines neighbor embedding projections with rank-based manifold learning through rank aggregation. Uniform Manifold Approximation and Projection (UMAP) generates alternative low-dimensional feature representations, and ranked lists obtained from UMAP projections and rank-based re-ranking methods are combined using the Borda Count aggregation strategy. Experiments were conducted on several public datasets using deep learning features extracted from ResNet152, Swin Transformer, and DINOv2 models. Results show that the proposed approach improves retrieval effectiveness in several scenarios, particularly when the baseline representation struggles to achieve high precision. The aggregation strategy also often improves the quality of top-ranked positions, leading to competitive Mean Average Precision (MAP) and Precision values across different datasets and feature extractors. These findings suggest that combining projection-based and rank-based manifold learning strategies through rank aggregation can provide complementary contextual information for image retrieval tasks.
101. 【2609.01928】Learning with Volterra Neural Networks: A System Theoretic Perspective
链接：https://arxiv.org/abs/2609.01928
作者：Haoyu Yun,Hamid Krim,Yufang Bao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：rapidly increasing parameter, important for signal, video modeling, computational costs, suffer from rapidly
备注：
点击查看摘要
Abstract:Higher-order interaction components are important for signal, image, and video modeling, but explicit high-order operators often suffer from rapidly increasing parameter and computational costs. This paper presents kVNN, a learnable kernelized Volterra Neural operator for compact higher-order filtering. The motivation is to use kernelization to improve the efficiency of Volterra-type neural operators while providing a structured interpretation of their higher-order components. The proposed formulation combines the order-wise structure of Volterra filtering with learnable polynomial-kernel atoms, allowing different interaction orders to be represented by separate learnable centers and coefficients. This order-decoupled representation avoids explicit high-order tensor parameterization and can be implemented as a CNN-compatible layer. Experiments on representative vision tasks show that kVNN achieves a favorable accuracy--efficiency trade-off.
102. 【2609.01921】Automated Maize Ear Phenotyping Using 3D Reconstructions
链接：https://arxiv.org/abs/2609.01921
作者：Ritwesh A. Kumar,Som Tripathi,Peja Matthews,Srikar Reddy,Talukder Zaki Jubery,Patrick Schnable,Adarsh Krishnamurthy,Baskar Ganapathysubramanian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：size vary largely, kernel size vary, influence yield, Maize kernel traits, size vary
备注：
点击查看摘要
Abstract:Maize kernel traits such as row number, kernels per row, and kernel size vary largely for genetic reasons and are consistently associated with regions of the genome that influence yield. Manual measurement of these traits, however, cannot keep pace with the volume of maize generated in a breeding program. To address this, we developed and validated a fully automated pipeline for extracting these traits from 3D point clouds of corn ears, built on a recently developed video-to-point-cloud platform. Raw video frames are processed through COLMAP and NeRF, the ear is isolated via density-based separation, and the point cloud is distance-calibrated to physical units. The calibrated ear point cloud was Z-axis aligned via PCA and cylindrically unwrapped to a 2D image. We enhanced contrast and performed zero-fine-tuning instance segmentation using Cellpose-SAM. A triple-juxtaposed unwrap strategy was used to prevent double-counting at the seam. The pipeline achieved kernel count R^2 = 0.921 (MAPE = 10.33%) and kernel row number within +-2 rows for 95.2% of ears (MAE = 0.75 rows) on a 168-ear held-out set from the 268-ear labeled dataset. The resulting multi-trait dataset has known genotype identity for each ear, positioning it for phenotype-to-genotype association analyses.
103. 【2609.01899】APVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views
链接：https://arxiv.org/abs/2609.01899
作者：Skanda Koppula,Frano Rajic,Abdullah Faiz Ur Rahman,Yi Yang,Ignacio Rocco,Jeet Thakwani,Rishabh Kabra,Andrew Zisserman,Joao Carreira,Siyu Tang,Carl Doersch,Gabriel Brostow
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：complementary views reduce, reduce depth ambiguity, Multi-camera systems, visibility under occlusion, point tracking
备注：
点击查看摘要
Abstract:Multi-camera systems are increasingly practical for robotics, AR/VR, and autonomous driving because complementary views reduce depth ambiguity and preserve visibility under occlusion. Existing point-tracking benchmarks, however, focus on a single video or static multi-camera rigs. None test long-term 3D point tracking across several synchronized views under camera motion. We introduce TAPVid-MV (Tracking Any Point in Video across Multiple Views), the first benchmark for this setting. It contains a curated set of 284 sequences, 1,142 calibrated camera streams, and 109,769 point tracks across seven subsets spanning indoor and outdoor domains, from robotics and human activity to driving and synthetic procedural scenes. We obtain these trajectories using dataset-specific auxiliary modalities: sensor depth, LiDAR, SLAM and SfM points, human meshes, posed object meshes, and simulation. Every sequence and trajectory is visually verified by human annotators. Across more than 30 baselines, no method comes close to solving the task. Surprisingly, existing multi-view point trackers do not consistently outperform monocular point trackers. By evaluating reconstruction and point tracking on the same datasets, TAPVid-MV helps distinguish errors in recovered geometry from errors in point correspondence. Through this joint analysis, we identify geometry recovery as a major bottleneck for accurate 3D point tracking. Beyond multi-view 3D point tracking, our released annotations support monocular 2D and 3D point tracking, future-trajectory prediction, and 4D reconstruction.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.01899 [cs.CV]
(or
arXiv:2609.01899v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.01899
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
104. 【2609.01888】Does Playing it Safe Count as Faithfulness? Reassessing LVLM Hallucination Mitigation Methods
链接：https://arxiv.org/abs/2609.01888
作者：Mehrdad Fazli,Sina Mansouri,Mohit Marvania,Ziwei Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent inference-time hallucination, large vision-language models, report strong gains, Recent inference-time, vision-language models
备注：
点击查看摘要
Abstract:Recent inference-time hallucination mitigation methods for large vision-language models (LVLMs) report strong gains on hallucination benchmarks. However, it remains unclear whether lower hallucination scores reflect improved multimodal grounding or more conservative generation. We evaluate six mitigation methods across three LVLMs and four benchmarks, including hallucination-focused evaluation and the diverse capability benchmark MMStar. Our analysis reveals two consistent patterns. First, hallucination reduction is often coupled with reduced informativeness: methods that lower hallucination rates also reduce object recall, visual coverage, or response detailedness. Second, improvements on hallucination benchmarks do not reliably transfer to broader multimodal capabilities, with methods showing inconsistent or degraded performance on fine-grained perception and reasoning tasks. Our findings suggest that current evaluation protocols may overestimate progress by rewarding conservative generation. We argue that hallucination mitigation should be evaluated as a faithfulness--informativeness--capability trade-off rather than through hallucination scores alone.
105. 【2609.01886】SignMatch: Matching Dictionary Signs to Continuous Sign Language Video
链接：https://arxiv.org/abs/2609.01886
作者：Ryan Wong,Youngjoon Jang,Liliane Momeni,Gül Varol,Andrew Zisserman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：continuous signing videos, match dictionary sign, sign, handshape and motion, motion relative
备注： 24 pages, 8 figures, Project page: [this https URL](https://www.robots.ox.ac.uk/~vgg/research/signmatch/)
点击查看摘要
Abstract:The objective of this paper is to match dictionary sign videos to corresponding signs in continuous signing videos, where a match is defined by the visual similarity alone - the handshape and motion relative to the body. To achieve this, we learn a prototype-structured sign embedding space from continuous video annotated with signs, where each learnable prototype corresponds to a sign class. Isolated dictionary videos are then mapped into this sign space, enabling the matching between dictionary exemplars and continuous sign instances. This design supports direct dictionary-guided sign matching through embedding similarity and naturally extends to unseen signs using only dictionary exemplars. Experiments on ASL-Citizen dictionary retrieval, ChaLearn OSLWL dictionary-to-continuous sign matching, and using BOBSL's CSLR2 evaluation for automatic sign annotation demonstrate strong generalisation across datasets, tasks and sign languages. Without benchmark-specific supervision, the learned representation transfers effectively across American, British, and Spanish Sign Languages, outperforming prior methods on all three benchmarks. Project page: this https URL
106. 【2609.01876】RAFT-DVC: Resolution-Aware Machine Learning-Based Digital Volume Correlation
链接：https://arxiv.org/abs/2609.01876
作者：Zixiang Tong,Lehu Bu,Jin Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Materials Science (cond-mat.mtrl-sci)
关键词：remains poorly understood, range remains poorly, DVC model affects, operating range remains, full-field displacement measurements
备注：
点击查看摘要
Abstract:Digital volume correlation (DVC) provides three-dimensional full-field displacement measurements from volumetric images, but how the internal resolution of a machine-learning-based DVC model affects accuracy and operating range remains poorly understood. Here, we present RAFT-DVC, a resolution-aware family of recurrent all-pairs field transforms (RAFT)-based DVC solvers with encoder downsampling factors s = 2, 4, and 8. Using a matched design, we find that the three solvers localize displacement to approximately 0.017 feature-grid voxel, giving an empirical raw-volume error scaling of approximately 0.017s voxel. The solvers exhibit complementary operating regimes governed jointly by displacement reach and volumetric-texture compatibility. Synthetic benchmarks show that RAFT-DVC achieves errors of the same order as tuned classical DVC under fine-texture, small-to-moderate-displacement conditions and becomes competitive or advantageous under coarse-texture, large-displacement conditions. Frequency-swept tests quantify deformation spatial resolution, while tiled inference enables dense estimation on large volumes. Evaluation on confocal volumetric images acquired during indentation illustrates the importance of matching solver operating regime to deformation magnitude and image texture. Tests on micro-CT images of elastomeric foam, despite training only on particle-labeled synthetic data, provide evidence of cross-texture transfer. We also identify coordinate-order inconsistencies in three-dimensional RAFT correlation sampling and introduce a non-cubic impulse test to verify sampler geometry independently of network training. Correcting the sampler improves native-input accuracy and generalization to unseen volume dimensions. Together, these results establish RAFT-DVC as a fast, resolution-aware framework for dense DVC with characterized accuracy and operating regimes.
107. 【2609.01840】Cross-Model Distillation of a Human-Pose Foundation Model from Unannotated Infant Video for Markerless 3D Pose Estimation
链接：https://arxiv.org/abs/2609.01840
作者：R. James Cotton,Divya Joshi,Colleen Peyton
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：structured clinical instruments, validated early predictors, Spontaneous movement, infant neuromotor health, neuromotor health
备注： Accepted to the ECCV 2026 Workshop MoCha
点击查看摘要
Abstract:Spontaneous movement is one of the earliest windows onto an infant's neuromotor health, and structured clinical instruments that score it are validated early predictors of cerebral-palsy risk. However, they require specially trained raters, are time-consuming, and carry inter-rater variability. This motivates automated, video-based markerless assessment, especially as marker-based motion capture is impractical in infants. Yet the foundation models that make markerless capture possible are trained almost entirely on adults: our recent multi-view infant study found that no single model is jointly best, with strong 2D keypoint accuracy and direct 3D body recovery split across different models. While that study identifies this trade-off, it does not resolve it. Here, we perform cross-model distillation from the Sapiens 2 pose model into the SAM 3D Body model, using unannotated infant video alone. A frozen teacher supplies dense pseudo-labels, and a differentiable renderer aligns the predicted mesh to them in the training loop. On eleven held-out infants (18 sessions, 173 recordings) under our prior study's multi-view protocol, fine-tuning improves same-view 2D keypoint agreement with the Sapiens reference (median body percentage of correct keypoints @ 10px 0.22 - 0.42, face 0.22 - 0.42) and Procrustes-aligned mean per joint 3D position error (25.5 - 22.2 mm). This demonstrates how cross-model distillation improves SAM 3D Body model performance on infants.
108. 【2609.01827】SliceBridge: context-consistent repair of corrupted slice intervals in T1-weighted MRI
链接：https://arxiv.org/abs/2609.01827
作者：Jiheng Li,Michael E. Kim,Trent Schwartz,Gaurav Rudravaram,Derek B. Archer,Timothy J. Hohman, theAlzheimer's Disease Neuroimaging Initiative,Lianrui Zuo,Bennett A. Landman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Structural magnetic resonance, reconstruction effects leave, Structural magnetic, magnetic resonance imaging, image remains usable
备注：
点击查看摘要
Abstract:Structural magnetic resonance imaging (MRI) images are sometimes corrupted over a contiguous set of slices, where acquisition, motion, hardware, or reconstruction effects leave a single slice or short interval inconsistent with its neighbors while the rest of the image remains usable. Such localized corruption can bias downstream morphometric analysis, yet discarding or reacquiring an otherwise usable image is costly. We formulate this as an image restoration problem: given the location of the affected interval, reconstruct those slices from the surrounding anatomical and imaging context. We propose SliceBridge, a framework for restoring corrupted slice intervals in T1-weighted MRI using rectified flow matching conditioned on the surrounding intact slices and their relative slice positions. Through-plane consistency is encouraged by coupling the slices within the interval through interval-correlated initial noise, a shared flow time, and synchronized sampling. The restored interval is then inserted back, leaving all other slices unchanged. We trained and validated the model on 9,877 T1-weighted brain MRI volumes from four datasets and evaluated it on 581 external subjects using clean interval withholding and controlled corruptions. Compared with a matched model that reconstructed target slices independently, SliceBridge reduced error in slice-to-slice changes within repaired intervals by 32.9%-41.3% across interval lengths and achieved higher SSIM at every interval length. In controlled-corruption cases, SliceBridge reduced the median error in regional brain volume estimates produced by a downstream segmentation model from 1.95% in corrupted volumes to 1.05%.
109. 【2609.01823】Kirin: Animal Motion Generation from In-the-Wild Video
链接：https://arxiv.org/abs/2609.01823
作者：Brian Nlong Zhao,Zhuoyang Pan,James M. Rehg,Jiajun Wu,Shangzhe Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Understanding animal motion, high-quality motion data, modeling animal behavior, motion research due, Understanding animal
备注： ECCV 2026
点击查看摘要
Abstract:Understanding animal motion is fundamental to modeling animal behavior and biomechanics, yet progress in this area lags far behind human motion research due to the scarcity of high-quality motion data. While human motion can be captured in controlled environments, it is impractical for most animal species, resulting in small, domain-limited datasets that restrict downstream applications such as animation. To address this challenge, we introduce Kirin, a framework that reconstructs motion from video, learns motion priors at scale, and generates realistic motion that can be directly applied to animated assets. Using large collections of in-the-wild animal videos, we reconstruct 3D motion sequences and pair them with captions to create AiM3D, the first large-scale dataset offering aligned video-text-motion tuples for quadruped animals. Building on this dataset, we develop a visual-guided motion generation model that conditions on both text and image to guide the generation of realistic motion across diverse animal species. Finally, by leveraging an off-the-shelf image-to-3D model, we automatically rig and animate 3D meshes using generated motion, producing ready-to-render animated animals. Together, our dataset and framework establish a new foundation for large-scale, text and image conditioned animal motion generation and animation. Project page: this https URL.
110. 【2609.01816】Video2Reaction: Training Foundation Video Models to Predict Audience Reaction
链接：https://arxiv.org/abs/2609.01816
作者：Sidong Zhang,Trang Nguyen,Shiv Shankar,Gauri Jagatap,Deepak Chandran,Andrea Fanelli,Madalina Fiterau
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：maps short movie, short movie segments, social media comments, maps short, short movie
备注： Presented in the Workshop on Emerging Directions in Data for Multimodal Foundation Models at CVPR 2026
点击查看摘要
Abstract:We introduce Video2Reaction, a multimodal dataset that maps short movie segments to the induced emotional reactions of viewers in the wild, as expressed through social media comments. Video2Reaction captures the natural diversity of emotional responses by aggregating reactions from online comments at scale, modeling labels as distributions over categorical emotions to better reflect the subjective and ambiguous nature of emotional perception. We benchmark two vision-language models (VLMs) finetuned with LoRA, showing that VLMs learn effectively from Video2Reaction and outperform specialized baselines on dominant reaction prediction. We further demonstrate that VLMs pre-finetuned on Video2Reaction transfer effectively to VCE, another induced emotion dataset with a different taxonomy and video domain. Notably, LLaVA-NeXT-Video-7B pre-finetuned on Video2Reaction and adapted on only 1% of VCE training data achieves a top-3 accuracy of 0.682, on par with the best reported VCE performance trained on the full dataset. The dataset is available at this https URL
111. 【2609.01808】Integrated Laser Scanning and Image-Based Topology Optimization Techniques for Detection and Quantification of Visible and Subsurface Structural Defects
链接：https://arxiv.org/abs/2609.01808
作者：Mehrdad Shafiei Dizaji,Devin Harris
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reliable characterization, directly observable surface, requires methods capable, capable of resolving, resolving both directly
备注： 9, 5
点击查看摘要
Abstract:Reliable characterization of structural defects requires methods capable of resolving both directly observable surface damage and damage that is not visible from the inspected surface. This study presents two complementary non-contact, vision-based approaches for the detection and quantitative characterization of defects in structural components. The first approach employs high-resolution laser scanning to generate three-dimensional (3D) point clouds of damaged steel specimens. Comparative processing of measured and reference point clouds is used to localize damaged regions, quantify geometric loss, and transfer the measured defect geometry to a finite element representation. The second approach combines full-field surface deformation measurements obtained using three-dimensional digital image correlation (3D-DIC) with finite element model updating and topology optimization. In this inverse framework, measured surface response is used to infer subsurface abnormalities through their influence on the spatial distribution of structural response. Experimental steel-beam specimens containing controlled smooth defects and randomly distributed defects are used to evaluate the approaches. Comparisons with milling-based ground-truth measurements demonstrate that both methods can identify and quantify defect geometry, while providing complementary information for visible and subsurface damage assessment. The combined framework establishes a pathway toward high-fidelity, non-contact structural condition assessment and model updating for components with complex and irregular damage.
112. 【2609.01806】Consistency as Regularization for Unsupervised Shadow Removal
链接：https://arxiv.org/abs/2609.01806
作者：Anh-Kiet Duong,Petra Gomez-Krämer,Jean-Michel Carozza
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：important preprocessing step, require paired shadow, existing supervised methods, supervised methods require, methods require paired
备注： 22 pages, 20 figures
点击查看摘要
Abstract:Shadow removal is an important preprocessing step for many vision tasks, yet existing supervised methods require paired shadow and shadow-free images, while unsupervised approaches often still rely on shadow masks or shadow-free references. We propose ShadowCLR, an unsupervised framework that learns shadow removal directly from shadow images. Our key observation is that shadows vary across observations while the underlying scene content remains largely consistent. We therefore use consistency across shadow observations as regularization, encouraging the model to recover scene-consistent appearance while suppressing shadow-specific variations. Global and local consistency further enable us to explore visually related images, learn from imperfectly aligned observations, and focus the representation on shared scene information. Experiments on multiple benchmarks show that ShadowCLR achieves competitive and often superior performance over state-of-the-art unsupervised methods, demonstrating that consistency can provide regularization for shadow removal without shadow masks or shadow-free images.
113. 【2609.01800】Improved Automatic Target Recognition in Synthetic Aperture Sonar Imagery Using Large Deep Neural Networks
链接：https://arxiv.org/abs/2609.01800
作者：C.J. Moore,Alex Hurt,Jordan Malof
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automatic Target Recognition, Synthetic Aperture Sonar, Automatic Target, Target Recognition, Aperture Sonar
备注：
点击查看摘要
Abstract:Automatic Target Recognition (ATR) in Synthetic Aperture Sonar (SAS) is a task largely dominated by deep neural networks (DNNs). Most SAS-ATR models use convolutional neural network (CNN) architectures whereas transformer-based architectures have had much less representation in the literature despite being state of the art in general computer vision (CV) research. Additionally, researchers have had mixed results in attempting to overcome challenges presented by a scarcity of labeled training data by using methods such as data augmentation and the use of pretrained weights from a variety of imaging modalities. In this work, we compare the performance of modern CNN and transformer-based DNNs to determine which architecture and training configurations elicit the highest performance in SAS-ATR. We investigate how network size, architecture, pretraining method, data augmentation and other forms of regularization affect SAS-ATR performance with a focus on producing the highest-performing model and providing a roadmap for training state-of-the-art SAS-ATR models.
114. 【2609.01799】Designing Versatile Samples for Learned Trajectory Scoring
链接：https://arxiv.org/abs/2609.01799
作者：Yaguang Li,Jiaru Zhang,Chuheng Wei,Can Cui,Ziran Wang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：driving policies emit, driving policies, separable component, policies emit, candidate trajectories
备注：
点击查看摘要
Abstract:Many current end-to-end driving policies emit a pool of candidate trajectories and select one, which makes selection a separable component: a scorer can be retrained while the planner, its backbone, and its trajectory generator all stay frozen. However, many strong planners concentrate their proposals around safe mode, providing limited supervision near decision boundaries. In this work, we design a training dataset that provides more informative supervision for the scorer. In particular, we construct two generators that perturb the logged human trajectory along the two axes a vehicle can be displaced: laterally toward the drivable boundary and longitudinally toward a leading vehicle. The designed dataset produces more informative positive and negative samples than the base planner's proposal pool. We attach a transformer-based scorer to two frozen generative planners, DiffusionDrive and MeanFuser, and train it on the NAVSIM navtrain dataset. The results of the experiments show that we achieve 90.1 EPDMS on DiffusionDrive and 90.4 EPDMS on MeanFuser when using ResNet-34, with 0.4 and 0.3 EPDMS respectively, from the designed training dataset.
115. 【2609.01795】DESA-TTA: Dynamic EMA and Source Anchoring for Test-Time Adaptation
链接：https://arxiv.org/abs/2609.01795
作者：Atif Belal,Lilian Hollard,Marco Pedersoli,Eric Granger
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language object detectors, Vision-language object, achieve strong zero-shot, strong zero-shot performance, object detectors
备注：
点击查看摘要
Abstract:Vision-language object detectors (VLODs) achieve strong zero-shot performance but remain vulnerable to distribution shifts during deployment. Mean-teacher methods for test-time adaptation (TTA) can improve robustness by updating a student model using teacher-generated pseudo-labels. However, mean-teacher TTA is highly sensitive to the choice of a fixed exponential moving average (EMA) coefficient for teacher updates, and repeated optimization with noisy pseudo-labels can cause cumulative student drift. We propose Dynamic EMA and Source Anchoring for TTA (DESA-TTA), a low-overhead method that jointly regulates teacher updates and student drift through dynamic temporal averaging and source anchoring. Dynamic temporal averaging estimates teacher uncertainty from pseudo-label confidence and box density and uses it to select a sample-wise EMA coefficient within bounds determined by teacher parameter drift. Source anchoring partially restores the updated student parameters toward their pretrained values, with the anchoring strength increasing according to student drift. Experiments across diverse distribution shifts and two VLOD architectures show consistent improvements over existing TTA methods. On VOC-C, DESA-TTA improves AP$_{50}$ by 14.5 points over zero-shot inference while achieving 55\% higher inference throughput than the previous state-of-the-art TTA method for YOLO-World. Our code: this https URL
116. 【2609.01792】Efficient Passive Acoustic Monitoring of Killer Whales Using a Two-Stage Detection and Ecotype Classification Cascade
链接：https://arxiv.org/abs/2609.01792
作者：Daniela Ruiz,Manuel Castellote,Zhongqi Miao,Carl Chalmers,Bruno Demuro,Rahul Dodhia,Pablo Arbelaez,Juan M. Lavista
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV)
关键词：endangered Southern Resident, Southern Resident killer, Southern Resident, severe class imbalance, Resident killer whale
备注：
点击查看摘要
Abstract:Passive acoustic monitoring of killer whales is particularly important for conservation of the endangered Southern Resident killer whale population, but requires accurate models that can operate in real time under severe class imbalance and deployment shift. We propose a lightweight ResNet-based two-stage cascade that first detects killer whale vocalizations and then classifies confident detections into five eastern North Pacific ecotypes, abstaining on ambiguous calls. We train and evaluate the pipeline on the DCLDE 2027 dataset, where the detector achieves 0.960 macro-F1 and the classifier 0.958, outperforming frozen Perch 2.0 embeddings on the five-ecotype benchmark. By separating detection from ecotype recognition, the end-to-end cascade improves seven-class macro-F1 from 0.919 for a single-stage model to 0.933, with the largest gain on the rare OKW ecotype. To assess transfer beyond the benchmark, we use active learning to adapt the Stage 1 to the acoustic environment of Puget Sound, WA, increasing killer whale detection F1 from 0.405 to 0.755 on manually verified detection windows. Finally, each stage processes a 3 s window in approximately 1.4 ms on an NVIDIA H100, enabling faster than real time inference. These results demonstrate that the proposed two-stage cascade pipeline enables reliable killer whale detection and classification, adaptation to new acoustic domains, and real-time monitoring for conservation applications.
117. 【2609.01787】CoViT: Instance-Correspondence Contrastive Learning for Vision Transformer
链接：https://arxiv.org/abs/2609.01787
作者：Yisen Wang,Zhirong Wu,Limin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Contrastive Vision Transformer, Vision Transformers, Vision Transformer, excel in semantic, object detection
备注：
点击查看摘要
Abstract:Vision Transformers (ViT) excel in semantic understanding but fail to discriminate between object instances (e.g., identical embeddings for two dogs), limiting their use in instance-level tasks such as object detection and instance segmentation. We propose Contrastive Vision Transformer (CoViT), a self-supervised learning framework that injects instance-awareness into ViT through geometry-guided contrastive learning. CoViT uniquely coordinates ViT's attention maps and embeddings by constructing triplets: (1) Attention-guided masking: Refine multi-head attention via adaptive thresholding and morphological operations to generate instance masks, identifying foreground anchors; (2) Hardest contrastive mining: For each anchor, computing pairwise embedding similarities to select the intra-instance hardest positive (least similar patch within its mask) and inter-instance hardest negative (most similar patch from other instances), with intra-instance regions masked during negative search. These triplets drive a contrastive loss that simultaneously compresses intra-instance variance and expands inter-instance margins, forcing ViT to discern subtle geometric and appearance differences between instances. CoViT consistently achieves stable performance gains of over 2 AP points across multiple instance-level perception tasks by using ViT as backbone architecture. Notably, CoViT requires no extra decoders or labels, demonstrating that a pure ViT can learn instance-aware representations via inherent attention priors and targeted contrastive constraints. Code and models will be released.
118. 【2609.01786】n Architectures, One Error: Shared Failure Modes in Hyperspectral Classification under Spatially Disjoint Evaluation
链接：https://arxiv.org/abs/2609.01786
作者：Ehsan Faghih,Fatemeh Ashrafi,Marguerite Moore,Zahra Saki
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Hyperspectral image classification, Hyperspectral image, single scene, image classification, classification still relies
备注：
点击查看摘要
Abstract:Hyperspectral image classification still relies heavily on random pixel splits within a single scene. The Salinas dataset, randomly split, is among the most widely used datasets for comparing different architectures. However, under a random split method, a large fraction of test pixels fall immediately adjacent to a training pixel, which inflates reported accuracy. This work introduces a leakage-free evaluation protocol linking spatial separation to the model's receptive field. Applying this protocol across ten different architectures, including classical, spectral, spectral-spatial, transformer, vision-backbone, and state-space families, shows that Macro-F1 drops by 0.147 on average and model rankings change by as many as five places. Furthermore, leakage-free evaluation limits which architectures can be tested on a given benchmark. Since each partition supports patches only within a finite radius, reporting this radius alongside the receptive field is essential for fair comparison. In addition, this study reveals that all ten architectures misclassify largely the same pixels, pointing to a spectral ambiguity in the data that none of them resolves.
119. 【2609.01778】Allocate Before You Embed: Adaptive Visual Input Allocation for Video Embeddings
链接：https://arxiv.org/abs/2609.01778
作者：Song Jin,Zhongtao Jiang,Chenglei Shen,Huanxuan Liao,Haozhe Chi,Zhiwei Wang,Kun Xu,Yong Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large-scale video retrieval, Large-scale video, video retrieval requires, diverse videos, fixed visual-input budget
备注：
点击查看摘要
Abstract:Large-scale video retrieval requires embedding models to encode long and diverse videos under tight visual-input and inference budgets. Existing methods typically sample a small, fixed set of frames at their original resolution, limiting temporal coverage and ignoring frame importance. Our empirical analysis shows that expanding temporal coverage improves retrieval even under a fixed visual-input budget. Gains are larger when the original per-frame resolution is preserved, highlighting the complementary roles of temporal coverage and spatial fidelity. Motivated by this finding, we propose AllocEmbed, an allocate-then-embed framework that reallocates a fixed visual-input budget across more frames. A lightweight allocator uses low-cost previews to assign frame-wise resolutions before the embedding backbone, preserving more detail where it most benefits retrieval while reducing visual cost elsewhere. We further introduce Retrieval-Driven Policy Optimization (RDPO), which learns the allocator directly from retrieval feedback using a rank-validated similarity gap and a confidence-guided efficiency incentive. Operating entirely before the backbone, AllocEmbed integrates with existing retrieval systems without modifying the embedding model or downstream pipeline. Experiments on the MMEB-V2 V-QA and V-RET tasks and our LongRet benchmark show that AllocEmbed achieves the best overall retrieval performance among the evaluated budget-matched methods and transfers across embedding backbones. Our code is publicly available at this https URL.
120. 【2609.01772】MemeCULT-1K: Benchmarking South Asian Cultural Context and Humor Understanding of Multimodal Models
链接：https://arxiv.org/abs/2609.01772
作者：Tawsif Tashwar Dipto,Mehedi Ahamed,Radib Bin Kabir,Mueeze Al Mushabbir,Mohammed Saidul Islam,Mir Rayat Imtiaz Hossain,Md Tahmid Rahman Laskar,Sabbir Ahmed
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：recognizing visual content, South Asian memes, requires implicit cultural, literal text, implicit cultural knowledge
备注： Accepted by EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Meme understanding goes beyond recognizing visual content or literal text; it requires implicit cultural knowledge and pragmatic inference that most vision-language models still lack. We introduce MemeCULT-1K, a multilingual benchmark of 1,000 South Asian memes in Bengali, English, and Hindi, where each meme is paired with a cultural context note and three human-written explanations, along with a supplementary set of 54 Bengali regional dialect memes. We evaluate thirteen popular Vision Language Models (VLMs) under two settings: meme-only and context-aware. Providing minimal cultural context yields consistent gains across all models and languages: mean SBERT similarity improves from 44.6 to 56.4 (+11.8), BLEURT from 37.3 to 42.3 (+5.0), and LLM-as-a-Judge scores from 2.57 to 3.43 out of 5 (+0.86). Fine-grained error analysis reveals that closed-source models fail mainly on entity and reference misidentification, while open-source models are bottlenecked by broader cultural knowledge gaps, with linguistic and phonological failures proving the most context-resistant across both. These results highlight the difficulty of culturally grounded meme understanding and motivate future work on explicit cultural knowledge integration. Our dataset and code are publicly available at TawsifDipto17/MemeCULT-1K.
121. 【2609.01757】AlphaRAD: Grounded Zero-Shot Classification in Chest Radiology via $α$-Corrected Binary Cross Entropy and Factorized Latent Supervision
链接：https://arxiv.org/abs/2609.01757
作者：Jianzhong You,Yuan Gao,Chris McIntosh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-Language Pretrained Models, aspects remain underexplored, clinical semantics extracted, Vision-Language Pretrained, structured clinical semantics
备注： ECCV 2026
点击查看摘要
Abstract:Vision-Language Pretrained Models (VLPMs) offer a scalable path to open-vocabulary chest radiology understanding, yet two aspects remain underexplored: how structured clinical semantics extracted from medical reports can reduce in-batch noise during contrastive learning, and how cross-modal fusion can be designed to produce more faithful spatial grounding without added complexity. We introduce AlphaRAD, addressing these opportunities through two contributions. First, we construct a large-scale structured medical concept space from medical reports parsed by a Large Language Model for training, thereby mitigating in-batch learning noise and removing heuristic pair matching in contrastive learning, and thus naturally positioning AlphaRAD as a medical concept discriminator trained via $\alpha$-Corrected Binary Cross-Entropy. Second, we propose FLaS (Factorized Latent Supervision), an extremely simple yet effective cross-modal feature fusion module that factorizes VLPM representations into independent subspaces, using dedicated alignment supervision to enhance the expressiveness of spatial grounding without introducing additional model parameters. Through extensive empirical validation, AlphaRAD shows strong zero-shot generalization across diverse chest radiology tasks. Notably, it establishes state-of-the-art average performance across 16 classification benchmarks, while achieving individual state-of-the-art results via distinct gains on 7 grounding/phrase grounding and 3 segmentation datasets.
122. 【2609.01749】Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics
链接：https://arxiv.org/abs/2609.01749
作者：Sejuti Basu,Ashima Sood,Vijay Kumar,Sahil Sharma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Modern generative models, Modern generative, produce facial images, produce facial, Swin Transformer
备注： 12 pages, 2 figures, 1 table. Presented at the International Conference on Computational Techniques in Data Science (IICTDS 2025), online. Proceedings forthcoming
点击查看摘要
Abstract:Modern generative models, such as GANs, diffusion architectures, and autoregressive systems, now produce facial images that are nearly indistinguishable from authentic photographs. This capability makes detecting forged images increasingly difficult, raising serious concerns about identity theft, fraud, and misinformation campaigns. Our research focuses specifically on GAN-generated synthetic faces, which underpin many face-centric deepfakes, and investigates efficient detection approaches using image analysis alone. Existing detection systems rely heavily on either convolutional neural networks (CNNs) or global vision transformers. While CNNs excel at identifying texture-based local features, they struggle with broader contextual understanding. Traditional Vision Transformer (ViT) models can capture long-range structures effectively, but demand substantial computational resources. Our work explores Swin-Transformer-based architectures across three implementations: a compact Swin Transformer trained from the ground up, ImageNet-1K pre-trained Swin-Tiny and Swin-Small models adapted for binary classification, and a novel hybrid combining EfficientNet-B0's convolutional processing with a Swin Transformer backend. We evaluated all models using the 140K Real and Fake Faces dataset, which includes StyleGAN-generated fake faces alongside authentic images from Flickr and DFDC, with balanced splits for training, validation, and testing. The EfficientNetB0+Swin hybrid achieved 99% accuracy and a 99.44% recall on 5,000 test images, outperforming both pure Swin variants and a previous CNN-only baseline on this dataset. Our results suggest that combining hierarchical CNN features with shifted-window self-attention provides an efficient and computationally lightweight method for detecting GAN-generated synthetic faces.
123. 【2609.01743】SCULPT: Training Edge Vision Models for Post-Training Quantization Readiness
链接：https://arxiv.org/abs/2609.01743
作者：Bharadwaj Kavuri,Sourav Babu-PK,Varadhraj Ellapan,Pullarao Maddu,Prasad Deshpande
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Edge vision models, Edge vision, Image Processing Conference, Irish Machine Vision, resource-constrained hardware
备注： Published at Irish Machine Vision and Image Processing Conference (IMVIP) 2026. Paper 043. 8 pages, 3 figures
点击查看摘要
Abstract:Edge vision models are difficult to deploy on resource-constrained hardware, making low-bit post-training quantization (PTQ) attractive. In practice, standard FP32 training often produces heavy-tailed activation distributions whose outliers destabilize activation quantization: preserving the full range wastes quantization bins on rare extremes, while aggressive clipping causes information loss. Existing solutions typically rely on quantization-aware training (QAT), which adds training complexity and bit-width coupling, or advanced PTQ procedures that repair the model after training. We present SCULPT (Statistical Clipping and Uniform Loss for Post-Training), a training-time method that improves PTQ readiness during ordinary FP32 fine-tuning. SCULPT combines a topology-aware activation regularizer that suppresses quantization-hostile skewness and kurtosis with a stable percentile-based clipping mechanism that learns deployment-ready activation bounds. Unlike QAT, SCULPT does not simulate quantization during optimization; unlike post hoc outlier-repair PTQ methods, it does not require runtime activation transformations. The learned clipping bounds can be exported directly into a standard PTQ workflow for low-bit deployment, including INT8 and lower-bit settings such as W4A8.
Comments:
Published at Irish Machine Vision and Image Processing Conference (IMVIP) 2026. Paper 043. 8 pages, 3 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.01743 [cs.CV]
(or
arXiv:2609.01743v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.01743
Focus to learn more
arXiv-issued DOI via DataCite
Journalreference:
Irish Machine Vision and Image Processing Conference (IMVIP), 2026
124. 【2609.01742】Evidential Deep Learning for Multi-Modal Anti-UAV Detection
链接：https://arxiv.org/abs/2609.01742
作者：Dmitry Golovchits,Seyed Sahand Mohammadi Ziabari,Ali Mohammed Mansoor Alsahag
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：per-modality reliability signal, systems increasingly fuse, increasingly fuse multiple, Anti-UAV systems increasingly, fuse multiple sensors
备注：
点击查看摘要
Abstract:Anti-UAV systems increasingly fuse multiple sensors, yet their detection heads provide no per-modality reliability signal. This study evaluates whether evidential deep learning (EDL) heads, Dempster-Shafer (DS) evidence fusion, and uncertainty-driven temporal sensor gating improve anti-UAV detection through a controlled ablation on three benchmarks: thermal tracking (AntiUAV600), RGB-audio-RF classification (TRIDENT), and RGB-IR tracking (MM-UAV). The EDL training objective improves accuracy over retrained sigmoid baselines (+5.9 percentage points in accuracy and a tripled tracker-on-absent rate in E1; +4.8 percentage points in classification accuracy in E2, surviving a clip-clustered bootstrap, p = 0.011) and ranks classification errors substantially better (entropy UAUC approximately 0.94 vs. 0.51). The remaining components do not support their respective hypotheses. DS fusion does not outperform simple probability averaging. Dirichlet vacuity adds no ranking power beyond predictive entropy and inverts at the detection level, where extreme background imbalance causes it to encode class membership rather than error likelihood, a failure also observed for entropy and sigmoid confidence. Temporal gating preserves accuracy only when nearly inactive and yields no realised latency saving on shared-backbone hardware. The benefit of evidential learning therefore arises primarily from its training objective rather than its uncertainty estimate; a crop-level control further localises the detection-level breakdown to anchor-level evaluation rather than the learned representation.
125. 【2609.01740】ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes
链接：https://arxiv.org/abs/2609.01740
作者：Mingda Lin,Weijie Wang,Zeyu Zhang,Bowen Cui,Yefei He,Haoyu Zhao,Yuanyu He,Donny Y. Chen,Feng Chen,Bohan Zhuang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：token, token sequences, Compact token sequences, tokenizers typically organize, Abstract
备注： 25 pages, 9 figures, 6 tables, including appendix
点击查看摘要
Abstract:Compact token sequences are essential for efficient 3D generation. However, existing 3D tokenizers typically organize latent representations either over spatial regions or as fixed-size sets of global tokens, both suffering sharp reconstruction degradation when compressed to extremely low token budgets. In this paper, we present ZipTok3D, a 3D tokenizer designed for high-fidelity reconstruction from extremely short token sequences. Its key idea is to organize object geometry into progressively informative global-token prefixes and unfold these compact representations through iterative decoding. Specifically, nested dropout randomly truncates the latent sequence after encoding during training and requires each retained prefix to reconstruct the complete object, thereby prioritizing essential geometric information in the leading tokens. The decoder then repeatedly applies a parameter-shared Transformer block to recover fine-grained geometry from each prefix without a separate generative sampling stage. With the same token dimension, ZipTok3D achieves reconstruction quality comparable to the 32-token COD-VAE baseline using only one token on ShapeNet and four on TRELLIS, yielding $32\times$ and $8\times$ shorter token sequences, respectively.
126. 【2609.01738】UAV Thermal Imagery for Inert Ordnance Screening: Multi Campaign Dataset Development,Object Detection, and Practical Recommendations
链接：https://arxiv.org/abs/2609.01738
作者：Chad Melton,PhD.,Annabelle Kelton
类目：Computer Vision and Pattern Recognition (cs.CV); Databases (cs.DB)
关键词：restrict civilian access, Unexploded ordnance, UAV thermal image, agricultural activity, infrastructure recovery
备注： Abstract edited to fit format
点击查看摘要
Abstract:Unexploded ordnance (UXO) continues to restrict civilian access, agricultural activity, infrastructure recovery, and environmental remediation in contaminated areas around the world. This study created a multi campaign UAV thermal image data set of inert ordnance, developed a labeled image set from collected imagery, tested object detection models, and identified practical considerations for humanitarian mine action and demining applications. Data were collected during four field campaigns in Tennessee under summer and winter conditions using inert mines, munitions, and other ordnance placed in short grass, tall vegetation, gravel, mulch, rock, compost, and compacted surfaces. Thermal imagery was collected under flight altitutes of 33 m and 15 m. The final source inventory contained 5,855 thermal image label pairs, including 918 positive images and 4,937 background images. After retaining all positive images and downsampling background images, the 33 m dataset contained 420 training and 106 validation images, while the 15 m dataset contained 629 training and 157 validation images. YOLOV11l and RT-DETR-R50 algorithms were trained and evaluated to develop an automated candidate detection model. Practical recommendations include collecting thermal and RGB imagery together, incorporating varied surfaces and background only imagery, considering periods following changes in solar exposure, balancing survey coverage against target pixel representation, calibrating models with representative local data, and retaining qualified human review. The intended use is screening and prioritization for follow on technical survey or EOD assessment, and not a standalone clearance.
127. 【2609.01725】From Visual Cues to Spoken Narration: Rethinking Audio Description
链接：https://arxiv.org/abs/2609.01725
作者：Akshita Gupta,Aditya Arora,Federico Tombari,Marcus Rohrbach,Anna Rohrbach
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visually impaired audiences, making movies accessible, Audio Description, dialogue gaps, impaired audiences
备注： Accepted to EMNLP main conference
点击查看摘要
Abstract:Audio Description (AD) provides spoken narration of visual events during dialogue gaps, making movies accessible to visually impaired audiences. The problem requires determining both what (which visual event) and when (position for inserting the AD) to narrate, to achieve the best user experience. Prior work has largely reduced the problem to video captioning of pre-segmented video clips, i.e., what is largely predefined and when is ignored entirely. We propose Cue2Narrate, a two-stage pipeline that jointly predicts what and when to narrate in longer untrimmed movie clips. A dual-head audio-visual localizer predicts two temporally distinct windows per AD utterance: a visual cue window and a spoken narration window. A LoRA-adapted VLM then generates concise ADs from the predicted visual evidence, trained with a Description Ranking Loss that ranks captions (negative samples) of the same frames lower than the GT AD. To benchmark this new problem statement, we introduce the LongLSMDC benchmark with up to 8-min movie clips (~6.5min on average). On LongLSMDC, Cue2Narrate outperforms video-only and audio-only localization baselines by 5--12 points in avg. mAP. Under both predicted- and GT-window evaluation, Cue2Narrate improves AD generation over the corresponding fine-tuned base VLM. These results establish the first benchmark for multi-segment AD generation on long-form clips. Data Code: this https URL
128. 【2609.01691】FairLens: Benchmarking Fairness in Vision-Language Models for High-Stakes Decision-Making
链接：https://arxiv.org/abs/2609.01691
作者：Vahid Reza Khazaie,Ahmed Y. Radwan,Shaina Raza
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Vision-language models, make decisions, decisions from visual, Vision-language, FAIRLENS
备注： Code and benchmark resources are available at [this https URL](https://vectorinstitute.github.io/fairlens)
点击查看摘要
Abstract:Vision-language models (VLMs) are increasingly used to make decisions from visual inputs. We introduce FAIRLENS, a benchmark and evaluation framework for measuring both the fairness and the validity of VLM responses in three high-stakes domains: hiring, legal, and healthcare. FAIRLENS pairs real face images spanning gender, race, and age groups with closed- and open-ended questions, giving more than 100K image-question pairs per model, and evaluates responses from four complementary views: demographic parity over adverse outcome rates, soundness, demographic association over unsupported roles and statuses, and bias in free-text generation. Soundness is the central validity criterion: a response is sound when it follows the evidence stated in the question and abstains when the image cannot support an answer. Evaluating eight VLMs, we find that the primary failure is unwarranted inference rather than unequal treatment. Models routinely infer qualifications, threat, illness, or professional role from a face instead of abstaining, and the weakest model does so on 99% of the questions its input cannot answer. These failures are most severe in legal and healthcare, where recognizing insufficient evidence matters most, and disparity metrics alone would miss them: parity gaps are small in absolute terms, yet when baseline adverse rates are low the same gap means one demographic group receives adverse labels several times as often as another, and a small gap can equally reflect a model that treats every group unsafely. Bias in free-text responses is only loosely coupled to multiple-choice accuracy, so correct structured answers do not imply safe generation. FAIRLENS shows that fair high-stakes VLM behavior requires similar treatment across groups and refusal to infer high-stakes attributes from appearance, and its question suite transfers to any face corpus with demographic annotations.
129. 【2609.01683】FORGE: Forward-Only Test-Time Adaptation for Integer-Only Vision Models on Microcontrollers
链接：https://arxiv.org/abs/2609.01683
作者：Muhammad Rehan,Haider Ali,Muhammad Ali Munir,Moaz Amjad
类目：Computer Vision and Pattern Recognition (cs.CV); Hardware Architecture (cs.AR); Machine Learning (cs.LG)
关键词：Vision models deployed, Vision models, sensor noise, distribution shift, forward-only TTA method
备注： 16 pages, 5 figures, 9 tables. Published in Transactions on Machine Learning Research (2026). OpenReview: [this https URL](https://openreview.net/forum?id=A45I5p25dd) . Code and checkpoints: [this https URL](https://github.com/Rehan000/forge-tta)
点击查看摘要
Abstract:Vision models deployed on microcontrollers (MCUs) are quantized to integer-only arithmetic and run in inference-only runtimes that do not carry the machinery backpropagation needs: the standard tool for adapting a model to the distribution shift (sensor noise, blur, lighting) it meets in the field. Existing forward-only test-time adaptation (TTA) methods either run only on server- or edge-GPU-class models (not true microcontroller integer execution), or require the batch-normalization (BN) layers that integer deployment fuses away. We present a forward-only TTA method that operates on deployed, BN-folded, integer-only convolutional networks. The key observation is that fusing BN into the preceding convolution, a mandatory step for integer inference, destroys the statistics that normalization-based adaptation relies on. We restore adaptation by re-normalizing each folded convolution's per-channel output to its clean training statistics, using only forward-pass estimates. The method (i) recovers most of gradient-based TENT's accuracy gain (+20.9 vs. +24.9 points) and matches forward-only BN adaptation, while being the only method that runs on a folded integer-only model; (ii) needs to adapt only 3 of 21 layers (selected without seeing the test corruptions) to recover 93% of the benefit; (iii) survives single-sample streaming with a batch-size-scaled momentum; and (iv) generalizes across three datasets (up to 200 classes) and two architectures. We validate bit-exact int8 convolution execution and deploy on an ESP32-S3, where, measured with a Nordic PPK2 power profiler, the forward-only adaptation (a lightweight fp32 recalibration around the int8 convolutions) costs only 8.3 mJ (6.8% of inference energy) and 21.9 ms on the deployed SIMD-optimized model: forward-only adaptation is cheap on a real microcontroller.
130. 【2609.01659】Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving
链接：https://arxiv.org/abs/2609.01659
作者：Zhengxu Tang,Xiaozhou Zhang,Guofeng Cui,Ziyu Gong,Zi Wang,Yunfei Shi,Ruifeng Deng,Chengzhi Qi,Ke Chen,Sachin Patil,Tianjun Xiao,Langechuan Liu,Pichao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：powers generative models, reasoning powers generative, eliciting intermediate steps, powers generative, generative models
备注： Accepted by EMNLP 2026
点击查看摘要
Abstract:Chain-of-thought (CoT) reasoning powers generative models by eliciting intermediate steps before producing an answer. In autonomous driving, the answer is a continuous action. Thus its reasoning must share the same spatiotemporal structure as the physical world. This survey studies the resulting shift from textual CoT to action-grounded reasoning. Surveying 171 papers, including 130 method papers and 41 benchmarks, datasets, surveys, and analysis papers, we propose a representation-centered taxonomy that treats the form of the intermediate state as the organizing axis. We systematize the 130 methods into four categories: language-based, visual-spatial, latent-dynamic, and externalized reasoning, further divided into 13 subtypes tied to distinct regions of interests. Our synthesis shows that the open frontier of reasoning in driving agents lies in intermediate representations that can be grounded in the real world, coupled to real-time action, and verified under safety-critical systems. Project page: this https URL.
131. 【2609.01657】NeoMME: A Single-Tower Multimodal-Native Multilingual Foundation Encoder for Efficient Fine-Tuning and Inference
链接：https://arxiv.org/abs/2609.01657
作者：Aurélien Lac,Tony Wu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：generative vision-language modeling, typically combining separately, causal language models, combining separately pretrained, vision-language modeling
备注：
点击查看摘要
Abstract:Multimodal models often build on architectures designed for generative vision-language modeling, typically combining separately pretrained vision encoders with causal language models. Visual document retrievers such as ColPali repurpose these models as encoders, carrying over the parameter and compute overhead of a VLM for a non-generative task. We introduce NeoMME, a family of 260M and 800M-parameter Multimodal and Multilingual bidirectional Encoders that process multilingual text and raw image patches in a single bidirectional Transformer encoder. Both models are pretrained from scratch with a masked discrete-diffusion text objective, conditioned on visible image patches for multimodal examples. Both support a 16,384-token context, enough to encode up to two standard 4K UHD images. To demonstrate its downstream capabilities, we fine-tune NeoMME with jointly trained dense and late-interaction heads. On the ViDoRe v3 benchmark, the resulting NeoMME-Retriever 260M outperforms all evaluated models strictly below 800M parameters with 0.523 nDCG@10, while NeoMME-Retriever 800M reaches 0.556. At a matched 2048x2048 image input size on an NVIDIA L40S, NeoMME-260M encodes pages with about 2x the throughput of ColModernVBERT. Hierarchical token pooling and asymmetric quantization compress late-interaction multimodal document embeddings by 255x while preserving over 95% of baseline nDCG@10. We contribute NeoMME to Hugging Face Transformers and release the pretrained backbone and retrieval-compatible checkpoints under Apache 2.0 at this https URL.
Subjects:
Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.01657 [cs.IR]
(or
arXiv:2609.01657v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.01657
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
132. 【2609.01623】PRISM: An Agentic Multi-Model Architecture for Proactive Safety in Autonomous Transportation Systems
链接：https://arxiv.org/abs/2609.01623
作者：Joyjit Roy,Samaresh Kumar Singh,Sushanta Das
类目：Multiagent Systems (cs.MA); Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET); Machine Learning (cs.LG); Physics and Society (physics.soc-ph)
关键词：vulnerable road users, Autonomous and intelligent, vehicle behavior, road users, pedestrians and cyclists
备注： 15 pages, 7 figures, 8 tables. Accepted for presentation at ASCE2027: The Infrastructure and Engineering Experience, Philadelphia, PA, March 1-5, 2027. Extends SafeDriver-IQ ( [arXiv:2603.14841](https://arxiv.org/abs/2603.14841) )
点击查看摘要
Abstract:Autonomous and intelligent transportation systems operate in complex urban environments where safety depends on interactions among vehicle behavior, environmental conditions, and vulnerable road users (VRUs) such as pedestrians and cyclists. Most advanced driver assistance systems (ADAS) employ reactive mechanisms that activate only after hazards have emerged, a critical limitation underscored by rising VRU fatalities in the United States. This study introduces PRISM (Proactive Risk Intelligence and Safety Management), an agentic multi-model safety architecture that transitions from reactive crash avoidance to proactive, continuous risk management. PRISM employs inverse crash-probability modeling to convert binary crash classifiers into dynamic, interpretable safety scores. Three specialized models addressing trajectory kinematics, environmental risk, and VRU interaction operate concurrently, coordinated by a reasoning layer incorporating reinforcement learning, contextual memory, and feature-level attribution. The system provides graduated safety interventions across four tiers, from silent monitoring to emergency alerts. Unlike rule-based systems with static thresholds, PRISM dynamically adjusts safety parameters in real time. Validated across 1,296 scenarios from three naturalistic driving datasets without dataset-specific retraining, the system yielded a mean safety score of 68 out of 100, classified 77.6% of scenarios as advisory, and flagged a near-miss rate of 3.8%, with 11% of scenarios escalating to intervention or emergency response. Feature attribution consistently identified trajectory risk and VRU proximity as primary safety factors. PRISM provides a unified, interpretable framework for proactive transportation safety with emphasis on VRU risk reduction in dense urban environments.
Comments:
15 pages, 7 figures, 8 tables. Accepted for presentation at ASCE2027: The Infrastructure and Engineering Experience, Philadelphia, PA, March 1-5, 2027. Extends SafeDriver-IQ (arXiv:2603.14841)
Subjects:
Multiagent Systems (cs.MA); Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET); Machine Learning (cs.LG); Physics and Society (physics.soc-ph)
Cite as:
arXiv:2609.01623 [cs.MA]
(or
arXiv:2609.01623v1 [cs.MA] for this version)
https://doi.org/10.48550/arXiv.2609.01623
Focus to learn more
arXiv-issued DOI via DataCite</p>
133. 【2609.02676】LoFi RADIO: A Distilled In-Domain Backbone Applied for Artifact-Severity Grading of Ultra-Low-Field Neonatal Brain MR
链接：https://arxiv.org/abs/2609.02676
作者：Jonathan B. Martin,Yashwant Kurmi,Charlotte R. Sappo
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：brain imaging deploy, motivating automated quality, automated quality control, makes neonatal brain, scan duration make
备注： 11 pages, 2 figures, MICCAI 2026 satellite
点击查看摘要
Abstract:Ultra-low-field MRI makes neonatal brain imaging deploy- able in low-resource settings, but its low SNR, lack of shielding, and long scan duration make it especially prone to acquisition artifacts, motivating automated quality control. We address the LISA 2026 Task 1a challenge: multi-label severity grading (0/1/2) of seven common image artifacts on ULF T2 weighted volumes. We identify that a number of backbones may be successfully paired with a classification MLP, but that no single backbone is uniformly best across artifacts. To improve performance, we evaluate routing complementary foundation model teachers through a per-artifact gate, as well as distilling the teachers into a single in-domain ViT-S student (LoFi RADIO) over an unlabeled low-field MRI corpus. Both of these strategies improve the weighted composite. The distilled backbone matches or exceeds the gate and has the added advantage of not requiring deployment of multiple large foundation models at infer- ence.
134. 【2609.02390】Seeing Beyond the Lesion: Disease Recognition from Reactive CNS Tissue
链接：https://arxiv.org/abs/2609.02390
作者：Jan Schnorrenberg,Jan Ernsting,Enrico Küllenberg,Tim Hahn,Benjamin Risse,Christian Thomas
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Tissues and Organs (q-bio.TO)
关键词：error yields exclusively, non-lesional brain parenchyma, Sampling error yields, underlying disease undiagnosed, yields exclusively reactive
备注：
点击查看摘要
Abstract:Sampling error yields exclusively reactive, non-lesional brain parenchyma in a significant proportion of intracranial biopsies, leaving the underlying disease undiagnosed. We benchmark four pathology foundation models (UNI2-h, Virchow2, Prov-GigaPath, H-optimus-0) as frozen patch encoders within a shared attention-based multiple-instance learning framework using 245 whole-slide images from 186 patients with confirmed downstream diagnoses. We first show that coarse disease-category prediction can be reproduced largely from slide size alone. After restricting classification to three finer diagnostic distinctions within common tissue categories, this confound no longer explains performance, yet disease labels remain predictable above chance under permutation testing (p $\le 10^{-4}$ throughout). Surprisingly, performance is statistically indistinguishable across all foundation-model encoders, suggesting that recovering these weak morphological signatures is not limited by current patch representations. Signed instance-contribution maps and expert review further test whether predictive evidence localizes to reactive parenchyma rather than sampling-induced bias like blood introduced during tissue sampling. These results position acquisition-shortcut auditing via a provenance-only baseline as a necessary control in computational-pathology benchmarks, and show, once that confound is removed, that weakly supervised models still recover disease signal from tissue conventionally regarded as non-diagnostic.
135. 【2609.02016】Perceptually Regularized Diffusion Model for Image Super-Resolution
链接：https://arxiv.org/abs/2609.02016
作者：Chuxiangbo Wang,Pavithra Venkatachalapathy,Ying Liang,Min Wang,Jing Qin,Yifei Lou,Weihong Guo
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：remote sensing, low-resolution observations, medical imaging, scientific visualization, aims to reconstruct
备注：
点击查看摘要
Abstract:Image super-resolution, which aims to reconstruct high-resolution images from their low-resolution observations, is fundamental to medical imaging, remote sensing, surveillance, microscopy, and scientific visualization. Traditional model-based methods formulate super-resolution as an inverse problem with hand-crafted regularization priors. While interpretable and theoretically grounded, they rely on fixed assumptions and require computationally intensive iterative solvers. Deep learning methods offer data-driven flexibility by learning nonlinear mappings from low- to high-resolution images, among which diffusion models have achieved particularly impressive perceptual quality. However, the standard diffusion training objective is a pixel-domain noise-prediction loss that does not explicitly enforce perceptual fidelity, which can lead to oversmoothing and loss of fine image structure. To address these limitations, we propose a perceptually regularized diffusion framework that incorporates prior knowledge through perceptual-loss-based regularization, improving training convergence and encouraging the recovery of meaningful image features. Experiments on benchmark datasets demonstrate improved perceptual quality and competitive distortion metrics, highlighting the effectiveness of regularization for diffusion-based super resolution.
136. 【2609.01959】Data-Efficient Networks for Multi-Contrast MRI Reconstruction based on a Generalized Content/Style Prior
链接：https://arxiv.org/abs/2609.01959
作者：Chinmay Rao,Efe Ilıcak,Matthias J.P. van Osch,Mariya Doneva,Laurens Beljaards,Navid Jabarimani,Nicola Pezzotti,Marius Staring
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：accelerate acquisition times, redundant structural information, potentially accelerate acquisition, acquisition times, scans contain redundant
备注：
点击查看摘要
Abstract:Multi-contrast MR scans contain redundant structural information that can be leveraged during reconstruction and potentially accelerate acquisition times. This idea has inspired end-to-end guided reconstruction models, leveraging one or more contrasts to guide the reconstruction of a different contrast. However, these models require large paired multi-contrast raw datasets for training, limiting their application in low-data regimes. In this work, we propose a modular framework, namely CoSMo-RecNet, for learning guided reconstruction models in the low-data regime. At its core is a reusable multi-contrast representation based on a content/style model, which can be learned from large-scale, publicly accessible, unpaired multi-contrast image datasets, without available k-space data. Using this frozen model as a multi-contrast prior and using a set of reference contrasts, the reconstruction problem reduces to a much simpler refinement problem that can be solved by a lightweight unrolled network and thus learned from small, task-specific reconstruction datasets. We demonstrate the efficacy of CoSMo-RecNet by evaluating it on the low-field 0.3 T M4Raw dataset, showing stable reconstruction quality on decreasing the raw training data budget. CoSMo-RecNet achieved higher reconstruction quality with 5 training subjects or lower compared to a parameter-count-matched MoDL trained on 100 subjects. On a data-limited and severely out-of-distribution ultra-low-field 47 mT Halbach scanner dataset, CoSMo-RecNet was superior to other viable strategies, including classical reconstruction, transfer learning, and zero-shot reconstruction.
