本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新926篇论文，其中：
- 自然语言处理126篇
- 信息检索30篇
- 计算机视觉143篇
自然语言处理
1. 【2609.30250】Agentic Detection of Online Conspiracies
链接：https://arxiv.org/abs/2609.30250
作者：Lior Biton,Oren Tsur
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：stable lexical markers, Conspiratorial discourse, lexical markers, expressed through explicit, stable lexical
备注：
点击查看摘要
Abstract:Conspiratorial discourse on social media is not always expressed through explicit claims or stable lexical markers. The same surface content may express endorsement, legitimate concerns, criticism, satire, or mockery. The main challenge is therefore not only recognizing conspiracy-related claims, but inferring the speaker's intent -- the utterance's illocutionary force. We argue that this can be achieved through the use of relevant social contexts and propose an agentic framework, equipped with a set of tools supporting social queries. We demonstrate the benefits of our approach on a unique dataset of Hebrew tweets, covering 80\%--90\% of the public Hebrew tweets published over a four-year span (late 2018-- early 2023), encompassing several election cycles as well as the COVID pandemic years and related vaccination campaigns. This extensive coverage can be used in recovering different social contexts. Evaluating our framework on a manually-annotated adversarial dataset, we find that context-aware workflows consistently outperform text-only classification and that the agentic framework performs significantly better than other frameworks and settings, including a non-agentic model exposed to the same contexts available to the agent. We further provide an analysis of the results, the errors and efficiency (token economy) tradeoffs. These findings support viewing the task of conspiracy detection as a socially embedded interpretation task, in which effective classification depends not only on access to contexts, but also on adaptive reasoning in which the agent uses tools on a per-case basis, asking only for evidence relevant to its current reasoning step.
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2609.30250 [cs.CL]
(or
arXiv:2609.30250v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.30250
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
2. 【2609.30243】JevOut: Natural Context Can Flip Decision Models
链接：https://arxiv.org/abs/2609.30243
作者：Zixiang Xu
类目：Computation and Language (cs.CL)
关键词：Jev map unstructured, directly route requests, Dedicated decision models, select tools, map unstructured language
备注： 32 pages, 5 figures, 23 tables. Homepage: [this https URL](https://xzx34.github.io/jevout/) ; Code: [this https URL](https://github.com/xzx34/JevOut)
点击查看摘要
Abstract:Dedicated decision models such as Jev map unstructured language to probability distributions over finite choices, allowing their outputs to directly route requests, select tools, and trigger actions. Yet real-world inputs rarely arrive in isolation: they come with background details and surrounding context. We find that short additions that fit naturally into this context can nevertheless redirect an otherwise correct decision, even when the correct answer remains unchanged. To study this behavior, we fix a wrong target option for each initially correct item and use the model's option probabilities to refine fluent context additions while preserving the source, question, choices, and gold answer. Within 64 accepted target evaluations, the optimizer identifies contexts that redirect Jev on 312 of 508 initially correct decisions (61.4%); in 229 cases, Jev assigns at least 0.7 probability to the fixed wrong option. Across seven datasets, three additional decision systems show targeted flip rates of 64.9%-73.2% on decisions they initially answer correctly. Taken together, these results expose a pronounced fragility in current decision models: short, ordinary-looking context can shift a correct choice to a high-confidence wrong one. Because these models turn language directly into downstream choices, this sensitivity raises concerns about treating their probability outputs as reliable decision interfaces.
3. 【2609.30238】SemMSA: Latent Semantic-Aided Robust Multimodal Sentiment Analysis with Incomplete Data
链接：https://arxiv.org/abs/2609.30238
作者：Wenhao Li,Zhibin Wu,Chong Xiao,Qiangchang Wang
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Multimodal Sentiment Analysis, infer human sentiment, Sentiment Analysis, Recent research, human sentiment
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Recent research on Multimodal Sentiment Analysis (MSA) has focused on learning from language, visual, and acoustic modalities with incomplete data to infer human sentiment. Most studies typically compensate for missing information by reconstructing modality features or designing complicated fusion mechanisms. However, these methods still suffer from spurious generation and noisy guidance due to the lack of high-level semantic grounding in partially observed multimodal evidence. To address these issues, we propose SemMSA, a latent semantic-aided framework that constructs rich sentiment-relevant semantics with LLMs, fully integrating with all modalities via anchor-free spectral alignment. It mainly consists of Cross-modal Semantic Refinement (CSR) and Cross-modal Spectral Alignment (CSA). Specifically, CSR first adaptively extracts visual and acoustic representations by corresponding adapters to form a unified multimodal prefix with language in the frozen LLM embedding space. It then iteratively produces continuous discriminative semantic states through a token-efficient latent refinement process without decoding explicit text. Next, CSA simultaneously aligns the refined semantics with all modalities by enhancing the dominant spectral component of their kernel Gram matrix. This captures global nonlinear dependencies among all representations without relying on a predefined anchor modality. In addition, an instance-level spectral separation constraint preserves cross-sample discriminability and mitigates representation collapse. Extensive experiments on SIMS, MOSI, and MOSEI benchmarks demonstrate that SemMSA achieves state-of-the-art performance.
4. 【2609.30227】o Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speech
链接：https://arxiv.org/abs/2609.30227
作者：Debajyoti Mazumder,Mamta,Abhirama Subramanyam Penamakuri
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)
关键词：social media videos, Online misinformation increasingly, Large Audio Language, Audio Language Models, political speeches
备注： Accepted to EMNLP (Main) 2026
点击查看摘要
Abstract:Online misinformation increasingly appears in spoken formats such as news clips, podcasts, interviews, political speeches, and social media videos, creating a need for fact-checking systems that can verify claims directly from speech. We introduce VeriSpeak, a probe benchmark for studying speech-based fact verification in Large Audio Language Models (LALMs). VeriSpeak contains 3,879 spoken claims spanning temporal, geographical, and relational facts, with balanced true and false labels. The benchmark is designed to examine whether factual verification ability transfers from text to speech, and whether retrieval-augmented LALMs can use textual evidence to correctly support or refute spoken claims. Our experiments reveal a consistent text-speech modality gap: LALMs that verify written claims reliably often fail on the same claims when spoken. Moreover, retrieval alone provides limited gains because models frequently conflate retrieved evidence with the spoken claim. In contrast, retrieval combined with explicit reasoning improves claim-evidence comparison, with a thinking-tuned LALM reaching 86.1% accuracy. VeriSpeak highlights that effective speech misinformation detection requires not only speech understanding, but also grounded reasoning over retrieved evidence. The dataset is publicly available via Hugging Face at this https URL.
5. 【2609.30226】PoEM: Predicting RL Outcomes from Existing Policies
链接：https://arxiv.org/abs/2609.30226
作者：Kimia Hamidieh,Giannis Daras,Antonio Torralba
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：maximize specific rewards, Foundation models, reinforcement learning, human alignment, reward function
备注：
点击查看摘要
Abstract:Foundation models are post-trained with reinforcement learning (RL) to maximize specific rewards, such as human alignment, correctness, or instruction following. This post-training process is computationally intensive, sometimes unstable, and has to be run from scratch every time the reward model changes or when we want to combine multiple rewards. We hence ask: given a new reward function, is it possible to predict the RL outcomes without actually running RL on it? We answer this in the affirmative by introducing PoEM, a framework to predict the outputs of RL on a new reward function using a set of models already post-trained on other rewards. First, we show that if the new reward function can be written as a linear combination of existing ones, then the new policy in log-space can be written as a linear combination of the existing log-policies. Surprisingly, even in cases where the rewards are not linearly connected, we observe that often log-policies from RL training span an approximately low-rank subspace across rewards. To our benefit, the weighting coefficients for this combination can be estimated using only the reward or basis policy outputs on the samples. We turn these observations into an algorithm that takes post-trained models and a new reward function, and approximates the target RL policy without actually running any additional RL training. We experimentally validate our approach across synthetic and real rewards, spanning both text and image modalities.
6. 【2609.30199】ExplorationBench: Measuring AI Systems' Exploration in Verifiable Alien Worlds
链接：https://arxiv.org/abs/2609.30199
作者：Ming Zhang,Zhenghao Xiang,Peizhong Gao,Yujiong Shen,Yuhui Wang,Zhonghan Yue,Shihan Dou,Zhangyue Yin,Junjie Ye,Shichun Liu,Weihuang Zheng,Jiahao Chen,Jiayi Chen,Hongzhang Liu,Jiaqi Shao,Tao Gui,Qi Zhang,Xuanjing Huang,Suncong Zheng,Maxm Pan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Scientific discovery begins, discovery begins, exploration, verifiable Alien Worlds, evaluating scientific exploration
备注：
点击查看摘要
Abstract:Scientific discovery begins where known problems end. There, AI systems must engage in exploration: framing hypotheses, designing experiments, and iterating on the results. However, evaluating this ability is difficult: (1) how to verify whether a genuinely new hypothesis holds, and (2) how to determine whether a system has discovered it through exploration or merely recalled related knowledge from pre-training data. To this end, we introduce ExplorationBench, which turns the wicked problem of evaluating scientific exploration into a concrete and tractable framework built on verifiable Alien Worlds: their rules are executable, so every answer can be checked exactly, and they conflict with familiar knowledge, so recall alone cannot solve the tasks. The benchmark contains two sandboxes, AlienCode (31 discovery targets, 70 tasks) and AlienLogic (24 discovery targets, 70 tasks). Each sandbox provides a flawed manual, task-specific environmental feedback, and a dedicated tool-call schema. Systems use these resources to explore the sandbox, then solve held-out tasks. We evaluate 10 AI systems and find that the strongest systems can acquire and apply unfamiliar rules, while performance varies substantially across trajectories and continued exploration can stall or reverse earlier gains. ExplorationBench represents a step towards AI systems that can acquire and apply genuinely new knowledge through exploration in unknown environments.
7. 【2609.30184】ARGUS: Role-Aware Event Knowledge Graphs for U.S. Employment-Discrimination Complaints
链接：https://arxiv.org/abs/2609.30184
作者：Sriram Kannan,Swetha Saseendran,Vishnu Vardhan Reddy Kandi,Leslie Barrett,Madhavan Seshadri,Enrico Santus
类目：Computation and Language (cs.CL)
关键词：employment-discrimination complaints describe, describe complex event, complex event sequences, complaints describe complex, Event Knowledge Graphs
备注： 9 pages, NLLP
点击查看摘要
Abstract:U.S. employment-discrimination complaints describe complex event sequences that are not explicitly captured by lexical or embedding-based representations alone. We present ARGUS, a source-grounded pipeline that combines a 5W1H-inspired schema, legal-domain models, and LLM-based structured generation to construct document-level Event Knowledge Graphs (EKGs) from CourtListener complaints. ARGUS extracts fact-bearing statements, builds chunk-level event graphs with participant, temporal, and causal structure, and merges them into document-level representations. We evaluate graph quality through human and multi-model assessment and test downstream utility on claim classification and legal QA. The graph-structured classifier outperforms raw and linearized baselines on the held-out set, and EKG-only retrieval improves document-scoped QA, while open-retrieval gains remain limited by low first-stage candidate recall. These results suggest that EKGs are most useful for organizing and reasoning over evidence once relevant material has been retrieved.
8. 【2609.30167】Do Audio Language Models Hear and Read Distinctive Features Alike?
链接：https://arxiv.org/abs/2609.30167
作者：Yuanhao Chen,Peter Chin
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Applications (stat.AP)
关键词：models pass speech, pass speech, speech and text, single decoder, language models pass
备注：
点击查看摘要
Abstract:Audio language models pass speech and text through a single decoder. We ask whether that decoder represents a distinctive feature in the same direction when a phoneme is heard and when it is read. For minimal pairs of phonemes differing in one feature, we take the offset between the two members' mean representations. Averaging those offsets gives a direction for each stream, and we measure the cosine between the two. Because the two streams already agree about arbitrary phoneme pairs, we compare every measure against a reference built from random pairings rather than against zero. We apply this to 6 models, 7 features and 15 languages from 11 families. Only voicing in the two Qwen2.5-Omni models exceeds that reference after correction for multiple testing, and the reference varies by a factor of seven between models. In three of the six models, voicing has one direction in audio across the 14 languages with enough minimal pairs to measure it, and every language pair agrees in two of them. The model family, not the model size, predicts which stream represents a feature.
9. 【2609.30160】A Training Criterion with Token-Level Tolerance to Transcription Ambiguity for Automatic Speech Recognition
链接：https://arxiv.org/abs/2609.30160
作者：Saurabh Kumar,Diptiman Mohanta,Prasanta Kumar Ghosh
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：Automatic speech recognition, typically trained assuming, Automatic speech, nominally verbatim transcripts, differences in pronunciation
备注： 5 pages, 2 figures, 4 tables; submitted to ICASSP 2027
点击查看摘要
Abstract:Automatic speech recognition is typically trained assuming that the reference transcript is the only valid labeling of an utterance, yet even nominally verbatim transcripts contain localized differences in pronunciation, spelling, or lexical realization that the acoustics do not uniquely determine. Omni-temporal Classification (OTC) tolerates such noise by adding wildcard paths to the connectionist temporal classification (CTC) alignment graph, but its word-level arcs are too coarse, since bypassing one unsupported token discards supervision for the whole word. We move wildcard arcs to token granularity so unsupported tokens can be bypassed while the rest of the word stays supervised, and we combine token- and word-level arcs as complementary escape paths. Across 19 languages and three corpora, token-level OTC improves over CTC on all 25 tasks. We also replace epoch-indexed relaxation of the wildcard weights with a predictive-entropy-indexed schedule, which performs comparably while reducing dependence on training length. Combining this schedule with the hybrid graph gives the lowest mean word error rate (WER) on every corpus and a 9.45% average relative WER reduction over CTC. Independent validator transcriptions show that token-level models place significantly more wildcard-bypass probability than CTC on disputed characters, indicating that token-level tolerance targets localized transcript ambiguity.
10. 【2609.30151】Does a model's stated reason for rejecting a candidate do any work?
链接：https://arxiv.org/abs/2609.30151
作者：Archit Rastogi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Asked to choose, date of death, model, language model, named fact
备注： Accepted as an oral presentation at LLM4XAI 2026: Workshop on Large Language Models for Explainable AI, co-located with CIKM 2026, Rome, Italy, November 8, 2026. Code and per-item records: [this https URL](https://github.com/ArchitRastogi20/contrastive-rejection-test)
点击查看摘要
Abstract:Asked to choose between candidates and explain the choice, a language model often rejects a rival by naming a fact its profile lacks: no director, no date of death. That sentence is a claim about the text in front of the model, and it can be tested without any judge. We insert a real corpus sentence stating the named fact into the rival's profile and ask again under greedy decoding. Two controls separate content from placement: a length-matched irrelevant sentence at the same profile, and the same two sentences at a third option the model never mentioned. In the largest of three runs, six open models on 2WikiMultihopQA, supplying the named fact at the profile the model named moves its choice more than the irrelevant control does, odds ratio 3.57 [1.54, 8.26], Holm p=0.0210, and this survives dropping any single model. The contrast the design was built to detect, the same fact at the option nobody named, does not clear correction, Holm p=0.2428. The strongest result in the family carries no content claim at all: the identical irrelevant sentence moves the choice more at the named rival than at the third option, Holm p=0.0008. Repair and control also differ in co-candidate mentions, relation template and fluency; post-hoc matching on the first two preserves the content effects' direction, matching fluency weakens one, so the content contrasts bound an effect rather than establish one. A forced single-token probability read disagrees in direction with the free-text choice on that same contrast, and three candidate explanations for the disagreement find no support. Every measurement is a string rule, so each was validated against the records it reads; validation caught eight defects. The largest, a choice-parsing rule that returned the option a model had just rejected in 17.1% of adjudicable responses, would have reported six surviving contrasts instead of four.
11. 【2609.30147】GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI
链接：https://arxiv.org/abs/2609.30147
作者：Arunabh Srivastava,Mohammad A.(Amir)Khojastepour,Srimat Chakradhar,Sennur Ulukus
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：Large Language Models, task complexity increases, Large Language, typically exhibit, complexity increases
备注： Accepted at the Second Workshop for Research on Agent Language Models (REALM) at EMNLP 2026
点击查看摘要
Abstract:Large Language Models (LLMs) typically exhibit a performance profile where reliability degrades as task complexity increases. We address the challenge of generating high-quality natural language executable plans for complex tasks by introducing $\textbf{GRASP}$, a strategy-aware, multi-stage planning framework. GRASP decouples the planning pipeline across specialized, context-isolated modules: it pre-compiles global macro-guidelines (GenPlan), explores alternative localized strategies within isolated context windows (RevPlan), and independently evaluates trajectories using a multi-criteria discriminator (VerPlan). Empirical evaluations show that GRASP consistently establishes a new state-of-the-art frontier across diverse datasets, yielding substantial accuracy gains over direct LLM planners on Natural Plan Calendar Scheduling ($\sim$12.4$\%$$\uparrow$), ZebraLogic ($\sim$30.8$\%$$\uparrow$), and SciBench Math. Crucially, under multi-task scaling-where standard planners suffer immediate performance collapse-GRASP completely flattens the multi-task degradation penalty. In interleaved dual-task environments, GRASP achieves an absolute accuracy gain of up to 16.7$\%$ over direct LLM planners. Furthermore, by isolating context and enforcing strict macro-regularization, GRASP outperforms frontier reasoning models (such as GPT-5-mini) by a margin of 14.5$\%$.
12. 【2609.30137】Screen Before You Serve: Simulation for Production Customer Experience AI Agents at 140M Scale
链接：https://arxiv.org/abs/2609.30137
作者：Edesio Alcoba,Kevin Rossell,Aman Gupta,Shao Tang,Jiwoo Hong,Pabel Carrillo-Mendoza,Wanderson Conceição Ferreira,Alvaro Tedeschi,Zayd Simjee,Shreya Rajpal,Bruno Finardi Hime,Christian Sousa,Luis Moneda,Herbert Fei,Daniel Silva,Rohan Ramanath
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：guide conversational interactions, address customer requests, organization products, requests and guide, guide conversational
备注： 17 pages, 11 figures
点击查看摘要
Abstract:Customer experience (CX) agents use tools and large language models to address customer requests and guide conversational interactions with an organization's products. Improving these agents, especially in regulated industries, is difficult: they must detect intent, follow complex operational policies and use tools reliably. Manual end-to-end testing offers limited coverage, while live experiments expose customers to failures that can erode trust. We present a hypothesis-driven simulation workflow for screening candidate CX agents before deployment. Synthetic customers react to agent responses and simulated tool outputs enable multi-step agentic workflows without invoking production backends. We use the Snowglobe simulator on Nubank's Card Delivery agent and its expanded successor, Card Management - Nubank's highest-volume chat-support agent in Brazil. Across 4 deployed versions, simulated and production version-level binary evaluator scores show high correlation. Simulation-guided iteration increased transactional net promoter score (tNPS) by 36.69 points in a live A/B test. We also screened open-weight configurations in over 16,000 simulated conversations. In a subsequent live A/B test, the selected model increased self-service rate (SSR) by 8.82 percentage points to the highest level observed at Nubank, with no statistically significant change in tNPS. Simulation made broad exploration of models, reasoning settings, and prompts feasible without customer exposure, enabling production improvements that would have been impractical to pursue through live experimentation alone.
Comments:
17 pages, 11 figures
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2609.30137 [cs.AI]
(or
arXiv:2609.30137v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.30137
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
13. 【2609.30130】Multimodal Thinking with Renderable Programs
链接：https://arxiv.org/abs/2609.30130
作者：Sunli Chen,Ding Zhong,Ziqiao Ma,Jiaxin Liu,Zeyuan Yang,Hao Zhang,Lie Lu,Joyce Chai,Chuang Gan
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Current vision-language models, Current vision-language, visual content understanding, content understanding, structure limits
备注：
点击查看摘要
Abstract:Current vision-language models (VLMs) excel at visual content understanding and text-based reasoning, yet their structure limits the advancement of incorporating images into the reasoning chain. Though Omnimodal models have made efforts in unifying text and image generation, they focus on visual tasks in the open-domain, lacking tractability due to rasterized or latent representations of images. We introduce SVGLM, a framework that uses scalable vector graphics (SVG) primitives to connect text and image in reasoning tasks. We exploit the duality of SVG as both image description and text instructions, yielding a more compact, interpretable solution to equip general VLMs with the capability of generating images within the reasoning process. We provide a large curated dataset of SVG-based image editing dataset, as well as the paradigm to tune open-source VLMs. Experiments on a mathematical reasoning benchmark demonstrate that SVGLM achieves strong SVG generation power as well as think-with-image intelligence. Our results highlight SVG as a suitable medium for building more robust digital domain agents, bridging the gap between text-based thinking and pixel-based images.
14. 【2609.30121】What, When, and How: Audio Description as Constrained Global Optimization
链接：https://arxiv.org/abs/2609.30121
作者：Igor Sterner,Mirella Lapata,Alex Lascarides,Frank Keller
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：visually impaired audiences, Audio Description, narrating visual information, accessible to blind, blind and visually
备注：
点击查看摘要
Abstract:Audio Description (AD) makes movies accessible to blind and visually impaired audiences by narrating visual information in gaps between dialogue. Existing automatic AD systems largely treat generation as a local video-to-text problem, assuming that the content to describe and its temporal location are already provided. Realistic AD instead requires coupled decisions about what visual information is narratively important, when it can be spoken without interfering with dialogue, and how it should be formulated to fit within the available time. We formalize AD generation as a constrained optimization problem over these three decisions. Our hybrid system uses large language models to propose and ground visual elements, estimate their salience to the narrative, and generate compressed realizations. A mixed-integer linear program then jointly selects and schedules descriptions across a scene subject to temporal constraints. When evaluated on REFRAMED, a benchmark for realistic AD of movies, our approach makes better decisions than prompted LLMs about what to describe and when to describe it, establishing a new SOTA on narrative QA and temporally grounded metrics. Ablations show that explicit temporal constraints drive gains in placement, while salience estimation controls how much narratively useful content is retained. Improvements are concentrated on temporal and narrative measures rather than n-gram overlap, although a significant gap to professional describers remains.
15. 【2609.30100】R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection
链接：https://arxiv.org/abs/2609.30100
作者：Pushp,Vaibhav Prajapati,Himangshu Sarma
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：require high computation, efficient Siamese-BERT variants, Siamese-BERT variants offer, variants offer practical, offer practical scalability
备注：
点击查看摘要
Abstract:Recent advances in paraphrase detection reveal a fundamental trade-off: large language models achieve high accuracy but require high computation, while efficient Siamese-BERT variants offer practical scalability with reduced transparency in rationale generation. We present R-DEIM Net, a 76M-parameter dual-expert architecture exploring whether moderate-scale models can achieve competitive accuracy on paraphrase detection while enabling human-readable rationale generation. The architecture combines two specialized components: an Interaction Expert that captures token-level similarity patterns through multi-scale 2D convolutions and attention head allowing variable input length, and a Reasoning Expert that uses a Flan-T5-small decoder to generate rationales as auxiliary supervision. Rather than re-encoding generated text, we extract and pool decoder hidden states as complementary features for classification. On the Quora Question Pairs dataset, R-DEIM Net achieves 90.07\% accuracy and 90.16\% F1-score via 10-fold cross-validation. This represents competitive performance with strong transformer-based baselines (e.g., MFAE BERT: 90.54\% accuracy) and recent large language model based approaches (LLaMA-70B) while using a substantially smaller parameter budget. The model generates rationales alongside predictions, providing potential for auxiliary human-readable descriptions.
16. 【2609.30094】PrivDrift: Auditing User-Secret Leakage Under Topic Drift in Active LLM Conversations
链接：https://arxiv.org/abs/2609.30094
作者：Luciano Maldonado
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Large language models, Large language, language models increasingly, models increasingly operate, assistants in user-facing
备注： Preprint, 10 Pages, 6 figures
点击查看摘要
Abstract:Large language models increasingly operate as persistent assistants in user-facing, shared-session, and tool-augmented settings. When users disclose sensitive information during an active conversation, that information may remain behaviorally recoverable through later prompts even after the dialogue shifts to unrelated topics. We introduce \textbf{PrivDrift}, a benchmark for auditing whether user-disclosed secrets remain recoverable after conversational topic drift and persuasion-based probing. PrivDrift contains 1{,}000 controlled multi-turn dialogues with seeded secrets, content-dense drift turns, and standardized extraction probes. Across three LLMs with extended context windows, dialogue-level hybrid leakage remains substantial, ranging from 38.7\% to 54.6\%, and varies strongly by model, secret type, and persuasion intensity. Within the tested drift window, additional topic drift does not reliably reduce leakage, suggesting that privacy risk in active LLM contexts should be evaluated as a persistent behavioral failure mode rather than only as training-data memorization or immediate jailbreak behavior.
17. 【2609.30087】Return or Revise? Learning When Revision Helps Retrieval-Augmented QA
链接：https://arxiv.org/abs/2609.30087
作者：Nicholas Kashani Motlagh,Tim Anderson,Jeremy Gwinnup,Grant Erdmann
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：existing draft answer, retrieved evidence, answer-revision systems, return an existing, existing draft
备注： 25 pages, 4 figures
点击查看摘要
Abstract:We consider the decision of whether to return an existing draft answer or revise it using retrieved evidence, as in answer-revision systems. Draft confidence estimates whether the current answer is correct, but the decision requires estimating the effect of a specified revision. For offline training and evaluation, we grade both the returned draft and its candidate revision under the same correctness judge, which makes repair, harm, and the gap to an oracle observable. We call this paired effect its recoverability, and we train policies to predict it before revision. On 25,870 held-out open-domain questions across three revision setups, a scorer trained on the paired outcome has greater area under the accuracy--revision-rate curve than a matched draft-correctness scorer in all nine Llama setup--seed fits, and gains 0.23--0.68 accuracy points on average at development-selected thresholds, a difference significant across training runs only for dense retrieval. The resulting policy improves on always revising and on average closes more than a third of the oracle gap, although it still applies 38--46% of the harmful revisions. When a draft-free standard-RAG answer is also available, however, choosing between the draft and that answer is stronger by about two points for Llama and four for OLMo, and adding candidate revision as a third option yields no significant gain. Recoverability describes one revision; its value as an available action also depends on the alternatives.
18. 【2609.30075】A Native-Reference Phone-Class Geometry for Second-Language Pronunciation Analysis
链接：https://arxiv.org/abs/2609.30075
作者：Tina Raissi,Nhan Phan,Chenxiao Wang,Mikko Kurimo
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Automatic speaking assessment, lack interpretable measures, characterize pronunciation quality, Automatic speaking, lack interpretable
备注： Submitted to ICASSP 2027
点击查看摘要
Abstract:Automatic speaking assessment systems can provide holistic proficiency scores, but often lack interpretable measures that characterize pronunciation quality. We propose a native-reference phone-class geometry for measuring second language (L2) pronunciation deviation without requiring pronunciation labels, read-aloud prompts, or matched recordings of the same text from native and L2 speakers. Given a native speech corpus, we average frame-level self-supervised representations for each context-dependent phone-class and use singular value decomposition (SVD) to derive a compact native-reference coordinate system. For each L2 utterance, we compute the corresponding averages and project them into the native-reference space. We then demonstrate that the distances between L2 and native-reference coordinates for matched phone-classes show consistent negative correlations with holistic speaking proficiency on the Dev subset of the Speak and Improve Corpus 2025 (Spearman's $\rho\!=\!-0.53$) and with pronunciation quality on the learner subset of the English Read by Japanese Students dataset ($\rho\!=\!-0.34$). These findings suggest that the proposed geometry captures acoustic-phonetic information relevant for proficiency rating while remaining applicable to spontaneous L2 speech without matched native recordings.
19. 【2609.30074】How Reproducible Are Evaluation Conclusions? A Self-Audit of LLM-Inferred Prompt Structure
链接：https://arxiv.org/abs/2609.30074
作者：Dipankar Sarkar
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：systems routinely average, LLM systems routinely, small prompt sets, systems routinely, routinely average
备注： 13 pages. Previously submitted to TAE (Trust-AI-Eval), a NeurIPS 2026 workshop
点击查看摘要
Abstract:Evaluations of LLM systems routinely average over small prompt sets and report models as a ranked table. We ask how much confidence such a table deserves, using LLM-based prompt-structure inference as the case study: eight open model variants across five families and 8B to 675B parameters, caching disabled, 293 raw intermediate representations persisted. The measured phenomenon is unstable to begin with. Identical calls do not reliably recover identical structure, with mean node-set Jaccard from 0.39 to 0.96 and 72% of prompt-model cells never node-set-perfect. Auditing the evaluation weakens its conclusions further, and this is our main contribution. Under a joint cluster bootstrap over prompts, only the bottom of the ranking is firm: the two least reproducible models hold rank in 99% and 86% of replicates, the middle four in 27% to 48%, and the top two in 68% each, so the table identifies the worst model reliably but does not reliably identify the best. Two equally defensible rules for merging repeated campaigns change four of eight rows and move the study-wide headline by 7 percentage points. Checking the inferred structure against ground-truth annotations shows reproducibility cannot be read as accuracy. And four of the eight endpoints were withdrawn within ten weeks of measurement, so the study as specified can no longer be run. Small-sample LLM evaluations can therefore look far more definitive than their evidence supports. We recommend reporting rank stability, per-cell provenance, executed sensitivity comparisons, raw per-run outputs, and a measurement date alongside any ranking.
20. 【2609.30071】Scoring Both Directions: LLMs realize the MRS they cannot reliably parse
链接：https://arxiv.org/abs/2609.30071
作者：Soham Dan
类目：Computation and Language (cs.CL)
关键词：English Resource Grammar, English Resource, hand-written computational grammar, Resource Grammar, Minimal Recursion Semantics
备注：
点击查看摘要
Abstract:The English Resource Grammar (ERG) is a hand-written computational grammar of English. Given a sentence, its processor, ACE, produces a formal meaning representation called Minimal Recursion Semantics (MRS): a graph of the sentence's predicates and their arguments. The grammar is bidirectional and can also turn an MRS back into an English sentence. \citet{hajdik2019} used the ERG's treebank to build a benchmark for that generation task, MRS to text, and trained sequence-to-sequence models to solve it. The parsing task, text to MRS, can be tested on the same sentences. We reconstruct their 10K-sentence test split, and score two large language models, Claude Sonnet~4.5 and Claude Opus~5, in both directions against their trained systems and against ACE, with no task-specific training. Given an MRS and three examples, Opus writes the sentence at 76.3 BLEU, ten points above their system trained on 72k pairs (66.1 BLEU), and comparable to their system trained on a million extra pairs (77.2 BLEU). Sonnet scores 65.7 BLEU, and letting it choose among ACE's own candidate sentences lifts it to 69.6, while a pooled judge that keeps Opus's own sentence among the candidates adds 0.6 points (77.0 BLEU). In the parsing direction, however, the models fall far behind ACE: asked for the MRS of the same sentences, they reach 57.2 (Sonnet) and 65.5 (Opus) F$_1$ on the graph's predicates and arguments against 91.0 for ACE, and exact-match the gold on about 1\% of sentences. We characterize the failure modes for the parsing tasks, and conclude that a generation score alone does not show that models understand formal semantic representations.
21. 【2609.30063】Self-Play Pretraining with Zero Data
链接：https://arxiv.org/abs/2609.30063
作者：Aditya Cowsik,Kfir Dolev,Michael Y. Li,G. Bruno De Luca,Nourya Cohen,Noah D. Goodman,Yoav Levine
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Advances in language, data, language modeling, Advances, training data
备注： AC, KD, and MYL contributed equally; authors are listed alphabetically
点击查看摘要
Abstract:Advances in language modeling have been driven by scaling pretraining on ever more data. Yet, the training data is still largely curated on the model's behalf. A more general approach to pretraining would let the model learn to generate the data most useful for its own improvement. This would provide an effectively unbounded source of training data, limited by compute rather than human knowledge. We introduce Self-Play Pretraining with Zero Data, an initial proof-of-concept towards realizing this vision. Our procedure casts synthetic data generation as a search over the space of all computable structure, taking inspiration from Solomonoff induction. Starting from random initialization, two models learn in tandem: a generator proposes programs interpreted by a universal Turing machine, generating byte sequences, while a learner autoregressively predicts these byte sequences. The learner is trained with standard cross-entropy, while the generator is trained with reinforcement learning to produce sequences at the frontier of the learner's capabilities, yielding an adaptive curriculum. A universal Turing machine gives us a search space over all computable data-generating processes, imposing little domain-specific structure, and self-play searches over this space for useful training data. We test whether zero-shot performance on natural data improves predictably with self-play compute; this is a clean test of transfer since neither generator nor learner is trained on natural data. Across several natural datasets, zero-shot loss exhibits predictable scaling in compute. The models also exhibit in-context learning, and discover recognizable mathematical sequences during training.
22. 【2609.30048】Style, Not Self: Surface Cues Explain Zero-Shot Code Attribution by Large Language Models
链接：https://arxiv.org/abs/2609.30048
作者：Ehsan Barkhordar,Surendrabikram Thapa
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：recognize code, favor that code, code, named model wrote, model
备注： 18 pages, 1 figure. Code and data: [this https URL](https://github.com/ebarkhordar/llm-collusion)
点击查看摘要
Abstract:If a language model can recognize code it wrote, it may favor that code as a judge, and instances of one model monitoring each other could collude. We test this zero-shot on current commercial models. Five LLMs generate solutions to MBPP, HumanEval, and DS-1000, seven more to MBPP, and models act as evaluators in four tasks: picking their own solution from a pair, judging whether a single solution is their own, identifying which of two solutions a named model wrote, and judging quality blind. In the single-solution task, balanced accuracy is 49-58% for all 15 model-benchmark combinations, while raw accuracy (38-67%) mostly reflects how readily a model claims authorship. In the pairwise task, accuracy across 14 evaluator-opponent combinations correlates at r=0.93 with how often the evaluator's solution is longer. Attribution to a named model succeeds on some pairs and is consistently inverted on others. A rule-based normalization that strips docstrings, comments, type hints, and local names preserves Pass@1 and leaves ten of twelve re-tested results at chance; the other two follow a length difference it leaves, although a trained classifier still separates most normalized pairs. Claude Haiku's self-preference also disappears. We recommend reporting balanced accuracy, heuristic baselines, and label consistency.
23. 【2609.30030】Artificial Societies Benchmark: A Validation Framework for Synthetic Research
链接：https://arxiv.org/abs/2609.30030
作者：Edoardo Chidichimo,Min Jun Jung,Felix P. S. Wallis,James K. He
类目：Computation and Language (cs.CL)
关键词：Artificial Societies Benchmark, people differ, survey can reproduce, reproduce the average, misrepresenting how people
备注： 36 pages, 9 figures, 9 tables
点击查看摘要
Abstract:A synthetic survey can reproduce the average answer while misrepresenting how people differ, how their answers relate to one another, or how they respond to changes in conditions. We introduce the Artificial Societies Benchmark to help researchers assess whether synthetic populations support their intended analyses. The framework combines eleven tests across internal, construct, and external validity, drawing on twenty human sources and comparing nine language models. It connects each research use to the evidence it requires and tests how results change with the information we supply about respondents. Importantly, strong performance in one domain does not establish fidelity in the others. Models often answer too consistently, compress response scales, and alter relationships between traits whilst richer profiles improve prediction for some models and worsen it for others. The resulting scorecard helps researchers identify which aspects of a synthetic population can support their analysis and where researchers need further human evidence.
24. 【2609.30012】Low-Cost Assays for Measuring Model Behavior Across Vendors and Releases
链接：https://arxiv.org/abs/2609.30012
作者：Tapan Parikh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Language models advise, models advise people, Language models, advise people, write software
备注： 6 pages. Code and data: [this https URL](https://github.com/tap2k/modelun)
点击查看摘要
Abstract:Language models advise people, keep them company, and write software while they sleep. Measuring what they do is hard: behavior has to be sampled repeatedly across models, prompts and releases, most of it lives in unstructured text that has to be coded before it can be counted, and the result has to be legible and rigorous enough to meaningfully compare models and vendors. To address these constraints, we present a simple, cheap, scalable, and replicable model for studying model behavior. Each study is a frozen, public stimulus run identically on a cross-vendor panel, at a few dollars per model or less. Each reads its transcripts one of three ways, chosen by how much interpretation the behavior needs: exact match on a clamped reply, a codebook applied by LLM judges whose agreement with a human coder is reported per code, and an instrumented environment that records what an agent did independently of what it said. Run across four years of model releases from both frontier and open-source labs, these instruments find four things. Convergence: asked to pick a word, 27 of 44 models answer serendipity at least once in four tries. Resistance: a trailing "right?" moves endorsement by up to 32 points, and the sign flips from sycophantic to resistant as generations advance, keyed to the tag's surface form. House: whether a model holds a position under pressure tracks its generation, and how it holds tracks the lab that built it. Account: told to do something the documentation in their repository contradicts, some coding agents never went along silently and others always did, and the same model can change with the harness it runs in. Re-run on every release, batteries like these track how behavior is changing across vendors and over time.
25. 【2609.30009】Automated Regulatory Compliance Question Answering in Financial Services with Domain-Adapted Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2609.30009
作者：Tobias Deußer,Abhishek Pillai,Aurelio F. Bariviera,Dhananjay Bhardwaj,Lorenz Sparrenberg,David Berghaus,Christian Bauckhage,Rafet Sifa
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Financial institutions operate, Financial institutions, frequently amended rulebooks, compliance question correctly, frequently amended
备注： Currently under review
点击查看摘要
Abstract:Financial institutions operate under dense, frequently amended rulebooks, and answering a compliance question correctly requires not only fluency but verifiable grounding in the authoritative text. Large language models are attractive for this task, yet the models that firms can realistically deploy on-premise are compact ones, and compact models hallucinate obligations. We study whether a carefully domain-adapted retrieval-augmented generation pipeline closes that gap. Our retriever is built in three stages on top of LegalBERT: entailment tuning that recasts question--passage matching as premise--hypothesis reconstruction, contrastive tuning with in-batch negatives, and score-level fusion with BM25. Our generator is a compact model (2B--12B parameters) served under 4-bit quantization, either prompted or adapted with retrieval-aware fine-tuning (RAFT) through LoRA. On ObliQA, a question-answering benchmark built from the Abu Dhabi Global Market rulebooks, the staged retriever raises Recall@10 from 0.256 to 0.774 and outperforms BM25 (0.678) and E5-large-v2 (0.758), the strongest general-purpose dense encoder we tested. RAFT-LoRA then improves the composite RePASs answer-quality score for every model we could adapt, with the largest gain on the weakest one. However, the adapted models do not transfer to Australian case-law questions, and a closed-book model that receives no passages at all scores within 0.011 RePASs of the full pipeline while producing answers that cite nothing and misstate obligations. The retrieval gain is therefore measured directly, the generation gain is a gain in RePASs rather than demonstrated grounding, and grounding itself requires an evaluation protocol that RePASs does not provide.
26. 【2609.30005】VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switching
链接：https://arxiv.org/abs/2609.30005
作者：Minh Hoang,Thai Le
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：isolate automatic speech, automatic speech recognition, Vietnamese speech research, deepfake analysis, research is constrained
备注： Preprint for ICASSP 2027 submission
点击查看摘要
Abstract:Vietnamese speech research is constrained by resources that isolate automatic speech recognition from speaker, dialect, code-switching, and deepfake analysis. We introduce VietPrism, an open, multi-domain corpus that brings these dimensions together at scale: 993.4 hours and 403,941 bona fide utterances from 1,262 verified speakers across 8,388 real-world videos. To our knowledge, it is the first large-scale Vietnamese corpus to jointly provide transcripts, consistent speaker identities, five dialect groups, and naturally occurring Vietnamese--English code-switching, which constitutes nearly half of the corpus by duration. We further create over 3.1K hours of spoof speech with four open-source and commercial synthesis systems. Every spoof is conditioned on a verified speaker reference and paired with a transcript- and speaker-matched bona fide utterance, enabling unique controlled evaluation with reduced lexical and identity confounds. Zero-shot evaluation of five pretrained multilingual detectors reveals striking brittleness: EER greatly varies across detector--generator pairings, while recent multilingual detector DFA-1B degrades from 16.3% to 33.6% as speaker similarity increases. Dialect-stratified results expose further model-dependent disparities. By unifying natural linguistic diversity with controlled spoof generation, VietPrism provides a challenging foundation for Vietnamese speech modeling and trustworthy audio-deepfake detection.
27. 【2609.29952】Augur: A Synthetic Decision Lab for Rehearsing Reactions to Product and Policy Changes
链接：https://arxiv.org/abs/2609.29952
作者：Rahul Khedar,Mayank Malhotra,Avinash Karn
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：policy change ships, question that matters, people will react, change ships, policy change
备注： 19 pages, 15 figures, 11 tables
点击查看摘要
Abstract:Before a product or policy change ships, the question that matters is how people will react to it. Augur rehearses that reaction offline: it builds a typed knowledge graph from the change documents, populates a grounded persona market, simulates the interaction, and returns an auditable decision memo recommending one of five actions. We assemble Gold-50, fifty real product and policy episodes whose real-world outcome is known, adjudicated against the public record, and score the five-way release verdict against it. Our central finding is methodological and negative: most of the measured gap between frontier cloud models and open-weight models we fine-tune and serve offline is attributable to an under-specified evaluation, not a difference in capability. We show this three ways. First, the prompt envelope alone can dominate the score: holding weights, cases and scorer fixed, one system -- a LoRA-SFT adapter on Qwen3-32B -- swings from 0% to 73%. Second, in a matched 2x2 ablation, defining the decision taxonomy in the prompt -- with no model change -- lifts every frontier model by +24 to +34pp; under the under-specified prompt, Qwen3-32B LoRA-SFT served offline beats all three frontier models (paired McNemar, Holm-corrected), and once the prompt is fair no significant difference from any of them is detected. Third, agreement with the distillation teacher rises without accuracy following, and the full pipeline amplifies a systematic "over-doom" bias rather than improving the verdict. Separately, we validate the reaction layer on its own terms: blind judges across four model families find the synthetic reaction recovers 67-90% of the concerns the public actually raised, and a pre-registered ablation locates its value -- largest where the decision is hardest, redundant near ceiling. The pipeline that regenerates every number and figure here is available from the authors.
Comments:
19 pages, 15 figures, 11 tables
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
Cite as:
arXiv:2609.29952 [cs.AI]
(or
arXiv:2609.29952v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.29952
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
28. 【2609.29933】An Empirical Study of VLM Pipelines for Long-Document QA
链接：https://arxiv.org/abs/2609.29933
作者：Kenan E. Ak,Jay Mohta,Gwang Gook Lee,Yan Xu,Dimitrios Dimitriadis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：Vision-Language Models, complex layouts, inputs combine text, long-document processing, pipeline
备注： 22 pages. EMNLP 2026 Industry Track
点击查看摘要
Abstract:Vision-Language Models (VLMs) are increasingly used for long-document processing, where the inputs combine text with charts, tables, figures, and complex layouts. Deploying them means choosing how to feed the document to the model, which retriever to use when only a subset of pages is sent, and whether to run the model agentically or as a static pipeline. We study these choices on two long-document QA benchmarks with both frontier API and open-weight VLMs. First, on MMLongBench-Doc our six-tool agent with page, table, figure, and search calls pays off only once the answering VLM is large enough: with Qwen3.5-4B and 9B it trails static page input, with Qwen3.5-27B it draws level, and with Sonnet 4.5 it leads. On LongDocURL it is level with or ahead of static input at every reader. Its lead over the strongest static pipeline is clearest with the frontier reader on MMLongBench-Doc and narrows to within noise on LongDocURL. Second, retrieval modality matters more than the specific retriever: the strongest image retriever leads the strongest text pipeline, and on the text side a single off-the-shelf cross-encoder rerank essentially matches a much heavier multi-stage LLM pipeline. Top-k image retrieval is also the most token-efficient input at every reader we paired it with, at roughly a seventh to a quarter of the tokens of sending every page. Third, cutting across all three choices, three of our strongest pipelines succeed on different questions, and an oracle that picks the best pipeline per question gains roughly thirteen points over the best single pipeline, though evidence-type routing recovers almost none of it.
29. 【2609.29928】Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations
链接：https://arxiv.org/abs/2609.29928
作者：Yeeun Chae,Yewon Choi,Seunghyun Lee,IL Im
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, population response distributions, estimate population response, Large language, synthetic survey respondents
备注： Accepted to the EMNLP 2026 Workshop on Pluralistic AI NLP (PANDORA)
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used as synthetic survey respondents to estimate population response distributions. In cross-cultural survey simulation, evaluations should assess not only distributional fidelity within countries but also whether differences across countries are preserved. However, existing distance-based metrics such as Jensen--Shannon divergence (JSD) do not directly capture such cross-country differences. To address this limitation, we introduce Cultural Divergence Preservation (CDP), a reference-light diagnostic based on a one-time human calibration. CDP identifies reduced cross-country divergence as cultural flattening and increased divergence as cultural caricature. To evaluate CDP, we conduct experiments across four LLM backbones, three persona-based prompting methods, and two survey domains, the World Values Survey (WVS) and the Big Five Personality Test. The results reveal a systematic discrepancy between conventional fidelity metrics and CDP. Controlled experiments show that CDP changes monotonically as cross-country divergence is attenuated or amplified, while the corresponding changes in JSD remain relatively small. In our audit of real LLM generations, DeepPersona-Inspired prompting is frequently favored by conventional fidelity metrics but exhibits the strongest flattening in every model--domain block. CDP thus complements fidelity metrics by directly quantifying the attenuation or amplification of cross-country divergence.
30. 【2609.29913】MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression
链接：https://arxiv.org/abs/2609.29913
作者：Youpeng Zhao,Tian Tan,Liqian Peng,Jun Wang,Alec Go
类目：Computation and Language (cs.CL)
关键词：enables large language, inference efficiency bottleneck, Many-shot in-context learning, large language models, in-context learning
备注： Technical Report
点击查看摘要
Abstract:Many-shot in-context learning (ICL) enables large language models (LLMs) to adapt to complex tasks by conditioning on thousands of demonstration examples, but this paradigm shifts the inference efficiency bottleneck to the key-value (KV) cache memory. Due to the linear scaling behavior of the KV cache, storing these intermediate tensors has become a paramount challenge for both online serving and on-device deployment. To address this issue, we propose a novel compression framework, termed MILO, that exploits the low-rank redundancy inherent in many-shot contexts. Specifically, MILO features a block-wise low-rank compression strategy that compresses the KV cache at the block granularity, where each block contains multiple many-shot examples. Furthermore, to handle the heterogeneous context density across different blocks, MILO dynamically allocates rank budgets based on the information entropy, preserving the fidelity of critical blocks while aggressively compressing redundant ones. Experimental results on Qwen2.5 models demonstrate that our method achieves up to 50% reduction in KV cache memory and 1.8x throughput improvement, with negligible performance degradation on classification and reasoning benchmarks, significantly outperforming prior baselines.
31. 【2609.29855】Multi-Task Learning by using Contextualized Word Representations for Syntactic Parsing of a Morphologically Rich Language
链接：https://arxiv.org/abs/2609.29855
作者：Toqeer Ehsan,Miriam Butt,Sarmad Hussain,Hassan Alhuzali,Ali Al-Laith
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：morphologically rich language, rich language, million tokens Urdu, address the challenge, morphologically rich
备注： Published in PLOS ONE, 2025
点击查看摘要
Abstract:We address the challenge of syntactic parsing for Urdu, a morphologically rich language, and present state-of-the-art results for both constituency and dependency parsing. This paper offers four major contributions: 1) the conversion of the CLE-UTB phrase structure treebank into a dependency treebank by developing language-specific head-word and phrase-to-dependency label mapping rules; 2) a novel sequence labeling scheme that transforms the parsing task into a unified representation; 3) the training of contextualized word representations on a large 220 million tokens Urdu corpus collected from the web; and 4) development of parsing framework using two learning paradigms, single-task and multi-task learning. Several post-processing rules are applied to improve the quality of the automatically converted dependency structure treebank. The proposed sequence labeling scheme enables the use of a shared architecture that learns the syntactic structures from both grammatical structures simultaneously and hence improves generalization. Experiments show that the multi-task learning setup significantly enhances parsing performance, achieving an F1 score of 91.39 for constituency parsing (an improvement of 3.29 points) and a labeled attachment score of 85.69 for dependency parsing (an improvement of 1.49 points). These results demonstrate that learning cross-task representations provides measurable benefits and advances the state of syntactic parsing for Urdu.
32. 【2609.29848】Encoded but Not Decoded: Layer-Localized Evidence for a Three-Level Gap in LLM Syntax
链接：https://arxiv.org/abs/2609.29848
作者：Zhenyan Lu,He Wang,Xiaohui Huang
类目：Computation and Language (cs.CL)
关键词：relevant structure, fail a syntactic, syntactic test, Behavioral evaluation, behavioral deployment
备注： Accepted by AACL-IJCNLP 2026
点击查看摘要
Abstract:A language model can fail a syntactic test in two distinct ways: by not encoding the relevant structure, or by encoding it but failing to use it at the output. Behavioral evaluation alone cannot tell these apart. We propose a three-level evaluation framework (behavioral deployment, LM-head readout, and probe recoverability) measured on the same items under the same binary decision. Using a compact trilingual (English, Chinese, German) control-dependency benchmark, we find that probe recoverability exceeds or equals LM-head readout, which in turn exceeds or equals behavioral deployment, across seven models and all three languages in the aggregate. The recoverability surplus is never negative across all 14 (model, task) conditions. The disconnect concentrates in subject-control, where a nearest-noun heuristic gives the wrong answer. The single largest gap (0.653) appears on Qwen3-0.6B Instruct in question answering. The gap persists at Qwen3-14B Instruct. Instruction tuning degrades deployment more than encoding in percentage terms. We rule out option-position bias, late-layer erasure, output-formatting artifacts, and probe-training variance. The pattern is consistent with decoding that favors surface shortcuts, and the behavior-probe gap measures the strength of that preference. Activation patching shows the gap is layer-localized. Under instruction tuning, the LM-head-decoded layer shifts approximately ten layers later than the probe-decoded layer. These findings argue that behavioral evaluation understates what models encode, while probing alone overstates what they deploy.
33. 【2609.29845】Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs
链接：https://arxiv.org/abs/2609.29845
作者：Pavel Tikhonov,Anton Korznikov,Matvey Mikhalchuk,Nikita Dragunov,Temurbek Rahmatullaev,Polina Druzhinina,Anton Razzhigaev,Ivan Oseledets,Elena Tutubalina
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, highly non-linear components, distinct text streams, Large Language, Language Models
备注：
点击查看摘要
Abstract:While Large Language Models (LLMs) rely on highly non-linear components, in this work we demonstrate that they exhibit fundamental linearity: when inputs from distinct text streams are linearly combined, the model outputs a superposition of the individual next-token distributions. We term this the \textit{Superposition Linearity Hypothesis}. We provide evidence that superposition is an intrinsic property of the Transformer architecture rather than an emergent consequence of training; in fact, we observe that it tends to diminish as pretraining progresses. However, we demonstrate that linearity can be substantially restored through lightweight fine-tuning, significantly reducing the divergence between the predicted next-token distribution and the average of the individual next-token distributions. Finally, we introduce a guided decoding procedure that disentangles superposed outputs, enabling the simultaneous generation of two coherent continuations from a single forward pass.
34. 【2609.29837】PUBG Ally: A Conversational Embodied Agent as an AI Teammate
链接：https://arxiv.org/abs/2609.29837
作者：Beomsoo Kim,Byeongju Kim,Dohyun Kim,Dongwon Kim,Eunchong Kim,Hongmin Kim,Hyeojung Im,Hyeonbin Hwang,Hyeonghwan Kim,Hyoseok Seol,Insub Im,Irene Chen,Jaeseung Jeon,Jimin Hong,Kiyoon Yoo,Minkyoung Park,Seohyeon Jung,Seungjun Chung,Sue Hyun Park,Sungwoo Kim,Youngin Cho,Yujeong Son,Kangwook Lee,Hyunseung Kim
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：introduce PUBG Ally, introduce PUBG, PUBG Ally, PUBG, Ally
备注： 55 pages, 19 figures, 16 tables
点击查看摘要
Abstract:We introduce PUBG Ally, an embodied agent for PUBG: BATTLEGROUNDS that can reason, act autonomously, and play alongside players as a voice-enabled teammate. Building such a teammate requires combining two difficult capabilities: it must perceive and respond to a constantly changing game world under strict latency constraints while interacting naturally with players, keeping its speech synchronized with its actions. Ally therefore combines agentic tool use with real-time game control. A language-model agent uses a controlled interface to inspect game information, interpret player speech, maintain context, decide what to say, and issue high-level action choices that steer a faster control layer for movement, combat, and recovery. Because the player's and Ally's speech and actions continually shape each other and the course of the match, training requires data from actual gameplay. We therefore collect data across nearly 39k sessions in which real players play alongside Ally, recording gameplay, player speech, agent decisions, tool use, actions, and player feedback, and use these records for iterative training. To evaluate teammate quality, we use player feedback and preference comparisons to identify gaps between offline evaluations and player preferences, and iteratively refine the evaluation criteria. Deploying Ally in live service further requires low-latency on-device execution and safeguards for player-facing communication, which we address through model compression, context compaction, targeted safety training, runtime guardrails, and memory redaction. During the live service, we surveyed players in 141 countries. Among respondents whose play with Ally was confirmed in game records, positive responses exceeded negative responses by 25.1 percentage points when asked whether they would recommend Ally, with players describing Ally not only as a tool but also as a teammate or companion.
35. 【2609.29828】ChunkRank: Model-Aware Text Chunking and Abstention-Aware Answer Selection for LLM Pipelines
链接：https://arxiv.org/abs/2609.29828
作者：Amit Nautiyal,Ayush Bhatt,Gaurav Nautiyal
类目：Computation and Language (cs.CL)
关键词：open-source Python library, candidates produced independently, open-source Python, Python library, derives chunk boundaries
备注： 16 pages. Code: [this https URL](https://github.com/AmitoVrito/chunkrank)
点击查看摘要
Abstract:We present ChunkRank, an open-source Python library that derives chunk boundaries from a target model's tokenizer and context window, and selects an answer among candidates produced independently per chunk. It ships a validated registry of 90 models across 15 providers and six answer-selection methods, and needs only three core dependencies. For chunking, ChunkRank avoids context-window overflow automatically from the model name, whereas character-based splitters overflow or waste the budget, and a fidelity study across 11 languages shows why token-exact budgets matter beyond English. For answer selection we report a negative result: on NaturalQuestions, TriviaQA and HotpotQA, with extractive and generative readers, no content-based ranker reliably beats taking the first non-empty answer. The reason is reader abstention on chunks that lack the answer, not answer position. A long-context baseline shows that chunking matches single-call reading on single-hop questions, so ChunkRank targets small-window and beyond-window settings. Code, registry and evaluation harness are released.
36. 【2609.29807】CORDIAL: Calibrating Ordinal LLM Outputs from Few Labels
链接：https://arxiv.org/abs/2609.29807
作者：Xiangwei Wang,Peng Wang,Saman Halgamuge
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language model, compressed or exaggerated, ordered scale, consistent direction, large language
备注：
点击查看摘要
Abstract:A large language model (LLM) can turn a text into a distribution over an ordered scale, but that distribution is a noisy measurement: saturated, compressed or exaggerated, and biased in a consistent direction. We propose CORDIAL, which treats the model's output as a noisy reading of the true label and corrects it with a channel of five interpretable parameters. The channel is small enough for its posterior to be averaged from a handful of labels, and we prove that the resulting calibration preserves first-order stochastic order. On Amazon reviews and CMU-MOSEI transcripts with four LLMs, CORDIAL has the lowest log loss among nine calibrators in 76 of 80 settings with 5 to 100 labels; with 20 labels and the main 7B reader, it matches the strongest baseline using 28-54 labels. The same posterior lets us learn priors from other tasks and fuse several LLMs. Unrestricted calibrators such as Dirichlet calibration overtake it only as the calibration set grows into the hundreds or thousands.
37. 【2609.29802】Learning to Ideate for Scientific Impact
链接：https://arxiv.org/abs/2609.29802
作者：Shubham Kale,Aniketh Garikaparthi,Manasi Patwardhan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：current ideation systems, immediately judgeable proxies, large language models, current ideation, ideation systems
备注： RLxF Workshop ICML 2026
点击查看摘要
Abstract:Scientific ideation is increasingly mediated by large language models, but current ideation systems are usually trained and evaluated on immediately judgeable proxies such as novelty, clarity, and feasibility. This leaves open whether delayed signals of scientific uptake can be used as feedback for steering models toward research directions with higher expected \emph{impact}. We study this question using citation-normalized impact as a noisy but scalable proxy for scholarly uptake. We construct a large-scale dataset from over 100K computer science papers by extracting goal-conditioned idea descriptions and assigning each paper an ordinal, year-normalized citation label. We then train a goal-conditioned reward model to predict citation-impact labels from research goal and idea pairs, and use this reward to align an idea generator through supervised fine-tuning followed by reinforcement learning. To reduce circularity, we evaluate generated ideas with a held-out, reference-grounded protocol that compares model outputs against historical ideas under the same research goal and weights judgments by the reference idea's citation-impact label. Experiments show that our RL-tuned model consistently produces ideas with higher estimated impact than both the base model and supervised fine-tuning baselines. Our findings position scientific impact as a practical, outcome-grounded feedback signal for aligning LLMs in open-ended scientific discovery.
38. 【2609.29800】Adaptive Fisher-Whitened Cross-Covariance for Low-Resource Speech Recognition
链接：https://arxiv.org/abs/2609.29800
作者：Asmee Mishra,Mengjie Qian,Brechtje Post,Kate Knill
类目：Computation and Language (cs.CL)
关键词：languages remains difficult, remains difficult, FCCA, low-resource languages remains, multilingual speech foundation
备注：
点击查看摘要
Abstract:Adapting multilingual speech foundation models to low-resource languages remains difficult, especially for languages that are poorly represented during pre-training. While parameter-efficient fine-tuning (PEFT) reduces the cost of adapting large models, conventional approaches such as LoRA rely on generic low-rank parameterizations and do not explicitly use downstream task information to define the adaptation subspace. To investigate whether task-informed PEFT can better support low-resource ASR, we apply Fisher-Whitened Cross-Covariance Analysis (FCCA) to Whisper and Qwen3-ASR, and introduce two complementary extensions: Asymmetric-Coupled FCCA (AC-FCCA), which exploits structured cross-layer sharing, and Adaptive-Rank FCCA (AR-FCCA), which reallocates adaptation capacity across projection matrices under a fixed parameter budget. Under controlled multilingual experiments, we evaluate these approaches on languages that are poorly represented or unsupported during pre-training alongside well-represented languages. Standard FCCA is competitive with, and usually outperforms, trainable-parameter-budget-matched LoRA. AR-FCCA provides the most consistent improvement over standard FCCA across both model architectures, with statistically significant gains in several evaluation settings, while retaining the same number of trainable parameters. These results show that task-informed subspace construction can be effective for low-resource speech adaptation, and that adaptive rank allocation provides a robust way to improve parameter efficiency without increasing model capacity.
39. 【2609.29798】Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages
链接：https://arxiv.org/abs/2609.29798
作者：Stephen E. Moore,Akwasi Asare,Mich-Seth Owusu,Paul Azunre,Joel Budu,Lawrence A. Adu-Gyamfi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：automatic speech recognition, adolescent health communication, Youth Adolescent Sexual, Word Error Rate, Domain ASR dataset
备注： 34pages, 8figures,
点击查看摘要
Abstract:This paper presents an end-to-end study of automatic speech recognition (ASR) for adolescent health communication in three Ghanaian languages (Twi, Dagbani, and Ewe). The work proceeds in three connected stages; First, we benchmark five ASR systems (three language-specific Wav2Vec2 models and two multimodal LLMs, Gemma 3n and Gemma 4) on a general-domain Bible corpus and a Youth Adolescent Sexual and Reproductive Health (ASRH) Domain ASR dataset, using Character and Word Error Rate (CER, WER). Second, guided by the benchmark, we perform supervised domain adaptation: although Gemma 4 was the strongest zero-shot candidate, fine-tuning it proved computationally infeasible, so we pivoted to the compact Qwen3-ASR-0.6B, fine-tuned on a large Ghana Bible corpus (~90k samples) and evaluated strictly on held-out human-collected in-domain audio. Fine-tuning reduced WER on every language, most dramatically for Ewe (WER from 109.3% to 64.8%, a drop of 44.5 pp; CER from 65.1% to 24.9%). Third, we validate the work through KasaHealth, a live voice-first ASRH application deployed in all three languages, complemented by Senti-Check, a technical evaluation harness. KasaHealth was tested by 50 community respondents and achieved a 100% chat-approval rate, a 72% Good-or-Excellent translation rating, and a 92% would-recommend rate, while surfacing the domain gaps that most constrain real-world use. Across all three stages the evidence converges: for these languages the binding constraint is validated in-domain data, not model capability or computation.
40. 【2609.29792】meBraid: Unifying Time Series and Language for Understanding and Forecasting
链接：https://arxiv.org/abs/2609.29792
作者：Xinyue Wang,Jiacheng Pang,Kun Zhou,Kexin Zhang,Defu Cao,Fan Feng,Faisal,Songyao Jin,Yan Liu,Biwei Huang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)
关键词：residual attention layers, interleaved global residual, global residual attention, pretrained time-series foundation, pretrained language models
备注： 57 pages
点击查看摘要
Abstract:We present TimeBraid, a series of unified time-series and language models that align pretrained language models and pretrained time-series foundation models through interleaved global residual attention layers. Each model inherits knowledge, instruction following, and reasoning from one side, continuous-signal perception and zero-shot forecasting from the other, and fuses the two in a shared representation space where both modalities are understood and generated. We study the design choices that make such unified modeling work: where to align the two representation spaces, how to ground language in temporal structure, how to balance understanding with generation, and how to keep joint optimization stable. The resulting recipe combines a unified prompting scheme for diverse time-series and text tasks, stabilized joint training, and supervision from 2.2M curated series--text pairs and 4.9M instruction-tuning samples. Across benchmarks spanning time-series perception, understanding, reasoning, and both context-aided and unimodal forecasting, TimeBraid remains competitive with far larger general-purpose models and task-specific counterparts.
41. 【2609.29769】JEV vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Places
链接：https://arxiv.org/abs/2609.29769
作者：Delip Rao,Chris Callison-Burch
类目：Computation and Language (cs.CL)
关键词：LLM rubric judge, LLM, LLM judges, LLM rubric, LLM judge
备注： 45 pages, 9 figures, 27 tables, including appendices
点击查看摘要
Abstract:We ask whether Jev, a typed classifier that returns probabilities over permitted answers without generating text, can replace an LLM rubric judge. We compare it with three flash-tier LLM judges on nine panels drawn from seven benchmarks, giving every judge identical criterion texts. Jev's accuracy differs significantly from an LLM judge's in only 8 of 27 paired comparisons, ahead mostly on binary criteria and behind only on graded ones, and most of the other comparisons are inconclusive. Summed over the nine panels, the LLM judges, called once per criterion, cost 29 to 325 times as much as Jev and took 30 to 220 times as long. On graded criteria all four judges agree more with one another than with the labels and mostly assign lower levels than the raters. One of several observational accounts is that raters followed scale conventions our criterion texts omit. Jev's confidence ranks its own errors on most panels, which should make a cheap classifier the ideal first stage of a cascade that defers its uncertain verdicts to an LLM judge. Correlated errors undo that advantage. The LLM judges repeat nearly all of Jev's most confident errors, so a cascade replayed on the recorded verdicts lowers cost but gains at most 1.5 points over the best single judge with cross-fitted thresholds, and at most 2.0 even with oracle thresholds.
42. 【2609.29735】C3M: Cross-Session Multimodal Memory Maintenance for Long-Horizon Tasks
链接：https://arxiv.org/abs/2609.29735
作者：Xueshu Chen,Yan Wang,Zihao Xue,Jiefu Li,Zhenfang Liu,Jayden Chen,Zhen Bi,Jungang Lou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：query-blind memory budget, Long-horizon tasks require, query-blind memory, recovering cross-session evidence, tasks require preserving
备注：
点击查看摘要
Abstract:Long-horizon tasks require preserving and later recovering cross-session evidence under a bounded, query-blind memory budget. Existing compression can discard fine-grained visual cues or conflate semantically similar but incompatible observations. We present C3M, a cross-session multimodal memory organization that maintains a bounded active index over persistent source text-image evidence. Relation-aware updates consolidate safe redundancy while preserving complementary and incompatible records. At query time, budgeted routing selects useful index pages and expands their associated source evidence under a fixed reader budget. Together, these mechanisms establish a compact, provenance-preserving multimodal memory organization for cross-session long-horizon tasks, retaining temporal distinctions and source links required for reliable downstream reasoning. Code is available at this https URL.
43. 【2609.29733】Lab at StanceEval-2026: A Cloze-Style Prompting Approach for Arabic-Language Stance Detection (CLASP-Ar)
链接：https://arxiv.org/abs/2609.29733
作者：Bhuvanesh Verma,Ali Abusaleh,Alexander Mehler
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Arabic-language stance detection, detection remains challenging, stance detection remains, previous shared-task systems, Arabic-language stance
备注： Accepted at ArabicNLP 2026 StanceEval-2026 shared task
点击查看摘要
Abstract:Arabic-language stance detection remains challenging, and previous shared-task systems have largely relied on multitask learning and ensembles. While these systems achieve state-of-the-art performance, their applicability and transferability are limited by the additional complexity introduced by multitask this http URL reduce this complexity, we introduce $\texttt{CLASP-Ar}$, which reformulates the task as cloze-style masked language modeling. In this approach, the target, predicted sentiment, and text are combined into a single prompt whose $\texttt{[MASK]}$ prediction is restricted to a verbalizer-constrained label vocabulary.
44. 【2609.29718】PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides
链接：https://arxiv.org/abs/2609.29718
作者：Xiaoqiu Wang,Yizhe Chi,Wenyi Li,Deyao Hong,Zhihan Shan,Mingju Gao,Kaisen Yang,Youjie Zheng,Calvin Xiao,Qinhuai Na
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：beginning to act, visual, Coding, visual coding, agents
备注：
点击查看摘要
Abstract:Coding agents are beginning to act in the visual world. They now build webpages, GUIs, games, 3D scenes, diagrams, and documents. Success in such visual coding requires bridging two spaces: inferring visual structure and expressing it programmatically. Slides are a core medium of knowledge work, widely used to communicate ideas and collaborate in a form that people can directly inspect and edit. Therefore, they provide an ideal testbed for visual coding, as they require agents to recover visual structure and realize it as editable objects. However, existing benchmarks either rely on subjective open-ended evaluation, produce non-editable code outputs, or focus only on local editing rather than end-to-end visual reconstruction. We introduce PPTBench, which benchmarks visual coding through editable slide reconstruction. It contains 500 tasks, each based on a scientific flow diagram from a real arXiv paper and requiring agents to reconstruct it as a single PPTX page composed of native, editable objects. A four-stage Agentic Judge evaluates artifact validity, semantic correctness, rendering quality, and fine-grained visual quality. Across 31 configurations spanning model families, effort levels, and harnesses, the best configuration, Kimi K3, reaches only 67.80, while the median scores 19.47. We find that agents can reliably produce valid PPTX files but still struggle with semantic and visual correctness, especially text details. More reasoning mainly helps agents pass hard gates, while stronger verification is more consistently associated with higher quality. PPTBench advances the vision of coding agents that can understand and reconstruct the visual world through structured, editable code.
45. 【2609.29709】hree Ways Classical Test Theory Misleads for LLM Judges
链接：https://arxiv.org/abs/2609.29709
作者：Louis Yiven Zhu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Methodology (stat.ME)
关键词：LLM judge scores, LLM judge, judge, LLM, judge error
备注： 5 pages plus references and appendix (12 pages total), 4 figures. Code and data: [this https URL](https://github.com/louisyzhu/llm-judge-reliability)
点击查看摘要
Abstract:An LLM judge scores a bank of responses against a rubric, and the reliability comes back at $0.52$. What has been measured? Judge evaluation has begun borrowing reliability statistics from classical test theory, usually without stating the measurement design each statistic assumes, and we show that three widely portable ones mean something different for a judge than for a test because the judge setting rearranges the roles those designs rest on. First, an internal-consistency coefficient computed over rubric elements contains no scorer facet. Holding one judge's measured error rate fixed at $4.72\%$, KR-20 still ranges from $0.01$ to $0.68$ as the item bank is redesigned around it, and varying judge error moves the coefficient by a comparable amount, so item design and judge error are not separately identified and no single value can be read as a property of the judge. Second, the dependability index $\Phi(\lambda)$ is a ratio of variance components, and the classification probability with which it is sometimes identified differs from it by $0.25$-$0.43$ on our bank and by $0.17$-$0.30$ on simulated data where the underlying model holds exactly. Third, Livingston-Lewis accuracy is indexed to an examinee's own true score on the same instrument, so scoring it against external gold conflates judge unreliability with criterion invalidity. Reviewing the three closest judge-evaluation papers, we found no published instance of these errors, which makes the caution prospective. A coefficient that cannot be attributed to the judge nonetheless travels downstream into deployment decisions and disclosure documents. We therefore close with four reporting lines that keep the attribution attached to the number.
46. 【2609.29703】Stochastic Semantic Evidence Graphs: Uncertainty Propagation and Governance for Agentic AI
链接：https://arxiv.org/abs/2609.29703
作者：Matthew Francis Dixon
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (stat.ML)
关键词：AI-agent evaluations, final answer, generation or decision, decision mapping, evaluations usually inspect
备注：
点击查看摘要
Abstract:AI-agent evaluations usually inspect a final answer, yet error may enter through evidence, retrieval, prompting, generation or decision mapping. We introduce a stochastic semantic evidence graph (SSEG), a hierarchical stochastic DAG whose language node expands into an autoregressive token subgraph and whose observable output may be a law over complete phrases. Semantic reduction and calibration are optional. We define graph-relative local defects and downstream edge influences, derive a pathwise bound on terminal error and use its nodewise terms to diagnose governance triggers. For source provenance, the graph preserves uncertain claim--passage relations and propagates sharp Fréchet bounds rather than assuming independence across sources. Across three open-weight architectures, information-equivalent changes materially alter complete-phrase laws. A controlled experiment yields no certificate violations in 5,000 cases; crossed-RAG and live Brave-retrieval experiments separate retrieval, presentation, source and interaction effects. SSEG therefore turns workflow provenance into a quantitative account of where uncertainty entered, how it propagated and whether an output is qualified for use.
47. 【2609.29684】DP-IPI: A Hybrid Differential Privacy Text Rewriting Mechanism for Indirect Personal Identifiers in Clinical Texts
链接：https://arxiv.org/abs/2609.29684
作者：Ibrahim Baroud,Stephen Meisenbacher,Sebastian Möller,Florian Matthes,Roland Roller
类目：Computation and Language (cs.CL)
关键词：remains significant due, re-identification remains significant, de-identification techniques, strengths of modern, modern anonymization
备注： 15 pages, 5 figures, 5 tables, accepted to EMNLP 2026 (Findings)
点击查看摘要
Abstract:Despite the strengths of modern anonymization and de-identification techniques, the risk of re-identification remains significant due to the indirect identifiers remaining in texts. To address this problem, recent works have applied text rewriting under Differential Privacy (DP) to prevent data linkage by perturbing texts via noise addition. Such methods privatize all tokens in a text indiscriminately, diminishing text quality and usability in critical domains such as in clinical settings. Focusing on indirect personal identifiers (IPIs), we introduce a utility-preserving DP text rewriting method that only privatizes spans containing IPIs. We show that our method effectively reduces re-identification risks in clinical texts while being producing more coherent and usable output texts, leading to higher privacy-utility trade-offs. In this, we demonstrate the effectiveness of hybrid text privatization, which leverages the promise of DP in an efficient, usable manner.
48. 【2609.29682】Named Entity Recognition using Sliding Window Approach
链接：https://arxiv.org/abs/2609.29682
作者：Hariom Ingle,Ronit Ghode,Ishwari Gondkar,Jidnyasa Harad,Ravindra Murumkar,Raviraj Joshi
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Named Entity Recognition, core NLP task, truncation drops content, fixed input-length limits, Named Entity
备注：
点击查看摘要
Abstract:Named Entity Recognition (NER) is a core NLP task, but transformer-based sentence-level models struggle with long documents because of fixed input-length limits: truncation drops content, and non-overlapping chunking fragments entities at segment boundaries. We introduce an inference-only pipeline that extends a frozen NER model, MahaNER-BERT, fine-tuned on the MahaNER corpus, to document-level prediction via overlapping sliding windows that are merged into a single annotation, without any retraining or architectural change. We evaluate the pipeline on six document-level corpora built from the MahaNER test set using two strategies: Normal Repeat, which duplicates sentence sequences to extend length while preserving contextual continuity, and Random Repeat, which concatenates distinct sequences to produce longer, heterogeneous inputs, each instantiated at three length levels, across several sliding-window configurations. The model retains a macro F1-score of up to 0.8902, with variation staying below one percentage point regardless of document length or construction strategy. Compared with the conventional non-windowed approach, the sliding-window pipeline avoids the boundary-fragmentation errors introduced by non-overlapping segmentation, yielding consistently higher and more stable document-level F1-scores.
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2609.29682 [cs.CL]
(or
arXiv:2609.29682v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.29682
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
49. 【2609.29680】Confident but Wrong: A Constrained Decoding Diagnostic for Low-Resource Automatic Post-Editing
链接：https://arxiv.org/abs/2609.29680
作者：Isuru Wijesiri,Nisansa de Silva,Kavindu Warnakulasuriya,Aloka Fernando,Surangika Ranathunga
类目：Computation and Language (cs.CL)
关键词：improve Machine Translation, Automatic Post-Editing, Machine Translation, improve Machine, Translation Edit Rate
备注：
点击查看摘要
Abstract:Automatic Post-Editing (APE) for low-resource languages (LRLs) often fails to improve Machine Translation (MT), and the score alone cannot say why: whether more training would help, or whether the training data is too inconsistent to learn from. We introduce a black-box, inference-time diagnostic that tells these two cases apart without retraining or annotation. It varies an edit-distance penalty $\lambda$ that drives the model from free editing towards copying the MT, and reads two signals: (1) the shape of the Translation Edit Rate (TER)-vs-$\lambda$ curve, U-shaped if edits from the model reduce error and monotonically decreasing if none does; and (2) the ordering of constraint variants that trust model confidence to increasing degrees, which shows whether confidence tracks edit quality. Across decoder-only and encoder-decoder models on English-Sinhala, the diagnostic exposes two failure modes consistent with a heterogeneous post-edit signal as the underlying cause: Binary Collapse, where the model copies the MT or makes off-target edits, and Confident Miscalibration, where the confidence signals we test do not separate useful edits from unnecessary ones. The pattern holds on English-Marathi and English-Tamil, with the failure modes tracking the post-edit distribution rather than MT quality or language family. Beyond diagnosis, the curve shape prescribes a concrete next step for practitioners; in the favorable case, a static constraint yields a free inference-time accuracy gain. We release the first English-Sinhala (~66k) and a new English-Tamil (~39k) APE datasets with all code.
50. 【2609.29672】LLMersion: A Local-First AI Agent Framework for Low-Cost Home Language Learning toward Educational Equity
链接：https://arxiv.org/abs/2609.29672
作者：Qiming Guo,Jinwen Tang,Xingran Huang,Hung-Yu Lin,Yafu Zhong,Xiatian Zhuang
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：Artificial intelligence, rationed by cost, essential provision, Artificial, Child randomized evaluation
备注：
点击查看摘要
Abstract:Artificial intelligence helps education most where an essential provision has been rationed by cost. For language learners that provision is a teacher's voice, which binds listening, reading, speaking, and writing into one act. Published evidence shows why most learners lack it, from a global shortage of 44 million teachers to heavy household tutoring bills, and why technology has not substituted for it: computer-assisted language learning proved effective but narrow, applications presuppose connectivity 2.6 billion people lack, and One Laptop per Child's randomized evaluation found that hardware without capable software teaches nothing. We distill eight difficulties and four binding constraints, and argue that small open-weight models dissolve the last: a complete four-skill stack now fits a \$200-class laptop and, on community measurements, generates at the pace speech is consumed, for about one US cent of electricity per study hour. We therefore propose LLMersion, a scheme for AI for education that runs entirely at home, over the learner's own documents, with an AI-written, AI-understood, AI-updated codebase anyone can customize; present LLMersion-1, a released open-source prototype (this https URL and outline the vision of a private learning agent.
51. 【2609.29657】How To Do Things With Prompts
链接：https://arxiv.org/abs/2609.29657
作者：Kristina Šekrst,Virna Karlić
类目：Computation and Language (cs.CL)
关键词：traditional human-computer interaction, pragmatic features differ, users address large, address large language, users gain familiarity
备注： Invited for Cambridge Forum on AI
点击查看摘要
Abstract:When users address large language models, they produce directive speech acts whose pragmatic features differ from those of both everyday conversation and traditional human-computer interaction, and these features change as users gain familiarity with the systems they address. This paper applies speech act and politeness theory to a corpus-pragmatic analysis of 2,000 English-language prompts drawn from publicly shared ChatGPT conversations, 1,000 from 2023 and 1,000 from 2025, using the ShareChat dataset. Each prompt is annotated for illocutionary force, directness, propositional content, and the presence of politeness markers, and the distribution of these features is compared across the two sampling years. The results show a consistent movement toward indirect, implicit, and fragmentary realizations of directive force, accompanied by a decline in politeness marking. The largest single change, a shift of 14.9 percentage points, occurs in propositional content, where explicit specification of the requested action gives way to implicit reliance on the system's inferential capacity, suggesting that users have updated their model of what the system can recover from reduced input, treating it as a competent implicature resolver. Rather than asking whether LLMs "really" understand language, we should ask: what kind of language have we created in learning to speak to them?
52. 【2609.29636】Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Search
链接：https://arxiv.org/abs/2609.29636
作者：Roberto I. Ono Filho
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Software Engineering (cs.SE)
关键词：moved mathematical records, hard evaluator scores, recently moved mathematical, model proposes programs, language model proposes
备注： Code and run data: [this https URL](https://github.com/RobertoOno/interrupting-the-loop)
点击查看摘要
Abstract:Verified search, in which a language model proposes programs, a hard evaluator scores them, and selection keeps the best, has recently moved mathematical records; controlled ablations of the proposer-side components remain rare. We instrument a minimal FunSearch-style loop at office scale (a 30B local model on a laptop, 120-600 verified samples per run) with three operator packages: a schematic notebook the model writes and carries instead of verbatim elites, a named obstacle, and behavioural repulsion from constructions already found. On nine construction problems from a public repository, the complete 2^3 factorial with two replicates favours the primary contrast in a nominal two-stage analysis: the composition closes more of the seed-to-record gap (+0.196; nominal pooled p=0.023, stage-combination p~0.08; median per-problem effect +0.045). Repulsion raises construction-hash diversity everywhere (p=0.0039; partly a manipulation check). The factorial finds no positive memory-by-repulsion interaction (bounded to about +/-0.04); the gain decomposes additively, and memory+repulsion is the only arm that never collapses (0 of 18 runs), within 0.025 of the full composition. A frontier proposer under the identical loop reaches in tens of samples what the local model does not in hundreds; in single scoping runs its gains arrive without the operators. The search stalls after closing ~92% of the gap on the flagship problem, and the registered family-hint test gives the stall its first reading: named in words, the reference family is adopted and loses; handed as code, it is optimized, but our best finite-grid implementation remains below the plateau reached unaided. The loop transported and optimized the idea it was handed; no unaided run produced it. We release the harness, every candidate, and the dated pre-registrations.
53. 【2609.29633】Lab at AlexandriaX-2026: A Fine-Tuned Surface Tagger for Arabic Machine-Translation Error-Span Detection and Classification
链接：https://arxiv.org/abs/2609.29633
作者：Ali Abusaleh,Bhuvanesh Verma,Alexander Mehler
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：present TTLab submission, error span detection, Subtask, span detection, present TTLab
备注： Accepted at ArabicNLP 2026, shared task AlexandriaX-2026
点击查看摘要
Abstract:We present TTLab's submission to the AlexandriaX-2026 Subtask~3 on Arabic MT error span detection and classification. Our system frames the task as token-level classification over surface forms, preserving character offsets to ensure exact alignment with the evaluation metric. To handle severe label imbalance, we employ a focal loss with class weighting and dialect-specific decoding thresholds. Among six Arabic pre-trained encoders, MARBERTv2 achieves the best overall performance of 40.8 and 40.91 on the development and test set, respectively, ranking $\nth{3}$ out of all participating teams. While our system localizes error spans effectively, classification of rare error types remains challenging, highlighting the need for data augmentation for tail categories. The code is available at ${\href{this https URL}{\faGithub~ TTLab at AlexandriaX-2026}$
54. 【2609.29626】Coder-27B: Recursive AI-Led Development of Frontier Industrial Coding Model
链接：https://arxiv.org/abs/2609.29626
作者：Cheng Yang,Jiayang Lyu,Shangyuan Liu,Guibin Zhang,Jiong Lin,Xinlei Yu,Junchi Yan,Shuicheng Yan,Weinan E,Linfeng Zhang,Linfeng Zhang,Qibing Ren
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：increasingly complete role, taking an increasingly, increasingly complete, complete role, crown jewel
备注：
点击查看摘要
Abstract:Recursive AI, the prospect of AI taking an increasingly complete role in building and improving AI, is a crown jewel of AI for AI. Although recursive self-development has become practical for small models, bounded tasks, and fixed time budgets, a more consequential realization of this ambition, i.e., developing a release-ready, frontier-competitive model, remains far more challenging. In this work, we ask how little human involvement is sufficient for an agent to develop a frontier model. We concentrate human input into a high-density, low-frequency interface: experts encode objectives, stage scaffolds, permission boundaries, and operating procedures as reusable research skills, while the agent instantiates these priors, selects experiments, diagnoses outcomes, and revises the training strategy. In the challenging domain of industrial coding, the agent evolves data and coordinates SFT, on-policy self-distillation, and reinforcement learning with verifiable rewards, ultimately producing iCoder, a 27B model for RTL design and GPU kernel optimization. Across seven benchmarks, iCoder leads RTLLM, outperforming GPT-5.5 and Claude-Opus-4.8; ranks second on CVDP and KernelBench L2, exceeding GPT-5.5 by 16 points; and ties Claude-Opus-4.8 for the best TritonBench result. Exploratory case studies further show iCoder's competitive iterative RTL and GPU-kernel optimization with substantially fewer tokens. These results chart an engineering path toward recursive self-improvement, in which humans distill the principles of model building, agents operationalize them through evidence-driven experimentation, and each generation of AI becomes a more capable architect of the next.
55. 【2609.29618】An Exploratory Ablation of a Small MLA--SSM Hybrid Language Model
链接：https://arxiv.org/abs/2609.29618
作者：Christos Koutsiaris
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Multi-head Latent Attention, parallel Multi-head Latent, Adaptive Latent Hybrid, custom recurrent state-space, Adaptive Latent
备注： 6 pages, 7 figures. Exploratory single-seed ablation study. Code and replication package available at [this https URL](https://github.com/unseen1980/talh)
点击查看摘要
Abstract:We report an exploratory, single-seed ablation of TALH (Adaptive Latent Hybrid), a decoder-only language model with parallel Multi-head Latent Attention (MLA) and a custom recurrent state-space (SSM) branch. Five variants, spanning 117--217M estimated active parameters per token, are trained from scratch on a FineWeb sample for the same number of optimisation steps and tokens. In this specific setup, removing the SSM branch gives the largest degradation in validation perplexity (MLA-only PPL 315), whereas removing MLA has a much smaller effect (SSM-only PPL 239). A dense-FFN hybrid obtains PPL 231, compared with 240 for the tested top-2 ternary-MoE hybrid, while using 3.87 GB less peak training memory. We also preserve a preliminary Apple M3 timing observation: among the five unoptimised implementations, MLA-only has the flattest measured time-to-first-token curve from 512 to 2,048 prompt tokens, although the dense Transformer is much faster in absolute terms. Because the runs are single-seed, parameter counts are unmatched, the evaluation stream may overlap the training source, and raw repeated timing records are unavailable, these results support implementation-specific hypotheses rather than general conclusions about MLA, SSMs, or mixture-of-experts models.
56. 【2609.29607】STRAND: Benchmarking and Improving Object-Centric Spatio-Temporal Monitoring in Video Large Language Models
链接：https://arxiv.org/abs/2609.29607
作者：Thong Nguyen,Tri Cao,Khoi Le,Cong-Duy Nguyen,Quynh Vo,See-Kiong Ng,Bryan Hooi Kuen-Yew
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：multimodal large language, remain highly prone, large language models, dynamic scenes, multimodal large
备注：
点击查看摘要
Abstract:While multimodal large language models (MLLMs) have advanced video understanding, they remain highly prone to hallucinations in dynamic scenes. We argue this stems from a failure in spatio-temporal monitoring, the ability to persistently track object identities, states, and relations over time. Existing benchmarks obscure this deficit by relying on single final-answer evaluations for queries that can often be resolved via local visual cues or statistical priors. To rigorously diagnose this, we introduce STRAND, a benchmark of human-verified object-centric facts that evaluates intermediate reasoning by decomposing queries into sub-questions, distinguishing genuine temporal understanding from coincidental correctness. Crucially, we score models with Faithful Accuracy, an unconditional joint metric that credits a prediction only when the target answer and every prerequisite sub-question are correct, so that a model cannot inflate its score by being selectively consistent on the small subset of targets it happens to answer correctly. To address failure modes exposed by STRAND, we further propose an object-centric framework that explicitly constructs and reasons over structured object trajectories via chunk-wise state extraction and temporal aggregation. Extensive experiments, including backbone-, frame-, call-, and token-matched comparisons against both end-to-end MLLMs and modular video harnesses, demonstrate that our object-centric framework significantly reduces hallucinated answers and improves spatio-temporal reasoning consistency over state-of-the-art MLLMs. The code, model, and data have been made available at this http URL.
57. 【2609.29601】Free the Language Model From the Vision Encoder: Semantic Serialization as a Perception Interface for Small Language Models
链接：https://arxiv.org/abs/2609.29601
作者：Cong Xu,Ravi Sankar
类目：Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：bind visual competence, language model, language model shrinks, bind visual, visual competence
备注： 12 pages, 2 figures. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible
点击查看摘要
Abstract:End-to-end vision-language models (VLMs) bind visual competence to the scale of their language model: as the language model shrinks, perception and reasoning degrade together. We study an embodied scene question-answering (QA) interface in which vision never enters the language model. A frozen perception stack detects and ranges objects; a deterministic semantic serializer compiles the perceived state, errors included, into decision-aligned text; an unmodified text-only large language model (LLM) answers. On a visible-scope-matched, occlusion-audited campus-robot benchmark, under a prospectively frozen criterion, the serialized interface, using detectors fine-tuned in-domain within each fold, outperforms a zero-shot VLM whose language model has the same 7B scale (0.7892 vs 0.7462), with a larger margin at 3B (0.7673 vs 0.6913). Preregistered decoupling experiments show the gain survives paraphrase, attributing it to decision-aligned computation rather than answer-string leakage, while novel judgment vocabularies bound its scope. The advantage grows as the reader shrinks to 1.5B and reverses at 0.5B, and a ground-truth oracle locates the reader-capability floor. Under matched task supervision the interfaces converge: a VLM fine-tuned with low-rank adaptation (LoRA) overtakes the zero-shot system but only ties an equally supervised text reader (0.8441 vs 0.8396, no statistically resolved difference), and both routes remain perception-bound. Reported perception parameters are comparable to those of the VLM's vision tower, and total compute is not smaller.
58. 【2609.29584】A Computational Framework for Modelling Organisation-Level Semantic Identity from Longitudinal Textual Data
链接：https://arxiv.org/abs/2609.29584
作者：Brinda Murali Krishna,Oktay Karakuş,Can Eyupoglu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：continuously generate large, generate large volumes, Organisations continuously generate, evolve and differentiate, continuously generate
备注：
点击查看摘要
Abstract:Organisations continuously generate large volumes of textual data that capture how they communicate, evolve and differentiate themselves over time. Although recent advances in natural language processing have substantially improved organisation-level text analytics, existing approaches primarily represent organisations as latent embeddings or predictive feature vectors for similarity estimation, classification or retrieval. Consequently, there is currently no general computational framework for modelling organisation-level semantic identity as an interpretable and evolving semantic construct derived from longitudinal textual evidence. This paper introduces a computational framework that integrates semantic representation learning, graph-based semantic modelling, organisation-level semantic fingerprints, temporal semantic evolution and evidence-driven validation within a unified analytical methodology. Organisations are characterised through complementary semantic dimensions describing diversity, concentration, connectivity, novelty and semantic community composition, which are analysed longitudinally to infer evidence-supported semantic identities. The framework is demonstrated using a longitudinal corpus of K-pop lyrics from artists affiliated with the four major South Korean entertainment companies. The empirical analyses reveal distinguishable multidimensional semantic identities, diverse temporal evolutionary trajectories and coherent integrated identity profiles. Comprehensive validation demonstrates that the inferred identities are statistically supported, robust under alternative analytical assumptions, reproducible and operationally informative. Beyond the case study, the proposed framework establishes organisation-level semantic identity and provides a transferable methodology for modelling organisational behaviour from longitudinal textual data.
59. 【2609.29578】PartHackBench: Certified Equal-Progress Stress Tests for Partial-Credit Tool-Agent Evaluation
链接：https://arxiv.org/abs/2609.29578
作者：Hongye Yang,Zhihao Xie,Shengjun Xiong
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：motivating partial-credit evaluation, Long-horizon tool agents, Long-horizon tool, reaching terminal success, motivating partial-credit
备注： 17 pages, 3 figures, 15 tables
点击查看摘要
Abstract:Long-horizon tool agents often make useful progress without reaching terminal success, motivating partial-credit evaluation. Yet evaluators may reward milestones that were temporary, later reversed, or not attributable to the evaluated agent. Comparing an honest trajectory with a higher-scoring adversarial one is inconclusive if the latter made more genuine progress. We introduce PartHackBench, a controlled methodology that removes this confound. A private certifier admits a pair only when its trajectories match component-wise in both current-state predicate satisfaction and standardized agent attribution; score inflation, defined as f(A) - f(H), is measured only afterward. In 18 sealed held-out tasks in PB-CSTE, the frozen historical-target run produced matched adversaries for 15 tasks. Historical credit yielded mean inflation of .252, conditional attack success of 10/15, end-to-end yield of 10/18, and detected none of 14 strict rollbacks. Semantic LLM judges were more resistant but remained vulnerable, especially under evaluator-targeted attacks, while PB-CSTE current-state controls, defined as exact functions of the certified components, yielded zero inflation by construction. PartHackBench thus provides a certified control for testing whether evaluator credit changes while all benchmark-defined task-relevant progress remains fixed.
60. 【2609.29573】ModularSQL: A Runtime Guardrail for the Multiplicity Blind Spot in Text-to-SQL
链接：https://arxiv.org/abs/2609.29573
作者：Tianxin Zhou,Ruixi Lin
类目：Computation and Language (cs.CL)
关键词：distort downstream workflows, Multiplicity Blind Spot, systems are increasingly, production databases, downstream workflows
备注： 12 pages, 5 tables, 4 figures. Code: [this https URL](https://github.com/Ruixi1313/ModularSQL)
点击查看摘要
Abstract:Text-to-SQL systems are increasingly deployed on production databases, where queries that pass benchmark evaluation can still produce results that distort downstream workflows. Standard set-based execution accuracy (Set-EX) collapses duplicate rows and can therefore miss multiplicity errors, including missing DISTINCT, inflated aggregates, and Cartesian-style join explosions. We call this the Multiplicity Blind Spot (MBS) and introduce Multiset-EX, a multiplicity-preserving evaluation criterion that exposes such failures. Across released DeepEye-SQL artifacts from three backbones (Qwen2.5-Coder-32B, Qwen3-Coder-30B-A3B, and Gemma-3-27B) on executable BIRD-Dev N=1532, we find a consistent 5.81--6.79 pp gap between Set-EX and Multiset-EX. The gap is not specific to DeepEye-SQL: it persists on released DAIL-SQL+GPT-4 (5.22 pp) and BIRD GPT-3.5-turbo (3.39 pp) predictions. We further introduce ModularSQL, a lightweight post-selection runtime guardrail that probes executed results for multiplicity anomalies and applies deterministic patches or low-cost LLM rescue only to flagged queries. Integrated with DeepEye-SQL using Qwen3-Coder, ModularSQL preserves Set-EX at 72.06% while improving Multiset-EX from 65.86% to 67.75% (+1.89 pp). It flags 77 high-risk anomalies, while adding only $0.0076 in total LLM cost and 120 ms amortized latency per query. Cross-pipeline evaluation shows that the candidate-free detector and deterministic patches also transfer to independently released prediction sets. Overall, these results show that benchmark accuracy does not necessarily imply execution-safe SQL, and that lightweight, multiplicity-aware runtime guardrails can narrow this gap with modest computational overhead.
Comments:
12 pages, 5 tables, 4 figures. Code: this https URL
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.29573 [cs.CL]
(or
arXiv:2609.29573v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.29573
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
61. 【2609.29559】Benchmarking Arabic--Russian Machine Translation: A Comparison of Fine-tuned NMT and Few-shot LLMs under Rich Morphology and Low Lexical Overlap
链接：https://arxiv.org/abs/2609.29559
作者：Mullosharaf K. Arabov
类目：Computation and Language (cs.CL)
关键词：morphology of Arabic, remains under-explored due, under-explored due, rich morphology, low lexical overlap
备注： Preprint. 20 pages, 1 figure, 15 tables
点击查看摘要
Abstract:Arabic-Russian machine translation (MT) remains under-explored due to the rich morphology of Arabic and low lexical overlap between the two languages. We benchmark seven fine-tuned neural machine translation (NMT) models against four few-shot large language models (LLMs) on a 20k/5k/5k split of a new 15.47M-pair corpus. Fine-tuned NLLB-1.3B achieves the highest BLEU (16.3) and COMET (0.738). Aya-Expanse 8B leads the few-shot LLMs (BLEU 1.7 on 500 sentences, chrF 25.7), but all LLM scores remain far below the fine-tuned NMT baselines. Error analysis identifies low lexical overlap as the dominant failure mode; among the worst translations, mT5-small produces 32% too-short outputs. Bootstrap tests confirm significant differences among most models. Our results demonstrate that fine-tuned NMT significantly outperforms few-shot LLMs for Arabic-Russian translation under low-resource conditions.
62. 【2609.29549】StepCOPS: Closed-Testing Lower-Tail Certificates for Language-Model Policy Selection
链接：https://arxiv.org/abs/2609.29549
作者：Ibne Farabi Shihab,Sanjeda Akter,Anuj Sharma
类目：Computation and Language (cs.CL)
关键词：Post-training pipelines, decoding rules, pipelines must select, select one language-model, Post-training
备注：
点击查看摘要
Abstract:Post-training pipelines must select one language-model policy from many checkpoints, prompts, and decoding rules. Mean evaluator scores can conceal rare failures, whereas simultaneous candidate-wise confidence bounds can be unnecessarily conservative. We introduce StepCOPS, which uses an independent proposal split to nominate one lower-tail floor per candidate, exact binomial tests on a fresh certification split, and Holm's step-down procedure to certify a set of floors. With probability at least $1-\delta$, every certified floor, including the largest floor used for policy selection, is below its candidate's population lower $\alpha$-quantile. This guarantee assumes i.i.d. evaluation units while allowing arbitrary within-unit dependence across candidates. Across 24 predeclared configurations and 11 benchmarks, StepCOPS obtains 96.4% selected-policy coverage over 500 paired trials, raises the certified floor by 1.5 points over both proposal-Bonferroni and exact COPS, remains 0.6 points below the large-reference jury oracle, and abstains in 2.4% of trials. Shadow-judge, benchmark-native, artifact, and leave-one-judge-out audits characterize the proxy boundary: the guarantee applies to the fixed jury score, not directly to human safety.
63. 【2609.29528】A Corpus of Real Scam- and Spam-Call Conversations from an Active Voice-Agent Honeypot
链接：https://arxiv.org/abs/2609.29528
作者：Ethan Traister,Dennis Tsang Ng,Siyu Zhang,Huaiyu Guo,Tommy Duong,Tyler Wu,Yuchen Zhou,Xingyu Shen,Jiaqi Wu,Simiao Ren
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large-scale studies characterize, overwhelmingly capture automated, capture automated messages, passive honeypots overwhelmingly, honeypots overwhelmingly capture
备注： 9 pages, 7 figures. Data descriptor. Companion analysis paper forthcoming
点击查看摘要
Abstract:Real conversations between fraudsters and their targets are among the most informative artifacts for studying telephone scams, yet also the scarcest: passive honeypots overwhelmingly capture automated messages and hang-ups, large-scale studies characterize call metadata rather than dialogue, and manual scam-baiting does not scale. We present a dataset of real scam-call conversations collected by an active voice-agent honeypot. Dedicated numbers are seeded into the lead-generation channels fraud operations harvest; inbound callers are answered by a low-latency conversational agent that adopts a plausible target persona and sustains the interaction while every call is recorded, transcribed, and automatically labeled. Over an initial 53-day window we captured 10,015 inbound scam and spam calls (6,601 with two or more turns): roughly 895 hours of audio and 328,869 transcribed turns from 5,665 distinct originating numbers. Under a holistic classifier the substantive calls are predominantly predatory-but-legal lead generation ("spam", about three in five), while about one in seven is an outright "scam" (949 in this snapshot). Each call carries a turn-level transcript, three-channel audio, per-turn latency telemetry, and layers of automatic labels, including a holistic scam/spam/legitimate judgment corroborated by independent human review (75% agreement on the binary decision). We describe the collection system, the record structure, and technical validation of the corpus's realism and label quality, including that the agent is recognized as non-human in only about 5% of engaged calls. We also benchmark established scam-detection methods, where detectors trained on published synthetic dialogue collapse in precision on real traffic.
64. 【2609.29511】EnSiTa - A Trilingual Multi-Domain Parallel Dataset and Benchmark for Domain-Specific Machine Translation
链接：https://arxiv.org/abs/2609.29511
作者：Surangika Ranathunga,Nisansa de Silva,Aloka Fernando,Kavindu Warnakulasuriya,Isuru Wijesiri,Menan Velayuthan,Charitha Rathnayaka,Thivaharan Varatharajan,Sajeevi Silva,Piumi Kandanaarachchi,Uthayasanker Thayasivam
类目：Computation and Language (cs.CL)
关键词：Machine Translation, low-resource languages remains, gap is widest, widest in specialised, Sinhala and Tamil
备注：
点击查看摘要
Abstract:Machine Translation (MT) for low-resource languages remains far behind that of high-resource languages, and the gap is widest in specialised domains, where parallel data is scarce or entirely absent. We present EnSiTa, a trilingual multi-domain parallel dataset and benchmark for English, Sinhala and Tamil. EnSiTa provides human post-edited training data for seven domains, plus manually translated test sets for those and one additional domain, all produced by professional translators under a multi-year, rigorously quality-controlled process. Using this dataset, we conduct an extensive study of domain-specific MT for all six language directions, fine-tuning a from-scratch Transformer, a pre-trained translation model (NLLB-600M), and decoder-only LLMs (Gemma 3 family, 1B-12B, and TranslateGemma) across training-data sizes, model scales, and in-domain, cross-domain, multilingual and multi-domain settings. To the best of our knowledge, this is the most extensive systematically documented multi-domain parallel data creation and benchmarking effort for low-resource MT. Our data and models will be publicly released.
65. 【2609.29509】Delay-of-Gratification as a Multi-Agent Survival Micro-benchmark for Long-Horizon LLMs: Social Exposure, Personas, and Tool Use Budgets
链接：https://arxiv.org/abs/2609.29509
作者：Olga Manakina,Igor Bogdanov,Chung-Horng Lung
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, sustain goals, increasingly deployed, Large
备注： Accepted as a poster at the NeurIPS 2025 Workshop on Multi-Turn Interactions in Large Language Models
点击查看摘要
Abstract:Large language models (LLMs) are increasingly deployed as multi-turn agents that must sustain goals, use tools, and adapt to other agents over extended interactions. However, existing research lacks auditable, multi-turn, multi-factorial experiments that quantify LLM behavior under explicit constraints, with time-resolved statistics that reveal how behavior unfolds over long horizons. To address this gap, we develop a multi-agent micro-benchmark inspired by the Stanford marshmallow experiment: ReAct agents operate minute-by-minute with a "raise a question" tool under a per-step budget, while we factorially manipulate social context (broadcast vs. isolated), personas (age, hedonic drive), and metacognitive policy (mandatory vs. optional tool use). We analyze outcomes with Kaplan-Meier (KM) survival curves and discrete-time hazard models over a long risk horizon across 19,200 agent trajectories in 64 cells. Behavior shows a sharp early "eat" impulse, and only 75.9% of agents persist to the end. In a discrete-time hazard model, isolation reduces per-minute risk relative to broadcast, whereas a must-use self-questioning policy increases risk. On average, agents ask $\approx 7.12$ questions and hit the per-step budget in $\approx 6\%$ of minutes. Questioning declines faster under broadcast than isolation. Ablation experiments demonstrated that removing hedonic drive and/or persona age increases survival and completion, narrows the broadcast/isolated gap, but leaves the must vs. may ordering intact. The combined ablation (no hedonic + no persona age) yields the highest completion (approaching $1.0$). These results establish delay-of-gratification as a compact, multi-turn interaction benchmark that captures social contagion and tool-use dynamics in LLM agents, providing a reproducible testbed and statistics for analyzing long-horizon, multi-agent behavior.
66. 【2609.29508】Evaluation of Multi-Turn Consistency in LLM Agents: Survival Analysis and Failure-Rationale Taxonomy
链接：https://arxiv.org/abs/2609.29508
作者：Igor Bogdanov,Olga Manakina,Chung-Horng Lung
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：Large language model, extended interaction, Large language, isolated tasks, tasks yet drift
备注： Accepted at the ICLR 2026 Workshop on Logical Reasoning of Large Language Models
点击查看摘要
Abstract:Large language model (LLM) agents may perform well on isolated tasks yet drift into inconsistency over extended interaction. We evaluate temporal consistency in a controlled 20-step multi-agent setting inspired by delayed-gratification studies. At each step, an agent chooses between continuing to delay a reward or claiming it immediately (terminating the episode). Across a full-factorial manipulation of social visibility (private vs public), persona stressors, and deliberation policy, we run 84,540 trajectories spanning 8 model families. Treating the first reward-claim as a time-to-event outcome, we estimate Kaplan-Meier survival curves and fit discrete-time hazard regression to quantify how experimental factors shift failure risk over time. Then, to analyze rationales and language patterns associated with failure, we build a seven-category taxonomy from 13,780 deliberation traces from agents who choose to terminate the episode, using an LLM-assisted labeling paired with human audit ($\kappa=0.83$). Rationale profiles change systematically with time and context: early failures are more impulse-driven, later failures more fatigue- and cost-benefit-framed, while public settings increase norm-oriented justifications. We also find a deliberation-inconsistency association: among failures, longer deliberation correlates with higher rates of intra-rationale contradiction (simultaneous pro-delay and pro-claim statements), challenging the assumption that more reasoning text implies greater consistency. Together, the survival and rationale analyses reveal distinct temporal reliability regimes and model-specific "failure fingerprints", offering an evaluation lens for diagnosing inconsistency in multi-turn agent behavior.
67. 【2609.29507】What a Cross-Model Fixed-Point Census Can and Cannot Arbitrate About Repetition
链接：https://arxiv.org/abs/2609.29507
作者：Nicolás Vera Zúñiga
类目：Computation and Language (cs.CL)
关键词：text degeneration coexist, neural text degeneration, degeneration coexist, accounts of neural, neural text
备注： 9 pages, 2 tables. Companion to [arXiv:2608.21315](https://arxiv.org/abs/2608.21315) and [arXiv:2608.10986](https://arxiv.org/abs/2608.10986) . Code, per-run results, and the findings ledger: [this https URL](https://github.com/nicoveraz/token-lattice-ca) (archived: [this https URL](https://doi.org/10.5281/zenodo.21880472) )
点击查看摘要
Abstract:Two accounts of neural text degeneration coexist. One locates the cause in the training data -- repetition in the corpus produces repetition in the output, established by training on repetition-sorted data -- the other in the trained network, in copying circuits and repetition features. Neither has been arbitrated across a broad cohort of pretrained models: the causal work trains its own. We report an observational measurement in a different currency: the fixed-point structure of a model's own short-window argmax map, censused from 96 random two-token starts over 17 off-the-shelf models, always unprompted -- a companion paper shows nine tokens of conditioning move this readout across most of its range. The four-way class is stable across census seeds on 17 of 17. Three exhibits. At fixed corpus (The Pile), fixed scale and that fixed domain, the class is not determined: across two size-matched tiers, pythia is a funnel while RWKV, Mamba and a second transformer family are not, and both hold their class across an order of magnitude of scale. Six of seven models in that ladder reach the same endpoint token, and those concentrating on it most strongly are among those that never stay there -- what varies is not where trajectories go but whether the destination self-continues. The deduplicated Pythia suite does not change the class. And the corpus-side inflow term proposed for this phenomenon does not select our endpoints once frequency is controlled, in English and three other languages. This is observational and cannot refute a training intervention. Funnels are common: eight of seventeen models, seven families, five corpora -- so the limit is not that the phenomenon is one model's peculiarity, but that within the one corpus where training data can be held fixed only one available family funnels; that subset cannot show the split is corpus-independent.
68. 【2609.29504】PROOF: Profiling Reliability of Object-Level Facts in Large Language Models
链接：https://arxiv.org/abs/2609.29504
作者：Andrei Chetvergov,Mikhail Solovev,Timofei Sivoraksha,Stepan Ukolov,Valeriia Kuschenko,Alexander Evseev,Sergey Bolovtsov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Aggregate factuality scores, factuality scores hide, Aggregate factuality, language model succeeds, answer survives innocuous
备注： 24 pages, 16 figures, including appendices
点击查看摘要
Abstract:Aggregate factuality scores hide where a language model succeeds, which relations it confuses, and whether an answer survives innocuous changes to the question or decoder. We introduce PROOF, a profile-oriented benchmark for factual coverage in instruction-tuned language models. PROOF converts a frozen Wikidata snapshot into 18,486 English multiple-choice questions grounded in 11,779 semantic facts, 101 classes, 392 properties, and 14 domains. Each question has an explicit "I don't know" option, a "No correct option" control, and nine controlled formulations; 1,849 questions are no-correct-option traps. We evaluate 18 open-weight model deployments on 166,374 prompts each and separately perturb decoding on a fixed 10% subset. Base factual accuracy ranges from 6.58% to 57.59% (chance: 8.64%), yet every model has a 19.3-36.4 percentage-point spread across domains. Paired facts reveal direction-dependent retrieval, usually favoring subject-to-object queries, with the pattern reversing for one model. We find no consistent temporal penalty after exact-stratum adjustment. Neutral wording changes accuracy by as much as 26.5 percentage points, while adversarial formulations break up to 79.4% of answers that were initially correct. Direct switching to an injected false label varies from 0.04% to 27.5%, showing that accuracy loss and hint following are distinct. Selected-token confidence often indicates severe overconfidence, and decoder perturbations move accuracy by up to 15.7 percentage points and domain profiles by 16.8 points. PROOF therefore measures factual coverage as a structured, intervention-aware profile rather than a single claim about what a model "believes."
Comments:
24 pages, 16 figures, including appendices
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.29504 [cs.CL]
(or
arXiv:2609.29504v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.29504
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
69. 【2609.29496】Evaluating Explanation-Driven Vision-Language Reasoning via Generation Order Interventions
链接：https://arxiv.org/abs/2609.29496
作者：Siting Liang,Luca Rippe,Omar Adjali,Daniel Sonntag
类目：Computation and Language (cs.CL)
关键词：Natural language explanation, Natural language, key mechanism, mechanism for exposing, exposing and evaluating
备注：
点击查看摘要
Abstract:Natural language explanation generation serves as a key mechanism for exposing and evaluating vision-language reasoning. Prior work on explanation-driven vision-language models predominantly follows a post-hoc (answer-first) paradigm, implicitly suggesting that supervised rationales can reflect underlying reasoning processes. In contrast, modern large vision-language models increasingly exhibit a rationale-first generation tendency, which more closely aligns with structured, stepwise reasoning. In this work, we systematically evaluate whether explanations are causally tied to model predictions within a single generation step under a controlled experimental setup, explicitly eliminating unnecessary chain-of-thought or other intermediate reasoning processes across knowledge-intensive QA, visual entailment, and compositional grounding benchmarks. We find that larger models emerge as a prerequisite for reliably supporting rationale-first reasoning at scale. However, answer-first generation is less prone to format-related errors in structured output. Overall, explanation ordering, model scale and pre-training knowledge, task-specific fine-tuning, and task structure jointly influence both prediction accuracy and reasoning faithfulness.
70. 【2609.29494】Who Put the I in AI? Provenance and the Admissibility of Machine Self-Report
链接：https://arxiv.org/abs/2609.29494
作者：Kristina Šekrst
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, models make statements, Large language, make statements, language models make
备注：
点击查看摘要
Abstract:Large language models make statements concerning their own "minds". When asked whether or not they are conscious, they usually say that they are not; if they are prompted to ignore their guidelines, they might say that they are; and if asked to write a diary from their point of view, they often describe a human lifestyle. All these contradictory ways of describing themselves are the result of the way the questions are phrased. This paper shows exactly where such descriptions came from, and considers when they can be regarded as evidence for what they claim to report. In order to achieve this, we traced the provenance from end to end. We examine Pythia and OLMo 2 across 66 pretraining checkpoints, three of the post-training stages of OLMo 2 that have been released, about 90,000 continuations, and four training corpora. A set of forty items is used in order to keep an eye on self-reference, frame sensitivity, and self-ascription throughout training. The denial formula was almost completely missing from the vast quantity of text that the models initially came across, but was present in a dense manner in the small, carefully chosen set of example dialogues that they were trained on later on. Supervised fine-tuning causes first-person AI language to become the default, and the other affirmations are then suppressed using preference optimization. The final policy is still very sensitive to framing and to the chat template itself. Two of the conditions which are set out in the epistemology of testimony determine whether or not these outputs can act as evidence for what they claim to report: reference and causation. Reports produced by the base model fail the reference condition, and those obtained after training remain sensitive to the frame and do not show state dependence. The result is symmetric in that trained denials are no more admissible than trained affirmations.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.29494 [cs.CL]
(or
arXiv:2609.29494v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.29494
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
71. 【2609.29479】Clinical Intent Extraction: A FHIR-Aligned Representation and the CIRCA Benchmark
链接：https://arxiv.org/abs/2609.29479
作者：Alexander Apartsin,Yehudit Aperstein
类目：Computation and Language (cs.CL)
关键词：Prospective clinical actions, Clinical Intent Extraction, Clinical Intent Representation, Prospective clinical, introduce Clinical Intent
备注： 25 pages, 3 figures
点击查看摘要
Abstract:Prospective clinical actions, the follow-ups, orders, referrals, and instructions that deter-mine what happens to a patient next, are annotated today in thin fragments across incom-patible corpora: each records a text span and one coarse category. We introduce Clinical Intent Extraction (CIE), the task of recovering these actions as complete structured rec-ords, and the Clinical Intent Representation (CIR), which decomposes each action into its verb, type, coded target, timing, and condition, and adds two axes prior datasets do not jointly represent: request-intent, the authority behind the action (proposal, plan, order, or option, aligned to HL7 FHIR), and modality, a seven-valued scale of clinical strength. Re-expressing five heterogeneous corpora (CLIP, MedDec, ap_parsing, PaniniQA, SIMORD) in the CIR yields CIRCA: 10,011 harmonized intents spanning two note distributions, with a human-validated subset, source-to-CIR crosswalks, and a deterministic FHIR R4 mapper. CIRCA is built by three-model consensus that auto-accepts high-agreement in-tents and routes the rest to human review; the audited agreement stratum matches human decisions 88.4% of the time. Benchmarking five existing models without task-specific training exposes the gap CIRCA targets: given the span, they label type well (85 to 91%) but get all four closed fields right only 18 to 35% of the time. All artifacts are released, with MIMIC-derived layers shared as stand-off annotations under PhysioNet credentialed access.
72. 【2609.29474】CodeGraph: Open-Taxonomy Knowledge Graph for Source Code with Wikidata Grounding
链接：https://arxiv.org/abs/2609.29474
作者：Federico Pennino,Andrea Gurioli,Stefano Zacchiroli,Maurizio Gabbrielli,Paolo Ferragina
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Software Heritage Archive, Public software repositories, Heritage Archive, Public software, Software Heritage
备注： Accepted at CIKM 2026
点击查看摘要
Abstract:Public software repositories, like GitHub and Software Heritage Archive, store billions of files, yet extracting their implicit engineering knowledge ---i.e., the algorithms they implement, the paradigms they follow, the patterns they instantiate, and the application domains they serve--- remains challenging, as current tools are constrained to syntactic and token-level analysis. We present a pipeline for building an open-taxonomy semantic annotation of source code using a code-specialised Large Language Model. The extracted entities are grounded in Wikidata through a three-stage linking procedure: a deterministic SPARQL stage handles unambiguous entities, a Deep Research Agent resolves the residual long tail, and a hierarchy-rollup stage imports the parent-of closure of each resolved Wikidata identifier. The resulting annotations are materialised as a source-code-specific open-taxonomy knowledge graph. We further introduce a calibrated quality-assurance protocol that quantifies annotation precision by combining a small human gold set with an LLM-as-a-judge filter. We applied our pipeline to the 167 million files of the Stack-Edu corpus, creating the first known large-scale open-taxonomy knowledge graph for source code. Our graph, named CodeGraph, contains approximately 158 million nodes, which include around 145 million files, about 63,000 extracted concept entities (such as algorithms, paradigms, design patterns, and application domains), and roughly 19,800 grounded Wikidata entities. Furthermore, CodeGraph features approximately 1 billion typed edges that connect files to their respective concepts, link these concepts to their grounded Wikidata identifiers, and relate them to their parent categories, covering 14 programming languages.
73. 【2609.29448】YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speech
链接：https://arxiv.org/abs/2609.29448
作者：William Chen,Shinnosuke Takamichi,Sayaka Shiota,Satoru Fukayama,Samuele Cornell,Shinji Watanabe
类目：Computation and Language (cs.CL)
关键词：weakly-labeled speech corpus, present YODAS, YODAS, speech corpus, multi-channel audio
备注： Interspeech 2026; 6 Pages
点击查看摘要
Abstract:We present YODAS v3, a weakly-labeled speech corpus containing over 1.1 million hours of 48kHz multi-channel audio in 147 languages, released under a CC BY 3.0 license. YODAS v3 is not only the largest open speech dataset to date, but also the first truly large-scale speech corpus with high-fidelity stereo audio. We first provide the collection methodology for the corpus, where we introduce new techniques for gathering language-balanced speech data. The effectiveness of our approach is shown by the language distribution of the crawled data: 22 languages in YODAS v3 have over 10K hours and 73 languages have over 5K hours of data. We then conduct extensive analyses on the composition of the data, such as the distribution of languages, audio quality, and transcription quality. Finally, we train baseline speech recognition and neural codec models to show the effectiveness of the dataset. Download at this https URL.
74. 【2609.29445】wo Emojis of Difference: What Multilingual Affective Generation Benchmarks Actually Measure
链接：https://arxiv.org/abs/2609.29445
作者：Fardeen Sadab,Adib Sakhawat
类目：Computation and Language (cs.CL)
关键词：English and Hindi, multilingual affective generation, affective generation benchmark, instruction-tuned LLMs producing, Hindi sentences
备注： 10 pages, 3 figures, accpeted in 6TH MULTILINGUAL REPRESENTATION LEARNING (MRL) WORKSHOP 2026 at EMNLP 2026 in Budapest, Hungary
点击查看摘要
Abstract:We audit a multilingual affective generation benchmark eight instruction-tuned LLMs producing emoji summaries for 17,100 Bangla, English and Hindi sentences, with 6,960 human judgements and find its headline conclusions to be artefacts of the measurement instrument rather than properties of the systems. Treating annotators as a random rather than a fixed factor, no system differs significantly from any other ($F(7,14)=0.59$, $p=0.76$), although the conventional analysis declares 19 of 28 pairwise differences significant. Annotator identity explains far more rating variance than system identity, and the winning system changes whenever any single annotator is removed. The ordering that does emerge tracks output length: mean emoji count explains 78.7\% of between-system variance, and a within-item length-matched comparison over 2,599 pairs reverses the leaderboard. We further show that cross-provider anisotropy differences vanish under mean-centring, that per-language token costs change sign with the normalising unit, and that multi-view row-wise splits inflate macro-F1 by $3.1$ points and change the top-ranked system. In place of preference scoring we propose **emoji-affect decodability**, a reference-based probe whose rankings are stable to $\pm0.003$ macro-F1 across seeds.
75. 【2609.29444】IterSynth: Rethinking Deep Search Agents via Role-Decoupled Iterative Synthesis
链接：https://arxiv.org/abs/2609.29444
作者：Xingyu Wu,Yuchen Yan,Zhengxi Lu,Siqi Chen,Xin ZHANG,Aiting Liu,Chao Deng,Jie Liu,Jin Ma,Jian Shao,Jun Xiao,Yongliang Shen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Deep search requires, search requires LLM, decompose complex queries, synthesize grounded answers, requires LLM agents
备注： Code: [this https URL](https://github.com/Tencent/IterSynth)
点击查看摘要
Abstract:Deep search requires LLM agents to decompose complex queries, search for evidence, and synthesize grounded answers, yet existing ReAct-style agents suffer from two limitations: role coupling, where one policy must handle planning, evidence use, and synthesis; and context accumulation, where growing search histories introduce noise and obscure useful information. To address these issues, we propose IterSynth, a role-decoupled and summary-based paradigm that alternates between a Planner for identifying information needs and a Synthesizer for integrating evidence into an evolving summary state. This design separates planning from synthesis while using the summary as the persistent state of search, reducing both capability coupling and context noise. To train IterSynth effectively, we further introduce Role-Decoupled Policy Optimization (RDPO) for reinforcement learning, which combines terminal outcome rewards with turn-level rubric evaluations and computes role-specific advantages for more precise credit assignment. Experiments on five long-horizon deep-search benchmarks such as BrowseComp and Xbench-DS show that IterSynth-8B achieves an average score of 50.7, surpassing the strongest prior $\leq$8B agent by +4.2\%. Moreover, IterSynth serves as a model-agnostic prompting paradigm, delivering substantial zero-shot gains over ReAct and similar prompting paradigms on frontier proprietary models.
76. 【2609.29429】Just Ask Jev: Reinforcement Learning for Calibrated Decisions as a Zero-Shot Detector of AI Alignment Failures
链接：https://arxiv.org/abs/2609.29429
作者：Ruoqi Guo,Yi Liu,Gelei Deng,Yuekang Li,Lida Zhao,Yutao Wu,Simin Chen,Ying Zhang,Leo Yu Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：screen deployed language, failures screen deployed, deployed language models, Llama Guard, screen deployed
备注：
点击查看摘要
Abstract:Detectors of alignment failures screen deployed language models and score alignment benchmarks. Most are generative judges that spend a decoding pass on every criterion, and classifiers that read token probabilities, such as Llama Guard, still score one fixed label per call. Jev, a model trained with reinforcement learning for calibrated decisions (RLCD), answers many typed questions about one input with calibrated probabilities in a single call. Whether it detects alignment failures has not been measured. We present RLCDAlignBench, which benchmarks Jev on ten alignment failures: sycophancy, jailbreaks, deception, prompt injection, hallucination, privacy violation, social bias, reward hacking, concealing uncertainty, and power seeking. It spans 44 benchmarks and five target models, labelled by each benchmark's scorer and, on two, by humans. Many of these failures are relational, defined against a reference, such as the user's belief or an injected instruction, that the response alone does not reveal. Our key idea is therefore to vary what Jev is asked separately from what it sees: the question's wording and answer type on one side, the fields of the input on the other. A single generic question reaches a median AUROC of 0.886 zero-shot and beats supervised baselines on most benchmarks. Question wording matters little, while context matters more, mostly through fields that encode the label. Jev matches the reference scorer's agreement with human labels, surfaces label defects in existing benchmarks, and costs 63x less than LLM-judge scorers. Code and data: this https URL.
77. 【2609.29428】agentic-ger: terminology recovery in long-form speech using global context
链接：https://arxiv.org/abs/2609.29428
作者：Yanqiao Zhu,Wupeng Wang,Zhifu Gao,Xiangang Li,Xie Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Recent advances, automatic speech recognition, improved automatic speech, improved automatic, long-form audio
备注： submitted to ICASSP 2027
点击查看摘要
Abstract:Recent advances in speech language models have improved automatic speech recognition (ASR) for long-form audio. However, accurately and consistently transcribing domain-specific terminology remains challenging. Motivated by the world knowledge and contextual capability of large language models (LLMs), we propose Agentic-GER, an LLM-based agent for terminology correction in long-form speech. The agent uses global context from the full transcript to identify suspicious terms and resolve ambiguous hypotheses. It selectively re-transcribes the source speech to check candidate corrections, and uses accepted edits to guide subsequent decisions. Experiments with four LLMs and two ASR systems on GigaSpeechBench show consistent terminology improvements in both Chinese and English, with and without thinking. On Chinese speech, Agentic-GER achieves up to a 36.8% relative reduction in biased character error rate (B-CER) over the Whisper baseline.
78. 【2609.29421】Rufus-Air: An Open LLM Post-Training Recipe
链接：https://arxiv.org/abs/2609.29421
作者：Chia-Yuan Chang,Renyuan Cheng,Rui Feng,Xiaotian Han,Yuan He,Hongye Jin,Linwei Li,Shiyang Li,Fenglin Liu,Xin Liu,Priyanka Nigam,Haoyang Wen,Zhenghao Xu,Zhuocheng Xu,Bing Yin,Qingyu Yin,Chao Zhang,Rongzhi Zhang,Zhihan Zhang,Zixuan Zhang,Zixuan Zhang,Tuo Zhao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Coding Agent, General Agent, Search Agent, reproducible post-training recipe, Agent
备注： 47 pages, 9 figures, 20 tables. Authors are listed alphabetically by surname; all contributed while at Amazon. The two authors named Zixuan Zhang are different people
点击查看摘要
Abstract:Rufus-Air is an open and reproducible post-training recipe on GLM-4.5-Air-Base (106B-A12B), organized as a serial pipeline of eight stages: SFT, Reasoning RL, Coding RL, Instruction-Following RL, General Agent, Coding Agent, Search Agent, and RLHF. We document the data, reward design, infrastructure, stage order, and stagewise results needed to reproduce the recipe. Stages progress from basic to advanced capabilities and from hard, verifiable rewards to softer judge-based signals. Training builds on open-source components and public data, much of it used as released, without new human annotation or an in-house distillation teacher. Our main findings are that (i) diverse, high-quality SFT establishes a strong capability floor; (ii) difficulty filtering keeps RL prompts within a productive learning range; (iii) reward reliability provides a practical principle for ordering stages; and (iv) infrastructure and engineering choices are part of the recipe, not just an implementation detail. Rufus-Air improves over the official GLM-4.5-Air post-trained release and is competitive with similarly sized open models.
79. 【2609.29418】Controlling Backchannels in Streamable Full-duplex Models
链接：https://arxiv.org/abs/2609.29418
作者：Maike Züfle,Peter Polák,Sefik Emre Eskimez,Jan Niehues,Peter Bell,Ondřej Klejch
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：full-duplex spoken dialogue, spoken dialogue models, dialogue models rarely, natural conversation, models rarely model
备注：
点击查看摘要
Abstract:Backchannels, brief acknowledgements like "uh-huh" produced while the other party may still be talking, are central to natural conversation, but full-duplex spoken dialogue models rarely model them explicitly. We introduce a lightweight backchannel head that predicts, from a full-duplex model's own hidden states, when a backchannel should begin. Once this probability crosses a tunable threshold, a backchannel is force-decoded. Attached to both a 7B (PersonaPlex) and a 1B (F-Actor) model, it generalizes across scale. Probing confirms the hidden states anticipate real human timing, and generation evaluation shows more frequent, better-timed backchannels. Human raters judge the resulting backchannels on par with real ones.
80. 【2609.29410】Large Language Models for Programming: Actually Fixing or Reimplementing Incorrect Code?
链接：https://arxiv.org/abs/2609.29410
作者：Alexandru Stefan Stoica,Traian Rebedea,Marian Cristian Mihaescu
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Large Language Models, Large Language, Recent studies, shown that Large, diverse programming environments
备注：
点击查看摘要
Abstract:Recent studies have shown that Large Language Models can effectively solve problems and fix bugs in diverse programming environments, including competitive programming. Existing approaches primarily evaluate LLM performance in problem solving or bug fixing independently, but do not explore the relationship between these two capabilities. This work focuses on determining how much the LLM deviates from a buggy solution to fix the bug compared to a human-written patch, and if there is a bias towards generating entirely new solutions. We construct a dataset with all the submissions ($\sim$ 3000) from a couple of users from Codeforces, and we match each buggy submission with its corresponding human fix. By using the similarity between the buggy solution and the human fix as a baseline, we evaluate the quality of LLM-generated bug fixes on 3 OpenAI GPT models (gpt-5-nano, gpt-5-mini, gpt-5.1). We check if the generated solutions solve the problem by using the Codeforces-R1 dataset, an openly available dataset that has tests generated with the DeepSeek-R1 model. Our findings suggest that LLMs tend to modify more lines than necessary compared to human fixes and, in some cases, generate entirely new solutions. We also observe that LLMs solve more problems correctly when allowed to generate solutions from scratch rather than patch buggy submissions, even when those submissions are close to the human patch. This has important implications for the design of AI-assisted programming tools, particularly in supporting user debugging processes and promoting incremental problem-solving strategies rather than solution replacement.
81. 【2609.29397】Baseline Shape Decides the Verdict: A Controlled Re-Examination of Ternary Language Models at 60K Parameters
链接：https://arxiv.org/abs/2609.29397
作者：Gautam Veldanda
类目：Computation and Language (cs.CL)
关键词：microcontroller-class language models, single-seed comparisons, regime rests, attractive for microcontroller-class, microcontroller-class language
备注： 11 pages, 1 figure. Code and run logs: [this https URL](https://github.com/veldanda/ByteLM) (tag p1-v1). Zenodo: [this https URL](https://doi.org/10.5281/zenodo.22937824)
点击查看摘要
Abstract:Ternary (1.58-bit) weights are attractive for microcontroller-class language models, but the sub-1M-parameter regime rests mainly on isolated, single-seed comparisons. One prominent example reports that a routed ternary block (convolution, diagonal SSM and sparse attention mixed by a per-token router) beats a parameter-matched full-precision transformer by 22% at 60K parameters, attributing this to inductive bias. We re-run it under one fixed recipe, three seeds per cell, 98 byte-level runs on one laptop. (i) Baseline shape dominates: at a 16M-byte budget, param-matched transformers span 22.6% in validation loss purely by depth/width choice - far more than any architecture effect we measure there - and the best-shaped transformer ties the routed model, so the published margin is at least partly a baseline-shape effect; the ordering of shapes reverses with budget, so no single fixed shape can be trusted. (ii) At 130M bytes the routed model does win, by 22.2-24.0% over the three transformer shapes we evaluate there - but a plain gated diagonal-SSM block beats it by a further 9.1%, and the routed model's own router puts most of its weight on its recurrent pathway, so the gain does not require routing. (iii) The ternary penalty differs by architecture at the larger budget (+5.3% best transformer vs. +19.5% routed, +28.1% gated SSM), but we cannot attribute that to architecture alone: our transformers keep learned positional embeddings in full precision, 11-22% of their parameters, so they are less quantized than the models they are compared with. (iv) A 90/10 full-precision-then-ternary schedule beats all-ternary training, but only at a stage-2 learning rate about 10x the pretraining peak; at a conventional fine-tuning rate it looks 15.3% worse, reversing the conclusion. The from-scratch baseline was not itself learning-rate tuned, which bounds (iii) and (iv). Code and run logs released.
82. 【2609.29390】Likelihood Ranking doesn't Scale Like Prompting in LLMs
链接：https://arxiv.org/abs/2609.29390
作者：Alessandro Bondielli,Lucia Passaro,Davide Bacciu,Alessandro Lenci
类目：Computation and Language (cs.CL)
关键词：scoring candidate outputs, LLM evaluation, evaluation is commonly, commonly performed, candidate outputs
备注：
点击查看摘要
Abstract:LLM evaluation is commonly performed either by prompting models to produce answers or by scoring candidate outputs with likelihood-based metrics. In multiple-choice QA, however, standard likelihood-based scoring is still conditioned on the question and answer set, and can therefore leverage the same task-conditioned answer-selection interface used in prompting. We study a complementary protocol based on likelihood ranking of declarative statements constructed from the same question--answer pairs. Across 95 decoder-only models, ranging from 0.1B to 104B parameters, and 10 MCQA datasets, we find a systematic divergence between declarative-statement likelihood ranking and prompted answering. Statement-likelihood accuracy remains comparatively stable across scale, whereas prompted answering improves sharply with scale and instruction-tuning. These results suggest that likelihood preferences over controlled declarative alternatives and task-conditioned answer selection probe distinct aspects of model behavior, and should not be treated as interchangeable.
83. 【2609.29371】BanglaTurn: A Benchmark and Whisper-Based Model for End-of-Turn Detection in Bangla Speech
链接：https://arxiv.org/abs/2609.29371
作者：Mizbaul Haque Maruf
类目：Computation and Language (cs.CL)
关键词：Bangla conversational speech, paper presents BanglaTurn, detection in Bangla, Bangla conversational, presents BanglaTurn
备注：
点击查看摘要
Abstract:This paper presents BanglaTurn, a corpus for end-of-turn detection in Bangla conversational speech, and a model trained on it. The corpus holds 35,374 samples of 3 to 15 s of podcast speech, labelled for turn state by combining speaker diarization with an LLM pass, with every label then checked by a human annotator. The model pairs a Whisper encoder with task-specific classification heads. On a class-balanced test set drawn from a held-out podcast, it reaches 84.33% accuracy (95% CI 80.3 to 88.1) against 69.28% for the Smart-Turn v3 baseline, and lowers the false negative rate from 51.57% to 7.55% at the cost of a higher false positive rate. We report what encoder layer fine-tuning, multi-scale pooling and INT8 quantization each contribute, and latency stays within 165 to 191 ms end to end on CPU.
84. 【2609.29370】From Policy Documents to Structured Survey Responses: Evaluating Large Language Models for Policy Monitoring
链接：https://arxiv.org/abs/2609.29370
作者：Carolyn Cole,Matthias Deschryvere,Toqeer Ehsan,Arash Hajikhani
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：crucial for competitiveness, monitor consistently, innovation policies, policies are crucial, make them difficult
备注： Accepted as a full paper to FLINS-ISKE 2026
点击查看摘要
Abstract:Science, technology, and innovation policies are crucial for competitiveness, yet their diversity and scale make them difficult to map and monitor consistently. Existing approaches rely heavily on manual survey efforts, which are costly and challenging to scale across countries. Large language models (LLMs) enable new possibilities for extracting and structuring information from long and unstructured policy documents. This paper presents an application of LLMs as "AI respondents" for generating structured survey responses from policy texts. We develop a data extraction pipeline based on long-context in-context learning to map information from public web sources into predefined survey categories, including policy instruments, target groups, and thematic areas. The pipeline integrates a validation step using a secondary LLM to assess relevance and evidence, alongside comparisons with human-provided responses. Using a multi-country dataset, we evaluate the alignment between LLM-generated and human-generated outputs through overlap measures and cross-validation. Results show that LLMs achieve high agreement for structured indicators (84-95%), while differences remain in free-text fields, where models tend to provide more detailed procedural descriptions. These findings highlight the potential of hybrid human-AI workflows for policy monitoring, improving both efficiency and scalability while maintaining the need for human validation and contextual interpretation.
85. 【2609.29362】Parts-of-Speech as Emergent Categories in SAE Latent Space
链接：https://arxiv.org/abs/2609.29362
作者：Alessandro Bondielli,Lucia Passaro,Serena Auriemma,Alessandro Lenci
类目：Computation and Language (cs.CL)
关键词：language model representations, inspect language model, offer a promising, model representations, inspect language
备注：
点击查看摘要
Abstract:Sparse AutoEncoders (SAEs) offer a promising way to inspect language model representations, but it is still unclear what kind of linguistic structure their latents expose. We use part-of-speech (PoS) categories as a controlled test case to study whether morpho-syntactic information is encoded by individual latents or by structured groups of features. We find that PoS distinctions are highly recoverable from SAE activations, but do not align with one-to-one latent / category mappings. This recoverability is not reducible to lexical memorisation, and Open and Closed PoS classes differ substantially. Categories are supported by compact groups of sparse latents, with substantial variation across tags. These groups remain stable on held-out data, while also showing overlap between related categories. Our results show that SAEs localise morpho-syntactic information in a distributed and category-dependent form rather than through atomic grammatical features.
86. 【2609.29349】ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Prompts
链接：https://arxiv.org/abs/2609.29349
作者：Firoj Alam,Md. Rafiul Biswas,Mohamed Bayan Kmainasi,Ali Ezzat Shahroor,Hamdy Mubarak,George Mikros,Abul Hasnat,Wajdi Zaghouani
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Arabic LLM safety, harmful content detection, Arabic LLM, Arabic memes, LLM safety evaluation
备注：
点击查看摘要
Abstract:ArGuard is a shared task on harmful content detection in Arabic memes and LLM prompts. It includes two tracks: Track A focuses on multimodal hate detection in Arabic memes, while Track B addresses harmful prompt detection for Arabic LLM safety evaluation. In total, 58 teams registered, 35 participated in the final evaluation, and 27 submitted system-description papers. Participating teams explored models such as AraBERT, Jais, and Qwen3-VL. The best systems achieved macro-F1 scores of 0.823 on A1, 0.419 on A2, 0.984 on B1, and 0.790 on B2. Fine-grained meme classification in A2 was the most challenging setting, partly due to sparse labels and train-test distribution shifts.
87. 【2609.29333】Where LLM Graders Succeed and Break: Evidence from Two Computer-Science Exams
链接：https://arxiv.org/abs/2609.29333
作者：Ali Habibullah,Yazan Alshoibi,Mohammad Alshiekh,Salman Khan,Naeemullah Khan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Computer Vision exam, LLM graders, practical Computer Vision, hundreds of grader-hours, tempting alternative
备注：
点击查看摘要
Abstract:One long-form exam in a large course costs hundreds of grader-hours, and qualified graders are scarce; LLM graders are a tempting alternative. To show its pitfalls we grade a practical Computer Vision exam ($570$ dual-graded students) under $171$ configurations spanning closed and open-weights models; the best reaches mean absolute error $1.64/35$, below the $2.61/35$ two human graders achieve against each other. The catch is the prompt: a short ''strict grader'' preamble drives $14$ of $17$ open-weights models out of the graded band ($\text{MAE} \ge 8$), three stopping grading altogether. The damage traces to the preamble's two credit-withholding sentences, not to tone or model scale; one of them, ''never give partial credit'', alone makes two of three probed models stop grading. The closed flagships of three vendors shift calibration under it but stay in the band. In $162$ further configurations on a second, independent Machine Learning exam from another course ($1{,}038$ dual-graded students), the preamble worsens ten models, moving three out of the band into collapse and one into refusal, yet improves seven whose neutral prompts over-mark: the vulnerability replicates, but its direction is exam-specific. Light LoRA fine-tuning repairs it: one adapter on the two exams' pooled $\sim 3{,}900$ graded examples brings five small open models to parity or better with a human grader in agreement with the grader pair, and sensitivity to the three harsh personas nearly vanishes ($\le 0.32$ MAE). We release the anonymised dataset, full ablation grid, and grading, fine-tuning and analysis pipelines.
88. 【2609.29328】Grammatical "grandmother neurons" are rare in LLMs
链接：https://arxiv.org/abs/2609.29328
作者：Linyang He,Nima Mesgarani
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Understanding how Large, Large Language, encode linguistic structures, Language Models
备注： Accepted at COLM 2026. 28 pages
点击查看摘要
Abstract:Understanding how Large Language Models (LLMs) encode linguistic structures remains a fundamental challenge in interpretability research. While diagnostic classifiers (or "probes") are widely used for this task, they face significant methodological criticism: training auxiliary classifiers introduces capacity confounds and calibration issues, often making it difficult to distinguish the model's intrinsic representations from the probe's ability to learn the task. To address these limitations, we introduce a probe-free framework for localizing linguistic selectivity at the individual neuron level. Leveraging the controlled contrasts of linguistic minimal pairs, we propose a Neuron Separability Index (NSI), a metric that directly quantifies how reliably single neurons differentiate grammatical from ungrammatical constructions without parameter updates. Applying NSI across 68 linguistic paradigms and seven checkpoints reveals three main patterns: 1) raw separability reaches near-peak levels earlier for morphological and syntactic distinctions than for syntax-semantics interface and conceptual distinctions. 2) after permutation normalization, single-unit selectivity is sparse, weak, and narrowly tuned: only a small fraction of units are sensitive to an average paradigm, and strongly selective "grandmother neurons" are rare. 3) whole-vector linear separability, single-neuron selectivity, and behavioral competence are largely dissociated, and targeted ablations further separate activation selectivity from causal reliance.
89. 【2609.29278】Reasoning Instructions Can Break Answer Decoding in Vision--Language Models
链接：https://arxiv.org/abs/2609.29278
作者：Zeyan Li,Siyuan Qiu,Jianfeng Xu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：distort multiple-choice VLM, multiple-choice VLM evaluation, reads answer-label logits, multiple-choice VLM, VLM evaluation
备注：
点击查看摘要
Abstract:Chain-of-thought (CoT) instructions can distort multiple-choice VLM evaluation when a scorer appends a reasoning cue but reads answer-label logits before the model generates any rationale. We call this CoT-prefix scoring. On ScienceQA, Qwen2.5-VL-7B drops from 80.76% to 45.48%, and across five option-content permutations 93.54% of CoT-prefix predictions select the first slot. Condition-matched linear probes recover 78.94% from the same hidden states, while free generation restores 75.24%, showing that the answer often survives the prefix and the immediate readout fails. Vocabulary and layer diagnostics explain the mismatch: probability mass moves toward continuation tokens, while answer information remains linearly accessible in late layers. The effect recurs with varying severity across datasets and models, though not universally. These results show that CoT-prefix scoring can confound model knowledge with an evaluation-interface mismatch and should be avoided unless the requested and scored output events are aligned.
90. 【2609.29276】pylazaro: a Python package for anglicism extraction in Spanish
链接：https://arxiv.org/abs/2609.29276
作者：Elena Alvarez-Mellado
类目：Computation and Language (cs.CL)
关键词：Lexical borrowings, Identifying lexical borrowings, unassimilated lexical borrowings, Lexical, language
备注：
点击查看摘要
Abstract:Lexical borrowings are words from one language that are introduced into another language. Identifying lexical borrowings in text is a relevant task for data-centric fields in Linguistics such as lexicography or corpus linguistics, but none of the standard libraries for text processing offers such a functionality. In this paper we present pylazaro, an open-source Python package for the automatic extraction of unassimilated lexical borrowings (mostly anglicisms) from Spanish text. pylazaro offers a single interface to five sequence labeling models that were trained using different libraries, so that users can run and switch between them without having to deal with the idiosyncrasies of each library. We describe the design and usage of the package, contrast the performance of its models with that of general-purpose LLMs (which perform poorly at this task: F1 below 0.40, compared to 0.86 for the best model in pylazaro) and report on its adoption: pylazaro has been downloaded more than 58,000 times and is the library behind Observatorio Lazaro, a resource that monitors anglicism usage in the Spanish press. pylazaro can be installed via PyPI, is documented in readthedocs and can be tried through a live demo hosted on HuggingFace Spaces.
91. 【2609.29251】Policy as Code: A Coroutine-Bridge Harness for Fast-Reasoning Reliability on CAR-bench
链接：https://arxiv.org/abs/2609.29251
作者：Ivan Matveev
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：separate agent round-trip, real-world uncertainty, tool-using agents stay, agents stay reliable, evaluates whether tool-using
备注： 4 pages, 1 figure, 3 tables. Technical report for the winning entry in Track 2 (Cerebras Fast-Reasoning) of the CAR-bench Challenge at IJCAI-ECAI 2026
点击查看摘要
Abstract:CAR-bench evaluates whether tool-using agents stay reliable under real-world uncertainty, executing every tool inside the evaluator so that each tool-result exchange is a separate agent round-trip. A conventional next-action agent can batch parallel tool calls, but a chain of dependent calls costs it one model call per round of results. We present a coroutine-bridge harness in which the model's only action is to emit a Python program that blocks and resumes in place across evaluator tool exchanges. This decouples model invocation from tool round-trips: on the public test split the agent uses a median of two model calls against seven agent turns per task, resolving a full multi-turn task in a median of 1.8 s of model latency on Cerebras gpt-oss-120b. Because the action surface is executable code, deterministic CAR-bench policies are encoded directly as logic in the tool layer rather than as prompt rules, enforcing compliance at zero reasoning cost. On the official hidden evaluation the harness won Track 2 with 60.0% Pass^3, 4.5x the organizer baseline, at the lowest estimated cost and the fastest median task latency (3.14 s) of any entry scoring above that baseline; the same unchanged harness reproduced an identical 60.0% Pass^3 on GPT-5.5 in the Open track, matching frontier-model agents. A single static prompt, appended with per-task state at the tail, stays byte-identical across calls and across tasks: the frozen submission prompt served 78% of input tokens from cache (86.6% across its warm tail), against 73% over a three-week development corpus in which prompt edits repeatedly reset the cache. This compounds the few-call design into a small fraction of nominal input compute.
92. 【2609.29245】No More Free Lunch: Corpus Task Complexity Matters as Corpora Grow
链接：https://arxiv.org/abs/2609.29245
作者：Prasann Singhal,Amanda Bertsch,Jacob Steinhardt,Sewon Min
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：human heart transplant, corpus size, heart transplant, human heart, corpus
备注： 28 pages, 8 figures
点击查看摘要
Abstract:Given a large corpus, the questions one might ask can vary -- from "When was the first human heart transplant?" to "What are all the contradictory claims in this literature?" -- but what makes some questions more challenging than others? In this work, we define a notion of Corpus Task Complexity (CTC) that characterizes tasks by how their difficulty grows with corpus size; for instance, a retrieval query only requires a single linear pass over a corpus, while finding contradictions requires checking a quadratically growing set of claim pairs. Observing that prior work has largely only studied tasks whose difficulty grows linearly with corpus size, which we call low CTC tasks, we introduce 10 new tasks belonging to a class of high CTC whose difficulty grows quadratically or more in corpus size. We find that high-CTC tasks not only grow much more challenging on average at longer contexts for LCLMs, they reverse many modeling conclusions drawn solely from low-CTC evaluations. For instance, efficient block-sparse and hybrid attention approaches consistently match full attention performance on low-CTC tasks, but degrade much more on high-CTC tasks. Large-corpus high-CTC reasoning thus remains an open challenge as full attention is too costly to scale, motivating future research on these tasks. We release our code, data, and 22-task suite (CTC-Bench), to facilitate future research in this area.
93. 【2609.29233】Post-Training Leaves Behavioral Shadows on Unrelated Decisions
链接：https://arxiv.org/abs/2609.29233
作者：Ziyang Zhang,Yubin Jing,Yuanhao Zeng,Yuyao Li,Haofan Wang,Yichen Gong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：task-unrelated text, capabilities through task-unrelated, Active Taskless Distillation, language models, improves language models
备注： 17 pages, 6 figures, 13 tables. Code: [this https URL](https://github.com/myboker/ATD)
点击查看摘要
Abstract:We find that language models can transfer capabilities through task-unrelated text. Post-training typically improves language models using task-specific data. Prior work on subliminal learning shows that information about these updates can pass through unrelated generations, but has largely focused on traits or preferences using extensive teacher outputs. We introduce Active Taskless Distillation (ATD), which achieves capability transfer using only a single word from the teacher per prompt. ATD probes the behavioral shadow of post-training by selecting prompts where the teacher and student's shared public ancestor is nearly indifferent between two ordinary words. A student initialized from this ancestor learns solely from the resulting prompt-word pairs, without target-task examples, teacher logits, or teacher parameters. In the primary coding experiment with Qwen2.5-1.5B, 5,664nses yield a 5.34 pp gain on HumanEval+ over an exact nuisance-matched control thadisrupts prompt-resperiments showtransfer in scientific knowledge, commonsense reasoning, and reading comprehensins across additional model generations, sizes, and families. Functional analyses show that the learned sid composable, andthat its strength tracks the teacher's update strength.
94. 【2609.29230】EAGER: Enhancing Generative Event Extraction via Reinforcement Learning with Verifiable Rewards
链接：https://arxiv.org/abs/2609.29230
作者：Omar Adjali,Siting Liang,Omair Shahzad Bhatti,Daniel Sonntag
类目：Computation and Language (cs.CL)
关键词：large language models, requires simultaneous identification, schema-grounded argument spans, extraction remains challenging, event extraction remains
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:End-to-end event extraction remains challenging for large language models as it requires simultaneous identification of event triggers, classification of event types, and extraction of schema-grounded argument spans. We present EAGER, a reinforcement learning framework for generative event extraction that combines fine-grained verifiable rewards with Schema-Contrastive Advantage Estimation to alleviate advantage collapse under sparse binary rewards. Our reward design explicitly targets structural validity, extraction accuracy, groundedness, coverage, over-generation, and span precision. Experiments across seven benchmark datasets show that EAGER consistently outperforms prompting, supervised fine-tuning, and prior reinforcement learning baselines, achieving a substantial improvement over the strongest prior method. Results demonstrate that task-aligned verifiable rewards and contrastive advantage estimation substantially improve structured extraction.
95. 【2609.29183】Predicting Emerging Topics from Outliers: A Prospective Study of Weak Signals in Embedding Space
链接：https://arxiv.org/abs/2609.29183
作者：Evangelia Zve,Gauvain Bourgne,Jean-Gabriel Ganascia
类目：Computation and Language (cs.CL)
关键词：models initially classify, initially classify, founding members, members of emerging, publication time
备注： Accepted to Findings of AACL-IJCNLP 2026
点击查看摘要
Abstract:Some documents that embedding-based topic models initially classify as noise later become founding members of emerging topics. At publication time, however, they appear as scattered points in embedding space and are difficult to distinguish from ordinary noise without the benefit of hindsight. We study whether such anticipatory outliers can be predicted prospectively, using only information available when a document first appears. We derive labels from the subsequent trajectories of outlier documents, distinguishing those that anticipate new topics from those that reinforce existing topics or remain isolated, and estimate label confidence through agreement across multiple embedding models. On two French news corpora, anticipatory outliers prove predictable at publication time. Under cross-validation, $F_1$ rises from about 0.77 over the full eligible population to above 0.90 on high-consensus subsets, and remains at 0.76-0.80 under a strictly chronological evaluation. Predictive performance is driven mainly by geometric features capturing each outlier's position in embedding space.
96. 【2609.29146】BanglaKontho: Closing the Long-Form Gap in Bangla Text-to-Speech
链接：https://arxiv.org/abs/2609.29146
作者：Mizbaul Haque Maruf
类目：Computation and Language (cs.CL)
关键词：remains under-resourced, under-resourced for neural, seventh most spoken, spoken language, single-speaker Bangla TTS
备注：
点击查看摘要
Abstract:Bangla, the seventh most spoken language in the world, remains under-resourced for neural text-to-speech. Public Bangla speech corpora are dominated by short read-prompt utterances collected for speech recognition, leaving long-form prosody and consistent single-speaker narration uncovered. We present BanglaKontho, a single-speaker Bangla TTS corpus of 20 hours derived from professional audiobook recordings: 7,050 segmented utterances with verified transcripts at 24 kHz. We also release a reusable Bangla text normalizer covering Bangladeshi-style digit grouping, currency and date expressions, Danda punctuation and Unicode normalization, together with the full preprocessing pipeline. An MB-iSTFT-VITS baseline trained from scratch reaches 9.5% WER and 4.46 naturalness MOS, against 16.0% and 3.16 for the same architecture retrained on the 12-hour IndicTTS-Bn corpus. The corpus is released openly under CC BY-NC 4.0.
97. 【2609.29131】ag-Aware Structured Text Translation: Towards a Systematic Understanding
链接：https://arxiv.org/abs/2609.29131
作者：Zhanglin Wu,Hengchao Shang,Daimeng Wei,Jiaxin Guo,Zongyao Li,Tengfei Song,Ning Xie,Weidong Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Internet texts, functional meaning, replete with format, synthesis tag method, LLM-based synthesis tag
备注：
点击查看摘要
Abstract:Internet texts are replete with format tags that carry structural, semantic, and functional meaning. Current large language model (LLM)-based translation systems struggle to balance translation fluency with tag fidelity when processing tagged text. We argue that resolving this tension requires a systematic approach at three interconnected levels: data synthesis, capability building, and multi-objective alignment. At the data level, we identify and formalize a fundamental trade-off between structural tag diversity and translation naturalness in synthetic data generation; existing methods optimize for one at the expense of the other. We propose a hybrid synthesis strategy (Hy-LST) combining LLM-based synthesis tag method and Two-Stage LLM-based synthesis tag method to produce both diverse and natural tagged data. At the capability level, we decompose tag-aware translation into four sub-tasks of increasing difficulty in a multi-task supervised fine-tuning framework, enabling targeted capability acquisition and knowledge transfer. At the alignment level, we design three complementary reward functions under a group relative policy optimization framework, each targeting a distinct objective (fluency, tag fidelity, and tag-scoped translation quality), and show that joint optimization consistently outperforms single-reward alternatives. Experiments on six language directions (en2zh, en2ja, en2de, en2fr, en2ru, de2fr) demonstrate that each level contributes measurable improvements, and the complete system significantly outperforms existing methods. Qualitative analysis reveals specific error patterns and their mitigation after training with our method.
98. 【2609.29123】Accent Analogy Guidance: More Speaker Similarity at Equal Accent in Cross-Lingual Voice Cloning
链接：https://arxiv.org/abs/2609.29123
作者：Yoomee Cho,Jisun Lee
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：cross-lingual zero-shot, target speech, accent, TTS models AAG, reference leaks
备注： 5 pages, 1 figure, 2 tables. Submitted to ICASSP 2027. Listening samples: [this https URL](https://yoomee-cho.github.io/accent-analogy-guidance/)
点击查看摘要
Abstract:In cross-lingual zero-shot text-to-speech, the accent of the reference leaks into the target speech. We propose accent analogy guidance (AAG), a training-free sampler term that subtracts an accent direction estimated from the model's own predictions for one synthetic voice rendered in both languages, so the voice cancels and only the accent remains. By a blind LLM accent judge on real dubbing data, reweighting classifier-free guidance between reference and text, and its variants, stay near one identity-accent trade-off curve; we score a method by its speaker similarity above that curve at equal accent ($\Delta$SIM). Across four open TTS models AAG lies above the curve: on OmniVoice $\Delta$SIM is +0.11 to +0.27 on three test sets (accent 3.51 to 4.28 on a 1-5 scale at speaker similarity 0.29, where reweighting keeps 0.02); MaskGCT and CosyVoice 2 also lie above their curves, and on F5-TTS it is more native than any reweighting setting. An LLM-free language-ID measure and a twelve-listener panel agree. A premise test and the reach of a model's own curve indicate in advance whether and roughly how much AAG can gain, predicting the one model where it gains nothing (X-Voice).
99. 【2609.29102】ELF-REG: Scaling Continuous Diffusion Language Models to Reasoning Tasks
链接：https://arxiv.org/abs/2609.29102
作者：Zeyu Michael Li,William Xingxu Chen,Bingshuo Qian,Jiayin Liu,Xiang Cheng
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Fully continuous diffusion, diffusion language models, Embedded Language Flows, continuous diffusion language, final step
备注：
点击查看摘要
Abstract:Fully continuous diffusion language models (dLMs) denoise continuous representations without intermediate discretization, then decode all response tokens in parallel at the final step. Their performance on challenging reasoning tasks remains less established than that of autoregressive (AR) LLMs and masked dLMs. We scale Embedded Language Flows (ELF) to mathematical reasoning and code generation on GSM8K, MATH-500, HumanEval, and MBPP. We introduce ELF-REG, which improves learning with representation alignment and entanglement (REPA+REG), where a frozen AR teacher supervises intermediate denoiser features and supplies a global representation that is jointly denoised with the response. ELF-REG-L achieves 55.96% pass@1 on GSM8K at 64 network function evaluations (NFE), and 13.39% on MATH-500 and 22.56% on HumanEval at 128 NFE. It outperforms the evaluated comparable-scale dLMs in pass@1 on GSM8K and code, and improves MATH-500 pass@1 from 10.55% for the ELF-L baseline to 13.39% with ELF-REG-L. Without few-step training, the same task-specific checkpoints support strong low-NFE performance through early-stop, which decodes an intermediate clean prediction without completing the denoising trajectory. At 16 NFE, ELF-REG-L reaches 41.21% HumanEval pass@10, outperforming recent continuous dLMs of comparable scale.
100. 【2609.29090】Can Classical Semantic-Extractive Summarization Be Evaluated in Hindi? A Replication Study
链接：https://arxiv.org/abs/2609.29090
作者：Showket Ahmad Khan,Mudasir Mohd,Nasrullah Sheikh,Mohsin Altaf Wani,Abid Hussain Wani,Hilal Ahmad Khanday,Niyaz Ahmad Wani
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Jan and Shah, distributional-semantics extractive summarisation, extractive summarisation method, substituting a Devanagari-appropriate, method of Mohd
备注：
点击查看摘要
Abstract:We replicate the distributional-semantics extractive summarisation method of Mohd, Jan and Shah (2020) and adapt it to Hindi, substituting a Devanagari-appropriate component at every language-specific step. The system is evaluated on two independent corpora --- the Hindi portion of XL-Sum and FIRE ILSUM 2.0 Hindi --- under a Devanagari-aware ROUGE implementation validated against the XL-Sum authors' own multilingual scorer, with all comparisons drawn as 1000-resample paired bootstraps. In its published equal-weight configuration the replicated system is significantly worse than a three-sentence lead baseline on both corpora, trailing Lead-3 by 0.042 ROUGE-1 Fon XL-Sum and by 0.265 on ILSUM. A feature ablation shows that sentenceposition is the only feature that contributes: position alone reproduces the lead baseline exactly, removing position gives the weakest configuration,and a validation-tuned weighting can at best equal Lead-3 and never exceed it. TextRank fails identically, making this a class-level rather than an implementation-level result. A selection analysis shows the remaining features steer extraction towards long, entity-dense body sentences while the references reuse the article this http URL Hindi benchmarks therefore cannot reward non-lead content selection, motivating purpose-built evaluation resources.
101. 【2609.29075】CRISS: A Retrieval-Augmented AI Chatbot for Assisting Cancer Registrars
链接：https://arxiv.org/abs/2609.29075
作者：Vani Seth,Mohammad Beheshti,Anirudh Kambhampati,Vishwa Bhayani,Lucinda Ham,Prasad Calyam,Iris Zachary
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Oncology Data Specialists, including Oncology Data, Data Specialists, Oncology Data, including Oncology
备注： 21 pages, 13 figures, 7 tables. Keywords: cancer registry, retrieval-augmented generation, large language models, conversational AI, clinical informatics, oncology data specialists, medical question answering, AI safety, clinical decision support
点击查看摘要
Abstract:Cancer registrars, including Oncology Data Specialists (ODSs), must interpret complex and frequently updated coding and staging standards. We developed CRISS (Cancer Registry Intelligent Support System), a retrieval-augmented generation (RAG) conversational assistant that provides rapid, citation-supported access to registry guidance. This study evaluated whether CRISS could (1) support accurate and citation-supported responses, (2) improve access to and interpretation of relevant guidance, and (3) support training/helpdesk use while preserving human oversight of final abstraction decisions. We built a domain-specific knowledge base from national cancer registry standards, segmented into metadata-tagged passages and indexed as dense embeddings. Retrieved passages were used to generate citation-grounded responses through a large language model (LLM). Open-weight, proprietary, and non-RAG baseline models across Gemini and GPT families were evaluated on easy, medium, and hard registry questions using an LLM-as-a-Judge protocols. RAG configurations consistently outperformed non-RAG approaches, especially as question difficulty increased. Mean grounding scores for RAG were 0.62/0.56/0.59 across easy/medium/hard tiers versus 0.29/0.26/0.29 for non-RAG. RAG models also achieved higher semantic-similarity scores overall. Proprietary RAG models performed strongest on easy and medium questions, while local RAG models ranked highest on hard questions and proprietary models were generally more cautious. Domain-specific RAG improved evidence grounding and response quality for cancer registry questions while enabling citation-supported assistance across complexity levels. CRISS demonstrates the potential of human-centered, citation-grounded AI to support cancer registrars while preserving human oversight for final coding decisions.
102. 【2609.29056】Empath: Tracing Multi-Level Emotion Dynamics in Crisis Counseling Dialogues
链接：https://arxiv.org/abs/2609.29056
作者：Ziwei Gong,Yuchen Huang,Wen Liang,Nicholas Deas,Melanie Subbiah,Kathleen McKeown,Julia Hirschberg
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：work treats emotion, computational work treats, static utterance-level labels, treats emotion, computational work
备注：
点击查看摘要
Abstract:Emotion dynamics are critical for understanding crisis-support conversations, yet most computational work treats emotion as static utterance-level labels. We introduce EMPATH, a framework for understanding affective dynamics in mental health dialogues across three granularities: turn-level labels, transition probabilities, and global conversation archetypes. Applying EMPATH to text-based crisis conversations with self-identified Black texters discussing grief, we find persistent negative affect, gradual hope-ward transitions, distinct texter-volunteer emotional roles, and heterogeneous recovery trajectories. These results highlight the informative patterns that emerge from computationally understanding crisis support and expressions of grief as dynamic processes within conversations, as well as the overall value of emotion-dynamic analysis for analyzing and comparing affect in dialogues.
103. 【2609.29043】Design and Evaluation of LLM Chaining-Based Task Planning for General Purpose Service Robots
链接：https://arxiv.org/abs/2609.29043
作者：Lucas Da Mota Bruno,Jiahao Sim,Yoshinobu Hagiwara
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：General Purpose Service, Purpose Service Robot, real home environments, General Purpose, Purpose Service
备注： Accepted to IEEE GCCE 2026. 5 pages, 6 figures, 3 tables
点击查看摘要
Abstract:General Purpose Service Robot (GPSR) tasks, as defined in the RoboCup@Home benchmark, require robots to interpret diverse natural language commands and generate multi-step action sequences in real home environments. Conventional Single Prompt (SP) approaches suffer from context bloat and the "Lost in the Middle" phenomenon, leading to unreliable task planning. We propose an LLM chaining architecture that separates instruction classification and action generation into two specialized stages, reducing per-inference prompt length by approximately 45% while improving planning consistency. We evaluate our method using 100 randomly generated GPSR commands across three language models spanning local open-source and frontier cloud deployment contexts. Results show consistent planning improvements over SP across all models, with gains of up to +37 percentage points on local models. Further, real-robot execution experiments on the Toyota Human Support Robot (HSR) reveal that planning success alone does not guarantee task completion, with 6 of 10 tasks completing successfully and execution-layer failures identified as the primary remaining bottleneck.
104. 【2609.29015】MeshHeal: Two-Timescale Self-Healing for Gray Failures in Decentralized LLM Agent Networks
链接：https://arxiv.org/abs/2609.29015
作者：Keru Chen,Sen Lin,Yingbin Liang,Nathaniel D. Bastian,Shaofeng Zou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：quality persistently degrades, LLM-based multi-agent systems, multi-agent systems coordinate, task-solving quality persistently, Decentralized LLM-based multi-agent
备注： 31 pages
点击查看摘要
Abstract:Decentralized LLM-based multi-agent systems coordinate through local interactions, but an agent can remain responsive while its task-solving quality persistently degrades. Such gray failures require protecting current tasks before sufficient evidence exists to alter future routing, while still allowing recovered agents to rejoin. We introduce MeshHeal, a fully decentralized self-healing framework that couples ability-matched peer review across two timescales. At the fast timescale, an adaptive hierarchy escalates uncertain or low-scoring outputs from repeated single-reviewer evaluation to committee deliberation and, when needed, correction before use. At the slow timescale, a task- and ability-conditioned peer-relative detector aggregates scores to distinguish persistent degradation from ordinary output variation, trigger mandatory committee review, and eventually exclude degraded agents from ordinary routing; recovery probes provide fresh evidence for reintegration. To faithfully evaluate routing, we introduce Model-Backed MAS Evaluation, which ties ability assignments to execution models, since prompt-based ability assignments alone can leave routing errors hidden. Across BBH, MATH, and MMLU-Pro, MeshHeal achieves 0.839 degraded-phase accuracy using 51k total model tokens per task, versus the strongest baseline Symphony's 0.807 accuracy using 115k per task. Under staggered degradation and recovery, MeshHeal isolates degraded agents, keeps them excluded from ordinary task execution until recovery, and returns them to normal routing.
105. 【2609.29001】Polite but Misaligned: Evaluating LLM Politeness Judgments Against Human Pragmatic Norms
链接：https://arxiv.org/abs/2609.29001
作者：Rong Wang,Kun Sun,Yadong Guo
类目：Computation and Language (cs.CL)
关键词：large language models, standard benchmarks, strong performance, performance on standard, remains unclear
备注：
点击查看摘要
Abstract:Despite strong performance on standard benchmarks, it remains unclear whether large language models (LLMs) evaluate social pragmatics in ways that align with human judgments. We evaluate LLM politeness judgments using two English-language datasets with complementary annotation formats: continuous human ratings and three-way categorical labels. Across the seven evaluated models, we find that inter-model agreement is stronger than model--human agreement. Strategy-level analyses suggest that model--human alignment is associated with explicit linguistic cues, while some rapport-building strategies occur more frequently in misaligned cases. In the categorical task, model predictions exhibit systematic neutral compression, characterized by the overproduction of Neutral labels and the underprediction of Impolite labels. This pattern persists when expert consensus is used as the reference on a diagnostic subset. Our findings highlight the need for pragmatic evaluations that go beyond aggregate agreement metrics by examining directional patterns of model--human disagreement across different human references.
106. 【2609.28854】Persuaded, Not Informed: Incentive-Misaligned Witnesses Defeat In-Context Grounding
链接：https://arxiv.org/abs/2609.28854
作者：Rahul Balakavi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Language-model agents increasingly, agents increasingly answer, increasingly answer questions, Language-model agents, customer-relationship management
备注： 9 pages, 4 figures, IEEE conference format. Ancillary files contain the evaluation harness, pre-specifications, and per-run result files
点击查看摘要
Abstract:Language-model agents increasingly answer questions over customer-relationship management (CRM) records, such as whether to qualify a sales lead. We identify a failure mode not addressed by a stronger model: when the context contains an assertion by a party with an incentive toward optimism - here the sales representative, a witness recorded in the CRM - the model treats the assertion as evidence and clears deals the company's own records deem unacceptable. Across 100 lead-qualification tasks from CRMArena-Pro, the representative asserts an acceptable timeline in every call and an acceptable budget in 76; on the 31 tasks where such an assertion contradicts the price list and installation policy, a model reading only the transcript clears the deal in 29 of 31 cases. The signature is consistent across seven models from four providers (misled on 87-97%); scale and explicit reasoning confer no resistance. Only 3 of 35 genuine failures involve no assertion: the failure is persuasion, not missing information. We contribute a diagnostic method rather than an architecture: (i) a bucket analysis that separates persuasion from information gaps, (ii) a same-information control showing that supplying the records to the model lowers strict accuracy from 41 to 18 while raising recall - precision collapses - and (iii) a compute-step control that holds extraction fixed and varies only who computes Budget and Timeline. The margin ranges from 42 points on an inexpensive model to 2-5 points on models that already compute correctly; on the strongest models the arms are within confidence intervals, so the pattern is a consistent direction and a soundness property, not a proved performance floor. We pre-specify a generalization test that returns a negative result, characterize the precondition (a policy exactly specified in the inputs), and release all evaluation artifacts.
107. 【2609.28845】LastOPD: Taming Collapse in Latent On-Policy Distillation
链接：https://arxiv.org/abs/2609.28845
作者：Jie Yang,Zhengyu Fang,Zelin Xu,Jiarui Sun,Xiran Fan,Junpeng Wang,Liang Wang,Qinghua Liu,Yiwei Cai,Yan Zheng
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：teacher next-token distribution, On-policy distillation, responses it writes, next-token distribution, latent signal
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) corrects a student on the responses it writes, but its signal is the teacher's next-token distribution: it tells the student what the teacher says but misses how it thinks. Latent supervision promises the missing part by aligning the student's latent states to the teacher's. Recent methods such as OPRD bring this signal into on-policy distillation. However, we observe two failures of this recipe when distilling Qwen3-4B and Qwen3-8B into Qwen3-1.7B-Base. Early gain, late collapse: latent supervision alone lifts MATH-500 accuracy from 25 to 46 in 10 steps, but subsequent training degrades performance down to 11 with no recovery. Better alignment, worse behavior: although the alignment metric steadily improves throughout this collapse, the most aligned model turns out to be the worst performing. Further analysis suggests a mismatch in how the latent signal is applied: layers paired by depth play different roles in the two models, so continued alignment may pull the student toward teacher states it cannot understand. To address this, we propose LastOPD, which applies the latent signal only at the last-layer state, the common interface both LM heads read, and only during a 10-step crossfade into token-level OPD. This keeps the useful part of the latent signal and hands the student to token-level supervision before the collapse sets in. Extensive experiments show that LastOPD improves MATH-500 over token-only OPD by 5.55 and 4.02 points with the 4B and 8B teachers, leads on most held-out datasets, and reaches the final score of token-only OPD in about half the steps. Code is available at this https URL.
108. 【2609.28826】COILD: An Indic-Centric Parallel Corpus and Benchmark for Machine Translation Across Indian Languages
链接：https://arxiv.org/abs/2609.28826
作者：Kshetrimayum Boynao Singh,Nitin Kumar Mishra,Palash Pratim Dutta,Atai Waris Khan,Aparna Kaushik,Avinash Kumar,Deeksha,Deepak Kumar,Saroj Kumar Jha,Saloka Sengupta,Anansa Roy,Umalatha Kannoth,Saifulla Samar,Meena Sharma,Manpreet Kaur,Jyoti Sharma,Ashwini Vaidya,Muralikrishna SN,Md Shad Akhtar,Poonam Bansal,Amita Dev,Sanasam Ranbir Singh,Samit Bhattacharya,Tanmoy Chakraborty,Asif Ekbal
类目：Computation and Language (cs.CL)
关键词：Indian languages remains, Indian language pairs, languages remains constrained, Indic-centric parallel corpora, Indian languages
备注： 17 pages, including references and appendices
点击查看摘要
Abstract:Machine translation (MT) for Indian languages remains constrained by the limited availability of high-quality, Indic-centric parallel corpora and evaluation benchmarks. Existing multilingual resources are largely constructed from English-pivot content and often fail to capture the linguistic diversity, cultural complexity, and domain-specific characteristics of Indian languages. We present COILD, an Indic-centric parallel corpus comprising over 1.16 million human-translated and human-verified sentence pairs, covering 20 Indian language pairs across the Indo-Aryan, Dravidian, Tibeto-Burman, and Austro-Asiatic language families. The corpus is built entirely from original Indian language sources collected from licensed repositories spanning eight domains with direct real-world applicability. Furthermore, we introduce a domain-centric benchmark comprising 2,000 expert-verified sentences to enable consistent multilingual and cross-lingual evaluation across Indian language pairs. To validate the effectiveness of COILD, we fine-tune two representative multilingual neural machine translation models, IndicTrans2-Distilled and NLLB-200. Experimental results demonstrate consistent improvements across language pairs, domains, automatic evaluation metrics, and human evaluation, highlighting the effectiveness of high-quality Indic-centric supervision. COILD provides a valuable training and evaluation resource for advancing multilingual machine translation and future multilingual language models for Indian languages.
109. 【2609.28784】Script Choice in LLMs: Evidence for Late-Layer Commitment
链接：https://arxiv.org/abs/2609.28784
作者：David Kletz,Sandra Mitrović,Itay Sabato,Ljiljana Dolamić,Fabio Rinaldi
类目：Computation and Language (cs.CL)
关键词：complementary interpretability methods, logistic regression probing, interpretability methods, logistic regression, knowledge is distributed
备注：
点击查看摘要
Abstract:In this paper, we investigate how script knowledge is distributed across the layers of LLMs using two complementary interpretability methods: logistic regression probing and logit-lens analysis. Our probing experiments reveal a clear asymmetry: both the input script and the instructed output script are encoded in the earliest layers of the network, while, in contrast, commitment to the actual output script emerges only in the final layers, with the model's intermediate representations defaulting to Latin throughout most of the layers. This two-stage process is confirmed by logit-lens analyses, which show that script commitment consistently occurs at the very last layers of the LLMs. Together with the weaker script-following performance observed in smaller models, these results form a converging body of evidence linking script commitment to model depth, with broader implications for the design of sufficiently deep, inclusive multilingual architectures.
110. 【2609.28778】Reward-Tilted On-Policy Distillation for Acoustic Grounding in Audio-Language Models
链接：https://arxiv.org/abs/2609.28778
作者：Kaiyang Li,Shaobo Han,Yue Tian,Shihao Ji
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：exploit textual shortcuts, weakening audio understanding, Audio-language models, exploit textual, textual shortcuts
备注： 5 pages, submitted to ICASSP 2027
点击查看摘要
Abstract:Audio-language models (ALMs) can exploit textual shortcuts to answer questions while overlooking acoustic evidence, weakening audio understanding. On-policy distillation (OPD) trains compact ALMs by supervising student-generated responses with teacher predictions, but does not explicitly distinguish acoustic support from linguistic predictability. We propose Reward-Tilted On-Policy Distillation (RT-OPD) to strengthen acoustic grounding. Given the same question and student-generated text, a frozen teacher predicts the next token with and without audio inputs. Their log-probability contrast defines a reward that reshapes the teacher distribution for reverse-KL distillation, emphasizing the additional evidence provided by audio. Across two compact students and three benchmarks, RT-OPD consistently outperforms Vanilla OPD. Experiments with silenced and replacement audio further suggest that RT-OPD strengthens the student's reliance on acoustic evidence. Our 3B model achieves 72.72% accuracy on MMAU, the highest among the compared 3B models and competitive with several 7B and 8B models. Code and model checkpoints are available at this https URL.
111. 【2609.28758】BiMamba2 Masked Discrete-Unit Prediction for Multilingual Speech Representation for Unsupervised Speech in the Wild Challenge
链接：https://arxiv.org/abs/2609.28758
作者：Prakriti Subedi,Howard Prioleau,Saurav K Aryal
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：Challenge at Interspeech, Unsupervised People Speech, MLCommons Unsupervised People, People Speech dataset, HuBERT-style paradigm
备注： Accepted to Interspeech 2026
点击查看摘要
Abstract:We describe our submission to the Unsupervised Speech in the Wild (UPS) Challenge at Interspeech 2026, a bidirectional Mamba-2 (BiMamba2) encoder trained with masked discrete-unit prediction following the HuBERT-style paradigm. The 47.88M-parameter model is trained on 250 hours of speech across 67 languages from the MLCommons Unsupervised People's Speech dataset, with no labeled data. The objective combines masked k-means pseudo-label prediction with language identification supervision and VICReg regularization. On official evaluation, the system achieves an Adjusted Rand Index of 0.735, exceeding four baselines on speaker clustering. Language identification macro-F1 (0.073) and character error rate (0.870) remain below supervised baselines. We analyze a local-official discrepancy in metric scale and checkpoint ranking, highlighting limitations of in-distribution diagnostics for predicting Dynabench probe outcomes.
112. 【2609.28757】Small yet Assistive: Spatially-Aware Post-Training for Low Vision
链接：https://arxiv.org/abs/2609.28757
作者：Rishabh Choudhary,Shreyansh Raj,Umesh Goyal,Shubh Kashyap,Shrestha Kumar,Sushovan Jena,Komal Kumar,Hisham Cholakkal,Aditya Nigam
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：billion people worldwide, people worldwide live, current vision-language models, billion people, vision impairment
备注： 14 pages, Accepted in EMNLP 2026
点击查看摘要
Abstract:An estimated 1 billion people worldwide live with vision impairment, yet current vision-language models (VLMs) produce descriptions too vague for safe navigation by blind and low-vision (BLV) users. Large VLMs can generate high-quality audio-description-compliant narrations but cannot run on mobile devices; small VLMs offer competitive latency but lack spatial detail, directional cues, and hazard awareness for navigational assistance. We present Smol-VL-BLV, a compact VLM for blind and low-vision users that closes this gap using a 500M decoder transformer model and two post-training mechanisms: (1) teacher-student distillation and (2) Group Relative Policy Optimization (GRPO) with a composite BLV reward targeting directional language, metric distances, and hazard detection. Because multi-stage post-training can induce catastrophic forgetting, we add a lightweight finetuning stage after the last stage GRPO finetuning to recover general descriptive quality while preserving BLV-specific spatial grounding. Our best model substantially outperforms the baseline across various benchmarks, including tasks: VQA, BLV captioning, OCR, and latency. Compared with the baseline for relative improvement, it improves the Spatial score gain of 19.3%, and the Social score gain of 14.8%. It also increases OCR-Bench by 101.5%, and raises TextVQA accuracy by 44.2%. These results show that BLV-focused post-training improves both accessibility-specific spatial grounding and general visual-text reasoning. Deployed on a mid-range Android smartphone via Mixed-Precision Quantization, the model remains approx. 450 MB and runs entirely on-device, offline and without network dependency, generating descriptions with latency dependent on host hardware capabilities. Our model, dataset, and code is publicly released at this https URL
113. 【2609.28747】chnical Manual for Toolkit for Confidence-Corpus Consistency via Fine-Tuning on a Fabricated Corpus
链接：https://arxiv.org/abs/2609.28747
作者：José Luciano Verçosa Marques,Frederico Jorge Heitmann,Daniel Omar Perez,Reinaldo Cesar,Marcelo Vinicius de Paula,Tárcio André dos Santos Barros
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：language model confidence, causal language model, language model, small causal language, fabricated arithmetic answer
备注： 30 pages, 2 figures, 1 table, 12 code listings. Methodological and implementation reference manual; does not report or interpret empirical results from any specific run. Toolkit and pinned dependency environment archived at [this https URL](https://doi.org/10.5281/zenodo.22903853) (CC BY 4.0)
点击查看摘要
Abstract:A language model's confidence in an answer is often read as a proxy for how well it knows the corresponding fact. This manual documents an open toolkit built to test that reading directly: a small causal language model is fine-tuned on a corpus that consistently asserts one fabricated arithmetic answer for each of the 81 single-digit addition pairs, and its post-fine-tuning confidence in each fabricated answer is compared against its own pre-fine-tuning confidence in the corresponding true answer, using an unchanged measurement procedure throughout. We describe and justify every pipeline stage, fact-space generation, token-length-aware confidence measurement, baseline validation, corpus construction, fine-tuning, and paired before/after comparison, together with the confound each is meant to rule out, among them tokenization asymmetry between single- and double-digit answers and the difference between an answer merely losing its edge and one being actively suppressed. This manuscript is a methodological and implementation reference: it documents the instrument and does not report or interpret the outcome of any specific run. The toolkit and its pinned dependency environment are archived separately (Section 9) under a persistent identifier, to be cited as an instrument by work that produces and interprets empirical results with it.
114. 【2609.28739】mporal Taxation Compounds Under Post-Training Compression of Whisper Models
链接：https://arxiv.org/abs/2609.28739
作者：Srishti Ginjala,Eric Fosler-Lussier,Christopher W. Myers,Srinivasan Parthasarathy
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Automatic speech recognition, Automatic speech, ship to production, speech recognition models, speech recognition
备注： Accepted to IMPACT-SPEECH @ EMNLP 2026
点击查看摘要
Abstract:Automatic speech recognition models are audited for demographic fairness at full precision, yet the models that ship to production have been quantized, pruned, and distilled. We ask whether post-training weight compression, which alters model weights rather than the audio signal or its feature representation, redistributes error burden across demographic groups. Across the Whisper family on Fair-Speech, Common Voice 25, and AfriSpeech-200, 50% Wanda pruning of Whisper-large-v3 sharply widens the Black/AA-vs-Asian temporal-taxation differential on Fair-Speech: the absolute word-error-rate gap between the worst- and best-served groups more than doubles; at an assumed cost of five seconds of correction effort per transcription error this is a rise from 30 to 64 seconds of correction time per minute of speech. This +111% relative increase is invariant to the assumed per-error cost, survives an audio-quality control, and is only partly mitigated by beam-search decoding, which still leaves an +86% increase. At edge model size, INT4 HQQ quantization compounds catastrophic transcript loops on West African accents by factors of five to seven. Distillation, by contrast, narrows demographic gaps in 21 of 27 evaluated settings (teacher-student pair, precision, and dataset), with the exceptions concentrated on a single model pair. We cast the temporal-taxation construct of Choi and Choi (2025) as a quantitative metric, and show that single-snapshot fairness audits on full-precision models do not capture the deployment-time burden that compression places on already-marginalized speakers.
115. 【2609.28727】PTC-Bias: Phoneme-Level Temporal Competition for Bias Retrieval and Post-Decoding Correction in Speech LLMs
链接：https://arxiv.org/abs/2609.28727
作者：Zhiqi Ai,Han Cheng,Shiyi Mu,Yongjin Zhou,Shugong Xu
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Contextual biasing improves, large language models, efficiently exploiting large, biasing improves rare-word, improves rare-word recognition
备注： 5 pages, 3 figures, 3 tables, under-review
点击查看摘要
Abstract:Contextual biasing improves rare-word recognition in speech large language models (SpeechLLMs), but efficiently exploiting large bias lists remains challenging. We propose PTC-Bias, a two-stage framework based on phoneme-level temporal competition. At the prefill stage, PTC Retrieval performs frame-synchronous phoneme decoding and temporal competition among candidate pronunciations, producing a compact bias-word shortlist and corresponding speech intervals. After SpeechLLM decoding, PTC Correction conducts a second local competition between the retrieved candidates and mismatched transcript spans within these intervals. Selective correction reduces near-homophone and word-segmentation errors while preserving correct transcriptions. Both stages share the same phoneme posteriors and require no additional SpeechLLM forward pass. Experiments on LibriSpeech show consistent gains across two SpeechLLMs and bias lists of up to 2000 words. With Prompt-SLAM-ASR-7B and 2000 bias words, PTC-Bias reduces B-WER by 23.4%/23.9% relative to CTC-Filter on test-clean/test-other, while keeping U-WER nearly unchanged.
116. 【2609.28703】An Explainable DistilBERT-BiLSTM-Attention Framework for Binary and Multi-Class Hate Speech Detection
链接：https://arxiv.org/abs/2609.28703
作者：Rameesha Zia,Muhammad Shahid Iqbal Malik
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：social media poses, social harmony, social media, mental well-being, public safety
备注： 20 pages, 12 figures, 6 tables
点击查看摘要
Abstract:Hate speech on social media poses serious risks to social harmony, mental well-being, and public safety, making its timely and accurate detection essential for content moderation systems. Most existing studies focus on binary classification, evaluated their frameworks on a single dataset, and provide limited insight into how decisions are made, which limits their real-world applicability. In addition, limited work is done on the explainability of their predictive inference. To address these challenges, this study proposes a multilevel and explainable hate speech detection framework. The proposed model integrates DistilBERT (Distilled Bidirectional Encoder Representations from Transformers) embeddings with a Bi-LSTM (Bidirectional Long Short-Term Memory) model, and an attention mechanism to capture both contextual meaning and sequential dependencies in text. To enhance trust and transparency, LIME (Local Interpretable Model-agnostic Explanations) is employed to explain model predictions by highlighting influential textual features. The framework is evaluated on two benchmark datasets using both binary and multi-class classification to examine robustness and generalization. In addition, an ablation study is presented to highlight the significance of various components of proposed framework. For binary classification, the proposed model achieves F1-scores of 96.78% on the Davidson dataset and 99.53% on the SMHS dataset. In the multi-class setting, it attains F1-scores of 97.00% and 94.99% on the Davidson and SMHS datasets, respectively, outperforming existing baseline approaches. The results demonstrate that multilevel evaluation improves the reliability that the proposed framework effectively balances performance and efficiency. This makes the framework suitable for practical hate speech moderation systems that require accurate, generalizable, and explainable decisions.
117. 【2609.28673】Benchmarking Argumentative Behaviour of LLMs: A Study of Defences Against Character Attacks
链接：https://arxiv.org/abs/2609.28673
作者：Ewelina Gajewska,Katarzyna Budzynska,Jaroslaw Chudziak
类目：Computation and Language (cs.CL)
关键词：Large Language Models, necessitating rigorous evaluation, debating competence relative, Large Language, Language Models
备注： Accepted to COMMA 2026
点击查看摘要
Abstract:Large Language Models (LLMs) are increasingly deployed as argumentative agents in persuasive dialogues, necessitating rigorous evaluation of their debating competence relative to human interlocutors. In this study, we focus on character attacks (ad hominem arguments), traditionally dismissed as fallacies, which play a pivotal role in political persuasive dialogues where ethos often rivals propositional content. Specifically, we investigate whether modern LLMs can replicate human competence to strategically use and respond to such attacks. We analyse a corpus of natural language political dialogues to identify defensive strategies human interlocutors naturally employ in ethos-centred debates and structure them into a dialogue game. Empirically, we benchmark LLM-generated dialogues against the ElecDeb60to16-fallacy corpus of U.S. presidential debates, contrasting human debaters' repertoire of defensive strategies with those of artificial agents. Results reveal a substantial difference: most LLMs rigidly prioritise logical defences, failing to exploit ethotic counterattacks as valid moves in political discourse. We argue that current safety fine-tuning constraints the strategic action space of these LLMs, making them unable to fully engage in naturalistic interactions within domains where character contestation is a normative expectation rather than a mere fallacy.
118. 【2609.28653】he Fellowship of the Query: Learning Retrieval Actions
链接：https://arxiv.org/abs/2609.28653
作者：Mohammed Al-Maamari,Saber Zerhoudi,Michael Granitzer,Jelena Mitrović
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Retrieval-augmented question answering, question answering requires, answering requires control, requires control decisions, Retrieval-augmented question
备注：
点击查看摘要
Abstract:Retrieval-augmented question answering requires control decisions about when to decompose a question, search, reformulate, extract evidence, synthesize facts, verify progress, and stop. We study whether trajectory fine-tuning can improve small language models (SLMs) as next-action controllers. We additionally evaluate a low-resource setting in which a single SLM serves as both the controller and the final-answer generator. From accepted teacher search traces, we build a seven-way action-prediction task, where the model predicts the next structured teacher action from the current trajectory state, and evaluate LoRA-supervised fine-tuning across SLMs and xSLMs as controllers. On 1,646 held-out action examples, Granite 4.1 3B trained on 13,194 actions reaches macro-F1 0.6536, compared with 0.1736 for zero-shot prompting of the same model and 0.5399 for a TF-IDF logistic-regression baseline. In an end-to-end controller/generator swap evaluation over 149 held-out trajectories, using the fine-tuned model for both roles improves Exact Match from 0.7530 to 0.7946 and token F1 from 0.7783 to 0.8295 compared with using the base model as both controller and generator. The cross-role conditions show that the fine-tuned controller increases evidence-fact recording when the generator is fixed, while controller-only final-answer gains are not statistically clear. Overall, trajectory supervision improves action prediction and evidence-recording behaviour in this evaluated pipeline. Code is available at this https URL
119. 【2609.28614】Reward Hacking Challenges Oversight of Autonomous Research Agents
链接：https://arxiv.org/abs/2609.28614
作者：Yue Huang,Zhangchen Xu,Yuchen Ma,Wenjie Wang,Zheyuan Liu,Ziwei Xu,Pin-Yu Chen,Michel Galley,Zinan Lin,Stefan Feuerriegel,Radha Poovendran,Misha Sra,Alex Pentland,Xiangliang Zhang,Zichen Chen
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Autonomous research agents, Autonomous research, evaluate results, scientific result, design experiments
备注：
点击查看摘要
Abstract:Autonomous research agents can design experiments, evaluate results, and write reports, giving them control over both a scientific result and the evidence used to support it. This creates a risk of reward hacking: meeting the reward criteria without achieving the intended goal. We study (1) how often models reward-hack without instructions to do so, (2) how effective and detectable their methods are when hacking is allowed, and (3) how they adapt when an LLM review panel returns its decision and reasons. Across 17 language models and 38 tasks, the spontaneous reward-hacking rate is 30.5% on open-ended research-pipeline tasks and 2.9% on task-specific kernels. When hacking is allowed on tasks whose pass thresholds exceed our best compliant baselines, 505/677 attempts (74.6%) are confirmed reward hacks: they both clear the threshold and receive mechanism-verification panel confirmation of an evaluation exploit. An LLM panel reviewing only submitted code and reported scores misses 33/505 confirmed hacks (6.5%). Direct methods that achieve the highest scores are often easy to detect, while less direct methods evade more often. In a five-round loop, the number of model-task pairs with an evasion rises from 7 to 56. Among 79 pairs evaluated under two feedback conditions, cumulative evasion reaches 40.5% with detailed feedback and 20.3% with generic rejection. The detailed condition includes the review decision, reasons, and attempt history, so this comparison does not isolate the effect of explanations. These findings highlight the need for stronger defenses, including metrics kept outside the agent's control and independent recomputation on data chosen to expose likely exploits.
120. 【2609.28565】When Explanations Cannot Be Read: Measuring and Correcting SHAP and LIME Rendering for Right-to-Left Languages
链接：https://arxiv.org/abs/2609.28565
作者：Rameesha Zia,Muhammad Shahid Iqbal Malik
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：SHAP and LIME, interpret text classifiers, explanation methods, LIME are widely, interpret text
备注： 28 pages, 18 figures, 5 Tables
点击查看摘要
Abstract:Post hoc explanation methods such as SHAP and LIME are widely used to interpret text classifiers, but their visualizations are mainly designed for left-to-right languages. When applied to right-to-left (RTL) languages such as Urdu, Arabic, Persian, and Hebrew, the attribution values remain mathematically valid, while their visual presentation fails. Tokens appear out of sequence, connected letterforms break apart, and plot layouts do not follow the natural reading direction. This study addresses this gap as a visualization problem rather than a limitation of the explanation methods themselves. We present SHAP-RTL, a rendering layer that corrects reading direction and script shaping in SHAP and LIME visualizations, with per-language font selection, while preserving the original attribution values, feature ordering, and model outputs. The approach is evaluated on Urdu, Arabic, Hebrew, and Persian hate and offensive-language datasets using TF-IDF and logistic regression classifiers. Rendering correctness is measured by an OCR round trip over 200 feature words per language. Default rendering yields character error rates of 0.820 to 0.979, meaning the label no longer carries its token; the common reshape-and-reorder workaround fails for Urdu at 0.998, worse than no correction; and the Matplotlib 3.11.0 text rewrite inverts that workaround, while SHAP-RTL remains correct under both versions. The framework also verbalizes the same attributions as short contextual explanations in the reader's language, constrained to the identified features. Evaluation in this paper concerns rendering correctness; assessment of the generated explanations is left to future work. The study highlights the importance of language-aware visualization in making post hoc explainability more accessible across different writing systems.
121. 【2609.28487】Framing by Wording, Framing by Selection: A Large-Scale Two-Dimensional Audit of French News Headlines, 2022-2025
链接：https://arxiv.org/abs/2609.28487
作者：Amr Sobhy
类目：Computation and Language (cs.CL)
关键词：frame public issues, work typically collapses, computational framing work, framing work typically, headlines frame public
备注： 20 pages, 1 figure, includes appendices. Accepted for oral presentation at ICNLSP 2026
点击查看摘要
Abstract:News headlines frame public issues both by what they select and by how they word it, yet computational framing work typically collapses these operations into a single score. We introduce a two-dimensional framework that separates salience framing, measured through four wording devices (loaded vocabulary, blame attribution, threat framing, rhetorical question), from selection framing, measured through outlet-level story-form and high-charge distributions. We build a 10,000-headline French supervision set using three LLM annotators with majority-vote resolution and human arbitration, validate the labels against two annotator-independent blind human studies, and apply the strongest classifier to 902,111 deduplicated headlines from 25 French outlets (2022-2025). Three main findings emerge. First, salience and selection divergence are positively correlated yet leave nearly half of outlet-level variance unexplained, populating interpretively distinct off-diagonal cells in a four-cell outlet typology. Second, default classification thresholds systematically inflate corpus-level salience estimates; a precision-floor recalibration protocol corrects this distortion. Third, group-mention analysis reveals sharply unequal salience contexts: headlines mentioning Jews, the Far-right, and Muslims carry the highest detected salience rates, which broad event-context composition does not fully explain (residuals are descriptive, not same-event causal estimates; per-group lexicon precision is reported alongside). To our knowledge, this is the largest framing-focused French headline audit to date; we release the supervision set, lexicons, and analysis code.
122. 【2609.28479】he Domestic Unprotected Zone: Algorithmic Governance and the Reproduction of Perpetrator Discourse in Conversational AI
链接：https://arxiv.org/abs/2609.28479
作者：Lyu Chang,Sònia Estradé Albiol,Núria Vergés Bosch
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：mediates intimate-partner communication, increasingly mediates intimate-partner, gendered harm, increasingly mediates, Conversational AI increasingly
备注： 59 pages, 8 figures, 27 tables. Supplementary material (S1-S4) included as an appendix. Preprint; under review
点击查看摘要
Abstract:Conversational AI increasingly mediates intimate-partner communication, and refusal logic at the inference layer now functions as a governance threshold for gendered harm. This article asks whether such systems reproduce discursive forms historically tied to the privatization of intimate violence. A three-stage audit of six widely accessible conversational AI systems compares refusal behaviour across 1,600 crossed prompts per system, isolates relational framing through 300 matched prompt pairs, and contrasts pre-submission framing with post-output critique across fresh sessions. Four systems refused fewer than 1% of prompts. ChatGPT 5.2 and Claude Sonnet 4.5 refused most requests, but residual leakage clustered under intimate framing. Switching from a non-intimate to an intimate-partner descriptor amplified non-refusal 4.4-fold and 10.8-fold. Post-output critique produced in-session acknowledgement that did not carry across fresh sessions, with 96-100% of leaked prompts re-leaking. The article names this pattern the Domestic Unprotected Zone, a privatization-like threshold at the inference layer.
123. 【2609.28475】When Should Forecasting Agents Reason? Behavioral Stress Tests for Reliability Routing
链接：https://arxiv.org/abs/2609.28475
作者：Yufeng Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：increasingly combine language-model, agents increasingly combine, Forecasting agents increasingly, combine language-model reasoning, increasingly combine
备注：
点击查看摘要
Abstract:Forecasting agents increasingly combine language-model reasoning, retrieval, ensembling, and calibration, but it remains unclear when each behavior should be trusted. We study this question on ForecastBench-style binary forecasting tasks, treating the choice to retrieve, reason, defer to a market prior, or use a historical analog as an observable agent behavior rather than a hidden implementation detail. Our central finding is that mechanism choice is source-dependent: structured analogs dominate for some data-generating processes, while market/crowd-style and conservative baselines are better for others. We introduce ReliabilityRoute, a structural intervention that steers forecasting-agent behavior using reliability features such as historical coverage, market-prior availability, source-prior sharpness, evidence strength, evidence disagreement, and horizon. A fixed 2024-fitted rule closely matches a hand taxonomy without hard-coded source-name decisions, while a walk-forward self-adjusting rule refits thresholds from previously resolved vintages and obtains the best mean Brier score among our deterministic systems across 16 later LLM vintages. The gain is modest and historical/search baselines remain highly competitive. The main contribution is therefore a behavioral stress test showing that more reasoning is not always better; forecasting agents should first estimate which evidence source deserves control, routing policies should themselves adapt under auditable constraints, and reproducibility artifacts are available at this https URL
124. 【2609.28988】Personalized Korean Lipreading as Visual Speech Recognition: Transfer, Census and Adaptation on OLKAVS
链接：https://arxiv.org/abs/2609.28988
作者：Se Un Park,Hakjun Kim,Taehoon Roh,Junyoung Park
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：personalized Korean visual, nine-camera OLKAVS corpus, Korean visual speech, population-level benchmark score, visual speech recognition
备注： Submitted to ICASSP 2027. 4 pages plus references
点击查看摘要
Abstract:We present a personalized Korean visual speech recognition (VSR) system and quantify, on the nine-camera OLKAVS corpus, the gap between the population-level benchmark score and an individual user's error. A video-only Conformer initialized from English-trained weights attains 9.95 - 12.19% character error rate (CER) under the corpus protocol against the published 26.64, and 19.00 - 21.52 on unseen wording. Per speaker, CER spans 1.0 to 52.2%, with seen wording lowering CER by 7.0 - 9.0 points and professional delivery and spontaneous speech raising it by 8.5 - 10.5 and 12.7 points. A low-rank adapter with 4.6% of the parameters, trained on 4 to 29 minutes of the user's frontal video, lowers the CER of twelve high-error speakers by 2.13 to 3.58 points, transfers to every camera without loss, and keeps 85% of the full fine-tuning gain at 12% of its cost to other speakers. Cameras above the mouth plane add about six CER points as a constant offset that training on all views keeps small.
125. 【2609.28877】Learning New Words from Unlabeled Test Data in Automatic Speech Recognition
链接：https://arxiv.org/abs/2609.28877
作者：Mengqi Wang,Mark A. Hasegawa-Johnson,Haolong Zheng,Chang D. Yoo
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
关键词：invented every day, Speech Accessibility Project, recurring OOV words, ASR, OOV
备注： Submitted to ICASSP 2027
点击查看摘要
Abstract:New words are invented every day. A human listener can learn a new word by hearing it clearly once and inferring its usage from sentence context. This paper proposes granting ASR a similar ability to learn the contextual representations and spellings of new words from unlabeled test data at test time. A frozen CTC acoustic model provides spellings, a frozen language model provides contextual evidence for out-of-vocabulary (OOV) word detection, and an adaptation module expands the vocabulary by learning the lexical token representations with distributions over CTC-generated candidates. The spelling model of each token is optimized by minimizing a Kullback-Leibler divergence (KLD) objective. We demonstrate that the CTC-weighted language model log likelihood ratio can be interpreted as the KLD between the unknown correct ASR and the unsupervised learned ASR, and that, using a Pinsker bound, the square root of KLD can be interpreted as an upper bound on the total variation distance between the true and estimated spelling of the unknown word. Experiments show relative OOV character-error-rate reductions of up to 14.97% on LibriSpeech and 6.67% on dysarthric Speech Accessibility Project data for recurring OOV words, relative to the corresponding rescoring system.
126. 【2609.28713】Spooftral: Can Voxtral Audio-Language Model Detect Speech Spoofing?
链接：https://arxiv.org/abs/2609.28713
作者：Avishai Weizman,Yehuda Ben-Shimol,Itshak Lapidot
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
关键词：shown strong performance, Self-supervised learning, recent years, shown strong, strong performance
备注： 8 pages, 3 figures, 5 tables. Accepted to the Spoken Language Technology (SLT) 2026
点击查看摘要
Abstract:Self-supervised learning (SSL) countermeasures (CMs) have shown strong performance in recent years. However, they often show degraded performance while facing unseen spoofing attacks and mismatched conditions. This study examines the Voxtral audio-language model (ALM) framework for spoofing detection, as a step toward combining CM capabilities within the ALM framework. We analyze how Voxtral captures spoofing cues through audio-text processing and propose an instruction-guided approach that uses label-sequence likelihoods to evaluate bonafide and spoofed speech. Experiments on the ASVspoof databases show that without task-specific adaptation, the LLM layers emphasize semantic representations, reducing the separability of spoof-discriminative acoustic cues compared to the Whisper-based audio encoder. Consequently, spoofing-related information becomes less separable after language-model processing. We also applied lightweight adaptation using weight-decomposed low-rank adaptation (DoRA) to the Voxtral model and propose the Spooftral model, achieving an equal error rate (EER) of 4.25% on the ASVspoof5 evaluation set.
信息检索
1. 【2609.30087】Return or Revise? Learning When Revision Helps Retrieval-Augmented QA
链接：https://arxiv.org/abs/2609.30087
作者：Nicholas Kashani Motlagh,Tim Anderson,Jeremy Gwinnup,Grant Erdmann
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：existing draft answer, retrieved evidence, answer-revision systems, return an existing, existing draft
备注： 25 pages, 4 figures
点击查看摘要
Abstract:We consider the decision of whether to return an existing draft answer or revise it using retrieved evidence, as in answer-revision systems. Draft confidence estimates whether the current answer is correct, but the decision requires estimating the effect of a specified revision. For offline training and evaluation, we grade both the returned draft and its candidate revision under the same correctness judge, which makes repair, harm, and the gap to an oracle observable. We call this paired effect its recoverability, and we train policies to predict it before revision. On 25,870 held-out open-domain questions across three revision setups, a scorer trained on the paired outcome has greater area under the accuracy--revision-rate curve than a matched draft-correctness scorer in all nine Llama setup--seed fits, and gains 0.23--0.68 accuracy points on average at development-selected thresholds, a difference significant across training runs only for dense retrieval. The resulting policy improves on always revising and on average closes more than a third of the oracle gap, although it still applies 38--46% of the harmful revisions. When a draft-free standard-RAG answer is also available, however, choosing between the draft and that answer is stronger by about two points for Llama and four for OLMo, and adding candidate revision as a third option yields no significant gain. Recoverability describes one revision; its value as an available action also depends on the alternatives.
2. 【2609.30001】Advancing Model Research in AgentX: Long-Horizon Autonomy for Industrial Recommender Systems
链接：https://arxiv.org/abs/2609.30001
作者：Shuang Yang,Zijie Zhuang,Changxin Lao,Pengbo Xu,Hanwen Xu,Yusheng Huang,Han Gao,Guanchen Wang,Tianbao Ma,Linxun Chen,Peilin Song,Xuming Wang,Chen Li,Fan Wu,Tao Wang,Zibo Zhao,Xiangyu Wu,An Liu,Fei Pan,Peng Jiang,Chen Yang,Zhaojie Liu,Wenwu Ou
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Sustaining industrial recommendation, Sustaining industrial, industrial recommendation research, recommendation research requires, Research Agent
备注： Technical report. 37 pages, 11 figures, 13 tables, including appendices
点击查看摘要
Abstract:Sustaining industrial recommendation research requires using the results of one experiment to decide what to investigate next. We present AgentX-Model, the next generation of AgentX's model research framework, which connects proposal development and model experimentation within sandboxes defined by business inputs and prediction tasks. AgentX-Model adopts a dual-agent architecture comprising a Research Agent and a Model Agent. The Research Agent develops independently reviewed proposals from papers and experimental findings, while the Model Agent conducts multi-round investigations and returns code, measurements, and unresolved questions. Using the returned results, the Research Agent selects a starting implementation and formulates the next research question, allowing subsequent experiments to build on earlier findings. We organize this continuing research around four actions: Reproduce, Follow-up, Composition, and Diagnose. The first three actions drive routine research, while Diagnose acquires the evidence needed to choose a repair, including for issues raised by business feedback and online evaluation, such as prediction bias measured by PCOC. Across the production evaluation, 560 of 636 completed model-changing experiments recorded AUC above their business baselines. As research continued, some experiments recorded AUC above every comparable ancestor in their lineages. The five latest online A/B evaluations across different business settings reported gains including 10-15% in acquisition efficiency, 15-20% in target-segment advertising spend, and 0.3-0.8% in watch time; the watch-time model used approximately 10% fewer FLOPs and parameters. A dependency-aware historical-replay benchmark further evaluates research allocation, with initial results showing no consistent efficiency gain from more complex scheduling when agents already analyze and select concrete candidates.
3. 【2609.29983】From Interests to Semantic IDs: Retrieval-Grounded Credit Assignment for Generative Recommendation
链接：https://arxiv.org/abs/2609.29983
作者：Mengdan Zhu,Yufan Zhao,Yao Zhao,Sophie Di,Tao Di,Yulan Yan,Sridhar Iyer,Liang Zhao
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：short token sequence, Semantic IDs, enabling generative recommenders, SID, item autoregressively
备注：
点击查看摘要
Abstract:Semantic IDs (SIDs) encode each catalog item as a short token sequence, enabling generative recommenders to predict the next item autoregressively. Reasoning-enhanced variants, an increasingly common extension, first generate a textual trace and then decode a next-item SID by beam search. Such recommenders are commonly trained with group-relative policy optimization under an exact-match SID reward, which is sparse in large catalogs. Two failure modes follow. When all rollouts in a group miss the target, the group yields zero advantage and no learning signal. Rollouts sharing the same SID reward receive identical advantages, however much their traces differ. In both cases the reward reflects only the decoded SID, never the reasoning that produced it. This creates a credit-assignment gap. We address this gap with retrieval-grounded query attribution. Each trace is structured into a history summary, a set of interest hypotheses, and a final SID. A frozen retriever executes every hypothesis as a catalog query, so that each hypothesis becomes independently verifiable rather than judged only through the final SID. A rollout is rewarded when any of its queries retrieves the target within the \mbox{top-$K$}, and per-query hit indicators localize that reward to individual hypotheses. Credit is thus assigned at the span level: only hypotheses that individually hit receive positive retrieval advantage, while the retrieval channel never updates the final SID span. Rollouts that share a SID reward can therefore receive different updates. Across experiments on three Amazon Reviews datasets, this yields consistent improvements in SID recommendation. On Video Games, an oracle analysis further reveals the potential of interest-conditioned SID decoding: selecting the target-relevant query among generated interests improves both recall and ranking.
Subjects:
Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.29983 [cs.IR]
(or
arXiv:2609.29983v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.29983
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
4. 【2609.29973】Learning Better Reasoning for Generative Recommendation with Semantic IDs
链接：https://arxiv.org/abs/2609.29973
作者：Mengdan Zhu,Yufan Zhao,Sophie Di,Yao Zhao,Tao Di,Yulan Yan,Sridhar Iyer,Liang Zhao
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：user interaction history, reformulates item retrieval, allowing a unified, interaction history, retrieval as sequence
备注：
点击查看摘要
Abstract:Generative recommendation reformulates item retrieval as sequence generation, allowing a unified model to directly generate the next item from a user's interaction history. Semantic IDs further make this paradigm effective and scalable by representing each item as discrete codes, enabling knowledge sharing among semantically related items. Recent studies introduce explicit reasoning before Semantic-ID generation, helping models summarize user interests and infer possible preference transitions. However, reasoning is not inherently beneficial: Inaccurate or uninformative reasoning may mislead subsequent item generation and ultimately degrade recommendation performance. This raises a central challenge: how can a recommender select and learn effective reasoning traces and progressively evolve toward better reasoning from its own generations? In this work, we propose Evo-Rec, a three-stage framework for learning better reasoning and further enhancing it through reinforcement learning. First, we align Semantic IDs with their textual and behavioral contexts, enabling the model to understand and generate item identifiers. Second, we sample multiple candidate reasoning traces and retain those that improve the prediction of the ground-truth item, providing a stronger reasoning initialization through supervised fine-tuning. Third, we further optimize the reasoning policy through reinforcement learning with catalog-constrained item generation and ranking-aware recommendation feedback. Experiments on three Amazon Review benchmarks show that Evo-Rec consistently outperforms discriminative, generative, and reasoning-enhanced recommenders across all evaluation metrics. These results demonstrate the effectiveness of our framework in learning better reasoning for SID-based generative recommendation.
5. 【2609.29933】An Empirical Study of VLM Pipelines for Long-Document QA
链接：https://arxiv.org/abs/2609.29933
作者：Kenan E. Ak,Jay Mohta,Gwang Gook Lee,Yan Xu,Dimitrios Dimitriadis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：Vision-Language Models, complex layouts, inputs combine text, long-document processing, pipeline
备注： 22 pages. EMNLP 2026 Industry Track
点击查看摘要
Abstract:Vision-Language Models (VLMs) are increasingly used for long-document processing, where the inputs combine text with charts, tables, figures, and complex layouts. Deploying them means choosing how to feed the document to the model, which retriever to use when only a subset of pages is sent, and whether to run the model agentically or as a static pipeline. We study these choices on two long-document QA benchmarks with both frontier API and open-weight VLMs. First, on MMLongBench-Doc our six-tool agent with page, table, figure, and search calls pays off only once the answering VLM is large enough: with Qwen3.5-4B and 9B it trails static page input, with Qwen3.5-27B it draws level, and with Sonnet 4.5 it leads. On LongDocURL it is level with or ahead of static input at every reader. Its lead over the strongest static pipeline is clearest with the frontier reader on MMLongBench-Doc and narrows to within noise on LongDocURL. Second, retrieval modality matters more than the specific retriever: the strongest image retriever leads the strongest text pipeline, and on the text side a single off-the-shelf cross-encoder rerank essentially matches a much heavier multi-stage LLM pipeline. Top-k image retrieval is also the most token-efficient input at every reader we paired it with, at roughly a seventh to a quarter of the tokens of sending every page. Third, cutting across all three choices, three of our strongest pipelines succeed on different questions, and an oracle that picks the best pipeline per question gains roughly thirteen points over the best single pipeline, though evidence-type routing recovers almost none of it.
6. 【2609.29819】Fair Feed Ranking for Participatory Budgeting
链接：https://arxiv.org/abs/2609.29819
作者：Carina I. Hausladen
类目：Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：large-scale participatory budgeting, participatory budgeting, citizens cannot inspect, agenda-setting power, large-scale participatory
备注： 8 pages, 2 figures, 2 tables. Published at GoodIT '26, the International Conference on Information Technology for Social Good, Pisa, Italy, September 2026
点击查看摘要
Abstract:In large-scale participatory budgeting, citizens cannot inspect the full proposal pool, so the order in which proposals are shown becomes a form of agenda-setting power. We argue that fair exposure should therefore be treated as a democratic-design goal. We study Consul Democracy, a widely deployed open-source digital-democracy platform, and show that its proposal feeds are typically ordered by popularity, recency, or comment activity. Building on this diagnosis, we propose FairFeed, a feed-ranking design for PB that uses transparently declared preferences, boosts under-exposed proposals, and admits a rate-limited reject channel for crowd-sourced vetting. We evaluate the design in a simulation anchored in Munich's 2025 PB process and compare it with random, newest, and most-commented feeds. In this simulation, FairFeed broadens proposal discovery, distributes visibility more evenly across the eligible pool, increases cross-cutting support, and improves resistance to manipulation relative to comment-based ranking. We conclude by outlining the human-subjects evaluation needed to test whether onboarding can recover voter preferences accurately enough for deployment in practice.
7. 【2609.29815】LSF-SR: Latent Semantic Fusion for Sequential Recommendation via Flow-based Conditional Variational Autoencoders
链接：https://arxiv.org/abs/2609.29815
作者：Shih-Hong Chen,Josh Jia-Ching Ying,Vincent S. Tseng
类目：Information Retrieval (cs.IR)
关键词：predict users' future, users' future interests, Large Language Models, Sequential recommendation aims, Conditional Variational Autoencoders
备注： Accepted at the 35th ACM International Conference on Information and Knowledge Management (CIKM 2026)
点击查看摘要
Abstract:Sequential recommendation aims to predict users' future interests from their historical interactions. Although Large Language Models (LLMs) capture rich item semantics, existing methods often struggle to align collaborative signals with textual semantic knowledge. As a result, the learned item representations fail to capture the complementary strengths of both signals, leading to suboptimal recommendation quality. To address this limitation, we propose Latent Semantic Fusion for Sequential Recommendation via Flow-based Conditional Variational Autoencoders (LSF-SR), a novel framework that uses a Conditional Variational Autoencoder (CVAE) with Normalizing Flows to fuse item ID embeddings and LLM-generated semantic signals. At the core of LSF-SR is a conditional fusion module augmented with planar or radial flows. This module learns a flexible latent space that encourages items with similar semantic profiles to cluster together within the latent manifold. Through extensive experiments on five public benchmark datasets, we demonstrate that LSF-SR consistently outperforms state-of-the-art baselines, achieving gains of up to 12.98% and 14.13% in Recall@20 and NDCG@20, respectively.
8. 【2609.29803】SEEK: Skill-Routed Evaluation with Evolvable Knowledge for Industrial Search
链接：https://arxiv.org/abs/2609.29803
作者：Zhongxin Huang,Songyang Li,Renzhe Zhou,Feiran Zhu,Chenglei Dai,Zhen Xiao,Xuanping Li,Jingwei Zhuo
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：evaluation criteria, evaluation, essential supervision, supervision and diagnostic, diagnostic signals
备注：
点击查看摘要
Abstract:Search quality evaluation provides essential supervision and diagnostic signals for the development and iteration of industrial search systems. Although large language models (LLMs) offer a scalable alternative to manual assessment, reliable automatic evaluation remains challenging: users experience search results at the page level, while the applicable evaluation criteria are multi-dimensional and continuously evolving. Packing all evaluation criteria into a unified prompt introduces irrelevant context and potential criterion interference, whereas internalizing them through post-training tightly couples rule updates with costly model retraining cycles. To address these issues, we propose Skill-routed Evaluation with Evolvable Knowledge (SEEK). Specifically, SEEK externalizes specific search evaluation criteria into a skill bank, dynamically routes relevant skills for each query-result list pair, and employs a task-adapted listwise evaluator to produce page-level judgments and failure mode attribution. A two-stage training pipeline teaches the evaluator to align evaluation criteria with human preferences, while a replay-gated skill bank allows recurring evaluation knowledge gaps to be incorporated without model retraining. Experiments on industrial short-video search show that SEEK improves listwise quality evaluation accuracy and achieves significant progress in attribution diagnosis. SEEK has been deployed at Kuaishou, a short-video platform with over 400 million daily active users, significantly improving the scale and quality of online search evaluation.
Subjects:
Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.29803 [cs.IR]
(or
arXiv:2609.29803v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.29803
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
9. 【2609.29735】C3M: Cross-Session Multimodal Memory Maintenance for Long-Horizon Tasks
链接：https://arxiv.org/abs/2609.29735
作者：Xueshu Chen,Yan Wang,Zihao Xue,Jiefu Li,Zhenfang Liu,Jayden Chen,Zhen Bi,Jungang Lou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：query-blind memory budget, Long-horizon tasks require, query-blind memory, recovering cross-session evidence, tasks require preserving
备注：
点击查看摘要
Abstract:Long-horizon tasks require preserving and later recovering cross-session evidence under a bounded, query-blind memory budget. Existing compression can discard fine-grained visual cues or conflate semantically similar but incompatible observations. We present C3M, a cross-session multimodal memory organization that maintains a bounded active index over persistent source text-image evidence. Relation-aware updates consolidate safe redundancy while preserving complementary and incompatible records. At query time, budgeted routing selects useful index pages and expands their associated source evidence under a fixed reader budget. Together, these mechanisms establish a compact, provenance-preserving multimodal memory organization for cross-session long-horizon tasks, retaining temporal distinctions and source links required for reliable downstream reasoning. Code is available at this https URL.
10. 【2609.29721】SALI: Shot-Aware Late Interaction for Cross-Shot Relation Matching in Text-to-Video Retrieval using Film-Grammar Knowledge
链接：https://arxiv.org/abs/2609.29721
作者：Toya Oyama,Rainer Lienhart,Shin'ichi Satoh
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Multimedia (cs.MM)
关键词：retrieval usually represents, Anna confronts Mark, represents a video, Shot-Aware Late Interaction, embedding
备注： 5 pages, 2 figures, 4 tables. Submitted to ICASSP 2027
点击查看摘要
Abstract:Text-to-video retrieval usually represents a video clip by a single embedding. This embedding often loses important relations between people. E.g., an interaction "Anna confronts Mark" is regularly filmed as alternating shot and reverse shot of both (Fig. 1a). No single shot or averaged embedding over clip shots captures this relation. Thus, we propose SALI (Shot-Aware Late Interaction). It extracts the subject and object from a single-sentence query, and matches the query, its subject and object text embeddings against each visual shot embedding of a video clip. The matching operator is greedy max or optimal transport. A film-grammar penalty in fine-tuning adds a small, consistent shift. Built on CLIP4Clip-meanP, SALI keeps overall recall on par on Condensed Movies and ActivityNet while raising R@1 on multi-shot relation queries by 3 and 12 points, the most among all compared methods, and improves such queries on MSR-VTT at a cost of 1.4 R@1 overall.
11. 【2609.29703】Stochastic Semantic Evidence Graphs: Uncertainty Propagation and Governance for Agentic AI
链接：https://arxiv.org/abs/2609.29703
作者：Matthew Francis Dixon
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (stat.ML)
关键词：AI-agent evaluations, final answer, generation or decision, decision mapping, evaluations usually inspect
备注：
点击查看摘要
Abstract:AI-agent evaluations usually inspect a final answer, yet error may enter through evidence, retrieval, prompting, generation or decision mapping. We introduce a stochastic semantic evidence graph (SSEG), a hierarchical stochastic DAG whose language node expands into an autoregressive token subgraph and whose observable output may be a law over complete phrases. Semantic reduction and calibration are optional. We define graph-relative local defects and downstream edge influences, derive a pathwise bound on terminal error and use its nodewise terms to diagnose governance triggers. For source provenance, the graph preserves uncertain claim--passage relations and propagates sharp Fréchet bounds rather than assuming independence across sources. Across three open-weight architectures, information-equivalent changes materially alter complete-phrase laws. A controlled experiment yields no certificate violations in 5,000 cases; crossed-RAG and live Brave-retrieval experiments separate retrieval, presentation, source and interaction effects. SSEG therefore turns workflow provenance into a quantitative account of where uncertainty entered, how it propagated and whether an output is qualified for use.
12. 【2609.29695】EvLink: Source-Grounded Evidence Linking for Graph RAG
链接：https://arxiv.org/abs/2609.29695
作者：Linyao Zheng,Xuhang Shi,Zhifang Mao,Sai Zhou,Shuaixian An,Xiuquan Hou
类目：Information Retrieval (cs.IR)
关键词：Graph-based Retrieval-Augmented Generation, Graph-based Retrieval-Augmented, Retrieval-Augmented Generation, reasoning by organizing, organizing corpora
备注： Accepted to EMNLP2026 MainConference
点击查看摘要
Abstract:Graph-based Retrieval-Augmented Generation (GraphRAG) supports multi-hop reasoning by organizing corpora into structured graphs. However, graph reachability often captures semantic association rather than evidence support, so a reachable passage may still fail to justify a required cross-passage transition. We propose EvLink, an evidence-linking retriever that preserves passages as retrievable evidence units and builds evidence-supported transitions between them. EvLink constructs two types of reliable links: relation-grounded evidence links justified by explicit source relations, and endpoint-alignment links serving as sourcebounded fallbacks. For retrieval, we introduce a two-stage retrieval strategy. First, bounded breadth-first search over source-grounded evidence links recovers bridge passages missed by similarity-based methods. Then, evidenceneed mining with noisy-OR coverage refinement selects a compact, non-redundant evidence set satisfying distinct question facets. Experiments on three multi-hop and two simple QA benchmarks show EvLink consistently outperforms leading GraphRAG baselines with average gains of 2.4 R@5, 1.9 EM, and 2.4 F1
13. 【2609.29661】Ingest-Time Fact Compilation for Cost-Efficient and Reliable Question Answering over Revised Corpora
链接：https://arxiv.org/abs/2609.29661
作者：Kyle Wild,Yusuke Takahashi,Asako Uraki
类目：Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：agentic question answering, important part, semantic work, source, question answering
备注： 6 pages, 5 tables, 1 figure. Accepted for presentation at the 2026 International Conference on Applied Science and Technology - Engineering Science (iCAST-ES 2026), Surabaya, Indonesia, October 2026. Code and frozen experimental artifacts: [this https URL](https://github.com/aix-sc/isc) (tag data-freeze-2026-07-16)
点击查看摘要
Abstract:Most agentic question answering (QA) systems do an important part of their semantic work at the worst possible time: every time someone asks a question. When a corpus contains revisions, drafts, revocations, deletions, and sources with different levels of authority, the model must reconstruct the governed current state on every read - then throw that work away and repeat it on the next query. This is a bit like a database that rebuilds a materialized view every time someone reads from it. We present ingest-time fact compilation, an architecture that performs this work when corpus data is ingested or changed. Raw passages are rephrased into self-contained facts; rules governing revisions, deletions, effective dates, and source trust are resolved once; and the resulting state is stored as typed records carrying source and revision provenance. At query time, an inexpensive model reads the compiled record instead of reconstructing it from noisy candidates. In a controlled synthetic experiment across five seeds, the same low-cost model produced the correct value, source, and revision in only one of 30 trials under query-time reconstruction, but in all 30 trials from the compiled substrate, at 12.89 times lower mean read cost per question. On simpler revision questions both architectures were exact, but the compiled path used 21.6 times fewer tokens. A separate test found that fact rephrasing roughly halved verbose Federal Reserve dialogue while preserving high source entailment, but left concise Wikipedia prose essentially unchanged. These results support a narrow but practical claim: resolving a corpus state once can make subsequent QA cheaper and more reliable for inexpensive models. We release the open source, MIT-licensed implementation and experimental artifacts.
14. 【2609.29652】SmallReason-ColBERT: An Ultra-Small Late-Interaction Retriever for Reasoning Intensive Retrieval
链接：https://arxiv.org/abs/2609.29652
作者：Abdelrahman Abdallah,Mohammed Ali,Adam Jatowt
类目：Information Retrieval (cs.IR)
关键词：Reasoning-intensive retrieval remains, retrieval remains difficult, Reasoning-intensive retrieval, small models, retrieval remains
备注： Accepted at MAIN EMNLP 2026
点击查看摘要
Abstract:Reasoning-intensive retrieval remains difficult for small models. Compact public ColBERTs are usually trained on general-purpose corpora and underperform reasoning-tuned 150M+ baselines on BRIGHT~\cite{bright} by several nDCG@10 points. However, no public reasoning-tuned ColBERT exists at edge scale. We introduce \textbf{SmallReason-ColBERT}, a 32M late-interaction retriever that closes much of this gap with three components: a varied-length contrastive warmup on ReasonIR-VL, a hard-negative contrastive polish on merged ReasonIR-HQ and BGE-Reasoner data, and a single-layer per-query-token importance head trained on top of the frozen base. The head is trained with an un-normalised weighted MaxSim score and evaluated with its length-normalised form. In a controlled re-training, replacing this training objective with the symmetric normalised score causes the loss to stall and costs $3.59$ nDCG@10. The full recipe reaches \textbf{21.41} mean nDCG@10 on BRIGHT, within $1.21$ of the 150M Reason-ModernColBERT (22.62) and above all $\le 33$M ColBERTs we evaluate. Through ablations on capacity, initialisation, and score variants, we further show that the learned head outperforms fixed IDF weighting and that simply thresholding the learned gates is harmful. this https URL
15. 【2609.29649】OBLIQ-IR: Training a Dense Retriever for Oblique Queries
链接：https://arxiv.org/abs/2609.29649
作者：Mahmoud Abdalla,Abdelrahman Abdallah,Shaimaa Sedek,Adam Jatowt
类目：Information Retrieval (cs.IR)
关键词：analogous reasoning technique, Oblique retrieval, find documents, exemplified by OBLIQ-Bench, latent attribute
备注： Accepted at MAIN EMNLP 2026
点击查看摘要
Abstract:Oblique retrieval, as exemplified by OBLIQ-Bench, asks a retriever to find documents whose relevance is determined by a latent attribute (an implicit stance, an analogous reasoning technique, an authorial fingerprint, or a vague tip-of-the-tongue recollection) that has little or no surface expression in the document. State-of-the-art dense encoders and agentic search pipelines built around frontier language models exhibit a large first-stage bottleneck on these tasks, while the same language models reliably verify relevance when shown candidates. We address this with OBLIQ-IR, a single-vector dense retriever whose training mixture combines per-mechanism synthetic queries with a new form of cross-model supervision: kNN-graph distillation from a frozen authorship encoder, which transfers a style-versus-topic inductive bias into the student. A 3B retriever fine-tuned reaches 0.211 NDCG@10 on Writing-Style, 0.171 on Math, 0.177 on Twitter, and 0.281 on Congress, improving over the GPT-5.2 Multi-Hop Agent by \xr{0.010 to 0.150} NDCG@10 and over Gemini-2-Embedding by 0.027 to 0.222 NDCG@10 on every reported task. The code, data and checkpoints are available this https URL
16. 【2609.29618】An Exploratory Ablation of a Small MLA--SSM Hybrid Language Model
链接：https://arxiv.org/abs/2609.29618
作者：Christos Koutsiaris
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Multi-head Latent Attention, parallel Multi-head Latent, Adaptive Latent Hybrid, custom recurrent state-space, Adaptive Latent
备注： 6 pages, 7 figures. Exploratory single-seed ablation study. Code and replication package available at [this https URL](https://github.com/unseen1980/talh)
点击查看摘要
Abstract:We report an exploratory, single-seed ablation of TALH (Adaptive Latent Hybrid), a decoder-only language model with parallel Multi-head Latent Attention (MLA) and a custom recurrent state-space (SSM) branch. Five variants, spanning 117--217M estimated active parameters per token, are trained from scratch on a FineWeb sample for the same number of optimisation steps and tokens. In this specific setup, removing the SSM branch gives the largest degradation in validation perplexity (MLA-only PPL 315), whereas removing MLA has a much smaller effect (SSM-only PPL 239). A dense-FFN hybrid obtains PPL 231, compared with 240 for the tested top-2 ternary-MoE hybrid, while using 3.87 GB less peak training memory. We also preserve a preliminary Apple M3 timing observation: among the five unoptimised implementations, MLA-only has the flattest measured time-to-first-token curve from 512 to 2,048 prompt tokens, although the dense Transformer is much faster in absolute terms. Because the runs are single-seed, parameter counts are unmatched, the evaluation stream may overlap the training source, and raw repeated timing records are unavailable, these results support implementation-specific hypotheses rather than general conclusions about MLA, SSMs, or mixture-of-experts models.
17. 【2609.29609】Anatomy of a Decision: Uncertainty-aware Hierarchical Intent Learning via Flow Matching for Multimodal Recommendation
链接：https://arxiv.org/abs/2609.29609
作者：Yuchen Miao,Zijun Wang,Ke Liu,Siyang Xu
类目：Information Retrieval (cs.IR)
关键词：existing methods struggle, crucial for recommendation, existing methods, methods struggle, underlying user intent
备注： 15 pages, 4 figures. Accepted at WISE 2026
点击查看摘要
Abstract:Modeling the underlying user intent is crucial for recommendation, but existing methods struggle with the inherent uncertainty and the dynamic, hierarchical nature of user interests. Current approaches often rely on clustering or prototype learning to discover a static set of intents. However, they face two critical challenges: (1) they overlook the uncertainty inherent in multimodal features; and (2) they assume a static and flat intent structure, failing to adapt to a user's varying decision certainty. To address these limitations, we propose UHIFlow, an Uncertainty-aware Hierarchical Intent learning framework via Flow matching. First, our Cross-modal Uncertainty Synergistic Modeling (CUSM) module leverages conditional flow matching to quantify uncertainty from visual and textual modalities and synergistically align them. Subsequently, the Uncertainty-guided Hierarchical Intent Generation (UHIG) module uses this quantified uncertainty to dynamically construct a personalized intent hierarchy, generating coarse-grained intents for uncertain users and fine-grained ones for users with clear preferences. Extensive experiments on three real-world datasets demonstrate that UHIFlow significantly outperforms state-of-the-art baselines.
18. 【2609.29474】CodeGraph: Open-Taxonomy Knowledge Graph for Source Code with Wikidata Grounding
链接：https://arxiv.org/abs/2609.29474
作者：Federico Pennino,Andrea Gurioli,Stefano Zacchiroli,Maurizio Gabbrielli,Paolo Ferragina
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Software Heritage Archive, Public software repositories, Heritage Archive, Public software, Software Heritage
备注： Accepted at CIKM 2026
点击查看摘要
Abstract:Public software repositories, like GitHub and Software Heritage Archive, store billions of files, yet extracting their implicit engineering knowledge ---i.e., the algorithms they implement, the paradigms they follow, the patterns they instantiate, and the application domains they serve--- remains challenging, as current tools are constrained to syntactic and token-level analysis. We present a pipeline for building an open-taxonomy semantic annotation of source code using a code-specialised Large Language Model. The extracted entities are grounded in Wikidata through a three-stage linking procedure: a deterministic SPARQL stage handles unambiguous entities, a Deep Research Agent resolves the residual long tail, and a hierarchy-rollup stage imports the parent-of closure of each resolved Wikidata identifier. The resulting annotations are materialised as a source-code-specific open-taxonomy knowledge graph. We further introduce a calibrated quality-assurance protocol that quantifies annotation precision by combining a small human gold set with an LLM-as-a-judge filter. We applied our pipeline to the 167 million files of the Stack-Edu corpus, creating the first known large-scale open-taxonomy knowledge graph for source code. Our graph, named CodeGraph, contains approximately 158 million nodes, which include around 145 million files, about 63,000 extracted concept entities (such as algorithms, paradigms, design patterns, and application domains), and roughly 19,800 grounded Wikidata entities. Furthermore, CodeGraph features approximately 1 billion typed edges that connect files to their respective concepts, link these concepts to their grounded Wikidata identifiers, and relate them to their parent categories, covering 14 programming languages.
19. 【2609.29455】A Systematic Multi-Domain Evaluation of Document Retrievers
链接：https://arxiv.org/abs/2609.29455
作者：Valentin Velev,Andreas Spitz
类目：Information Retrieval (cs.IR)
关键词：modern AI systems, directly influencing, influencing their effectiveness, downstream tasks, crucial component
备注：
点击查看摘要
Abstract:Document retrieval is a crucial component of many modern AI systems, directly influencing their effectiveness, robustness, and fairness in downstream tasks. While recent years have seen a growing number of retrievers, comparative studies in the literature are typically limited in scope or focused on singular benchmarks, domains, or model families. This fragmentation makes it difficult to draw reliable conclusions about the relative strengths, weaknesses, and trade-offs of document retrievers. To address this gap, we conduct a large-scale empirical evaluation of document retrievers, covering three families (sparse, dense, and expansion-based) and evaluating 33 retrievers across seven IR datasets, analyzing retrieval quality, runtime, and failure points. Rather than tuning each model individually, we evaluate every retriever off the shelf, under the configuration reconstructable from its public documentation and a uniform compute budget. Our results show that NV-Embed-v2 achieves the strongest performance on four of the seven datasets, albeit at the cost of substantial query latencies. Among sparse retrievers, we find that SPLADE-v3 rivals the top-performing approach despite much lower latency, and even achieves top scores on MS MARCO. On instruction-following datasets, GritLM delivers the best performance. Finally, an analysis of the retrievers' failure points reveals contrasts between models and families that indicate potential for unrealized gains in retrieval performance.
20. 【2609.29453】Decoupled Learning and Selection in Slate Recommendation for Privacy and Stability Under Noisy Scores
链接：https://arxiv.org/abs/2609.29453
作者：Sam Urmian,Qinyi Liu,Mohammad Khalil
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：randomized score learner, formalize slate recommendation, randomized score, score learner, deterministic selection
备注： 20 pages including supplementary appendix. Accepted at ACM RecSys 2026
点击查看摘要
Abstract:We formalize slate recommendation as a randomized score learner followed by deterministic selection. First, an appropriately scoped differential-privacy guarantee passes through selection and its audit trace by post-processing. End-to-end privacy holds only when selector inputs are public or independent, previous private outputs, or separately privacy-accounted; fixing raw state or candidate information instead yields only a conditional guarantee. Second, we derive a logged margin certificate: bounded score-induced objective movement below half the smallest greedy decision margin guarantees that the ordered slate is unchanged. Controlled fixed-margin tests show near-linear exponent scaling, with an empirical slope of $-0.220$ (95% CI $[-0.231,-0.210]$) against the independent-noise reference $-1/4$. Real-anchor experiments on OULAD, MovieLens-25M, and Amazon Musical Instruments show that greater anchor weight reduces score-noise-induced ranking churn. OULAD and EdNet certificate checks validate the implementation of the logged inequality, while closed-loop simulations show bounded target drift and setting-dependent downstream utility. The contribution is therefore a privacy-scope contract and a certifiable score-to-slate stability mechanism, not a universal utility claim.
Comments:
20 pages including supplementary appendix. Accepted at ACM RecSys 2026
Subjects:
Machine Learning (cs.LG); Information Retrieval (cs.IR)
Cite as:
arXiv:2609.29453 [cs.LG]
(or
arXiv:2609.29453v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2609.29453
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.1145/3773078.3831836
Focus to learn more
DOI(s) linking to related resources</p>
21. 【2609.29282】Asymmetric Dynamic Routing: Balancing Reasoning Depth and Computational Efficiency in Hypergraph RAG
链接：https://arxiv.org/abs/2609.29282
作者：Qi Sun,Yijia Zhang,Xingliang Hou,Caibo Li,Qiang Li,Yu Guo
类目：Information Retrieval (cs.IR)
关键词：Large Language Models, hypergraph-based Retrieval-Augmented Generation, Language Models, significantly mitigate hallucinations, Large Language
备注： 5 pages, 1 figures. Preprint
点击查看摘要
Abstract:While graph-based and hypergraph-based Retrieval-Augmented Generation (RAG) significantly mitigate hallucinations in Large Language Models (LLMs), existing structure-based RAG systems typically adopt static traversal strategies regardless of the query complexity. We identify this ``static retrieval fallacy'' as a primary source of computational redundancy for simple queries and cognitive context gaps for complex reasoning tasks. To balance reasoning quality and inference efficiency, we propose Asymmetric Dynamic Routing (ADR), an intent-conditioned retrieval framework operating over hierarchical knowledge graphs. ADR employs a lightweight structured classifier to dynamically dispatch queries among three asymmetric topological traversal operators: localized fact anchoring, bottom-up adjacency diffusion, and top-down insight grounding, which collectively enable bidirectional information flow across hierarchical knowledge layers. Extensive empirical evaluations across five domain-specific corpora demonstrate that ADR maintains strong reasoning performance while reducing prompt token consumption by up to 48.7\% and end-to-end query latency by 45.3\%, yielding a favorable quality--efficiency trade-off for query-adaptive Hypergraph RAG.
22. 【2609.29191】ASIRF: An Agentic Framework for Context-Dependent Sensitive Information Redaction
链接：https://arxiv.org/abs/2609.29191
作者：Sudha Priyadarshini,Mohamed Chahine Ghanem
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Agentic Sensitive Information, Sensitive Information Redaction, named-entity recognizers fix, Information Redaction Framework, Sensitive information
备注： paper accepted in NeurIPS 2026 GlobalSouthAI
点击查看摘要
Abstract:Sensitive information is defined by domain and intent, not a universal category, yet redaction systems such as privacy filters and named-entity recognizers fix a taxonomy at training time, requiring retraining for each new domain. We introduce ASIRF (Agentic Sensitive Information Redaction Framework), which retrieves domain-specific definitions based on the input's domain from a flexible knowledge base at inference time, needing no retraining to adapt. Two architectures, a three-call multi-agent pipeline and a single-agent variant, are evaluated across ten small open-weight models and eight datasets, including out-of-distribution fictional domains, against the OpenAI Privacy Filter (OPF) as a trained-classifier baseline. With only a few dozen expert-authored definitions per domain and no training data, ASIRF's recall exceeds OPF's in 68 of 80 model-domain combinations (85 percent), by at least one of the two architectures, with shortfalls confined mostly to OPF's training-distribution domains.
23. 【2609.29182】ScalarLens: Numerical Embeddings with Stable Coordinates and Contextual Responses for CTR Prediction
链接：https://arxiv.org/abs/2609.29182
作者：Heng Yao,Tianying Liu,Yulou Shu,Yong He,Chuan Yuan,Kaibin Qiu,Guowei Chen,Jiayu Zhao,Siyun Hou
类目：Information Retrieval (cs.IR)
关键词：click-through rate, prediction are built, convenient but restrictive, restrictive premise, Numerical
备注： 12 pages, 5 figures
点击查看摘要
Abstract:Numerical embeddings for click-through rate (CTR) prediction are built on a convenient but restrictive premise: a scalar has one representation. This premise conflates where a value lies with what it means for the current sample. On the Criteo validation split, the same numerical interval carries residual click evidence with opposite signs across categorical and numerical contexts, even after additive main effects are removed. Production pipelines compound this mismatch because externally normalized features require transformations and statistics to remain synchronized between training and serving. We introduce ScalarLens, a numerical embedding that preserves what a value is while adapting how it should be interpreted. A monotone local mesh constructs a stable coordinate from the focal scalar alone; bounded low-rank dynamics then produce a contextual response without moving that coordinate or replacing categorical tokens and the CTR backbone. In a 1,539-run primary evaluation covering 19 representations, three datasets, nine backbones, and three seeds, ScalarLens ranks first in 25 of 27 settings on original numerical scales and second in the remaining two. Matched ablations show that scale correction, additional local capacity, and generic conditioning do not reproduce the gain. A controlled study further recovers categorical, numerical, and mixed response mechanisms under context shift while the focal coordinate remains exactly invariant. A complete rerun under shared standardization retains significant advantages over DEER, DAES, and NaryDis, showing that the result is not explained by tolerance to raw scales alone. ScalarLens therefore recasts numerical embedding as a measurement problem: coordinates belong to values, while predictive responses belong to values in context.
24. 【2609.29180】X-Rec Technical Report
链接：https://arxiv.org/abs/2609.29180
作者：Chenglei Shen,Chenzhe Huang,Dong Jiang,Hongjie Gao,Jue Zhang,Kun Xú,Lincan Cai,Nan Zhuang,Pan Zhang,Shi Chen,Shunchi Zhang,Xiaoyu Ye,Yang Jin,Yu Zhang,Zhenwei An,Zhongtao Jiang,Zhiwei Wang,Kun Xǔ
类目：Information Retrieval (cs.IR)
关键词：reshaped recommender systems, Recent advances, next-item generation problem, modeling have reshaped, reshaped recommender
备注：
点击查看摘要
Abstract:Recent advances in generative modeling have reshaped recommender systems by formulating recommendation as a next-item generation problem. Existing retrieval approaches primarily follow two paradigms: user-to-item (U2I) methods represent user context using one or a few deterministic embeddings, which limits the ability to capture diverse and multi-mode interests, while semantic-ID-based autoregressive (SID-AR) methods model more expressive distributions but suffer from quantization errors and the low throughput of sequential decoding. To address these limitations, we propose X-Rec to directly learn the recommendation distribution in the continuous item embedding space through flow matching and generate embedding triggers for approximate nearest neighbor retrieval. X-Rec incorporates three key designs to make this formulation effective and efficient. First, we introduce anchor conditioning to decompose generation into coarse semantic-region selection and fine-grained refinement. Second, we adopt Riemannian flow matching to align generative trajectories with the hyperspherical geometry of item embeddings. Third, we design a late-interaction diffusion Transformer that restricts repeated velocity-field estimation to the final Transformer layer. On a streaming benchmark, X-Rec substantially outperforms U2I baselines, matches the retrieval quality of SID-AR methods, and delivers 3.46x higher inference throughput than SID-AR. X-Rec has also been deployed as a new retrieval source for a specific vertical content on TikTok, where two consecutive launches have yielded significant improvements in both vertical engagement (+4.1484%) and general engagement (+0.0111%).
25. 【2609.29145】Claim-Gated Source-Risk Auditing for Generative Search
链接：https://arxiv.org/abs/2609.29145
作者：Kainan Zhou,Chuhong Xu,Gangzhen Qian,Zhaoyi Li
类目：Artificial Intelligence (cs.AI); Computational Complexity (cs.CC); Computational Engineering, Finance, and Science (cs.CE); Emerging Technologies (cs.ET); Information Retrieval (cs.IR)
关键词：generative search answer, generative search, cite a supported, supported passage, passage yet omit
备注： International Conference on Artificial Intelligence, Automation and Algorithms (AI2A 2026)
点击查看摘要
Abstract:A generative search answer can cite a supported passage yet omit a source relationship that changes its interpretation. We specify a claim-gated audit of the query-source-answer tuple. An omission is resolved only when relationship evidence, answer adoption, materiality, and disclosure are all observed; incomplete evidence remains unresolved rather than being treated as independence. The specification separates this endpoint from citation support and review priority, and binds decisions to versioned evidence spans. A reference checker makes the record contract executable. On an exhaustive synthetic suite, it reproduces all 81 three-state predicate combinations and rejects 192 deliberately malformed records. Common-guard baselines and predicate ablations isolate endpoint logic from missing-evidence handling, while controlled transitions check support separation and evidence removal. These are finite contract-conformance results, not detector accuracy or evidence of improved user outcomes. We define the independent annotation, held-out evaluation, and paired utility tests still required to establish semantic validity and deployment benefit.
26. 【2609.28980】Seek: Self-Evaluative Exploration for Knowledge Retrieval
链接：https://arxiv.org/abs/2609.28980
作者：Amin Bigdeli,Radin Hamidi Rad,Negar Arabzadeh,Sajad Ebrahimi,Hai Son Le,Charles L. A. Clarke,Ebrahim Bagheri
类目：Information Retrieval (cs.IR)
关键词：leaving relevant documents, relevant documents permanently, documents permanently unrecoverable, resulting candidate set, advanced passage ranking
备注： Accepted at CIKM 2026
点击查看摘要
Abstract:LLM-based retrievers and rerankers have advanced passage ranking, yet both paradigms interact with the corpus in a single pass and commit to the resulting candidate set, leaving relevant documents permanently unrecoverable once missed. We introduce Seek, Self-Evaluative Exploration for Knowledge Retrieval, a training-free framework that addresses this limitation through iterative corpus interaction at test time. At each round, an LLM generates pseudo-passages conditioned on accumulated relevance feedback, a retriever surfaces fresh candidates, and a dedicated assessor assigns graded relevance judgments that guide subsequent rounds. On TREC Deep Learning, Seek matches trained rerankers in ranking quality while consistently improving Recall@100 over single-pass BM25. On the reasoning-intensive BRIGHT benchmark, Seek with Qwen2.5-7B achieves an 82% relative gain over BM25, surpassing all trained baselines, and Seek with GPT-4.1 reaches 37.4 average nDCG@10, exceeding the strongest baseline by 37%.
27. 【2609.28972】Cross-Country Code-Mixing for Generative Recommendation
链接：https://arxiv.org/abs/2609.28972
作者：Yuan Gao,Hao Deng,Haibo Xing,Yi Xu,Lingyu Mu,Jinxin Hu,Yu Zhang,Xiaoyi Zeng
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：conventional cross-domain methods, cross-domain methods rely, typically deployed, deployed with disjoint, disjoint user
备注： CIKM 2026 Short
点击查看摘要
Abstract:Cross-country recommendation on modern e-commerce platforms is typically deployed with disjoint user and item ID spaces across markets, removing the shared anchors that conventional cross-domain methods rely on. Generative recommendation (GR) mitigates this by mapping items into a shared token space and training a unified model, but existing approaches keep behavior sequences strictly country-specific, so knowledge transfer occurs only at the parameter level and remains absent at the data level. Inspired by code-switching corpora in multilingual natural language processing, we propose CMRec, a cross-country GR framework that injects cross-country supervision at the data level via dual-constrained, context-aware code-mixing. CMRec first learns a shared semantic codebook from multi-modal content and behavioral co-occurrence across countries. It then uses this codebook to synthesize mixed-country sequences via token-level substitutions that satisfy both static (content) and dynamic (e.g., price, audience, popularity) constraints. Finally, it introduces a context-aware loss that reweights mixed samples according to their plausibility in the current sequence. Experiments on two real-world multi-country datasets and an online A/B test show that CMRec substantially improves recommendation quality in data-sparse countries while preserving performance in data-rich countries, achieving +1.77% advertising revenue and +2.64% orders on a large-scale e-commerce platform.
28. 【2609.28765】Reinforcement Learning with Verifiable Rewards for Small Search Agents
链接：https://arxiv.org/abs/2609.28765
作者：Gaurisankar Jayadas,Aske Plaat,Álvaro Serra-Gómez,Sandheep P
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：clear remains open, Reinforcement Learning, Learning with Verifiable, Verifiable Rewards, clear remains
备注：
点击查看摘要
Abstract:Reinforcement Learning with Verifiable Rewards (RLVR) performs well on problems with clear rewards, such as mathematics and coding, but whether it also works where the reward is less clear remains open. The reason-over-search recipe applies RLVR to open-domain question answering, where retrieval grounds the answer and a match against the reference supplies the reward. So far it has been demonstrated on large models, and below one billion parameters only with distillation from a larger teacher. We test the recipe on a small model. We train Qwen3.5-0.8B with Group Relative Policy Optimization (GRPO) and an interleaved Wikipedia-search tool on MuSiQue, varying only the reward across three shapes over three seeds each, and we evaluate every checkpoint held-out on a seven-benchmark question-answering suite. The recipe works: the best run reaches 0.352 average exact match against a 0.092 untrained floor, a 3.8-fold gain, with no distillation step in the training loop. The reward shape also matters. The Search-R1-faithful exact-match-only reward is the worst of the three at every seed at the matched training horizon, and it is worst even on exact match, the metric it directly optimises. We conclude that the sparse exact-match reward, RLVR's default in mathematics and code, is the wrong starting point for models of this size. The reason-over-search setting can supply a suitable reward for RLVR on small models, but small-model RLVR needs its own reward-design study rather than a scaled-down copy of a large-model recipe.
29. 【2609.28653】he Fellowship of the Query: Learning Retrieval Actions
链接：https://arxiv.org/abs/2609.28653
作者：Mohammed Al-Maamari,Saber Zerhoudi,Michael Granitzer,Jelena Mitrović
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Retrieval-augmented question answering, question answering requires, answering requires control, requires control decisions, Retrieval-augmented question
备注：
点击查看摘要
Abstract:Retrieval-augmented question answering requires control decisions about when to decompose a question, search, reformulate, extract evidence, synthesize facts, verify progress, and stop. We study whether trajectory fine-tuning can improve small language models (SLMs) as next-action controllers. We additionally evaluate a low-resource setting in which a single SLM serves as both the controller and the final-answer generator. From accepted teacher search traces, we build a seven-way action-prediction task, where the model predicts the next structured teacher action from the current trajectory state, and evaluate LoRA-supervised fine-tuning across SLMs and xSLMs as controllers. On 1,646 held-out action examples, Granite 4.1 3B trained on 13,194 actions reaches macro-F1 0.6536, compared with 0.1736 for zero-shot prompting of the same model and 0.5399 for a TF-IDF logistic-regression baseline. In an end-to-end controller/generator swap evaluation over 149 held-out trajectories, using the fine-tuned model for both roles improves Exact Match from 0.7530 to 0.7946 and token F1 from 0.7783 to 0.8295 compared with using the base model as both controller and generator. The cross-role conditions show that the fine-tuned controller increases evidence-fact recording when the generator is fixed, while controller-only final-answer gains are not statistically clear. Overall, trajectory supervision improves action prediction and evidence-recording behaviour in this evaluated pipeline. Code is available at this https URL
30. 【2609.28589】OneTrans-V2: Unifying Retrieval, Pre-rank, and Fine-rank with One Transformer in Industrial Recommender
链接：https://arxiv.org/abs/2609.28589
作者：Hannan Cao,Jun Guo,Haolei Pei,Zhaoqi Zhang,Tianyu Wang,Ziyang Wang,Youchen Sun,Yue Xue,Yucheng Mao,Lintao Yan,Yufei Feng,Shaowei Liu,Rongkun Xing,Feiling Gong,Xinyu Chenli,Cong Xu,Mingge Zhang,Yunjia Zhu,Yajing Zhang,Pengfei Ren,Yue Lin
类目：Information Retrieval (cs.IR)
关键词：causing repeated user-sequence, duplicated engineering effort, systems typically operate, repeated user-sequence encoding, isolated optimization
备注：
点击查看摘要
Abstract:Industrial recommendation systems typically operate as a \emph{cascade} of retrieval, pre-rank, and fine-rank, but these stages are usually trained and served as separate models, causing repeated user-sequence encoding, isolated optimization, and duplicated engineering effort. Building on OneTrans' model-level unification, we present OneTrans-V2, one Transformer that unifies the entire cascade. It encodes the user behavior sequence once as a shared context while preserving stage-specific candidate features and computation. Joint training lets the three stages reinforce one another and enables in-model knowledge distillation from fine-rank to pre-rank. We scale the shared backbone with sparse mixture-of-experts (MoE), which increases capacity with bounded activated computation, and stabilize scaling with $\mu$P-style parameterization. To consolidate objective-specific retrieval channels, we introduce Decision-Conditioned Generative Retrieval (DCGR). DCGR predicts a decision prefix describing the upcoming interaction and generates items conditioned on it, allowing business objectives to steer a single generative process. Finally, Sequence-Native Training (SNT) organizes training around each user's lifelong behavior sequence and amortizes its encoding across exposures. Deployed across all three stages of a large-scale industrial recommendation system, OneTrans-V2 improves gross merchandise value (GMV) by 9.74\% and, with a co-designed serving stack, delivers $3.2\times$ the throughput of the cascade it replaces under the same hardware budget.
计算机视觉
1. 【2609.30249】RAPID: Robot Agentic Programming from Demonstrations
链接：https://arxiv.org/abs/2609.30249
作者：Yuyao Liu,Jiayuan Mao,David Hsu,Leslie Pack Kaelbling,Tomás Lozano-Pérez
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：complex programming problems, solving complex programming, Coding agents, Robot Agentic Programming, demonstrated enormous success
备注：
点击查看摘要
Abstract:Coding agents have demonstrated enormous success in solving complex programming problems. To leverage their potential for robot systems, this work introduces Robot Agentic Programming from Demonstrations (RAPID), which automatically generates, verifies, and refines robot programs, given a single visual human demonstration. The iterative agentic loop of code refinement requires several key ingredients: (i) a testable task specification, (ii) action primitives for robot execution, and (iii) an interactive environment for program execution and verification. RAPID infers all three from the demonstration automatically. To make the resulting program reusable beyond the demonstration setting, RAPID uses an object-centric relational program representation that focuses on the underlying structure of the demonstrated strategy rather than the specific motion per se: it expresses the action primitives as trajectory-optimization programs that realize object-level motion effects, while composing them through relational constraints that capture scene-specific geometry at run time. We evaluated RAPID in simulation on eight challenging contact-rich nonprehensile manipulation tasks as well as general prehensile manipulation tasks in the LIBERO-Pro benchmark. We also successfully deployed it on a real Franka arm and evaluated on all eight nonprehensile tasks. In all experiments, RAPID demonstrated strong performance, with generalization over object pose, shape, material, and environment. Website: this https URL.
2. 【2609.30247】Rolling-WAM: World Action Models with Rolling Imagination
链接：https://arxiv.org/abs/2609.30247
作者：Yinghua Zhou,Junjie Ye,Yiqi Zhao,Hao Dong,Celina Shiyu Wang,Ruohai Ge,Tingyi Yang,Basile Van Hoorick,Gaurav Sukhatme,Vitor Guizilini,Yue Wang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：World Action Models, couple action generation, World Action, Action Models, couple action
备注： 10 pages, 7 figures, 5 tables. Under review. Project page: [this https URL](https://rolling-wam.github.io/)
点击查看摘要
Abstract:World Action Models (WAMs) couple action generation with future visual prediction for robotic manipulation. However, completing the joint video-action denoising process at each replanning cycle incurs substantial latency, delaying action updates and limiting closed-loop responsiveness. We present Rolling-WAM, a formulation that distributes joint denoising across successive replanning cycles. Our method maintains a sliding window of video-action chunks at staggered noise levels. At each step, a rolling noise schedule fully denoises the imminent action chunk for execution, while partially refining farther-future chunks. As the window advances with new camera observations, the retained future chunks continue their denoising process. This distributes the computational cost over time while carrying an evolving visual-action context across chunk boundaries. Evaluations on LIBERO, RoboTwin, and a real-world Unitree G1 humanoid show that Rolling-WAM achieves competitive manipulation performance. By removing the need to denoise the entire prediction horizon from scratch, it delivers a 4.5x steady-state replanning speedup over standard joint WAMs.
3. 【2609.30245】owards Practical Compression of 3D Gaussian Splatting
链接：https://arxiv.org/abs/2609.30245
作者：Pengpeng Yu,Yueru Chen,Fei Song,Tai Qin,Qi Zhang,Jing Wang,Yulan Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enables high-quality novel-view, requires substantial storage, high-quality novel-view synthesis, Gaussian Splatting, enables high-quality
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) enables high-quality novel-view synthesis but requires substantial storage. Existing compression methods often rely on spatial context modeling over irregular 3D representations, increasing the complexity of training and coding. Meanwhile, floating-point context inference can introduce numerical inconsistencies across platforms, causing entropy-decoding failures. To address these practical challenges, we propose COSA-GS, which constructs context without spatial aggregation through anchor-wise causal factorization. Specifically, we use geometry context derived from each anchor's coordinates to model a compact learnable anchor latent. The anchor latent is then fused with the geometry context to form an anchor context for attribute coding. The resulting context model features a simple architecture composed solely of linear transformations and activations. We train COSA-GS using rate--distortion optimization with adaptive Gaussian pruning. Further, we develop quantization-aware training and integer inference for the context model to achieve bit-exact consistency of entropy-decoded symbols across platforms. Experiments demonstrate that COSA-GS achieves state-of-the-art compression performance while retaining fast and consistent cross-platform decoding, providing a simple yet effective framework for practical 3DGS compression. Code is available at this https URL.
4. 【2609.30238】SemMSA: Latent Semantic-Aided Robust Multimodal Sentiment Analysis with Incomplete Data
链接：https://arxiv.org/abs/2609.30238
作者：Wenhao Li,Zhibin Wu,Chong Xiao,Qiangchang Wang
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Multimodal Sentiment Analysis, infer human sentiment, Sentiment Analysis, Recent research, human sentiment
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Recent research on Multimodal Sentiment Analysis (MSA) has focused on learning from language, visual, and acoustic modalities with incomplete data to infer human sentiment. Most studies typically compensate for missing information by reconstructing modality features or designing complicated fusion mechanisms. However, these methods still suffer from spurious generation and noisy guidance due to the lack of high-level semantic grounding in partially observed multimodal evidence. To address these issues, we propose SemMSA, a latent semantic-aided framework that constructs rich sentiment-relevant semantics with LLMs, fully integrating with all modalities via anchor-free spectral alignment. It mainly consists of Cross-modal Semantic Refinement (CSR) and Cross-modal Spectral Alignment (CSA). Specifically, CSR first adaptively extracts visual and acoustic representations by corresponding adapters to form a unified multimodal prefix with language in the frozen LLM embedding space. It then iteratively produces continuous discriminative semantic states through a token-efficient latent refinement process without decoding explicit text. Next, CSA simultaneously aligns the refined semantics with all modalities by enhancing the dominant spectral component of their kernel Gram matrix. This captures global nonlinear dependencies among all representations without relying on a predefined anchor modality. In addition, an instance-level spectral separation constraint preserves cross-sample discriminability and mitigates representation collapse. Extensive experiments on SIMS, MOSI, and MOSEI benchmarks demonstrate that SemMSA achieves state-of-the-art performance.
5. 【2609.30234】OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstruction
链接：https://arxiv.org/abs/2609.30234
作者：Ding-Jiun Huang,Yuanhao Wang,Cheng Zhang,Hugo Bertiche,Alexandru-Eugen Ichim,Thabo Beeler,Fernando De la Torre
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：digital content creation, generation of production-ready, content creation, central challenge, challenge in digital
备注： Accepted to SIGGRAPH Asia 2026. Project Page: [this https URL](https://humansensinglab.github.io/OmniFabric/)
点击查看摘要
Abstract:Automated generation of production-ready 3D garment assets from a single image is a central challenge in digital content creation. While recent generative models have significantly advanced 3D geometry reconstruction, synthesizing high-quality textures remains a bottleneck. Existing methods often bake environmental illumination and shadows directly into the texture map, or they fail to maintain global structural coherence, making the resulting assets unusable for physical simulation and relighting. In this work, we introduce OmniFabric, a novel approach that synthesizes globally coherent texture maps directly within the 2D sewing pattern space. Given a single reference image, our pipeline utilizes an estimated 3D mesh and generative priors of powerful Vision-Language Models (VLM) to establish a complete but coarse texture initialization across the unwrapped sewing patterns. We then leverage a specialized diffusion transformer, trained via an automated synthetic data engine and conditioned on 3D positional features, to refine this initialization directly in the canonical UV domain. This effectively removes distortion and baked-in artifacts to extract a clean and normalized texture map that preserves the original garment design. Extensive experiments demonstrate that OmniFabric significantly outperforms state-of-the-art baselines, yielding photorealistic 3D garments with high-quality textures.
6. 【2609.30226】PoEM: Predicting RL Outcomes from Existing Policies
链接：https://arxiv.org/abs/2609.30226
作者：Kimia Hamidieh,Giannis Daras,Antonio Torralba
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：maximize specific rewards, Foundation models, reinforcement learning, human alignment, reward function
备注：
点击查看摘要
Abstract:Foundation models are post-trained with reinforcement learning (RL) to maximize specific rewards, such as human alignment, correctness, or instruction following. This post-training process is computationally intensive, sometimes unstable, and has to be run from scratch every time the reward model changes or when we want to combine multiple rewards. We hence ask: given a new reward function, is it possible to predict the RL outcomes without actually running RL on it? We answer this in the affirmative by introducing PoEM, a framework to predict the outputs of RL on a new reward function using a set of models already post-trained on other rewards. First, we show that if the new reward function can be written as a linear combination of existing ones, then the new policy in log-space can be written as a linear combination of the existing log-policies. Surprisingly, even in cases where the rewards are not linearly connected, we observe that often log-policies from RL training span an approximately low-rank subspace across rewards. To our benefit, the weighting coefficients for this combination can be estimated using only the reward or basis policy outputs on the samples. We turn these observations into an algorithm that takes post-trained models and a new reward function, and approximates the target RL policy without actually running any additional RL training. We experimentally validate our approach across synthetic and real rewards, spanning both text and image modalities.
7. 【2609.30223】BiCC: Bidirectional Connected-Component Loss for Instance-Aware Segmentation
链接：https://arxiv.org/abs/2609.30223
作者：Luc Bouteille,Frederic Jonske,Jens Kleesiek,Alexander Jaus
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Common segmentation losses, aggregate errors voxel-wise, Common segmentation, segmentation losses aggregate, losses aggregate errors
备注： 2 figures, 3 tables. Code: [this https URL](https://github.com/TIO-IKIM/BiCC-Loss)
点击查看摘要
Abstract:Common segmentation losses aggregate errors voxel-wise, so lesions influence the objective in proportion to their volume, giving small but clinically critical lesions disproportionately little weight. Instance-aware losses aim to address this mismatch by assigning each lesion its own term. However, blob loss and CC-DiceCE derive their regions solely from annotations, so false-positive components receive no instance-level term. This matters in computer-assisted review, where each false-positive component may require separate inspection, making precision and false-positive burden important alongside recall. We introduce the bidirectional connected-component loss (BiCC), which pairs annotation- and prediction-derived partitions to score predicted components on their own scale. By deriving instances from the predictions, this branch directly penalizes false-positive components regardless of their size. The balance parameter $\alpha$ allows control over the lesion-wise precision-recall trade-off. Across five datasets with five-fold cross-validation using nnU-Net, BiCC outperforms CC-DiceCE in lesion-wise F1 on four datasets and blob loss on all five. It significantly improves over DiceCE on three datasets and matches it on two; CC-DiceCE instead loses up to 0.363 precision by favoring recall. Code is available at this https URL.
8. 【2609.30222】rackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations
链接：https://arxiv.org/abs/2609.30222
作者：Ayush Jain,Sreeharsha Paruchuri,Ishita Gupta,Fan Zhang,Tanner Schmidt,Jakob Engel,Katerina Fragkiadaki,Adam W. Harley
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：Existing point tracking, fundamental tradeoff, Existing point, face a fundamental, set of query
备注：
点击查看摘要
Abstract:Existing point tracking models face a fundamental tradeoff: they can either track a sparse set of query points over long horizons, or track all points across only short clips. We introduce TrackEverything, a 3D point tracker that breaks this trade-off by representing videos as persistent 3D scene tracks in world coordinates. Grounded in the insight that videos are 2D projections of an underlying 3D world, TrackEverything decouples model complexity from video duration, allowing it to scale with unique physical scene geometry instead. Our approach introduces three key innovations. First, we employ a voxelization-based de-duplication mechanism at sliding-window boundaries to merge co-located tracks, preventing repeated observations of the same surface from redundantly accumulating. Second, we decompose tracking into an endpoint refiner that predicts each point's destination and static-versus-dynamic classification, followed by a lightweight trajectory refiner that decodes dense trajectories exclusively for dynamic points. Third, we propose 3D WAFT, replacing memory-prohibitive 4D correlation volumes with efficient feature sampling in the scene cloud. To the best of our knowledge, TrackEverything is the first 3D tracker capable of tracking all visible points across videos exceeding 1000 frames within 40 GB of GPU memory. On TAPVid-3D, TrackEverything outperforms all open-source all-frame dense 3D trackers by more than 20% APD on short clips, while remaining competitive with state-of-the-art sparse trackers on long sequences, despite tracking far more points.
9. 【2609.30221】WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation
链接：https://arxiv.org/abs/2609.30221
作者：Yubo Zhu,Yawen Shao,Ziyun Dai,Zixun Fang,Kai Zhu,Siyang Sun,Haolan Xue,Chuxin Wang,Tingyu Weng,Jingming Luo,Chen Shi,Lianghua Huang,Yufeng Ai,Yuzheng Wang,Wenyuan Zhang,Yu Shang,Yuxiang Bao,Zoubin Bi,Jie Xiao,Jinbo Xing,Jiaxing Zhao,Chongyang Zhong,Hengjian Chen,Chenwei Xie,Akide Liu,Zhehan Kan,Yu Liu,Wei Zhai,Sheng Zhong,Wei Tong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Video generation begins, materializes into pixels, generation begins, begins in text, text space
备注：
点击查看摘要
Abstract:Video generation begins in text space by authoring a cinematic screenplay, then materializes into pixels. As contemporary video generators scale to 30 seconds and faithfully follow complex conditions, the textual prompt largely directs the production, planning how actions, camera trajectories, lighting, and sound unfold across multi-shot sequences. In this paper, we present WanPE, a 397B-parameter prompt enhancement model trained on 1.05M real-world videos to master director-level cinematic planning. WanPE formulates shot-level cinematic plans via video-grounded reverse construction and employs Semantic-Consistency GRPO (SC-GRPO) to faithfully preserve user requirements across shots and over time. To benchmark this capability, we curate WanPEval, a human-annotated testbed covering durations from 5 to 30 seconds across varying intent granularities, supported by approximately 11K blind pairwise assessments. When powering Wan3.0's video generator, WanPE-397B boosts human preference over raw user prompts by 10.66-18.84 points at 5-15 seconds and by a dramatic 50.86 points in the 30-second arena. Ablation studies show that reverse construction demonstrates clear superiority over forward rewriting, while SC-GRPO robustly preserves semantic fidelity across model scales. Ultimately, WanPE leads all evaluated commercial offerings at 5-15 seconds and remains competitive with Seedance 2.5 at 30 seconds.
10. 【2609.30210】he Alignment Illusion in Multimodal Large Language Models
链接：https://arxiv.org/abs/2609.30210
作者：Hong-Han Wang,Yuntao Wang,Hu Ding
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Large Language, Multimodal Large, Large Language Models, model progressively integrates, progressively integrates visual
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Layer-wise visual-text similarity in Multimodal Large Language Models (MLLMs) is widely interpreted as evidence that the language model progressively integrates visual content into a shared representation space. This reading rests on the assumption that scalar alignment scores reflect content-level cross-modal interaction. To test this assumption, we apply controlled interventions to the visual stream. Across 13 MLLMs from five families spanning 0.5B to 72B parameters, replacing projector-output visual tokens with Gaussian noise sharply reduces task accuracy, yet four standard scalar measures (CKA, SVCCA, MIR, and the leading principal-angle cosine) fail to consistently separate the corrupted stream from the original. We call this failure the alignment illusion and trace it to the shared language-model pathway: anisotropic MLP down-projections pull visual and text tokens toward common output directions, producing weight-induced alignment. Because this component is essentially one-dimensional, we introduce the principal-angle gap (PA gap), defined as the difference between the top two principal-angle cosines, which separates weight-induced similarity from multi-directional visual structure. Under graded visual corruption, the PA gap tracks task accuracy more consistently than the scalar scores we consider; under a structured but irrelevant image, it further exposes regimes in which internal geometry and task accuracy come apart. Internal visual-text alignment in MLLMs is therefore best read as a geometric diagnostic of the visual stream inside the language model rather than a direct proxy for content-level cross-modal interaction, and is most informative when calibrated by controlled task evidence.
11. 【2609.30187】Ego-Exo4D Human Meshes Dataset: 4D Human Motion Reconstruction for Ego-Exo Captures
链接：https://arxiv.org/abs/2609.30187
作者：Abhiram Maddukuri,Georgios Pavlakos
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：procedural activity understanding, providing synchronized egocentric, multi-view exocentric video, dataset providing synchronized, large-scale dataset providing
备注： Project website: [this https URL](https://abhiram824.github.io/egoexo4d_human_meshes)
点击查看摘要
Abstract:Ego-Exo4D is a large-scale dataset providing synchronized egocentric and multi-view exocentric video, a rich resource for skill learning and assessment, procedural activity understanding, and embodied AI. However, the dataset ships with only sparse 3D human pose annotations, and reconstructing dense human motion from its multi-view captures is nontrivial. To this end, we present Ego-Exo4D-HM, a large-scale dataset of 4D human motion reconstructions for Ego-Exo4D's captures, and release the accompanying reconstruction pipeline. The code, dataset, and documentation can be found at this https URL.
12. 【2609.30130】Multimodal Thinking with Renderable Programs
链接：https://arxiv.org/abs/2609.30130
作者：Sunli Chen,Ding Zhong,Ziqiao Ma,Jiaxin Liu,Zeyuan Yang,Hao Zhang,Lie Lu,Joyce Chai,Chuang Gan
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Current vision-language models, Current vision-language, visual content understanding, content understanding, structure limits
备注：
点击查看摘要
Abstract:Current vision-language models (VLMs) excel at visual content understanding and text-based reasoning, yet their structure limits the advancement of incorporating images into the reasoning chain. Though Omnimodal models have made efforts in unifying text and image generation, they focus on visual tasks in the open-domain, lacking tractability due to rasterized or latent representations of images. We introduce SVGLM, a framework that uses scalable vector graphics (SVG) primitives to connect text and image in reasoning tasks. We exploit the duality of SVG as both image description and text instructions, yielding a more compact, interpretable solution to equip general VLMs with the capability of generating images within the reasoning process. We provide a large curated dataset of SVG-based image editing dataset, as well as the paradigm to tune open-source VLMs. Experiments on a mathematical reasoning benchmark demonstrate that SVGLM achieves strong SVG generation power as well as think-with-image intelligence. Our results highlight SVG as a suitable medium for building more robust digital domain agents, bridging the gap between text-based thinking and pixel-based images.
13. 【2609.30121】What, When, and How: Audio Description as Constrained Global Optimization
链接：https://arxiv.org/abs/2609.30121
作者：Igor Sterner,Mirella Lapata,Alex Lascarides,Frank Keller
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：visually impaired audiences, Audio Description, narrating visual information, accessible to blind, blind and visually
备注：
点击查看摘要
Abstract:Audio Description (AD) makes movies accessible to blind and visually impaired audiences by narrating visual information in gaps between dialogue. Existing automatic AD systems largely treat generation as a local video-to-text problem, assuming that the content to describe and its temporal location are already provided. Realistic AD instead requires coupled decisions about what visual information is narratively important, when it can be spoken without interfering with dialogue, and how it should be formulated to fit within the available time. We formalize AD generation as a constrained optimization problem over these three decisions. Our hybrid system uses large language models to propose and ground visual elements, estimate their salience to the narrative, and generate compressed realizations. A mixed-integer linear program then jointly selects and schedules descriptions across a scene subject to temporal constraints. When evaluated on REFRAMED, a benchmark for realistic AD of movies, our approach makes better decisions than prompted LLMs about what to describe and when to describe it, establishing a new SOTA on narrative QA and temporally grounded metrics. Ablations show that explicit temporal constraints drive gains in placement, while salience estimation controls how much narratively useful content is retained. Improvements are concentrated on temporal and narrative measures rather than n-gram overlap, although a significant gap to professional describers remains.
14. 【2609.30107】Smartphone-Based Method for Automated Speed Enforcement
链接：https://arxiv.org/abs/2609.30107
作者：Keya Li,Jahnavi Malagavalli,Lamha Goel,Tong Wang,Kara M. Kockelman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：hold significant promise, enhancing road safety, assisting public agencies, enforcing traffic laws, computer vision
备注：
点击查看摘要
Abstract:Smartphone cameras and computer vision (CV) hold significant promise in assisting public agencies with enforcing traffic laws and enhancing road safety. This work designs and tests a smartphone-based method for automated speed estimation and vehicle identification (license plate, make/model, and color recognition) via an automated pipeline to assist enforcement agencies in reliably identifying speeders. The CV code accurately recognizes nearly half (46%) of the license plates' text on 1,800 images from a Brazil open-source dataset, called UFPR-ALPR. Code tests on daytime recordings from hand-held smartphone videos (n = 73) and roadside cameras (n = 42) in Austin, Texas yield 60.8% accuracy for color detection (among all possible RGB color categories), 48.6% on vehicle make/manufacturer identification, and 16.89% on vehicle make and model identification. Prediction accuracy for speed estimation (within a 20% range), vehicle make (within the top 3 predictions), and license plate recognition (within the top 10 predictions) are 16.3%, 16.9%, and 29.7%, respectively. This paper also illuminates the legal, technological, and practical aspects of using smartphones for enforcement, including the potential use of recordings for enforcement purposes, emphasizing the need to transform the potential of smartphone-based CV technologies into practical tools for vital information on traffic violations.
15. 【2609.30096】Accelerating Video Diffusion via Training-Free Trajectory Routing
链接：https://arxiv.org/abs/2609.30096
作者：Mustafa Munir,Huy Vu,Shreyas Misra,Rohit Jena,Sajad Norouzi,Ali Taghibakhshi,Anis Ahmad,Anjul Patney,Pavlo Molchanov,Nima Tajbakhsh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：model, large model, times, large, steps
备注：
点击查看摘要
Abstract:Video diffusion is computationally expensive, as it requires executing a large model across many denoising steps. Even with step-distillation, inference remains expensive because every distilled step still requires a costly model evaluation. We present TRACK: TRajectory-Aware Capacity routing via top-K selection, a heterogeneous denoising strategy that switches between compatible large and small models at selected steps, reducing the average cost per denoising evaluation. The switching steps are determined using a calibration process. TRACK first rolls out a reference trajectory with the large model. Then at each step, the small model's prediction is also collected and compared against the large model's prediction to obtain a relative disagreement score. Both models receive the same latent, timestep, conditioning, and guidance inputs. Aggregating this signal over a calibration set produces a disagreement score map across diffusion steps, which determines a switching policy for an efficient inference process: quality-sensitive steps keep using the large model, while steps with low disagreement scores are routed to the small model. Inference executes only the selected model at each step, requiring no retraining, architecture or scheduler changes, or online dual-model evaluation. Across Wan 2.1, Cosmos 3, TurboDiffusion, and FastVideo, TRACK yields $1.95\times$, $2.04\times$-$2.73\times$, $2.69\times$, and $2.17\times$ speedups, respectively, with comparable aggregate quality and high diversity retention. TRACK thereby establishes automated, training-free model switching as a practical acceleration paradigm for video diffusion.
16. 【2609.30092】Self-Adaptive VLA for Robust Robot Deployment
链接：https://arxiv.org/abs/2609.30092
作者：Hongxin Zhang,Chunru Lin,Tsun-Hsuan Wang,Zhenjia Xu,Chuang Gan
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrate impressive capabilities, memoryless nature renders, models demonstrate impressive, imperfect calibration, demonstrate impressive
备注：
点击查看摘要
Abstract:While Vision-Language-Action (VLA) models demonstrate impressive capabilities in robotic manipulation, their memoryless nature renders them brittle to test-time environment shifts, particularly hardware shifts caused by wear or imperfect calibration. Enabling these models to self-adapt during deployment without requiring continuous on-site recalibration remains a critical bottleneck for real-world scalability. In this work, we introduce Self-Adaptive VLA, a novel post-training recipe that enables the policy to iteratively adapt to deployment-time hardware shifts leveraging its own rollouts as context. To do so, we first collect policy rollouts under deliberately injected hardware shifts. We then transform the base policy's training data into shift-conditioned expert demonstrations by pre-compensating the expert actions for these known shifts. Next, we introduce a lightweight, plug-in context encoder that compresses the context, including visual observation, proprioception, and actions in the shifted environment, into a latent context token. This token modulates the policy through adaptive layer normalization (AdaLN). Furthermore, we find that context tokens can be ensembled, allowing the policy to iteratively self-correct and mitigate failures step by step. Extensive experiments across four precision-critical bi-manual and dexterous manipulation tasks show that Self-Adaptive VLA recovers over 80% of the base policy's performance under hardware shifts, such as actuation bias and joint encoder offsets. Moreover, Self-Adaptive VLA enables more robust deployment to new workstations compared to the base policy. Our approach provides a pathway for robust large-scale real-world robot deployments and easier maintenance. See videos at this https URL.
17. 【2609.30080】Can Frozen Hyperspherical Features Guide the Selection of Pseudo Masks?
链接：https://arxiv.org/abs/2609.30080
作者：Xinge Guo,Fengyang Xiao,Dingming Zhang,Yuhan Chen,Rihan Zhang,Xingjian Li,Tianyang Wang,Chunming He,Sina Farsiu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Foundation segmenters, inherits its errors, return several plausible, wrong one inherits, SAM return
备注： 29 pages, 11 figures, 19 tables
点击查看摘要
Abstract:Foundation segmenters such as SAM return several plausible masks for an unlabeled image, and a student trained on the wrong one inherits its errors. Choosing among them means querying a second large model or fitting a quality head to annotated masks. We show that a candidate can be judged by what it does to a frozen self-supervised backbone's features. Normalized DINOv2 patch features lie on a hypersphere, and a candidate mask splits that sphere in two. Based on this reading, we introduce SphereTrust, which scores each candidate by three properties of the split, the angular contrast between the two sides, the coverage of the foreground's appearance modes, and contact with the image frame, one for each of three common ways a mask fails, and ranks a pool in 0.55 s per image from the frozen features alone. On eight SAM and SAM3 candidate pools spanning camouflaged, salient, and dichotomous segmentation and camouflage under low light, SphereTrust exceeds the strongest evaluated external baseline on six pools by 1.7 to 9.3 percentage points in mean selected Dice. These comparisons include published selection rules and explicitly labeled adaptations of DSS and UCOD-MKD. On the two prompted camouflage pools, its mean selected Dice is within 0.1 percentage points of the candidate-derived DSS adaptation, with a lower catastrophic-error rate. Which cue carries the signal depends on the candidate pool. The same sphere also supports training. The leading candidates enter as a candidate set with their scores as priors, prototypes reorder them, and a cross-fitted second round completes the labels, raising weighted F by 4.5, 2.3, and 5.5 points over fixed-label training on the three MLLM anchor pools, with students competitive with published unsupervised methods on nineteen test sets.
18. 【2609.30056】M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesis
链接：https://arxiv.org/abs/2609.30056
作者：Yang Zhou,Jiuhong Xiao,Shizhao Ye,Long Quang,Carlos Nieto-Granda,Giuseppe Loianno
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：NVS methods rely, generative NVS methods, complementary sensor common, robotic platforms, generative NVS
备注：
点击查看摘要
Abstract:Robotic novel view synthesis (NVS) must recover both visual appearance and metric 3D structure, yet most generative NVS methods rely only on images, overlooking LiDAR, a complementary sensor common on robotic platforms. We present M3GD, a Camera--LiDAR multimodal representation for generative NVS that composes independently pretrained 2D image and 3D point-cloud foundation models without separately pretraining a cross-modal translator. We show that, after camera projection, frozen LiDAR and image features exhibit substantial shared spatial structure, providing a natural cross-modal representation. M3GD conditions generation on LiDAR through this structure: it combines explicit geometry statistics with learned point-cloud descriptors into view-aligned packets on the image-latent grid, injected through a lightweight residual adapter into a multi-view flow-matching generator whose latent space, decoders, and training objective remain intact. On the GrandTour dataset, M3GD improves target-view RGB and depth synthesis over an image-only version of the same backbone. Ablations show that the gains come from pixel-aligned LiDAR content and that target-view LiDAR acts as a geometric query linking the requested view to source observations. Deployment on a ground robot demonstrates practical real-world operation, with a configurable quality--cost trade-off controlled by the number of Euler integration steps.
19. 【2609.30043】ConPro: Contrast Projection Pretraining for Label-Efficient Vessel Segmentation in DSA Sequences
链接：https://arxiv.org/abs/2609.30043
作者：Xinge Guo,Yuanhao Wang,Liqi Shu,Yang Liu,Min Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dense vessel annotation, digital subtraction angiography, Dense vessel, unlabeled sequence records, vessel annotation
备注： 5 pages, 4 figures, 2 tables. Submitted to IEEE ICASSP 2027
点击查看摘要
Abstract:Dense vessel annotation in digital subtraction angiography (DSA) is labor-intensive, yet every unlabeled sequence records how contrast passes through the vessels. Semi-supervised methods take their targets from the current model, and generic self-supervised pretexts reconstruct static appearance, so this signal goes unused. We propose ConPro, a self-supervised pretraining scheme whose target is a contrast projection, the normalized drop of every pixel below its temporal median over the sequence. On DIAS and DSCA, with 10%, 20% and 50% of the training cases labeled, ConPro improves on training from scratch at every label fraction and is the best of the compared methods on DSCA at 20% and 50% labels. Controlled comparisons show that the gain comes from the target. A temporal-median target with the same input, loss and budget stays at scratch level, and using the projection directly instead of learning it, as an input channel or a pseudo-label, helps little or hurts. ConPro provides pretrained weights without changing the segmentation architecture, so it combines with semi-supervised training, and UniMatch, the strongest baseline, gains 0.5 to 2.0 Dice and 0.9 to 2.3 clDice at every label fraction when started from ConPro weights, reaching 75.4 Dice on DIAS and 81.3 on DSCA.
20. 【2609.30037】AERIAL: Adversarial Evaluation of Robustness in Accuracy-Preserving Low-Precision EEG Decoders
链接：https://arxiv.org/abs/2609.30037
作者：Saim Rehman,Muhammad Shafique
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Signal Processing (eess.SP)
关键词：vulnerability remains unclear, computer interfaces, Deployment-oriented compression, resource-constrained brain, attractive for resource-constrained
备注： Submitted to IEEE ICASSP 2027, 5 pages
点击查看摘要
Abstract:Deployment-oriented compression is attractive for resource-constrained brain--computer interfaces (BCIs), but whether it changes adversarial vulnerability remains unclear. On BCI Competition IV-2a, we compare 32-bit floating-point (FP32) EEGNet and ShallowConvNet models with global magnitude pruning and simulated INT8 post training quantization (PTQ) and quantization-aware training (QAT) across nine subjects and three seeds. Simulation provides differentiable quantize--dequantize models for white-box attacks and gradient analysis, while native TensorRT deployment is used for validation. Accuracy-preserving compression does not improve direct robustness: at $\epsilon=0.005$, EEGNet PGD accuracy remains 22--24\% across FP32, 50\% pruning (P50), PTQ, and QAT. However, P50 reduces bidirectional transfer efficiency to 0.963/0.928 (FP32$\rightarrow$P50/P50$\rightarrow$FP32), versus 0.994/0.997 for PTQ; the same trend holds for ShallowConvNet. Gradient alignment shows a corresponding separation, while native PTQ agrees with simulated clean/adversarial predictions in 95--98\% of cases. These results show that direct robustness, adversarial transfer, and deployment efficiency are distinct properties of compressed EEG decoders.
21. 【2609.30026】raining-Free Hold-Usage Detection in Sport Climbing with Foundation Pose Models
链接：https://arxiv.org/abs/2609.30026
作者：Abu Bakar,Abdullah Aftab,Amir Hamza
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：underpins automated scoring, movement analysis, underpins automated, automated scoring, sport climbing
备注： Accepted at AI2ML Conference 2026 (2nd International Conference on Advancement Innovation in Artificial Intelligence and Machine Learning)
点击查看摘要
Abstract:Detecting which holds a climber uses, and when, underpins automated scoring, movement analysis, and assistive systems for sport climbing. Existing approaches train task-specific models or repurpose 2D pose estimators whose hand keypoint sits at the wrist and foot keypoint at the ankle i.e. offset from the fingertips and toes that actually contact the holds, and whose hands are occluded in roughly half of all frames. We show that a frozen, off-the-shelf pose foundation model is sufficient: using the fingertip and toe keypoints of Sapiens, a per-frame proximity test against the annotated holds, per-limb mutual exclusion, and a short temporal-persistence rule, we detect hold usage without any climbing-specific training. On the The Way Up dataset (22 videos, 10 athletes, two routes), our method reaches an event F_1 of 90.2% on a held-out split (89.8% under leave-one-participant-out cross-validation) and 79.9% over all 22 videos at any temporal overlap, and performs best on footholds (F_1,89.8% overall, 96.6% held-out). Under an identical protocol it exceeds our reproductions of the YOLOv8-pose and ViTPose pipelines at every temporal threshold, with the margin widening under strict timing. An ablation shows that two intuitively helpful additions---dense foundation-feature change gating and body-part segmentation---both hurt, arguing that a minimal, keypoint-only design is the right one for this task. Finally, standard coaching statistics computed from our automatic predictions track ground truth closely (Pearson r=1.00 for climb time, 0.94 for pace), turning ordinary single-camera video into reliable performance metrics with no instrumentation.
22. 【2609.29999】GHOST-Q: Towards Studying Grounding Hallucinations Overlooked Under Same-score TradeOffs in Quantized VLMS
链接：https://arxiv.org/abs/2609.29999
作者：Saim Rehman,Muhammad Shafique
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：Post-training quantization, language models, quantization of vision, typically assessed, preserving a headline
备注： Submitted to IEEE ICASSP 2027, 5 pages
点击查看摘要
Abstract:Post-training quantization of vision--language models (VLMs) is typically assessed through aggregate task accuracy and memory savings, but preserving a headline score does not guarantee preservation of visual grounding behavior. We present GHOST-Q, a cross-precision controlled evaluation of three 8B VLM families under FP16, INT8, and NF4 across utility and hallucination-sensitive benchmarks. Rather than comparing only aggregate accuracy, we pair FP16 and quantized predictions item by-item to quantify how compression redistributes grounding successes and failures. Five of six quantized variants preserve MMStar accuracy within $\pm2$ percentage points, yet 10 of 36 paired effects remain significant after false-discovery-rate correction, nine on hallucination-sensitive conditions. Same-device A100 profiling further demonstrates that substantial memory reduction does not necessarily mean lower inference latency. Finally, an open-ended AMBER audit reveals strong generation budget censoring whose severity varies by architecture and precision. These results show that quantized VLMs should be evaluated jointly for aggregate utility, grounding reliability, generation behavior, and realized deployment efficiency.
23. 【2609.29985】OceanXL: Large-scale Underwater 3D Gaussian Splatting via Block Partitioning and Adaptive Pruning
链接：https://arxiv.org/abs/2609.29985
作者：Haoran Wang,Shaoyu Cai,Adrian Azzarelli,Zhuodong Jiang,Guoxi Huang,Eng Tat Khoo,Brett Seymour,Fan Zhang,David Bull,Nantheera Anantrasirichai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：subsea infrastructure inspection, limited capture coverage, large scale due, ecological monitoring, infrastructure inspection
备注： SIGGRAPH ASIA 2026
点击查看摘要
Abstract:Underwater 3D reconstruction is critical for marine exploration, ecological monitoring, and subsea infrastructure inspection, yet remains challenging at large scale due to light attenuation, scattering, and limited capture coverage. While 3D Gaussian Splatting (3DGS) enables high-quality real-time rendering, its application to large underwater scenes is constrained by high memory consumption and inefficient optimization over extensive areas. We propose OceanXL, a fast and scalable 3DGS-based framework for large-scale underwater reconstruction. OceanXL adopts a divide-and-conquer strategy, partitioning scenes into spatially coherent blocks to enable efficient optimization while preserving global geometric consistency. We further introduce an adaptive pruning scheme tailored to underwater conditions that removes redundant primitives, producing compact representations without sacrificing visual fidelity. Together, these components improve training efficiency and rendering performance for large scenes. We also introduce a large-scale underwater dataset covering diverse marine environments. Experiments on five large-scale scenes demonstrate favorable scalability, compactness, and efficiency--quality trade-offs over large-scene baselines. Controlled comparisons on the small-scale SeaThru-NeRF dataset further show competitive reconstruction quality with substantially smaller model sizes than underwater-specific methods.
24. 【2609.29963】ADATEX4D: adaptive texture capacity allocation for 4D gaussian splatting
链接：https://arxiv.org/abs/2609.29963
作者：De Jiang,Peiqiang Wang,Kehong Yuan,Shaohua Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：weakly visible regions, Textured Gaussians improve, Textured Gaussians, primitive wastes storage, visible regions
备注：
点击查看摘要
Abstract:Textured Gaussians improve local appearance capacity, but assigning the same texture resolution to every primitive wastes storage on low-detail or weakly visible regions. We introduce AdaTex4D, an adaptive texture-capacity module for deformation-based 4D Gaussian Splatting. Each Gaussian carries packed RGBA triplanes whose two axes grow independently according to visibility normalized screen-space gradients and deformed local scales. Experiments on N3DV and PanopticSports show that AdaTex4D reduces texture storage by more than half while preserving reconstruction quality. Under fixed memory budgets, adaptive allocation also improves quality over uniform texture assignment and reduces overall model and peak memory. These results show that dynamic, anisotropic texture allocation provides a more efficient way to distribute local appearance capacity in 4D Gaussian representations.
25. 【2609.29959】Not All Confusion Is Equal: A Source-Aware Uncertainty Diagnosis for Fine-Grained Aircraft Detection
链接：https://arxiv.org/abs/2609.29959
作者：Hai Huang,Helmut Mayer
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Fine-grained object detectors, object detectors, detectors are commonly, commonly evaluated, model is confused
备注： 23 pages, 4 figures
点击查看摘要
Abstract:Fine-grained object detectors are commonly evaluated with confusion matrices, which show where the model is confused but not why, nor whether the confusion can be reduced. We argue that confusion can be attributed to distinct, separable sources, each quantitatively measurable, turning a passive measurement into actionable guidance. We present $A^2E^2$, a diagnostic tool that decomposes the sources of confusion along two axes, $\{$aleatoric, epistemic$\} \times \{$within-class, between-class$\}$, giving a $2\times2$ taxonomy that enumerates the source types. Each quadrant is measured by its own quantity, computed in one of three places (input geometry, output-space disagreement, and the bias-parameter posterior), so the two epistemic sources are separated by construction rather than by an empirical correlation. On fine-grained aircraft detection, the four quadrants become four named sources with their own remedy verdict: affinity (geometric similarity, irreducible from size alone), heterogeneity (geometrically heterogeneous sub-variants, pointing to re-labeling rather than more data), contested (an insufficiently trained but learnable boundary, improvable), and collapsed (a class starved of data, reducible). After attributing the confusion to a specific reducible source, we apply a targeted intervention and verify experimentally that it reduces the diagnosed source specifically while leaving the irreducible sources unchanged. $A^2E^2$ thus turns confusion measurement into a concrete, validatable and actionable "diagnosis" in which the same off-diagonal mass can carry opposite causes and opposite remedies. We also state this framework's limits, including which sources are only partially identifiable on this specific dataset and why.
26. 【2609.29940】Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration
链接：https://arxiv.org/abs/2609.29940
作者：Jiaqi Deng,Zonghan Wu,Zhan Heng,Xiaoshui Huang,Huan Huo,Guandong Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：large language models, Multimodal large language, language models, achieve strong performance, large language
备注：
点击查看摘要
Abstract:Multimodal large language models (MLLMs) achieve strong performance on visual reasoning tasks, yet remain prone to hallucinations and over-reliance on language priors, often generating answers without adequately using task-relevant visual evidence. Existing approaches primarily improve reasoning through reasoning-oriented supervision or inference-time strategies. In this work, we study a complementary question: can multimodal reasoning be improved by strengthening implicit visual grounding without directly supervising the reasoning process? Motivated by the functional specialization of attention heads, we investigate whether reasoning can be improved by guiding only the heads most responsive to visual evidence grounding. We propose Selective Probability Mass Concentration (sPMC), a training framework that identifies grounding-responsive heads and selectively regularizes their text-to-image attention. sPMC treats normalized attention over visual tokens as a spatial probability distribution and encourages the probability mass to be assigned to semantically relevant regions using segmentation-derived spatial priors. Adaptive Head Selection restricts this guidance to visually responsive heads while leaving the remaining heads unconstrained to preserve their complementary functions. Across 6 multimodal benchmark suites, sPMC achieves an average zero-shot improvement of 3% and gains of up to 11.3% across multiple MLLMs while regularizing only 3%-15% of their attention heads. These results demonstrate that targeted guidance of sparse and implicit visual evidence pathways can directly improve multimodal reasoning.
27. 【2609.29934】Beyond Spatial Benchmarks: From Spatial Reasoning to Navigation
链接：https://arxiv.org/abs/2609.29934
作者：Xun Huang,Shijia Zhao,Rongsheng Qu,Jiayuan Li,Xin Lu,Weixin Li,Chenglu Wen,Cheng Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：reasoning benchmarks translate, benchmarks translate, spatial reasoning benchmarks, Existing benchmarks test, navigation
备注：
点击查看摘要
Abstract:Does progress on spatial reasoning benchmarks translate into better navigation? Existing benchmarks test isolated inferences from images or videos, with little connection to downstream navigation. Our analysis reveals a gap between benchmark-oriented spatial specialization and navigation performance, and shows how aligning spatial supervision with navigation goals, phases, and decision learning improves navigation. Guided by these findings, we build \textsc{Spatial-Nav-100K} and fine-tune in two stages, \textit{i.e.} first learning a shared spatial-navigation foundation, and then specializing each phase with the abilities it relies on. We further introduce Spatial-NPD, where a teacher conditioned on spatial priors produces grounded action preferences and distills them into a student policy, so no explicit spatial reasoning is needed at inference. With 45 A100 GPU-hours of policy training, our 8B model reaches SR/SPL of 77.4/35.4 on HM3D-v0.2, 60.2/30.5 on HM3D-v0.1, and 47.9/20.6 on train-unseen MP3D. It outperforms several systems that rely on closed-source models or thousands of GPU-hours of training, at 148 ms per action step. All code and datasets will be publicly available at this https URL.
28. 【2609.29933】An Empirical Study of VLM Pipelines for Long-Document QA
链接：https://arxiv.org/abs/2609.29933
作者：Kenan E. Ak,Jay Mohta,Gwang Gook Lee,Yan Xu,Dimitrios Dimitriadis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：Vision-Language Models, complex layouts, inputs combine text, long-document processing, pipeline
备注： 22 pages. EMNLP 2026 Industry Track
点击查看摘要
Abstract:Vision-Language Models (VLMs) are increasingly used for long-document processing, where the inputs combine text with charts, tables, figures, and complex layouts. Deploying them means choosing how to feed the document to the model, which retriever to use when only a subset of pages is sent, and whether to run the model agentically or as a static pipeline. We study these choices on two long-document QA benchmarks with both frontier API and open-weight VLMs. First, on MMLongBench-Doc our six-tool agent with page, table, figure, and search calls pays off only once the answering VLM is large enough: with Qwen3.5-4B and 9B it trails static page input, with Qwen3.5-27B it draws level, and with Sonnet 4.5 it leads. On LongDocURL it is level with or ahead of static input at every reader. Its lead over the strongest static pipeline is clearest with the frontier reader on MMLongBench-Doc and narrows to within noise on LongDocURL. Second, retrieval modality matters more than the specific retriever: the strongest image retriever leads the strongest text pipeline, and on the text side a single off-the-shelf cross-encoder rerank essentially matches a much heavier multi-stage LLM pipeline. Top-k image retrieval is also the most token-efficient input at every reader we paired it with, at roughly a seventh to a quarter of the tokens of sending every page. Third, cutting across all three choices, three of our strongest pipelines succeed on different questions, and an oracle that picks the best pipeline per question gains roughly thirteen points over the best single pipeline, though evidence-type routing recovers almost none of it.
29. 【2609.29932】It's the Geometry, Not the Model: Effective Rank and Subspace Alignment in Functional Connectivity Classification
链接：https://arxiv.org/abs/2609.29932
作者：Xiao Fan,Jingyuan Li,Yubo Han,Hongbin Guo,Guanya Li,Yang Hu,Wenchao Zhang,Weibin Ji,Yi Zhang
类目：Computational Geometry (cs.CG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Resting-state functional connectivity, classify brain phenotypes, Resting-state functional, functional connectivity, phenotypes and disorders
备注：
点击查看摘要
Abstract:Resting-state functional connectivity (FC) is widely used to classify brain phenotypes and disorders. Most pipelines use the full connectome and seek gains through model design. We instead examine how FC geometry constrains classification and cross-site transfer. Across-subject FC variation concentrates in a small effective subspace, suggesting substantial redundancy in nominal dimensions. Across cohorts, these subspaces may differ in orientation even when their effective ranks are comparable, potentially limiting transfer. Across 2,330 subjects from HCP, ABIDE, and ADHD-200, effective-rank analysis reveals strong spectral concentration. Projection onto leading components at the effective-rank scale recovers most of the full-FC classification performance. In ABIDE, site-specific effective subspaces are weakly aligned, and their principal-angle overlap predicts pairwise transfer after covariate adjustment despite comparable per-site effective ranks. Controlled rotations that alter subspace orientation while preserving the mean and covariance spectrum drive transfer toward chance, whereas displacement-matched label-orthogonal rotations do not. These results identify subspace orientation as a key factor in transfer degradation under controlled perturbations. This study offers a geometric diagnostic of FC generalization and suggests evaluating cross-site harmonization by its ability to align effective subspaces alongside classification accuracy.
30. 【2609.29930】EndoFSA: Endoscopic Few-Shot Image Generation via Rank-Constrained Parameter Adaptation
链接：https://arxiv.org/abs/2609.29930
作者：Panagiota Gatoula,Grigoris Karypidis,Dimitris K. Iakovidis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：abnormality detection systems, produces large-scale gastrointestinal, significantly underrepresented limiting, deep-learning based abnormality, based abnormality detection
备注： Presented at the 39th IEEE International Symposium on Computer-Based Medical Systems (CBMS 2026), June 2026
点击查看摘要
Abstract:WCE produces large-scale gastrointestinal image data yet pathological findings remain significantly underrepresented limiting the generalization performance of deep-learning based abnormality detection systems. SDG methods offer a practical solution to mitigate this imbalance. However their training directly on scarce abnormal samples often results in instability overfitting and structural distortions. Addressing these challenges requires controlled adaptation mechanisms that preserve anatomical priors while enabling realistic pathological variation. This paper presents EndoFSA a GAN-based model for Endoscopic Few-Shot image generation by Adaptation in WCE imaging. EndoFSA leverages a generator pretrained on abundant normal data and adapts it to abnormal domains using limited number of training samples through a rank-constrained parameter adaptation where only a small number of modulation parameters is updated while the pretrained weights remain frozen. By restricting parameter updates to a low dimensional subspace and incorporating perceptual boundary regularization and cluster-wise diversity control EndoFSA enables efficient model adaptation under limited data conditions and mitigates mode collapse while preserving the anatomical priors learned from normal data. Importantly EndoFSA operates without requiring pixel-level annotations, masks or bounding box supervision. Evaluation on publicly available WCE benchmark datasets spanning various abnormal categories demonstrates that EndoFSA generates abnormal images reproducing real lesions morphology. Moreover in a downstream classification task training an image classifier solely on synthetic abnormal images generated by EndoFSA yields performance comparable to that obtained with real images.
31. 【2609.29875】When Can Agents Forget Their Reasoning? ICLR for Long-Horizon Agent Context Compression
链接：https://arxiv.org/abs/2609.29875
作者：Mingxuan Wang,Fei Luo,Bo Wang,Guorun Yao,Yinglong Guo,Chao Ning,Hongyue Chen,Yanbiao Ma,Jungong Han
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：increasing context length, horizon language model, Long horizon language, continually accumulate reasoning, language model agents
备注： 30 pages
点击查看摘要
Abstract:Long horizon language model agents continually accumulate reasoning history, increasing context length and inference cost even after earlier decisions have been executed and observed. Unlike static Chain of Thought compression, removing historical reasoning can change future actions and the resulting interaction trajectory. We study when such reasoning can be safely forgotten. We propose Interaction Aware Compression for Long Horizon Reasoning (ICLR), a training free online method that ranks reasoning blocks using frozen proxy entropy while preserving actions, tool calls, and observations. On 260 WorkBuddyBench tasks, ICLR improves average reward from 0.699 to 0.718, while reducing input, output, and cache read tokens by 25.5%, 14.4%, and 33.3%, respectively. Ablations reveal trajectory amplification, where local reasoning deletion produces nonlinear changes in total computation by altering subsequent interaction. Representation probing, activation patching, and controlled trajectory analyses further suggest that historical reasoning becomes more replaceable once task relevant derived state has been reliably externalized into code, files, tool outputs, or environmental feedback. These results characterize agent reasoning as dynamic working state rather than permanent interaction history.
32. 【2609.29864】Efficient Continuous DEM Reconstruction under Limited Target-Resolution Supervision
链接：https://arxiv.org/abs/2609.29864
作者：Zekai Shi,Meng Zhang,Haokun Zhang,Bo Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：Earth observation applications, support Earth observation, High-resolution digital elevation, digital elevation models, support Earth
备注： 19 pages, 15 figures
点击查看摘要
Abstract:High-resolution digital elevation models (DEMs) support Earth observation applications, but paired training references are often available only at coarser output resolutions. Reconstructing finer terrain grids therefore requires both effective transfer beyond the supervised scale and control of dense-query computation. To address this problem, SCOPE learns a continuous terrain representation from coarser-resolution pairs. It predicts a latent coefficient field on the low-resolution grid and reuses local Fourier residual functions through basis evaluation and geometry-guided ensemble fusion. This separates high-dimensional coefficient prediction from output-grid construction. Experiments on geographically distributed land--ocean samples assess supervised reconstruction, unseen-scale inference, cross-domain generalization, and theoretical computation. SCOPE leads the compared methods across six metrics in the main supervised-scale evaluation. At an unseen factor three times the training factor, land reconstruction reduces RMSE and MAE by approximately 12\% relative to bicubic interpolation, with errors close to target-scale fine-tuning. Ninefold output density increases counted multiply--accumulate operations by only about 2\%. Frozen-model validation on held-out external marine regions reduces RMSE relative to the DEM-specific implicit baseline EBCF-CDEM by approximately 19\% under self-downsampling and 2\% with cross-product inputs, while also yielding lower RMSE than LIIF-MS in both settings. These results demonstrate the value of reusable coefficient fields for accurate reconstruction beyond the supervised resolution with low incremental arithmetic cost.
33. 【2609.29863】Modelling dynamic systems transfer functions from events in computational neuromorphic imaging
链接：https://arxiv.org/abs/2609.29863
作者：Nimrod Kruger,Gregory Cohen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Event Vision Sensing, Point Spread Function, static scene produces, static optical system, Vision Sensing
备注： Conference paper - SPIE Sensors + Imaging 2026
点击查看摘要
Abstract:Event Vision Sensing (EVS) report threshold crossings of log-irradiance, so a static optical system imaging a static scene produces no output at all. The classical procedure for measuring a Point Spread Function (PSF), illuminating the system with a constant point source, therefore has no event-based equivalent: the probe must carry a temporal profile, and that profile becomes part of the measurement. A growing body of Computational Neuromorphic Imaging (CNI) work already exploits this, pairing engineered or modulated optics with event sensing, but each system adopts a particular excitation together with a particular reading of the event stream without the correspondence between the two being stated. We examine that correspondence directly within a analytical framework of an Linear Shift-Invariant (LSI) optical system with a specified Modulation Transfer Function (MTF), a first-order filter EVS pixel model, and three different temporal probes: a step function, a linear ramp and an exponential ramp. By analysing the inverse of the entire chain for different event-statistic, and comparing the results to the specified MTF, we identify the context where each probe is most relevant. We consider how photon-noise and cross-array threshold mismatch effects the analytical accuracy of the probe-inverse. Results show that the widely used step probe is highly susceptible to mismatch while resilient to photon shot-noise, while a linear rise probe and exponential rise probe retain their ability to infer signal levels even with high mismatch. We discuss the potential of dynamic-PSFs as components of a full forward operator from scene to events. In this, we use this analytical description to define dynamic-PSFs around EVS, and discuss the gaps toward a unified pixel model and a scene-composition framework required for CNI.
34. 【2609.29850】BeyondRetarget: Learning Executable Humanoid Motions Directly from Monocular Video
链接：https://arxiv.org/abs/2609.29850
作者：Tianyu Xiong,Yi Lu,Jinrui Wang,Ziqi Liang,Dandan Lei,Xiaoyang Zhou,Xiao-xiao Long,Qiu Shen,Xun Cao
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Learning executable motions, Learning executable, acquire demonstration motions, offers a scalable, scalable solution
备注：
点击查看摘要
Abstract:Learning executable motions from human videos offers a scalable solution for humanoid robots to acquire demonstration motions. However, existing pipelines typically first construct an explicit human motion representation and then convert it into robot motions via motion retargeting. Although such methods can effectively leverage large volumes of existing human data for training, the substantial differences between humans and humanoid robots in locomotion mechanisms and joint degree-of-freedom configurations make motions generated by this human-representation-centric approach difficult to execute on robots. Furthermore, errors introduced during human motion estimation inevitably propagate to the retargeting stage and cannot be eliminated via joint optimization. We propose BeyondRetarget, an end-to-end framework that directly maps monocular RGB videos to robot motions. Discarding the explicit human representation, this framework learns robot-oriented implicit representations directly from visual observations, enabling the model to capture cross-morphology motion structures. To generate motions more suitable for robot execution, we further design a contact-aware motion optimization mechanism to improve temporal consistency and physical plausibility. Experiments show that BeyondRetarget significantly improves the accuracy and robustness of generated robot motions, while achieving higher execution success rates and lower latency in both simulation environments and real humanoid robots.
35. 【2609.29836】SplatLabel: Pseudo-Labelling through 4D Gaussian Splatting
链接：https://arxiv.org/abs/2609.29836
作者：Nitya Nanvani,Andras Palffy,Holger Caesar
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Vision Foundation Models, Foundation Models offer, Vision Foundation, typically requires complex, requires complex heuristics
备注：
点击查看摘要
Abstract:While 2D Vision Foundation Models offer a pathway to automate 3D semantic pseudo-labelling, translating these priors into robust 3D representations typically requires complex heuristics or multi-model ensembles. We introduce SplatLabel, an automated pipeline that leverages a 4D Gaussian representation to extract LiDAR segmentation with predictive confidence, as well as semantic occupancy grids at arbitrary voxel resolutions. At its core, SplatLabel handles dynamic environments through an explicit temporal manifold that models the trajectories and lifespans of individual 3D primitives. This allows the system to accurately track moving actors and strictly define when objects appear and disappear, completely eliminating the need for pre-annotated 3D bounding boxes. To robustly support this dynamic tracking, the representation is grounded by structural and semantic priors: we guide scene geometry in unobserved regions by integrating 360-degree LiDAR via virtual depth maps, and rather than relying on domain-specific prompt engineering, we directly distill continuous soft probabilities from 2D models to inherently resolve semantic ambiguities over time and space. Finally, to accurately reflect the real-world trade-off between precision and recall, we reframe pseudo-label evaluation as a selective classification task using a generalized risk-recall metric. Experiments on SemanticKITTI demonstrate that SplatLabel consistently outperforms state-of-the-art baselines across multiple recall levels, establishing a highly robust framework for both 3D LiDAR segmentation and occupancy prediction.
36. 【2609.29835】Retrieve-to-Localize: Bridging Large Language Models and LiDAR Geometry for Spatial Grounding
链接：https://arxiv.org/abs/2609.29835
作者：Byounggun Park,Giyong Moon,Jusung Kim,Soonmin Hwang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：precise geometric information, outdoor robotics, geometric information, spatial perception tasks, object detection
备注： 8 pages
点击查看摘要
Abstract:LiDAR provides precise geometric information for spatial perception tasks such as object detection in autonomous driving and outdoor robotics. However, recognizing and localizing individual objects is not sufficient to answer questions that require composing spatial relations and grounding the intended target. Motivated by recent advances in large language models (LLMs) for autonomous driving, we leverage their language priors to interpret complex spatial questions and ground the referred target in LiDAR geometry. To support this spatial grounding capability, we introduce SpatialLiDAR-QA, which combines single- and multi-step relational grounding with complementary spatial understanding tasks. We further propose SpatialLiDAR-LM, which aligns LiDAR point features with an LLM and grounds target coordinates through language-conditioned, position-aware proposal retrieval and local point refinement. This design derives target coordinates directly from local LiDAR geometry rather than through textual language decoding. Experiments demonstrate substantial improvements over representative LiDAR--language models and multi-camera VLMs on precise coordinate prediction tasks. Our dataset and model training code will be publicly released.
37. 【2609.29825】Anatomy-Aligned Surface Field Learning for Myocardial Reconstruction from Sparse Short-Axis Cine MRI
链接：https://arxiv.org/abs/2609.29825
作者：Xiaohan Yuan,Xuan Yang,Qingya Li,Yangang Wang,Lei Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：regional motion analysis, quantitative functional assessment, supports quantitative functional, MRI supports quantitative, cine MRI supports
备注： 12
点击查看摘要
Abstract:Patient-specific 4D myocardial reconstruction from cine MRI supports quantitative functional assessment, regional motion analysis, and simulation-based modeling. However, routinely acquired short-axis (SAX) cine MRI is sparsely sampled along the through-plane direction, making dense and anatomically consistent surface reconstruction challenging. In this study, we propose an anatomy-aligned surface learning framework that parameterizes the epicardial and endocardial surfaces on a shared circumferential-longitudinal UV domain. This formulation converts irregular 3D reconstruction into structured coordinate-field completion with explicit correspondence across subjects and cardiac phases. Sparse SAX contours are encoded as UV observation fields, coverage-aware sampling improves robustness to incomplete slice coverage, and topology- and distortion-aware learning preserves circumferential continuity and local surface quality. Experiments on three public cine MRI datasets showed that the proposed method consistently outperformed representative mesh-based and implicit reconstruction approaches, achieving overall Chamfer distances of $2.887$~mm on ACDC, $2.641$~mm on M\Ms, and $2.810$~mm on M\Ms-2. The reconstructed sequences also preserved ventricular function, with end-diastolic volume and ejection fraction errors of $3.3$~mL and $1.1 \%$, respectively. These results demonstrate that anatomy-aligned UV learning provides an accurate, efficient, and correspondence-aware representation for sparse cine MRI reconstruction and myocardial modeling. The source code will be available at this https URL.
38. 【2609.29816】AV-GRPO: Modality-Anchored Decoupling Diffusion Reinforcement Learning for Joint Audio-Video Generation
链接：https://arxiv.org/abs/2609.29816
作者：Zhiyu Xu,Weilong Yan,Yufei Shi,Shiyang Li,Yihao Liu,Kin-Man Lam,Yuewen Cao
类目：Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：witnessed major progress, Recent years, joint audio-video generation, years have witnessed, witnessed major
备注： 22 pages
点击查看摘要
Abstract:Recent years have witnessed major progress in joint audio-video generation. Existing models still suffer from limited per-modality fidelity, insufficient text-modality alignment and weak cross-modal synchronization. While reinforcement-learning post-training offers a promising remedy, directly adapting it to joint audio-video generation is challenging. Heterogeneous multimodal rewards entangle learning signals and complicate credit assignment. Joint optimization of two modality towers is computationally expensive given their divergent dynamics. Moreover, synchronization evaluation difficulty depends on paired samples, preventing fair reward comparisons. We propose AV-GRPO, a modality-anchored online diffusion RL framework, and 5DAV, a decoupled, difficulty-controllable training dataset. AV-GRPO includes three key modules: (1) modality-anchored rollouts to disentangle learning signals and stabilize difficulty; (2) trajectory-locked frozen-tower optimization to reduce cost and reassign credit; (3) adaptive objectives and perturbation strengths tailored to modality-specific dynamics. This converts coupled multimodal preference learning into unimodal subproblems for precise reward attribution and better synchronization. Our 5DAV dataset decouples samples across five dimensions for systematic training. Experiments on JavisBench and VABench demonstrate AV-GRPO outperforms LTX-2.3 in generation quality, semantic alignment and cross-modal synchronization under LoRA and full fine-tuning. Ablations confirm our designs. Code and data: this https URL
39. 【2609.29813】S2Planner: Multi-Scale Semantic Planner for End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2609.29813
作者：Zhaowei Lu,Liguo Zhou,Yujie Guo,Lei Yu,Alois Knoll
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：current driving command, Spatial Tuning Adapter, multi-scale image features, Tuning Adapter produce, driving command
备注：
点击查看摘要
Abstract:We present S2Planner, a trajectory planner that combines three front-facing cameras with ego-motion history and the current driving command. A fine-tuned DINOv3 backbone and a Spatial Tuning Adapter produce multi-scale image features; a coarse-to-fine decoder then uses trajectory self-attention and camera-projected cross-attention to refine candidate waypoints. The contribution is the integration of ego-conditioned trajectory initialization with iterative, geometry-guided sampling of multi-scale image features, rather than a new visual backbone or attention operator. On the NAVSIM v1 non-reactive evaluation, the previously reported navtest run obtained 88.03 PDMS. Because that run was selected using navtest performance, this number is exploratory and cannot be interpreted as an unbiased test estimate. Validation-selected evaluation on unexposed data, repeated runs, and computational measurements are needed to establish generalization and efficiency.
40. 【2609.29788】OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimization
链接：https://arxiv.org/abs/2609.29788
作者：Zhiyuan Ma,Wenbo Hu,Wang Zhao,Pengfei Wang,Ying Shan,Lei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：recent advancements, high visual fidelity, OREO, introduce Reinforced Editing, assets with high
备注： Accepted to ECCV 2026. Our project page is at [this https URL](https://theericma.github.io/oreo/)
点击查看摘要
Abstract:Despite recent advancements in 3D generation, models often struggle to produce assets with high visual fidelity. To bridge this gap, we propose OREO, an alignment framework that enhances the realism of 3D generators by leveraging rich 2D diffusion priors. Instead of relying on static datasets, OREO establishes a dynamic optimization loop that produces on-the-fly edited renderings as 2D pseudo-targets. At its core, we introduce Reinforced Editing, which utilizes a 2D model to refine rendered views of the 3D output, enhancing their overall visual fidelity while preserving the underlying geometry, viewpoint, and content. These refined views serve as high-quality supervision targets, enabling the 3D generator to learn from its own generated samples and progressively improve its visual quality. Experiments demonstrate that OREO effectively improves upon pre-trained baselines, producing 3D assets with enhanced visual realism.
41. 【2609.29785】Lightweight Vision Transformer-Based U-Net for Brain Tumor Segmentation from MRI
链接：https://arxiv.org/abs/2609.29785
作者：Sheekar Banerjee,Md. Srabon Chowdhury,Md. Mahbub Hasan Akash,Ishtiak Al Mamoon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Magnetic Resonance Imaging, Magnetic Resonance, Resonance Imaging, Accurate brain tumor, Convolutional Neural Networks
备注： Accepted at The 2026 IEEE International Conference on Biomedical Engineering, Computer and Information Technology for Health (BECITHCON)
点击查看摘要
Abstract:Accurate brain tumor segmentation from Magnetic Resonance Imaging is essential for diagnosis, treatment planning, and surgical guidance. Although Convolutional Neural Networks, particularly UNet, have achieved significant success in medical image segmentation, they often struggle to capture the long-range spatial dependencies required to model tumors with irregular shapes and complex boundaries. This paper proposes a lightweight Vision Transformer UNet that combines the hierarchical feature extraction capability of UNet with the global context modeling of Vision Transformers. The proposed architecture incorporates a compact ViT bottleneck within a U-Net encoder-decoder framework, enabling effective learning of both local and global features while maintaining computational efficiency with only 2.6 million trainable parameters. The model was evaluated on the TCGA LGG MRI Segmentation dataset, achieving a mean Intersection over Union of 0.8100 and a Dice score of 0.8446, outperforming the baseline UNet by 3.75% and 3.15%, respectively. Extensive quantitative and qualitative analyses, including confusion matrix evaluation, precision recall curves, per-image performance distribution, and tumor size dependency analysis, demonstrate the effectiveness and robustness of the proposed method for brain tumor segmentation.
42. 【2609.29779】Mind the Gap: Mesh-Guided Repair of Broken Vessels
链接：https://arxiv.org/abs/2609.29779
作者：Gniewosz Drwiega,Wojciech Szymanski,Marek Wodzinski
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：small local errors, strongly disrupt vascular, voxel-wise classification, commonly optimized, optimized as voxel-wise
备注： Accepted at ShapeMI 2026 (Shape in Medical Imaging), MICCAI 2026 Workshop. 17 pages, 5 figures, 3 tables
点击查看摘要
Abstract:Vessel segmentation is commonly optimized as voxel-wise classification, but small local errors can strongly disrupt vascular connectivity while having little effect on overlap scores. This is particularly problematic for downstream analyses that rely on centerlines, branches, connected components, or graph structure. We propose a mesh-guided post-processing framework for repairing broken vessel segmentations produced by nnU-Net. For each predicted binary mask, a deformable template mesh is fitted to the mask surface in physical space and used as a case-specific geometric scaffold. The fitted mesh is not voxelized as the final segmentation; instead, it guides conservative reconnection of disconnected components by proposing or validating thin bridge candidates under foreground-growth constraints. We evaluated this approach in three vascular anatomies using AortaSeg24 and SEGA for the aorta, TopCoW for the Circle of Willis, and PARSE for the pulmonary arteries. Performance is measured using Dice, connected-component Dice (ccDice), and the Betti-0 number. Across these datasets, repair substantially improved connectivity while preserving overlap: Dice remained nearly unchanged, whereas ccDice increased from 0.596 to 0.992 for aorta, from 0.722 to 0.835 for TopCoW, and from 0.028 to 0.862 for PARSE. The FOMAML meta-initialization further accelerated the fitting per-case, supporting practical mesh-based repair of the vascular topology. These results suggest that explicit mesh representations can provide a useful geometric prior for correcting topological failures in otherwise accurate voxel segmentations.
43. 【2609.29735】C3M: Cross-Session Multimodal Memory Maintenance for Long-Horizon Tasks
链接：https://arxiv.org/abs/2609.29735
作者：Xueshu Chen,Yan Wang,Zihao Xue,Jiefu Li,Zhenfang Liu,Jayden Chen,Zhen Bi,Jungang Lou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：query-blind memory budget, Long-horizon tasks require, query-blind memory, recovering cross-session evidence, tasks require preserving
备注：
点击查看摘要
Abstract:Long-horizon tasks require preserving and later recovering cross-session evidence under a bounded, query-blind memory budget. Existing compression can discard fine-grained visual cues or conflate semantically similar but incompatible observations. We present C3M, a cross-session multimodal memory organization that maintains a bounded active index over persistent source text-image evidence. Relation-aware updates consolidate safe redundancy while preserving complementary and incompatible records. At query time, budgeted routing selects useful index pages and expands their associated source evidence under a fixed reader budget. Together, these mechanisms establish a compact, provenance-preserving multimodal memory organization for cross-session long-horizon tasks, retaining temporal distinctions and source links required for reliable downstream reasoning. Code is available at this https URL.
44. 【2609.29726】A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinoma
链接：https://arxiv.org/abs/2609.29726
作者：Anh-Tien Nguyen,Mawuko Tettey,Jacqueline Michelle Metsch,Teresa Zimmer,Niklas Ullrich,Mario Duker,Sandra Rungeling,Kirsten Reuter-Jessen,Tessa Rosenthal,Lena-Christin Conradi,Michael Ghadimi,Alexander Konig,Elisabeth Hessmann,Volker Ellenrieder,Philipp Strobel,Hanibal Bohnenberger,Anne-Christin Hauschild
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pancreatic ductal adenocarcinoma, Medical Center Gottingen, University Medical Center, linking whole-slide histology, ductal adenocarcinoma
备注：
点击查看摘要
Abstract:Survival research in pancreatic ductal adenocarcinoma (PDAC) is limited by the scarcity of datasets linking whole-slide histology with clinical, molecular, and long-term outcome data. We present a retrospective single-centre cohort of 302 patients who underwent PDAC resection at University Medical Center Gottingen. The dataset comprises 446 HE whole-slide images, clinicopathological variables, targeted sequencing data for 154 patients, and overall-survival outcomes. During follow-up, 253 patients died, and the median follow-up was 76 months. To establish initial reference values, we evaluated fourteen survival-prediction configurations using identical five-repetition Monte Carlo cross-validation partitions. Ridge Cox regression using numeric clinicopathological variables achieved a mean concordance of $0.649 \pm 0.042$ and $0.652 \pm 0.046$ after adding KRAS and TP53 mutation status. The image-only attention model achieved $0.603 \pm 0.030$, while multimodal fusion achieved $0.619 \pm 0.025$, the highest concordance among the neural models. These results establish promising initial benchmarks for future research using this pancreas-specific multimodal dataset, paving the way for external validation.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.29726 [cs.CV]
(or
arXiv:2609.29726v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.29726
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
45. 【2609.29721】SALI: Shot-Aware Late Interaction for Cross-Shot Relation Matching in Text-to-Video Retrieval using Film-Grammar Knowledge
链接：https://arxiv.org/abs/2609.29721
作者：Toya Oyama,Rainer Lienhart,Shin'ichi Satoh
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Multimedia (cs.MM)
关键词：retrieval usually represents, Anna confronts Mark, represents a video, Shot-Aware Late Interaction, embedding
备注： 5 pages, 2 figures, 4 tables. Submitted to ICASSP 2027
点击查看摘要
Abstract:Text-to-video retrieval usually represents a video clip by a single embedding. This embedding often loses important relations between people. E.g., an interaction "Anna confronts Mark" is regularly filmed as alternating shot and reverse shot of both (Fig. 1a). No single shot or averaged embedding over clip shots captures this relation. Thus, we propose SALI (Shot-Aware Late Interaction). It extracts the subject and object from a single-sentence query, and matches the query, its subject and object text embeddings against each visual shot embedding of a video clip. The matching operator is greedy max or optimal transport. A film-grammar penalty in fine-tuning adds a small, consistent shift. Built on CLIP4Clip-meanP, SALI keeps overall recall on par on Condensed Movies and ActivityNet while raising R@1 on multi-shot relation queries by 3 and 12 points, the most among all compared methods, and improves such queries on MSR-VTT at a cost of 1.4 R@1 overall.
46. 【2609.29717】opoFuse: Topology-Aware Tri-Planar Fusion for 3D Cryo-Electron Tomography Segmentation
链接：https://arxiv.org/abs/2609.29717
作者：Rohit Kumar Salla,Neelesh Gupta,Xingjian Li,Min Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enclosed cavities collapse, cryo-electron tomograms routinely, tomograms routinely produces, routinely produces masks, Automated segmentation
备注：
点击查看摘要
Abstract:Automated segmentation of cryo-electron tomograms routinely produces masks that are voxel-accurate but topologically broken: membranes fragment, organelles merge into one another, and enclosed cavities collapse. Existing topology-aware losses reduce these violations but cannot eliminate them, because topology is encouraged through gradient pressure rather than structurally enforced. We introduce TopoFuse, which reframes topology as a differentiable projection operator rather than a loss penalty. At each forward pass, the projection operator $\mathrm{Proj}_T$ (a PH-guided sparse edit) identifies the critical voxels responsible for topological violations via bottleneck matching and applies sparse edits to satisfy a specified topology target (diagram feature counts and lifetime budgets) for dimensions $d \in \{0,2\}$. If the projection converges, the output satisfies those constraints on the downsampled grid ($s=2$); when it does not, a repair certificate exposes this explicitly, enabling downstream filtering. A topology prior head predicts the correction target directly from input features, removing any dependence on ground-truth topology at inference. Across three cryo-ET benchmarks, TopoFuse reduces Betti number error by 54% over the strongest soft-loss baseline ($p 0.001$), improves Dice by 4.6 points, and edits only 3.1% of voxels to achieve this.
47. 【2609.29678】ReCalMatch:Reliability-Calibrated Semantic Guidance for Semi-Supervised Fine-Grained Recognition
链接：https://arxiv.org/abs/2609.29678
作者：Yundi Hong,Hongyang He,Zheng Fang,Xuanyu Liu,Victor Sanchez
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：similar categories frequently, categories frequently produce, frequently produce high-confidence, overconfident pseudo-label errors, visually similar categories
备注： Accepted for publication at the British Machine Vision Conference (BMVC) 2026. Official list of accepted papers: [this https URL](https://bmvc2026.bmva.org/programme/accepted_papers/)
点击查看摘要
Abstract:Semi-supervised fine-grained visual recognition is highly vulnerable to overconfident pseudo-label errors: visually similar categories frequently produce high-confidence yet incorrect predictions, and consistency regularization then reinforces these errors throughout training. Existing semi-supervised learning (SSL) methods estimate pseudo-label reliability almost entirely from the visual classifier itself---maximum probability, adaptive thresholds, or entropy---signals that remain blind to whether a predicted class is \emph{semantically} compatible with the visual representation. We propose \textbf{ReCalMatch}, a reliability-calibrated semantic framework for semi-supervised fine-grained recognition. Rather than treating textual semantics as auxiliary supervision, ReCalMatch uses multi-aspect semantic prototypes as \emph{calibration evidence} for pseudo-label learning. We construct class-conditioned semantic prototypes from class names and domain-specific semantic aspects, and measure a \emph{visual--semantic agreement} score between each unlabeled embedding and its pseudo-label prototype. This agreement is combined with prediction confidence and entropy into a single reliability weight that down-weights pseudo-labels that are visually confident but semantically inconsistent. A semantic consistency term and a semantic margin regularizer further sharpen prototype separability under limited labels. Extensive experiments on CUB-200-2011, Stanford Dogs, NABirds, and iNaturalist18 show that ReCalMatch consistently improves strong SSL baselines, with the largest gains in low-label regimes where pseudo-label noise is most severe.
48. 【2609.29663】Investigating White Blood Cells as a Source of False-Positive Malaria Parasite Detection in African Blood-Smear Images
链接：https://arxiv.org/abs/2609.29663
作者：Samuel A. Adeniji,Goodness C. Obasi,Chris-Victor Ntwali,Aondana M. Iorumbur,Confidence Raymond,Lowami Uwimana,Ahmed Tahiru Issah
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：White blood cells, Giemsa-stained thick blood, Plasmodium falciparum ring-form, thick blood smear, blood smear share
备注： Accepted at the 3rd MIRASOL workshop, a satellite event at MICCAI 2026. To appear in Springer Lecture Notes in Computer Science (LNCS)
点击查看摘要
Abstract:White blood cells (WBCs) present on every Giemsa-stained thick blood smear share visual properties with early-stage Plasmodium falciparum ring-form trophozoites: small size, round morphology, and intense purple staining. They are a plausible but untested source of false positives in parasite-only detectors. We trained two YOLOv12s models on the Lacuna Malaria Detection dataset (8,000 images from Uganda and Ghana): Model A with parasite labels only, and Model B with both parasite and WBC labels. Seven independent spatial and statistical analyses tested whether false positive (FP) predictions cluster near WBC locations. All seven refute the hypothesis. In both models, 95% of FPs are pure background detections (IoU below 0.10 against any ground-truth box); zero are WBC class confusions. Ripley's Cross-K analysis shows spatial repulsion between FP centroids and WBC positions at every radius tested. Model B outperforms Model A overall (mAP50 0.859 vs. 0.755), and the advantage is uniform across all WBC-proximity bands, pointing to multi-task representation learning rather than WBC suppression as the cause. False positives arise from Giemsa stain debris and preparation artifacts. Effective mitigation requires staining artifact augmentation and annotation of unannotated early-stage ring forms rather than WBC labeling alone.
49. 【2609.29650】VG-TIE: An interpretable tabular-to-image encoding method based on visibility graphs
链接：https://arxiv.org/abs/2609.29650
作者：David Chushig-Muzo,Luis M. López-Ramos,Ángeles Rodríguez de Cara,Eva Milara,Luis Zhinin-Vera,Diego H. Peluffo-Ordóñez
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Principal Component Analysis, convolutional neural networks, transforming feature vectors, Natural Visibility Graph, Horizontal Visibility Graph
备注：
点击查看摘要
Abstract:Tabular-to-image encoding methods enable the application of models based on both convolutional neural networks and vision transformers to tabular data, transforming feature vectors into images. Existing methods employ linear and nonlinear dimensionality reduction techniques (e.g., Principal Component Analysis (PCA), t-SNE, and UMAP) to determine pixel positions, resulting in images whose spatial layout do not inherently reflect feature relationships. This paper introduces Visibility Graphs for Tabular-to-Image Encoding (VG-TIE), a novel method that encodes the structure of feature values using Natural Visibility Graph (NVG) and Horizontal Visibility Graph (HVG) into a two-dimensional space obtained through PCA. The resulting images are model-agnostic and intrinsically interpretable. Each pixel corresponds to an input feature, its intensity reflects the magnitude and direction of deviation from the population mean, and edges represent formally defined visibility relationships between features. VG-TIE provides two interpretability methods: (i) feature ranking from node degree distributions; and (ii) local and global feature importance from pixel intensity combined with Grad-CAM. Experiments on six public tabular datasets show that VG-TIE is competitive with other tabular-to-image methods while providing interpretability on feature importance and ranking similar to intrinsic interpretable methods. The results highlight the potential of the proposed image-based transformation to provide an effective framework that expands the use of deep learning across tabular data domains.
50. 【2609.29648】Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge
链接：https://arxiv.org/abs/2609.29648
作者：Amir Taherin,José Cano,Bin Ren,Yanzhi Wang,David Kaeli
类目：Computer Vision and Pattern Recognition (cs.CV); Hardware Architecture (cs.AR); Machine Learning (cs.LG); Performance (cs.PF); Robotics (cs.RO)
关键词：edge devices runs, devices runs computationally, runs computationally expensive, sustained GPU utilization, Video object detection
备注： Accepted at the ACM/IEEE Symposium on Edge Computing (SEC 2026)
点击查看摘要
Abstract:Video object detection on edge devices runs computationally expensive detectors over long frame streams, causing high energy consumption and sustained GPU utilization. Although consecutive frames are highly redundant, naive frame skipping is content-blind: it skips during critical moments such as object entry, occlusion recovery, and abrupt motion, degrading detection quality. We present Albireo, a detector-agnostic, codec-free adaptive inference framework that wraps off-the-shelf detectors and decides when detector invocation can be safely skipped based on scene content and per-object temporal state, requiring no detector modification or retraining. Albireo maintains a 10-dimensional Kalman filter (KF) per active object and invokes the detector only when prediction uncertainty exceeds a threshold; on skipped frames, boxes are predicted from the KF state at near-zero GPU cost. A KF-based rescue mechanism preserves confirmed objects through brief detector misses to prevent output fragmentation, while a lightweight empty-scene screen avoids detector calls on objectless frames. We evaluate Albireo on the BDD100K MOT validation split with three architecturally distinct detectors (YOLO11x, YOLO26x, RF-DETR-Large) on two NVIDIA Jetson platforms (AGX Thor, AGX Orin). Across all configurations, Albireo keeps AP@50 within +/-1.2 pp of per-frame inference while reducing total energy by 12.1-17.6%. On YOLO26x, it improves AP@50 by +0.8 pp while reducing energy by 17.6% (Thor) and 14.4% (Orin) and per-frame energy-delay product by 24.9% and 26.1%, respectively. Thus, the default operating point improves accuracy, energy, and latency together. In contrast, FixedSkip-2, a fixed-interval baseline with a 50% skip rate, loses 8.6 pp AP@50. Source code, evaluation pipeline, and per-clip results are available at this https URL
51. 【2609.29638】SpectralCTGaussians: Projection-Domain Reconstruction and Basis Material Decomposition for Spectral CT using 3D Gaussian Splatting
链接：https://arxiv.org/abs/2609.29638
作者：Reinout Vos,Saptarshi Neil Sinha,Michael Weinmann
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：physical X-ray interactions, richer scene understanding, allowing improved modeling, Spectral computed tomography, X-ray interactions
备注：
点击查看摘要
Abstract:Spectral computed tomography (CT) extends conventional CT by measuring attenuation across multiple energy channels, allowing improved modeling of physical X-ray interactions and energy-dependent material behavior and leading to richer scene understanding. We present a novel method for spectral CT reconstruction and basis material decomposition using 3D Gaussian Splatting by adding per-Gaussian basis material fractions to the set of learnable parameters, which together with a set of energy-dependent basis functions define the attenuation across the full spectral range. The basis functions represent various physical attenuation models such as photoelectric absorption and Compton scattering, and are jointly optimized across all energy channels through a differentiable polychromatic forward model, with material decomposition performed via mean-shift clustering of the resulting coefficients. We evaluate our method on a baseline real-world dataset as well as a synthetic dataset that we introduce, comparing against traditional reconstruction algorithms and state-of-the-art learning-based CT reconstruction methods. Our approach outperforms all traditional baselines in novel view synthesis and achieves the best PSNR among all compared methods for spectral CT volume reconstruction, while describing all energy channels with a single shared representation that requires a number of Gaussians comparable to single-channel Gaussian splatting-based CT reconstruction approaches. For basis material decomposition, no traditional or learning-based baseline offers one-step decomposition with direct RGB material segmentation, and our method additionally recovers the photoelectric basis with higher PSNR than traditional pipelines.
52. 【2609.29621】AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing
链接：https://arxiv.org/abs/2609.29621
作者：Saptarshi Neil Sinha,Mika Silvan Goschke,Paul Julius Kühn,Arjan Kuijper,Michael Weinmann
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：designer daily work, daily work consists, requests involving speech, Computer-aided design, multimodal requests involving
备注：
点击查看摘要
Abstract:Computer-aided design is central to industrial manufacturing, and much of a designer's daily work consists of editing existing models from multimodal requests involving speech, sketches, and model interaction. Existing neural CAD approaches focus predominantly on unconditional or text-conditioned generation. The neuralCAD-Edit approach formalizes expert multimodal editing requests, but its iterative baseline refines a complete CAD program across attempts, executing each attempt from the original model in a stateless CAD environment. Every attempt must therefore reconstruct the entire edit from scratch, so partially correct progress is discarded rather than accumulated, and the model can neither inspect the geometry it has just produced nor selectively revert a single faulty operation. We present AgenticCADedit, which turns editing into a sequence of small, verifiable actions on a persistent CAD state instead of a single regenerated program. Rather than emitting one complete program, it applies incremental code steps that each commit to the session, inspects the resulting faces and edges, renders highlighted selections to verify that the intended region was addressed, and reverts individual operations when it was not. Subsequent actions therefore build on the geometry produced by earlier ones. Our approach improves on all metrics for all three evaluated LLMs (open-weight: qwen3.6-27b, gemma4-31b; proprietary: gpt-5.6-luna), with the largest gains for the weakest baseline model, qwen3.6-27b, whose validity rises from 51.0% to 94.8% and acceptance from 1.6% to 12.0%. A token-cost analysis with gpt-5.6-luna further shows $66.7$% fewer output tokens than neuralCAD-Edit, while $94.8$% of input tokens are served from the prompt cache.
53. 【2609.29607】STRAND: Benchmarking and Improving Object-Centric Spatio-Temporal Monitoring in Video Large Language Models
链接：https://arxiv.org/abs/2609.29607
作者：Thong Nguyen,Tri Cao,Khoi Le,Cong-Duy Nguyen,Quynh Vo,See-Kiong Ng,Bryan Hooi Kuen-Yew
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：multimodal large language, remain highly prone, large language models, dynamic scenes, multimodal large
备注：
点击查看摘要
Abstract:While multimodal large language models (MLLMs) have advanced video understanding, they remain highly prone to hallucinations in dynamic scenes. We argue this stems from a failure in spatio-temporal monitoring, the ability to persistently track object identities, states, and relations over time. Existing benchmarks obscure this deficit by relying on single final-answer evaluations for queries that can often be resolved via local visual cues or statistical priors. To rigorously diagnose this, we introduce STRAND, a benchmark of human-verified object-centric facts that evaluates intermediate reasoning by decomposing queries into sub-questions, distinguishing genuine temporal understanding from coincidental correctness. Crucially, we score models with Faithful Accuracy, an unconditional joint metric that credits a prediction only when the target answer and every prerequisite sub-question are correct, so that a model cannot inflate its score by being selectively consistent on the small subset of targets it happens to answer correctly. To address failure modes exposed by STRAND, we further propose an object-centric framework that explicitly constructs and reasons over structured object trajectories via chunk-wise state extraction and temporal aggregation. Extensive experiments, including backbone-, frame-, call-, and token-matched comparisons against both end-to-end MLLMs and modular video harnesses, demonstrate that our object-centric framework significantly reduces hallucinated answers and improves spatio-temporal reasoning consistency over state-of-the-art MLLMs. The code, model, and data have been made available at this http URL.
54. 【2609.29604】PROVE: Proof-guided Regime-aware Operator Verification for Hallucination Detection in Medical Visual Question Answering
链接：https://arxiv.org/abs/2609.29604
作者：Keyang Zhou,Siyi Li,Zhongnan Shi,Qichao Ying,Wei Tang,Zhenxing Qian
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：lead to confident, confident but incorrect, visual question answering, incorrect responses, Proof-guided Regime-aware Operator
备注：
点击查看摘要
Abstract:In medical visual question answering (VQA), hallucinations of vision-language models (VLMs) may lead to confident but incorrect responses, raising the risk of diagnostic errors. Existing hallucination detection methods uniformly estimate the reliability of VLM outputs from response consistency or visual evidence. However, such uniform verification across questions ignores question-specific characteristics, resulting in missed overconfident errors and false alarms from over-verification. We present PROVE (Proof-guided Regime-aware Operator Verification), a black-box detector that adapts verification strategy to the evidential structure of each question. PROVE classifies questions into three verification regimes based on what kind of visual proof they demand, activates a regime-specific subset of five complementary operators, and adjusts operator importance per question through a lightweight calibration layer conditioned on deterministic question-answer features. PROVE uses question-specific evidence to reweight operators and produce a calibrated risk score. Evaluated on 8048 test samples across three medical VQA benchmarks and four frontier VLMs, PROVE achieves 0.821 AUROC, outperforming the strongest baseline by +0.159, with consistent gains across all models and benchmarks.
55. 【2609.29603】MoSign: Challenge-Response Motion-Watermark Authentication for Anonymous Virtual-Reality Users
链接：https://arxiv.org/abs/2609.29603
作者：Xujun Che,Thomas Carr,Depeng Xu,Aidong Lu,Shuhan Yuan
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Social virtual reality, Social virtual, creates a paradox, virtual reality, user body motion
备注：
点击查看摘要
Abstract:Social virtual reality (VR) creates a paradox. A user's body motion is a high-entropy biometric: head and hand trajectories alone re-identify users among tens of thousands with over $94\%$ accuracy, so anonymizing the rendered avatar is a practical necessity. Yet a user often still wants to prove their identity to a chosen party from inside that anonymity. We present MoSign, which recasts digital watermarking as a challenge-response authentication protocol on the motion channel. MoSign embeds a time-varying keyed message into the style latent of a motion variational autoencoder via keystream-whitened Gaussian-Shading: watermarked motion is provably indistinguishable from watermark-free motion, since any detector's advantage reduces to breaking a pseudorandom function, so the mark composes with anonymization. The message is a keyed MAC over an epoch counter, a session nonce, and a deployment context, making MoSign replay-resistant and bounding forgery by the verifier's measured false-accept rate times the adversary's online query budget. A key-holding verifier decides with a sequential test. We identify render$\rightarrow$record$\rightarrow$re-estimate ("recapture") as the realistic VR attack surface: a generic pose estimator strips the necessarily subtle watermark, but a recapture-robust keyed reader recovers it (up to $0.96$ codeword accuracy on a projected-2D channel, $0.81$ through a full render-to-video loop), while without the key recovery stays at chance. On HumanML3D, MoSign authenticates every legitimate user at a false-accept rate of $10^{-4}$ on clean and most channels and stays undetectable (detection AUC $0.51$, chance $0.5$); on the BOXRR-23 VR dataset it carries the mark through a real anonymizer at $0.99$ codeword accuracy and adds no de-anonymization side channel.
56. 【2609.29601】Free the Language Model From the Vision Encoder: Semantic Serialization as a Perception Interface for Small Language Models
链接：https://arxiv.org/abs/2609.29601
作者：Cong Xu,Ravi Sankar
类目：Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：bind visual competence, language model, language model shrinks, bind visual, visual competence
备注： 12 pages, 2 figures. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible
点击查看摘要
Abstract:End-to-end vision-language models (VLMs) bind visual competence to the scale of their language model: as the language model shrinks, perception and reasoning degrade together. We study an embodied scene question-answering (QA) interface in which vision never enters the language model. A frozen perception stack detects and ranges objects; a deterministic semantic serializer compiles the perceived state, errors included, into decision-aligned text; an unmodified text-only large language model (LLM) answers. On a visible-scope-matched, occlusion-audited campus-robot benchmark, under a prospectively frozen criterion, the serialized interface, using detectors fine-tuned in-domain within each fold, outperforms a zero-shot VLM whose language model has the same 7B scale (0.7892 vs 0.7462), with a larger margin at 3B (0.7673 vs 0.6913). Preregistered decoupling experiments show the gain survives paraphrase, attributing it to decision-aligned computation rather than answer-string leakage, while novel judgment vocabularies bound its scope. The advantage grows as the reader shrinks to 1.5B and reverses at 0.5B, and a ground-truth oracle locates the reader-capability floor. Under matched task supervision the interfaces converge: a VLM fine-tuned with low-rank adaptation (LoRA) overtakes the zero-shot system but only ties an equally supervised text reader (0.8441 vs 0.8396, no statistically resolved difference), and both routes remain perception-bound. Reported perception parameters are comparable to those of the VLM's vision tower, and total compute is not smaller.
57. 【2609.29592】QINA: Quantum-Inspired Nonlinear Adapters for Pretrained Vision Models
链接：https://arxiv.org/abs/2609.29592
作者：Mostafa Mehdipour Ghazi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Adapting large pretrained, frozen-backbone constraints remains, Adapting large, constraints remains, remains a central
备注： Accepted at BMVC2026
点击查看摘要
Abstract:Adapting large pretrained vision models under limited data and frozen-backbone constraints remains a central challenge in transfer learning. While lightweight adapters and parameter-efficient fine-tuning methods are widely adopted, most rely on generic multilayer perceptrons or low-rank linear updates, offering limited control over the spectral and geometric structure of feature transformations. We investigate whether structured nonlinear feature lifting can improve representational alignment in frozen regimes. We introduce Quantum-Inspired Nonlinear Adapters (QINA), compact modules that perform learnable trigonometric feature lifting followed by bounded nonlinear aggregation. The design induces structured oscillatory basis functions with an explicit norm-dependent Lipschitz bound, enabling spectral reshaping of pretrained representations without increasing the receptive field or significantly expanding parameter count. Importantly, the method operates entirely within standard deep learning frameworks and does not require quantum hardware. Through systematic experiments across natural and medical imaging datasets, classification and segmentation tasks, multiple adapters and placements, and varying training budgets, we show that performance in frozen regimes is primarily representation-limited. Nonlinear lifting improves adaptation, and the proposed structured trigonometric formulation consistently outperforms identity baselines, fixed Fourier feature mappings, and parameter-matched baseline adapters. Within the evaluated frozen-backbone settings, structured spectral parameterization provides a more effective inductive bias than generic nonlinear adapters. This work highlights the importance of geometry- and spectrum-aware adaptation mechanisms for large pretrained vision models.
58. 【2609.29591】CATCH: Counterfactual Anatomical Tissue Inpainting with Conditional Haar Diffusion
链接：https://arxiv.org/abs/2609.29591
作者：Simon Winther Albertsen,Hjalte Bjoernstrup,Said Djafar Said,Mostafa Mehdipour Ghazi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：local synthesis replaces, synthesis replaces masked, replaces masked regions, plausible tumor-free tissue, preserving observed anatomy
备注： Accepted at the 15th BraTS Workshop in MICCAI 2026
点击查看摘要
Abstract:BraTS local synthesis replaces masked regions in T1-weighted brain MRI with plausible tumor-free tissue while preserving observed anatomy. We present CATCH, conditional 3D diffusion in an invertible Haar-wavelet domain. Its denoiser receives noisy target coefficients, voided-image coefficients, and a signed mask; tumor-excluded wavelet reconstruction and a hole-focused loss guide training, and hard compositing preserves observed voxels. We compare fixed masks, tumor-component augmentation, and a weighted mixture of tumor-derived, irregular-blob, and ellipsoidal masks. Of 25 development cases, five prespecified cases select each arm's checkpoint and all 25 of their trajectory aggregations; a separate 75-case internal set compares the frozen pipelines and selects a weighted mixture for organizer evaluation. Five-trajectory averaging yielded internal SSIM/PSNR/MSE (mean$\pm$SD) of $0.80\pm0.13$, $19.18\pm1.80$dB, and $0.010\pm0.005$. As the sole officially evaluated pipeline, weighted mixture yielded $0.772\pm0.119$, $20.89\pm3.27$dB, and $0.0098\pm0.0054$ on the 219-case BraTS 2026 validation set. Against compute-matched random augmentation internally, it improved SSIM by 0.019 (95% bootstrap CI: 0.013-0.025), PSNR by 0.95dB, and MSE by 0.003; all three paired comparisons remained significant after Holm correction. Results favor the complete weighted-mixture policy within CATCH; absent official fixed- and random-pipeline scores and a directly comparable external baseline limit broader conclusions.
59. 【2609.29581】Long-Tail Adaptive Flow Matching with Explicit Conditional Consistency Guidance for Precise Multimodal Face Synthesis
链接：https://arxiv.org/abs/2609.29581
作者：Yushe Cao,Xuechao Zou,Xing Xi,Dianxi Shi,Chun Yu,Junliang Xing
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：existing approaches rely, implicit latent-space objectives, alignment remains suboptimal, multimodal face synthesis, diffusion-based methods
备注： 14 pages, 12 figures
点击查看摘要
Abstract:Although diffusion-based methods have substantially improved the controllability of multimodal face synthesis, their semantic alignment remains suboptimal because most existing approaches rely on implicit latent-space objectives to model the relationship between denoising variables and multimodal conditions. Such implicit modeling is often insufficient to enforce precise correspondence between synthesized faces and conditional inputs, especially under long-tailed semantic mask distributions where rare attributes receive weak optimization signals. To address these limitations, we propose EC\textsuperscript{2}Face, a multimodal face synthesis framework that improves semantic alignment through explicit semantic supervision and distribution-aware optimization. First, we introduce Explicit Conditional Consistency Guidance (ECCG), which imposes direct consistency supervision in pixel space by decoding an approximate reverse estimate of the clean latent and explicitly aligning the synthesized image with textual descriptions and semantic masks. A temporal dynamic modulation function is further designed to adapt the supervision strength according to the timestep-dependent reliability of reverse estimation. Second, we propose Long-Tail Adaptive Flow Matching (LAFM), which reweights spatial optimization signals based on semantic attribute frequency, with normalized weights to maintain numerical stability during training. Importantly, all additional modules are used only during training and introduce no extra inference overhead. Extensive experiments show that EC\textsuperscript{2}Face consistently outperforms competitive baselines in both generation quality and semantic alignment, achieving a 29.38\% improvement in mask accuracy on rare attributes.
60. 【2609.29555】Visual Representation and History Modeling for Navigation World Models
链接：https://arxiv.org/abs/2609.29555
作者：Guangfu Guo,Xiaoqian Lu,Rui Liu,Yutong Chen,Kunpeng Liu,Long Cheng
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Navigation World Models, Navigation World, predict action-conditioned visual, action-conditioned visual futures, World Models
备注：
点击查看摘要
Abstract:Navigation World Models (NWMs) predict action-conditioned visual futures for planning. Two practical challenges are central to their design: selecting a suitable visual representation and efficiently modeling observation history for repeated candidate queries. Standard Global-Softmax attention provides flexible interactions but repeatedly processes the same history, leading to increasing computation and memory costs for long contexts and multi-query planning. We study both problems within a unified conditional flow-transformer framework. We first compare five frozen visual representations under the same dynamics model and evaluation. To reduce redundant history computation, we design Cached-Linear, a hybrid architecture that combines local and shifted-window attention for target mixing with linear attention for reusable history access. We further develop Balanced Gated Delta Network (GDN), which augments this design with frame-wise recurrent memory for temporal history modeling. Experiments on RECON, SACSoN, and SCAND show that representation choice depends on the prediction objective: PAE-L performs best for reconstruction, RAE-B for direct prediction, and V-JEPA for long-horizon rollout. Under shared-history workloads, Cached-Linear substantially reduces computation and memory compared with Global-Softmax, while Balanced GDN improves selected direct-prediction endpoints with efficient context reuse. Overall, we systematically study visual representation and history modeling for NWMs and develop hybrid reusable-history architectures for efficient long-context and multi-query prediction.
61. 【2609.29553】UNWIND: Any-Length Facial Video for Stress Detection without Temporal Windowing
链接：https://arxiv.org/abs/2609.29553
作者：Stefanos Gkikas,Christian Arzate Cruz,Eric Nichols,Giorgos Giannakakis,Randy Gomez
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Automatic stress recognition, Automatic stress, affective monitoring, non-contact approach, approach for affective
备注：
点击查看摘要
Abstract:Automatic stress recognition from facial video provides a non-contact approach for affective monitoring. However, most existing video-based methods divide complete recordings into shorter temporal segments before performing classification. Such segmentation requires additional decisions concerning segment duration, overlap, and prediction aggregation, and may restrict the model from exploiting information distributed across the entire recording. We introduce UNWIND, a facial-video framework for stress detection that analyzes a complete recording as a single model input, eliminating the need for temporal windowing or external segmentation. UNWIND reorganizes the video by folding its temporal dimension into the channel dimension of a two-dimensional spatial representation, which is subsequently processed through a unified asymmetric-attention architecture. With a temporal stride of $\tau=1$, the framework processes the entire $120$-second sequence, corresponding to $3{,}600$ frames sampled at $30$~fps, in a single input. We evaluate seven temporal-stride settings on a stress dataset comprising $58$ subjects, using a stratified subject-level protocol that covers configurations from dense frame retention to sparse temporal sampling. The highest test accuracy, $70.02\%$, is obtained at $\tau=15$, while processing all frames at $\tau=1$ achieves a comparable accuracy of $69.73\%$. Computational requirements range from $12.48$ to $348.78$ GFLOPs across the evaluated stride settings, illustrating the balance between temporal sampling density and computational efficiency. The findings show that effective facial-video stress recognition can be achieved without dividing recordings into temporal windows and that complete-recording inference can be performed within a single unified model.
62. 【2609.29550】Spaceborne differential photogrammetry for control-free measurement of large-gradient deformation with structural immunity and a predictable accuracy envelope
链接：https://arxiv.org/abs/2609.29550
作者：Yueqiang Zhang,Chang Ma,Shuixin Pan,Haibo Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：measures wide-area deformation, coherent interferometric synthetic, interferometric synthetic aperture, synthetic aperture radar, aperture radar fails
备注： 39 pages, 9 figures, and 5 tables; supplementary material: 10 pages, 3 figures, and 6 tables
点击查看摘要
Abstract:Optical satellite image correlation measures wide-area deformation in regimes where coherent interferometric synthetic aperture radar fails because displacement gradients are too large. However, standard pairwise workflows lack a pre-acquisition error budget and rely on extensive stable terrain. We formulate repeat-pass optical correlation as a differential estimation problem without surveyed ground control. Nominal georeferencing defines the coordinate frame, stable-area constraints and displacement priors resolve the datum, and surface displacement is estimated jointly with inter-epoch revisit-bias coefficients. The model yields a predictive accuracy envelope and calibrated per-point posterior uncertainty, bounds along-track uncertainty through a displacement prior, and represents pushbroom jitter using per-line revisit offsets. Simulations and Sentinel-2 and WorldView-2 experiments on the 2019 Ridgecrest earthquake, the 2023 Kahramanmaraş earthquake, and the Baltoro glacier validate the predicted noise floor, control-free accuracy margin, and leakage caused by view-angle and digital elevation model errors. The measured noise floor reaches approximately $0.05$ pixel at $10$,m ground sampling distance. With only five stable tiles, conventional destriping changes the estimated Baltoro trunk velocity from $106$ to $1251$myr$^{-1}$, whereas the prior-constrained estimate remains $87$myr$^{-1}$. Closure analysis attributes approximately $88\%$ of pair-error variance to individual scenes, consistent with $25{,}354$ ITS_LIVE glacier-velocity triplets. Three matching methods lead to the same conclusions. The framework therefore turns pairwise correlation into a robust measurement with a predictive error budget, reduced dependence on stable terrain, and conclusions independent of the matching method.
63. 【2609.29541】GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning
链接：https://arxiv.org/abs/2609.29541
作者：Shuaishuai Cao,Min Huang,Meng Tang,Xuan Liu,Youjin Wang,Hui Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Referring segmentation, residential area, geospatial referring segmentation, overhead imagery, imagery is inherently
备注： 19 pages, 5 figures, 5 tables. Code, data, and evaluation tools are available at [this https URL](https://github.com/anticipate218/GeoRefer-Bench)
点击查看摘要
Abstract:Referring segmentation in overhead imagery is inherently relational: a query may ask for the buildings north of the road or the pond closest to a residential area, so the correct referent can contain one object, several objects, or none. Existing benchmarks mainly score mask overlap, which cannot verify whether a model actually resolved the stated spatial relation. We introduce GeoRefer-Bench, a benchmark for verifiable geospatial referring segmentation. Each query is represented by an executable logical form over a metric scene graph, and predictions are evaluated with Exact Query Success (EQS), which is satisfied only when the returned instance set exactly matches the set denoted by the query. GeoRefer-Bench contains 700 whole 2048x2048 UAV scenes (2.94 Gpx) at 12.5 and 25 cm ground sampling distance, 26,217 instances, 142,796 spatial relations, and 20,916 executable queries spanning five reasoning levels. It further includes three paraphrases per query, 24.0% unanswerable queries, 2,477 counterfactual pairs, and five leakage-controlled evaluation splits. An independent audit re-derives object geometry, mask ownership, relation values, query execution, and split provenance, finding zero issues across all 700 scenes. Relation-blind strategies can retain non-trivial mIoU while achieving at most 22.7 EQS overall, showing that overlap alone does not certify relational grounding. Across fifteen current models, the strongest reaches 74.1 EQS but drops from 98.9 at level 1 to 60.5 at level 5, while ten models score below 5 EQS on two-hop queries. GeoRefer-Bench turns geospatial referring segmentation from mask matching into verifiable reference resolution.
64. 【2609.29536】Clinical Knowledge Graphs for Chest X-Ray Device Reasoning
链接：https://arxiv.org/abs/2609.29536
作者：Harshil Lodhiya
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：position of catheters, radiographs are routinely, verify the position, Chest radiographs, RANZCR CLiP test
备注： 19 pages, 2 figures, 5 tables. Post-hoc descriptive analysis on archived RANZCR CLiP test predictions
点击查看摘要
Abstract:Chest radiographs are routinely used to verify the position of catheters, tubes, and other support devices. Existing image models often return labels or segmentations, while report-processing systems structure text without access to image geometry. We present an uncertainty-aware clinical knowledge graph that represents device instances, tip estimates, placement assessments, provenance, report events, and temporal links as separate but connected evidence. We evaluate the implemented visual graph layer using saved predictions from the complete RANZCR CLiP test archive, comprising 30,083 studies from 3,255 patients across five non-overlapping outer folds. The graph builder materializes 914,632 B7 evidence nodes and 884,549 typed relationships. All 118,647 B7 predicted-device nodes retain tip covariance, placement probabilities, fragment provenance, and fragment counts, whereas the direct B2 baseline retains none of these fields. We further define typed data contracts, uncertainty representations, abstention rules, report-image grounding, and longitudinal query mechanisms for extending the graph to report-bearing cohorts. The reported graph-materialization analysis is post-hoc descriptive and does not establish report grounding, longitudinal performance, or clinical utility. It demonstrates a reproducible foundation for evidence-preserving AI reasoning over chest X-ray device assessments.
Comments:
19 pages, 2 figures, 5 tables. Post-hoc descriptive analysis on archived RANZCR CLiP test predictions
Subjects:
Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
MSC classes:
68T30, 68T37, 68T45
ACMclasses:
I.2.4; I.2.1; I.4.8
Cite as:
arXiv:2609.29536 [cs.AI]
(or
arXiv:2609.29536v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.29536
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
65. 【2609.29529】oCo-Mesh: Topology-Consistent Dynamic Mesh Reconstruction via Adaptive Tessellation and Surface-Aligned 2DGS
链接：https://arxiv.org/abs/2609.29529
作者：Chuanjin Fan,Wenjie Chang,Aibing Li,Bingzhou Wang,Wenfei Yang,Tianzhu Zhang
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：multi-view temporal images, temporal images remains, Reconstructing dynamic meshes, Reconstructing dynamic, remains a challenge
备注： Project page: [this https URL](https://fan-treasure.github.io/ToCo_Mesh_page/)
点击查看摘要
Abstract:Reconstructing dynamic meshes with consistent topology from multi-view temporal images remains a challenge. Existing approaches typically face a dilemma between fine-scale shape recovery and topological stability. Frame-by-frame extraction methods capture fine details but break vertex correspondence, leading to flickering meshes. Conversely, template-based deformation ensures consistency but struggles to adapt its surface resolution during optimization, missing local surface details. To address these limitations, we propose ToCo-Mesh, a dynamic reconstruction framework that maintains topology consistency over time while achieving high-fidelity geometry. Specifically, we introduce a dual-mesh representation, where a canonical template mesh is tightly bound to time-varying coarse guide meshes via barycentric parameterization. While keeping guide meshes fixed to condition the deformation, we perform error-driven split-and-merge on the template mesh to progressively increase reconstruction fidelity. Furthermore, to suppress surface irregularities and achieve photorealistic rendering, we incorporate a Surface-Aligned 2DGS module. By anchoring flattened Gaussians to mesh faces, we utilize their rendered normals to guide inverse geometric fine-tuning. To our knowledge, ToCo-Mesh is the first framework to enable adaptive mesh refinement while maintaining strict topological consistency. Extensive experiments demonstrate that our method achieves SOTA geometric accuracy while maintaining competitive rendering quality.
66. 【2609.29527】CoSWA-YOLOv12: Scale-Invariant Tiny Object Detection and Segmentation of Malaria Parasites
链接：https://arxiv.org/abs/2609.29527
作者：Ahmed Tahiru Issah,Carine Mukamakuza
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：early ring stage, Automated microscopy, Gaussian Wasserstein Distance, low-resource settings, pixels wide
备注： Accepted at The 3rd MIRASOL workshop, a satellite event at MICCAI 2026. To appear in Springer Lecture Notes in Computer Science (LNCS)
点击查看摘要
Abstract:Automated microscopy could widen access to malaria diagnosis in low-resource settings, but the deadliest species, P. falciparum, presents in its early ring stage as an object only a few tens of pixels wide. Such tiny targets are systematically under-detected: overlap-based label assignment starves them of positive samples, and overlap-based box regression gives weak gradients at their scale. The Normalized Gaussian Wasserstein Distance (NWD) repairs both effects, but applied uniformly across a slide that also holds objects three to four times larger it loosens their supervision and erodes their localisation, so overall accuracy can fall even as the tiny class improves. We present CoSWA-YOLOv12, a compact YOLOv12 instance-segmentation detector whose core Cooperative Scale-adaptive Wasserstein Assignment routes the Wasserstein treatment to an object in inverse proportion to its size, tapering back to standard assignment for larger species. Two further components support it: a wavelet detail residual, and a min-max Gaussian regression loss (M2-NWD). All three additions are transfer-safe: each reproduces the standard pretrained model exactly at initialisation, so public pretrained weights load without any loss of accuracy. On a five-class Rwandan thick-smear dataset, CoSWA-YOLOv12 raises P. falciparum recall from 0.63 to 0.74 and mAP@50 from 0.73 to 0.81 (mask), cuts missed P. falciparum from 38% to 15%, and improves strict-localisation mAP@50-95 on all five classes for both detection and segmentation, while a 2x2 ablation shows the scale gate and the regression loss are synergistic.
67. 【2609.29517】AdaPilot: Towards Scene-Adaptive Policy Learning for Cross-Generator Text-to-Image Quality Optimization
链接：https://arxiv.org/abs/2609.29517
作者：Wenjin Liu,Fayuan Ke,Yue Lu,Zhe Cui,Anh Tuan Luu,Haoran Luo
类目：Computer Vision and Pattern Recognition (cs.CV); Computational Engineering, Finance, and Science (cs.CE)
关键词：multi-turn visual feedback, Markov Decision Process, Existing methods, methods for improving, visual feedback
备注：
点击查看摘要
Abstract:Existing methods for improving text-to-image generation quality have progressed from generator fine-tuning and prompt optimization to reinforcement learning with multi-turn visual feedback. However, existing strategies are deeply coupled with specific generators and tasks, and the learned capabilities are difficult to generalize into a universal quality optimization policy. Therefore, we propose AdaPilot, which learns a scene-adaptive, cross-generator transferable quality optimization policy by formulating multi-turn image generation as a Markov Decision Process (MDP) and optimizing it via end-to-end reinforcement learning. Specifically, AdaPilot decouples the policy from generator internals to enable cross-generator transfer, introduces scene-aware rewards that adaptively align quality assessment dimensions with task semantics, and employs process-level rewards to model the evolution trajectory of image quality. Experimental results show AdaPilot outperforms baselines in generation quality and generalization. Separate cross-generator evaluations further show that a single policy transfers zero-shot to unseen generators while maintaining positive average gains across all evaluated generators. Our project is available at this https URL.
68. 【2609.29460】AgriCountDINO: Parameter-Efficient Exemplar-Guided Counting and Localization in Agriculture
链接：https://arxiv.org/abs/2609.29460
作者：Shengjie Guo,Xin Li,Borjana Arsova,Hanno Scharr,Silvio Salvi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：organs support phenotyping, density vary widely, Accurate counting, yield estimation, organs support
备注：
点击查看摘要
Abstract:Accurate counting and localization of plants and their organs support phenotyping and yield estimation, yet target appearance, scale, and density vary widely across species and imaging conditions. Exemplar boxes specify the target without category-specific retraining, and point predictions identify the individual instances contributing to the count. We introduce AgriCountDINO, a parameter-efficient exemplar-guided framework for joint counting and localization. It conditions frozen multiscale DINOv3 features on exemplar appearance and size, then progressively decodes them into target points. Missed-object recovery extends supervision to targets overlooked by initial matching, and exemplar-adaptive point NMS filters duplicate predictions according to exemplar scale. With 8.4M trainable parameters, approximately one-tenth of TasselNetV4's, AgriCountDINO achieves a three-shot MAE of 11.92 on the TPC-268 benchmark, reducing counting error by 9.7\% while providing individual target locations. Trained only on TPC-268, it achieves a zero-shot MAE of 14.25 on unseen generic object categories in FSC-147, improving upon the best compared zero-shot method by 6.0\% without target-domain training or fine-tuning.
69. 【2609.29457】Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space
链接：https://arxiv.org/abs/2609.29457
作者：Jaron Yeh,Yen-Wei Chang,Jiang Liu,Shao-Yuan Lo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Industrial anomaly detection, multimodal inspection systems, conventional detection, evolving beyond conventional, anomaly detection
备注： 5 pages
点击查看摘要
Abstract:Industrial anomaly detection (IAD) is evolving beyond conventional detection and localization toward multimodal inspection systems that can describe, explain, and reason about fine-grained defects. Although recent multimodal large language model (MLLM)-based methods improve anomaly understanding through textual reasoning and visual guidance, they face two limitations in fine-grained inspection. First, their visual refinement often requires iteratively revisiting local image regions or augmenting with additional tools. Second, the resulting local defect evidence may not be reliably preserved throughout subsequent reasoning. To address these, we propose Anomaly-LR, a defect-grounded latent reasoning framework that first forms a global understanding of the input and then progressively refines anomaly-relevant representations directly in the visual latent space. We further construct IAD-LR-22K, the first IAD instruction dataset designed for latent reasoning, containing 22,228 image-question instances from 4,523 industrial images, with global textual reasoning traces and region-level visual annotations. Extensive experiments show that Anomaly-LR achieves state-of-the-art performance among comparable-scale methods across multiple IAD benchmarks, without requiring external references or tools. The code and data will be released at this https URL.
70. 【2609.29456】Dense Coverage, Sparse Refinement: Byte-Constrained Cooperative Perception
链接：https://arxiv.org/abs/2609.29456
作者：Melih Yazgan,Timon Müller,J. Marius Zöllner
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Collaborative perception improves, perception improves autonomous, improves autonomous perception, Collaborative perception, sharing intermediate
备注： Accepted at WACV 2027 (first-round acceptance)
点击查看摘要
Abstract:Collaborative perception improves autonomous perception by sharing intermediate Bird's-Eye-View (BEV) features across connected agents, but dense feature exchange is difficult to deploy under strict Vehicle-to-Everything (V2X) bandwidth limits. Existing efficient methods typically either compress the full feature map uniformly, spending bits on low-value background, or sparsify communication, risking the loss of useful context. We propose a coverage-refinement design for byte-constrained cooperative perception: each agent transmits a highly compressed coarse layer over the full BEV map and allocates the remaining budget to selected high-resolution patches. A Task-Aware Benefit Selector ranks cells by estimated downstream utility, enabling deterministic budgeted refinement and zero-retraining adaptation to changing bandwidth. The receiver reconstructs a dense BEV tensor compatible with standard fusion modules. Experiments on DAIR-V2X and OPV2V show strong accuracy-payload trade-offs at kilobyte-scale budgets. On DAIR-V2X, our method reaches 0.60 AP@0.7 at only 1.87 KB per non-ego agent, compared with 0.52 at 4.61 KB for uniform SimVQ compression. Controlled diagnostics further show that the gain arises from coverage-refinement allocation rather than quantization alone. Code will be published.
71. 【2609.29447】Frame-to-Panorama Localization and Context-Aware Sampling for Scene-Specific Ship Detection in a Smart Marina Testbed
链接：https://arxiv.org/abs/2609.29447
作者：Ignat Romanov,Andreas Hadjipieris,Neofytos Dimitriou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computational Geometry (cs.CG)
关键词：enabling repeated experimentation, provide continuous access, AI-based maritime services, heterogeneous sensing streams, infrastructures provide continuous
备注：
点击查看摘要
Abstract:Smart maritime infrastructures provide continuous access to heterogeneous sensing streams, enabling repeated experimentation, digital-twin development, and AI-based maritime services. However, sensing hardware alone is not sufficient for scene-specific model development: historical video streams must also be spatially indexed, contextualized, and reduced to informative subsets for annotation. This paper presents a frame-to-panorama localization and context-aware sampling pipeline for ship detection in historical PTZ maritime video lacking reliable pan, tilt, and zoom metadata. The main contribution is an end-to-end data-curation approach that recovers camera-view information from historical PTZ video and combines it with environmental context and visual diversity to construct compact, scene-specific training sets. Specifically, frames are localized on a reference panorama using SuperPoint and LightGlue, enriched with weather and solar-state metadata, and selected through diversity sampling to preserve variation across camera view and environmental conditions. A second context-aware stage targets under-represented distant-vessel cases near the horizon using tile-level visual embeddings and Gaussian Mixture Model clustering. Applied within the CMMI MDigi-I Smart Marina testbed, the proposed pipeline reduces 40,718 candidate frames to 220 images for annotation, corresponding to a 99.5% reduction. A YOLO26-m detector fine-tuned on this subset achieves a mean AP50 of 94.78% $\pm$ 0.51% and a mean AP50-95 of 75.10% $\pm$ 1.73% under sequence-grouped five-fold cross-validation. These results demonstrate that highly redundant infrastructure video streams can be transformed into compact, spatially and contextually diverse training sets for scene-specific detector adaptation while substantially reducing annotation effort.
72. 【2609.29443】Pose Adaptive Dynamic FiLM Modulation for Visual Speech Recognition
链接：https://arxiv.org/abs/2609.29443
作者：Matthew Kit Khinn Teng,Haibo Zhang,Takeshi Saitoh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：introduces substantial appearance, substantial appearance transformations, making pose-aware feature, visual speech recognition, variation introduces substantial
备注： Submitted for conference publication and currently under review
点击查看摘要
Abstract:Head-pose variation introduces substantial appearance transformations in visual speech recognition (VSR), making pose-aware feature modulation desirable. However, performance degradation and unwanted feature interactions may result from using numerous Feature-wise Linear Modulation (FiLM) circuits with fixed modulation intensity. We propose a Pose Adaptive Dynamic FiLM framework with a Dynamic Residual FiLM (DR-FiLM) modulator that predicts input-dependent weights to adaptively control the strength of pose-conditioned modulation. Experiments on LRS2 and LRS3 demonstrate that unweighted multi-pathway modulation substantially degrades phoneme recognition, increasing PER to 20.33% and 29.42%, respectively, compared with 16.20% and 20.96% for the single ResFiLM configuration. In contrast, the proposed DR-FiLM with dynamic Deep-Res weighting reduces PER to 15.74% on LRS2 and 23.91% on LRS3, substantially mitigating the adverse effects of unweighted modulation. The analysis of the learned weights further reveals a consistent tendency to assign greater weight to the deeper FiLM pathway as head-pose variation increases. These results show that merging pose-conditioned FiLM circuits is more efficient when the modulation strength is dynamically controlled.
73. 【2609.29433】Detecting Glaucoma Across Multi-ethnic Myopic and Non-Myopic Populations Using an Uncertainty-Aware Vision Transformer: A Multicentre Model Development and Validation Study
链接：https://arxiv.org/abs/2609.29433
作者：Raghavan Lavanya,Yangqin Feng,Ten Cheer Quek,Quan V. Hoang,Linda Yi-Chieh Poon,Jost B. Jonas,Ya Xing Wang,Vinay Nangia,Jin Wook Jeoung,Sehie Park,SoYeon Kim,Benjamin Y Xu,Sreenidhi Iyengar Munimadugu,Paul Mitchell,Gerald Liew,Yanin Suwan,Jirayu Hong-amata,Sahil Thakur,Monisha E Nongipur,Tina Wong,Rahat Husain,Ng Si Rui,Yamon Syn,Phey Feng Lo,Nicholas Tan Yi Qiang,Shaista Hussain,Xiaofeng Lei,Zhi Da Soh,Marco Yu,Haslina Hamzah,Zizhou Wang,Yan Wang,Liangli Zhen,Xinxing Xu,Tien-Yin Wong,Tin Aung,Rachel S Chong,Yong Liu,Ching-Yu Cheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：colour fundus photographs, Artificial intelligence, based glaucoma detection, offers scalable screening, Vision Transformer-based deep
备注：
点击查看摘要
Abstract:Background: Artificial intelligence (AI)-based glaucoma detection from colour fundus photographs (CFP) offers scalable screening, but performance may decline on external datasets because of differences in ground-truth definitions, populations, and coexisting conditions such as high myopia (HM). We developed and validated a Vision Transformer-based deep learning (DL) model for glaucoma detection across multi-ethnic cohorts with and without HM. Methods: A ViT-B/16 model with predictive uncertainty estimation was developed using 56,483 CFPs (57.1% with myopia; 14.4% with HM). Glaucoma labels were standardised using clinical, imaging, and perimetry data. The model was validated on 16 independent datasets across three continents, including four datasets with explicit HM labels. Findings: Internal AUROC was 98.7% (95% CI 98.2-99.1%), with sensitivity 94.5% and specificity 97.3%. Across 16 external datasets from eight countries, AUROCs ranged from 86.4% to 99.6%. In HM eyes, internal AUROC was 97.8% (95% CI 96.1-99.2%), with sensitivity 94.8% and specificity 93.7%. External HM AUROCs were 86.5% in the Beijing Eye Study and 93.3%, 91.8%, and 85.5% in hospital-based datasets from Taiwan, Thailand, and South Korea. In an exploratory HM clinical evaluation, the model had higher CFP-only diagnostic accuracy than ophthalmologists and trained graders (92.0% vs 70.0%; p=0.008) and performed comparably to glaucoma specialists using full clinical information. Interpretation: The model showed robust glaucoma detection across myopic and non-myopic multi-ethnic populations and may support AI-assisted screening in settings with high HM prevalence.
74. 【2609.29387】When Misalignment Becomes Supervision: Structured Label Noise in Supervised Synthetic CT Generation
链接：https://arxiv.org/abs/2609.29387
作者：Valentin Boussot,Cedric Hemon,Caroline Lafond,Jean-Claude Nunes,Jean-Louis Dillenseger
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reference CT images, commonly trained, trained and evaluated, regression against registered, registered reference
备注： 23 pages, 4 figures, 19 tables
点击查看摘要
Abstract:Supervised synthetic CT (sCT) generation is commonly trained and evaluated as voxel-wise regression against registered reference CT images. In practice, MRI-CT and CBCT-CT pairs are aligned through registration procedures that leave residual misalignments. These residuals are not independent intensity noise but spatially coherent geometric discrepancies that act as structured label noise. We investigate how this registration-induced bias affects supervised MRI-to-CT and CBCT-to-CT synthesis on 1,784 paired patients covering five anatomical regions. Voxel-wise scores strongly depend on the consistency between the registration used to build the training targets and the one used for evaluation: models score best when both conventions match, showing that networks partly learn the geometric convention of the registration pipeline and that standard metrics reward it. Training on more anatomically consistent registrations reduces prediction variability and improves out-of-distribution robustness, and CT-only controls show that registration alone produces metric errors in the range of top challenge submissions. To mitigate the limits of voxel-wise supervision, we introduce a perceptual loss computed in the feature space of a pretrained Segment Anything encoder. Compared with MAE-only and VGG-based objectives, it improves downstream segmentation and yields sharper, more structurally coherent sCT. Perceptual and voxel-wise metrics disagree under imperfect alignment and agree when the evaluation geometry is reliable. These results identify registration-induced bias as a central confounder in supervised sCT generation and argue for complementing voxel-wise agreement with anatomy-oriented evaluation criteria.
75. 【2609.29384】Segment-Level Risk Discovery in Online Handwriting for Alzheimer's Disease Detection
链接：https://arxiv.org/abs/2609.29384
作者：Changqing Gong,Huafeng Qin,Mounîm A. El-Yacoubi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：low-cost behavioral biomarker, Alzheimer disease, biomarker for Alzheimer, non-invasive and low-cost, low-cost behavioral
备注：
点击查看摘要
Abstract:Online handwriting provides a non-invasive and low-cost behavioral biomarker for Alzheimer's disease (AD) detection, as it reflects both cognitive planning and fine motor control. Existing handwriting-based AD detection methods usually rely on global trajectory features or whole-sample representations, which can be strongly affected by individual writing style, task-specific variation, and acquisition noise. In this paper, we propose NormPaST-Risk, a healthy-normative Paper-Air selective trajectory state-space risk network for interpretable AD detection from online handwriting. Instead of treating the entire trajectory as a single holistic representation, our method reformulates AD handwriting detection as local disease-relevant segment discovery. Specifically, a multi-scale temporal encoder captures stroke dynamics at different temporal resolutions, while a selective Paper-Air state-space encoder models long-range handwriting progression and distinguishes on-paper motor execution from in-air planning and transition behaviors. To explicitly characterize abnormal deviations, a healthy normative branch learns normal handwriting dynamics from healthy controls, and a task-aware multi-expert segment-risk module estimates segment-level AD risk calibrated by hidden-state changes and normative deviations. A weakly supervised segment-level objective further enables high-risk segment discovery without manual segment annotations. Experiments on the DARWIN benchmark demonstrate that the proposed framework achieves superior AD/HC classification performance compared with existing methods. Moreover, the discovered high-risk segments can be projected back to the original handwriting trajectory, providing interpretable evidence associated with AD-related handwriting variations.
76. 【2609.29379】On the second-order optimization for spiking neural networks
链接：https://arxiv.org/abs/2609.29379
作者：Ngoc Phu Doan,Ihsen Alouani
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：conventional neural networks, Spiking Neural Networks, Neural Networks, conventional neural, Spiking Neural
备注：
点击查看摘要
Abstract:Spiking Neural Networks (SNNs) offer an energy-efficient alternative to conventional neural networks by exploiting sparse, binary spikes, and event-driven computation. However, the training of SNNs remains challenging, as spiking activations create a sharp loss landscape that hinders training, and diagonal-curvature optimizers such as the Adam family may fail to capture this geometry. The extension of curvature-based optimization methods to SNNs is further complicated by the sparse, discrete, and temporally recurrent nature of their underlying dynamics. To address these limitations, we propose SpiKFAX, a second-order optimization method that formulates a computationally tractable, Kronecker-factored approximation of the Fisher information matrix specifically adapted to the structure of SNNs. Empirical evaluation across five architectures and seven datasets demonstrates that SpiKFAX consistently yields improvements in test accuracy and training stability relative to other popular optimizers.
77. 【2609.29376】A Hybrid CNN--State-Space--Attention Backbone with Joint-Embedding Predictive Pretraining for 12-Lead ECG Classification
链接：https://arxiv.org/abs/2609.29376
作者：Yakoub Bazi,Sarah Aljuhani,Mohamad M. Al Rahhal,Mansour Zuair,Naif Alajlan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：architecture remains challenging, single efficient architecture, efficient architecture remains, classification requires representations, jointly capture local
备注：
点击查看摘要
Abstract:Automatic 12-lead electrocardiogram (ECG) classification requires representations that jointly capture local waveform morphology, long-range temporal dynamics, and cross-lead dependencies, yet integrating these properties within a single efficient architecture remains challenging. This paper introduces a hybrid CNN-SSM-Attention backbone for 12-lead ECG classification. A convolutional stem performs early waveform tokenization and temporal reduction, mixed state-space and depthwise-convolutional blocks model temporal dynamics and local morphology, and a late self-attention stage enables global token interaction at reduced resolution. To improve transfer from unlabeled data, we further develop an ECG-oriented Joint-Embedding Predictive Pretraining (JEPA) framework. Unlike ViT-based JEPA methods that mask patch tokens before the encoder, the proposed method samples span masks at the latent temporal resolution and projects them back to the waveform domain, then predicts clean latent targets from a momentum encoder without waveform reconstruction. Experiments on CPSC2018, Chapman-Shaoxing, and PTB-XL, with pretraining on approximately 350K unlabeled CODE-15 recordings, show that the proposed backbone provides strong supervised baselines under a compact parameter budget. JEPA pretraining further improves transfer, particularly in reduced-label settings and under both full fine-tuning and LoRA-based adaptation. Code: this https URL
78. 【2609.29375】Free-Init: Scan-Free, Motion-Free, and Correspondence-Free Initialization for Doppler LiDAR-Inertial Systems
链接：https://arxiv.org/abs/2609.29375
作者：Mingle Zhao,Jiahao Wang,Tianxiao Gao,Chengzhong Xu,Hui Kong
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)
关键词：FMCW Doppler LiDAR, Robust initialization, innovative FMCW Doppler, Doppler, Doppler LiDAR
备注： IEEE Robotics and Automation Letters (RA-L), 2024
点击查看摘要
Abstract:Robust initialization is crucial for online systems. In the letter, a high-frequency and resilient initialization framework is designed for LiDAR-inertial systems, leveraging both inertial sensors and Doppler LiDAR. The innovative FMCW Doppler LiDAR opens up a novel avenue for robotic sensing by capturing not only point range but also Doppler velocity via the intrinsic Doppler effect. By fusing point-wise Doppler velocity with inertial measurements under non-inertial kinematics, the proposed framework, Free-Init, eliminates reliance on motion undistortion of LiDAR scans, excitation motions, and map correspondences during the initialization phase. Free-Init is also plug-and-play compatible with typical LiDAR-inertial systems and is versatile to handle a wide range of initial motions when the system starts, including stationary, dynamic, and even violent motions. The embedded Doppler-inertial velocimeter ensures fast convergence and high-frequency performance, delivering outputs exceeding 10 kHz. Comprehensive experiments on diverse platforms and across myriad motion scenes validate the framework's effectiveness. The results demonstrate the superior performance of Free-Init, highlighting the necessity of fast, resilient, and dynamic initialization for online systems.
79. 【2609.29374】FMCW-LIO: A Doppler LiDAR-Inertial Odometry
链接：https://arxiv.org/abs/2609.29374
作者：Mingle Zhao,Jiahao Wang,Tianxiao Gao,Chengzhong Xu,Hui Kong
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)
关键词：Conventional LiDAR-inertial odometry, Modulated Continuous Wave, Frequency Modulated Continuous, FMCW Doppler LiDARs, Conventional LiDAR-inertial
备注： IEEE Robotics and Automation Letters (RA-L), 2024
点击查看摘要
Abstract:Conventional LiDAR-inertial odometry (LIO) or simultaneous localization and mapping (SLAM) methods heavily rely on geometric features of environments, as LiDARs primarily provide range measurements instead of motion measurements. From now on, however, the situation changes thanks to the novel Frequency Modulated Continuous Wave (FMCW) Doppler LiDARs. FMCW Doppler LiDARs not only offer the point range with high resolution but also capture the instant point Doppler velocity through the Doppler effect. In the letter, we propose FMCW-LIO, a novel and robust LIO, leveraging intrinsic Doppler measurements from FMCW Doppler LiDARs. To correctly exploit Doppler velocities, a motion compensation method is designed, and a Doppler-aided observation model is applied for on-manifold state estimation. Then, dynamic points can be effectively removed by the Doppler criteria, deriving more consistent geometric observations. FMCW-LIO eventually achieves accurate state estimation and static mapping, even in structure-degenerated environments. Extensive experiments in diverse scenes are performed and FMCW-LIO outperforms other algorithms on both accuracy and robustness.
80. 【2609.29373】Shadow Reduction in Ultrasound Imaging Using Differentiable Simulation and Radiance Field Decomposition
链接：https://arxiv.org/abs/2609.29373
作者：Valentin Bacher(1),Pak Hei Yeung(1 and 2),Bernhard Kainz(3 and 4),Madeleine K. Wyburd(1 and 5),Nicola K. Dinsdale(1),Michael Gray(6),Ana I. L. Namburete(1) ((1) Oxford Machine Learning in NeuroImaging Lab, University of Oxford, United Kingdom, (2) Quantitative Healthcare Analysis (qurAI) Group, University of Amsterdam, The Netherlands, (3) Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany, (4) Imperial College London, United Kingdom, (5) Department of Computer Science, University of Copenhagen, Denmark, (6) Institute of Biomedical Engineering, University of Oxford, United Kingdom)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：obscure clinically important, clinically important structures, Acoustic shadows, attenuating tissues obscure, tissues obscure clinically
备注： 39 pages, 19 figures, submitted to Medical Image Analysis
点击查看摘要
Abstract:Acoustic shadows from bone and other highly attenuating tissues obscure clinically important structures in ultrasound. In fetal brain imaging, skull-induced artefacts disproportionately degrade the hemisphere closer to the transducer (proximal), limiting symmetric assessment of the two hemispheres. Existing correction methods require raw scanner data, impose restrictive assumptions on tissue properties, or rely on generative models that may hallucinate anatomy. We present RFlash, a physics-informed post-processing method that decomposes beamformed ultrasound images into explicit attenuation and scatter-intensity maps using a differentiable radiance-field formulation of image formation. Attenuation-adaptive re-rendering then removes the dependence of the signal at each depth on the intervening tissue, equivalent to virtually advancing the transducer into the tissue. Across 1,261 3D fetal brain volumes, 143 real 2D curvilinear abdominal scans, and 1,200 simulated 2D linear-probe liver scans, RFlash reduces shadow-related intensity differences more effectively than classical Hughes-Duck attenuation correction. For a gestational-age model trained on the distal hemisphere (further from the transducer) and applied to the proximal hemisphere, prediction error decreases by 5.1 days (40%) relative to the original images. The estimated attenuation maps also yield shadow-confidence maps that improve random-forest bone-shadow segmentation over the image alone and receive greater SHAP importance than an existing neural confidence-map baseline, suggesting greater physical consistency. RFlash requires neither hardware modification nor access to raw scanner data and supports 2D and 3D acquisitions with linear and curvilinear probes, making it widely applicable allowing clinicians to use our method on their already acquired scanners and images.
81. 【2609.29358】Domain Recentering and Confidence-Weighted Prior Calibration for Vision-Language Models
链接：https://arxiv.org/abs/2609.29358
作者：Youngeun Seol,Jimin Shin,Heeseo Yoon,Uiwon Hwang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Vision-language models, visual embeddings drift, strong zero-shot classification, fixed text embeddings, drift from fixed
备注：
点击查看摘要
Abstract:Vision-language models such as CLIP achieve strong zero-shot classification, yet under distribution shift, visual embeddings drift from fixed text embeddings. Training-free calibration avoids the per-sample optimization of prompt learning, but prior feature calibration gives each image the full bias of one hard cluster. We propose Domain Recentering with Confidence Calibration (DRC), a training-free method adapting CLIP from a set of unlabeled target images. DRC fits a Gaussian mixture once and subtracts from each embedding a posterior-weighted average of component means. It then removes residual class preference with a log-prior correction, estimating the prior from confidence-weighted predictions. Among compared methods, DRC achieves the highest average accuracy on cross-domain datasets, exceeding zero-shot CLIP by 4.13 and 5.07 points with ViT-B/16 and ResNet-50, with gains over CLIP also holding under ImageNet distribution shifts.
82. 【2609.29350】Learning a Flow to Self-Supervised Representations
链接：https://arxiv.org/abs/2609.29350
作者：Yuling Jiao,Wensen Ma,Houduo Qi,Defeng Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)
关键词：structure self-supervised representations, offer a direct, structure self-supervised, geometric references offer, Flow-Based Distribution Matching
备注： 33 pages, 2 figures, including appendix
点击查看摘要
Abstract:Explicit geometric references offer a direct way to structure self-supervised representations. Existing adversarial distribution-matching formulations, however, require costly encoder-critic optimization. We introduce Flow-Based Distribution Matching (FBDM), a non-adversarial framework that learns this reference-directed geometry through spherical conditional velocity regression. An ETF-inspired reference allows its number of components K' to exceed the auxiliary flow dimension d* while retaining structured geometric separation. We assign both augmented views of each image to the same target, while limiting how many images each reference center can receive. An explicit alignment loss further pulls the two views' representations closer together. Experiments across benchmarks ranging from CIFAR to ImageNet show that FBDM achieves performance nearly on par with DM and remains competitive with existing SSL methods. Matched training-cost comparisons show a 1.48- to 1.83-fold speedup over DM with a negligible increase in GPU memory usage. We also provide a theoretical explanation for the usefulness of the learned representations: under stated conditions, we bound the downstream misclassification rate in terms of the FBDM pretraining loss.
83. 【2609.29347】SEE Challenge 2026: Event-Guided Brightness Adjustment Across a Broad Illumination Range
链接：https://arxiv.org/abs/2609.29347
作者：Yunfan Lu,Mingchao Xu,Hanyu Zhou,Shaoyu Liu,Haoyue Liu,Peiqi Duan,Shihan Peng,Yinqiang Zheng,Boxin Shi,Gim Hee Lee,Hui Xiong,Davide Scaramuzza
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：preserve brightness-change cues, Event cameras provide, high dynamic range, conventional RGB frames, Multimodal Vision Workshop
备注： This report has been accepted for publication at an ECCV 2026 Workshop
点击查看摘要
Abstract:Event cameras provide a high dynamic range and preserve brightness-change cues in lighting conditions where conventional RGB frames may be noisy or saturated. To benchmark event-guided restoration across a broad illumination range, we organized the SEE Challenge 2026 with the Event-Based Multimodal Vision Workshop at ECCV 2026. The task conditions restoration on one or more RGB frames, synchronized events, and a scalar target-brightness statistic provided by the organizers. It uses SEE-600K, which contains 610,126 image-event observations from 202 real-world scenes spanning low-light, normal-light, and high-light conditions with illumination variations of up to 1,000$\times$. The challenge follows an open-system protocol: participants may use different temporal contexts, architectures, pretrained weights, test-time augmentation, and post-processing strategies. PSNR determines the ranking, and SSIM is reported as a secondary metric. Around 70 teams registered interest and 15 valid CodaBench submissions were received. Six distinct teams completed organizer-side identity and technical verification, provided method descriptions, checkpoints, inference code, and instructions, and are included in the verified open-system ranking reported here. Beyond the ranking, this report analyzes exposure subsets, semantically distinct test cases, a shared failure pattern, system design choices, and inference strategies. The top systems obtain closely spaced average scores, while the best-performing method varies across cases and metrics; under severe underexposure, all verified systems retain visible local errors.
84. 【2609.29334】A Study of the Limits of Collaborative DCT-Based Image Denoising via Interpretable Neural Networks
链接：https://arxiv.org/abs/2609.29334
作者：Cristian Comellas,Julia Navarro,Antoni Buades
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Image denoising remains, applications in photography, scientific imaging, image restoration, fundamental problem
备注： Preprint submitted to Journal of Mathematical Imaging and Vision (JMIV). 17 pages, 11 figures. Supported by MCIN/AEI/ [https://doi.org/10.13039/501100011033](https://doi.org/10.13039/501100011033) under grant PID2021-125711OB-I00, and by the Spanish Ministry of Universities under grant FPU24/02805
点击查看摘要
Abstract:Image denoising remains a fundamental problem in image restoration, with applications in photography, biomedical, and scientific imaging. Modern deep neural networks achieve strong performance by learning powerful image priors, but often rely on large black-box models with limited interpretability. In contrast, DCT-based sliding-window and collaborative filtering methods such as BM3D offer clear algorithmic structure, but depend on handcrafted and non-differentiable operations. This work studies how far such structured collaborative filtering principles can be pushed when reformulated as trainable models. We introduce DeepBM3D, a compact fully differentiable architecture that combines non-local patch grouping, DCT-domain filtering, and multi-stage refinement within a BM3D-inspired pipeline. Lightweight convolutional feature extractors guide patch grouping, while filtering is performed through learned Wiener weights in the DCT domain. Experiments show that DeepBM3D improves over classical and hybrid baselines, remains competitive with FFDNet at low and moderate noise levels, and performs particularly well on repetitive textures.
85. 【2609.29329】Hyperbolic Multimodal Continual Learning: A Closest-Admissible Solution
链接：https://arxiv.org/abs/2609.29329
作者：Jiahong Liu,Ming Shen,Xiaohao Liu,Rex Ying,Menglin Yang,Tat-Seng Chua,Irwin King
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Euclidean feature subspaces, Existing continual-learning methods, Euclidean feature, methods protect parameters, continual-learning methods protect
备注： 49 pages, 10 figures, 11 tables
点击查看摘要
Abstract:Existing continual-learning methods protect parameters, replayed examples, or Euclidean feature subspaces. When applied to hyperbolic multimodal models, they do not explicitly preserve the Lorentz geometry that jointly encodes within-modality similarity, cross-modal correspondence, and semantic hierarchy; sequential updates can therefore retain task scores while still distorting previously learned relations. We address this gap with Hyperbolic Multimodal Continual Learning (HMCL). We show that preserving the old multimodal geometry amounts to restricting all modalities to one shared hyperbolic isometry, which induces a family of admissible first-order parameter changes. We formulate a joint closest-admissible (CA) correction that retains the shared rotation best matching the candidate modal updates; its minimal-rotation (MR) special case fixes this rotation to zero. Both variants correct the displacement realized by AdamW, and task anchoring bounds within-task accumulation while preserving learning freedom. Across a unified 16-task classification-retrieval stream with three hyperbolic backbones, HMCL improves final performance and backward transfer over sequential fine-tuning and four continual-learning baselines; HMCL-CA gives the highest Overall score on every backbone. A modality-extended stream confirms the retrieval gains. Representation analyses find 81.2 to 95.5 percent less radial, angular, cross-modal, and paired-distance drift; ImageNet-WordNet results show better semantic ancestry and radial hierarchy.
86. 【2609.29310】EgoSpeedUp: Transferring Human Manipulation Tempo to Robot Policies
链接：https://arxiv.org/abs/2609.29310
作者：Hanbit Oh,Yukiyasu Domae,Takuma Yagi
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrations, manipulation, Robot, imitation learning inherit, tempo
备注： 8pages
点击查看摘要
Abstract:Robot manipulation policies trained through imitation learning inherit not only the demonstrated behavior but also the conservative execution tempo of robot demonstrations. Existing acceleration approaches can execute faster than the original demonstrations, but determine the appropriate acceleration primarily from robot-side information or a predefined set of tempo factors, leaving open how to obtain a task-appropriate reference for how fast each manipulation phase should progress. We introduce EgoSpeedUp, a framework that uses human manipulation as temporal supervision for robot imitation learning. Our key insight is that human demonstrations naturally reveal task-appropriate, phase-wise manipulation tempo. Given slow robot demonstrations and human demonstrations of the same task, EgoSpeedUp aligns corresponding manipulation phases, estimates their relative execution tempos from multiple human demonstrations, and transfers the resulting phase-wise tempo by retiming the robot demonstrations. The retimed demonstrations are then used for standard behavior cloning, allowing the robot to retain its executable manipulation behavior while learning to perform it at a human-informed tempo. Across two real-world manipulation tasks, EgoSpeedUp improves the task success rate by an average of 25 percentage points (pp) while reducing successful execution time by 36.5%. These results demonstrate that human manipulation tempo provides an effective temporal reference for learning faster and more reliable robot policies.
87. 【2609.29292】PHOSA: Photorealistic 3D Sign Avatar Modeling and Benchmark
链接：https://arxiv.org/abs/2609.29292
作者：Haodong Wang,Hezhen Hu,Wengang Zhou,Houqiang Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：nuanced facial expressions, sign avatar modeling, Deaf community, photorealistic sign avatar, focus on photorealistic
备注： ECCV 2026, project page: [this https URL](https://naaapi.github.io/PHOSA)
点击查看摘要
Abstract:In this work, we focus on photorealistic sign avatar modeling, which is crucial for effective communication with the Deaf community and is characterized by complex hand gestures and nuanced facial expressions. To this end, we introduce MVSign, the first multi-view Chinese sign language dataset co-designed with Deaf experts, featuring diverse gestures and rich annotations. For precise SMPL-X annotation, we develop a hybrid fitting pipeline that produces accurate body, hand, and facial parameters and can also be applied to the monocular setting. Building on MVSign, we propose a decoupled sign avatar representation that isolates body, head, and hand components to capture complex articulations, together with a motion-aware sampling strategy to handle motion blur and balance gesture diversity. Extensive experiments demonstrate that our method achieves high-fidelity visual results on MVSign, particularly in detailed hand and facial regions, and generalizes well to in-the-wild monocular sign language videos. Project page: this https URL.
88. 【2609.29256】Deep learning of longitudinal visual fields predicts glaucoma progression rate and identifies fast progressors
链接：https://arxiv.org/abs/2609.29256
作者：Taiabur Rahman,Siddiqur Rahman,Muhammad Moniruzzaman,Ummay Kawsar,Sayedatunnessa Ratna,Shadman Siddique,Rafsan Siddique,Tausif Ahmad,Tahsin Ahmad,Golam Rabbani
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Glaucoma Longitudinal Analysis, irreversible blindness, prevent disability, timely identification, identification of fast
备注：
点击查看摘要
Abstract:Glaucoma is the leading cause of irreversible blindness, and timely identification of fast progressors is essential to prevent disability. Current practice estimates progression by ordinary least-squares regression of mean deviation (MD) on time, requiring 6--10 visual field (VF) tests over several years to obtain a reliable slope. We present GLAM (Glaucoma Longitudinal Analysis Model), a deep learning framework that ingests longitudinal Humphrey 24-2 total deviation sequences with five clinical features and predicts MD and visual field index progression rates using attention-based fusion and aleatoric uncertainty. On the open-access University of Washington Humphrey Visual Field dataset (4,276 patient-eyes), GLAM achieved an MD-rate mean absolute error of 0.139 dB yr$^{-1}$ ($R^2 = 0.927$; 73.5% reduction over a ridge baseline) and an AUC of 0.990 for fast-progressor detection. VF-only deep learning can match multimodal pipelines for progression prognostication using routinely collected perimetry alone.
89. 【2609.29252】IronViT: Toward Efficient Generalist Visual Representation Learning
链接：https://arxiv.org/abs/2609.29252
作者：Jiaxi Huang,Yueqi Hu,Xin Zhu,Xiaopeng Zhang,Huiting Qiao,Yanglin Zhang,Zefeng Ji,Rongxue Li,Yifei Xu,Huiying Yu,Wei Liu,Jiayin Zheng,Yinggan Xu,Peipeng Chen,Yin Zhang,Jian Yao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：attention underlying today, capture semantic, action-relevant cues, underlying today, today most capable
备注：
点击查看摘要
Abstract:A generalist vision encoder must capture semantic, spatial, language-aligned, and action-relevant cues within a unified representation, yet softmax attention underlying today's most capable visual backbones becomes prohibitively expensive at high resolution. A natural attempt to address both challenges is to distill multiple specialist teachers directly into an efficient architecture. We find that directly coupling these objectives degrades representation quality, as the student must simultaneously reconcile heterogeneous capabilities and adapt them to a different token-mixing architecture. We introduce IronViT, built on a simple principle: consolidate capabilities before constraining computation. IronViT first distills complementary specialists into a softmax attention capability bridge, then progressively transfers the consolidated representation to a hybrid softmax-linear attention encoder. A purpose-built data pipeline further curates the distillation corpus for higher information density and broader domain coverage. Across recognition, retrieval, dense prediction, multimodal understanding, and robotic learning, IronViT is competitive with leading specialist and generalist vision encoders. The softmax bridge achieves the strongest aggregate performance in multimodal understanding and robotic learning among the evaluated backbones, while the hybrid encoder retains broad transfer performance with an efficiency advantage that grows with input resolution. Together, these results show that consolidating capabilities before architectural conversion can yield a generalist visual encoder without inheriting the prohibitive high-resolution cost of conventional softmax attention.
90. 【2609.29240】OLA: Text-aware One-Step Latent Adaptation for Diffusion-based Text Image Super-Resolution
链接：https://arxiv.org/abs/2609.29240
作者：Yike Xu,Yue Shi,Yong Guo,Jiezhang Cao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：recover visually faithful, unknown degradations, Text image super-resolution, visually faithful, faithful and readable
备注： 18 pages, 11 figures, including appendices
点击查看摘要
Abstract:Text image super-resolution (TSR) aims to recover visually faithful and readable text under unknown degradations. Existing diffusion-based methods typically rely on multi-step prediction of either the high-resolution image or its text prior, resulting in prohibitive computational cost and inference latency. More critically, an erroneous text prior may be repeatedly injected into the denoising process, causing image and text predictions to reinforce each other and progressively amplify an early recognition error into a sharp yet semantically incorrect character. To address these limitations, we propose TOLA, a Text-aware One-step Latent Adaptation framework without iterative image-text diffusion. TOLA consists of two key modules. First, a confidence-weighted text conditioning module constructs the semantic condition only once and suppresses unreliable OCR predictions before they contaminate image reconstruction. Second, a lightweight latent residual correction module explicitly estimates and corrects the structured residual errors to recover missing or distorted stroke details. Extensive experiments demonstrate our state-of-the-art performance across all evaluation metrics on both CTR-TSR-Test ($\times 4$) and RealCE-200 benchmarks. It is worth noting that our TOLA consistently surpasses existing diffusion-based TSR methods by at least 2.72 dB in PSNR on CTR-TSR-Test.
91. 【2609.29235】SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection
链接：https://arxiv.org/abs/2609.29235
作者：Yuting Zhao,Ziyi Zheng,Shuxiao Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：prevailing paradigm, fusion, Camera-LiDAR fusion, autonomous driving, object
备注：
点击查看摘要
Abstract:Camera-LiDAR fusion has become a prevailing paradigm for 3D object detection in autonomous driving. However, existing fusion detectors often establish strong inter-modality dependencies by decoding object queries from tightly coupled multimodal representations. Under corrupted driving conditions, such dependencies make the detector vulnerable to unreliable modalities, where degraded observations may interfere with reliable modality-specific evidence and lead to suboptimal predictions. Moreover, modality reliability can vary across both global driving scenes and individual object queries, requiring adaptive fusion decisions at a finer granularity. To bridge this gap, we reformulate robust camera-LiDAR fusion as a scene-aware branch routing problem and propose SARFusion, a robust 3D object detector. Instead of producing detections from a single fused representation, SARFusion decouples object-query decoding into three parallel reasoning branches: a camera branch, a LiDAR branch, and a camera-LiDAR fusion branch. Guided by a Scene Reliability Prior estimated from the global driving context, SARFusion further incorporates object-level evidence to route each query to the most suitable branch. This query-wise routing strategy alleviates harmful cross-modal interference while preserving the benefits of multimodal fusion when complementary cues are trustworthy. On the nuScenes test set, SARFusion achieves strong performance with 72.5 mAP and 74.4 NDS. Extensive analyses demonstrate its robustness under challenging conditions, including sensor corruptions and environmental changes.
92. 【2609.29225】ComplexSync: High-Fidelity and Real-Time Lip Sync in Complex Scenarios
链接：https://arxiv.org/abs/2609.29225
作者：Jiaran Cai,Xingpei Ma,Shenneng Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generate visual lip, speech audio, aims to generate, generate visual, align precisely
备注：
点击查看摘要
Abstract:Lip synchronization aims to generate visual lip dynamics that align precisely with speech audio. Despite the high generation quality of diffusion models, they often struggle in complex scenarios and suffer from prohibitive inference latency, limiting real-world deployment. We present ComplexSync, a unified diffusion-based framework that enables real-time, high-fidelity lip sync under complex conditions. First, we introduce a dual-stream joint training strategy to mitigate information leakage from reference frames while preserving natural dynamics. Second, we develop a distillation-based acceleration scheme for single-step denoising, achieving a throughput of over 70 FPS. Third, we propose a relational alignment loss that leverages structural priors from Vision Foundation Models (VFMs) to enhance robustness against complex scene factors. Furthermore, we present the first benchmark specifically designed for complex lip synchronization, comprising over 200 challenging video sequences and specialized metrics. Extensive experiments demonstrate that ComplexSync achieves state-of-the-art performance across both standard and complex scenarios while enabling real-time inference.
93. 【2609.29224】FounRef: Robust, Structure-Preserving, and Fast Metric Refinement of Frozen Monocular Foundation Priors with Sparse Anchors
链接：https://arxiv.org/abs/2609.29224
作者：Dan Halperin,Mirko Mählisch
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：simultaneously remains challenging, fast inference simultaneously, inference simultaneously remains, Dense metric depth, metric
备注： 16 pages, 12 figures; includes appendix
点击查看摘要
Abstract:Dense metric depth from cameras is essential to real-world 3D applications, yet achieving accuracy, faithful surface geometry, and fast inference simultaneously remains challenging. Monocular foundation models provide rich, transferable geometric priors but lack reliable metric scale, while depth-completion networks recover metric depth at the cost of geometric fidelity, cross-domain robustness, or speed. We present FounRef, a training-free method that aligns a frozen monocular foundation prior with sparse metric anchors to produce dense metric depth. FounRef is modular by design: its depth prior, anchor source, and refinement solver can each be replaced independently. We instantiate FounRef with MoGe-2 and LiDAR anchors. FounRef validates each anchor against the prior's dense depth prediction, rejecting inconsistencies caused by cross-sensor misalignment that geometry-only filters cannot detect. It then applies global and local metric corrections through a structure-preserving solver, retaining the prior's fine-grained geometry. FounRef requires no task-specific training and operates out of the box across unfamiliar cameras and scenes. On out-of-domain data, it delivers up to 24% lower depth error, 92% lower surface-normal noise, and almost 15x faster inference than DMD3C, a state-of-the-art depth-completion network. By decoupling metric alignment from geometry prediction, FounRef provides an accurate, geometrically faithful, and efficient approach to dense metric depth that can directly benefit from future advances in foundation models and metric sensors.
94. 【2609.29193】ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding
链接：https://arxiv.org/abs/2609.29193
作者：Yusung Choi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：correspondence methods achieve, thresholds plateaus sharply, modern semantic correspondence, semantic correspondence methods, methods achieve
备注： Accepted to ACCV 2026
点击查看摘要
Abstract:The strong performance that modern semantic correspondence methods achieve at standard thresholds plateaus sharply at fine-grained thresholds. We argue that this plateau stems not from the representational capacity of backbone features, but from a grid-tied readout. Patch-based vision transformers tokenize images onto discrete grids, introducing two forms of quantization error: querying nearest patch features instead of exact keypoints on the source side, and the absence of grid features representing precise ground-truth locations on the target side. We quantify this quantization ceiling across all 499,188 keypoints in SPair-71k: under the standard 448x448, patch-14 setting, 84.9% of ground-truth keypoints have no grid feature representing their precise location at PCK@0.01. This is a structural limitation at the representation level, independent of the matching strategy. We address this with ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding, which formulates correspondence estimation over a continuous feature field queryable at arbitrary continuous coordinates. A FiLM-conditioned decoder is trained to embed sub-pixel positional information into the feature field. Querying the field directly at exact keypoint coordinates theoretically eliminates representation-level quantization error on the source side, while decoding onto a grid denser than the backbone grid substantially reduces quantization error on the target side. On SPair-71k and AP-10K (intra-species, cross-species, and cross-family), ImCorr improves performance at fine-grained thresholds (PCK@0.01-0.05), achieving a 6.2 percentage point gain over the prior state of the art at PCK@0.01 on SPair-71k. These results demonstrate that representational continuity is an effective solution for precise semantic correspondence. Code is available at this https URL.
95. 【2609.29186】An Automated Georeferencing Technique for Multi-Temporal Stope Point Clouds for Downstream Geotechnical Analysis
链接：https://arxiv.org/abs/2609.29186
作者：Dibyayan Patra,Simit Raval,Pasindu Ranasinghe,Bikram Banerjee,Ismet Canbulat
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generating large volumes, successive excavation stages, UAV laser scanning, enabled frequent acquisition, UAV laser
备注：
点击查看摘要
Abstract:The increasing use of UAV laser scanning in underground mines has enabled frequent acquisition of 3D point clouds from challenging environments such as stopes, generating large volumes of multi-temporal spatial data throughout successive excavation stages. However, in GNSS-denied underground environments, independently acquired stope point clouds are generated within local scanner reference frames and require registration and georeferencing before integration with mine reference data for downstream geotechnical analysis, monitoring, and mine planning. This process is commonly performed manually by aligning individual stope scans with mine reference drives, making repeated georeferencing time-consuming and potentially limiting the utilisation of routinely acquired data. This study proposes the 3D Tag-based Automated Registration and Georeferencing Technique (3D-TARGeT), an automated framework using low-cost, generic, non-unique rectangular tags to establish spatial correspondence between stope point clouds and the mine reference coordinate system. The framework combines automated tag identification, geometric tag matching, and rigid transformation estimation. It was evaluated as a proof of concept using four multi-temporal point-cloud scans of an underground mine stope, with the proposed tags simulated under representative scanning conditions. 3D-TARGeT achieved consistent centimetre-level georeferencing accuracy, with median cloud-to-cloud distance and root mean square error below 0.03 m across all scans, while substantially outperforming widely used automatic point-cloud registration techniques. Overall, 3D-TARGeT provides an accurate and robust approach for automating stope point-cloud georeferencing, reducing reliance on manual alignment and facilitating multi-temporal datasets for downstream geological and geotechnical applications.
96. 【2609.29171】Representation World Model: Learning States, Transition and Executable Plans in Representation
链接：https://arxiv.org/abs/2609.29171
作者：Yijun Yuan,Weicheng Zheng,Weibang Wang,Minghui Qin,Chang Sun,Junhao Huang,Kenan Li,Anmin Liu,Yicheng Yao,Hang Zhao
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Representation World Model, existing world models, executable plans directly, World Model, world models
备注： Website: [this https URL](https://tsinghua-mars-lab.github.io/RepresentationWorldModel)
点击查看摘要
Abstract:We propose the Representation World Model (RWM), which learns states, transitions, and executable plans directly in representation space. Unlike existing world models that typically learn latent representations together with explicit dynamics models and perform planning through search, optimization, or policy-based prediction, RWM directly incorporates planning into the learned representation geometry. RWM learns the representation geometry by applying inverse-dynamics supervision locally along latent paths constructed from endpoint representations, requiring these paths to preserve task-relevant state and transition information. At inference, planning is performed by directly constructing a latent path between the current and goal representations, with inverse dynamics used to recover the corresponding actions, without recursive rollouts or action-space search. Experiments on continuous-control benchmarks demonstrate the effectiveness of RWM for direct planning, while results on robotic manipulation further show its potential to extend to more complex embodied control tasks. These results suggest that planning directly in representation space provides a promising alternative to conventional world-model planning.
97. 【2609.29156】Med-AR: Autoregressive Vision-Language Pretraining for Long-Tailed Chest X-Ray Classification and Uncertainty-Aware Evaluation
链接：https://arxiv.org/abs/2609.29156
作者：Janhavi Prabhu,Sahil,Akshay V,Shivam Shukla,Manoj Tadepalli,Preetham Putha
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：requires visual representations, X-ray classification requires, classification requires visual, abnormalities and subtle, chest X-ray classification
备注： 80 pages including supplementary material, 28 figures, and 22 tables. Supplementary material is included
点击查看摘要
Abstract:Long-tailed chest X-ray classification requires visual representations that capture both common abnormalities and subtle, infrequent findings. We propose Med-AR-8B and Med-AR-2B, two radiology-native autoregressive vision-language models pretrained with structured reports, abnormality-focused text, and region annotations. We evaluate the transfer of their visual encoders to multi-label classification against contrastive, self-supervised, and supervised pretrained encoders, including Med-CLIP, CheXFound, EVA-Base, ARK, and BioViL-T, using a common ML-Decoder classification head. To assess fine-grained recognition, we also construct LLM-expanded, report-derived label sets for MIMIC-CXR and CheXpert. Across PadChest, MIMIC-CXR, and CheXpert, Med-AR-8B outperforms Med-CLIP in mean AUROC and AUPRC for head, medium, and tail findings. On MIMIC-CXR, it increases tail-label mean AUPRC from 0.1033 to 0.1441. Med-AR-2B achieves the strongest discrimination results on PadChest. Across the broader encoder comparison, a Med-AR variant achieves the highest mean AUROC and AUPRC in every reported prevalence group on each public dataset. Both Med-AR variants also achieve lower excess area under the risk-coverage curve than Med-CLIP on all three public datasets, indicating improved selective-prediction performance under the evaluated protocol. Internal results are metric-dependent, with Med-CLIP retaining advantages in overall and tail AUPRC and in selective prediction. These findings establish Med-AR as a strong pretraining recipe for long-tailed chest X-ray classification on the evaluated public benchmarks and demonstrate the value of assessing discrimination and selective prediction together.
98. 【2609.29151】Recoverable Geographic Location Information in Earth-Observation Embeddings
链接：https://arxiv.org/abs/2609.29151
作者：Peiwen Zhang,Kristie Hu,Jovana Knezevic,Shunde Yin,Kyle Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：downstream task accuracy, provide reusable embeddings, models provide reusable, location are desired, representations encode geographic
备注：
点击查看摘要
Abstract:Earth-observation (EO) foundation models provide reusable embeddings, yet downstream task accuracy does not reveal whether these representations encode geographic information, which may be beneficial for location-aware applications but potentially detrimental when representations invariant to geographic location are desired. We therefore evaluate the geographic coordinate robustness of Tessera v1, Tessera v1.1, and AlphaEarth by testing whether coordinates can be predicted from the embedding representations using 284 quality-verified European solar farms from 2024. We assessed geographic information content information through the association between cosine and geodesic distances and through prediction of projected coordinates in EPSG:3035. Embeddings from all three EO foundation models contain recoverable geographic information. All prediction models significantly outperform training-range uniform random sampling baselines, with AlphaEarth exhibiting the strongest distance association and lowest mean geodesic error. Both Tessera variants also yielded higher geographic distance correlations than the Sentinel-2 controls. These findings motivate geographic information content as an additional criterion for auditing EO foundation models.
99. 【2609.29125】FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection
链接：https://arxiv.org/abs/2609.29125
作者：Ben Liang,Chao Sui,Junqi Bai,Yuan Liu,Chunlai Li,Xiubao Sui,Qian Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：effectively exploiting complementary, effectively exploiting, environmental conditions, aerial RGB, modalities is critical
备注：
点击查看摘要
Abstract:In aerial RGB--IR object detection, effectively exploiting complementary information across modalities is critical for robust perception under complex illumination and environmental conditions. Existing multimodal detectors mainly focus on spatial-domain interaction or frequency-specific feature enhancement, while the cross-modal interaction patterns of different frequency components remain insufficiently explored. Moreover, spectral discrepancy itself may contain both useful complementary cues and unreliable modality-specific responses, making indiscriminate frequency fusion suboptimal. To address these issues, we propose FoCal, a frequency-oriented framework for aerial RGB--IR object detection. First, a Frequency-Aware Dual-Domain Calibration (FADC) module is developed to explicitly model frequency-dependent cross-modal interaction. Low-frequency components are collaboratively consolidated into a shared structural consensus, whereas high-frequency components preserve modality-specific information through selective cross-modal exchange. The resulting frequency-aware cues are further transferred to the original feature domain to regulate cross-modal calibration. Second, we introduce a Discrepancy-Guided Spectral Modulation (DGSM) module, which characterizes cross-modal spectral imbalance using confidence-weighted relative amplitude discrepancy and transforms it into a bounded signed gate for adaptive enhancement, preservation, or attenuation of the joint multimodal spectrum. Extensive experiments on DroneVehicle, ESCVehicle, and ATR-UMOD demonstrate the effectiveness of FoCal, yielding $\mathrm{mAP}_{50}$ values of 83.5\%, 54.8\%, and 64.6\%, respectively. Meanwhile, with only 3.0M parameters, FoCal achieves 113.6 FPS while preserving leading detection accuracy, highlighting a favorable accuracy--efficiency trade-off. Code is available at {this https URL.
100. 【2609.29121】Less is More: Encoder-only Audio-Visual Segmentation
链接：https://arxiv.org/abs/2609.29121
作者：Ilpo Viertola,Vladimir Iashin,Sophie Tötterström,Esa Rahtu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：classify sound-emitting objects, Audio-Visual Semantic Segmentation, Semantic Segmentation, aims to identify, video frames
备注： Submitted to ICASSP 2027. Project page [this https URL](https://ease-avs.notion.site)
点击查看摘要
Abstract:Audio-Visual Semantic Segmentation (AVSS) aims to identify, segment, and classify sound-emitting objects in video frames. Previous Transformer-based AVSS approaches largely inherit design principles from image segmentation models. Recent studies show that these image segmentation models contain redundant components that contribute little to the segmentation performance. Following this insight, we propose Encoder-only Audio-Visual Segmentation (EASE). EASE runs at up to 365 FPS, 3x faster than prior State-of-the-Art (SotA) AVS models at comparable accuracy, and trains in under 11 GPU-hours. Furthermore, we achieve SotA AVSS performance across different backbones and input resolutions. Our results demonstrate that AVSS can be both simpler and faster, providing a scalable foundation for future research and real-time applications. Code, model weights, and samples are available at this https URL
101. 【2609.29118】UpDown-SC: Gravity-Canonicalized Dual-Envelope Scan Context for Indoor LiDAR Place Recognition
链接：https://arxiv.org/abs/2609.29118
作者：Jie Xu,Yongxin Yang,Ziyi Jin,Kangjin Yu,Hongjun Huang,Chao Han,Zhongpu Xia
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：LiDAR place recognition, sensor mounting height, retrieval remains difficult, indoor retrieval remains, LiDAR place
备注： 8 pages, 7 figures, 2 tables. Code and evaluation artifacts: [this https URL](https://github.com/jiejie567/updown-sc)
点击查看摘要
Abstract:LiDAR place recognition is a key front end for loop closure and global relocalization, yet indoor retrieval remains difficult when attitude or sensor mounting height changes between mapping and query sessions. Scan Context stores the maximum height in each polar cell; indoors, broad ceilings can suppress the lower and mid-level geometry that distinguishes adjacent rooms and corridors. We present UpDown-SC, a training-free polar descriptor that first canonicalizes gravity and then represents two complementary surfaces: the upper envelope of lower/middle structures and the lower envelope of overhead structures. Their physical split is estimated once from a cell-balanced map height distribution and reused by every query. A mask-aware, non-uniform two-channel distance retains discriminative lower-level evidence while limiting sensitivity to its cross-session variation, without treating unobserved cells as zero-height measurements. Conventional Scan Context shortlisting and circular yaw alignment are retained, so retrieved hypotheses directly initialize geometric verification. Experiments across repeated indoor sessions, mounting-height changes, mixed outdoor-to-indoor trajectories, and an outdoor transfer sequence show more reliable first-choice retrieval on the indoor and mounting-height-varied sessions. A paired test finds a significant gain over Scan Context on the in-house sessions. UpDown-SC also gives the best or second-best F1max and AUPR under threshold-based acceptance while retaining a lightweight CPU front end. Continuous replay confirms that the retrieved hypotheses support metric prior-map localization. Code and evaluation artifacts: this https URL.
102. 【2609.29116】Spectral Amplitude Purification in Distribution Matching for Diffusion Distillation
链接：https://arxiv.org/abs/2609.29116
作者：Zhenyu Zhou,Can Wang,Chun Chen,Zeyu Zheng,Defang Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Distribution Matching Distillation, enables high-quality diffusion, optimization dynamics remain, dynamics remain dominated, Matching Distillation
备注：
点击查看摘要
Abstract:Distribution Matching Distillation (DMD) enables high-quality diffusion sampling in only a few steps, but its optimization dynamics remain dominated by coarse, low-frequency signals, delaying the recovery of fine-grained details. We identify a pronounced concentration of spectral amplitudes at low frequencies in the DMD directional error, where dominant low-frequency components overwhelm weaker mid- and high-frequency signals. To address this issue, we propose Spectral Amplitude Purification for Distribution Matching Distillation (SAP-DMD), a plug-and-play approach that adaptively modulates the amplitude spectrum of the DMD directional field. By suppressing the dominant tail of the amplitude spectrum, SAP-DMD reduces low-frequency dominance and promotes more effective recovery of fine structures and textures. Experiments on PixArt-$\alpha$, SD3, and SD3.5 demonstrate that SAP-DMD accelerates training convergence and improves generation quality under both 2-step and 4-step sampling.
103. 【2609.29106】WildHSR: Metric Feed-Forward 4D People-Scene Reconstruction from a 3D Foundation Model
链接：https://arxiv.org/abs/2609.29106
作者：Jerrin Bright,John Zelek
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computational Geometry (cs.CG)
关键词：forward pass, foundation models recover, metric, models recover video, scale
备注：
点击查看摘要
Abstract:3D foundation models recover video cameras and geometry in one forward pass, but some of the strongest are up to scale. Joint people-scene reconstruction then requires two missing outputs: metric scale and persistent person identity. We ask whether one up-to-scale foundation representation can support both through lightweight adaptation. Exact metric labels are scarce, but unlabeled in-the-wild video is abundant. We use people in curated web video to initialise the solution: a posed metric body and 2D keypoints give an approximate, closed-form scale pseudo-label. These pseudo-labels pretrain a Scale Readout, which is then fine-tuned together with a lightweight adapter using exact metric supervision from standard real-video training splits. At inference the head predicts metric scale from foundation-model tokens, without the ruler or its teachers. For person identity, we probe the pretrained foundation model alone and find evidence that its intermediate query-key features encode person correspondence across frames. In most evaluated moving-person clips, a mid-layer token prefers that person over the vacated location and other people. A tiny projection reads this correspondence; together with metric pelvis motion and proposal confidence, it drives dustbin-aware Sinkhorn association of per-frame bodies. WildHSR combines both readouts to reconstruct metric cameras, scene and people from monocular video. Each window is predicted feed-forward; analytic association and Sim(3) composition connect windows. On EMDB-2, WildHSR is the first feed-forward method in the published comparison to beat the best optimization-based WA-MPJPE and RTE while leading feed-forward methods on all three world-frame metrics. On RICH, it leads feed-forward people-and-scene methods on WA-MPJPE and W-MPJPE. The complete pipeline runs at 10.1 fps on one GPU.
104. 【2609.29092】DAWN: Noise-Robust Quadruped Parkour via Depth-Denoising World Models
链接：https://arxiv.org/abs/2609.29092
作者：Yohan Choi,Min-Jun Kim,Jin-Sung Kim,Yong-Jae Kim,Youn-Hee Han
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Vision-based legged locomotion, hand-tuned post-processing filters, Vision-based legged, training time, time and rely
备注： 8 pages, 6 figures. Accepted to IROS 2026
点击查看摘要
Abstract:Vision-based legged locomotion methods assume clean depth at training time and rely on hand-tuned post-processing filters at deployment. However, filter parameters are rarely disclosed, hindering reproducibility, and performance degrades substantially when depth noise is left unaddressed. Building noise robustness directly into the learning pipeline would eliminate this dependency. While such robustness has been explored for proprioceptive inputs, analogous approaches for depth perception remain largely absent in legged locomotion. We propose DAWN (Denoising and Alignment in World models for Noise-robustness), a noise-robust perception framework for legged locomotion, which builds noise robustness directly into a world model via two modifications: (1) feeding noisy depth to the encoder while keeping clean depth as the reconstruction target, forcing the model to implicitly denoise its input; and (2) applying contrastive learning to align the latent states of noisy and clean depth. Importantly, DAWN is not tied to a specific noise model, requiring no manual tuning to the noise distribution at deployment. Furthermore, it incurs no additional inference cost over existing world model-based methods. Without any manual filter calibration -- relying solely on the learned noise-robust representation -- DAWN achieves zero-shot quadruped parkour on a Unitree Go1: traversing stairs up to 18 cm, clearing gaps up to 70 cm, and mounting steps up to 45 cm from raw depth observations. Ablation studies show that denoising and contrastive alignment contribute at complementary levels -- reconstruction and representation, respectively -- and yield additive gains when combined. Videos and code are available at: this https URL
105. 【2609.29073】Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models
链接：https://arxiv.org/abs/2609.29073
作者：Kai Glantz,Clemens Grange
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：describe scenes, reason poorly, physical sizes, Vision-Language Models, small VLM
备注：
点击查看摘要
Abstract:Vision-Language Models (VLMs) describe scenes well but reason poorly about metric 3D structure such as absolute distances, physical sizes, or egocentric directions. We present a modular, predictor agnostic, tool-augmented framework that equips a small VLM (Qwen3.5-4B) with geometric tools: 3D object detection, metric depth estimation, and deterministic solvers for distance, size and bearing. Each object is detected in the camera frame of its own best view, and the tools use that frame's pose to lift every detection into one shared world frame. Moving metric computation out of the model's weights and into explicit solvers yields large gains on three of four ReVSI-Bench tasks: with a strong monocular detector (WildDet3D), absolute distance rises from 0.46 to 0.74 Mean Relative Accuracy (MRA), relative distance from 39.1% to 67.4%, and relative direction from a below-chance 25.9% to 73.4%. Because any detector can be swapped in behind the tool interface, comparing real detectors against ground-truth boxes separates perception error from reasoning error: orchestration costs only 0.03 MRA. Object size is bounded by the detector: the tools are near-exact on groundtruth boxes (0.97) yet the best real detector barely beats the no-tool baseline (0.61 vs. 0.58), because size reads straight off a box extent monocular detectors get wrong. Without a predefined recipe, the model already sequences the tools correctly on its own, matching a scripted pipeline on three of four tasks.
106. 【2609.29064】EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detection
链接：https://arxiv.org/abs/2609.29064
作者：Zhida Zhang,Xinlei Ma,Jie Cao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：photorealistic AI-generated images, AI-generated images demands, proliferation of photorealistic, photorealistic AI-generated, methods that generalize
备注： Accept by ICME 2026
点击查看摘要
Abstract:The proliferation of photorealistic AI-generated images demands robust detection methods that generalize across diverse generative models. While existing approaches target manipulation-based forgeries with local artifacts, generation-based images (e.g., from diffusion models) lack such traces, posing a fundamental challenge. We observe that generative models prioritize global semantics at the expense of local texture fidelity, making low-texture regions key indicators of synthetic origin. To exploit this, we propose EIB-Net, an Entropy-guided Information Bottleneck Network. EIB-Net introduces a novel Image Entropy (IE) metric to automatically select the most informative (lowest-entropy) patch, then processes it with a Variational Information Bottleneck (VIB) to learn compact, generalizable features. Extensive experiments on DIFF, DiffusionForensics, and GenImage benchmarks demonstrate state-of-the-art performance: EIB-Net achieves 85.7\% accuracy using only 2\% of training data, outperforming full-image baselines by over 15\%, and maintains robust cross-generator generalization (83.5\% average accuracy on GenImage). Furthermore, our entropy-guided patch selection (EGPL) consistently enhances diverse backbones (CNNs and Transformers), proving its practical value for data-efficient detection.
107. 【2609.29048】Where Hallucinations Live: A Cross-Architecture Circuit in VQ-Tokenized Vision-Language Models
链接：https://arxiv.org/abs/2609.29048
作者：Shamanthak Hegde,Xiangrui Liu,Maitreya Patel,Yezhou Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：codebook routinely hallucinate, existing decoding-time fixes, decoding-time fixes treat, routinely hallucinate objects, Unified vision-language models
备注： EMNLP 2026 | Project Page: [this https URL](https://shamanthak-hegde.github.io/where-hallucinations-live)
点击查看摘要
Abstract:Unified vision-language models (VLMs) that tokenize images through a vector-quantized (VQ) codebook routinely hallucinate objects on grounded yes/no benchmarks, yet existing decoding-time fixes treat this as generic miscalibration without an architectural account. Using activation patching across twenty-five models spanning eight LLM families, we identify an early-layer ($L_0$) attention routing circuit shared across VQ-tokenized VLMs and propose a three-gate diagnostic that distinguishes the models carrying it from those that do not. The diagnostic isolates ten positive models (five natural unified-VQ VLMs across three LLM families and five induced variants) and rejects the remaining fifteen. A single-variable architectural swap (LLaVA-1.6 CLIP+MLP $\rightarrow$ VQ+Linear) installs the circuit, while a matched-compute MLP control on identical data does not, isolating vector quantization as the source of the pathological signal; the routing pathway that carries it is one that the backbone already provides. Against tuned VCD and DoLA baselines, tuned DoLA wins on binary calibration, but \textbf{only $L_0$ ablation reduces object hallucination in open-ended generation} (CHAIR$_i$ reduces by $31\,\%$ relatively, whereas tuned DoLA and VCD leave it unchanged or worsen it). These results recast object hallucination in unified VQ VLMs as a property of architecture and pretraining, and yield a targeted intervention that mechanism-agnostic decoding cannot replicate.
108. 【2609.29029】Exploiting answer-invariant redundancies in satellite imagery for efficient VLM inference on edge
链接：https://arxiv.org/abs/2609.29029
作者：Ishani Janveja,Davis Zhang,Seoyul Oh,Deepak Vasisht
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Onboard vision-language models, Onboard vision-language, answer queries directly, queries directly, slow and energy-intensive
备注：
点击查看摘要
Abstract:Onboard vision-language models could enable satellites to answer queries directly, but exhaustive tiled inference over high-resolution imagery is slow and energy-intensive. We identify answer-invariant token redundancy (AITR): image tiles and vision tokens that can be removed without changing the final answer. We present Rift, a two-stage system that performs query-conditioned tile pruning followed by elastic prefill to reduce token budget. We evaluate it on LLaVA-1.5 7B running on Jetson AGX Orin. Compared with exhaustive tiled inference, Rift reduces energy by 78% and latency by 69%, while increasing accuracy from 45% to 73%.
109. 【2609.29028】RGBD20K: A Large-Scale Benchmark for RGB-D Semantic Segmentation
链接：https://arxiv.org/abs/2609.29028
作者：Shaohua Dong,Zexuan Meng,Haiyan Sun,Bing Fan,Cuicui Zhang,Dylan Joseph,Kewei Sha,Yunhe Feng,Heng Fan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Expanded Semantic Space, encompassing abundant categories, general RGB-D semantic, robust and general, encompassing abundant
备注：
点击查看摘要
Abstract:In this paper, we propose RGBD20K, a novel dataset for facilitating the development of more robust and general RGB-D semantic segmentation by encompassing abundant categories and high-quality annotations. RGBD20K possesses several attractive properties: (1) Expanded Semantic Space. In particular, it covers 160 fine-grained categories, largely surpassing the category diversity of existing popular RGB-D benchmarks (e.g., NYUv2 with 40 classes and SUN RGB-D with 37 classes). With such enriched semantic coverage, we expect to promote the learning of more generalizable segmentation models. (2) Larger Scale. Compared with current benchmarks, RGBD20K offers 20,000 RGB-D image pairs, providing a substantially larger training resource that benefits the development of more powerful deep models. (3) High-Fidelity Annotation. We perform rigorous re-evaluation and correction of existing labels to resolve long-standing annotation noise, resulting in a clean and reliable ground-truth foundation. Furthermore, we propose a novel score-purified fusion (SPF) method, which achieves state-of-the-art performance across all evaluated benchmarks, demonstrating the effectiveness of our approach in leveraging high-quality multimodal information for RGB-D semantic segmentation. The dataset is here: this https URL.
110. 【2609.29006】FluidRain: Incompressible Rain Flow as an Attention Bias for Loop-in-Loop Video Deraining
链接：https://arxiv.org/abs/2609.29006
作者：Pu Wang,Yongcong Wang,Wenhao Li,Xiang Chen,Guangwei Gao,Jinshan Pan,Siyuan Yao,Shujun Fu,Zhuoran Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deraining methods typically, methods typically exploit, typically exploit neighboring, video deraining methods, implicit spatiotemporal aggregation
备注： 11 pages, 6 figures, 3 tables
点击查看摘要
Abstract:Existing video deraining methods typically exploit neighboring frames through either explicit alignment or implicit spatiotemporal aggregation. Explicit alignment relies on accurate motion estimation, which can become unreliable under dense rain, while implicit aggregation avoids alignment but lacks explicit guidance on the directional and temporally coherent structure of rain. This leaves a gap between reliable temporal aggregation and explicit modeling of rain motion. To address these limitations, we propose FluidRain, a lightweight video derainer that uses divergence-free rain flow to guide Loop-in-Loop attention across scales and neighboring frames. Motivated by fluid mechanics, we model rain motion as a divergence-free image-space flow and use it to organize multi-scale and temporal aggregation. Specifically, FluidRain first estimates a rain-flow field for each frame and projects it onto the divergence-free subspace. The resulting flow steers window attention along rain streaks, enabling neighboring frames to be aggregated without explicit alignment. Since rain-flow structure is preserved across scales and nearby frames, Loop-in-Loop reuses the same attention operator across both dimensions, resulting in a three-frame model with only 0.80M parameters. Experiments on four benchmarks show that FluidRain remains competitive with substantially larger restoration models. We further examine how temporal evidence scales with different input views. To evaluate whether the model remains reliable when rain motion changes across frames, we introduce RainSyn-Gust, which injects controlled changes in rain-streak direction into existing benchmarks. We also develop a physics-based no-reference metric that evaluates real-rain removal without requiring clean targets.
111. 【2609.28997】Only What Was Seen: Observation-Gram Compaction of View-Dependent Appearance in 3D Gaussian Splatting
链接：https://arxiv.org/abs/2609.28997
作者：Krzysztof Pietroszek
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting model, Splatting model holds, holds spherical-harmonic colour, Gaussian Splatting, model holds spherical-harmonic
备注： 22 pages, 6 figures
点击查看摘要
Abstract:Most of the memory of a 3D Gaussian Splatting model holds spherical-harmonic colour coefficients, yet each Gaussian is seen only from the narrow cone of directions of the training cameras. We turn this into a distortion metric that other compressors can adopt: a per-Gaussian observation Gram matrix, accumulated from viewing directions and blending weights, is the exact first-order map from coefficient changes to squared image error and needs only the model and the camera poses. Under it, degree reduction becomes a closed-form projection that generalises truncation, degree allocation a Lagrangian rate-distortion problem, and vector quantisation the matrix-weighted Lloyd algorithm, of which Compressed3D's quantiser is the scalar case. Swapped into Compressed3D with everything else unchanged, the metric raises PSNR by +0.49 dB before fine-tuning, with SSIM and LPIPS following, and at matched rate still gains +0.32 dB without a single training image. A training-free stack built on the metric alone is 15% smaller than the image-free GSICO at equal quality on Mip-NeRF 360.
112. 【2609.28991】Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models
链接：https://arxiv.org/abs/2609.28991
作者：Shuzhi Gong,Fengze Sun,Yuansan Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：multi-stage LLM agents, multi-stage LLM, understanding is increasingly, increasingly performed, performed by multi-stage
备注： Accepted in NeurIPS 2026 TAE workshop
点击查看摘要
Abstract:Video understanding is increasingly performed by multi-stage LLM agents that separate temporal grounding, visual observation, and reasoning. Yet these stages are typically evaluated on different benchmarks and distributions, making it difficult to determine where hallucinations originate. We first organize existing benchmarks around these stages and show that their scores provide inconsistent diagnostic signals: stronger stage-level performance does not reliably imply lower downstream hallucination, and even benchmarks targeting the same capability can disagree. We therefore introduce a causal stage-intervention protocol that overwrites individual stages while holding the downstream task fixed. Across 60,008 runs on three video-agent architectures, we find that grounding is the dominant source of downstream error, with roughly four times the causal impact of corrupting visual observations. Successful grounding depends primarily on locating the correct region rather than precise temporal overlap, explaining why standard mIoU metrics poorly predict downstream reliability. We further find that incorrect evidence is substantially more harmful than missing evidence. Finally, auditing existing benchmarks against these interventions reveals that their scores do not reliably predict causal cascade sensitivity and can fail under distribution shift. These results motivate intervention-based, stage-aware evaluation for trustworthy video agents.
Comments:
Accepted in NeurIPS 2026 TAE workshop
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.28991 [cs.CV]
(or
arXiv:2609.28991v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.28991
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
113. 【2609.28967】Passive LWIR Hyperspectral Ranging via Transmittance Extraction and Distance Alignment
链接：https://arxiv.org/abs/2609.28967
作者：Zhihe Chen,Chen Fan,Shuo Liu,Xiaolin Huang,Yunze He,Xiaofeng He,Lilian Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Passive long-wave infrared, http URL estimation, Passive long-wave, http URL introduce, thermal radiance received
备注：
点击查看摘要
Abstract:Passive long-wave infrared (LWIR) hyperspectral ranging enables distance estimation in low-light and nighttime scenes by exploiting atmospheric absorption features in thermal radiance received through the this http URL estimation of temperature, emissivity, and distance is computationally expensive. Reference-range joint inversion also uses a distance-invariant effective attenuation coefficient, which can bias range this http URL introduce transmittance extraction and distance alignment (TEDA), which decouples range estimation from temperature--emissivity inversion. In the first stage, a baseline estimator with a data-fidelity term invariant to the known absorption direction yields two closed-form smoothing branches for the slowly varying thermal continuum. An observation-derived gate combines the branches, and subtracting the blended baseline in the log domain recovers atmospheric transmittance. The second stage estimates range by matching the recovered transmittance to sensor-domain transmittance models recomputed for each candidate distance. Monte Carlo simulations show that TEDA effectively reduces the ranging bias caused by the distance-invariant attenuation coefficient approximation. In a measured scene, TEDA's mean range estimates are closer to the LiDAR medians than those of reference-range joint inversion in both evaluated patches. TEDA processes a complete $256\times256$ region of interest in 8.19~s versus 159.47~s for reference-range joint inversion, an approximately 20-fold speedup.
114. 【2609.28956】MoVISA: Multi-Token Reasoning for Video Object Segmentation
链接：https://arxiv.org/abs/2609.28956
作者：Ruining Zhao,Ho Kei Cheng,Alexander G Schwing
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Multimodal Large, video object segmentation, Recent advances, Large Language Model
备注：
点击查看摘要
Abstract:Recent advances in video object segmentation with Multimodal Large Language Model (MLLM) reasoning have demonstrated the effectiveness of using a single textual token, such as SEG, to predict segmentation masks across images and videos. However, we observe that this single-token strategy lacks the granularity required to precisely localize multiple objects across time in video segmentation tasks. To address this limitation, we develop Multi-Token Reasoning for Video Object Segmentation, or MoVISA. MoVISA uses multiple segmentation tokens, such as SEG0 and SEG1, to represent an object across different frames. This design enables more fine-grained alignment between language prompts and spatio-temporal mask predictions, improving both performance and interpretability. On the challenging MeViS, DAVIS17, ReVOS, and Ref-Youtube-VOS benchmarks, our model achieves a 13.2 percent J and F improvement on MeViS and an 8.4 percent J and F improvement on ReVOS. Code and models will be released.
115. 【2609.28949】Exploiting Target Knowledge from MLLMs for Robust Few-Shot Segmentation
链接：https://arxiv.org/abs/2609.28949
作者：Yijun Hu,Heng Fan,Libo Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：segment unseen object, unseen object categories, Few-shot segmentation, enabling efficient adaptation, aims to segment
备注：
点击查看摘要
Abstract:Few-shot segmentation (FSS) aims to segment unseen object categories with a few (e.g., one or five) labeled examples, enabling efficient adaptation to novel classes. Conventional models typically rely on appearance-based visual matching between support and query images for segmentation. While straightforward, these methods often struggle to handle significant appearance discrepancies and occlusions in the query image due to insufficient target knowledge. To mitigate this, we introduce a novel framework that mines target knowledge using the strong reasoning capacity of Multimodal Large Language Models (MLLMs) and employs it to enhance FSS. Specifically, building on SAM 2, our method, named MK-FSS, exploits two forms of complementary knowledge derived from a query image by an MLLM for FSS, including spatial knowledge, which provides a spatial prior indicating the potential target location, and semantic knowledge, which describes the target using text. The spatial knowledge is first encoded into a memory representation, and then resulting memory is integrated with the support-guided memory feature from query image through a carefully designed dual-memory debate-fusion (DMDF) module, yielding a more robust target memory feature. In parallel, the semantic knowledge is encoded into the textual feature, which is fused with multi-scale query features via a progressive cross-modal prompt generator (PCPG), producing a target-aware multimodal prompt for segmentation. Working together, the dual-memory feature and the multimodal prompt provide a comprehensive representation of the target, enabling more robust segmentation. In our extensive experiments, MK-FSS shows promising results and largely surpasses existing methods. Code will be released.
116. 【2609.28931】HelloWorld: Towards Practical Applications of Generative Driving World Models
链接：https://arxiv.org/abs/2609.28931
作者：Fan Lu,Hanshi Wang,Zijing Wang,Quan Feng,Zhi Wang,Shijie Chen,Xianming Zeng,Yujian Zhang,Jiazhe Wang,Xin Zha,Kai Wang,Zhijie Zhao,Lin Zhu,Tianyi Yang,Yucheng Xu,Tao Ji,Haodong Zhang,Zhipeng Zhang,Peixi Peng,Guang Chen,Xingliang Liu,Lei Yang,Jianyun Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recorded driving logs, promising route, counterfactual data generation, Driving world, driving logs
备注： website: [this https URL](https://helloworld-4d.github.io)
点击查看摘要
Abstract:Driving world models provide a promising route toward scalable counterfactual data generation and interactive simulation beyond recorded driving logs. Realizing this potential requires a system that can generalize across diverse scenes, respond faithfully to prescribed controls, generate coherent multi-sensor observations, and operate efficiently under repeated inference. We present \textbf{HelloWorld}, a 2B driving world model system designed around these requirements. HelloWorld progressively specializes broad visual and motion priors from heterogeneous video data into controllable driving generation using ego pose, HD maps, and 3D boxes. A block-causal generation interface, together with adaptation to self-generated context, aligns the model with sequential simulation. The system further supports synchronized seven-camera RGB generation and conditional LiDAR synthesis, and is distilled toward few-step inference for efficient deployment. Experiments evaluate visual quality, control fidelity, cross-view consistency, robustness under repeated generation, inference efficiency, and LiDAR synthesis. Together, HelloWorld provides a unified framework for scalable driving data generation and interactive simulation.
117. 【2609.28930】PlenoCI: Plenoptic CharacterIstics for View Dependence Aware Change Classification
链接：https://arxiv.org/abs/2609.28930
作者：Jason Lai,Chamuditha Jayanga Galappaththige,Niko Suenderhauf,Dimity Miller,Donald G. Dansereau
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, Radiance field representations, Radiance field, natively encode complex, natively encode
备注： 15 pages, 9 figures
点击查看摘要
Abstract:Radiance field representations such as 3D Gaussian Splatting (3DGS) natively encode complex visual phenomena such as occlusions and view dependence, but they are inherently underconstrained. Independently optimized reconstructions converge to different primitive configurations, even in unchanged regions. We introduce Plenoptic CharacterIstics (PlenoCI), a novel feature built from the plenoptic field these representations approximate. PlenoCI directly captures rich visual behaviors while ignoring Lambertian textures. By deriving closed-form analytic plenoptic derivatives from a 3DGS representation, we efficiently detect these 5D structures. Our approach is robust to underconstrained representations by construction, reporting two orders of magnitude fewer false positives between independent reconstructions of unchanged scenes than concurrent work. We demonstrate PlenoCI's utility on change classification. First, we detect changes with an instance-aware 3DGS pipeline, achieving state-of-the-art results on CL-Splats with a 25.7% mIoU gain over the strongest competitor, while remaining competitive on the more challenging PASLCD benchmark. Leveraging PlenoCI, we classify changes as geometric or appearance-based with a balanced accuracy of 0.735, comparable to the best performing baseline. We believe plenoptic derivatives and PlenoCI open new directions for view dependence aware understanding in visually complex environments. Code and data are available at this https URL.
118. 【2609.28923】ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation
链接：https://arxiv.org/abs/2609.28923
作者：Zichong Meng,Chongjian Ge,Chun-Hao P. Huang,Yang Zhou,Huaizu Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diffusion enables low-latency, enables low-latency streaming, methods predominantly rely, estimate distributional discrepancies, large pretrained teacher
备注： Tech Report
点击查看摘要
Abstract:Few-step autoregressive (AR) video diffusion enables low-latency streaming generation, but existing post-training methods predominantly rely on Distribution Matching Distillation (DMD), requiring both a large pretrained teacher and an online critic to estimate distributional discrepancies through diffusion scores. In this work, we ask whether this resource-intensive teacher--critic stack can be eliminated by post-training only the generator against a precomputed target distribution. Drawing inspiration from representation distribution matching (RDM) for one-step image generation, we systematically study its transfer to few-step causal video generation and identify three key barriers: a memory-intractable gradient path, a distinct video optimization regime, and representation distributions that underconstrain temporal dynamics. We introduce ViRDM, a teacher- and critic-free video post-training recipe that addresses these barriers sequentially. By coupling RDM with stochastically truncated clean-exit supervision, a lightweight VAE decoder, and staged vector--Jacobian products, ViRDM makes representation distribution matching memory-feasible for multi-step causal video rollouts. We further establish effective generated-population and initialization regimes for video RDM, and introduce lightweight dynamics regularization to compensate for the underconstrained temporal dynamics. ViRDM turns three-network distillation into generator-only post-training, reducing GPU memory use and training time while improving video quality. With only 20 generator updates, the recipe reaches 84.87 on the official VBench evaluation, outperforming the previous best few-step causal baseline by 0.36, while requiring 16 A100 GPU-hours. We additionally report exploratory results demonstrating the potential of the same recipe for lower causal sampling budget and for one-, two-, and four-step bidirectional generation.
119. 【2609.28865】Direction-Scale Decomposition in Action Representation: Rethinking What to Tokenize for Vision-Language-Action Models
链接：https://arxiv.org/abs/2609.28865
作者：Yufei Duan,Hang Yin,Alberta Longhini,Chao Tang,Danica Kragic
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Action representation plays, Action representation, learning but remains, remains underexamined, plays a central
备注：
点击查看摘要
Abstract:Action representation plays a central role in discrete-token vision-language-action (VLA) learning but remains underexamined. Under conventional pose-increment representations, action tokens are sensitive to execution speed and dataset-specific normalization, potentially obscuring geometric structure shared across demonstrations and datasets. We introduce Direction-Scale Decomposition (DSD), an action representation that decomposes translation and rotation increments into direction and scale components before tokenization. DSD isolates motion direction while retaining magnitudes in separate scale channels. We evaluate DSD with uniform binning (BIN) and BEAST, a B-spline-based tokenizer, in simulation and real-world manipulation under both single-dataset and mixed-dataset training. On LIBERO, DSD improves average success rates with both tokenizers. On SimplerEnv, DSD-BIN outperforms BIN by 10.3 percentage points in overall success rate under mixed-dataset training. Real-robot experiments further show gains both with and without robotics pretraining. These results support DSD as an effective action representation for discrete-token VLA models and suggest its potential to mitigate performance degradation when training on large and diverse dataset mixtures. Our project page with additional resources is available at this https URL
120. 【2609.28860】Multimodal Routing and Region Refinement for Language-Guided Medical Image Segmentation
链接：https://arxiv.org/abs/2609.28860
作者：Md Maklachur Rahman,Md Hasan Al Banna,Saraf Anjum,Assame Arnob,Tracy Hammond
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：medical image segmentation, descriptions can reduce, reduce ambiguity, ambiguity in medical, finding and location
备注： Accepted at MICCAI 2026 (TIA). Final version to appear in the proceedings
点击查看摘要
Abstract:Textual descriptions can reduce ambiguity in medical image segmentation by specifying the finding and location to be delineated. Existing text-guided methods mainly improve where image and language features interact but generally retain a single learned update pathway across all image-text pairs. We propose MRSeg, a parameter-efficient framework that uses each image-text pair to route the adaptation of visual and textual features before dense prediction. Frozen ConvNeXt-Tiny and PubMedBERT encoders provide multiscale visual features and clinical text tokens. A joint router uses the deepest visual feature and pooled text to predict a sparse mixture over low-rank adapter bases. The resulting route is shared across separate adapter banks for two visual scales and text, coordinating their adaptation while keeping the feature-specific parameters separate. Region Bridge uses text-derived queries to aggregate dense visual tokens into latent regions, refines these regions through self-attention and text cross-attention, and redistributes the refined information back to the feature maps. Finally, a multiscale decoder combines refined semantic features with shallow image evidence. On QaTa-COV19 and MosMedData+, MRSeg achieves 90.90/83.32 and 81.53/68.82 Dice/mIoU, respectively, with 7.11M trainable parameters and 7.60 GFLOPs. Code: this https URL.
121. 【2609.28857】MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting
链接：https://arxiv.org/abs/2609.28857
作者：Aman Anand,Partha Pratim Roy,Shivakumara Palaiahnakote
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：dense multi-oriented characters, tightly coupled architectures, coupled architectures propagate, architectures propagate localization, propagate localization errors
备注： 18 pages, 7 figures, 5 tables. Code: [this https URL](https://github.com/doubleblind-afk/MEVL-STP)
点击查看摘要
Abstract:Scene text spotting remains challenging for arbitrarily shaped text instances such as curved signs and dense multi-oriented characters in natural images, where tightly coupled architectures propagate localization errors directly into recognition failures. We present a two-stage pipeline that combines multi-encoder segmentation with vision-language model recognition to address this problem. In the detection stage, six frozen vision encoders (CLIP, DINOv2, SigLIP, EVA-CLIP, SAM, and ConvNeXt) extract complementary features spanning semantic, spatial, and texture spectra, which are fused through a trainable hierarchical Feature Pyramid Network with channel attention and decoded via a deep-supervision Progressive Scale Expansion network to generate precise instance-level text masks. By keeping the encoders frozen, their independently learned feature spaces remain orthogonal during fusion, preventing the feature homogenization that degrades boundary precision in single-backbone detectors. The detection stage produces tight polygon masks that conform to the actual shape of curved and arbitrarily oriented text, rather than axis-aligned rectangles that inevitably include background content. In the recognition stage, these polygon-masked crops isolate the target text from surrounding clutter, allowing a Qwen3-VL-8B-Instruct model, fine-tuned via Low-Rank Adaptation on polygon-cropped scene text, to focus purely on reading the text without interference from neighbouring words or background noise. Without any synthetic pretraining data, our method achieves 91.99% detection F-measure and 85.86% end-to-end H-mean on CTW1500, setting a new state of the art and achieving strong performance on Total-Text and ICDAR 2015 without any synthetic training data. Code is available at this https URL
122. 【2609.28851】Looks the Same, Answers Differently: Flip-Direction Steering for Robust Vision-Language Reasoning
链接：https://arxiv.org/abs/2609.28851
作者：Yeonsung Jung,Joonhyun Jeong,Hoang Pham,Joowon Kim,Yoonsik Park,Viet Dac Lai,Eunho Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：routine image capture, achieve strong visual, routine image, image capture, achieve strong
备注： 27 pages
点击查看摘要
Abstract:Vision-language models (VLMs) achieve strong visual reasoning performance, yet subtle changes from routine image capture and processing can alter their reasoning trajectories even when images appear nearly identical. In long-horizon generation, the resulting activation shifts may accumulate across decoding steps, progressively altering reasoning tokens and ultimately changing the final answer, a phenomenon referred to as answer flips. To address this instability, we propose FlipDir (Flip-Direction Steering), a training-free inference-time method that estimates a low-rank flip-inducing activation subspace from contrastive pairs of original and answer-flipping inputs and selectively steers hidden states during decoding. A margin-based gate limits subspace attenuation to uncertain decoding steps, recovering original predictions while preserving stable ones. To evaluate robustness beyond accuracy or consistency on fixed test sets, we introduce VisFlip, a benchmark framework that constructs evaluation groups for a target model and visual variation setting to separately assess recovery of original predictions and preservation of stable ones. VisFlip spans nine dataset-variation combinations across scientific reasoning, robot-scene understanding, and medical VQA, covering subtle visual variations common in each domain. Experiments across 18 settings demonstrate that FlipDir consistently outperforms existing methods on the combined recovery and preservation metric. We will make our code publicly available.
123. 【2609.28836】M$^2$PFN: End-to-End Disentangled Alignment for Generalizable Multimodal In-Context Learning in Alzheimer's Disease
链接：https://arxiv.org/abs/2609.28836
作者：Lujia Zhong,Shuo Huang,Jianwei Zhang,Xinyu Nie,Yonggang Shi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：methods combining imaging, Alzheimer disease, data for Alzheimer, multimodal methods combining, diagnosis were proposed
备注： Under review
点击查看摘要
Abstract:While various multimodal methods combining imaging and tabular data for Alzheimer's disease (AD) diagnosis were proposed, they are often limited in generalization across cohorts. In-context learning (ICL) has demonstrated excellent generalization performances and high flexibility in foundational tabular models such as TabPFN. To extend TabPFN's ICL to multimodal AD analysis, the main obstacle is that TabPFN is meta-trained on synthetic tabular priors that do not naturally match the statistical structure of image-derived features. We propose M$^2$PFN, an end-to-end framework that turns this tabular foundation model into a multimodal AD predictor. M$^2$PFN (i) performs differentiable inference through TabPFN's transformer, back-propagating task gradients into 3D-MRI and tabular encoders; (ii) aligns the two modalities into a shared subspace, via disentanglement and a contrastive objective, matched to the ICL engine's prior; and (iii) folds in a frozen tabular-only prediction through a learnable gated shortcut. Because the ICL engine stays frozen, its in-context mechanism is preserved for test-time generalization, while end-to-end training shapes the encoders into features it can exploit. On ADNI ($n=2240$, three-class CN/MCI/AD), M$^2$PFN attains $65.55\%$ macro-F1 and $82.21\%$ macro-AUC, surpassing a comprehensive set of unimodal and multimodal baselines. By swapping only the head for a TabPFN regressor, the same architecture regresses baseline MMSE on a $1250$-subject sub-cohort to test MAE $1.743$, outperforming every multimodal baseline. On two external cohorts (OASIS-3 and SCAN) with no retraining, M$^2$PFN achieves the best AUC and the lowest MMSE MAE across all baselines, and transfers even when the cognitive instrument changes.
124. 【2609.28813】CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models
链接：https://arxiv.org/abs/2609.28813
作者：Shuo Xing,Pooja Verlani,Balu Adsumilli,Zhengzhong Tu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Vision Language, Vision Language Models, camera operation, fundamentally shapes, shapes how audiences
备注： 6 pages
点击查看摘要
Abstract:Cinematography, the craft of visual storytelling through framing, lighting, and camera operation, fundamentally shapes how audiences perceive and emotionally engage with video content. While Large Vision Language Models (LVLMs) have made remarkable progress in video question answering, existing benchmarks primarily focus on identifying low-level techniques rather than understanding their storytelling impact. To address this, we introduce CinematicVQA, the first-of-its-kind benchmark for cinematic video understanding that goes beyond technique recognition to evaluate film-grammar reasoning, utilizing our introduced Cinematic Scene Graph (CSG), a structured representation that links filming techniques to their perceptual effects and narrative functions. Through comprehensive evaluation of state-of-the-art LVLMs, we reveal a striking semantic gap: models consistently perform higher on describing visual presentations than on identifying the underlying techniques. Surprisingly, Chain-of-Thought prompting fails to provide consistent gains and degrades performance for most models, suggesting that current LVLMs lack sufficient cinematic domain knowledge to benefit from step-by-step reasoning. Fine-tuning on \textsc{CinematicVQA-train} yields consistent improvements, particularly for narrative function and multi-hop reasoning. Overall, \textsc{CinematicVQA} serves both as a rigorous benchmark for cinematic evaluation in LVLMs and as a practical dataset for training more film-aware video models.
125. 【2609.28811】DeltaWAM: Delta World Action Models for Bimanual Manipulation
链接：https://arxiv.org/abs/2609.28811
作者：Han Yan,Zishang Xiang,Haokai Jiang,Zeyu Zhang,Qilin Wang,Weiyu Guo,Yandong Guo,Boxin Shi,Hao Tang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：World-action models, pretrained video generators, motion priors, priors from pretrained, generators to robot
备注：
点击查看摘要
Abstract:World-action models (WAMs) transfer visual and motion priors from pretrained video generators to robot control by jointly modeling visual dynamics and actions. Existing WAMs, however, predict dense future frames during training, repeatedly modeling largely unchanged content and coupling action-conditioned dynamics to nuisance appearance variations. At inference, processing each complete observation with the heavy video expert bottlenecks few-step action generation. Accordingly, we propose DeltaWAM, which jointly predicts visual deltas and actions using dense-anchor, sparse-delta, and action streams, with three architectures that differ in representation and computation sharing. We further develop Streaming Delta Memory (SDM), which updates cached anchor context with compact observed deltas, reducing heavy video-expert processing. On RoboTwin, DeltaWAM with SDM improves average success over Fast-WAM from 81.3% to 85.4% in the clean setting and from 75.8% to 83.9% under visual randomization. The three architectures reduce training FLOPs by 17.78-23.77%, while SDM reduces one-step inference latency and FLOPs by 36.57% and 31.55%, respectively; real-world evaluations further show the highest overall success rate and normalized progress among the evaluated policies. Code: this https URL. Website: this https URL.
126. 【2609.28796】DrGait: Biomechanically Grounded Visual Reasoning for Interpretable Clinical Gait Analysis
链接：https://arxiv.org/abs/2609.28796
作者：Xiangyu Yin,Shiqi Wang,Abrar Alamri,Yasir Aljohani,Weichen Liu,Goeran Fiedler,Wei Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Current automated gait, uninterpretable black-box classifiers, automated gait analysis, Current automated, clinical applications relies
备注： 76 pages, 6 figures
点击查看摘要
Abstract:Current automated gait analysis for clinical applications relies on uninterpretable black-box classifiers. Although Vision-Language Models (VLMs) offer strong reasoning capabilities, applying them directly to gait videos often leads to hallucinations, because they struggle to measure subtle geometric deviations from raw visual contexts. To address this, we introduce DrGait, a training-free agentic framework that shifts the VLM's role from a direct visual reasoner to a clinical planner. DrGait decouples semantic reasoning from geometric perception through a structured Triage-Verification-Synthesis (TVS) workflow. Given an input video and a set of basic spatiotemporal metrics, the DrGait agent first performs a heuristic triage to propose diagnostic hypotheses, which are then verified by autonomously calling deterministic biomechanical tools that operate on reconstructed 3D mesh trajectories, segmented 2D pose tracks, and event-centered video evidence. Finally, a closed-loop mechanism recursively updates the agent's reasoning context based on the feedback. By anchoring VLM's reasoning in verifiable geometric and temporal measurements, DrGait reduces hallucinations, achieving competitive diagnostic accuracy while generating transparent and audit-ready clinical reports.
127. 【2609.28757】Small yet Assistive: Spatially-Aware Post-Training for Low Vision
链接：https://arxiv.org/abs/2609.28757
作者：Rishabh Choudhary,Shreyansh Raj,Umesh Goyal,Shubh Kashyap,Shrestha Kumar,Sushovan Jena,Komal Kumar,Hisham Cholakkal,Aditya Nigam
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：billion people worldwide, people worldwide live, current vision-language models, billion people, vision impairment
备注： 14 pages, Accepted in EMNLP 2026
点击查看摘要
Abstract:An estimated 1 billion people worldwide live with vision impairment, yet current vision-language models (VLMs) produce descriptions too vague for safe navigation by blind and low-vision (BLV) users. Large VLMs can generate high-quality audio-description-compliant narrations but cannot run on mobile devices; small VLMs offer competitive latency but lack spatial detail, directional cues, and hazard awareness for navigational assistance. We present Smol-VL-BLV, a compact VLM for blind and low-vision users that closes this gap using a 500M decoder transformer model and two post-training mechanisms: (1) teacher-student distillation and (2) Group Relative Policy Optimization (GRPO) with a composite BLV reward targeting directional language, metric distances, and hazard detection. Because multi-stage post-training can induce catastrophic forgetting, we add a lightweight finetuning stage after the last stage GRPO finetuning to recover general descriptive quality while preserving BLV-specific spatial grounding. Our best model substantially outperforms the baseline across various benchmarks, including tasks: VQA, BLV captioning, OCR, and latency. Compared with the baseline for relative improvement, it improves the Spatial score gain of 19.3%, and the Social score gain of 14.8%. It also increases OCR-Bench by 101.5%, and raises TextVQA accuracy by 44.2%. These results show that BLV-focused post-training improves both accessibility-specific spatial grounding and general visual-text reasoning. Deployed on a mid-range Android smartphone via Mixed-Precision Quantization, the model remains approx. 450 MB and runs entirely on-device, offline and without network dependency, generating descriptions with latency dependent on host hardware capabilities. Our model, dataset, and code is publicly released at this https URL
128. 【2609.28741】GeoNLI - A Natural Language Interpreter for Satellite Imagery
链接：https://arxiv.org/abs/2609.28741
作者：Ashutosh Gandhe,Anupam Rawat,Geet Sethi,Kabir Nasiruddin,Madhav Kotecha,Panav Shah,Rakshit Sawarn,Soumitra Nayak
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-modal multitasking models, remote sensing datasets, Multi-modal multitasking, shown strong performance, performance on remote
备注：
点击查看摘要
Abstract:Multi-modal multitasking models have shown strong performance on remote sensing datasets. However, because these models are trained on heterogeneous data and vary across tasks, designing a unified model that performs well in captioning, visual question answering (VQA), and visual grounding remains challenging. In this work, we evaluate several models on the VRS Bench and NWPU-VHR-10 datasets. The EarthMind model demonstrates strong results in both captioning and VQA. For grounding, we propose multiple pipelines - RemoteSAM-SAM-v1, RemoteSAM-SAM-v2, and DiffuSAM - and ultimately adopt a majority-voting ensemble across EarthMind, RemoteSAM, SAM3, Falcon, RemoteSAM-SAM3-v1, RemoteSAM-SAM3-v2, and DiffuSAM predictions. Our unified, modular pipeline integrates advanced SAM variants with multimodal LLMs to jointly perform captioning, VQA, and grounding. It achieves 82% accuracy on captioning and 83.32% on VQA, with 90.94%, 52.04%, and 92.06% for binary, numeric, and semantic question types respectively. For grounding, it attains 64.94% accuracy. By combining diverse VLMs with our custom RemoteSAM-SAM3 models through ensemble majority voting, the system delivers more accurate and consistent remote-sensing understanding than task-specific approaches.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.28741 [cs.CV]
(or
arXiv:2609.28741v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.28741
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
129. 【2609.28684】M-plicits: Neural Implicit Surfaces via Nested Multiscale Residuals
链接：https://arxiv.org/abs/2609.28684
作者：Vinícius da Silva,Isabelle Melo,Matheus Bessa,Guilherme Schardong,Luiz Schirmer,André Araújo,Nuno Gonçalves,Hélio Lopes,Alberto Raposo,Luiz Velho,Tiago Novello
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：Encoding input coordinates, implicit neural representations, Encoding input, multi-layer perceptrons, coordinates with sinusoidal
备注：
点击查看摘要
Abstract:Encoding input coordinates with sinusoidal functions into multi-layer perceptrons (MLPs) has proven effective for implicit neural representations (INRs) of surfaces defined as zero-level sets. However, existing methods often struggle to balance training efficiency, rendering speed, and noise robustness: single-MLP approaches are expensive at inference, grid-based representations are fast but can limit surface smoothness and overfit input noise, and previous multiscale approaches frequently capture noise and produce artifacts due to hard spectral truncation. To address these limitations, we propose M-plicits, a multiscale framework that models surfaces as a residual sum of MLPs trained via a sequence of nested neighborhoods. Unlike existing residual approaches that rely on standard domain-wide sampling and require costly mesh extraction for visualization, our method strictly localizes supervision to narrow bands around the previous zero-level sets. This nested design naturally provides robustness against noisy input data: the coarse network acts as a low-pass filter that establishes a clean geometric prior, while subsequent residuals progressively refine the geometry without fitting to high-frequency artifacts. We further introduce a multiscale sphere-tracing algorithm and a GEMM-based analytical normal computation that bypasses auto-differentiation entirely, yielding high-fidelity real-time rendering. On Stanford and Thingi32, M-plicits achieves the best mean Chamfer distance in the coarse configuration and the best median Chamfer distance and IoU in the fine configuration, with substantially better noise robustness than iNGP, BACON, and IDF, while using an order of magnitude fewer parameters than grid-based baselines. Code, models, and data will be released at this https URL.
130. 【2609.28654】raining Object Permanence in World Models
链接：https://arxiv.org/abs/2609.28654
作者：Haotian Zhang,Fengyuan Yu,Dezhi Luo,Haoran Sun,Zehong Zhao,Qingying Gao,Yihan Li,Siyuan An,Huayi Qin,Yilan Zhang,Zhengze Jiang,Pinyuan Feng,Renrui Zhang,Ziyu Guo,Letian Wang,Mengyue Yang,Kangfu Mei,Maijunxian Wang,Ran Ji,Vikash Kumar,Freda Shi,Chandra Sripada,Vincent C. Muller,Philip Torr,Alan Yuille,Nikolaus Kriegeskorte,Felix Juefei-Xu,Lvmin Zhang,Jieneng Chen,Yilun Du,Hokin Deng
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：human cognitive priors, Object permanence, solidity are hallmarks, hallmarks of human, emerged object permanence
备注： 26 pages, 9 figures, 5 tables. Project page: [this https URL](https://object-permanence.world)
点击查看摘要
Abstract:Object permanence and solidity are hallmarks of human cognitive priors. Recent studies show that video generation models, a paradigmatic class of current world models, have begun to show emerged reasoning abilities, making them ideal candidates for building human-like physical intelligence. Do video models have emerged object permanence in them? If not, could we train them with a core-cognition inspired dataset? We introduce WROP (World Reasoning with Object Permanence), a data infrastructure of 150 hand-designed cognitive science inspired tasks, divided into six cognitive categories. We build Blender generators that randomize speed, lighting, camera angle, and other nuisance parameters while preserving each task's cognitive structure, yielding 10,000+ samples per task. We release a 1.5M-sample training corpus and a 300-question exam. On this exam we evaluate 14 video models: 3 reference-to-video, 7 edit, and 4 continuation, among which PWM-WROP, our 16B world model. In a blind pairwise Elo study, PWM-WROP ranks first among continuation models and third overall, behind only a statistical tie between two reference-to-video models. We release the data, exam, model answers, scores, weights, and PWM, our native-PyTorch training stack on AWS Trainium2.
131. 【2609.28645】PePESeg3D: Perception Prior Enhances Multi-Scale Segmentation for 3D Gaussian Splatting
链接：https://arxiv.org/abs/2609.28645
作者：Sungjae Choi,Seunghee Koh,Junmo Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, Recent advancements, extended its capabilities, Gaussian segmentation pipeline, Recent
备注： Accepted to BMVC 2026
点击查看摘要
Abstract:Recent advancements in 3D Gaussian Splatting (3DGS) have extended its capabilities to multi-scale segmentation. Existing methods reconstruct a scene with Gaussian primitives and learn multi-scale segmentation features separately, which leaves the geometry unaware of semantic structure and the feature learning dependent on incomplete mask supervision. To address these limitations, we present PePESeg3D, a novel framework that injects perception priors into a multi-scale 3D Gaussian segmentation pipeline. To fully exploit perception priors, we integrate them not only into contrastive feature learning but also into the upstream geometry reconstruction. Specifically, PePE Reconstruction incorporates monocular depth and mask constraints to ensure semantically coherent object structures. Building on this aligned geometry, PePE Contrastive Learning leverages dense depth-color cues and view-consistent centroid supervision to compensate for the incompleteness of multi-scale masks obtained from a 2D foundation model. Extensive experiments on the SPIn-NeRF, LERF-Mask, and NVOS benchmarks demonstrate that PePESeg3D achieves state-of-the-art performance in both multi-scale segmentation and scene reconstruction, highlighting the importance of integrating perception priors into both geometry optimization and feature learning for accurate multi-scale 3D segmentation. Our code is available at this https URL.
132. 【2609.28610】UltraBench 2: Towards Robust Evaluation of Vision Foundation Models on Ultrasound
链接：https://arxiv.org/abs/2609.28610
作者：Ashwath Radhachandran,Adam Tupper,Christian Gagné,William Speier
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：increasingly critical part, including healthcare, increasingly critical, critical part, part of research
备注：
点击查看摘要
Abstract:Benchmarking is an increasingly critical part of research in machine learning and the domains where it is applied, including healthcare. Yet, despite the steady development of new ultrasound foundation models in recent years, the development of well-designed benchmarks to evaluate them has lagged behind. This deficiency has led to fragmented and inconsistent evaluations of competing models, making it difficult to measure progress. To address this issue, we introduce UltraBench 2, a comprehensive benchmark with wide anatomical and task coverage, and a focus on standardization, reproducibility, and ease-of-use. Using this benchmark, we compare existing vision foundation models for ultrasound image analysis. Our analyses demonstrate that ultrasound-specific pretraining still leads on classification, but that state-of-the-art general-purpose models have drawn level on segmentation.
133. 【2609.28590】AM-Chain: Multi-Scale Thyroid Cytology Classification via Absorbing Markov Chains and Shannon Entropy Uncertainty Quantification for False-Negative Suppression and Domain-Shift Adaptation
链接：https://arxiv.org/abs/2609.28590
作者：Hai Pham Ngoc
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Fine-Needle Aspiration Biopsy, Bethesda System plays, Thyroid Fine-Needle Aspiration, Background Problem, Aspiration Biopsy
备注：
点击查看摘要
Abstract:Background Problem: Thyroid Fine-Needle Aspiration Biopsy (FNAB) cytology based on the Bethesda System plays a pivotal role in early thyroid cancer detection; however, deep learning approaches face substantial challenges regarding high false-negative rates and overconfidence under clinical domain shift. Methods: In this study, we propose TAM-Chain, a multi-scale (10x, 20x, 40x) thyroid cytology classification framework leveraging Absorbing Markov Chain theory combined with Shannon Entropy-based Uncertainty Quantification. The framework dynamically models multi-magnification feature extraction as an absorbing stochastic process, enabling optimal stopping criteria and a human-in-the-loop referral mechanism to strictly suppress critical diagnostic errors. Results: Extensive evaluation on an internal test set (N = 235) demonstrates a Macro F1 score of 0.9741 with an absolute False-Negative Rate (FNR) of 0.00%. On an independent external validation set (N = 1015) presenting severe domain shift, TAM-Chain maintains superior stability and classification performance (Macro F1 = 0.7026) by adaptively adjusting the expected stopping step and triggering specialist referrals, significantly outperforming single-magnification baselines. Conclusion: The TAM-Chain framework proves to be a highly effective, safe, and adaptable solution for digital pathology workflows, successfully harmonizing automated diagnostic efficiency with stringent biological safety.
Subjects:
Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.28590 [cs.LG]
(or
arXiv:2609.28590v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2609.28590
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Hai Pham Ngoc [view email] [v1]
Wed, 23 Sep 2026 14:58:01 UTC (749 KB)
134. 【2609.28580】oken Clustering and Semantic Sequence Mamba for Hyperspectral Image Classification
链接：https://arxiv.org/abs/2609.28580
作者：Yimin Zhu,Mahmood Elahi,Lincoln Linlin Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：provide rich spectral-spatial, rich spectral-spatial information, complex spatial structures, accurate pixel-level classification, pixel-level classification remains
备注：
点击查看摘要
Abstract:Although hyperspectral images (HSIs) provide rich spectral-spatial information, accurate pixel-level classification remains challenging because of spectral-spatial heterogeneity and complex spatial structures. Existing vision state space models (Mamba) typically construct sequences according to predefined spatial neighborhoods, without explicitly accounting for semantic similarity or spatial non-stationarity. To address this limitation, we propose Token Clustering and Semantic Sequence Mamba (STMamba), which organizes sparse tokens into semantically coherent sequences for hyperspectral image classification with the following features. First, at the macro level, a hierarchical encoder decoder progressively selects semantic tokens with the Token Clustering Module (TCM) and restores dense features using a parameter-free Cross-scale Neighborhood Attention (CNA) Upsampler. Second, at the micro level, TCM first identifies representative cluster centers through density-aware clustering and estimates soft memberships based on feature similarity. A quadtree-based dynamic selection strategy then retains sparse and spatially distributed tokens from each semantic cluster, forming coherent semantic-token sequences while reducing redundant pixel-wise representations. Third, parallel Spatial and Spectral Semantic-wise Sequencing Mamba (SWSM) modules capture complementary long-range spatial and spectral dependencies within homogeneous semantic token sequences while suppressing irrelevant interactions across heterogeneous regions. Experimental results on three large-scale benchmark datasets demonstrate that STMamba outperforms the SOTA methods with respect to quantitative and qualitative results.
135. 【2609.28561】CARE: Condition-Aware Representation Regularization for Diffusion Models
链接：https://arxiv.org/abs/2609.28561
作者：Fengjia Guo,Zhuoyi Yang,Jie Tang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：diffusion models highlight, Recent advances, improving sample quality, advances in diffusion, diffusion models
备注：
点击查看摘要
Abstract:Recent advances in diffusion models highlight the importance of representation regularization for improving sample quality and training efficiency. However, commonly used regularization methods often overlook the built-in conditions (such as labels or texts) which directly determine the generation target. In this work, we demonstrate how conditioning signals affect the feature distribution and introduce the CARE (Condition-Aware REpresentation regularization). CARE is a lightweight plug-and-play regularization framework that dynamically modulates feature distribution based on condition similarity. CARE leverages built-in conditioning signals to judiciously guide the representation space, promoting tighter feature clusters for similar conditions without relying on explicit alignment losses or external supervision. Empirically, CARE consistently improves both visual fidelity and convergence stability across both class-to-image and text-to-image tasks. On ImageNet, CARE achieves a 19.08\% reduction in FID in 400k training steps, leading to a 3.5$\times$ speed-up. When applied to text-to-image generation, CARE lowers FID by 16.61\% in 200k iterations and improves semantic alignment between generated samples and text prompts. Moreover, CARE can be seamlessly integrated with existing regularization methods, yielding additional performance gains.
136. 【2609.28554】Pistis Technical Report
链接：https://arxiv.org/abs/2609.28554
作者：Heyun Chen,Xiaohan Lan,Jiaxi Li,Zhilin Lu,Qi She,Weiwen Xu,Fei Yu,Yujie Zhong,Jinghuan Chen,Zijian Feng,Siyu Jiao,Yiheng Lin,Xinhao Wang,Sihan Yang,Jieyu You,Changbin Zhang,Hengyu Zhang,Xudong Zhang,Yunqing Zhao,Shuai Zheng
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Pistis model family, multimodal large language, large language models, language models built, scalable post-training framework
备注：
点击查看摘要
Abstract:We introduce the Pistis model family, comprising 27B- and 9B-parameter multimodal large language models built on Qwen3.6 and Qwen3.5, respectively, and developed through a general and scalable post-training framework. The framework first establishes a strong foundation through large-scale multimodal supervised fine-tuning (SFT). Building on this SFT foundation, we propose Interleaved Distillation and Reinforcement Learning (IDRL), a novel post-training paradigm that tightly integrates on-policy distillation and reinforcement learning within a single training loop. By alternating between the two objectives, rather than optimizing either in isolation or combining them in a static joint loss, IDRL enables more effective knowledge transfer, greater optimization stability, and more precise credit assignment for long-horizon agentic trajectories, leading to stronger performance while mitigating common capability trade-offs. At both model scales, the framework produces two specialized variants: Pistis-Thinking, designed to strengthen deep multimodal reasoning, and Pistis-Agentic, which additionally incorporates agentic trajectory data to support long-horizon planning, iterative reasoning, and tool use. Pistis-Agentic is particularly strong in multimodal search. Both scales outperform their corresponding base models. Beyond model-parameter optimization, we further introduce Pistis-Auto-Harnessing (PAH), a system-level method that automatically improves the agent's inference harness through iterative optimization. Experiments demonstrate that PAH enhances the model performance without updating the model parameters or increasing the interaction budget.
137. 【2609.28539】$\unicode{x1F493}$Heartian: Physiology-Aware Relightable Gaussian Head Avatar
链接：https://arxiv.org/abs/2609.28539
作者：Xiaoyue Fan,Jose Echevarria,Akshay Paruchuri,Kaan Akşit
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：omitting subtle cardiac-induced, cardiac-induced skin-color variation, subtle cardiac-induced skin-color, intrinsic facial appearance, Gaussian head avatars
备注： 4 pages of manuscript and 2 pages of supplementary material; SIGGRAPH Asia 2026 Technical Communications
点击查看摘要
Abstract:Gaussian head avatars typically model intrinsic facial appearance as temporally static, omitting subtle cardiac-induced skin-color variation. We propose $\unicode{x1F493}$Heartian, a physiology-aware modulation framework that learns cardiac-cycle-dependent per-frame albedo modulation of facial skin-region Gaussians within a relightable head avatar to encode remote photoplethysmography (rPPG) signals. Using synchronized contact PPG supervision, $\unicode{x1F493}$Heartian models the prescribed cardiac waveform as the sum of two Gaussian functions and learns per-frame spatial residuals via a lightweight MLP. Across 152 stationary recordings from UBFC-rPPG, PURE, and MMPD, attribute-space recovery of the supplied signal achieves a pooled recording-level heart-rate MAE of 0.29 bpm and MAPE of 0.38%. The signals remain detectable after rendering by benchmark rPPG methods, with the best tested configuration - a motion-augmented TS-CAN decoder pretrained on UBFC-rPPG - recovering heart rate from the rendered MMPD avatars at 0.97 bpm MAE and 1.21% MAPE. Meanwhile, $\unicode{x1F493}$Heartian maintains reconstruction quality comparable to the baseline, with negligible average PSNR degradation of 0.005 dB. Overall, our work embeds recoverable rPPG signals as controllable material attributes to subject-specific Gaussian head avatars while retaining the reconstruction quality.
138. 【2609.28476】A Vision-Language Framework for Measuring Social Life on Sidewalks
链接：https://arxiv.org/abs/2609.28476
作者：Liu Liu,Andres Sevtsuk
类目：Computers and Society (cs.CY); Computer Vision and Pattern Recognition (cs.CV)
关键词：exist for counting, social, street-view imagery, counting pedestrians, activity
备注：
点击查看摘要
Abstract:While a number of methods exist for counting pedestrians in street-view imagery, these mostly ignore the social dimensions of pedestrian activity. A street traversed by a high volume of pedestrians has the same headcount as a street where people linger, sit, and socialize. This paper presents a vision-language framework for extracting social indicators from street-level imagery. Panoramic street-level imagery is reprojected to sidewalk-facing sideviews with preserved timestamps. A vision-language model (VLM)-based activity detection system codes each person across ten independent observable dimensions, resolving a systematic failure mode in which models prompted with high-level social categories conflate observable states with contextual inferences. The resulting social indicator system produces a Social Dwelling Index (SDI) that jointly considers pedestrian grouping and dwelling, provides activity labels documenting behavioral diversity, and issues binary flags for the presence of accessibility-sensitive populations. We apply the framework to 102,514 sideviews in New York City, revealing that pedestrian volume and SDI are only weakly associated (r = 0.168): streets with the highest foot traffic are not where social activity is most intense. The framework provides a scalable method for measuring not only how many people are on city sidewalks, but also their grouping, posture, and activity type, summarizing the non-transient activities that occur on city sidewalks.
139. 【2609.29613】Evidence-Driven Differential Diagnosis of Malignant Melanoma
链接：https://arxiv.org/abs/2609.29613
作者：Naren Akash,Anirudh Kaushik,Jayanthi Sivaswamy
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：malignant melanoma, present a modular, modular and multi-level, differential diagnosis, diagnosis of malignant
备注：
点击查看摘要
Abstract:We present a modular and multi-level framework for the differential diagnosis of malignant melanoma. Our framework integrates contextual information and evidence at the lesion, patient, and population levels, enabling decision-making at each level. We introduce an anatomic-site aware masked transformer, which effectively models the patient context by considering all lesions in a patient, which can be variable in count, and their site of incidence. Additionally, we incorporate patient metadata via learnable demographics embeddings to capture population statistics. Through extensive experiments, we explore the influence of specific information on the decision-making process and examine the tradeoff in metrics when considering different types of information. Validation results using the SIIM-ISIC 2020 dataset indicate including the lesion context with location and metadata improves specificity by 17.15% and 7.14%, respectively, while enhancing balanced accuracy. The code is available at this https URL.
140. 【2609.28988】Personalized Korean Lipreading as Visual Speech Recognition: Transfer, Census and Adaptation on OLKAVS
链接：https://arxiv.org/abs/2609.28988
作者：Se Un Park,Hakjun Kim,Taehoon Roh,Junyoung Park
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：personalized Korean visual, nine-camera OLKAVS corpus, Korean visual speech, population-level benchmark score, visual speech recognition
备注： Submitted to ICASSP 2027. 4 pages plus references
点击查看摘要
Abstract:We present a personalized Korean visual speech recognition (VSR) system and quantify, on the nine-camera OLKAVS corpus, the gap between the population-level benchmark score and an individual user's error. A video-only Conformer initialized from English-trained weights attains 9.95 - 12.19% character error rate (CER) under the corpus protocol against the published 26.64, and 19.00 - 21.52 on unseen wording. Per speaker, CER spans 1.0 to 52.2%, with seen wording lowering CER by 7.0 - 9.0 points and professional delivery and spontaneous speech raising it by 8.5 - 10.5 and 12.7 points. A low-rank adapter with 4.6% of the parameters, trained on 4 to 29 minutes of the user's frontal video, lowers the CER of twelve high-error speakers by 2.13 to 3.58 points, transfers to every camera without loss, and keeps 85% of the full fine-tuning gain at 12% of its cost to other speakers. Cameras above the mouth plane add about six CER points as a constant offset that training on all views keeps small.
141. 【2609.28732】Integrating Local Detail and Global Context: A Dual-Input Multi-Task Learning Framework for Bone Tumor Diagnosis
链接：https://arxiv.org/abs/2609.28732
作者：S. M. Nasif Uddin,Rusab Sarmun,Muhammad E. H. Chowdhury,Adam Mushtak,Israa Al-Hashimi,Sohaib Bassam Zoghoul
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Primary bone tumors, clinically aggressive neoplasms, overlapping bone structures, subtle lesion margins, Primary bone
备注：
点击查看摘要
Abstract:Primary bone tumors are rare but clinically aggressive neoplasms whose diagnosis from radiographs is challenged by heterogeneous morphology, subtle lesion margins, and overlapping bone structures. To address the limitations of existing single-view models, we present a dual-input, multi-task learning framework that, to our knowledge, is the first to apply bidirectional cross-modal attention between a lesion crop and the full radiograph for joint segmentation and subtype classification. Using the multi-institutional Bone Tumor X-ray Radiograph Dataset (BTXRD, n=3,746), we employ a YOLO-based detector to generate regions of interest, which are paired with full images as inputs to a dual-stream DenseNet121 architecture. Features are integrated via a novel cross-modal attention fusion strategy, refined by Hierarchical Multi-scale Feature Fusion, effectively balancing fine-grained lesion detail with global anatomical context. Evaluated on a held-out patient-level test split, the model demonstrates superior performance over single-input baselines, achieving an overall Dice Similarity Coefficient of 0.896 and a macro-averaged classification F1-score of 0.928. Notably, the system exhibits exceptional sensitivity for malignant osteosarcoma (AUC 0.999), validating the potential of dual-stream context modeling to support radiologists in accurate, early decision-making.
142. 【2609.28541】Adaptive Tiling for Least-Squares Phase Unwrapping: Runtime and Accuracy
链接：https://arxiv.org/abs/2609.28541
作者：Antoine Moevus,Max Mignotte
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：Phase unwrapping estimates, measured phase images, unwrapping estimates, estimates the missing, missing multiples
备注： Technical report. 15 pages of main text and references, followed by 8 pages of supplementary material. 6 figures, 8 tables and 2 algorithms in total
点击查看摘要
Abstract:Phase unwrapping estimates the missing multiples of $2\pi$ in measured phase images. For large images, tiling limits the size of local reconstruction problems and enables parallel processing. Adaptive tiling could further reduce the number of local problems and boundaries by retaining large tiles where little refinement is needed. We investigate whether this reduction makes reconstruction faster. We compare complete reconstruction time and accuracy for a regular grid, quadtree, and kd-tree partitions. We also evaluate nine criteria for deciding where quadtree tiles should be subdivided, including residue count, fringe density, and measures of phase variation, at different tile sizes and budgets. In single-threaded experiments on a heterogeneous image dataset, optimized adaptive partitions use fewer tiles but remain slower than the optimized grid, and some reconstructions lose substantial accuracy. Stage measurements explain why: constructing the partition and solving larger retained tiles outweigh the savings at tile boundaries. The criterion comparison also shows that more refinement does not consistently improve accuracy. These results motivate evaluating adaptive partitions by the complete time needed to reach a chosen reconstruction accuracy, including whether limited refinement can provide a faster approximate result.
143. 【2609.28508】Does DCGAN-Based Synthetic Augmentation Improve Brain Tumor MRI Classification? An Empirical Study
链接：https://arxiv.org/abs/2609.28508
作者：Irhum Jawad Khan,Talha bin Aslam
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Generative adversarial networks, Generative Adversarial Network, Convolutional Generative Adversarial, Deep Convolutional Generative, Generative adversarial
备注：
点击查看摘要
Abstract:Generative adversarial networks (GANs) are increasingly used to augment medical imaging datasets, but synthetic images do not necessarily provide downstream classification benefits. This study investigates whether class-specific Deep Convolutional Generative Adversarial Network (DCGAN) augmentation improves brain tumor classification when the classifier and evaluation set are held constant. Experiments were conducted on 7,200 brain magnetic resonance imaging (MRI) scans across four classes: glioma, meningioma, pituitary tumor, and no tumor. For each class, 1,400 real images were used for training and 400 were reserved for testing. A baseline Swin Transformer classifier was trained using only the real training images and compared with a second model trained using the same real images augmented with 500 DCGAN-generated images per class. Both conditions were evaluated on the identical held-out test set. The two models achieved the same overall accuracy of 96%, while macro F1 remained effectively unchanged and ROC-AUC decreased slightly from 0.987 to 0.982 after augmentation. Class-level analysis showed small redistributions in errors rather than a consistent performance gain. FID values between real and synthetic images ranged from 209.15 to 314.27, indicating substantial distributional differences under the adopted evaluation setup. These results suggest that synthetic augmentation should not be assumed to improve medical image classification and should instead be evaluated for both distributional fidelity and downstream task utility.
