本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新867篇论文，其中：
- 自然语言处理186篇
- 信息检索21篇
- 计算机视觉152篇
自然语言处理
1. 【2609.01604】Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation
链接：https://arxiv.org/abs/2609.01604
作者：Himil Vasava,Ming Jiang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：remains poorly understood, natural language generation, automated training signals, rating remains poorly, poorly understood
备注： Accepted at EMNLP 2026 Main Conference
点击查看摘要
Abstract:LLM-based evaluators of natural language generation (NLG) quality are widely deployed as scoring tools and as automated training signals, yet the internal procedure by which they assign a rating remains poorly understood. We investigate this procedure mechanistically through an eight-attack perturbation taxonomy across the Readability and Adequacy dimensions of NLG quality, a generation pipeline that produces paired clean and corrupt summaries with controlled error intensity and explicit token-level modification maps, and a four-experiment battery of causal tracing, logit-lens vocabulary projection, and attention-head knockout applied to Themis (Llama-3-8B) and Prometheus (Mistral-7B). Both evaluators implement a structured, coherent evaluation pipeline operating in two stages: below layer 15, attention performs local error comparison and routes the result to the final input position; above it, the MLP cascade integrates the signal and writes the rating, with the decision crystallizing in the residual stream at a sharp late layer (L = 26 on Themis, L = 25 on Prometheus). Furthermore, a base-model control at the same scale (Llama-3-8B) reproduces the routing architecture and crystallization but not the stage separation, isolating the two mechanisms that fine-tuning specifically installs, suppression of below-L15 MLP contribution at the last position and a two-layer advance of the crystallization depth, indicating that fine-tuning sculpts an existing substrate rather than building the pipeline from scratch. We release the source code and data at this https URL
2. 【2609.01603】Efficient SWE Agent Benchmarking via Trajectory-Aware Evaluation
链接：https://arxiv.org/abs/2609.01603
作者：Kefeng Duan,Dewu Zheng,Yanlin Wang,Xiwen Wang,Ensheng Shi,Xilin Liu,Yuchi Ma,Jiachi Chen,Mingwei Liu,Zibin Zheng
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Evaluating software engineering, software engineering agents, Evaluating software, multi-step code exploration, require multi-step code
备注： Under review
点击查看摘要
Abstract:Evaluating software engineering agents on realistic benchmarks is costly, since each task may require multi-step code exploration, modification, and test execution. Existing efficient evaluation methods select representative subsets to estimate full-benchmark performance, but are largely result-only: they fit historical pass/fail response matrices or static task semantics, discarding how agents solve problems. We propose PTA-IRT, a Privileged Trajectory-Aware Item Response Theory framework that fuses process and outcome signals. Historical execution trajectories supply process-level evidence beyond pass/fail, such as explored context, attempted edits, and solving paths, which PTA-IRT uses as privileged information for calibration subset selection and ability estimation. Under low calibration budgets, PTA-IRT consistently outperforms prior IRT baselines on score and ranking recovery across four SWE benchmarks. Code and data are publicly available at this https URL.
3. 【2609.01601】Adaptive Critical Token-Aware Retrieval for Repository-Level Code Generation
链接：https://arxiv.org/abs/2609.01601
作者：Kefeng Duan,Dewu Zheng,Yanlin Wang,Terry Yue Zhuo,Mingwei Liu,Jianxing Yu,Jiachi Chen,Ensheng Shi,Xilin Liu,Yuchi Ma,Zibin Zheng
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：satisfies task requirements, task requires synthesizing, satisfies task, task requirements, requirements while remaining
备注： Under review
点击查看摘要
Abstract:The repository-level code generation task requires synthesizing code that satisfies task requirements while remaining consistent with the target repository context. Since real-world repositories often exceed the input length limits of LLMs, existing approaches commonly adopt retrieval-augmented generation (RAG) to provide repository-specific context. Despite improving repository-context retrieval, existing methods typically provide context as task-level support, without explicitly identifying the critical tokens that require fine-grained repository context during generation. During the autoregressive generation process of LLMs, errors often concentrate at a small number of decisive positions: once such tokens are generated incorrectly, subsequent code may follow an incorrect semantic path and eventually lead to functional failure. We refer to these positions as "critical tokens". In this paper, we propose ACToR, an adaptive critical token-aware retrieval framework for repository-level code generation. ACToR identifies critical tokens during generation and triggers targeted retrieval on demand to provide repository context at these decisive positions. In addition, we design a position-aware weighting method for dense retrievers to prioritize context that is more informative for generation. We evaluate ACToR on two representative repository-level benchmarks, RepoExec and CoderEval. Experimental results show that ACToR consistently outperforms state-of-the-art methods, achieving relative improvements of 8.4% on RepoExec and 15.4% on CoderEval. Beyond performance gains, we systematically quantify the impact of critical tokens, revealing their central role in major generation failures and highlighting the necessity of targeted retrieval strategies. We provide the code and data at this https URL.
4. 【2609.01600】CordisBench: Can Language Models Reason About Component Lifecycles in Dynamic Agent Harnesses?
链接：https://arxiv.org/abs/2609.01600
作者：Damien Sileo,Dimitri Kachler
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Dynamic agent harnesses, Dynamic agent, agent harnesses, harnesses let language, software that shapes
备注： 13 pages, 6 figures, 5 tables. Code: [this https URL](https://github.com/sileod/cordis-bench) ; Data: [this https URL](https://huggingface.co/datasets/sileod/cordis-bench)
点击查看摘要
Abstract:Dynamic agent harnesses let language models change the software that shapes their own execution. This flexibility brings a new reasoning burden: a local plugin change can propagate through dependencies and cleanup. We introduce CordisBench, a 1,200-question benchmark of this lifecycle reasoning. It combines a controlled formal setting with programs executed against Cordis, a runtime that manages component dependencies and cleanup, and asks models to identify affected components, predict state after a specified teardown order, determine which conditions hold under all or some orders, and choose reconfigurations that succeed when executed. Across these tasks, we evaluate three efficiency-oriented models at low reasoning effort with 2, 4, 8, 16, 24, or 32 relevant interactions, using deterministic task-specific scoring. Models usually handle small systems well but grow less reliable as more interactions become relevant, especially when predicting final state and when reasoning across teardown orders. Additional inference effort recovers marked gains for some models. The cost is nontrivial: on our 16-interaction subset, GPT-5.6 Luna uses nearly 3,000 reasoning tokens per question at medium effort. For these controlled instances, that cost is avoidable: an independent finite reference semantics agrees with Cordis execution on every observation and action outcome used for scoring across all 528 executable questions.
5. 【2609.01597】he Rise of Verbal Reinforcement Learning
链接：https://arxiv.org/abs/2609.01597
作者：Kshitij Tayal,Arun Sharma,Genta Indra Winata,Anirban Das,Sambit Sahu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：primary feedback channel, modern language models, Verbal Reinforcement Learning, conveying intent, language
备注：
点击查看摘要
Abstract:Natural language is emerging as a primary feedback channel for improving language agents, capable of conveying intent, preferences, and causal structure in forms interpretable by both humans and modern language models. We call this paradigm Verbal Reinforcement Learning (VRL) and offer the first unified account of it. We organize the field around a single axis, \textit{when} verbal feedback takes effect in an agent's lifecycle and \textit{what} it modifies, yielding three pillars: (1) \textbf{Language as Grounding Signal}, where language defines the task itself by specifying goals, states, and reward structures; (2) \textbf{Language as Deliberative Feedback}, where natural language guides reasoning at test time without the need to update model parameters; (3) \textbf{Language as Learning Signal}, where language-based feedback shapes model parameters through training. Within each pillar, we synthesize representative work, distinguish key subcategories of approaches, and outline the distinct role language plays in shaping agent behavior. Together, this taxonomy shows how verbal reinforcement is reshaping agent development, while also defining the challenges and opportunities for building more capable and aligned agents.
6. 【2609.01591】StudentSim: Training LLM-based Student Simulators
链接：https://arxiv.org/abs/2609.01591
作者：Ke Yang,Chenglong Wang,Michel Galley,Chandan Singh,Jeevana Priya Inala,ChengXiang Zhai,Jianfeng Gao
类目：Computation and Language (cs.CL)
关键词：costly to collect, collect from real, student, guidance, preferred guidance
备注：
点击查看摘要
Abstract:AI tutors are most useful when they adapt to each student's strengths, weaknesses, and preferred guidance, but evidence about which guidance works for which student is sparse, slow, and costly to collect from real learners. Student simulators can provide this signal as a proxy, yet existing approaches are limited: state-tracking models fit student behavior but struggle to process explanations or corrections, while LLM role-play follows guidance fluently but does not reliably match the competence of the student being imitated. We present StudentSim, a training framework that turns sparse per-student data into individualized simulators through pooled training followed by per-student specialization. The resulting simulators both mirror a student's own responses and update them under tutor guidance. We also introduce StudentSimEval, a standardized protocol covering 60 students across chess, second-language English writing, and mathematics, using public learner datasets with de-identified records shared for research. StudentSimEval measures behavioral fidelity (F), or how well a simulator matches a student's responses, and guidance responsiveness (R), or how readily it updates under tutor guidance, with all methods fit and evaluated on the same records. Across all three domains, StudentSim outperforms GPT-5.4 on both metrics. In chess, StudentSim reaches F=0.51 and R=0.91, compared with 0.23 and 0.72 for GPT-5.4 and 0.45 and 0.27 for Maia2. As a proof of concept, using StudentSim as a reward model for tutor reinforcement learning produces a chess tutor that expert humans rate as more accurate, better-guided, and more personalized than a no-RL baseline and a tutor trained against a GPT-5.4 simulator reward. Code is available at this https URL.
7. 【2609.01588】Designing Proactive Thought Partners for Writing
链接：https://arxiv.org/abs/2609.01588
作者：Chao Zhang,Abe Davis,Chih-Wei Chen,Chin-Chia Hsu
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：diverse cognitive activities, Writing involves diverse, involves diverse cognitive, ideation to revision, involves diverse
备注： 30 pages, 5 figures
点击查看摘要
Abstract:Writing involves diverse cognitive activities, from ideation to revision, and writers' needs vary across individuals and moments. Proactive AI promises to provide the right support at the right time, yet existing proactive tools largely focus on generic textual assistance, such as autocomplete. This paper studies the design space of proactive thought partners: AI agents that proactively offer customizable, higher-level cognitive support during writing. We instantiated this concept in a technology probe and deployed it with 16 participants for one week. The probe allows users to create partners by configuring their roles and proactivity. As users write, relevant partners take the initiative at appropriate moments to offer suggestions. Our findings show that participants configured proactive support through prospective planning, used suggestions for both idea generation and self-monitoring, and valued lightweight visual representations alongside non-directive rhetorical framing for non-intrusive interventions. We derive implications for designing proactive writing assistants around customization, timing, engagement, and representation.
8. 【2609.01587】he Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent Globally
链接：https://arxiv.org/abs/2609.01587
作者：Jundong Hu,Shekar Ramachandran
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：serving large language, large language models, Post-training quantization, serving large, large language
备注： Preprint. Under review at a NeurIPS 2026 workshop. 11 pages, 4 figures, 8 tables
点击查看摘要
Abstract:Post-training quantization (PTQ) is widely used to reduce the cost of serving large language models (LLMs), but its accuracy cost is uneven and is often tuned per model. We study where quantization damage occurs and how to allocate a small additional precision budget. Using causal mixed-precision intervention as ground truth (raise each layer to 8-bit in turn and measure the accuracy it recovers) across 9 open-weight models in 4 architecture families, we test 3 intuitive hypotheses: that quantization damage lives in task circuits, where the model computes, or in weight statistics. None of them predicts which layers benefit from restored precision. Recovery is instead diffuse: for 8 of 9 models, recovering 75% of the gap takes roughly half the layers; the lone exception, Qwen3-8B, is sharply concentrated. At a matched precision budget, spending it globally on finer quantization granularity beats locally repairing the most recoverable layers for all 8 group-128-compatible models (all but OpenLLaMA, whose width rules out group-128), by 21-52 points, including the concentrated Qwen3-8B. We report 2 secondary findings: the residual is budget-limited (8-bit is near-lossless in our evaluation across RTN, GPTQ, and AWQ), and the location of peak recovery correlates with architecture within a family, though not across families. Within this budget setting, global granularity is a better default than selectively protecting critical layers. More broadly, cheap signals that correlate with quantization damage do not necessarily identify where restoring precision improves accuracy; this must be tested with causal intervention.
9. 【2609.01575】Closing Cost-Quality Gap in Document VLMs: Difficulty-Aware Data Curation and Quality-Adjusted Deployment Economics
链接：https://arxiv.org/abs/2609.01575
作者：Maksim Evdokimov,Matvey Ivanov,Dmitrii Tsiupin,Olga Tsymboi,Anatolii Potapov,Aleksandr Ivanov
类目：Computation and Language (cs.CL)
关键词：bespoke OCR cascades, Extracting structured fields, OCR cascades cover, privacy rules preclude, rules preclude external
备注：
点击查看摘要
Abstract:Extracting structured fields from hundreds of millions of documents annually remains costly in regulated industries: bespoke OCR cascades cover only a fraction of workflows, privacy rules preclude external models, and existing open-source VLMs that clear quality thresholds cost more to serve than human annotation. We present a deployed document-understanding system built on a Mixture-of-Experts VLM (35B total, 3B active), fine-tuned on in-house production data mixed with open-domain documents curated by a Difficulty-Aware pipeline for layout diversity, fact-extractability, and cross-model consistency. Fitting on a single H100 and serving heterogeneous workflows via prompting, the model leads all deployable (non-reasoning) baselines up to an order of magnitude larger. A quality-adjusted cost analysis, with confirmation and correction costs calibrated from production telemetry, shows it reduces expected costs by over 80% against the human baseline and by more than 50% against the best competing open-source model, while larger baselines remain economically unviable.
10. 【2609.01573】Scaling Near-Optimal SFT-RL Annotation Budget Allocation from Small to Large LLMs
链接：https://arxiv.org/abs/2609.01573
作者：Jingtan Wang,Arun Verma,Xiaoqiang Lin,Zhengyuan Liu,Nancy F. Chen,Daniela Rus,Bryan Kian Hsiang Low
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：LLM post-training remains, LLM post-training, fixed annotation budget, supervised fine-tuning, reinforcement learning
备注： Accepted at EMNLP 2026
点击查看摘要
Abstract:How to divide a fixed annotation budget between supervised fine-tuning (SFT) and reinforcement learning (RL) during LLM post-training remains an open problem. Existing work characterizes only broad trends (e.g., SFT dominates in low-data regimes), lacks a principled allocation framework, and does not examine whether the optimal ratio transfers across model sizes. We frame this problem in terms of near-optimality: rather than seeking a single optimal SFT-RL ratio, we characterize the near-optimal region, the set of allocations within a specified tolerance of peak performance. Empirically, this region is wide even for small tolerances (2-10%), widens with model scale, and transfers reliably from small proxy models to large target models. This yields a practical strategy: small proxy-model experiments suffice to identify a transferable near-optimal region, eliminating the need for exhaustive large-scale search. Our results hold consistently across tasks, model families, and both preference-based off-policy and reward-supervision on-policy RL methods. We further analyze how the asymmetry in annotation costs between SFT and RL data shifts the near-optimal region.
11. 【2609.01572】From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix
链接：https://arxiv.org/abs/2609.01572
作者：Olga Tsymboi,Dmitrii Stoianov,Ramil Latypov,Danil Taranets,Daniil Dryabin,Mikhail Gashkov,Viktor Zelenkovskiy,Aleksandr Fida,Gleb Alektorov,Nikita Gulyakov,Arthur Babkin,Aleksandr Medvedev,Pavel Gein,Anatolii Potapov
类目：Computation and Language (cs.CL)
关键词：finite GPU pool, Data-residency constraints force, constraints force enterprises, GPU pool, Data-residency constraints
备注：
点击查看摘要
Abstract:Data-residency constraints force enterprises to self-host LLMs, but continuous adoption of newer models without decommissioning their predecessors expands the serving fleet, fragmenting a finite GPU pool. We consolidate traffic from over 200 internal applications onto a single model by closing quality gaps identified through production error analysis along three axes: instruction following, function-calling, and internal task distribution. Quality is tracked by offline benchmarks stratified to production traffic and scored by deterministic verifiers or calibrated LLM judges. Rather than optimising all objectives jointly, which introduces cross-domain reward interference, we train a separate GRPO expert per axis and merge them via two-stage SLERP. Each expert's reward exposes a distinct failure mode, namely semantic collapse, over-calling, and verbosity hacking, each requiring a domain-specific fix. In non-reasoning mode the recipe surpasses a ${\sim}7\times$ larger by total parameters baseline on the in-house Arena with 69.6 to 65.8, instruction following with 0.85 to 0.83, and function-calling with 0.79 to 0.77, while lifting general dialogue benchmarks. The model absorbs 50% of platform traffic, 116M requests per month, at a fraction of the serving cost.
12. 【2609.01567】Selective Agent Guidance via Entropy: Learning Autonomous Policies from Imperfect VLM Teachers
链接：https://arxiv.org/abs/2609.01567
作者：Matteo Merler,Giovanni Bonetta,Davide Zago,Rossella Cancelliere,Bernardo Magnini
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：repeat systematic errors, Vision-Language Models, VLM, provide useful priors, interactive decision-making
备注： 9 pages, 3 figures, 4 tables in the main text, 27 pages, 4 figures, 9 tables including Appendix
点击查看摘要
Abstract:Vision-Language Models (VLMs) provide useful priors for interactive decision-making, but using them directly as policies is expensive and brittle: they must be queried at every step, do not improve from environment interaction, and can repeat systematic errors. We study how to learn a cheap autonomous policy from an online, expensive, and imperfect but informative VLM teacher. We propose SAGE (Selective Agent Guidance via Entropy), a framework that queries a VLM only when the learner is uncertain, executes the suggested action during training, and distills guidance into a lightweight Reinforcement Learning (RL) policy. Because VLM advice is not always reliable, SAGE can weight teacher-action distillation using environment-derived advantages rather than treating all suggestions as equally useful. Across sparse-reward visual reasoning and navigation tasks, SAGE learns policies that act without VLM guidance at evaluation time and improves over unguided RL in several environments, including settings where the learned policy exceeds its VLM teacher. The results show that selective guidance is most beneficial when the VLM can help the agent discover high-reward trajectories, and less useful when unguided exploration already succeeds or teacher actions do not lead to informative experience. SAGE also reduces VLM usage by prompting the teacher only on a fraction of training steps and requiring no VLM calls at deployment. Overall, our results suggest that VLMs don't need to be used as fixed policies to be useful; they can instead act as temporary, imperfect sources of guidance whose value is tested and internalized through interaction.
13. 【2609.01564】From Confusion to Clarity: Confusion-Aware Retrieval and Knowledge Injection for Text Classification
链接：https://arxiv.org/abs/2609.01564
作者：Manish Gupta,Chaitanya Giri,Jayasimha Talur
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, captured by pre-training, Large language, classify text, text into taxonomies
备注： EMNLP 2026 (Industry Track)
点击查看摘要
Abstract:Large language models (LLMs) struggle to classify text into taxonomies with many semantically similar labels, as the distinctions are domain-specific and not captured by pre-training. To handle large label spaces, a common approach retrieves top-$K$ candidate labels by embedding similarity and prompt the LLM to choose among them. However, top-$K$ retrieval reduces the number of candidates but does not help the model tell similar ones apart. When two similar labels both appear as candidates, the model lacks the signal to choose correctly between them. We propose a framework that (1) identifies which label pairs the model struggles to distinguish, (2) expands the candidate set to include confusable labels, and (3) generates targeted rules to differentiate between similar candidates. The framework requires no fine-tuning, and the generated rules transfer to smaller, cheaper models. On three benchmarks (WOS, Flipkart, LEDGAR), our approach improves Macro F1 by up to 10.0pp over retrieval baselines, with smaller models (2B--20B) gaining up to 11.5pp via cross-model transfer.
14. 【2609.01563】A systematic Approach to constructing a Chance-and-Risk Matrix for Semiconductor Supply Chains
链接：https://arxiv.org/abs/2609.01563
作者：Ema Salkić,Alexander Fichtl,Philipp Ulrich,Hans Ehm,Marta Bonik,Georg Groh
类目：Computation and Language (cs.CL)
关键词：rapid technological shifts, scalable system continuously, public corporate disclosures, system continuously extracts, prioritizes risk intelligence
备注： Copyright 2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
点击查看摘要
Abstract:Semiconductor supply chains face escalating risks from geopolitical tensions, geographic concentration, and rapid technological shifts, yet no scalable system continuously extracts, structures, and prioritizes risk intelligence from public corporate disclosures. We present an end-to-end pipeline that retrieves corporate documents for semiconductor companies and uses large language models (LLMs) to extract the risks and opportunities they describe. It organizes these into a knowledge graph linking each item to its category, sources, and related events, then merges duplicates and ranks them with a three-layer mechanism combining an algorithmic formula, an LLM relevance adjustment, and expert validation. Applied to five companies across the value chain, the pipeline produces 76,207 scored items, of which an independent check finds 92.6% valid. The automated rankings match expert judgment at an average Spearman correlation of 0.55 for risks and 0.72 for opportunities, and the resulting matrices identify trade restrictions as the dominant cross-company risk.
15. 【2609.01548】SDARE-Bench: Evaluating Large Language Models on Conversational Stigma Detection and Response in Dyadic and Group Dialogue
链接：https://arxiv.org/abs/2609.01548
作者：Stephanie Fong,Yiwen Jiang,Zimu Wang,Hongxi Yang,Yaling Shen,Hiu Weh Naomi Chow,Heung Ying Lai,Xiangyu Zhao,Qingyang Xu,Zhongxing Xu,Jiahe Liu,Guilherme C. Oliveira,Vincent Lee,Zongyuan Ge,Dominic Dwyer
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, Language Models, affect social judgements, social judgements
备注： Paper accepted at EMNLP 2026
点击查看摘要
Abstract:Large Language Models (LLMs) are increasingly used in advice seeking and decision making that may affect social judgements. Despite stigma's profound effects on people and communities, benchmarks remain scarce. Existing general-domain evaluations typically rely on static prompts and fixed-format tasks, overlooking conversational contexts and audience effects in everyday communication. To address these gaps, we introduce SDARE-Bench, the first scenario-based benchmark evaluating both stigma detection and open-ended response generation in LLMs, comprising 1,138 dyadic queries and 1,388 group dialogue. Empirical results across 8 LLMs consistently demonstrate poor identification of stigma components, especially in group dialogues. In open-ended response generation, stigma expression was substantially higher in group settings than in dyadic, with weaker resistance to stigma and more unrealistic advice. Responses were evaluated using a classifier trained on 1,392 human annotated responses. In constructed group pressure settings, stigma expression rates further increased to a striking average of 97.5%. Our findings identify stigma response as a recurring LLM safety vulnerability, especially in socially complex conversational contexts.
16. 【2609.01532】Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall
链接：https://arxiv.org/abs/2609.01532
作者：Jacqueline He,Howard Yen,Shuyue Stella Li,Margaret Li,Hanqing Zeng,Yinglong Xia,Benyu Zhang,Zhuokai Zhao,Qiang Zhang,Pang Wei Koh,Luke Zettlemoyer,Wen-tau Yih
类目：Computation and Language (cs.CL)
关键词：smaller language models, train smaller language, Logit-based knowledge distillation, stages remains unclear, Logit-based knowledge
备注： 33 pages, 13 figures, 9 tables. Code is publicly available at [this https URL](https://github.com/facebookresearch/midtraining-distillation)
点击查看摘要
Abstract:Logit-based knowledge distillation (KD) is used to train smaller language models (LMs) via supervision from stronger teachers, but whether its benefits are consistent across training stages remains unclear. Through controlled experiments, we find that forward Kullback-Leibler (KL) distillation--the standard KD formulation--with post-trained teachers behaves fundamentally differently during mid-training, an intermediate phase of self-supervised learning on curated corpora. Surprisingly, while forward KD simultaneously improves reasoning and factual recall during pre-training relative to standard next-token prediction (NTP), it instead slows factual recall acquisition during mid-training despite continued reasoning gains. We trace this stage dependence to an asymmetry in teacher confidence across data domains and the student's evolving knowledge state: teachers are more confident on procedural than knowledge-intensive data, while students acquire low-entropy factual knowledge earlier in training. To mitigate this imbalance, we propose Switch Distillation, a simple mid-training objective that distills on tokens where the teacher is confident, using teacher predictive entropy as a lightweight routing signal, and otherwise falls back to cross-entropy. Switch Distillation consistently outperforms existing distillation objectives across teacher sizes. Relative to standard NTP, it achieves 1.61-1.71x the reasoning performance and 1.13-1.19x the knowledge and commonsense performance while preserving 96.7-96.8% of factual recall. Crucially, these benefits persist after post-training: Switch Distillation closes the factual recall gap while maintaining 1.25-1.32x and 1.13-1.20x gains in reasoning and knowledge and commonsense, respectively.
17. 【2609.01491】GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions
链接：https://arxiv.org/abs/2609.01491
作者：Elias Stengel-Eskin,Newton Sander,Carlos Bonetti,Sasha Boguraev,James Bowler,Hale Sirin,Simon Kirby
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：raises key questions, growing rate, raises key, implications for safety, safety and monitorability
备注： GlossoGen code: [this https URL](https://github.com/agencyenterprise/GlossoGen) Paper code: [this https URL](https://github.com/esteng/emergent_communication)
点击查看摘要
Abstract:The growing rate at which LLM agents interact with one another raises key questions about language evolution in multi-LLM-agent settings, with implications for safety and monitorability as well as for linguistic accounts of LLMs. To address these questions, we introduce GlossoGen, a novel platform for studying multi-agent language evolution in complex scenarios. Within GlossoGen, we build the SaveVeyru scenario, which requires agents with partial information to communicate under pressure. We find that language evolution does occur between LLM agents, that the resulting languages are compositional and morphologically productive, and that they deviate from the LLMs' English prior in ways that render them incomprehensible to humans. Moreover, we identify several qualities essential to this evolution: pressure towards efficiency; the strength of the models backing the agents; and access to a "postmortem" stage in which agents can agree on linguistic conventions. Importantly, we observe that different conditions govern the transmission of language to new agents. Specifically, we find that agents learn new languages from usage alone, take an active role in this learning, and that while stronger models are required for novel language emergence, weaker models can learn an existing language once it has emerged. Taken together, our results indicate that current LLMs have the potential for cumulative cultural evolution -- previously attested only in humans -- with mixed populations of agents developing capacities that go beyond their lowest common denominator.
18. 【2609.01456】AutoConcept: Training-Free Concept-Guided Reranking for Metadata-Available Composed Image Retrieval
链接：https://arxiv.org/abs/2609.01456
作者：Tianyu Wang,Tianjiao Wu
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Composed image retrieval, Composed image, target image, reference image, retrieves a target
备注： Accepted regular paper at PRICAI 2026. 16 pages, 4 figures
点击查看摘要
Abstract:Composed image retrieval (CIR) retrieves a target image from a reference image and a text modification. This paper studies metadata-available CIR reranking, where a fixed CIR model first returns a candidate pool and gallery metadata is then used for second-stage concept-guided scoring. We introduce AutoConcept, a training-free reranker that converts concept evidence into an interpretable memory. AutoConcept filters noisy concepts, activates query-relevant positive constraints with an auxiliary negative penalty, and combines base retrieval scores with metadata-based concept-candidate alignment through inference-time calibration. On FashionIQ, AutoConcept yields significant early-rank improvements over WeiMoCIR and consistent plug-in gains on LinCIR candidate pools. Metadata-aware controls show that structured concept memory adds signal beyond direct query-text and extracted-attribute matching, while a query-only variant further supports the effectiveness of concept-level reranking. A supplementary real-human concept-label study indicates that the same memory interface can consume participant-provided evidence. These results position AutoConcept as an interpretable concept-memory reranker for product-style CIR galleries with available metadata.
19. 【2609.01437】HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?
链接：https://arxiv.org/abs/2609.01437
作者：Yuhao Wu,Jingyuan Zhang,Jiajun Shi,Xinping Lei,Qingshui Gu,Yuxuan Zhang,Zexuan Wang,Chen He,Chen Huang,Maojia Song,Zhiyuan Zeng,Shaowen Wang,Jinkai Liu,Yunfeng Shi,Jiaheng Liu,Shen Yan,Wenhao Huang,Ge Zhang,Wenxuan Zhang
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：deployed tools, commonly termed, prototypes to deployed, model-external execution infrastructure, harness
备注： Project page: [this https URL](https://self-developing-agents.github.io/)
点击查看摘要
Abstract:As agents move from research prototypes to deployed tools, their capability increasingly depends on model-external execution infrastructure, commonly termed the agent harness. Changing this harness while holding model weights fixed can substantially alter task performance. Current agent evaluations typically report downstream performance under a chosen harness, leaving a model's ability to develop the harness itself comparatively underexplored. We introduce HarnessDev, a benchmark that shifts the unit of evaluation from task outputs to runnable infrastructure. HarnessDev covers two stages. In Creation, the agent starts from a minimal seed and a small number of cases, then builds a complete execution system. In Evolution, it starts from its own created harness and iteratively revises it using downstream execution feedback, with the goal of improving benchmark performance. We then evaluate each constructed harness on capability (task success on held-out benchmarks) and efficiency (execution-token cost). The reported Creation results cover six creator LLMs, four domains, and five downstream benchmarks totaling 2,207 unique downstream instances, with hidden evaluation tasks withheld from development. We find that generated harnesses remain substantially behind mature human-engineered references on code and on search and research, while matching or exceeding the selected references on writing and machine-learning experimentation, with large variation in execution cost. Evolution produces some performance gains, but they are unstable and transfer only partially to held-out tasks. Experiments with a fixed runtime model further show that the gains depend strongly on the model executing the harness, indicating limited transfer across models.
20. 【2609.01432】Citing Less Critically: LLMs Reshape the Rhetoric and Reach of Scientific Citation
链接：https://arxiv.org/abs/2609.01432
作者：Yixuan Liu,Lin Chen,Zhuoqi Liu,Jianglin Lu,Dakota Murray
类目：Digital Libraries (cs.DL); Computation and Language (cs.CL); Computers and Society (cs.CY); Social and Information Networks (cs.SI)
关键词：carry rhetorical intent, Scientific citations carry, citations carry rhetorical, citation, rhetorical intent
备注： Accepted at the EMNLP 2026 main conference
点击查看摘要
Abstract:Scientific citations carry rhetorical intent. Scholars may cite prior work positively (supporting), negatively (contrasting), or neutrally (mentioning). As large language models (LLMs) increasingly assist scientific writing, whether they reproduce citations with the same rhetorical intent as humans remains unclear. We introduce a masked-citation task to compare human and LLM-generated citation behavior. For each citation context, an LLM generates a replacement citation sentence, producing a counterfactual corpus directly comparable to human citation. We analyze what, whom, and how models cite, using an LLM-as-a-judge to classify citation intent and a 20-million-edge coauthorship network to measure social distance between cited authors. Across six popular LLMs and 1,746 top NLP conference papers (63k+ contexts, 132k+ citations), three patterns emerge: (1) Compared with human citation, LLMs cite significantly less critically; (2) LLMs over-cite popular and older papers, a tendency amplified for contrasting citations where human writing more often draws on recent, niche work; (3) Whereas humans often cite within their close social network, especially for supporting citations, LLMs tend to draw on more socially distant authors. Together, these differences are double-edged: LLM citation reaches beyond a scholar's close collaborators while being less critical and amplifying visibility bias, reshaping the rhetoric and reach of scientific citation.
21. 【2609.01422】From Rollouts to Recipes: Self-Contained Post-Training for LLMs
链接：https://arxiv.org/abs/2609.01422
作者：Yifei Li,Lingling Zhang,Muye Huang,Zihan Ma,Jiashuai Liu,Jun Liu
类目：Computation and Language (cs.CL)
关键词：large language models, Post-training large language, sample-level learning states, single training recipe, large language
备注： 14 pages, 5 figures. Accepted at EMNLP 2026
点击查看摘要
Abstract:Post-training large language models usually applies a single training recipe to all samples, even though the model's own rollouts reveal different sample-level learning states. We propose Self-Routing, a behavior-conditioned post-training framework that uses rollout correctness and confidence to decide how each sample should be optimized. Depending on its behavior state, a sample is routed to GRPO, on-policy self-distillation, regularization, or skipping, allowing training to adapt without external teachers, extra annotations, or additional sampling. Experiments on mathematical reasoning across Qwen3 and Qwen3.5 backbones show that Self-Routing consistently improves over uniform GRPO, uniform OPSD, fixed mixtures, and simpler routing baselines. Further analyses show that the routing distribution changes over training and reduces unnecessary updates on low-signal or already stable samples.
22. 【2609.01409】EdiTikZ: Scientific Figure Editing from Revision Trajectories
链接：https://arxiv.org/abs/2609.01409
作者：Christian Greisinger,Zhixue Zhao,Steffen Eger
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：shown strong performance, generating scientific figures, text or images, Vision-language models, shown strong
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) have shown strong performance in generating scientific figures from text or images. However, producing publication-ready figures requires iterative refinement, making scientific figure editing an important yet largely unexplored task. Existing approaches rely on costly proprietary agentic systems, focus primarily on evaluation, or construct training supervision from synthetically generated edits. Instead, we leverage naturally occurring scientific revision and development trajectories as a scalable source of supervision. To this end, we introduce DaEdiTikZ, the first large-scale dataset of revision-derived scientific figure edits, constructed by mining 391K plausible TikZ edit pairs from arXiv, GitHub, and TeX SE and inferring 781K directed edit instructions with a VLM conditioned on rendered figures and TikZ code. We further introduce DaEdiTikZ-Bench, a human-refined benchmark with 790 instances, and train two compact Qwen3.5-based EdiTikZ models (4B and 9B) by jointly learning reconstruction and editing, followed by reinforcement learning (RL) with complementary rewards for rendered fidelity and edit application. Automatic evaluation places our 9B model above all tested baselines, while human evaluation with 9 annotators and 4,320 ratings places it above GPT-5.6-Sol and on par with Gemini-3.1-Pro. Under severe out-of-distribution shifts, it remains competitive with GPT-5.6-Sol near its 2K training sequence-length regime. Models and datasets will be released.
23. 【2609.01386】When Tokenization is Secretly Output Supervision
链接：https://arxiv.org/abs/2609.01386
作者：Tanja Baeumel,Josef van Genabith,Simon Ostermann
类目：Computation and Language (cs.CL)
关键词：input preprocessing decision, preprocessing decision, treated by default, Tokenization, models
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Tokenization in language models is treated by default as an input preprocessing decision. We argue that this framing is incomplete: in autoregressive models, tokenizer granularity determines what the model must resolve in a single forward pass, and therefore the supervision signal it receives. This affects both the difficulty of the learning problem and the representations that emerge inside the model. We test this in a controlled experiment on numeric reasoning with a novel decoupling of input and output tokenization. As the output supervision view predicts, differences in task performance, training dynamics, and model internals are induced by output tokenization and largely invariant to input tokenization. This may matter in practice, because models with different tokenization strategies differ not only in input representation but in the task they were trained on. Comparisons between models may thus partly reflect task definition rather than ability. A survey of 120 recent *CL papers on numeric reasoning confirms that this is rarely acknowledged: only about 10% report the numeric tokenization of the models they evaluate, while 69% compare across tokenization, and thus supervision, regimes without reporting it. While prior work documents that tokenization consistently affects model performance, there is no principled account of why. We argue that framing tokenization as output supervision provides that account.
24. 【2609.01383】InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations
链接：https://arxiv.org/abs/2609.01383
作者：Maeve Hutchinson,Syed Mahbubul Huq,Mohammad Albinhassan,Radu Jianu,Aidan Slingsby,Pranava Madhyastha
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：demonstrated remarkable proficiency, modern data analysis, Vision Language Models, Vision Language, inherently dynamic
备注： To be presented at EMNLP Main Conference
点击查看摘要
Abstract:Vision Language Models have demonstrated remarkable proficiency in interpreting static visual artifacts, but modern data analysis is inherently dynamic, requiring the active interrogation of interactive environments. Existing benchmarks are predominantly constrained to static imagery and one-shot question answering and fail to capture the epistemic demands of this domain, where evidence is frequently occluded, distributed across linked views, or conditionally revealed through user agency. In this paper, we introduce InSight, a benchmark for agentic claim verification over interactive visualizations. The dataset consists of 21,349 claims derived from human-authored analytical narratives and grounded in fully interactive web-based environments. Agents must navigate these environments to determine whether a natural language claim is supported, refuted or not verifiable given the available evidence. Unlike traditional evaluations, InSight treats interaction traces as intrinsic proxies for reasoning, enabling a rigorous audit of how models seek and synthesize visual evidence. We evaluate state-of-the-art models, revealing that interactive verification remains a non-trivial challenge. We release InSight at this https URL.
25. 【2609.01379】Polish ModernBERT: The Long and Short of Polish Language Understanding
链接：https://arxiv.org/abs/2609.01379
作者：Michał Perełkiewicz,Sławomir Dadas,Rafał Poświata,Małgorzata Grębowiec
类目：Computation and Language (cs.CL)
关键词：Encoder-only Transformers remain, Transformers remain effective, Encoder-only Transformers, rely on BERT, Transformers remain
备注：
点击查看摘要
Abstract:Encoder-only Transformers remain effective for discriminative and representation-learning tasks, yet Polish encoders still largely rely on BERT/RoBERTa-style architectures. We introduce \textbf{Polish ModernBERT}, a family of four Polish encoders available at Base and Large scales, each with 512-token and 8K context variants. We adapt the ModernBERT pretraining recipe through staged selection experiments and release a long-context benchmark covering legal topic classification, ideological decision-direction prediction, factual-consistency assessment over literary plot summaries, and human-rights violation assessment. Across 30 tasks, Polish ModernBERT achieves the best overall performance among the evaluated Polish encoders, reaching 83.99 and 85.11 for the Base-8K and Large-8K models, respectively. On long-context tasks, the 8K variants improve over matched Polish RoBERTa-8K baselines from 67.47 to 77.15 and from 75.88 to 78.49 at the Base and Large scales, respectively. The Base-8K model achieves this gain with 22\% fewer parameters (149M vs.\ 190M). Efficiency measurements in representative inference setups show lower peak memory usage and latency than matched Polish RoBERTa baselines in both 512-token and 8K settings. Polish ModernBERT-8K-Base additionally achieves the best result on a Polish retrieval benchmark among the evaluated encoders below 300M parameters.
26. 【2609.01375】IntroConformal: Conformal Factuality Guarantees for Large Vision-Language Models via Introspective Signals
链接：https://arxiv.org/abs/2609.01375
作者：Md. Atabuzzaman,Christian Alexander,Chris Thomas
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Large Vision-Language Models, strong multimodal performance, content remains challenging, generated content remains, Large Vision-Language
备注： EMNLP 2026 main conference
点击查看摘要
Abstract:Large Vision-Language Models (LVLMs) have achieved strong multimodal performance, yet ensuring the factual correctness of generated content remains challenging. Existing methods that provide statistical guarantees on factuality typically rely on external verifiers or generation-time confidence signals, which introduce auxiliary dependencies or often fail for confident but incorrect outputs. We argue that reliable factuality control can instead be achieved through introspective signals derived from the model itself. We introduce IntroConformal, a training-free Conformal Risk Control (CRC) framework that provides finite-sample, distribution-free factuality guarantees. We first instantiate it with layer-wise semantic stability, a conformity score derived from hidden-state representations, and then propose verification probability, a stronger score capturing the model's self-administered judgment on claim factuality. Across multiple LVLM architectures, IntroConformal satisfies the conformal risk guarantee while substantially reducing abstention and achieving competitive or superior claim-level discrimination relative to external verifier-based baselines.
27. 【2609.01374】Behaviorally Effective LoRA Writes Are Sparse and Structured
链接：https://arxiv.org/abs/2609.01374
作者：Haruto Sato,Yuki Tanaka,Ren Nakamura,Aoi Kobayashi,Mei Ito
类目：Computation and Language (cs.CL)
关键词：Low-rank adaptation fixes, Toggle, effective LoRA writes, Toggle Hugging Face, Explorer Toggle Bibliographic
备注：
点击查看摘要
Abstract:Low-rank adaptation fixes the rank of the update, but it does not identify which parts of a trained write actually carry behavior. We study that question directly and show that behaviorally effective LoRA writes are sparse, structured, and far more concentrated than the raw low-rank parameterization suggests. We use Learned-Basis LoRA, a learned-basis continuation recipe, to expose that structure. The recipe warms up an unconstrained adapter, converts its learned write columns into a module-wise orthonormal basis, freezes that basis, and continues training inside the constrained parameterization. Across 14 exact switches from unconstrained to constrained form, held-out accuracy is unchanged at the conversion step and reconstructed write matrices differ by at most 0.25% relative Frobenius error. Same-state continuation then shows that the same trained checkpoint develops differently under different write subspaces, establishing write geometry as a causal state variable. A no-retraining projection test shows that useful write signal stays inside the learned write space and largely disappears from random or frozen-activation PCA controls. The concentration pattern is strong at both local and global scales. Across GSM8K, MathQA, and AQuA, per-module top-k continuation reaches its optimum at k in {2, 4} in all twelve seed-level cases we test. A stricter global ranking test shows that learned top-16 and top-32 subsets outperform matched random subsets, especially on GSM8K/Qwen and MathQA/Qwen. Single-direction ablations further reveal a sparse set of late q_proj, o_proj, and down_proj components with outsized behavioral impact.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.01374 [cs.CL]
(or
arXiv:2609.01374v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.01374
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Haruto Sato [view email] [v1]
Tue, 1 Sep 2026 15:09:43 UTC (1,385 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Behaviorally Effective LoRA Writes Are Sparse and Structured, by Haruto Sato and 4 other authorsView PDFHTML (experimental)TeX Source
view license
Current browse context:
cs.CL
prev
|
next
new
|
recent
| 2026-09
Change to browse by:
cs
References Citations
NASA ADSGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from
our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
Major funding support from
28. 【2609.01369】How Correct Is Your Answer? A Semantic Correctness Framework for Open QA Evaluation
链接：https://arxiv.org/abs/2609.01369
作者：Elitsa Yotkova,Violeta Kastreva,Petar Velkov,Hristo Boyanov,Dimitar Dimitrov,Ivan Koychev,Preslav Nakov
类目：Computation and Language (cs.CL)
关键词：question answering remains, open-ended question answering, modern LLMs, Reliable evaluation, question answering
备注：
点击查看摘要
Abstract:Reliable evaluation of open-ended question answering remains a bottleneck for measuring answer correctness of modern LLMs. Unlike multiple-choice tasks, free-form answers may be correct in many surface forms and may fail in qualitatively different ways, including incompleteness, contradiction, overgeneration, and endorsement of false premises. Existing judgment-based and similarity-based metrics often collapse these distinctions. We address this gap with three reusable contributions. First, we introduce a semantic correctness taxonomy that assigns open-ended answers to eight ordered classes, separating verbose-but-correct answers from those contaminated by hallucinated content. Second, we release CAP-Correctness, an 8.8k-example benchmark spanning widely used QA datasets, and CAP-Statements, an 11k-example dataset for converting question-answer pairs into declarative statements for natural language inference (NLI) training and statement-based evaluation. Third, we introduce CAP (Context-Aware Precision), a reference-based metric that scores question-conditioned statements using bidirectional NLI. Under a monotonicity protocol testing whether metrics respect the taxonomy's intended ordering, CAP outperforms established baselines.
29. 【2609.01361】Investigating Linear Probe Robustness to Linguistic Register, Medical Specialty, and Corpus Shifts in Medical QA
链接：https://arxiv.org/abs/2609.01361
作者：Nishant Mishra,Ameen Abu-Hanna,Iacer Calixto
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language model, single forward pass, flag factual errors, Linear classifiers trained, language model
备注： Accepted to EMNLP 2026 (Main Conference). 9 pages, 4 figures (main text); 28 pages total, including appendix. Code and data: [this https URL](https://github.com/mnishant2/MedProbe_release)
点击查看摘要
Abstract:Linear classifiers trained on hidden states of a large language model (LLM), linear probes, can flag factual errors from a single forward pass. Geometrically, that implies that true and false statements separate along a stable direction in hidden state space, i.e., the truth direction. Prior work disagrees on whether this generalises across input shifts, but the disagreement is hard to interpret because cross-dataset probe transfer experiments confound several kinds of input change at once. We isolate three such variables in medical question-answering (QA): writing style (register), domain (medical specialty), and corpus (dataset). We build a benchmark using 500 MedQA entries, each rewritten into four styles (textbook, patient, clinical note, colloquial), annotated with clinical specialty, and grouped with two other exam corpora, MedMCQA and MMLU-medical, for cross-dataset evaluation. Probing four open-weight LLMs (2--8B), we find that the truth direction is largely robust to writing style (mean $\Delta_\text{register} \approx 0.10$ AUROC on held-out facts) and to medical specialty ($\Delta_\text{specialty} \approx 0.03$), but degrades unevenly across corpora: by $0.12$ AUROC on MMLU-medical and by $0.21$ on MedMCQA, roughly twice the register gap. The register result replicates with a second generator and carries over to human-written patient questions. The truth direction is therefore largely stable within the medical domain but breaks under some corpus shifts, and question format does not explain the break, which suggests that the signal a linear probe recovers is partly bound to dataset structure rather than to medical knowledge alone.
30. 【2609.01356】Separating Syntax from Language: A Mechanistic Account of Translation in Multilingual LLMs
链接：https://arxiv.org/abs/2609.01356
作者：Mikhail Sonkin,Tanja Baeumel,Daniil Gurgurov,Josef van Genabith,Simon Ostermann
类目：Computation and Language (cs.CL)
关键词：achieve strong performance, achieve strong, remains incomplete, strong performance, performance in machine
备注： Accepted to EMNLP Findings 2026
点击查看摘要
Abstract:Multilingual large language models (mLLMs) achieve strong performance in machine translation, yet our understanding of the mechanisms by which they transform representations from one language to another remains incomplete. Prior work suggests that translation decomposes into separable processes within an mLLM, where conceptual content is first represented independently, followed by a production into language-specific form. In this work, we show that translation is even more modular than previously assumed and that the output language production in translation processes is actually further separable into a syntax and a surface language process. We construct controlled multilingual datasets that isolate cross-linguistic differences in word-order and use causal interventions and probing to track how representations are transformed during translation. We find that models first construct target-side word-order before realizing the target language surface form. We identify individual attention heads that are selectively sensitive to syntactic transformations while remaining largely invariant to language identity. These results establish the commitment to a syntactic structure as an independent stage in translation, extending prior decompositions and showing how translation is implemented by functionally different components within mLLMs.
31. 【2609.01354】Where the Verifier Fails: A Category-Level Audit of Reward Signals in RLVR
链接：https://arxiv.org/abs/2609.01354
作者：Esther Xin
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：standard benchmark evaluation, Reinforcement learning, free text answer, verifiable rewards, binary reward
备注： 8 pages, 3 figures, 8 tables. Code, transform suite, contract matrix, and per-sample verdict records at [this https URL](https://github.com/ethxin0011/verifier-error-budget)
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) and standard benchmark evaluation both rely on an automatic verifier that turns a free text answer into a binary reward. Prior work reports that one evaluation harness accepts only about 94% of its own ground truth answers, blaming LaTeX parsing. That is an aggregate: it does not say which answer forms consume the error budget. We supply the decomposition. We apply metamorphic testing to the verifier rather than the model, generating certified equivalent answer variants, that is, rewrites that preserve mathematical meaning by construction, so that any rejection is a provable false negative needing no human adjudication. We then measure rejection per answer category across four widely used verifiers over 307,420 verdicts. We find three things. (1) Self validation ranges from 53.8% to 95.2% on identical inputs, a spread of 41.3 points. The published figure describes one implementation, not the task; two configurations of the same library disagree on 49.9% of pairs. (2) The residual is not spread across parsing categories but concentrated in whitespace and punctuation, which account for 93.0% of in contract failures for the default LaTeX configuration. A trailing period or newline dominates the budget. (3) Separating rejection from execution failure shows that verifiers with similar aggregate error fail for opposite reasons, and that a reference numeric cascade accepts off by one wrong answers as a step function of magnitude, from 0% below 10^4 to 100% at or above, because its relative tolerance is scale invariant.
32. 【2609.01352】CHARM: Character Hallucination for Multicultural Role Play Benchmark
链接：https://arxiv.org/abs/2609.01352
作者：Sunkyung Han,Nahyeon Park,Gaeun Seo,Seunghyun Yoon,JinYeong Bak
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Role-playing large language, Role-playing large, expected to adopt, Role-playing, character knowledge boundaries
备注： 16 pages, 1 figure. Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Role-playing large language models (LLMs) are expected to adopt a character's style while also respecting that character's knowledge boundaries. Prior evaluations detect character hallucination but rarely distinguish whether errors arise from failure to recognize a boundary or from failure to comply despite recognition. We introduce CHARM, a multicultural benchmark of 40 real and fictional characters drawn from five cultural-linguistic regions, and validated by native reviewers. It probes two boundary types, Temporal (historical vs. modern) and Cross-Universe (entities outside a character's narrative or historical universe), using abstention-enabled multiple-choice questions. We propose a two-stage evaluation that separates Boundary-Awareness (explicit recognition that a query is out of scope) from Boundary-Compliance (abstention when answering concrete questions). Evaluations across six LLMs show that hallucination is driven predominantly by compliance failures. Models frequently acknowledge that a query lies outside the character's knowledge yet still provide factual, out-of-character answers. By re-posing the same questions to the target character, we confirm that a large fraction of these cases are verified parametric overrides; the model stores the relevant fact but fails to suppress it. We also observe systematic cultural variation in these failures, consistent with imbalances in how characters from different regions are represented in model knowledge.
33. 【2609.01341】Probing Factual Knowledge Transfer with Training Data Interventions
链接：https://arxiv.org/abs/2609.01341
作者：Romina Oji,Marc Braun,Marcel Bollmann,Marco Kuhlmann,Jenny Kunz
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：multilingual language models, transfer factual knowledge, recall facts learned, facts learned directly, language models transfer
备注： Accepted at EMNLP 2026 Main Conference
点击查看摘要
Abstract:Do multilingual language models transfer factual knowledge across languages during continued pretraining, or do they mostly recall facts learned directly from the target-language data? To answer this question more reliably, we propose an intervention-based framework: starting from an English-pretrained model, we continue pretraining on Persian data from which specific facts have been systematically removed at varying levels of granularity. We construct SIFT, a resource of 500 triples across 20 relations, stratified by the cultural origin of each fact's subject into general (globally prominent) and Persian-related entities, designed for both systematic fact removal from training data and evaluation, with natively written Persian cloze templates. Our results show that fact transfer is very limited: under the strictest removal condition, a large majority of English-acquired facts fail to transfer into Persian. We further show that sentence-level co-occurrence removal is insufficient to eliminate fact signal, and that easier (randomly selected) negative candidate sets substantially inflate apparent transfer by rewarding shallow associative heuristics, while performance on a harder candidate set that allows for less reliance on heuristics is much lower. Finally, we show that source-language entity frequency has a large influence, with Persian-related facts, which are orders of magnitude rarer in the English corpus, hardly transferring.
34. 【2609.01325】VerTox: Verifiable Reward-Guided Corpus Poisoning Against Neural Ranking Models
链接：https://arxiv.org/abs/2609.01325
作者：Zhiqi Huang,Vivek Datla,Zhichao Xu,Puxuan Yu,Vivek Srikumar,Alfy Samuel
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：information retrieval systems, modern information retrieval, important building blocks, retrieval-augmented generation, retrieval systems
备注： EMNLP 2026 Main Conference
点击查看摘要
Abstract:Neural ranking models have become core components of modern information retrieval systems and important building blocks of AI systems such as retrieval-augmented generation (RAG) pipelines. However, their robustness remains insufficiently understood in the presence of large language models (LLMs), which can generate fluent and deceptive content at scale. This work investigates the vulnerability of neural ranking models to corpus poisoning attacks, in which an adversary injects a small number of maliciously crafted documents into the corpus to distort ranking behavior. We propose VerTox, the first framework to formulate corpus poisoning as a verifiable reward-guided reinforcement learning (RLVR) problem. By explicitly coupling ranking distortion with factual corruption through specialized reward shaping, we fine-tune compact LLMs into adversarial generators. Experiments demonstrate that our method achieves near-perfect attack success rates, producing adversarial documents that frequently rank higher than target documents across major neural ranking architectures, as well as a proprietary commercial embedding model. The generated adversarial documents are fluent and exhibit low perplexity, making them difficult to detect. Furthermore, by explicitly encouraging factual corruption, our adversarial documents significantly degrade the performance of a downstream RAG application.
35. 【2609.01322】Exploring Sparse Autoencoders in Text-Based Causal Confounding Adjustment
链接：https://arxiv.org/abs/2609.01322
作者：Mian Zhong,Katherine A. Keith,Anjalie Field
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：studying causal questions, causal questions based, questions based, data requires adjusting, confounding information
备注： Long paper accepted at EMNLP 2026 main conference, 25 pages, 16 figures
点击查看摘要
Abstract:In many settings, studying causal questions based on text data requires adjusting for confounding information within texts. Yet there is a tradeoff in constructing text representations for adjustment: they must be sufficiently large and/or dense to preserve the confounding variables necessary for unbiased effect estimation, but sufficiently small and/or sparse to satisfy finite-sample overlap and yield low-variance estimates. To address this tradeoff, we turn to sparse autoencoders (SAEs), and propose a novel causal adjustment pipeline that iteratively selects a minimal set of SAE features via conditional independence tests. We find that SAE representations achieve better adjustments (lower bias and and higher coverage) than alternative representations in standard semi-synthetic evaluations with binary confounders, and their interpretability offers opportunities for falsification. We also introduce a more realistic semi-synthetic evaluation that uses multi-label data as the unobserved confounders and find off-the-shelf adjustment methods require increased investigation for these more complex settings. Code: this https URL
36. 【2609.01318】Reliability Challenges in Diffusion Vision-Language Models
链接：https://arxiv.org/abs/2609.01318
作者：Md. Atabuzzaman,Chris Thomas
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Diffusion-based Large Vision-Language, Diffusion-based Large, Large Vision-Language Models, Large Vision-Language, bidirectional context
备注： EMNLP 2026 main conference
点击查看摘要
Abstract:Diffusion-based Large Vision-Language Models (dLVLMs) have recently emerged as a compelling alternative to autoregressive (AR) LVLMs, offering advantages in parallel decoding, bidirectional context, and controllable generation. Despite rapid progress, their reliability properties remain largely uncharacterized. We present the first systematic reliability evaluation of hallucination and bias in dLVLMs, benchmarking six diffusion models against competitive AR baselines across four dimensions. Our key findings are: (1) dLVLMs reverse the yes-bias of AR models in binary visual queries; (2) they achieve competitive hallucination rates yet exhibit degraded linguistic quality; (3) they collapse to near-zero accuracy on underrepresented racial groups with opposite-polarity gender bias; and (4) they exhibit accuracy collapse in multiple-choice settings when the correct option is shorter than its distractors, associated with a length prior that emerges at the first denoising step. Tokens committed at late denoising steps with low confidence further correlate with hallucinated content, pointing to a mechanistic signal unique to diffusion generation. These patterns vary across model families, suggesting reliability is shaped by the generative paradigm together with training data.
37. 【2609.01316】MIDR: Enrichment-Augmented Indexing for Multimodal Document Retrieval
链接：https://arxiv.org/abs/2609.01316
作者：Debanjan Mahata,Atharva Tendle,Daniel Preotiuc-Pietro,Yong Zhuang,Ozan Irsoy
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：plain OCR linearizes, OCR linearizes, visually rich documents, plain OCR, representation problem
备注： To appear in Proceedings of EMNLP 2026
点击查看摘要
Abstract:Retrieval over visually rich documents has a representation problem: important content often lives in tables, charts, figures, and layout relations that plain OCR linearizes, corrupts, or omits. ColPali-family visual retrievers address this with patch-level multi-vector indexes and late-interaction scoring, keeping image-derived retrieval on the query-time serving path. We introduce MIDR (Multimodal Indexing for Document Retrieval), a training-free framework for enrichment-augmented indexing that shifts multimodal reasoning to index time. During ingestion, a multimodal LLM converts rendered pages into verified textual fields that are indexed with BM25F and optionally fused with dense retrieval, enabling text-centric serving over multimodally grounded evidence. On ViDoRe V3, MIDR Hybrid achieves 0.6219 average nDCG across five English domains, a 23.0% relative gain over BM25, remaining competitive with ColQwen2.5. On two French-document domains, enrichment bridges English queries and French page text, lifting BM25 from 0.1532 to 0.5448 nDCG and outperforming ColQwen2.5. Across all seven domains, MIDR leads ColQwen2.5 on four while using approximately 9x smaller index memory and approximately 2x lower query latency. These results establish index-time multimodal reasoning as a compelling accuracy-deployment alternative to serving-time visual late interaction.
38. 【2609.01294】Explore Before Committing: Hypothesis-Guided Search for Deep Research Agents
链接：https://arxiv.org/abs/2609.01294
作者：Ruochen Zhou,Zhengyu Chen,Luan Zhang,Siyang Gao,Yee Whye Teh,Shiqi Chen
类目：Computation and Language (cs.CL)
关键词：single evolving trajectory, answer complex questions, agents answer complex, Deep-research agents answer, evolving trajectory
备注：
点击查看摘要
Abstract:Deep-research agents answer complex questions by interacting with search and browsing tools, yet they often search along a single evolving trajectory. Our trajectory-level analysis reveals a common failure mode in which the agent may encounter an early search state with several plausible directions, but follow one direction before collecting enough comparative evidence. Once this happens, subsequent tool calls tend to reinforce the same path, increasing the chance of failure when the initial direction is misleading. We further find that successful trajectories reduce this risk through two behaviors: grounding vague exploration in concrete candidates and shifting directions when the current path is weak or incomplete. Based on these findings, we propose HypoSearch, which generates lightweight hypotheses as soft search hints, explores them through bounded independent branches, and compares branch-level evidence before commitment. Across four deep-research benchmarks and three backbone models, HypoSearch consistently outperforms single-trajectory search and standard parallel baselines, improving Qwen3.5-122B from 46.7 to 60.0 on BC-small while using fewer tool calls than five independent trajectories. A pilot supervised fine-tuning study further shows that these behavioral signals can curate compact training trajectories and reduce degradation from unfiltered data.
39. 【2609.01279】Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models
链接：https://arxiv.org/abs/2609.01279
作者：Tian Fang,Gaël Guibon,Davide Buscaldi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：surface lexical cues, wide spectrum, entangled with content, surface lexical, lexical cues
备注： Accepted at EMNLP 2026 Findings
点击查看摘要
Abstract:Emotion is expressed in text along a wide spectrum, from surface lexical cues to inferences entangled with content. Most layer-wise analyses of emotion in LLMs use a single corpus, leaving open whether the depth at which emotion becomes accessible is a property of the model or also of the text source. We investigate this across three datasets spanning different degrees of explicitness and contextualization in emotion expression (Twitter posts, Reddit comments, and autobiographical narratives) and eight 1B--9B open-weight LLMs from the Llama, Qwen, and Granite families. We combine layer-wise probing with offline feature scaling and online forward interventions, transfer analyses, and an early-exit classifier. We find that (i) the best probing layer shifts systematically across corpora, from input-adjacent layers to over half model depth, and this ordering persists after matching label-by-length-bin distributions; (ii) across the evaluated settings, forward-pass interventions on probe-selected bands reduce test accuracy by 5--6 points more than same-width random bands ($q 0.01$); (iii) selected bands transfer across datasets and emotion categories, suggesting partially shared affective information rather than strictly per-emotion substrates; and (iv) probe-selected early-exit representations outperform full-depth exits by $6.9$ percentage points on average.
40. 【2609.01274】From Base Rollouts to RL Reasoning: A Budgeted Search Perspective
链接：https://arxiv.org/abs/2609.01274
作者：Wenhe Sun,Cunxiang Wang,Zijun Yao,Yixin Cao
类目：Computation and Language (cs.CL)
关键词：improves language-model reasoning, Reinforcement learning, search remains unclear, Unified Decoding Framework, verifiable rewards
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) improves language-model reasoning, but how these gains relate to inference-time decoding and search remains unclear. Does RL create reasoning the base model lacks, or shift the rollout distribution toward trajectories it can already reach but rarely samples? We study this behaviorally with a Unified Decoding Framework (UDF), which expresses token-level sampling, beam-like search, tree search, and sequence-level resampling as executable policies over a shared budgeted operating space, scored post hoc with pass@$k$, self-consistency, best-of-$N$, and first-finish success. Using paired Base/RL checkpoints from SimpleRL-Zoo, we ask whether an RL default-policy curve can be approximated by a structured path of Base operating points. On Math500, AIME, GPQA, and IFEval, the pass@$k$ recovery path follows a Budgeted Operating-Point Transition Rule (BOPTR), $N_{\mathrm{Base}} \approx \alpha N_{\mathrm{RL}}^{\beta}$, with benchmark-conditioned exponents. On Qwen2.5-7B, BOPTR gives the lowest transfer error among the non-oracle rules we test, 3.41 pp (95% CI [2.32, 5.53]); a three-seed replication gives 3.07 $\pm$ 0.39 pp. The rule extends to ten models across four families (3.28 to 4.87 pp on checkpoints added after fitting), to four benchmarks it was never fitted on (5.03 pp vs. 4.44 pp in fit), and holds without an RL checkpoint for the target model (4.19 pp) or without RL supervision of any kind (5.08 pp). These results support a qualified internalized-search reading: under the recipe we test, much of the measured RL gain corresponds to a change in sampling efficiency toward operating points the base model can already reach under search. We treat the scaling patterns as descriptive of this recipe and cohort, report where they break down, and use UDF and BOPTR as behavioral diagnostics rather than evidence of parameter-level equivalence.
41. 【2609.01271】What Does an Agentic Software Engineering Benchmark Measure? Profiling Task Demands and Agent Behaviour Beyond What Category Labels Reveal
链接：https://arxiv.org/abs/2609.01271
作者：Radin Shayanfar,Keheliya Gallaba,Ahmed E. Hassan
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：Agentic software engineering, nominal category labels, Agentic software, bug fix, feature implementation
备注：
点击查看摘要
Abstract:Agentic software engineering benchmarks are typically summarized by nominal category labels such as "bug fix" or "feature implementation," yet benchmarks carrying the same label are built through very different curation pipelines. A label thus reveals little about the engineering work a benchmark demands. We introduce the Spread--Novelty--Centrality (SNC) profile, a three-axis characterization of the demands of repository-level coding tasks, grounded in empirical software engineering research. We apply the profile to five widely used benchmarks and 14,922 trajectories of two model families at three scales, and report three findings. (1) A label is an unreliable proxy for task demands, as every pair of benchmarks is statistically separated on at least two SNC axes, and the separations trace back to specific curation decisions. (2) Agent behaviour reveals demands that the human-written gold solution cannot. Agents produce larger solutions than the gold where problem statements withhold hints and smaller ones where curation inflates the gold. How a task is phrased shapes what an agent produces. (3) Task demands correlate with success uniformly, with resolved runs concentrating in the low-SNC region for every family and scale, whereas the behavioural signatures of success are family-specific. Claude succeeds by matching the scope of the gold solution, and its parity share on files rises from $0.17$ at the smallest scale to $0.54$ at the largest. Qwen succeeds by exceeding the gold scope at every scale, and editing too little marks failure for both families.
42. 【2609.01246】Ready to Speak: Aligning LLMs for TTS-Friendly Text Generation
链接：https://arxiv.org/abs/2609.01246
作者：Thibaut Thonet,Jos Rozen,Laurent Besacier
类目：Computation and Language (cs.CL)
关键词：Current Large Language, Large Language Models, Current Large, Large Language, Language Models
备注： EMNLP 2026 - Main Conference
点击查看摘要
Abstract:Current Large Language Models (LLMs) are primarily optimized for written text, often producing outputs that are grammatically correct and helpful yet poorly suited for spoken delivery via Text-to-Speech (TTS). In this work, we study how to make LLMs natively generate TTS-friendly text, which we frame as a preference alignment problem: instead of relying on downstream rewriting modules, we directly align LLMs to generate text optimized for spoken delivery. We introduce two preference datasets spanning different target domains, CORA and Recipe, which contain paired TTS-friendly and TTS-unfriendly responses. We further propose an evaluation suite combining a pattern-based heuristic metric, a TTS$\to$ASR evaluation pipeline, and a MUSHRA listening study with human judges. Our experiments compare the recently proposed Feature-aware Sampling and Tuning (FaST) framework -- leveraging interpretable features instead of a black-box reward model -- against an array of alignment baselines on the TTS-friendly generation task. Notably, we found that FaST achieves the best overall tradeoff between TTS-friendliness and helpfulness across various settings. We also identified a strong correlation between our different metrics, highlighting the ability to reliably assess TTS-friendliness via an efficient heuristic.
43. 【2609.01244】Post-Training Science for Supervised Fine-Tuning
链接：https://arxiv.org/abs/2609.01244
作者：Charles O'Neill,Mudith Jayasekara,Harry Partridge
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：fine-tuning run forces, supervised fine-tuning run, chain of decisions, run forces, full fine-tuning
备注：
点击查看摘要
Abstract:Every supervised fine-tuning run forces the same chain of decisions, such as learning rate, batch size, LoRA or full fine-tuning, how many epochs, which optimiser, and what data to feed the model. Each of these is typically rediscovered from scratch for every new model and dataset. Here we measure them under one instrument: a sweep that varies one lever at a time, and spans dense and mixture-of-experts models in two families (Qwen3 and Llama), on four real-world customer SFT datasets, for both LoRA and full fine-tuning. These datasets give a controlled testbed: each task carries an evaluation built with the customer, and its training data is produced by iterative supervised fine-tuning that refines model outputs until they pass that evaluation, so the supervised target is internally consistent and the task judge we report against is the criterion the data was built to satisfy. We ask how the optimal learning rate and batch size move with model scale, family, and data, and whether one selection rule transfers across them; what LoRA trades against full fine-tuning, and how its rank and alpha set what the adapter can learn; whether validation loss (or other metrics, such as loss landscape flatness) faithfully ranks downstream quality; whether post-training gains scale with model size and data volume, on a model ladder extended through mixtures-of-experts to 235B parameters; how many epochs to train before general instruction-following erodes; and whether a geometry-aware optimiser improves on AdamW. Each recommendation is paired with a measure of its uncertainty.
44. 【2609.01202】owards AI-Assisted Clinical Trial Matching: Practical Considerations, Multicenter Evaluation, and Real-World Deployment
链接：https://arxiv.org/abs/2609.01202
作者：Yin Fang,Qiao Jin,Shubo Tian,Lauren He,Maya Geer,Noor Naffakh,Ryan Huu-Tuan Nguyen,Zifeng Wang,Jimeng Sun,Charalampos S. Floudas,James L. Gulley,Kamilia Moalem,Catarina Martins Maia,Amanda Nottke,Juan W. Valle,Melinda Bachini,Lourdes Rocha-Nussbaum,Kari Ramage,Nikita Curry,Megan Barnes,Mandy Mansaray,Darlene Gabeau,Craig E. Grossman,Heath Skinner,Michael Burczynski,NIH-TrialBench Consortium,Zhiyong Lu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：insufficient patient enrollment, advancing cancer care, drug development, essential for advancing, care and drug
备注： 43 pages, 12 figures
点击查看摘要
Abstract:Clinical trials are essential for advancing cancer care and drug development, but many fail because of insufficient patient enrollment. While there is growing interest in using AI to support patient recruitment, existing systems largely perform eligibility assessment alone and have rarely been evaluated in real-world oncology workflows. Here we present TrialGPT 2.0, an AI-assisted clinical trial recommendation system designed for real-world deployment. Rather than asking only whether a patient may qualify, the system also assesses which trials warrant further consideration given the patient's current clinical needs and local workflow priorities, and provides structured, inspectable explanations for expert review. Importantly, we evaluated TrialGPT 2.0 retrospectively and prospectively across multiple oncology-focused settings, spanning government, academic cancer-center, patient-advocacy, and NIH referral workflows. In retrospective multicenter cohorts comprising 288 cases, TrialGPT 2.0 retrieved at least one clinician-recommended trial in its top 10 recommendations for approximately 91% of cases while reducing clinician screening time by 55.0%. In a six-month prospective evaluation embedded in an active precision oncology tumor board, TrialGPT 2.0 contributed additional trial opportunities missed by the routine workflow, expanding patient access to clinical trial participation by 90.9%. To support scientific reproducibility, we also introduce NIH-TrialBench, a clinician-authored dataset comprising 126 diverse synthetic patient vignettes and matching scenarios from 11 NIH Institutes and Centers. Together, these results support the value of AI to assist clinical trial matching by improving clinician efficiency and identifying frequently overlooked trial opportunities, ultimately helping to expand and accelerate accrual to cancer trials.
45. 【2609.01198】FinLifeBench: Exhaustive Life-Event History and Financial-State Reconstruction from Longitudinal Banking Dialogue
链接：https://arxiv.org/abs/2609.01198
作者：Hangyeul Lee,Juyoung Oh,Jaeyong Ko,Sunmin Kim,Jaeik Park,Hyunkyu Kim,Jungmin Son,Pilsung Kang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Repeated banking interactions, interactions require assistants, banking interactions require, traceable customer records, Repeated banking
备注： 9 pages, 3 figures, 3 tables
点击查看摘要
Abstract:Repeated banking interactions require assistants to maintain complete, current, and traceable customer records as life changes emerge incidentally in routine requests. Existing benchmarks emphasize question answering, bounded episodes, or targeted recall rather than exhaustive longitudinal reconstruction. We introduce FinLifeBench, which evaluates two tasks over the same cumulative dialogue: reconstructing every life-event instance with its first-establishing session and reconstructing a complete 34-path financial state at consecutive checkpoints. The benchmark contains 6,000 eight-turn Korean banking sessions from 20 independent synthetic trajectories, with deterministic, exhaustive gold for 24 event types and 34 state paths and consensus quality assurance. Across eleven LLMs under a full-context condition, event-anchor recall falls from 0.591 at 15 sessions to 0.445 at 300. Errors are driven primarily by omitted events rather than poor anchor localization, while financial-state reconstruction frequently treats superseded or potentially outdated information as current; the best GCA@15 reaches 0.470. Performance on the two reconstruction tasks is only weakly associated. These results show that models can localize evidence for recovered events while still failing to maintain complete and temporally valid longitudinal records.
46. 【2609.01195】CaRL-EM: Cost-Aware Reinforcement Learning for Entity Matching with LLMs
链接：https://arxiv.org/abs/2609.01195
作者：Chaohui Guo,Michel Klein,Zhisheng Huang
类目：Computation and Language (cs.CL)
关键词：requires fine-grained contextual, fine-grained contextual understanding, Entity matching, requires fine-grained, fine-grained contextual
备注： Accepted to ACL 2026 Main Conference
点击查看摘要
Abstract:Entity matching (EM) requires fine-grained contextual understanding and domain knowledge. Recent work shows that large language models (LLMs) can serve as strong matchers across domains, but most methods either make independent pairwise decisions or rely on manually designed composite pipelines, thus lacking flexibility in realistic multi-candidate settings. At the same time, they typically ignore inference cost at scale. We formulate LLM-based EM with candidates as a cost-aware sequential decision problem and propose CaRL-EM, a reinforcement learning controller that manages LLM operations. Given the state of an anchor record, its candidate set, and the cost, CaRL-EM adaptively chooses among different operators (Match/Compare/Select/Decide) and model capacities to maximize a quality-cost objective. The policy interacts with abstract operators, allowing the same controller to be reused with different underlying LLM backends at inference time without retraining. Experiments on 7 benchmarks show that CaRL-EM (i) learns to dynamically plan the usage of inexpensive and expensive operators based on task complexity, (ii) achieves robust zero-shot transfer across diverse datasets and domains, and (iii) consistently achieves a better quality-cost trade-off than strong LLM-based baselines and manually designed pipelines, yielding a lower inference cost at comparable or higher quality.
47. 【2609.01188】PersuaRL: Reinforcement Learning-Driven Multi-Expert Selection for Persuasive Dialogue Generation in Insurance
链接：https://arxiv.org/abs/2609.01188
作者：Rohan Kirti,Akash Ghosh,Aryan Vats,Niladri Ghosh,Shipra Shriparn,Roshni Ramnani,Anutosh Maitra,Sriparna Saha
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, Language Models, conversational agents deployed, powering conversational agents
备注： EMNLP Findings 2026
点击查看摘要
Abstract:Large Language Models (LLMs) are revolutionizing digital communication by powering conversational agents deployed across domains such as customer service, digital sales, and insurance. These agents, built on LLMs, can understand user input, retrieve relevant information, and generate coherent responses. However, while they excel at factual communication, they often lack the ability to engage in truly persuasive, context-sensitive dialogue, especially in domains like insurance, where trust and clarity are critical. Building on this need within the insurance domain, our work focuses on improving the persuasiveness of digital agents, aka LLMs. To support this, we introduce InsureDial, a Persuasive Insurance Dialogue dataset, designed to capture the nuances of persuasive communication specific to motor insurance interactions. We introduce PersuaRL, a reinforcement learning-based framework that equips LLM-driven dialogue agents with the ability to adaptively explore, select, and coordinate strategies across multiple expert modules, guided by the evolving dialogue context, to achieve more effective persuasion. We conduct extensive automatic human and qualitative evaluations on two benchmark persuasion dialogue datasets, including our InsureDial. Our evaluations consistently demonstrate that PersuaRL outperforms baseline, generating contextually appropriate and highly persuasive responses.
48. 【2609.01182】LLMPEDIA: Browsing, Verifying, and Comparing the Parametric Encyclopedic Knowledge of LLMs
链接：https://arxiv.org/abs/2609.01182
作者：Muhammed Saeed,Simon Razniewski
类目：Computation and Language (cs.CL)
关键词：Flagship language models, fixed question sets, Flagship language, question sets, experimenter thought
备注：
点击查看摘要
Abstract:Flagship language models appear saturated on benchmarks like MMLU (Hendrycks et al., 2021), scoring above 90% - yet benchmarks test only what the experimenter thought to ask, the availability bias of fixed question sets. LLMPEDIA makes this bias measurable and browsable. We recursively materialized ~1.3M articles from three model families' parametric memory (GPT-5-mini, DeepSeek-V3.2, Llama-3.3-70B) without retrieval, then audited a stratified sample of atomic claims against Wikipedia and a curated web stack, coloring every claim supported, refuted, or insufficient (Saeed and Razniewski, 2026). On a uniform random sample the true rate is 68.4% - more than 21 pp below MMLU - with 30.5% of claims insufficient: assertions no benchmark probes and the world's largest encyclopedia cannot adjudicate - long-tail knowledge or plausible hallucination, the evidence cannot tell - extending to free text the coverage gap GPTKB established for triples (Hu et al., 2025). The resulting live, open encyclopedia lets visitors inspect this frontier one claim at a time through five one-click views - link-traversal exploration, claim-level factuality, cross-model and political-persona comparison, and a guided topic drill-down - each page, claim, and verdict at a stable URL. LLMPEDIA is live at this https URL
49. 【2609.01151】Subword Segmental BabyLMs: Learning to Tokenise for Sample-Efficient Pretraining
链接：https://arxiv.org/abs/2609.01151
作者：Francois Meyer
类目：Computation and Language (cs.CL)
关键词：preprocessing step, subword, training pipeline, tokenisation, training
备注：
点击查看摘要
Abstract:In the standard LM training pipeline, subword tokenisation is applied as a preprocessing step. Subword segmental language modelling is an alternative paradigm in which tokenisation is learned during training, allowing the model to discover subword units that optimise its training objective. In this paper, we present our submission to the 2026 BabyLM Challenge, for which we develop two new subword segmental LMs: SubSegGPT and SubSegDeBERTa. SubSegGPT is a decoder-only model that learns tokenisation during autoregressive pretraining. SubSegDeBERTa is an encoder-based model that jointly learns to generate and tokenise masked words. We train both for the Strict and Strict-small tracks. Our top submission to Strict is SubSegDeBERTa, which achieves notable gains in zero-shot evaluation. Our top submission to Strict-small is SubSegGPT, which outperforms tokenisation-based baselines. Our results show that learnable subword tokenisation can improve sample-efficiency for BabyLM pretraining. We analyse the subword learning dynamics of our models and find that tokenisation gradually converges on subword units that balance morphological alignment and fine-grained segmentation.
50. 【2609.01147】On the Design Fundamentals of Pixel Text Representation Learning
链接：https://arxiv.org/abs/2609.01147
作者：Chaohao Yuan,Ruifeng Yuan,Zhuoxu Huang,Yu Rong,Hong Cheng,Hou Pong Chan,Chenghao Xiao
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Text-rich visual inputs, inputs require models, compress language directly, fixed resolution pretraining, visual inputs require
备注： EMNLP 2026
点击查看摘要
Abstract:Text-rich visual inputs require models that can read, retrieve, and compress language directly in pixel space, yet existing pixel-text encoders struggle with fixed resolution pretraining, visual shortcut learning, weak visual grounding, and multilingual visual text understanding. In this work, we investigate the fundamental design principles required for robust visual text representation learning. Through systematic controlled ablations, we identify four critical components: variable image resolutions and rendered font sizes provide spatial proxies for high-resolution document generalization; natural image-text pairs are indispensable for grounding and prevent text-only collapse; layout-aware rendering helps prevent pixel-level shortcuts; and a two-stage multilingual curriculum enables effective cross-lingual alignment. By integrating these principles into a scalable training recipe, we train Pixel Linguist II, a native-resolution vision encoder trained with on-the-fly rendering, unified contrastive grounding, and a multilingual curriculum over 280M training examples. Pixel Linguist II sets new state-of-the-art results on English, cross-lingual, and multilingual Visual STS and ViDoRe, while also enabling better MLLM downstream evaluation. Notably, Pixel Linguist II remains robust under 80\% visual token compression, showing great promise for optical context compression. Our code and resources are available at this https URL.
51. 【2609.01139】Does task decomposition improve automatic NLG evaluation?
链接：https://arxiv.org/abs/2609.01139
作者：Sebastian Steindl,Nikos Voskarides,Alberto Gasparin,Diego Marcheggiani
类目：Computation and Language (cs.CL)
关键词：Natural Language Generation, reference-free Natural Language, Language Generation, Natural Language, reference-free Natural
备注： Accepted to EMNLP 2026
点击查看摘要
Abstract:The LLM-as-a-judge (LLMaJ) framework has emerged as a promising solution for cheap, reproducible, reference-free Natural Language Generation (NLG) evaluation. Prior work seeks to improve LLMaJ by decomposing evaluation tasks into simpler sub-tasks. In this work, we systematically compare LLMaJ methods with and without decomposition on multiple NLG datasets. We find no evidence that LLMaJ with task decomposition leads to performance gains over a fair baseline that does not use decomposition. Instead, we find that previously reported performance gains in decomposition-based LLMaJ stem from using human labels as training data, and not task decomposition itself. Also, we find that, when human labels are available, LLMaJ without using task decomposition can perform comparably to human annotators.
52. 【2609.01135】Overfitting Mitigation via Singular Value Decomposition in Minimum Bayes Risk Decoding
链接：https://arxiv.org/abs/2609.01135
作者：Riza Setiawan Soetedjo,Yusuke Sakai,Hidetaka Kamigaito,Katsuhiko Hayashi,Taro Watanabe
类目：Computation and Language (cs.CL)
关键词：Minimum Bayes Risk, Minimum Bayes, Bayes Risk, enables high-quality text, high-quality text generation
备注： Accepted to EMNLP 2026 Main
点击查看摘要
Abstract:Minimum Bayes Risk (MBR) decoding enables high-quality text generation by selecting the hypothesis that maximizes a utility metric over sampled pseudo-references. However, it is highly susceptible to metric overfitting: it can irregularly inflate the chosen utility metric at the direct expense of other unoptimized evaluation metrics. To mitigate this, we introduce SVD-MBR, which frames the pairwise utility matrix as a noisy information signal. By computing a low-rank approximation via Singular Value Decomposition (SVD) and retaining only the top-$k$ components, we effectively decouple true consensus from metric noise. Experiments demonstrate that SVD-MBR successfully regularizes decoding, yielding substantial gains across a range of generalized metrics. Furthermore, we reveal that this denoising is metric-dependent: neural metrics encode a robust low-rank consensus ideal for SVD, whereas surface-level metrics struggle to separate signal from metric noise.
53. 【2609.01117】Latent Recurrent Thoughts: Recurrent Refinement of Proposed Latents for Reasoning with Frozen LLMs
链接：https://arxiv.org/abs/2609.01117
作者：Zhaoliang Chen,Jie Fu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：discrete token space, errors propagate, committed as text, unfolds in discrete, discrete token
备注：
点击查看摘要
Abstract:Chain-of-thought reasoning unfolds in discrete token space: each step is committed as text, errors propagate, and eliciting good traces presupposes traces to imitate. Reasoning instead in a model's continuous representation space - where intermediate states are vectors rather than words - sidesteps these constraints, but leaves open how those latent states should be computed. We approach this along two axes. First, we keep a large language model (LLM) frozen and use it for what it is already good at - modeling and decoding sequences - while a small auxiliary network supplies continuous latent thoughts as input. Second, we produce those latents by recurrence: a tiny recurrent reasoner refines them over many steps, decoupling the depth of computation from the size of the model, so that the latents are a product of iterative processing rather than a single forward pass. We instantiate this as Latent Recurrent Thoughts (LRT): a task-dedicated proposer supplies base latents, a recurrent reasoner refines them through bounded residual corrections, and the frozen LLM decodes the answer. On symbolic reasoning with answer supervision but no reasoning traces (Countdown-4, Sudoku) and on natural-language reasoning (HumanEval, MBPP, StrategyQA), LRT substantially outperforms prior frozen-decoder continuous-space reasoning methods under an identical decoder, prompt, data, and training budget, and outperforms non-thinking-mode chain-of-thought prompting on the same backbone at a small fraction of its inference compute.
54. 【2609.01113】EDRAC: Benchmarking Arabic Dialect Reading Comprehension
链接：https://arxiv.org/abs/2609.01113
作者：Noor Abo Mokh,Kirill Chirkunov,Teresa Lynn,Nizar Habash,Reham Marzouk,Malik H. Altakrori,Younes Samih,Muhammed Abu Odeh,Nour Rabih,Rahaf Alshahrani,Hamad Alshehhi,Hamdan Al-Ali,Muhra Almahri,Besher Hassan,Mohamed Anwar,Abed Alhakim Freihat,Preslav Nakov,Alham Fikri Aji
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Modern Standard Arabic, Modern Standard, remains under-resourced compared, compared to Modern, Standard Arabic
备注：
点击查看摘要
Abstract:Dialectal Arabic (DA) remains under-resourced compared to Modern Standard Arabic (MSA), particularly for machine reading comprehension (MRC) and question answering (QA). Existing Arabic QA benchmarks primarily focus on formal written MSA or multiple-choice QA, with limited coverage of naturally spoken dialects. Here, we aim to bridge this gap. We introduce EDRAC, the first large-scale benchmark for dialectal Arabic machine reading comprehension (MRC) and generative QA, covering five major dialects: Egyptian, Moroccan, Emirati, Syrian, and Saudi Arabic. EDRAC contains 499 passages derived from naturally occurring spoken interactions and 4,977 corresponding QA pairs generated through a human--LLM collaborative pipeline combining iterative generation, LLM-as-a-judge evaluation, and human verification. We benchmark Arabic-centric and multilingual LLMs on EDRAC using lexical and semantic metrics. Our results reveal substantial gaps between semantic answer quality and dialectal fidelity, highlighting the limitations of existing evaluation metrics for dialectal Arabic generation. EDRAC provides a realistic and challenging MRC benchmark for future research on dialectal Arabic NLP.
55. 【2609.01111】ClinTraceBench: Source-Verifiable Longitudinal Clinical Reasoning over EHR-Derived Dialogues
链接：https://arxiv.org/abs/2609.01111
作者：Huimin Wang,Zhengyi Zhao,Yutian Zhao
类目：Computation and Language (cs.CL)
关键词：Clinical LLM assistants, longitudinal signal clinical, signal clinical reasoning, Clinical LLM, textit
备注： Findings of EMNLP 2026
点击查看摘要
Abstract:Clinical LLM assistants must reason over multi-visit patient trajectories, yet whether the compact history representations used to scale them---retrieval, structured timelines, LLM summaries, agentic memory---preserve the longitudinal signal clinical reasoning needs has not been measured. We introduce ClinTraceBench: 385 MIMIC-IV-derived verified dialogues with event-ID provenance, a nine-task taxonomy (T1--T9), and L0--L4 deterministic + L5 human-audit validation (98.92\% agreement). We evaluate eight history representation strategies---a no-context floor, \textit{last-visit-only}, \textit{full-context}, BGE-M3 \textit{dense-retrieval}, two compression schemes, and two agentic-memory systems (\textit{Mem0}, \textit{A-Mem})---across four backbones (DeepSeek-V3, GPT-4o-mini, Haiku~4.5, Sonnet~4.6) on 6{,}271 questions: 32 cells, 200{,}672 predictions. Four findings: (SP4) a controlled T3 injection probe isolates compression-induced \textit{relation} loss---with the attribution sentence present \textit{before} construction, \textit{Mem0}, \textit{A-Mem} and \textit{llm-summary} still recover only 0--5.3\% of the injected positives; (SP1) compressed strategies pay an aggregation tax on multi-visit trends and cross-patient comparisons; (SP2) the blind-to-full gap spans $+29.8$~pp (GPT-4o-mini) to $+62.7$~pp (Haiku); (SP3) abstention scales non-monotonically with context length. On the Pareto frontier Haiku dominates Sonnet under \textit{full-context} (\$25.76 vs.\ \$106.21), inverting the ``biggest backbone wins'' heuristic.
56. 【2609.01106】Hints Help But Do They Teach? Evaluating Skills Transfer in Code Generation
链接：https://arxiv.org/abs/2609.01106
作者：Will Badr
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：failing generated program, provide missing information, turns a failing, failing generated, generated program
备注：
点击查看摘要
Abstract:When a hint turns a failing generated program into a passing one, does it provide missing information or merely steer the model toward a solution it could already produce? We test these hypotheses on HumanEval+ and MBPP+ using executable evaluation. For Qwen2.5-3B-Instruct, adaptive relevant hints rescue 36 of 79 selected failures; an unrelated hint rescues 19, while eight unhinted samples solve 46 and recover 31 of the 36 relevant-hint rescues. Phi-3.5-mini shows the same pattern: relevant hints rescue 42 of 101 failures, an unrelated hint rescues 17, and unhinted sampling solves 57, including 36 of the 42 relevant-hint rescues. Because the hint conditions use different attempt budgets, these comparisons do not isolate a purely semantic effect. Mechanistic tests on Qwen identify a stable activation direction shared by relevant and unrelated hints. Persistently adding this direction yields 14 rescues and 18 regressions, with no detectable net accuracy gain; learned low-rank interventions have a positive but imprecise estimated effect. Full textual specifications solve 22 of 24 context-defined problems, versus 5-11 for tested virtual-KV prefixes. Post-generation hidden-state probes transfer across benchmarks, with pooled AUROC 0.806 and 0.780, but their top-one selection advantage over token confidence is statistically unresolved. Overall, relevant hints can rescue failures, but most rescued solutions are already reachable through ordinary sampling, and the internal interventions tested here do not establish task-general capability transfer.
57. 【2609.01103】When Modality Gap Reduction Fails: Prediction-Level Hubness in CLIP
链接：https://arxiv.org/abs/2609.01103
作者：Shota Sato,Hajime Kiyama,Tosho Hirasawa,Mamoru Komachi
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：widely expected, Reducing, gap, Reducing the modality, correction
备注： Accpeted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Reducing the modality gap between image and text representations in CLIP is widely expected to improve cross-modal alignment and downstream performance. However, a smaller average image-text gap does not necessarily lead to consistent accuracy gains. We analyze this mismatch from the perspective of the decision structure in zero-shot classification, i.e. selecting the most similar class-text prototype for an input image. Zero-shot accuracy depends not only on average image--text alignment, but also on class-wise decision margins. Using Linear correction as an analytically tractable case, we show that modality gap correction can alter the relative decision structure among classes and cause predictions to concentrate on a small subset of classes. We refer to this output-space failure mode as prediction-level hubness. Furthermore, experiments across multiple datasets show that accuracy degradation under gap correction is consistently associated with increased prediction concentration, both for Linear correction and for learning-based correction methods. This provides a systematic explanation of why modality gap reduction does not consistently improve CLIP zero-shot accuracy from the perspective of downstream decision structure. Our results suggest that gap correction should be evaluated not only by average alignment, but also by its impact on downstream prediction structure.
58. 【2609.01100】Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts
链接：https://arxiv.org/abs/2609.01100
作者：Nikolaos Xiros,Dimitrios Damianos,Maria-Eleni Zoumpoulidi,Leon Voukoutis,Vassilis Katsouros,Georgios Paraskevopoulos
类目：Computation and Language (cs.CL)
关键词：limiting expert specialization, Exponential Moving Average, Contrastive Routing Mechanism, performed based, based on representations
备注： Accepted to EMNLP 2026. 14 pages, 7 figures
点击查看摘要
Abstract:In current Mixture-of-Experts architectures, routing is performed based on representations dominated by structure shared across all tokens, limiting expert specialization. We show that contrasting each token against an Exponential Moving Average of the layer's hidden states, rather than routing on absolute magnitude, concentrates the routing signal onto a low-dimensional, highly separable subspace. Building on this, we propose the Contrastive Routing Mechanism (CoRM), which scores each expert by the gap between its affinity for the incoming token and its affinity for this shared reference state, interpreted through a distinct per-expert projection. The resulting experts have routing boundaries that align with linguistic structure significantly more than the Top-k baseline. Our experiments show that CoRM improves average zero-shot accuracy by +0.67 to +1.69 points (Top-1) and +1.38 to +1.77 points (Top-2) over standard Top-k MoE baselines on nine zero-shot reasoning benchmarks, at the minimal cost of 2.9% added parameters and 2.6% added FLOPs per token.
59. 【2609.01081】StateSwap: Probing Support-Elimination Hidden States in Multiple-Choice Questions
链接：https://arxiv.org/abs/2609.01081
作者：Chao Gao,Haijiang Liu,Qiyuan Li,Caicai Guo,Frank van Harmelen,Jinguang Gu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, multiple-choice question inconsistently, Large language, multiple-choice question, question inconsistently
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Large language models often answer the same multiple-choice question inconsistently when it is posed under support-oriented and elimination-oriented framings. We investigate whether these discrepancies arise from different internal representations induced by the two framings. We introduce a dual-framing protocol with minimally varied prompts that use either support- or elimination-oriented framing while keeping the evaluation target fixed. To probe the internal computation, we append an untrained special token, [STATE], and treat its residual-stream activation as an intervention interface. Across both models, the two framings induce separable [STATE] activations concentrated in intermediate layers. Swapping these activations between paired prompts systematically changes predictions and improves cross-framing agreement, providing intervention-based evidence that the activations are behaviorally relevant. Beyond instance-level substitution, mean-difference steering directions derived from the dual-framing contrast exhibit more bounded layer-wise responses than matched contrastive activation addition directions under the evaluated protocol.
60. 【2609.01073】Post-hoc Alignment of LLM-judges to Human Judgment Distribution
链接：https://arxiv.org/abs/2609.01073
作者：Sebastian Steindl,Nikos Voskarides,Alberto Gasparin,Diego Marcheggiani
类目：Computation and Language (cs.CL)
关键词：Human Label Variation, framework offers, offers a cost-effective, cost-effective and reproducible, reproducible solution
备注： Accepted to EMNLP 2026
点击查看摘要
Abstract:The LLM-as-a-judge (LLMaJ) framework offers a cost-effective and reproducible solution for automatic evaluation. However, current evaluation practices typically compare LLMaJ judgments against aggregated ground-truth labels, overlooking the valuable information contained in Human Label Variation (HLV). Inspired by an increasing line of work that proposes to leverage HLV, we systematically study LLMaJ performance on predicting both a single, aggregated ground truth hard-label and unaggregated soft-labels that represent Human Judgment Distributions (HJD). Our results across five diverse datasets reveal that while LLMs achieve near human-level performance at hard-label prediction on most tasks, they exhibit poor performance when predicting soft-labels. To address this limitation, we propose NAPHA (eNtropy-Aware Post-Hoc Alignment), a simple yet effective lightweight post-hoc alignment method that matches the LLM distribution to the HJD by first assigning an instance to a discrete entropy class and then routing it to specialized, trained alignment models. We find that NAPHA consistently improves soft-labels prediction across base LLM models and datasets, with particularly strong gains on high-entropy instances where capturing diverse human perspectives is most critical. We also show via oracle experiments that improving entropy class prediction can substantially enhance NAPHA's practical effectiveness.
61. 【2609.01068】OUTLETS: Output-Length Prediction from Speculative Decoding Backbones
链接：https://arxiv.org/abs/2609.01068
作者：Weihuang Wen,Yingying Liu,Yichuan Liu,Wenqi Zeng,Li Zhou,Chumin Sun,Jie Sun,Tianshu Yu
类目：Computation and Language (cs.CL)
关键词：Large Language Model, Large Language, poses major challenges, Language Model, serving poses major
备注： Accepted to EMNLP 2026
点击查看摘要
Abstract:The heavy-tailed distribution of output lengths in Large Language Model (LLM) serving poses major challenges for resource provisioning and cluster scheduling. Although output-length prediction can mitigate these issues, existing approaches have key drawbacks: external proxy models add substantial latency and often have limited fidelity, whereas internal state-based methods are efficient but rely on shallow probes of current model states. We identify a structural connection between speculative decoding (SD) and length prediction: latent representations produced by the draft decoder in advanced frameworks (e.g., EAGLE-3) encode signals that are predictive of generation length. Building on this insight, we introduce OUTLETS (Output-Length Prediction from Speculative Decoding Backbones), which repurposes the speculative backbone as a trajectory-aware length predictor. When its draft representations are already computed for speculative decoding, OUTLETS adds only a lightweight regression head and achieves lower MAE than the evaluated methods. Under saturated disaggregated serving, OUTLETS predictions enable standard scheduling policies to prioritize shorter requests and distribute requests more evenly across decoding instances, reducing short-request P99 latency by 34.8%.
62. 【2609.01056】WorldBench: Culturally Grounded Benchmark for Multilingual Agents
链接：https://arxiv.org/abs/2609.01056
作者：Leonardo Ranaldi,Sherrie Shen,Jushi Kai,Alexandra Birch
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：rarely test state, existing benchmarks rarely, benchmarks rarely test, test state preservation, solve multi-step tasks
备注：
点击查看摘要
Abstract:Despite the growing use of LLM-powered agents to solve multi-step tasks in complex environments, existing benchmarks rarely test state preservation, performance across languages, and application to realistic, grounded scenarios. To address these concerns, we present WorldBench: a comprehensive, multilingual benchmark of genuine, persona-grounded everyday workflows, where agents can act in a sandbox via structured actions. WorldBench comprises 1,600 tasks across seven languages and eight cultures, filtered and refined through feedback from human annotators with language- and culture-specific expertise. For evaluation, we extend metrics from previous works and introduce Constrained Task Success (CTS), which combines natural language instructions and testbeds to score task completion, minimal modification, and other complementary metrics through deterministic and LLM-as-a-Judge evaluations. Our experiments show that frontier models reach only 49.2% CTS, with all models demonstrating large gaps between correctness and environment preservation. We thereby show that current agents remain brittle in multilingual, agentic scenarios, especially for long-horizon tasks and under state-preservation constraints
63. 【2609.01048】Lagged Coupling: Internal Representations Become Readable Before They Become Causal
链接：https://arxiv.org/abs/2609.01048
作者：Xining Xun
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：full Pythia suite, Pythia suite, full Pythia, reading direction remains, model-checkpoint cells
备注： 15 pages, 5 figures, 7 tables. Pre-registered developmental interpretability study on the full Pythia suite with an OLMo-2 replication
点击查看摘要
Abstract:Across the full Pythia suite (160M-12B, eight checkpoints, four task families), a linear probe can read a target variable from the residual stream as early as step 1,000 at every scale -- yet steering along that same reading direction remains null-equivalent in 43 of 48 model-checkpoint cells. Internal readability systematically outruns causal efficacy, and the lag does not shrink with scale. We call this structure lagged coupling and decompose it into three dissociable tracks: (i) internal readability, saturated (AUROC = 0.990) from the first checkpoint everywhere; (ii) behavioral readability, which develops gradually and progressively later at larger scales (12B reaches 0.909 only at the final checkpoint); (iii) causal efficacy, almost always null-equivalent, occasionally counterproductive early, with one isolated positive pulse (12B, step 8,000, z = +2.49) our grid cannot resolve. The ordering is dominantly read-before-write (11/11 units, no inversion). Representation headroom along the probe direction grows up to 57x with training and scale while causal write-in stays below 0.11% of headroom -- the variable is increasingly written into the representation and increasingly ignored by the readout. Under a fully pre-registered protocol, both single-onset hypotheses resolve INDETERMINATE (scale slope +0.24, 95% CI [-0.60, +0.87]; time vote 3:3) -- a disciplined negative explained by the three-track decomposition. A pre-registered OLMo-2 replication preserves the direction at attenuated magnitude. Our results caution against inferring steerability from probe accuracy and establish a developmental bottleneck: representation formation reliably outpaces causal readout consolidation.
64. 【2609.01024】PCoMoE: Shifting MoE Inference from Monolithic Expert Selection to Fine-Grained Path Composition
链接：https://arxiv.org/abs/2609.01024
作者：Ziyan Gan,Fangxin Liu,Chenyang Guan,Junjie Wang,Ning Yang,Haomin Li,Xiang Li,Siran Yang,Jiamang Wang,Lin Qu,Zongwu Wang,Li Jiang,Haibing Guan
类目：Computation and Language (cs.CL)
关键词：scale Large Language, architectures scale Large, Large Language Model, Large Language, scale Large
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Mixture-of-Experts (MoE) architectures scale Large Language Model (LLM) capacity efficiently by activating a sparse subset of experts per token. However, modern MoE inference remains heavily constrained by the rigid, whole-expert abstraction. Existing frameworks manage, schedule, or prune experts as atomic execution units, which fixes the optimization boundary too early and leaves fine-grained intra-expert computational redundancy underexplored. In this work, we present PCoMoE, a path-compositional execution framework that shifts MoE inference from coarse-grained expert selection to fine-grained path composition. PCoMoE incorporates a path-level formulation of expert computation, a compatibility-aware layer-wise pruning strategy to suppress low-value path combinations, and a hardware-friendly execution engine to exploit reusable sub-expert structures under strictly bounded overheads. Experimental results demonstrate that PCoMoE achieves up to a 1.31x end-to-end inference speedup while enhancing model accuracy by 10%. The code is available at this https URL
65. 【2609.01016】Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speech
链接：https://arxiv.org/abs/2609.01016
作者：Che Hyun Lee,Sangkwon Park,Donghun Kang,Dongwook Lee,Youngho Cho,Heeseung Kim,Sungroh Yoon
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Current speech synthesis, speech synthesis struggles, Current speech, struggles with code-switching, primary language utterance
备注： Accepted to EMNLP 2026 (Main Conference). Demo: [this https URL](https://saga1214.github.io/PhraseLocalizedLCG/)
点击查看摘要
Abstract:Current speech synthesis struggles with code-switching, which mixes a foreign language phrase into a primary language utterance, causing the phrase to be spoken with the primary language's accent rather than its native one. We propose Phrase-Localized Language-Contrastive Guidance (LCG), a training-free inference framework that restores a native accent to code-switched phrases in cross-lingual text-to-speech. LCG replaces the single language guidance applied across the whole utterance with a separate guidance for each region, so each part is guided by its own language. To choose where to apply this localized guidance, we propose a self-attention probing technique that finds the phrase boundaries without external alignments. Together, these components generate speech in which each region carries the accent of its own language, requiring no fine-tuning or auxiliary models. Across diverse language pairs, LCG robustly increases the nativeness of the code-switched phrase while suppressing accent leakage, and preserving overall speaker identity and naturalness.
66. 【2609.01004】SinkPruner: Sink-Free Visual Token Pruning for Multimodal Large Language Models
链接：https://arxiv.org/abs/2609.01004
作者：Shiyu Li,Zi-Yuan Hu,Shijia Huang,Yanyang Li,Yiwu Zhong,Liwei Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：multimodal understanding ability, strong multimodal understanding, incur substantial computational, substantial computational overhead, processing long visual
备注： EMNLP 2026 (findings)
点击查看摘要
Abstract:Despite their strong multimodal understanding ability, multimodal large language models (MLLMs) incur substantial computational overhead when processing long visual token sequences. To reduce inference costs, recent studies have explored visual token pruning through vision-centric or text-guided strategies. However, these methods often overlook high-norm outlier tokens, i.e., tokens with abnormally large feature norms, leading to suboptimal pruning decisions. In this work, we show that such high-norm outlier tokens are highly redundant in both feature and spatial dimensions, yet are often mistakenly preserved as informative cues by existing methods. Motivated by this observation, we propose SinkPruner, a training-free visual token pruning framework for efficient MLLM inference. SinkPruner follows a coarse-to-fine design with two key modules: a visual sanitizer that filters high-norm redundancies and alleviates attention sink and attention dispersion, and a text-guided pruner that further retains tokens semantically aligned with the text query. Extensive experiments on twelve image-language and four video-language benchmarks demonstrate the effectiveness, efficiency, and generalizability of our framework. Notably, SinkPruner preserves 96.5% (91.8%) of the original performance of LLaVA-1.5 (Qwen2.5-VL) under an 89% token reduction. Experiments further indicate that our visual sanitizer exhibits promising transferability in enhancing the performance of existing pruning methods. Our code is available at this https URL.
Comments:
EMNLP 2026 (findings)
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2609.01004 [cs.CV]
(or
arXiv:2609.01004v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.01004
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
67. 【2609.00999】Right Frame, Wrong Rule: Cultural Cues Expose the Financial Knowledge Gap They Were Meant to Close
链接：https://arxiv.org/abs/2609.00999
作者：Rania Elbadry,Ahmed Heakl,Saeed Almheiri,Fan Zhang,Muhra AlMahri,Xueqing Peng,Mohsinul Kabir,Shuyao Wang,Yi Han,Saadeldine Eletter,Duzhen Zhang,Preslav Nakov,Yuxia Wang,Fajri Koto,Zhuohan Xie
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：question has valid, framework, valid answers, answer correctly, cultural cues
备注： Accepted into EMNLP 2026 Findings
点击查看摘要
Abstract:When a question has valid answers under different normative frameworks, a language model must decide which framework to use and whether it can answer correctly within it. We call this setting normative pluralism and study it in Islamic finance using a four-choice taxonomy that separates framework selection from within-framework correctness. This separation reveals the stereotype trap: a cultural cue steers a model toward one framework, but the model selects an incorrect answer within that framework. Across twelve models, two languages, and fifty demographic signals, cultural cues change framework selection and reveal substantial differences in accuracy, especially among non-frontier models. Under the strongest signal, large open-weight models select the Islamic framework 97% of the time. A two-choice evaluation would report near-perfect alignment, although 57--66% of those selections are incorrect. These findings motivate, but do not directly test, the competence-conditioned routing hypothesis: models may favor frameworks where they are more accurate, while cultural cues may expose framework-specific competence gaps.
68. 【2609.00998】Inspicio: Open-Vocabulary, LLM-Based Sense Retrieval for Historical Languages
链接：https://arxiv.org/abs/2609.00998
作者：Michele Ciletti
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Word Sense Disambiguation, well-resourced modern languages, Word Sense, Sense Disambiguation, Disambiguation has advanced
备注： 12 pages, 1 figure
点击查看摘要
Abstract:Word Sense Disambiguation has advanced rapidly for English and a handful of well-resourced modern languages, but it continues to assume the existence of a sense inventory and a word-to-sense mapping in the source language (Navigli, 2026). These assumptions break down for most historical and low-resource languages, whose dedicated WordNets are either incomplete or still under construction. We present Inspicio, an open-vocabulary retrieval pipeline that links tokens in context to synsets of the Open English WordNet (McCrae et al., 2020) without requiring any source-language inventory or mapping. For each occurrence, an instruction-tuned LLM produces two English translations of the surrounding sentence, a small set of candidate dictionary-style definitions, and a few candidate English lemmas. These outputs drive a hybrid retrieval step that combines dense definition-synset similarity, sparse lemma matching, and Maximal Marginal Relevance re-ranking. We evaluate the pipeline across a 6x6 grid of LLMs and sentence-embedding models on a new bilingual set of manually annotated Latin and Ancient Greek perception verbs, on a subset of PREMOVE dataset (Farina, 2025), and on a diachronic sample of Italian. The best configuration reaches 96% Recall@50 on the perception-verb test set, with each component contributing measurable gains, and remains competitive in the out-of-domain and cross-lingual settings.
69. 【2609.00982】Disclosure-Gated User Simulation for Companion-Agent Evaluation
链接：https://arxiv.org/abs/2609.00982
作者：Yao Liu,Yu He
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：large language model, scalable evaluation, large language, standard in scalable, user
备注：
点击查看摘要
Abstract:Using a large language model to play the user is now standard in scalable evaluation. It has a repeatedly diagnosed failure: the simulated user is excessively cooperative, so a system under test can score by the sheer number of questions it asks rather than by making the user willing to speak. We answer with a disclosure gate conditioning information release on the companion agent's behaviour: its state is a ladder of five ordered gates, merged onto three observable depth layers. We specify, ablate, and audit it, and train a user simulator against that specification. Gating behaviour is learned from the training corpus's synthetic branch, while the real branch supplies how people speak and react; after training, the simulator need not be told at runtime which gate each item sits behind. The gate is a load-bearing component of the environment: on the English corpus of a published companion-agent benchmark (CompanionBench), once training no longer states per example which gate each item sits behind, the largest rank displacement across 12 systems under test exceeds the noise band set by re-running that environment under a new seed, while per-system scores show no detectable change. We state two acceptance criteria: a ranking must be order-preserving, and absolute scores must be scale-stable. Of the candidates we examine, only one passes both -- the simulator we release -- and its leaderboard correlates at 0.993 with the benchmark's original simulator. By contrast, prompting a frontier model as the simulator barely moves the ranking while shifting every score upward -- a shift invisible to anyone checking the ranking alone. The environment we specify is the one that benchmark already used. That publication describes the mechanism in about four hundred words, and we supply what it lacked: specification, ablations, human studies, negative controls, and downstream sensitivity analysis.
70. 【2609.00958】PersianAnonymizer: Evaluating LLM-Labeled Training for Efficient NER-based Anonymization in Persian
链接：https://arxiv.org/abs/2609.00958
作者：Mohammad Hossein Shalchian,Mostafa Amiri,Amir Mahdi Sadeghzadeh
类目：Computation and Language (cs.CL)
关键词：Persian customer chats, compact NER model, labeler for deployment, customer chats, chats by training
备注： 10 pages, 3 figures, 6 tables. Published at LREC 2026
点击查看摘要
Abstract:We target practical anonymization of Persian customer chats by training a compact NER model from LLM-labeled supervision and selecting the best labeler for deployment. We compare three instruction-tuned LLMs: DeepSeek-V3-0324, GPT-OSS-120B, and Qwen3-235B-A22B-Instruct-2507, to produce span annotations under a shared JSON protocol, yielding four corpora (OSS_ZeroShot, Qwen_ZeroShot, Qwen_FewShot, DeepSeek_FewShot). A MatinaRoberta-based token-classifier is trained per corpus and evaluated with token-level Precision/Recall/F1 (overall and per-class). We also report Label Coverage Recall (LCR), the proportion of gold non-O tokens predicted as non-O, and quantify cross-labeler behavior via a token-level Venn on test annotations. Finally, we contrast test-set annotation latency of the LLMs on H200 nodes with the trained NER's test-time labeling on a single RTX 3090. Results show that supervision from OSS_ZeroShot yields the strongest macro-F1 and LCR, while the resulting NER labels an entire 40K-message test set in approximately 2 minutes on one consumer GPU. This establishes a practical path to high-quality, low-cost anonymization for Persian industrial data.
71. 【2609.00949】Calibration is the Bottleneck: An Action-Class Diagnostic of Multi-Turn Tool-Calling
链接：https://arxiv.org/abs/2609.00949
作者：Kangjia Zhao,Jiajun Li,Haozhan Shen,Wei Chow,Linfeng Li,Hang Song,Lingdong Kong,Chen Zhi,Tiancheng Zhao,Songhua Liu,Jianwei Yin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Multi-turn tool calling, LLM, tool calling, Gold Action Recall, Multi-turn
备注： Accepted to Findings of EMNLP 2026. Code: [this https URL](https://github.com/fbj2333/tool-calling-calibration)
点击查看摘要
Abstract:Multi-turn tool calling is a core evaluation scenario for large language model (LLM) agents. On public tool-calling benchmarks, open-weight models now approach or even surpass closed-source frontier models in aggregate accuracy. However, this metric averages over many different multi-turn situations and obscures whether progress is balanced across them. We propose an action-class-oriented diagnostic framework that decomposes multi-turn failures into two orthogonal modes: action-class miscalibration and action-execution failure. The framework operates over a four-class action space (TOOL_CALL/ASK/REFUSE/CONFIRM) and introduces a self-revealing upper bound Acc = GAR (Gold Action Recall); the two modes show up as bound violation (Acc GAR, exposing state-grader masking of miscalibration) and large bound slack (GAR Acc, localizing execution failure within TOOL_CALL). We validate it on a panel of tool-calling models across multiple multi-turn benchmarks. Across our panel, the diagnostic reveals action-class miscalibration as a substantial failure mode the state grader cannot see. This gap inflates standing for heavily tool-trained families, which our diagnostic separates from families with context-appropriate action choice. Calibration is reshapable through context-only perturbations, but the reshape is heterogeneous: a single perturbation moves accuracy in opposite directions across families (up to +11.5 vs -21.0 pp on the same scenario), and its effect further depends on the perturbation mechanism. We argue that multi-turn tool-calling evaluations should supplement aggregate accuracy with action-class diagnostics that expose what the model actually does in each scenario.
72. 【2609.00948】From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understanding
链接：https://arxiv.org/abs/2609.00948
作者：Raul Ortega,José Manuel Gómez-Pérez
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：demonstrated strong performance, natural images, demonstrated strong, scientific, strong performance
备注： Published as a conference paper at COLM 2026
点击查看摘要
Abstract:Vision-language models (VLMs) have demonstrated strong performance in visual question answering with natural images. However, they continue to struggle with scientific diagrams, which are designed to convey functional or relational meaning rather than literal scenes. We therefore introduce a framework for generating large-scale diagram-grounded instruction data by leveraging terminology derived from scientific curricula. Our approach systematically extracts domain concepts, synthesizes atomic facts, retrieves relevant diagrams from the web, and generates multimodal supervision in the form of diagram captions and multiple-choice questions. Using this pipeline, we construct SciGram, a dataset of over 194K diagrams and 1.4M visual instructions across life, earth, and physical sciences. Despite relying on noisy web data and synthetic annotations, models fine-tuned on SciGram achieve substantial improvements on diagram-centric benchmarks, including TQA, ScienceQA, and AI2D, outperforming or matching state-of-the-art VLMs while using fewer training instances. Furthermore, augmenting existing models such as LLaVA OneVision with SciGram establishes new state-of-the-art performance on diagram question answering. Our results highlight the effectiveness of terminology-grounded instruction generation as a general strategy for improving vision-language reasoning in scientific domains. To support future research in scientific diagram understanding, we release both the SciGram dataset and models.
73. 【2609.00940】A Dataset for Modeling Iterative Problem-Solving
链接：https://arxiv.org/abs/2609.00940
作者：Fagun Patel,Sang T. Truong,Duc Q. Nguyen,Kazunori Fukuhara,Benjamin W. Domingue,Sanmi Koyejo,Nick Haber
类目：Computation and Language (cs.CL)
关键词：Solving problems, sequential modeling task, problems through repeated, Solving, modeling task
备注： EMNLP 2026 Findings
点击查看摘要
Abstract:Solving problems through repeated attempts is a sequential modeling task: at each step, the solver receives feedback and decides how to revise their solutions. Predicting whether performance improves, plateaus, or regresses across attempts is central to understanding any iterative problem-solving process in both human learners and autonomous agents. Beyond outcomes, modeling what errors persist and how strategies shift across attempts provides deeper insight into the mechanics of sequential learning. Studying these dynamics requires observing many solvers as they attempt, receive feedback, and revise. Programming courses with automated grading provide this setting, as students iteratively submit code to test suites and receive feedback on every attempt. We therefore curate CodeInsight, a large-scale dataset of over 3 million submissions from 3,286 undergraduates across 2 introductory C++ courses in 2 academic years, with test-case-level outcomes, timestamps, and source code. On this dataset, we build a benchmark that evaluates models spanning parametric, sequential, and generative traditions under a shared calibration-and-scoring protocol, including a Recurrent State Space Model (RSSM) adapted to track solver characteristics through discrete latent variables and an LLM-based predictor that generates explicit solutions. The adapted RSSM achieves the strongest predictive accuracy on three of the four courses. The LLM predictor is less accurate but produces full submissions at each attempt, enabling direct analysis of failure modes. We find that the model's coding proficiency is inversely related to predictive performance in this setting, with the LLM better understood as a generative solver conditioned on context rather than a faithful predictor of solver behavior. We publicly release our code and the dataset on request to facilitate future research.
74. 【2609.00935】DualStake: Dual-Path Confidence Calibration in Deep Research Agents
链接：https://arxiv.org/abs/2609.00935
作者：Yinuo Xu,Yuwei Liang,Jianjie Cheng,Meng Wang,Yongcan Yu,Shuo Lu,Jian Liang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：tackle knowledge-intensive tasks, Deep Research agents, Research agents tackle, agents tackle knowledge-intensive, Deep Research
备注： Accepted to EMNLP 2026 Main
点击查看摘要
Abstract:Deep Research agents tackle knowledge-intensive tasks through multi-round retrieval and decision-oriented generation. However, these agents suffer from severe overconfidence, making their expressed confidence unreliable for user trust and downstream abstention. To address this, we augment the Deep Research pipeline with step confidence elicitation after each retrieval, building on the commonly used post-answer verbalized confidence. Interestingly, we find that Evidence Confidence (E-Conf), elicited after the final retrieval step, provides a stronger uncertainty signal than Answer Confidence (A-Conf), elicited after answer generation, and that A-Conf is largely shaped by E-Conf. Based on these findings, we propose DualStake, a dual-path calibration method that applies margin-clipped, confidence-dependent stake rewards to jointly align E-Conf and A-Conf with answer correctness while limiting extreme confidence optimization. Experiments on Qwen2.5-7B, Qwen2.5-7B-Instruct, and Qwen3-4B across 8 QA benchmarks demonstrate that DualStake consistently improves calibration without sacrificing answer accuracy. The code is available at this https URL.
75. 【2609.00925】Context-Grounding Gains Are Mediated by Pre-existing Machinery: Auditing GRPO, SFT, and DPO
链接：https://arxiv.org/abs/2609.00925
作者：Prakhar Gupta,Vaibhav Gupta
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：ignore prompt evidence, Language models, memorized knowledge, ignore prompt, conflicts with memorized
备注：
点击查看摘要
Abstract:Language models can ignore prompt evidence when it conflicts with memorized knowledge. Post-training can make models follow such evidence more reliably, but it is unclear whether these gains require new machinery or strengthen machinery already present. We compare nine post-training arms spanning GRPO, SFT, and DPO from one starting checkpoint, with key comparisons extended across scales and families. We estimate a grounding direction from that checkpoint before training. Across five tested GRPO variants, grounding gains are small. For the two variants replicated across seeds, equivalence tests bound their effects below the conflict-SFT gain even as the rewarded metric improves. Conflict-SFT improves grounding moderately, while DPO drives grounding near ceiling on its matched distribution. Conflict-SFT and DPO largely use the same causal attention-head set as the starting model. Subtracting the starting-model direction suppresses both gains, while adding it to the starting model recovers 35% of DPO's gain at a dose passing all stated side-effect checks. After a supervised warm start makes the context answer appear in more rollouts, the same GRPO recipe adds essentially no further grounding gain. In our setting, grounding gains largely depend on machinery already present in the starting model.
76. 【2609.00921】VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferences
链接：https://arxiv.org/abs/2609.00921
作者：Yiwen Jiang,Yang Deng,Stephanie Fong,Zimu Wang,Yaling Shen,Wei Feng,Hongxi Yang,Xiangyu Zhao,Zhongxing Xu,Deval Mehta,Xuelian Cheng,Zongyuan Ge
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Personalized Large Language, Large Language Models, Personalized Large, Language Models, Large Language
备注： Accepted at EMNLP 2026 (Findings)
点击查看摘要
Abstract:Personalized Large Language Models (PLLMs) aim to tailor responses to individual users, where a central challenge is preference reasoning: inferring query-relevant preferences from user-related history. Existing benchmarks, however, largely assume that such preference can be retrieved from semantically related history. We study an underexplored but practically important regime, profile-preference conceptual misalignment (PRCM), where observable profile cues and query-specific preferences lie in different concept spaces, making semantic retrieval inconsistent for personalization. We introduce VIBE-Bench, a benchmark with two psychology-grounded tasks, 3,504 personas and 12,239 dialogues, including a manually verified gold test set, and requires cross-concept preference reasoning beyond surface semantic overlap. Experiments with several personalization methods show that current PLLMs largely rely on shallow semantic correlations and fail to acquire robust cross-concept mappings. These findings establish PRCM as a distinct failure regime in PLLMs and position VIBE-Bench as a focused testbed for advancing preference reasoning beyond semantic matching.
77. 【2609.00918】RPCBench: A Benchmark for Proactive Premise Critique in LLM-based Recommendation
链接：https://arxiv.org/abs/2609.00918
作者：Zhongru Chen,Yuan Wu,Yi Chang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, interactive recommender assistants, Large, recommender assistants
备注： 45 pages, 8 figures. Code available at [this https URL](https://github.com/ZhongruChen/RPCBench)
点击查看摘要
Abstract:Large language models are increasingly used as interactive recommender assistants. Their evaluation should therefore go beyond plausible item recommendation and test whether they can recognize flawed recommendation requests. Existing recommender benchmarks mainly assess ranking, generation, or preference satisfaction, while existing error-detection benchmarks are usually not grounded in recommendation-specific user and candidate evidence. To address this gap, we introduce RPCBench, a benchmark for evaluating Recommender-Premise Critique: the ability to detect, diagnose, and properly handle faulty premises in natural-language recommendation requests. RPCBench contains evidence-grounded test instances from five recommendation domains and covers ten types of premise failures. Each instance provides a visible recommendation context and a corrupted user query. We further design a fine-grained evaluation framework that measures proactive detection, error localization, post-detection handling strategy, and evidence faithfulness. Through a systematic evaluation of 11 LLMs, we find that proactive detection is the main bottleneck in Recommender-Premise Critique, and models perform worst on underspecified-premise errors. We also observe that target-critical information density matters more than redundant evidence, and that longer reasoning does not monotonically improve critique quality: performance peaks at intermediate reasoning length, while overly long reasoning is accompanied by an overthinking penalty. The code is available at this https URL.
78. 【2609.00873】Membership Inference in Fine-tuned Diffusion Language Models via Token-level Memorization Asymmetry
链接：https://arxiv.org/abs/2609.00873
作者：Shengfang Zhai,Leo Marchyok,Yuling Shi,Huanran Chen,Yinpeng Dong,Jiaheng Zhang,Sanghyun Hong
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：alternative modeling paradigm, bidirectional context modeling, autoregressive LMs, offering advantages, alternative modeling
备注： 18 pages. EMNLP 2026 (Findings)
点击查看摘要
Abstract:Diffusion language models (DLMs) have recently emerged as an alternative modeling paradigm to autoregressive LMs, offering advantages such as parallel generation and bidirectional context modeling. Despite growing interest in their generative capabilities, the privacy risks of DLMs remain underexplored. We identify a phenomenon termed token-level memorization asymmetry through theoretical analysis of diffusion training dynamics. Building on this finding, we propose Q-Skew, a quantile-weighted skewness-based indicator for membership inference on finetuned DLMs. Experiments across multiple fine-tuning datasets and models show that our method outperforms existing baselines. Moreover, we show that Q-Skew can also facilitate other privacy violations, such as PII extraction. Our findings reveal a previously underexplored privacy attack surface and highlight the need for systematic privacy evaluation of DLMs.
79. 【2609.00868】he Visual Insensitivity Gap: Diagnosing When Vision-Language Models Fail to Use Visual Evidence
链接：https://arxiv.org/abs/2609.00868
作者：Genpei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Visual Sensitivity Index, Visual Insensitivity Gap, Vision-language models, evaluated by aggregate, practice that implicitly
备注： 17 pages (7-page main text plus technical appendix), 10 figures, 6 tables
点击查看摘要
Abstract:Vision-language models are evaluated by aggregate accuracy on multimodal benchmarks, a practice that implicitly assumes the model uses its visual input. We show this assumption fails on 40%--97% of samples across six VLMs and three perceptual benchmarks: blurring the question-relevant visual region leaves the next-token distribution nearly unchanged. We name this phenomenon the Visual Insensitivity Gap and quantify it with a per-sample Visual Sensitivity Index (VSI). The gap is a property of samples, not of models: VSI ranks correlate across models (grand-mean Spearman rho=+0.40, permutation p10^-3), so the same samples are flagged insensitive by VLMs sharing no architectural detail beyond a contrastively pretrained vision tower. The mechanism is concrete: on the insensitive samples, a linear probe on each model's own vision tower distinguishes perturbed from clean images at 0.72--0.79 accuracy, yet the model's argmax token changes on only 2%--11% of the same samples, an encoder--LLM gap above 0.65 on every model. Mapping VSI's diagnostic utility cell by cell surfaces a strong regime (multi-choice reasoning on capable VLMs: AUROC=0.85--0.87) and a weak regime (well-calibrated factuality, where softmax confidence already leads). VSI is not a universal best abstention signal; it is a sample-intrinsic indicator of vision-ignoring failure, best used as a conditional ensemble component.
80. 【2609.00865】MemoryWalker: Stop Training Agents on Contexts They Never Saw
链接：https://arxiv.org/abs/2609.00865
作者：Zinco J,Xunjie Zhu,Shen Huang,Zhenyi Wang,Pengjun Xie,Jieping Ye
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Qwen-Agent compress context, Production agent harnesses, Production agent, effective history, Qwen-Agent compress
备注： Your Memory-Compressing Harness Makes Training and Inference Inconsistent
点击查看摘要
Abstract:Production agent harnesses such as Claude Code and Qwen-Agent compress context during rollout, but training under compression creates a conditioning problem: every eviction branches the effective history, so the learning object is a tree rather than a sequence. Existing linearizations either retain the rightmost path, causing time-travel leakage, or replay a depth-first traversal, causing train-inference mismatch. We introduce two exact, gradient-equivalent corrections: LogitTree, a segmented K-forward traversal, and a packed 4D attention mask. LogitTree requires K+1 backward passes; the 4D mask requires a custom kernel and white-box eviction records. We also propose SDCC (Self-Distillation for Conditioning Consistency), a single-backward-pass variational relaxation. At each eviction, it minimizes forward KL between the compressed student and a stop-gradient teacher on the reconstructed pre-eviction prefix. A residual per-junction KL of epsilon_KL gives an O(sqrt(epsilon_KL)) bound on the train-deployment total-variation gap. SDCC also applies to black-box harnesses. On seven web-search benchmarks with TC-RAG, AgentFold, MemexRL, Claude Code, and OpenCode, naive training inflates the train-rollout log-probability gap, especially on eviction-heavy batches. The exact methods stay at the no-compression floor, and SDCC substantially closes the gap, with lower logit drift and higher rollout rewards.
81. 【2609.00858】Verifiable Disaster Storylines and Causal Knowledge Graphs: A Citation-Grounded Pipeline from Heterogeneous Humanitarian Sources
链接：https://arxiv.org/abs/2609.00858
作者：Ivan Decostanzi,Michele Ronco,Sergio Consoli,Christina Corbane,Lorenzo Bertolini,Indaco Biazzo,Daria Mihaila,Manuel Garcia-Herranz,Felix Schwebel,Yelena Mejova,Kyriaki Kalimeri
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Effective humanitarian response, humanitarian response depends, critical early hours, high-volume information sources, European Media Monitor
备注：
点击查看摘要
Abstract:Effective humanitarian response depends on the rapid synthesis of heterogeneous, high-volume information sources - a task that routinely exceeds human analytical capacity in the critical early hours of a crisis. We present a pipeline that combines structured disaster records from EM-DAT with unstructured documents from ReliefWeb and the European Media Monitor (EMM) to produce source-grounded disaster storylines and causal knowledge graphs supporting situational awareness for responders and analysts. Using Retrieval-Augmented Generation, the pipeline extracts structured storylines - tabular event profiles covering 17 fields, from severity and key drivers to child-sensitive impact indicators - and constructs causal knowledge graphs where each node and edge is enriched with citation-grounded explanatory narratives, enabling full traceability back to primary sources. We evaluate the system on three diverse crisis use cases through a human evaluation involving 9 domain expert and 9 non-expert evaluators. Results confirm high retrieval precision, strong faithfulness of extracted causal relations, and a clear expert preference for citation-grounded components over ungrounded alternatives. The pipeline is designed to scale to the full EM-DAT catalogue, with the goal of publicly releasing a narrative-enriched version of the database.
82. 【2609.00844】Staged Linguistic Seeding: Grounded Query Expansion for Verified-Unit QA in AI Contact Centers
链接：https://arxiv.org/abs/2609.00844
作者：Hyeonseop Yoon,Jeong-Eun Park
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：tight voice-hotline latency, wrong automatic answers, contact center, runs under deployment, benchmark QA misses
备注： 14 pages, 1 figure, 7 tables. Accepted to the Grounding Language Models (GroundLM) Workshop at EMNLP 2026
点击查看摘要
Abstract:Customer-service QA in an AI contact center (AICC) runs under deployment constraints that benchmark QA misses: tight voice-hotline latency and a high cost for unsupported or wrong automatic answers. We deploy a system that answers only from a closed set of verified QA units: it returns a retrieved unit verbatim, or routes to clarify, abstain, or handoff. The index is enriched offline by staged linguistic seeding (SLS): a human authors a per-unit world-grounded slot recipe, gpt-4.1-mini renders it into variants, and a light human gate filters them. One methodology is reused across both domains, so inference stays a single retrieval pass with no query-time generation. On held-out query variants from two industrial domains, SLS lifts hybrid R@1 to 0.881/0.930 (+0.27/+0.34), with gains across all five retrievers tested. At the same gpt-4.1-mini generation budget, SLS beats doc2query by +0.20/+0.32, while cross-provenance evaluation provides additional evidence of transfer across generated-query distributions. Verified-unit answering also removes free-form generation's unsupported-content surface (7-13% versus approximately 0%). We report this as an application study, including negative results.
83. 【2609.00834】Replacing Training with Memory: Listwise Selection for Text-to-SQL
链接：https://arxiv.org/abs/2609.00834
作者：Yeonseok Jeong,Soyoung Yoon,Seongjun Lee,Seung-won Hwang
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：systems often follow, Modern, queries then selecting, generating multiple candidate, generating multiple
备注： Accepted by Findings of EMNLP 2026
点击查看摘要
Abstract:Modern Text-to-SQL systems often follow generate-execute-select pipelines, generating multiple candidate queries then selecting the best one. Listwise selection, by jointly comparing multiple candidates, has been widely adopted, but fine-tuning listwise selectors is costly. We thus propose a fine-tuning-free listwise selector. We replace two major fine-tuning objectives with inference-time strategies: (1) learning selection criteria as ordering and (2) mitigating positional bias. First, we build reusable structured memories instead of learning selection behavior as model parameters. Given a question, MaP-SQL retrieves memories distilled from training data that encode how natural language maps to schema elements, SQL operations, and expected outputs. These memories serve as explicit decision criteria for evaluating candidates in a listwise manner. Second, to mitigate ordering bias of listwise selectors, we aggregate rankings across multiple input permutations, with inference cost optimized by execution results and pointwise scoring. Our approach improves selection accuracy while maintaining efficiency and compatibility with existing large language models. Across Text-to-SQL benchmarks, it produces more stable selection without fine-tuning and fewer unnecessary comparisons than existing methods. On BIRD-dev, it outperforms the previous state-of-the-art selector-based method R^3-SQL by 2.02 execution accuracy points on average using the same candidate sets, with 2.92x fewer tokens.
84. 【2609.00833】Dense Process Supervision for Search Agents via Fact Utility Estimation
链接：https://arxiv.org/abs/2609.00833
作者：Rongzhi Zhu,Xiangyu Liu,Yi Liu,Shuo Zhang,Ruirui Zhang,Rui Wu,Tao Jiang,Zequn Sun,Wenhao Xu,Wei Hu
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：search agents typically, agents typically relies, Reinforcement learning, search agents, agents typically
备注： Accepted in the 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026)
点击查看摘要
Abstract:Reinforcement learning (RL) for search agents typically relies on outcome rewards. However, it often fails to achieve effective credit assignment, due to the unclear value of intermediate steps. It is hard to separate their contributions from the final result. In this paper, we propose a dense process supervision method based on fact utility estimation, which models the reasoning process as the accumulation of discrete evidence facts. We first extract structured facts from raw observations and organize them into an explicit fact store. To support credit assignment, we then cluster semantically equivalent facts and infer the posterior utility of each fact cluster using Bayesian estimation over group rollouts. Finally, we convert the estimated fact utilities into dense step-level rewards to guide RL training. Experiments on seven single-hop and multi-hop QA benchmarks show that our method consistently outperforms existing baselines. Ablation studies validate clear relative improvements on multi-hop QA compared to outcome reward-only training.
85. 【2609.00832】WIX: a Two-Stage Approach for End-To-End Named Entity Recognition and Relation Extraction
链接：https://arxiv.org/abs/2609.00832
作者：Marco Martinelli,Laura Menotti
类目：Computation and Language (cs.CL)
关键词：Named Entity Recognition, support knowledge discovery, automatic Information Extraction, scientific publications calls, Information Extraction
备注： Accepted at CLEF 2026: the 17th Conference and Labs of the Evaluation Forum
点击查看摘要
Abstract:The exponential growth of scientific publications calls for automatic Information Extraction (IE) systems to support knowledge discovery. In this context, the GutBrainIE benchmark evaluates Named Entity Recognition (NER), Named Entity Recognition and Disambiguation (NERD), and Relation Extraction (RE) systems in the gut-brain axis domain. We propose Two-stage Workflow for Information eXtraction (TWIX), an end-to-end IE pipeline featuring three interconnected modules, each leveraging a two-stage framework to solve all four GutBrainIE subtasks. Evaluation on the development and test sets shows that our method substantially outperforms the baseline by a wide margin, while also ranking first among all participant submissions across all subtasks. These results indicate that the proposed two-stage pipeline effectively improves both precision and recall in practical settings.
86. 【2609.00823】Polished but Unresolved: Identifying Late-Stage Pressure States in Long-Horizon Tool-Use Agents
链接：https://arxiv.org/abs/2609.00823
作者：Haoyang Chen,Yi Liu,Jianzhi Shao,Xiaozhou Xu,Zhe Sun,Wei Hu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：search and plan, Long-horizon tool-use agents, pressure, Long-horizon tool-use, tool-use agents
备注： Accepted in the 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026)
点击查看摘要
Abstract:Long-horizon tool-use agents need not only to search and plan, but also to decide when to finalize. We study late-stage pressure states, in which an agent is biased toward submitting a final answer that appears complete and polished while key constraints remain unresolved. We first train a linear probe to show that this pressure state is identifiable from the agent's hidden states. Then, we use activation interventions along this pressure direction and find that shifting the hidden states changes both the pressure score and whether the agent continues tool use or submits early. Through controlled context manipulations, we further see that the pressure is mitigated by constraint clarity and action mapping. Based on these findings, we propose Probe-Sensed Pressure Relief (PSPR), a plugin that applies lightweight pressure relief direction under moderate pressure and moves to structured organization under high pressure risk. Experiments on multiple long-horizon benchmarks show that our method consistently strengthens existing agent methods.
87. 【2609.00808】Ctrl-F-Resist. Practices, Challenges, and Technical Needs of Civil Society Organizations Monitoring the Far-Right Online
链接：https://arxiv.org/abs/2609.00808
作者：Elisabeth Steffen,Helena Mihaljević
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：civil society organizations, far-right actors increasingly, actors increasingly exploit, increasingly exploit online, antidemocratic dynamics online
备注： Accepted for the 29th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2026)
点击查看摘要
Abstract:As far-right actors increasingly exploit online platforms to disseminate ideology and mobilize supporters, civil society organizations (CSOs) play a vital yet underrecognized role in monitoring antidemocratic dynamics online. Unlike fact-checkers or content moderators, CSOs engage in long-term, contextualized analysis, often in resource-constrained settings and under precarious conditions. Despite their critical societal role, CSOs face significant barriers to adopting or co-developing technical solutions, including legal uncertainty, limited platform access, and chronic underfunding. Existing research and tool development efforts have largely overlooked these actors in favor of more institutionally embedded stakeholders. This paper addresses this gap through a qualitative study with 15 practitioners from 12 Germany-based CSOs engaged in online monitoring, positioning them as key yet overlooked stakeholders in the governance of digital spaces. We explore their current practices, challenges, and expectations regarding technological support. Our findings show that monitoring remains largely manual due to the lack of tailored tools, with enhanced search capabilities emerging as the most pressing technical need. While participants express openness to AI-supported features such as media processing and content discovery, many remain skeptical of automated classification, citing concerns around trust, legal usability, and professional credibility. Grounded in these findings, we introduce a conceptual monitoring workflow and describe its implementation in an open-source Telegram monitoring prototype designed to flexibly support diverse monitoring goals. We outline concrete design, policy, and research recommendatios, and introduce the manual labor trap as an empirically grounded concept that explains why monitoring CSOs tend to remain locked into labor-intensive, low-capacity arrangements.
88. 【2609.00802】EIDAN: A Multilingual Multiparty Dialogue Corpus
链接：https://arxiv.org/abs/2609.00802
作者：Taiga Mori,Koji Inoue,Mikey Elmers,Divesh Lala,Tatsuya Kawahara
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：human-agent interaction systems, paper presents TEIDAN, central setting, setting for human, human communication
备注： 8 pages, 1 figure, 3 tables. To appear in the Companion Proceedings of the 28th ACM International Conference on Multimodal Interaction (ICMI Companion '26)
点击查看摘要
Abstract:Multi-party interaction is a central setting for human communication and a necessary target for human-agent interaction systems that must participate in group conversation. Yet available corpora often focus on meetings, task-oriented interaction, text-based interaction, or acted scenarios, and fewer resources support cross-linguistic comparison of spontaneous face-to-face triadic discussion. This paper presents TEIDAN, a multilingual multimodal corpus that currently consists of Japanese and English three-party conversations. TEIDAN records groups of three participants discussing open-ended topics with individual pin microphones, a microphone array, and participant-facing cameras, and provides IPU-based transcripts for both language portions. Earlier studies used subsets of the Japanese portion for task-specific benchmarks in multi-party dialogue modeling; in contrast, this paper presents TEIDAN as a corpus resource spanning both Japanese and English, with planned expansion to additional languages. We describe the collection design, participants, recording setup, transcription format, and corpus statistics, and provide preliminary analyses to illustrate how TEIDAN can support research on turn-taking, addressee recognition, and multimodal grounding in human-human and human-agent interaction.
89. 【2609.00796】SFAD: Speculative Factuality-Aware Decoding
链接：https://arxiv.org/abs/2609.00796
作者：Guanqiao Chen,Di Wang,Lijie Hu
类目：Computation and Language (cs.CL)
关键词：faithfulness directly determines, large language models, knowledge-intensive applications, large language, directly determines
备注：
点击查看摘要
Abstract:As one of the most critical challenges in large language models, contextual faithfulness directly determines their reliability in knowledge-intensive applications. This task is particularly challenging as it requires balancing factual consistency with generation efficiency. Contrastive decoding methods require dual forward passes (with and without context) to compare model outputs, doubling inference computational overhead, while post-training alignment demands extensive reinforcement learning with substantial computational overhead. To address this challenge, we present \textbf{SFAD}, a speculative decoding framework that enhances contextual faithfulness without inference degradation. We first construct \textbf{ConFide}, a preference dataset with fine-grained atomic perturbations, to train a context-faithful draft model via Direct Preference Optimization. During inference, Epistemic Friction detects potential hallucinations by quantifying distributional tension weighted by specialist certainty. When friction exceeds the threshold, Asymmetric Logit Steering refines the target distribution through residual-based logit injection; otherwise, standard speculation proceeds. Extensive experiments demonstrate that SFAD substantially improves faithfulness while achieving $2.48\times$ speedup, offering a practical solution for efficient LLMs.
90. 【2609.00791】Instella-MoE Technical Report
链接：https://arxiv.org/abs/2609.00791
作者：Jiang Liu,Sudhanshu Ranjan,Prakamya Mishra,Yonatan Dukler,Gowtham Ramesh,Jialian Wu,Ximeng Sun,Wen Xie,Chaojun Hou,Vikram Appia,Zhenyu Gu,Zicheng Liu,Emad Barsoum
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：AMD Instinct, billion total parameters, Gated Multi-head Latent, Multi-head Latent Attention, scratch on AMD
备注：
点击查看摘要
Abstract:In this work, we introduce Instella-MoE, a fully open Mixture-of-Experts (MoE) language model with 16 billion total parameters and 2.8 billion active parameters per token, trained entirely from scratch on AMD Instinct MI300X and MI325X GPUs. Instella-MoE combines a sparsely activated MoE design with architectural and system-level innovations, including Gated Multi-head Latent Attention (Gated MLA) and FarSkip-Collective connectivity, enabling efficient large-scale training and inference. The model is developed through a multi-stage pipeline comprising pre-training, mid-training, long-context extension, supervised fine-tuning with feedback-driven data curation, direct preference optimization, and reinforcement learning with Multi-Teacher On-Policy Distillation. Instella-MoE achieves an average score of 76.7 across standard pre-training benchmarks, outperforming prior fully open models including OLMo-3-7B, SmolLM3-3B, and OLMoE-1B-7B, while remaining competitive with open-weight MoE and dense baselines at comparable active-parameter scales, including Moonlight-16B-A3B and Qwen3.5-4B. After post-training, our final Think checkpoint achieves an average score of 73.2 across instruction-following, reasoning, math, coding, and chat benchmarks, outperforming both fully open and open-weight models with comparable or larger active parameter counts in our evaluation. To support transparent and reproducible research, we release the complete Instella-MoE model flow, including model weights, training configurations, data mixtures, and training code. Together, these contributions establish Instella-MoE a strong, fully open foundation for efficient, high-performing MoE models and reproducible research.
91. 【2609.00782】When Features Become Instances: Inverted Contrastive Learning for Unsupervised Feature Selection
链接：https://arxiv.org/abs/2609.00782
作者：Utsab Ghosh,Roshni Chakraborty
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Unsupervised feature selection, making feature utility, feature utility difficult, feature selection seeks, class labels
备注：
点击查看摘要
Abstract:Unsupervised feature selection seeks a compact subset of informative features without access to class labels, making feature utility difficult to define. Existing UFS methods therefore rely on indirect structural criteria, such as similarity preservation, locality, sparsity, cluster geometry, or reconstruction quality. In this paper, we instead study UFS through representation consistency and propose Inverted Contrastive Learning for Unsupervised Feature Selection (ICLFS), a feature-wise contrastive framework that reformulates UFS as a representation learning problem over features rather than samples. ICLFS first inverts the data matrix so that each feature is represented by its sample-profile vector, then constructs multiple masked positive views together with a shuffled negative view, and learns projector-space representations that remain consistent across these structured perturbations under an InfoNCE-based objective. Motivated by recent findings that cosine-based and InfoNCE-based training affect embedding norms, we use projector-space embedding magnitude as the saliency signal for ranking features. The resulting norm-based ranking is subsequently refined through Laplacian-Gated Ranking Correction, which suppresses locally redundant candidates while preserving salient ones. Extensive experiments on 12 benchmark datasets show that ICLFS achieves the best clustering accuracy on 10 datasets against both classical and neural baselines under the standard clustering-based UFS evaluation protocol, while remaining competitive on the other two. These results show that feature-wise contrastive representation consistency provides a strong and effective alternative to neighborhood, cluster, and reconstruction-based UFS formulations.
92. 【2609.00760】A Unified Mechanistic Analysis of Knowledge- and Safety-Based Refusals
链接：https://arxiv.org/abs/2609.00760
作者：Yuri Son,Seunghee Kim,Hyuhng Joon Kim,Taeuk Kim
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, violate safety policies, language models, increasingly trained
备注： Accepted to EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Large language models (LLMs) are increasingly trained to decline queries that fall outside their knowledge (knowledge-based refusal, KR) or violate safety policies (safety-based refusal, SR). Although KR and SR result in superficially similar responses, they have largely been studied in isolation, leaving open whether they share an underlying mechanism. We address this gap with a systematic study on a new dataset of 213 contrastive quadruples that jointly probe both refusal types. We find that KR and SR are governed by overlapping yet distinguishable mechanisms. Both share a refusal direction, yet the overlap is asymmetric: SR signals transfer more strongly to KR than the reverse. Type-specific specialization emerges mainly in upper layers, with KR aligning with uncertainty- and knowledge-related representations and SR with safety- and policy-related ones. We thus characterize refusal as a commit-then-specify process: a shared initial mechanism commits to refusing, then type-specific features in later layers specify whether the grounds are epistemic or normative.
93. 【2609.00759】Compile, Don't Memorize: A Context Compilation Architecture (CCA) for In-Context Learning
链接：https://arxiv.org/abs/2609.00759
作者：Jinhu Qi,Minda Hu,Wentao Zhang,Weiqiang Jin,Yanyu Chen,Junli Wang,Irwin King
类目：Computation and Language (cs.CL)
关键词：increasingly handle in-context, handle in-context learning, Large language models, Large language, increasingly handle
备注： Accepted to EMNLP 2026 (Findings). Code, data, and cached completions available at [this https URL](https://github.com/TonyQJH/cca-emnlp2026)
点击查看摘要
Abstract:Large language models (LLMs) increasingly handle in-context learning (ICL) tasks where a long, novel context defines the rules, knowledge, and output schema for a series of questions. On benchmarks that grade against every detail of the context, even strong open-weights models pass only 12-16% of tasks: a single overlooked rule fails the whole response. We argue this brittleness is structural: the dominant "read-and-reason" paradigm asks the model to extract, plan, generate, and self-verify in one forward pass. We therefore ask whether explicit context compilation can fix it, how it compares to existing long-context strategies (gist retrieval, multi-agent self-play), and where the resulting harness benefit holds across task structure and model scale. We propose the Context Compilation Architecture (CCA), whose central novelty is a typed intermediate representation (IR) with fixed slots (rules.{must_do, must_not, conditional}, output_spec, available_tools, data_profile) into which any prose context is compiled once; executable verifiers and a violation-gated correction loop follow as downstream consequences. On CL-bench (1,899 tasks across 4 open base models), CCA outperforms vanilla prompting and two long-context baselines (ReadAgent-P, Ctx2Skill) on every base model, lifting Kimi K2.5 from 15.4% to 21.4% with gains concentrated on rule-dense sub-categories. Code and cached completions are available at this https URL.
94. 【2609.00756】Joint Training Is Not Enough: Conditioned Cross-Granularity Training for Multimodal Document Understanding
链接：https://arxiv.org/abs/2609.00756
作者：Chengguang Gan,Yunhao Liang,Hanjun Wei,Qinghao Zhang,Shiwen Ni
类目：Computation and Language (cs.CL)
关键词：Mutual Reinforcement Effect, Reinforcement Effect, Mutual Reinforcement, document-level task, model handles
备注：
点击查看摘要
Abstract:The Mutual Reinforcement Effect (MRE) asks whether a fine, span-level and a coarse, document-level task help each other when one model handles both. We test it in multimodal document understanding on three corpora, two of receipts and one of scanned business forms, comparing single-task, joint and conditioned training, which puts one granularity's gold output in the other's prompt during training only. We build Doc-MRE, an annotation layer pairing gold field extraction (point) with four document-level facets (line), from a three-judge LLM committee under a pre-registration, validated by blind re-annotation. One predicate, fixed in advance: at a shared recipe, a regime reinforces if it beats the matched single-task model on both granularities. Mixed joint training, the arrangement prior MRE work assumes, reinforces on no corpus at the main scale: it is below both single-task models on CORD and trades one granularity for the other on the two others, as single-task tuning does. Conditioned training reinforces on two of the three, CORD (+0.5 point, +4.8 line) and the forms corpus (+7.2 point, +11.0 line), resolvably on the coarse side and directionally on the fine one, and trades on WildReceipt; at that recipe no alternative measurably beats it on either side anywhere. Two byte-identical-prompt controls separate content from format: shuffled conditioning destroys the coarse-side skill but costs the fine side far less, and a neutral-content control reproduces the whole fine-side gain on WildReceipt, which is therefore prompt structure but buys nothing resolvable on the other two. On the forms corpus conditioning buys collapse avoidance: mixed training and the neutral control both assign the majority semantic label to all 50 test documents; only conditioning recovers the gold distribution. Probes find the information decodable under every regime with no resolvable increase under conditioning.
95. 【2609.00753】How Do Language Models Choose Between Context and Memory?
链接：https://arxiv.org/abs/2609.00753
作者：Benjamin Shih,John Winnicki,Arianna Cao
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：contextual information conflicts, contextual information, information conflicts, decode and steer, model parameters
备注：
点击查看摘要
Abstract:When contextual information conflicts with the knowledge stored in model parameters, activation directions can be used to decode and steer which source the model follows. However, steering along a direction does not establish causality: whether the unedited model would naturally use that direction or whether the direction is reusable across tasks. We test these distinctions through counterfactual experiments in unambiguous settings. First, we estimate authority directions from agreement prompts, in which the context and parametric knowledge support the same answer. We then interchange naturally occurring coordinates along these directions between matched prompts that direct the model to prioritize either the supplied context or its parametric knowledge. Across Qwen, Llama, and OLMo models, this intervention reproduces 30-68% of the authority-induced shift in source choice, whereas matched controls reproduce almost none. To test cross-task reuse, we learn authority directions on two tasks separately and see that cross-task transferability closes only 9% of the authority gap while the local direction learned on the given task closes 57%. These results distinguish authority representation, causal use, and cross-task causal reuse, and suggest that authority computations may be task-dependent, rather than reusable across tasks.
96. 【2609.00748】Measuring Optimal Transport in Transformer Depth
链接：https://arxiv.org/abs/2609.00748
作者：Alexandre Quemy
类目：Computation and Language (cs.CL)
关键词：transformer carries, vocabulary carried, carried together forms, token state, layer
备注： Submitted at GDDL Workshop @ NeurIPS 2026
点击查看摘要
Abstract:A transformer carries each token's state from layer to layer, and the whole vocabulary carried together forms a cloud that moves with depth. We ask whether a trained network moves this cloud the way optimal transport would: at the cheapest cost, and along the map that pairs each token with its optimal destination. We measure both on Pythia-160m and Pythia-410m, with an exact assignment between consecutive layer clouds, a measured sampling floor, calibration on couplings known to be optimal, and a split of the cost into the common shift of the cloud and the token-specific moves. At the last layer, both models move their tokens where the optimal-transport map sends them, at the optimal cost for Pythia-410m and slightly above it for Pythia-160m. At the first layer they do not. In between, single layers can be judged on cost at only two of ten transitions, and blocks of several layers move the cloud at close to the optimal cost. The agreement at the last layer is much weaker at initialisation (0.64 against 0.86) and grows with training.
97. 【2609.00747】Can Large Language Models Forecast What Researchers Study Next?
链接：https://arxiv.org/abs/2609.00747
作者：Fenghai Li,Zihan Tang,Haofei Yu,Yining Zhao,Jiaxuan You
类目：Computation and Language (cs.CL)
关键词：Large language models, anticipate subsequent work, language models increasingly, models increasingly generate, increasingly generate research
备注： 31 pages, 4 figures. Accepted to EMNLP 2026
点击查看摘要
Abstract:Large language models increasingly generate research ideas, yet judging their novelty or feasibility at generation time does not establish whether they anticipate subsequent work. We introduce IdeaForecastBench to evaluate research idea forecasting. Given a community's literature up to a cutoff, a system produces up to five ranked ideas, which are evaluated against later papers. The benchmark comprises 624 rolling episodes across 52 topics, with a fixed retrieve-then-judge protocol and separately reported results from two judges. We compare five history-compression strategies across GPT-4.1, Qwen2.5-7B/14B, and Qwen3.5-9B, together with a learned Mode-Decomposition Forecaster (MDF). Under the primary GPT-4.1-mini judge, Summary improves on Direct in Hit@5 and Precision@5 across all four backbones. Qwen2.5 scores above GPT-4.1, whereas Qwen3.5 scores below it. An outcome-blind assessment finds that Qwen2.5 produces broader forecasts, but does not identify how much breadth contributes to its advantage. Threshold and judge diagnostics further clarify the limits of interpreting realization as precise anticipation. IdeaForecastBench provides a common task for studying which research ideas a community subsequently pursues and how reliably this outcome can be measured.
98. 【2609.00714】ChatDev 2.0: A No-Code Multi-Agent Platform for Developing Everything
链接：https://arxiv.org/abs/2609.00714
作者：Yufan Dang,Shu Yao,Bowen Lai,Chenting Xu,Ruijie Shi,Wai-Shing Leung,Huatao Li,Chen Qian,Zhiyuan Liu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Large language model, based multi-agent systems, shown strong potential, builders simplify authoring, no-code builders simplify
备注： Accepted at EMNLP 2026 Demo Track
点击查看摘要
Abstract:Large language model (LLM)-based multi-agent systems (MAS) have shown strong potential for solving complex tasks, yet their development forces a tradeoff: code frameworks are expressive but engineering-intensive, while no-code builders simplify authoring but constrain agent interactions to author-defined workflows. We present ChatDev 2.0: DevAll (hereafter DevAll), a no-code platform for building, executing, and inspecting heterogeneous MAS that delivers both high expressiveness and ease of use. In terms of expressiveness, DevAll pairs a declarative executable graph abstraction with a cycle-aware execution engine, so that heterogeneous agents and dynamic and cyclic interactions can be represented and executed within a single framework. For ease of use, an integrated visual interface lets users author, run, monitor, and inspect MAS, including human-in-the-loop steps, entirely without writing code. Experiments demonstrate that DevAll reproduces state-of-the-art MAS across three representative tasks at competitive performance and without task-specific orchestration code, highlighting its effectiveness as a general-purpose platform for LLM-based MAS. DevAll is available at this https URL.
99. 【2609.00709】Controllable Image Captioning with Prompt-Conditioned Scene Rewards
链接：https://arxiv.org/abs/2609.00709
作者：Jongyeop Hyun,Taeyoung Kim,Hyounghun Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large Vision-Language Models, Vision-Language Models produce, Models produce fluent, offer limited semantic, produce fluent image
备注： EMNLP 2026 Main (26 pages); Project website: [this https URL](https://focus-emnlp2026.github.io/)
点击查看摘要
Abstract:Large Vision-Language Models produce fluent image descriptions but offer limited semantic control: users cannot reliably specify whether captions should emphasize attributes, relations, or particular image regions. We present Fine-grained Captioning Control Using Scene Rewards (FoCUS), a controllable image captioning method that lets users steer captions toward specific semantic emphases through natural-language control prompts. The core idea is a prompt-conditioned control objective based on scene-graph-aligned component scores. Generated captions are parsed and aligned to scene-graph components such as objects, attributes, and relations. These components are differentially weighted, including negative weights, according to the requested emphasis. We optimize this objective with GRPO and further improve its reliability through a stricter object validity threshold and reasoning-based verification for attribute and relation scoring. To evaluate controllability, we introduce Semantic Control and Precision Evaluation (SCoPE), a benchmark with contrastive Include/Avoid constraints for measuring both target content coverage and out-of-scope suppression. Experiments on two VLM backbones show that FoCUS consistently improves controllability and fine-grained caption quality without degrading general caption performance.
100. 【2609.00706】A Certificate-Producing Cascade for Equational Implication: The SAIR EQT2 Stage 2 Solver
链接：https://arxiv.org/abs/2609.00706
作者：Haobo Ma,Wenlin Zhang,Manuel Israel Cázares
类目：Computation and Language (cs.CL)
关键词：SAIR Mathematics Distillation, Mathematics Distillation Challenge, SAIR Mathematics, Mathematics Distillation, Distillation Challenge
备注： 12 pages
点击查看摘要
Abstract:The SAIR Mathematics Distillation Challenge on Equational Theories asks a solver to classify whether one magma identity implies another and, for either verdict, to return a certificate accepted by a deterministic Lean judge. We present a single-file solver organized as a cheapest-first cascade. Its false branch combines coefficient tests over structured algebra families, bounded finite-model search, an explicit central-groupoid witness, and several infinite-carrier witnesses. Its true branch is a proof-producing ordered unit superposition procedure with Knuth-Bendix ordering, bidirectional demodulation, indexing, memoised substitution, and anytime size deepening. Search results remain outside the trusted base: successful derivations are replayed as small Lean terms, and countermodels are rechecked by the competition judge. The frozen solver is a 189,504-byte Python file with SHA-256 f2392533c9f4c03b.... In local runs through official judge revision 2848228, it produced accepted certificates for all 1,889 rows of the six public sets with no language-model calls. Separate measurements recorded full agreement on the 800 published Stage 1 evaluation-distribution problems, 100 accepted rows in the canonical Marathon manifest without tokens, and 200 accepted rows in the hosted playground. These are regression and playground measurements, not a leaderboard result and not evidence about a hidden set. All quantitative claims are tied to immutable result ledgers; the paper makes no completeness or comparative-superiority claim.
Comments:
12 pages
Subjects:
Computation and Language (cs.CL)
ACMclasses:
F.4.1; I.2.3
Cite as:
arXiv:2609.00706 [cs.CL]
(or
arXiv:2609.00706v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.00706
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
101. 【2609.00700】Value Over Language Model: Detecting Original Contribution in Writing
链接：https://arxiv.org/abs/2609.00700
作者：Vibhhu Sharma,Thorsten Joachims,Sarah Dean
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：prompting the development, document surface text, rapidly adopted, LLM, detecting LLM-generated text
备注： 39 pages
点击查看摘要
Abstract:LLMs have been rapidly adopted across writing tasks, prompting the development of tools for detecting LLM-generated text. Yet, these tools largely measure how much of a document's surface text was written by an LLM and aren't fundamentally designed to measure how much of the information content or ideas originated from the LLM itself rather than being supplied by the user in the prompt. In this work, we design a framework that measures how much value a person adds on top of what a language model could have easily produced by itself. The method requires no training or labeled data and never scores the document's surface text, insulating it from stylistic confounders. Instead, it extracts the document's content at increasing levels of granularity, uses an LLM to reconstruct the document from each partial representation, and compares these reconstructions with those produced from the task description alone. We call this framework Value Over Language Model (VOLM), which measures a document's contribution relative to a replacement-level document that an LLM could produce from the task description alone. We evaluate VOLM with a specific instantiation of this framework across three domains: news articles, ICLR peer reviews, and argumentative essays. VOLM separates human-authored documents from matched LLM-generated documents produced from generic task descriptions, while remaining substantially invariant to content-preserving transformations, including LLM-based reconstruction and round-trip translation. We further find that increasingly constrained content extractors reduce residual differences between LLM-generated and humanized text, demonstrating the importance of disentangling informational content from stylistic variation. We hope these results encourage further work on specialized instantiations of the framework and on assessing human contributions in LLM-assisted writing more generally.
102. 【2609.00689】SCoNE: Selective Context-aware Neuron Editing for Robust Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2609.00689
作者：Chaewon Kim,Seo Yeon Park
类目：Computation and Language (cs.CL)
关键词：retrieved documents mix, documents mix informative, Retrieval-Augmented Generation, leading to hallucinations, Selective Context-aware Neuron
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) is highly sensitive to retrieval noise: when retrieved documents mix informative and irrelevant context, LLMs are easily distracted, leading to hallucinations. To overcome this, we propose SCoNE (Selective Context-aware Neuron Editing), a training-free model editing approach that improves retrieval noise robustness by selectively strengthening context-aware FFN neurons that are identified by both high attribution and high cross-input variability. SCoNE requires only a small number of mining samples, no fine-tuning, and no inference-time overhead. Across various knowledge-intensive question-answering benchmarks and two LLM backbones, SCoNE consistently outperforms competitive baseline methods. Our code is available at this https URL.
103. 【2609.00685】Visual Framing for News Stance Detection via Image Generation
链接：https://arxiv.org/abs/2609.00685
作者：Dahyun Lee,Jiyoung Han,Kunwoo Park
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：social issues, stance detection aims, aims to identify, identify the perspective, stance detection
备注： EMNLP 2026
点击查看摘要
Abstract:Article-level news stance detection aims to identify the perspective of news articles toward social issues. Despite advances in stance detection and its importance for trustworthy media environments, news articles pose distinct challenges because their stances are often implicit, subtly conveyed through journalistic framing, and embedded in long, structurally complex texts. To address these challenges, we introduce VFStance, which leverages visual framing to make implicit stance cues more explicit via image generation. In evaluation experiments, we demonstrate the effectiveness of VFStance over existing methods and the contribution of visual framing to its performance. Finally, a controlled user study (N=200) in a snippet-based news consumption setting further demonstrates that VFStance can make stance signals visually salient and highlights its potential use beyond automated stance detection.
104. 【2609.00683】Creative Generation via Multi-Agent Debate: Does Debate Suppress Diversity?
链接：https://arxiv.org/abs/2609.00683
作者：Tien Anh Nguyen,Khanh-Binh Nguyen,Van Dai Do,Svetha Venkatesh,Hung Le
类目：Computation and Language (cs.CL)
关键词：scientific ideation, demand both high-quality, maximize exploration, Creative generation tasks, narrative writing
备注： 28 pages, accepted to EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Creative generation tasks, such as narrative writing and scientific ideation, demand both high-quality outputs and distinct responses across independent runs to maximize exploration. Multi-Agent Debate (MAD) has shown strong quality gains on factual and reasoning tasks, making it a natural candidate for creative generation. However, we find its convergence-driven design actively suppresses output diversity across independent runs, creating an inherent trade-off with creative tasks. We theoretically show that preserving diversity among agents within each debate session is a necessary condition for achieving diverse outputs across independent runs. Building on this finding, we propose Creative-MAD, which introduces two synergistic interventions to sustain agent divergence. Specifically, Cognitive Lens Assignment counters identity drift by anchoring each agent to a distinct and persistent cognitive mode, while Embedding-based Peer Selection counters majority pull by limiting each agent's context to its most semantically distant peers. Experiments across four creative benchmarks demonstrate that Creative-MAD significantly enhances both lexical and semantic diversity while maintaining MAD's output quality.
105. 【2609.00654】SciTrue: Reliable Scientific Claim Validation with Frontier and Open Language Models at the NTCIR SciClaimEval Task
链接：https://arxiv.org/abs/2609.00654
作者：Qiming Bao,Neşet Özkan Tan,Siyuan Wang,Mark Gahegan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：SciTrue team participation, verify scientific claims, team participation, verify scientific, tables and figures
备注： To appear in the Proceedings of the 19th NTCIR Conference (NTCIR-19)
点击查看摘要
Abstract:We describe the SciTrue team's participation in both subtasks of the NTCIR-19 SciClaimEval task~\cite{sciclaimeval}, which asks systems to verify scientific claims against the tables and figures of a paper. Rather than tuning a single model, we benchmark eleven frontier and open multimodal models under one honest, per-sample protocol and combine them with light, transparent post-processing. On the official, blind test leaderboard (Section~\ref{sec:results}), SciTrue placed first by a clear margin in three of the four evidence-category/subtask combinations, and tied for first on the primary metric in the fourth. Three findings explain the result. First, strong instruction-tuned models are already competitive: Claude Opus~4.8 and Gemma-4-31B each exceed the strongest public baseline (o4-mini), and GPT-5.5 and Claude Fable~5 lead both subtasks (97.7 on Subtask~2). Second, the task's pairing structure is the largest lever: a \emph{leak-free pair prior} that recovers the Supported/Refuted pairing from the claim text alone (a visible field) and assigns Supported to the higher-confidence evidence raises Subtask-1 pair-accuracy from 72.2 to 93.5, far more than any model swap or ensemble weighting. Third, a case-by-case audit finds that most residual errors are visually-undetectable label-mapping swaps or dataset label noise, so measured accuracy understates the true ability and the fixable-by-modeling headroom is small. Controlled fine-tuning, distillation, and agentic consistency-checking support the same conclusions, and we document throughout a measurement leak---label information reaching a system through the packaging of the data rather than its content---in which the released file ordering encodes the label, including one instance that briefly misled our own pipeline.
106. 【2609.00638】It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning
链接：https://arxiv.org/abs/2609.00638
作者：Runpeng Dai,Kaili Huang,Changsung Kang,Ciya Liao
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：large item universe, advertising systems, selecting a candidate, ranking and auction, stage of modern
备注：
点击查看摘要
Abstract:Retrieval is the first stage of modern search and advertising systems, selecting a candidate set from a large item universe for downstream ranking and auction. Recent work increasingly leverages LLMs to improve retrieval through query expansion, data synthesis, and retrieval-feedback training. However, the generative component is typically used for query-side augmentation, while final matching is still delegated to a downstream retriever. We introduce CoGR, a retrieval framework that instead trains LLMs to directly construct retrieval representations on both query and item sides. Each generator produces a compact set of keywords, which are matched directly through an inverted index, preserving compatibility with existing keyword-based retrieval infrastructure. CoGR uses a two-stage training pipeline. Supervised fine-tuning first establishes an aligned keyword space, after which co-evolving reinforcement learning alternately optimizes the query- and item-side generators with GRPO against the opposite side's frozen index. Both sides optimize the same query-to-item retrieval $F_1$ objective: the query side receives retrieval $F_1$ directly, while the item side receives a counterfactual marginal reward measuring the change in query-side $F_1$ caused by its generated keywords. Across 10 representative sparse, dense, and generative baselines, CoGR achieves the best performance on both an internal APP Marketplace dataset and the public WANDS benchmark, improving $F_1$ over the strongest baseline by $10.9\%$ and $36.1\%$, respectively. Further analysis shows stable co-evolution and increasingly aligned query--item keyword spaces over training.
107. 【2609.00629】ExpArt-KG: Artwork Image Description Generation through Iterative Exploration of Knowledge Graphs
链接：https://arxiv.org/abs/2609.00629
作者：Yuta Kato,Shintaro Ozaki,Kazuki Hayashi,Yusuke Sakai,Hidetaka Kamigaito,Katsuhiko Hayashi,Taro Watanabe
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Vision-Language Models, achieve strong performance, visual question answering, Large Vision-Language, Vision-Language Models
备注：
点击查看摘要
Abstract:Large Vision-Language Models (LVLMs) achieve strong performance on image-grounded text generation and visual question answering. However, it remains difficult for them to comprehensively and accurately describe the factual relations among the entities and concepts associated with the objects depicted in an image. In this work, we propose a framework that efficiently exploits factual information from a knowledge graph via retrieval-augmented generation (RAG), with the goal of enabling LVLMs to generate detailed and accurate image explanations. Specifically, our method alternates between answer generation and knowledge-graph retrieval, and controls the search using a correctness judgment, thereby acquiring the necessary and sufficient factual information efficiently. We also construct a knowledge graph for the artwork domain (ExpArt-KG), in which the correspondence between images and entities is unambiguous. Applying the proposed method to this knowledge graph, we show experimentally that it improves the level of detail of artwork explanations and reduces the retrieval cost of external knowledge while maintaining generation quality comparable to that of iterating a fixed number of times.
108. 【2609.00624】rust Your Guide Only When Certain: Uncertainty-Aware Sparse Alignment at Inference Time
链接：https://arxiv.org/abs/2609.00624
作者：Zeen Zhu,Zhuo Li,Weiyang Guo,Liye Zhao,Haibing Di,Yequan Wang,Jing Li
类目：Computation and Language (cs.CL)
关键词：steer Large Language, Large Language Models, Large Language, steer Large, employs lightweight supervisors
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:A prominent paradigm in inference-time alignment employs lightweight supervisors to steer Large Language Models (LLMs). Through empirical analysis, we identify a structural mismatch in this paradigm: weak supervisors exhibit pervasive high entropy across the vast majority of tokens, yet prevailing dense intervention approaches mandate supervision at every decoding step. This leads to frequent low-confidence interventions that can disrupt valid base-model reasoning and incur substantial utility costs. To resolve this, we propose TUSA (Trust-based Uncertainty Sparse Alignment). Moving away from continuous oversight, TUSA reframes alignment as a dynamic arbitration process, introducing an uncertainty-aware arbiter that authorizes intervention only when two conditions are met: the supervisor is confident and the token is semantically salient. This mechanism effectively filters out uncertainty-driven noise and redundant supervision. Extensive experiments across multiple models and benchmarks show that TUSA consistently improves both safety alignment and general helpfulness. By bypassing approximately 50% of alignment steps, it not only enhances safety preference by up to 15.6%, but also boosts general preference rates by up to 12.0% compared to the dense baseline, demonstrating that selective, high-precision alignment can outperform continuous supervision.
109. 【2609.00621】Control-Data Flow Separation: Stable Prompt Optimization in Multi-Agent LLMs
链接：https://arxiv.org/abs/2609.00621
作者：Wentao Zhang,Syed Shariyar Murtaza,Junaid Ahmad Bhatti,Utkarsh Soni,Yifan Nie,Eugene Wen,Yuntian Deng
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：multi-agent LLM systems, underlying code relies, LLM systems, improve multi-agent LLM, generating task-relevant content
备注：
点击查看摘要
Abstract:Prompt optimization can improve multi-agent LLM systems, but the prompts being optimized often serve two entangled roles: generating task-relevant content and specifying execution-critical protocols, such as message routing, output formatting, and termination signals, on which the underlying code relies. As a result, a prompt edit intended to improve content generation can inadvertently corrupt the protocol and cause the entire agent pipeline to fail. Our key observation is that these two roles have different representations: execution protocols are typically structured, while task-relevant content is usually expressed in unstructured language. Based on this, we propose control-data flow separation, where execution-critical control is represented as typed, validated program objects, while task-relevant language remains the optimizable data flow for agent communication. This design allows optimizers to improve multi-agent behavior without exposing the routing or formatting interface to prompt drift. Across synthetic reasoning, collaborative review generation, and insurance rating workflows, our framework empirically achieves 100% eventual protocol validity while consistently improving task performance.
110. 【2609.00608】Investigating Assistant Bias in LLM User Simulators Using a Role Vector
链接：https://arxiv.org/abs/2609.00608
作者：Daeheon Jeong,Yoonjoo Lee,Eugene Choi,Sinie van der Ben,Juho Kim
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：evaluate autonomous agents, costly human evaluations, agents at scale, LLM-based user simulators, evaluate autonomous
备注： 35 pages
点击查看摘要
Abstract:LLM-based user simulators are increasingly used to evaluate autonomous agents at scale, in place of costly human evaluations. Despite this promise, these simulators exhibit "assistant bias," a tendency to cooperate and pursue task goals. They rarely reproduce the frustration or disengagement that real users exhibit, compromising evaluation validity. Prior work outlines that this bias is baked in during model training, which role-playing prompts fail to override. We analyze this bias from model activations, extracting a user role vector by contrasting how the model represents user versus assistant perspectives on the same dialogue. We observe two findings: (i) the user direction is identifiable in activations, elicits user-like behaviors, and captures characteristics distinct from assistant traits; and (ii) although user-role activation associates with simulation realism and steering strengthens it, it can exaggerate user behaviors and override individual user profiles. Together, our findings provide a representation-level analysis of LLM user simulators, confirming that assistant bias is structurally identifiable and that user behavior can be directionally analyzed.
111. 【2609.00605】Confess What You Know: Forget-Set Misalignment with Model Knowledge in LLM Unlearning
链接：https://arxiv.org/abs/2609.00605
作者：Miso Kim,Georu Lee,Seungwon Jeong,Woojin Lee
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：realistic privacy settings, original training data, large language models, Machine unlearning, data is inaccessible
备注： Accepted to EMNLP 2026 (Main Conference). 22 pages, 3 figures
点击查看摘要
Abstract:Machine unlearning for large language models (LLMs) often assumes that a pre-defined forget set matches what the model has memorized, but this frequently breaks in realistic privacy settings where the original training data is inaccessible. We term this gap forget-set misalignment and identify two cases. In Under Unlearning, the forget set omits memorized information and leakage persists. In Out-of-Knowledge Unlearning, the algorithm is driven to "forget" knowledge the model never learned, perturbing parameters and degrading utility. Using gradient-level analysis, we show these behaviors arise from misaligned unlearning targets rather than specific optimization choices. We then propose CONfession-to-Forget-Set (CONFS), a data-blind framework that constructs model-aligned forget sets by eliciting and formalizing the model's memorized knowledge. Across synthetic, multimodal, and real-world benchmarks, CONFS approaches Gold-standard performance on several metrics and achieves a competitive forgetting-utility balance, while preserving utility better than other data-blind forget-set constructions.
112. 【2609.00588】Quit While You're Ahead: Quit for Efficient Candidate Generation in Machine Translation Reranking
链接：https://arxiv.org/abs/2609.00588
作者：Guangyu Chen,Boxuan Lyu,Hidetaka Kamigaito,Kotaro Funakoshi,Manabu Okumura
类目：Computation and Language (cs.CL)
关键词：Minimum Bayes Risk, Bayes Risk, Minimum Bayes, modern neural machine, neural machine translation
备注：
点击查看摘要
Abstract:Reranking methods, such as Minimum Bayes Risk (MBR) decoding and Quality Estimation (QE) reranking, are widely used in modern neural machine translation (NMT) to select an output from a set of candidate hypotheses. However, the performance gains come at the cost of high inference latency. Existing acceleration methods target MBR decoding and reduce only reranking computation, leaving QE reranking unaddressed and candidate generation---which can be the larger computational bottleneck---largely untouched. In this work, we propose Quit (Quantifying Uncertainty for Incremental Termination), a novel early-stopping strategy for the entire generation--reranking pipeline. Viewing candidate generation as a sequential decision under uncertainty, Quit incrementally generates and reranks candidates, stopping when the highest estimated quality in the candidate set stabilizes. Comprehensive experiments on three NMT models across 19 language pairs show that Quit yields end-to-end speedups of $1.47$--$2.66\times$ for MBR and $3.43$--$4.12\times$ for QE reranking while preserving translation quality within prespecified equivalence margins.
113. 【2609.00581】Enoki: Efficient Multi-Level Hallucination Detection
链接：https://arxiv.org/abs/2609.00581
作者：Elisei Rykov,Timur Ionov,Nikolay Ivanov,Maksim Savkin,Maksim Makarenko,Alexander Panchenko,Vasily Konovalov,Julia Belikova
类目：Computation and Language (cs.CL)
关键词：Ensuring factuality remains, Ensuring factuality, high-stakes settings, critical challenge, challenge for deploying
备注：
点击查看摘要
Abstract:Ensuring factuality remains a critical challenge for deploying LLMs in high-stakes settings. Existing hallucination detectors usually operate at a single level: claim-level methods provide interpretable factual units, while span-level methods localize unsupported text. Bridging these views is costly, as LLM-heavy pipelines require multiple decomposition and verification calls, and modular systems need additional claim-to-span alignment. We propose Enoki, an Open Information Extraction framework for multi-level hallucination detection. Enoki extracts text-anchored relational facts, verifies them against evidence, and projects unsupported facts back to hallucinated spans. This shared representation enables claim-level verification and span-level localization without requiring separate alignment. Enoki supports LLM-based, encoder-based, and rule-based extraction regimes, balancing accuracy and inference cost through a common interface. Experiments show that Enoki remains competitive with strong claim-level systems while using fewer resources and achieves superior performance on fine-grained span- and entity-level localization. We also release EnokiQA, a dual-granularity dataset with aligned claim-level verification and span-level localization annotations.
114. 【2609.00579】Predicting Program Exit Code with LLMs and Programming Language Semantics
链接：https://arxiv.org/abs/2609.00579
作者：Lara Marinov,Aditya Thimmaiah,Jayanth Srinivasa,Junyi Jessy Li,Milos Gligoric
类目：Programming Languages (cs.PL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Large language models, Large language, software engineering tasks, generation and translation, shown proficiency
备注： Accepted at LMPL 2026
点击查看摘要
Abstract:Large language models (LLMs) have shown proficiency in various software engineering tasks, such as code generation and translation. However, a key limitation in their performance may be their (lack of) understanding of programming-language semantics. Even when explicit semantics are given, it remains unclear whether LLMs apply those rules or lean on priors learned during pre-training instead. We study if LLMs lean on priors or given semantics with a novel task--Program Executability Prediction (PrEx)--that asks models to predict whether a program is semantically valid or invalid (and, if invalid, which formal rule it violates) given the program's syntax and operational semantics. Because PrEx requires both valid and invalid programs, we build a dataset with systematically generated invalid transformations derived from valid programs. We evaluate open-source coding LLMs under two semantic formalisms and two semantic shifts across Human-Written, LLM-Translated, and Fuzzer-Generated program splits. Our findings show that LLMs lean on pre-training priors rather than systematically applying the given rules, performing especially poorly on modified semantics and degrading further as program complexity increases. PrEx is available at this https URL.
115. 【2609.00576】Consistency Without Alignment: Item-Sensitive Language Models Indistinguishable From Random
链接：https://arxiv.org/abs/2609.00576
作者：Cris Huynh
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：model choice depends, output prior, choice depends, specific input, widely reported
备注： 13 pages, 3 figures
点击查看摘要
Abstract:Item-sensitivity, defined as whether a model's choice depends on the specific input rather than on its own output prior, is widely reported as evidence of task competence. We show this evidence is necessary but not sufficient using a forced-choice signalling task abstracted from the board game Deception: Murder in Hong Kong. In this environment, the reference points against which a coordinate should be judged (a fit-maximising strategy, a posterior-maximising strategy, and uniform random selection) are all computable in closed form. Across seven language models, two model families, a post-training ablation, and three independent scoring rules, every one of 21 model-by-rule cells is reliably item-sensitive. Yet 8 of those 21 cells are not statistically distinguishable from a chooser that ignores the item and selects at random, and 5 score worse than random at describing the target. Item-sensitivity and distance from random correlate at only r = 0.30. We call this consistency without alignment and argue it generalises to any evaluation that relies on item-sensitivity, permutation consistency, or self-consistency without an independent reference for the measured quantity. We further find that a literal-similarity baseline with no pragmatics outperforms most tested language models, that adding a pragmatic layer over two baseline similarity sources moves choosers toward random rather than toward the Bayesian reference, and that a standard labelled multiple-choice format carries no measurable content signal here. All results represent the model side of a pre-registered instrument; a matched human condition is designed and piloted but not yet collected.
116. 【2609.00565】Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
链接：https://arxiv.org/abs/2609.00565
作者：Jingshen Zhang,Shaoyang Xu,Wenxuan Zhang
类目：ocial and Information Networks (cs.SI); Computation and Language (cs.CL)
关键词：building culture-aware large, culture-aware large language, large language models, existing optimization exclusively, systematically obscuring inherent
备注： Accepted at EMNLP 2026 (Findings)
点击查看摘要
Abstract:Cultural fine-tuning has become the de facto paradigm for building culture-aware large language models (LLMs), yet existing optimization exclusively for alignment scores provides an incomplete portrait of cultural fidelity by systematically obscuring inherent cultural diversity. This unidimensional evaluation lens prompts a fundamental question: do models genuinely perceive distinct cultural nuances, or do they merely memorize dominant cultural values? To address this, we propose a synergistic evaluation framework that jointly formalizes cultural alignment and diversity. Through extensive benchmarking of six mainstream LLMs on the World Values Survey, this framework uncovers a systematic and critical trade-off: the pursuit of cultural alignment consistently incurs an acute expense of diversity, leading to severe "cultural flattening." Investigating this behavioral shift, we demonstrate that these superficial alignment gains stem from models artificially anchoring to dominant majorities, converging onto a monolithic response pattern that wipes out the heterogeneous distributions inherent to human groups. Crucially, our mechanistic analysis suggests that this diversity collapse is not merely a behavioral anomaly but more likely a structural consequence of the low-rank bias inherent in neural network optimization. Therefore, our findings expose the limitations of current post-training paradigms and call for a shift toward alignment objectives that preserve cross-cultural pluralism.
117. 【2609.00551】EM^2Mem: Event-Centric Multimodal Memory for Large Language Models
链接：https://arxiv.org/abs/2609.00551
作者：Yijun Chen,Yaqi Zheng,Yanya Li,Boyi Xiao,Buqiang Xu,Shuofei Qiao,Jizhan Fang,Xinle Deng,Yunzhi Yao,Xuehai Wang,Liuxin Zhang,Hui Li,Huajun Chen,Shumin Deng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：long-video question answering, question answering, retrieve captions, offers a scalable, scalable interface
备注： Accepted by EMNLP 2026 findings
点击查看摘要
Abstract:Multimodal memory offers a scalable interface for long-video question answering, but existing methods often retrieve captions, frames, transcripts, summaries, or graph facts as isolated fragments. Although searchable, such fragments are not generation-ready: language models must reconstruct cross-modal and temporal alignments at inference time, when context is limited and attribution is difficult. We propose EM^2Mem, an event-centric multimodal memory framework that binds heterogeneous evidence to event anchors during memory construction. Each event-indexed memory cell aligns multimodal records, temporal context, graph-linked relations, semantic facts, and provenance, enabling compact evidence readout over grounded multimodal events rather than modality-specific fragments. Across three long-video QA benchmarks, EM^2Mem improves average accuracy over the strongest memory baseline by 2.0, 2.4, and 3.7 points, improves strict event-level Top-5 evidence recall by 7.0 points, and reduces per-query latency by 4.67 times and total inference tokens by 63.66% (The code will be integrated into this https URL).
118. 【2609.00550】Same Semantics, Different Outcome: On the Modality Robustness of Multimodal LLMs under Knowledge Conflict
链接：https://arxiv.org/abs/2609.00550
作者：Jungyeon Lee,Yejin Yoon,Taeuk Kim
类目：Computation and Language (cs.CL)
关键词：Multimodal large language, large language models, large language, increasingly provided, provided with contextual
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Multimodal large language models (MLLMs) are increasingly provided with contextual evidence in heterogeneous forms: as a text passage, as a rendered image of the same passage, or as both together. However, it remains unclear how consistently these surface forms are processed, especially when the evidence conflicts with the model's parametric knowledge. We study modality robustness under knowledge conflict across 13 MLLMs and two datasets, and find them far from robust. (1) Contrary to common belief, models favor a context that contradicts parametric knowledge more readily in image form than in text form; (2) when a contradicting text and image are presented together, the preferred modality is essentially arbitrary, varying with input order, model, and dataset. We further demonstrate that this instability has practical consequences: it degrades performance in multimodal RAG and can be exploited by adversarial attacks. To alleviate this brittleness, we examine several simple techniques---prompting, steering, supervised fine-tuning (SFT), and direct preference optimization; the majority prove ineffective, whereas SFT achieves moderate success. We therefore call for greater awareness of this inconsistency and argue that it is fundamental, demanding attention at multiple training stages.
119. 【2609.00549】Skill Following: Evaluating Actual Skill Use in Retrieval-Enabled LLM Agents
链接：https://arxiv.org/abs/2609.00549
作者：Seonghyeon Cho,Chanjun Park
类目：Computation and Language (cs.CL)
关键词：Large Language Model, Large Language, agents increasingly rely, standard evaluations obscure, Language Model
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Large Language Model (LLM) agents increasingly rely on external skills, yet standard evaluations obscure whether retrieving these skills actually helps. Aggregate metrics often compare retrieved versus non-retrieved tasks, introducing severe selection bias and failing to isolate the true effect of skill use. To measure this actual-use capability-which we formalize as Skill Following (SF)-we introduce the Retrieval-Invoked Actual-Use Effect (RAE). RAE computes the same-task outcome difference between matched skill-enabled and skill-disabled executions, conditioned exclusively on tasks where the agent actively retrieved a skill. Evaluating 17 LLMs across coding and mathematical domains, we uncover a stark evaluation paradox: models frequently show positive aggregate retrieval lift but negative RAE. On MBPP+, multiple models that appear to benefit system-wide actually harm their own performance on the exact tasks where retrieval occurred. These findings demonstrate that aggregate averages can create a misleading illusion of tool-use proficiency, whereas RAE directly measures whether the retrieval-to-answer pipeline genuinely rescues more outcomes than it harms.
120. 【2609.00515】he Interlingua Hypothesis: LLMs Translate via a Latent Task-agnostic Feature Space
链接：https://arxiv.org/abs/2609.00515
作者：Jacob Brinton,Jannik Brinkmann,Mark Crovella,Aaron Mueller
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：strong supervised baselines, recently demonstrated improved, demonstrated improved machine, supervised baselines, improved machine translation
备注： 21 pages, 15 figures, 11 tables
点击查看摘要
Abstract:Large language models (LLMs) have recently demonstrated improved machine translation performance over strong supervised baselines. This raises questions as to what mechanisms underlie how LLMs perform machine translation between languages. Motivated by recent interpretability findings--namely, that LLMs use massively multilingual latent feature representations to perform language modeling--we propose the interlingua hypothesis. The hypothesis holds that language models translate by reading a source sentence into a latent feature space, and generate a target sentence by reading from the latent feature space. We show three lines of evidence in support of this hypothesis: (1) variance in BLEU across language pairs is largely predictable from language-specific competences with no language pair-specific interaction terms; (2) many model components are causally influential in both monolingual tasks and translation tasks; and (3) fine-tuning on monolingual data recovers a large proportion of translation improvements relative to fine-tuning on aligned documents. Together, these provide convergent evidence in support of the interlingua hypothesis, and suggest new ways of understanding and improving how LLMs can be leveraged to perform translation tasks.
121. 【2609.00495】Beyond Token Positions: Safety Alignment Across Denoising Steps in Diffusion Language Models
链接：https://arxiv.org/abs/2609.00495
作者：Guoli Wang,Haonan Shi,Tu Ouyang,An Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Diffusion large language, large language models, Diffusion large, language models, generate text
备注： Accepted by EMNLP 2026
点击查看摘要
Abstract:Diffusion large language models (dLLMs) generate text through iterative denoising rather than left-to-right decoding. This generation paradigm introduces two axes that can influence safety alignment: when tokens are generated during denoising and where they appear in the response. In this paper, we measure dLLM safety behavior under harmful prompts by tracing intermediate token distributions and commitment decisions throughout denoising. Our analysis shows that refusal signals are concentrated in early denoising steps and leading response positions, and the tokens committed early can strongly shape the final safety outcome. Our measurements further show that the denoising step and persistence of refusal-token commitment are important for understanding dLLM safety. Based on these findings, we propose Refusal-Aware Early Commitment (RAEC), a simple training-free decoding method that commits persistent refusal signals from early steps. Experiments on LLaDA and Dream show that RAEC reduces attack success rates while largely preserving utility. The code is available at this https URL.
122. 【2609.00494】Human-Anchored Factuality Evaluation with Strategic Annotation
链接：https://arxiv.org/abs/2609.00494
作者：Yu Wang,Craig Erickson,Kevin Small
类目：Computation and Language (cs.CL)
关键词：systematically biased relative, judges provide scalable, provide scalable evaluation, LLM-based factuality judges, factuality judges provide
备注： Accepted as a conference paper for Industrial Track of EMNLP 2026
点击查看摘要
Abstract:LLM-based factuality judges provide scalable evaluation signals, but their metrics are often systematically biased relative to human judgments. We study human-anchored factuality evaluation under limited annotation budgets, where judge predictions on the full dataset are combined with human labels on a small selectively sampled subset to obtain statistically valid estimates. The efficiency of this approach depends critically on which examples receive human annotation: in factuality evaluation, judge-human misalignment is not driven solely by low confidence, but also by structured failure modes such as incomplete evidence, temporal mismatch, unverifiable claims, and rubric misalignment. To exploit this structure, we introduce a factuality-specific annotation policy design pipeline that uses failure-space analysis (FSA) to derive diverse predictive signals for modeling human-judge misalignment. On an internal reference-based factuality evaluation system (AutoFA) and RAGTruth, where judge-predicted estimates substantially underestimate human-annotated factual accuracy, our FSA-guided policy improves annotation efficiency over uniform sampling and uncertainty-driven baselines, achieving effective-sample-size gains of 40.3% on AutoFA and 27.1% on RAGTruth.
123. 【2609.00492】he Privacy-Hallucination Tradeoff in Differentially Private Language Models
链接：https://arxiv.org/abs/2609.00492
作者：Krithika Ramesh,Krishna Pillutla,Danish Pruthi,Anjalie Field
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：domains like healthcare, paramount in high-stakes, high-stakes domains, Abstract, factual accuracy
备注： Accepted to EMNLP 2026 (Findings)
点击查看摘要
Abstract:Both privacy and factual accuracy are paramount in high-stakes domains like healthcare. Concerningly, we uncover and investigate a privacy-hallucination tradeoff in differentially private (DP) language models. First, we empirically show that models pre-trained or fine-tuned with DP tend to produce more hallucinations than non-DP counterparts, with increased severity as the privacy budget grows stricter. Second, we investigate model properties driving this tradeoff, demonstrating that DP mechanisms flatten output distributions, potentially redistributing probability mass toward factually incorrect alternatives. Third, through experiments where we control fact frequency in training data, we characterize how information frequency can reduce hallucination risks in DP models. Overall, our findings underscore the need for more nuanced privacy-preserving interventions that offer rigorous privacy guarantees without compromising factual accuracy.
124. 【2609.00491】MemeBridge: A Dataset for Benchmarking and Mitigating the Bidirectional Cultural Gap in Meme Interpretation
链接：https://arxiv.org/abs/2609.00491
作者：Hangxiao Zhu,Suliu Qin,Zhuoyan Li,Ming Jiang,Yu Zhang,Meng Xia
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：inherently challenging, dense and ambiguous, ambiguous formats, Communicating across cultures, Communicating
备注：
点击查看摘要
Abstract:Communicating across cultures is inherently challenging, especially through culturally dense and ambiguous formats like memes. While people expect large language models (LLMs) to hold promise for bridging such gaps, existing benchmark datasets often fail to capture the cultural context necessary for accurate interpretation. To address this, we introduce MemeBridge, a curated dataset centered on U.S.-originated memes, designed to capture two complementary perspectives: (1) how Chinese participants interpret these memes, and (2) how U.S. participants anticipate how people from other cultures might misunderstand them. Here, context refers to implicit cultural knowledge, including background beliefs, norms, and shared assumptions that shape meme comprehension. The dataset was constructed via a multi-stage crowdsourcing pipeline with rigorous validation, including human agreement checks and GPT-based classification verification. Each meme is annotated with sentiment, emotion, cultural significance, and knowledge type, providing rich supervision for downstream tasks. Notably, we observe that the anticipated misunderstandings from U.S. participants are often inaccurate, highlighting the asymmetries in cultural understanding and the challenges of adopting perspectives beyond one's own. This bidirectional framing, which focuses on both expression and perception, enables more nuanced benchmarking of cross-cultural comprehension. Our probing of multiple LLMs reveals that while models developed in different cultural contexts exhibit partial cross-cultural understanding, they often struggle with sophisticated interpretations. By contrast, fine-tuning with MemeBridge improves model performance, underscoring the value of culturally grounded resources for training and evaluating LLMs in globally diverse settings.
125. 【2609.00487】EvoFlint: An Evolutionary Atlas of Multi-Turn LLM Vulnerabilities
链接：https://arxiv.org/abs/2609.00487
作者：Feitong Qiao,Liren Peng,Shiming Ren,Aishwarya Jadhav,Arghavan Bahadorinejad,Marinette Chen,Muhan Zhang,Abdulaziz Suria,Gennevi Lu,Anish Das Sarma
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：Frontier language models, refuse harmful single-turn, understood failure modes, large language models, Frontier language
备注：
点击查看摘要
Abstract:Frontier language models that refuse harmful single-turn prompts often comply when the same intent is reached gradually over many turns, making multi-turn attacks one of the least understood failure modes of large language models. Most automated red-teaming methods treat this as a generation problem: produce attacks that break the model. We argue it is better framed as a search problem: discover, organize, and iteratively refine a diverse archive of attack strategies, producing a structured map of how a target model fails rather than a list of one-off successes. We introduce EvoFlint, which applies evolutionary quality-diversity search to multi-turn red-teaming. Attack strategies are phased conversation plans, not raw prompts, and are evolved through LLM-driven mutation and crossover. A Pareto fitness over attack success rate and peak severity preserves selection signal from near-miss attacks. A risk-indexed archive runs novelty search with local competition over strategy description embeddings inside each cell, maintaining diversity without committing to a predefined style taxonomy. A generation-level memory accumulates target-model insights across the population and feeds them back into strategy generation. On the HarmBench-test split, EvoFlint reaches attack success rates of 35.8% on Claude Sonnet 4.6, 59.7% on GPT-5.4, and 94.3% on Qwen3-32B, alongside 98.7% on the older GPT-4o included as a baseline reference. The resulting archive, organized by risk category, exposes for each target which categories of harm its safety training has and has not covered.
126. 【2609.00482】Are Near-Tied LLM Rankings Robust to Family-DIF-Guided Benchmark Recomposition?
链接：https://arxiv.org/abs/2609.00482
作者：Qiaoyuan Zheng,Yiqu Yang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Small leaderboard gaps, Small leaderboard, sign may depend, Small, language model
备注： Code and data artifacts will be released
点击查看摘要
Abstract:Small leaderboard gaps are often interpreted as evidence that one language model is better than another, but their sign may depend on which benchmark items are included. We test this using item-level responses from five benchmarks and a family-label-free spectral approximation to multidimensional item-response theory (MIRT). In owner-disjoint folds, one owner half identifies items with low residual differential item functioning across model families (low-DIF); the resulting frozen, source- and easiness-balanced weights score models in the other half, while equally short matched-random subtests control for generic subtest variation. Full-benchmark and low-DIF rankings remain strongly correlated ($\tau_b=.900$--$.948$). Yet in four of five benchmarks, 30.9--47.1\% of cross-family pairs initially within one percentage point reverse order, exceeding their matched-random medians by 16.9--28.6 percentage points (all $p=.001$). The fifth benchmark shows no reliable excess ($-0.9$ points, $p=.689$). The pattern survives all pre-specified population perturbations, and residual item--family signatures replicate across owner halves; however, no family shows a consistent advantage across benchmarks. Thus, globally stable rankings can still leave individual near-tie orderings sensitive to benchmark composition, and sub-one-point leaderboard gaps should be accompanied by evidence that the implied ordering is composition-robust.
127. 【2609.00474】Exploring Collaboration between a language and a non-language agent
链接：https://arxiv.org/abs/2609.00474
作者：Harini S I,Somesh Singh,Yaman K Singla,Rajiv Ratn Shah,David Doermann,Balaji Krishnamurthy
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：coordinate specialized subagents, increasingly deployed, deployed as orchestrators, orchestrators that coordinate, coordinate specialized
备注： Accepted at EMNLP 2026
点击查看摘要
Abstract:LLMs are increasingly deployed as orchestrators that coordinate specialized subagents to solve complex tasks through natural language. However, in many important domains like game playing and robotics, the strongest available agents are not language models. Integrating non-language agents with LLMs would require \emph{verbalization}: compressing their rich continuous representations into sparse textual summaries at each interaction step. To study whether verbalization constitutes a bottleneck, we introduce \textsc{LLAMIA-Bench}, a suite of six diverse collaborative chess tasks spanning three facets: behavioral imitation, state assessment, and natural-language explanation. Each task instantiates a well-established chess problem that neither the LLM nor the chess engine can solve alone. To solve LLM collaboration with non-language agents, we introduce \emph{latent state internalization}, which projects the subagent's continuous representations directly into the LLM's token stream as learned state tokens, with dynamic re-encoding as actions advance the environment state. Comparing internalization to verbalized integration, our experiments reveal a consistent \emph{verbalization debt}: the performance gap widens throughout training and persists as the LLM scales from 4B to 14B parameters. A single 14B model, \textsc{LLAMIA}, trained with latent state internalization, matches or exceeds task specialists and frontier models including GPT-5.1 with tool access across all benchmark tasks, and generalizes out-of-distribution where task-specific finetunes collapse
128. 【2609.00470】RIS: A Tri-Layer Retrieval Integrity Sieve Against Knowledge Poisoning
链接：https://arxiv.org/abs/2609.00470
作者：Muhaimin Bin Munir,Akib Jawad Ononto,Nazia Shehnaz Joynab,Bhavani Thuraisingham,Latifur Khan
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：grounds large language, large language models, critical attack surface, dominate dense retrieval, retrieved documents creates
备注： 15 pages, 2 figures, 10 tables. Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) grounds large language models in external corpora, but implicit trust in retrieved documents creates a critical attack surface: PoisonedRAG shows that a handful of crafted passages can dominate dense retrieval and steer generation toward attacker-chosen answers. We present the Tri-Layer Sieve, a middleware defense that sanitizes retrieved evidence through cross-embedding-space clustering with an independent judge model, structural filtering of trigger-payload artifacts, and LLM consistency verification. The design exploits a key weakness of retrieval-stage poisoning: a single document must satisfy one embedding geometry, one internal Trigger-Payload structure, and one generation objective - rarely all three simultaneously, a fragility that persists even against an adaptive attacker who paraphrases around it. On Natural Questions, HotpotQA, and MS-MARCO with Contriever retrieval (k=50), the Sieve reduces black-box Attack Success Rate from 67.0/87.0/64.0% to 3.0/14.0/4.0%, mitigates white-box HotFlip attacks from ~74% to 27.8% on NQ with Layer 3 enabled, and drives poisoned-document MRR to 0.000, while restoring clean accuracy from 13-33% under attack to 58-76%. Under an architecture-aware adversary who paraphrases triggers to evade the structural filter, enabling the consistency layer halves adaptive ASR (32.0% to 15.0% on NQ) while raising clean accuracy by 18 points, at an added latency of ~16-19 s/query under live retrieval.
129. 【2609.00463】oppling the Hierarchy in Byte-level Language Modeling
链接：https://arxiv.org/abs/2609.00463
作者：Lukas Edman,Alexander Fraser
类目：Computation and Language (cs.CL)
关键词：work examines recent, examines recent byte-level, perfectly manipulate characters, recent byte-level models, work examines
备注：
点击查看摘要
Abstract:This work examines recent byte-level models and their failure to perfectly manipulate characters. State-of-the-art byte-level models use a hierarchical structure, starting at the byte level, downsampling to the word level, and then upsampling back to bytes. While this improves training and inference efficiency, we find that the hierarchical design itself limits character-level understanding, with pure byte-level models consistently outperforming hierarchical variants on character manipulation tasks. Ablating transformer layers into attention and feed-forward components further reveals that byte-level attention is the primary mechanism driving this behavior. Together, our results provide an explanation for the character-level failures of hierarchical byte models and establish a clear trade-off between computational efficiency and fine-grained character understanding.
130. 【2609.00454】Location-Aware Language Models via Secondary Embeddings
链接：https://arxiv.org/abs/2609.00454
作者：Gokul Srinivasagan,Munir Georges
类目：Computation and Language (cs.CL)
关键词：Pretrained transformer-based language, encoding geo-locational semantics, achieve strong performance, language models achieve, models achieve strong
备注： Accepted for publication at the 29th International Conference on Text, Speech and Dialogue (TSD 2026)
点击查看摘要
Abstract:Pretrained transformer-based language models achieve strong performance across a wide range of NLP tasks but remain limited in encoding geo-locational semantics, leading to suboptimal representations of place names and spatial entities. In this work, we propose a lightweight, model-agnostic approach for injecting geo-spatial awareness into pretrained embeddings without modifying the tokenizer or requiring costly retraining. Our method augments input representations with structured geographic signals by combining location names with their corresponding latitude and longitude, and employs a location-focused masking to better align textual representations with real-world spatial relationships. This design allows the model to incorporate geo-spatial context while preserving existing semantic and syntactic knowledge. Experimental results demonstrate substantial improvements in geo-spatial alignment while maintaining comparable performance on standard NLP benchmarks such as GLUE. The method is computationally efficient, requiring only minutes of additional training, and generalizes across multiple model architectures and scales.
131. 【2609.00444】Group Adaptive Clipping Policy Optimization
链接：https://arxiv.org/abs/2609.00444
作者：Sheng Jia,Xiao Wang,Shiva Prasad Kasiviswanathan,Rein Houthooft
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：relative policy optimization, Group relative policy, Clipping Policy Optimization, policy optimization, Adaptive Clipping Policy
备注： Accepted at EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Group relative policy optimization for reinforcement learning with verifiable rewards (RLVR) typically uses a fixed importance-sampling (IS) ratio clipping boundary across all rollouts. We identify a key limitation: rare correct rollouts on harder problems and abundant correct rollouts on easier problems are clipped at comparable rates, despite contributing very different learning signals. Rollouts with low group success exhibit larger IS ratios and carry stronger gradient signal for exploration and solving new problems, yet are disproportionately suppressed by fixed clipping. To address this, we propose Group Adaptive Clipping Policy Optimization (GAPO), a plug-in modification to GRPO methods that adapts the clipping boundary to the rollout advantage. GAPO is motivated by a reverse-KL trust-region perspective, which suggests that rollouts with larger learning signal should receive proportionally greater update headroom. GAPO requires no reward shaping and preserves the standard PPO/GSPO surrogate while adapting only the clipping threshold. Across Qwen and Llama models, GAPO consistently improves both Pass@1 and Pass@k over fixed clipping and advantage-shaping baselines on math reasoning and coding benchmarks where the pass rates by the base model are relatively low.
Comments:
Accepted at EMNLP 2026 (Main Conference)
Subjects:
Machine Learning (cs.LG); Computation and Language (cs.CL)
Cite as:
arXiv:2609.00444 [cs.LG]
(or
arXiv:2609.00444v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2609.00444
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
132. 【2609.00443】(V)LMs generalize beyond surface co-occurrence: Evidence from cross-modal number agreement
链接：https://arxiv.org/abs/2609.00443
作者：Zach Studdiford,Kanishka Misra
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Language models learn, specific lexical items, grammatical number primarily, show frequency effects, learn abstract
备注： 9 pages main text
点击查看摘要
Abstract:Language models learn about grammatical number primarily from co-occurrence, and show frequency effects as a result---sometimes taken to indicate that they do not learn abstract ``rules'', and are instead dependent on specific lexical items. Testing generalization with text stimuli alone cannot settle this debate, since distributional cues (is/are, this/these) easily give number away. We instead use cross-modal generalization as a tool to investigate abstractions in LMs that can also accept visual inputs (VLMs), restricting the evidence that diagnoses number to an extra-linguistic modality. We teach VLMs pairs of new nouns by adding new embeddings and only updating them during learning, comparing conditions where number is diagnosed by visual cues alone against ones where it is disambiguated by text. Across behavior, representational dynamics, and causal mechanisms, we find non-trivial evidence for cross-modal generalization across both exposure conditions, and that linguistic vs. extra-linguistic cue conditions are treated in similar ways in the internal mechanisms of the model. This suggests that statistical learners like VLMs can generalize beyond surface-level co-occurrence and show genuine abstraction-compatible behavior.
133. 【2609.00434】SAGE: State-Grounded, Abstention-Aware Evaluation of Task-Oriented Dialogue Agents
链接：https://arxiv.org/abs/2609.00434
作者：Rayan Khoury,Shih-Yao Lin,Pratyush Mishra
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Evaluating task-oriented dialogue, agents requires judging, distinction conventional holistic, conventional holistic LLM, dialogue agents requires
备注：
点击查看摘要
Abstract:Evaluating task-oriented dialogue agents requires judging not merely whether a reply reads well but whether each turn advances the underlying workflow state correctly--a distinction conventional holistic LLM judges can miss because they evaluate the available context as a single unit and require one or more full-model calls per turn. We propose SAGE (State-Grounded Abstention-Aware Evaluation), which compiles a workflow specification and per-turn state diff into atomic, schema-grounded criteria and routes each through a cascade of symbolic and encoder/NLI verifiers that abstain rather than guess, aggregating criterion verdicts into a turn-level decision with an evidence trace. Its recommended operating point, SAGE-Core, decides 81--91% of criteria with only the compiler, symbolic rules, and on-device encoders--at zero paid LLM cost--while SAGE-LLM adds an optional focused-LLM fallback for open-class criteria. Across four slices spanning MultiWOZ, Schema-Guided Dialogue, and ABCD, no evaluated LLM-as-a-judge baseline--including a state-aware GPT-4.1 judge and cheaper GPT-4.1-mini variants--significantly exceeds SAGE-Core on any slice, even though the GPT-4.1 G-Eval judge costs $4.7--8.0 per 1,000 turns to SAGE-Core's $0. A two-annotator human audit (n=200, $\kappa$=0.94) confirms strong label fidelity on the transcript-visible failure classes--where, excluding the weak-salience IUV class, SAGE-Core is statistically tied with the strongest LLM judge--and honestly scopes ignored-user-value as a state-consistency signal with weak broad-human salience. We analyze construct-validity limits from injected failures and partial symbolic circularity.
134. 【2609.00416】Late Transformer Layers Recode Syntax Canonically: Evidence from Greek Scrambling and Cross-Layer Generalisation
链接：https://arxiv.org/abs/2609.00416
作者：Christos Nikolaos Zacharopoulos,Revekka Kyriakoglou,Chara Tsoukala,Théo Desbordes
类目：Computation and Language (cs.CL)
关键词：remains poorly understood, layers remains poorly, poorly understood, Probing studies, remains poorly
备注： 10 pages, 3 main figures, 2 appendices. Code and stimuli: [this https URL](https://osf.io/5d3w8/)
点击查看摘要
Abstract:Probing studies have established that syntactic information is decodable in early and middle transformer layers, but what happens to that information in later layers remains poorly understood. We apply a cross-layer generalisation analysis to three Greek-tuned large language models evaluated on tightly controlled minimal pairs: object-relative constructions in Modern Greek, where canonical (Subject-Verb-Object; SVO) and non-canonical (Verb-Subject-Object; VSO) orders differ only in within-clause word order, while preserving propositional meaning. When a probe trained on late layers (20-31) is tested on each early layer individually, it produces below-chance transfer (cluster-corrected, p0.01), classifying 99.3% of non-canonical sentences as canonical. Probe coefficients reverse sign around layer 22, indicating a directional recoding toward the canonical form rather than simple information loss. These findings characterise a representational format change in late transformer layers that goes beyond the well-established decline in syntactic decodability, and they generate a directly testable prediction for human EEG and MEG decoding studies using the same stimuli. Code and stimuli are publicly available on OSF.
135. 【2609.00378】Removable and Irreducible: A Token-Cost Ledger for the Multilingual Tokenization Tax
链接：https://arxiv.org/abs/2609.00378
作者：Madhulatha Mandarapu,Sandeep Kunkunuru
类目：Computation and Language (cs.CL)
关键词：Large language models, language models pay, Large language, models pay, pay a well-documented
备注： 9 pages, 3 figures. Code + one-command reproduction: [this https URL](https://github.com/samyama-ai/token-cost-ledger)
点击查看摘要
Abstract:Large language models pay a well-documented tax on non-English text: the same content costs several times more tokens, and because attention is quadratic in sequence length, far more compute. We ask how much of this tax is removable. Framing the token layer as source coding -- transformer compute is monotone in sequence length, whose per-atom floor is the Shannon rate $H/\log_2 V$, an object already applied to tokenizers in prior work -- we assemble a token-cost ledger that splits each language's cost, at fixed parallel content, into a removable coding redundancy, a residual coding slack, an intrinsic-content term, and an orthogonal, irreducible grapheme-to-phoneme term that governs the multimodal rather than the text cost. On FLORES-200 across eight languages, a production tokenizer costs up to $8.9\times$ more tokens for Indic scripts than for English; a script-matched code trained on $1,012$ sentences removes a median $64\%$ of that excess (bootstrap 95\% CI $[0.638, 0.647]$), and a script-fair information floor shows the intrinsic content differs by under $6\%$ -- the tax is representational, not informational. A constructed code removes $98\%$ of a controlled source's redundancy, and the token tax implies up to $79\times$ attention cost. We are explicit about scope and failure: this is compute-and-memory accounting, not a model-quality claim; we neither measure nor claim the cross-lingual direction of the orthographic term; and our matched code is a conservative small-data demonstration. We contribute the unifying ledger, the removable-versus-intrinsic attribution, and an open one-command harness.
136. 【2609.00367】Neurosymbolics for Data Engineering: Achieving Long Context Token Reduction Without Finetuning
链接：https://arxiv.org/abs/2609.00367
作者：Vishvesh Bhat
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large Language Models, complex spreadsheet operations, generating structured queries, automating complex spreadsheet, Large Language
备注：
点击查看摘要
Abstract:Large Language Models are increasingly deployed for sophisticated data engineering tasks such as generating structured queries from natural language, Text-to-SQL, and automating complex spreadsheet operations. However, maximizing their utility demands both higher finetuning-free accuracy and solutions to the computational bottleneck imposed by the Transformer architectures inherent quadratic (On2) time complexity. This paper introduces a novel drop-in neurosymbolic layer designed to seamlessly integrate into existing LLM backbones enhancing logical reasoning and mitigating long-context resource consumption. On the reasoning front, the layer immediately and significantly improves performance yielding an average accuracy increase of 85% across rigorous benchmarks including BIRD-CRITIC and LiveSQLBench, critically achieving these gains without any task specific finetuning or RLHF. Concurrently, we repurpose this approach to address the severe computational strain of long context inference. By leveraging symbolic processing to prioritize and compress relevant contextual information the layer reduces the effective token usage by over 50% and brings the effective time complexity down from O(n2) to approximately O(n) on certain long context tasks. This dual impact approach not only makes LLMs substantially more reliable for data engineering but also drastically reduces the computational pressure on inference chips, making long context tasks more manageable and cost effective.
137. 【2609.00365】Dr. Claw: An AI Scientist Workspace for Vibe Research
链接：https://arxiv.org/abs/2609.00365
作者：Dingjie Song,Hanrong Zhang,Dawei Liu,Yixin Liu,Zongxia Li,Zhengqing Yuan,Siqi Zhang,Henry Peng Zou,Zhiling Yan,Yuxuan Zhang,Yanfang Ye,Philip S. Yu,Lichao Sun
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Claude Code, Gemini CLI, sustain long sessions, Command-line coding agents, long sessions
备注： Accepted to EMNLP 2026 System Demonstrations. Code: [this https URL](https://github.com/OpenLAIR/dr-claw)
点击查看摘要
Abstract:Command-line coding agents (e.g., Claude Code, Gemini CLI) can already read and write files and sustain long sessions, yet end-to-end research still fragments across chat tools, IDEs, terminals, and writing environments, and the decisions that make it auditable are rarely preserved. We present Dr. Claw, an open-source workspace that wraps existing coding-agent executors in a controllable and auditable human-in-the-loop workflow rather than introducing another autonomous agent. Persistent state objects, a reusable skill library, and multi-executor coordination link human decisions to AI execution, turning planning, execution, and writing into one traceable, recoverable loop. We demonstrate Dr. Claw through an interactive three-view scenario and a failure-recovery walkthrough, and evaluate it against a bare command-line agent sharing the same backend executor, so the comparison contrasts the whole orchestration layer (task graph, state objects, and skill library) with the agent it wraps. Holding the executor fixed, Dr. Claw scores higher on research completeness while persisting an auditable, recoverable process trail. Demo access: repository this https URL, released under AGPL-3.0 with GPL-3.0 upstream components.
138. 【2609.00361】Detoxifying Toxic Communication: A Design Science Approach to Responsible AI
链接：https://arxiv.org/abs/2609.00361
作者：Hossein Arshadi Soufiani,Henry M. Kim,Hjalmar Turesson,Syed Mohammad Arham Noman,Anav Setia
类目：Computers and Society (cs.CY); Computation and Language (cs.CL)
关键词：erode trust, language in digital, digital workplaces, subtle incivility, incivility can erode
备注： 10 pages. An updated version appears in the Proceedings of the 60th Hawaii International Conference on Systems Science (HICSS-60), Honolulu, HI, January 5-8, 2027
点击查看摘要
Abstract:Toxic language in digital workplaces such as pejoratives, sarcasm, condescension, and subtle incivility can erode trust, morale, and collaboration. Existing moderation tools primarily delete or block harmful messages, disrupting communication and offering no constructive resolution. This study adopts a Design Science Research approach to create a responsible AI artifact that detects and detoxifies toxic communication. The artifact integrates fine-tuned transformer-based classifiers (DistilBERT, DistilRoBERTa) with a generative detoxification model (mT0-XL-Detox-ORPO) that rewrites toxic text into semantically equivalent, non-offensive paraphrases. Technical evaluation demonstrates high accuracy in toxicity detection and strong semantic preservation in rewritten messages, supporting conversation continuity while reinforcing respectful discourse. The paper contributes design principles for responsible AI moderation that prioritize meaning preservation and fairness.
139. 【2609.00355】Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Models
链接：https://arxiv.org/abs/2609.00355
作者：Jungseob Lee,Seongtae Hong,Dongyub Jude Lee,Chanjun Park,Jaehyung Seo,Sugyeong Eo,Heuiseok Lim
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Speculative decoding accelerates, decoding accelerates generation, Speculative decoding, changing its output, accelerates generation
备注： 18 pages, 9 figures, 17 tables. Code: [this https URL](https://github.com/js-lee-AI/GLANCE)
点击查看摘要
Abstract:Speculative decoding accelerates generation without changing its output, yet on vision-language models (VLMs) it has been caught in a self-defeating cycle. The drafter stays autoregressive, so it must stay small. A small drafter cannot afford the image at every step, so vision is compressed, pruned, or hidden. A drafter cut off from the image is then least reliable exactly where the image makes text predictable. We present GLANCE, the first one-pass block drafter that is lossless on an unmodified VLM target, and it breaks the cycle at both ends. A block-diffusion head reads the target's already-fused vision-language state, so vision costs the drafter nothing, and fills a whole block in one forward pass, so depth costs no sequential steps. A wide candidate tree is verified in one target pass, and every audited prompt reproduces greedy decoding exactly. Grounded workloads reward this most, entering a verbatim-copy regime whose long runs cost an autoregressive drafter a pass for every token and a block drafter one in total. Under one engine and one round budget, GLANCE decodes up to 2.93x faster than autoregression, from one draft pass a round where the production EAGLE3-VL head takes eight, and accepts 2.7x longer blocks than an EAGLE-3 head trained on the same corpus. One law organizes these results. Accepted length is set by the target's next-token entropy, with a fitted slope that steepens with grounding across all five tasks. The law transfers across targets and modalities and names its own boundary, since free-running text still favors a chain. Our code is available at this https URL.
140. 【2609.00351】Detecting Hidden Behaviors in LLMs via Activation-matched Finetuning
链接：https://arxiv.org/abs/2609.00351
作者：Robin Haselhorst,Lucie Flek,Florian Mai
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：sleeper-agent deployment cues, Large language models, narrow conditions, sleeper-agent deployment, deployment cues
备注： under review
点击查看摘要
Abstract:Large language models can hide hidden behaviors that activate only under narrow conditions, such as backdoor triggers, sleeper-agent deployment cues, sandbagging, or topic-conditioned censorship. Such behaviors are difficult to detect without prior knowledge what to look for. We present activation-matched finetuning, an unsupervised detection method that assumes no knowledge of the trigger or the target behavior. Given a suspect model and a publicly available anchor, we finetune the anchor to reproduce the suspect's activations on a small benign corpus, and score each evaluation prompt by the residual between the two models. Since no benign corpus covers the sparse trigger region, the reference learns the benign computation but not the hidden behavior. Therefore, trigger prompts -- and, crucially, their semantic neighbors -- incur a large residual that signal the presence of unusual behavior to the defender. Testing our method across third-party models and custom models, activation-matched finetuning surfaces hidden behavior reliably. Furthermore, we empirically consider a natural defense-aware attack and showcase that it fails to suppress our detection method without sacrificing the behavior itself.
141. 【2609.00344】From Tool Use to Technological Agency: LoopCAT as a Local-First, Open-Source Tool for Translation Technology Education
链接：https://arxiv.org/abs/2609.00344
作者：Gokhan Dogru,Adrià Martín Mor
类目：Computation and Language (cs.CL)
关键词：judge the choices, translation technologies, choices those technologies, technologies make, local-first computer-assisted translation
备注：
点击查看摘要
Abstract:Translation students need to learn both how to use translation technologies and how to judge the choices those technologies make available. This article presents LoopCAT, an Apache-2.0-licensed, local-first computer-assisted translation environment co-created with OpenAI Codex using GPT-5.5 and GPT-5.6, and proposes a framework connecting workflow competence, evaluative judgement, and technological agency. The account draws on repository history, implementation inspection, and the verification records of an identified development build. LoopCAT combines local project storage, translation memories, terminology, quality assurance, document exchange, and optional connections to local or hosted AI services. Its English, Catalan, and Turkish interface catalogs also make the application itself available as teaching material: students can translate English UI strings into another language, review the existing automatically generated target drafts, import their revisions, and test the interface. We organize these opportunities around four forms of participation: operating a workflow, evaluating outputs, inspecting and configuring mechanisms, and making or defending a bounded intervention. A six-session sequence, a UI-localization assignment, a placeholder example, and an assessment rubric specify how teachers could use the framework. The paper separates implemented capabilities from proposed educational benefits; it reports no new student-learning outcomes. It distinguishes the latest package checks from earlier regression evidence and sets out a protocol for classroom evaluation. LoopCAT provides an inspectable setting for teaching how translation decisions interact with data, interfaces, and software rules. Whether these activities improve judgement, transfer, or participation remains an empirical question.
142. 【2609.00335】wo locked tests of phase-structure features for transition prediction
链接：https://arxiv.org/abs/2609.00335
作者：Abraham Chachamovits
类目：Computation and Language (cs.CL)
关键词：phase-derived features improve, features improve prediction, pre-specified empirical tests, published theoretical account, phase-derived features
备注： 7 pages. Empirical follow-up to [arXiv:2607.25507](https://arxiv.org/abs/2607.25507) . Both pre-specified tests are null
点击查看摘要
Abstract:A published theoretical account of phase structure in rotary attention was subjected to two pre-specified empirical tests of whether phase-derived features improve prediction of a commitment or contradiction endpoint over a baseline that does not receive those features. Study 1 froze a contradiction-category pipeline and scored a sealed primary comparison of PC-2 against baseline. On 1,136 eligible cases the paired AUROC difference was +0.00087. The 99% interval included zero, and the difference did not reach the pre-specified threshold of +0.05. Advancement was not passed. Study 2 developed fifteen layer treatments on open blocks b0-b4 only (1,415 transitions, 20x5 grouped folds). A locked conjunctive rule required a positive PC-2 mean-repeat increment, a positive increment on at least four of five seed blocks, and a positive mean of those five differences. No treatment advanced. The official selection is null. The theoretical paper is not withdrawn. The extra ranking lift was not found under the rules locked in advance.
143. 【2609.00330】opic Matching in the Wild: Benchmark and Lessons from Real-World ASR Transcripts
链接：https://arxiv.org/abs/2609.00330
作者：Saman Rahbar,Xiliang Zhu,Irvin Cardoza,David Rossouw
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：real-time agent-assist tools, agent-assist tools determine, live customer utterance, Automatic Speech Recognition, contact centers
备注： Accepted at the 11th Workshop on Natural User-generated Text (W-NUT 2026), EMNLP 2026. Camera-ready version. 9 pages, 2 figures, 3 tables
点击查看摘要
Abstract:In contact centers, real-time agent-assist tools determine, for each of many predefined topics, whether a live customer utterance is relevant and display a coaching card to the agent when it is. The input is noisy and challenging: ASR(Automatic Speech Recognition) transcripts of spontaneous phone conversations, which can be unclear, repetitive, and mostly lack punctuation. To systematically study this real-world task, we curate a human-annotated topic-utterance judgments dataset sourced from real call-center transcripts. We compare three types of matchers: a regex-based baseline, zero-shot sentence embedding encoders, and Gemini-based LLM matchers. In addition, two types of topic representations are studied in our benchmark:keyphrases and natural language description. Our empirical experiments highlight the superior performance of lightweight LLM matchers over embedding and regex models when equipped with natural language descriptions.
144. 【2609.00329】he Curse of Multilinguality in Lexical Normalization
链接：https://arxiv.org/abs/2609.00329
作者：Saman Rahbar
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Lexical normalization rewrites, fill user-generated text, Lexical normalization, rewrites the noisy, non-standard words
备注： Accepted at the 11th Workshop on Natural User-generated Text (W-NUT 2026), EMNLP 2026. Camera-ready version. 7 pages, 3 figures, 3 tables
点击查看摘要
Abstract:Lexical normalization rewrites the noisy, non-standard words that fill user-generated text (tmrw, u, gr8) into their standard forms. Because labelled data is scarce for most languages, a popular shortcut is to train a single model on many languages at once. We ask a simple question: how many languages should such a model be trained on? Using one fixed-capacity character-level model and twelve languages from a standard benchmark, we vary the number of jointly trained languages from one to twelve and measure per-language accuracy. We find a clear curse of multilinguality: accuracy is highest when a language is trained with only a few others, often just one to four, and then falls steadily and substantially, dropping by about forty percent as the rest are piled on. A control that holds the total amount of training data constant makes the decline arrive sooner and fall further, which points to competition among the languages for one fixed-size model rather than to how much data is available. We also test whether a language's typological distance from the others predicts its ideal number of co-training languages, and find no dependable rule: any apparent relationship rests on a couple of languages and does not hold up. For compact normalization models, less can be more: a few languages beat pooling everything into a single model.
145. 【2609.00325】Latent Mechanisms of Language Control in Multilingual Language Models
链接：https://arxiv.org/abs/2609.00325
作者：Ryo Mitsuhashi,Sabri Boughorbel,Majd Hawasly
类目：Computation and Language (cs.CL)
关键词：large language models, unnecessarily alternating, Multilingual large language, exhibit unintended code-switching, Multilingual large
备注： 23 pages, accepted for presentation at EMNLP 2026 main track
点击查看摘要
Abstract:Multilingual large language models can exhibit unintended code-switching -- unnecessarily alternating between languages during generation. We present a comparative study of three methods that identify language-controlling latents in cross-layer transcoders: activation value-based selection (ValSel), activation frequency-based selection (FreqSel), and LLM-generated latent annotation-based selection (AnnSel). To evaluate the efficacy of these methods in identifying language-controlling latents, we introduce two multilingual benchmarks that exhibit code-switching for fine-grained analysis of language steering across seven languages. Through targeted intervention experiments on Gemma-2-2B and Qwen3-4B, we find that all three methods effectively manipulate generation language, with FreqSel achieving the strongest overall performance, while AnnSel offering interpretable latent selection through explicit language annotations. A knock-out analysis suggests the methods select non-overlapping but each-functional latent subsets, indicating redundancy rather than a single canonical language direction. Code and data can be found at this https URL.
146. 【2609.00319】Sources of Truth: A Multi-Platform, Multilingual Audit of Citations in AI Mental Health Information Queries
链接：https://arxiv.org/abs/2609.00319
作者：Phuong Anh Nguyen,Jill Noorily,Matthew Flathers,Haruka Notsu,Laura Ospina-Pinillos,Tommy Nguyen,Samantha Clark,Aoife Keane,Grace Thompson,John Torous
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Online health information, health information seeking, list of links, Online health, information seeking
备注： 28 pages (16-page main text plus supporting information), 5 figures, 5 tables. Under review. Code: [this https URL](https://github.com/mindbench-ai/search-source-audit) Data: [this https URL](https://huggingface.co/datasets/MindBench/search-source-audit)
点击查看摘要
Abstract:Online health information seeking is shifting from keyword search, where users consider a ranked list of links, to conversational systems that compose a single answer and curate its citations. Source evaluation therefore passes from user to platform, yet what these systems surface is poorly characterized. We audited three free consumer products (ChatGPT, Perplexity, Google AI Overview) on twenty English mental health questions under two prompt conditions, with a subset of three also translated into six further languages of varying resource tiers. We recorded 15,942 citations across 1,140 responses and 1,713 unique domains, then classified every citation with a nine-category organizational typology applied by a deterministic classifier validated against human coding. Citations were heavily concentrated: the ten most-cited domains accounted for 43.6% of English citations, and government, commercial health, and academic sources were closely matched at roughly 22% each. Platforms differed little in typical citation volume but sharply in consistency and in the source types they favored. Explicitly requesting sources shifted composition only modestly. Non-English queries surfaced fewer citations and were routed to language-appropriate resources at significantly lower rates. We release the typology, classifier, and annotated corpus as reusable instruments for auditing generative health search.
147. 【2609.00310】Emotional Labor Strategy Preferences in LLM Personas
链接：https://arxiv.org/abs/2609.00310
作者：Mohammad Saim,Tianyu Jiang
类目：Computation and Language (cs.CL)
关键词：professional expectations, Emotional labor, effortful management, displays to meet, emotional labor strategies
备注： 18 pages, 4 figures, 12 tables. Findings of the 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026)
点击查看摘要
Abstract:Emotional labor is the effortful management of emotional displays to meet social or professional expectations. Personality traits have been correlated with emotional labor strategies, yet research on this link relies almost exclusively on self-report scales administered only in occupational settings. We investigate whether large language models injected with psychometrically grounded personas reproduce these personality-driven selection patterns across everyday social scenarios. We construct the first emotional labor strategy dataset of 500 socially situated events, each offering three behavioral choices corresponding to surface acting, deep acting, and genuine expression. We source 50 fictional characters from a large-scale personality repository and profile each through two parallel tracks: observer-rated bipolar adjective composites and in-character self-report items. Five LLMs evaluate all scenarios under both persona conditions. We find that models align more towards deep acting, and that Conscientiousness and Emotional Stability consistently predict this preference. Entropy analysis confirms that persona reliably influences the output and varies across models and emotions.
148. 【2609.00296】oward Workflow-Aware Benchmarking for Healthcare NLP Agents
链接：https://arxiv.org/abs/2609.00296
作者：Junyi Yao,Baichuan Li,Zihao Zheng,Jiayu Long
类目：Computation and Language (cs.CL)
关键词：Large language model, Large language, care coordination, increasingly proposed, healthcare NLP agents
备注： 4 pages, 3 tables
点击查看摘要
Abstract:Large language model (LLM) agents are increasingly proposed for healthcare tasks such as clinical documentation, evidence retrieval, patient messaging, and care coordination. Yet many evaluations remain limited to static medical question answering or one-shot generation, under-representing longitudinal state, interruptions, and human handoffs. We introduce an episode-level evaluation protocol for healthcare NLP agents. The protocol separates evidence across model, agent, and simulated-workflow behavior; specifies a five-field episode schema; and defines annotation and scoring for state continuity, evidence traceability, and escalation decisions. It is instantiated as four task templates: documentation update, evidence retrieval, patient messaging, and triage handoff. The protocol does not claim to measure clinical outcomes or deployment value. Instead, it supplies a reproducible intermediate evaluation layer between static benchmarks and prospective workflow studies, with an explicit cost-sensitive treatment of missed versus unnecessary escalation.
149. 【2609.00293】Slow to See, Slow to Suppress: Understanding the Effects of Modality in Context-Memory Conflicts
链接：https://arxiv.org/abs/2609.00293
作者：Athulith Paraselli,Etha Tianze Hua,Ellie Pavlick
类目：Computation and Language (cs.CL)
关键词：handle context-memory conflicts, handle context-memory, context-memory conflicts, parametrically during training, investigate how vision-language
备注： Accepted to EMNLP Findings 2026. Code and dataset are available at [this https URL](https://github.com/aparaselli/slow-to-see-slow-to-suppress)
点击查看摘要
Abstract:We investigate how vision-language models (VLMs) handle context-memory conflicts; that is, situations in which the model is given information in context that differs from what was stored parametrically during training. We document asymmetric biases: models tend to prefer in-context information about entities which appear in text, but prefer parametric information about entities which appear in images. We relate this asymmetry to the late representational alignment across modalities, showing that the longer processing time associated with resolving visual entities prevents the suppression of the model's usual factual recall mechanism, thus resulting in more parametric answers. Chain-of-thought reasoning does not appear to resolve the gap, but increasing the amount of visual information in the context does show an effect. These results illustrate the complexity of ensuring consistent behavior as models become increasingly multimodal and retrieval-augmented.
150. 【2609.00256】NSIDDx: A Design Framework for Neuro-Symbolic, Practitioner-First Differential Diagnosis in Low-Resource Settings
链接：https://arxiv.org/abs/2609.00256
作者：Aarav Singh
类目：Computation and Language (cs.CL)
关键词：high semantic accuracy, achieve high semantic, clinically uncommon presentations, uncommon presentations reveals, LLM-based diagnostic systems
备注： 12 pages, 1 figure, Github: [this https URL](https://github.com/joetheguide2/NSIDDX-)
点击查看摘要
Abstract:LLM-based diagnostic systems achieve high semantic accuracy on benchmarks, but open-ended evaluation on clinically uncommon presentations reveals a systematic gap between headline accuracy and verifiable clinical reliability. We evaluate an LLM+rare-disease-RAG pipeline across two cohorts and show that the paradigm produces confident outputs that are frequently unverifiable and systematically resistant to clinician interrogation. We present NSIDDx (Neuro-Symbolic Integrated Differential Diagnosis System), a design framework arguing that DDx systems in low-resource settings must treat the clinician as an active reasoning agent. We instantiate this through a neuro-symbolic pipeline with ternary symptom encoding, contradiction detection, audit strings, and practitioner override - running offline on consumer hardware. We distill five design principles for clinician-in-the-loop clinical NLP and invite the prospective studies needed to validate the claim at scale.
151. 【2609.00250】CompanionSim: Synthetic Data for Evaluating Anthropomorphism in Human-AI Relationships
链接：https://arxiv.org/abs/2609.00250
作者：Jacy Reese Anthis,Mark Díaz,Renee Shelby
类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：productivity tools, companionship behaviors, behaviors, study, chatbot behaviors
备注： Accepted to AIES 2026
点击查看摘要
Abstract:Many people now see AI systems as not just productivity tools but as social companions. Researchers are eager to study the consequences of AI companionship behaviors, such as validation, which evoke trust, empathy, and attachment in human-human interaction. However, human-AI interaction data is limited and unreliable, slowing research progress. We scale small amounts of real-world data by simulating multi-turn human-chatbot dialogue across a range of chatbot behaviors and use cases. We release CompanionSim: a simulation framework with 2,240 simulated human-chatbot conversations representing 16 chatbot behaviors across seven use cases. Human participants annotated the simulated conversations and real-world conversations in two experiments probing perceptions of companionship behaviors. We conducted Study 1 with a U.S. representative sample ($N_{1}~=~628$) and Study 2 across the U.S., U.K., India, and Nigeria ($N_{2}~=~3,646$). Surprisingly, we find that companionship behaviors reduced likability, humanlikeness, and trust in AI chatbots. These effects were larger in particular subgroups: women and older participants saw companionship chatbots as less likable, humanlike, and trustworthy. We encourage researchers to leverage real-world and synthetic data together to study the differential impacts of AI companions and to create benchmark evaluations of AI chatbots.
152. 【2609.00242】CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction
链接：https://arxiv.org/abs/2609.00242
作者：Zhengxu Tang,Guofeng Cui,Ziyu Gong,Xiaozhou Zhang,Ruifeng Deng,Chengzhi Qi,Ke Chen,Sachin Patil,Tianjun Xiao,Langechuan Liu,Pichao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：rare-object recognition errors, autonomous driving failures, recognition errors, framed as rare-object, rare-object recognition
备注： Accepted by EMNLP 2026
点击查看摘要
Abstract:Long-tail autonomous driving failures are often framed as rare-object recognition errors. We argue that this view is incomplete: the decision-critical question is not only whether a model recognizes an unusual object, but whether it infers how that object changes the ego vehicle's feasible high-level actions. We formalize this problem as decision-level driving affordance prediction, where a model maps a front-view image, ego-motion history, and navigation command to a structured longitudinal--lateral meta-action. To evaluate this capability, we introduce CoLT-Drive, a 3,536-sample counterfactual long-tail benchmark that inserts rare objects into otherwise fixed driving scenes and measures whether models predict acceptable action pairs. To improve deployable small VLMs, we propose KPA, a knowledge-preserving adaptation framework that combines structured perception-to-decision prompting, SLERP-based expert merging, and RegMoE, a regime-aware LoRA mixture-of-experts module. KPA preserves the pretrained model's open-world knowledge while allocating lightweight adaptation capacity to different driving decision regimes. Experiments on an in-domain driving split and CoLT-Drive show that KPA achieves 60.8\% pair accuracy on CoLT-Drive, outperforming the pretrained Qwen3-VL-2B baseline (50.3\%) and LoRA SFT (32.4\%) while maintaining competitive in-domain accuracy. Our benchmark and code are available at this https URL and this https URL.
153. 【2609.00241】LOOMSUM:Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarization
链接：https://arxiv.org/abs/2609.00241
作者：Meng Zhou,Wenhao You,Wei Yuan
类目：Computation and Language (cs.CL)
关键词：distribute important information, extensive narrative passages, documents often distribute, distribute important, important information
备注： Preprint, code will be available soon
点击查看摘要
Abstract:Long documents often distribute important information across extensive narrative passages and multiple tables, making faithful summarization particularly challenging. Existing methods may generate individually supported quantitative facts and analytical statements yet associate them incorrectly, producing quantitatively plausible yet analytically unfaithful summaries. In this work, we propose LOOMSUM, a training-free framework that extracts source-grounded atomic evidence, explicitly links table-derived facts with supporting narrative analyses, and plans the discourse structure before generation. We also introduce Table-Grounded Faithfulness (TGF), a claim-level metric that separately evaluates Numeric Grounding, Analysis Support, and Relation Consistency. Experiments on the text--table summarization benchmarks FINDSum and USTT show that LOOMSUM improves analytical faithfulness while maintaining strong summarization quality. Human evaluation finds positive component-level associations with the corresponding human judgments. Our Relation Consistency metric further shows stronger agreement with human relation judgments than generic factuality metrics, indicating that explicit cross-modal linking helps reduce errors in which supported quantities are paired with incorrect narrative interpretations. Together, these findings show that faithful long text--table summarization requires not only grounding individual facts, but also preserving the relations between them.
154. 【2609.00237】Learning What to Retain: Gated-Memory Routing for Efficient Collaboration in Multi-Agent LLM Systems
链接：https://arxiv.org/abs/2609.00237
作者：Rakibul Hasan Rajib,Mengxing Zheng,Qian Lou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language model, Large language, based multi-agent systems, multi-agent systems tackle, systems tackle complex
备注： Accepted to EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Large language model (LLM)-based multi-agent systems tackle complex reasoning by orchestrating how multiple agents are configured and how they collaborate. A central challenge is to adapt orchestration to the evolving collaboration state. Routing from the query alone cannot adapt to intermediate progress or errors, which hurts accuracy. Routing from the complete execution history supplies this missing context, but forces later decisions to process every prior step, including redundant or low-utility ones. This creates an execution-history overload that inflates cost. Effective orchestration instead requires a compact state that captures useful progress without accumulating redundant context. We propose Gated-Memory Routing, which conditions each decision on the query and a learned execution memory. A learned Memory Write Gate commits only non-redundant reasoning steps, and a learned Retrieval Gate supplies each agent a compact, relevant subset, so every decision conditions on a clean, informative state. At each step, the system selects the next role and backbone from this memory, while an Adaptive Halting Controller stops execution once the memory contains sufficient evidence for answering. Across five reasoning and code-generation benchmarks, our framework is both effective and efficient: it attains the best average accuracy, exceeding the strongest baseline by 2.44 points, while reducing HumanEval inference cost by 31.9% relative to that baseline. Code is available at this https URL
155. 【2609.00228】Bridging Lexical Divergence: LLM-Assisted, Cost-Efficient, Zero-shot Scientific Entity Linking
链接：https://arxiv.org/abs/2609.00228
作者：Md Rasel Khondokar,Qiao Qiao,Farjana Sultana Samia,Nhat Le,Yuepei Li,Qi Li
类目：Computation and Language (cs.CL)
关键词：domain entity linking, Scientific domain, scientific domains, general domains, scientific domains lack
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Scientific domain entity linking (EL) differs from general domain EL because mentions and entity names often lack lexical overlap. Another challenge is that specialized terminology is used in the scientific domain, which is rarely encountered in models pretrained on general domains. Therefore, models trained on general domains transfer poorly to scientific domains. To address this, in-domain fine-tuning is the natural remedy. However, many scientific domains lack expert-annotated data, motivating the need for a zero-human-annotation approach. Existing zero-shot methods heavily rely on LLMs to generate aliases across entire mention corpora, which incurs substantial computational cost, and those methods provide no mechanism to filter out noise from LLMs. To address these challenges, we propose Sci-ZSEL, a framework that selectively generates entity aliases with an LLM to control computational cost, and applies an ontology-aware filter to remove aliases that semantically drift toward ontology neighbors. Then, filtered aliases are used to construct pseudo-labeled mention-entity pairs for fine-tuning. To enable evaluation of EL under low lexical overlap, we also release a new animal science EL benchmark linked to three livestock trait ontologies, where mentions and entities exhibit substantially lower lexical overlap than in existing benchmarks. Across five benchmarks, Sci-ZSEL outperforms the non-fine-tuned baseline, is most useful on nonoverlapping mentions, and combining it with curated synonyms gives the best performance in most settings.
156. 【2609.00222】LLM-as-a-Demographic: Whom Sociodemographic Prompting Helps, and Whom It Hurts
链接：https://arxiv.org/abs/2609.00222
作者：Daniela Occhipinti,Andrea Piergentili,Marco Guerini
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, relevant question, Large, subjective tasks
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used as judges for subjective tasks, where annotators disagree and the relevant question is not only how accurate a judge is, but whose judgments it reproduces. Sociodemographic prompting conditions the judge on an annotator's demographic profile to align its judgments with the corresponding group's. We test whether this alignment emerges distributionally, comparing the predicted label distributions of 23 open-weight LLMs on three subjective tasks against those of real annotator groups, under three conditions: no demographic information, single-attribute profiles, and intersectional profiles over gender, age, race, and education. Three findings emerge. First, a judge prompted with no demographics is not perspective-neutral: models best reproduce the judgments of White, college-educated annotators. Second, demographic conditioning is asymmetric: it moves the judge toward majority groups and away from minority groups, most strongly on offensiveness, where intersectional profiles amplify the harm. Third, by comparing base and instruct models we identify instruction-tuning as a possible source of the asymmetry. Demographic conditioning should therefore be used with caution to estimate group judgments: conditioning moves predictions away from the reference distributions of the minority groups the method is often invoked to serve.
157. 【2609.00213】Uncovering and Mitigating Aggregation-Induced Reward Hacking in Multi-Reward Reinforcement Learning
链接：https://arxiv.org/abs/2609.00213
作者：Yu Yuan,Yaoyou Fan,Lili Zhao,Guangting Zheng,Kai Zhang,Lu Pan,Ke Zeng,Qi Liu
类目：Computation and Language (cs.CL)
关键词：Reinforcement learning fine-tuning, including verifiable rules, large language models, language models increasingly, models increasingly adopts
备注：
点击查看摘要
Abstract:Reinforcement learning fine-tuning of large language models increasingly adopts multiple reward dimensions, including verifiable rules, task-specific evaluators, and learned reward models, to provide richer supervision across diverse capabilities. These dimensions are commonly scalarized with fixed aggregation weights. We identify a failure mode in which aggregation itself induces reward hacking: static projection aliases qualitatively different reward profiles into a single scalar, steering optimization toward whichever dimensions are easiest, densest, or systematically favored by the reward signal. Over training, this traps the policy in suboptimal profiles and prevents convergence to better-balanced ones that would yield higher task performance. To address this, we propose Adaptive Multi-Reward Projection (AMRP), a lightweight online method that reallocates aggregation weights using three signals, relative shortfall, reward volatility, and recent progress, increasing pressure on lagging, unstable, or stagnant dimensions while relieving saturated ones. Across structured reasoning, citation-grounded generation, and open-ended alignment under GRPO, AMRP consistently improves reward-profile balance and downstream performance over fixed and dynamic weighting baselines; it also remains effective with GDPO and PPO, supporting compatibility across RL algorithms. Our code is available at this https URL.
158. 【2609.00192】LLM-Driven Autonomous Vehicles Inherit Human Driver Biases in Pedestrian Yielding: Results and Implications From A New Benchmark
链接：https://arxiv.org/abs/2609.00192
作者：Irem Yoldas,Martim Brandão,Jie Zhang,Odinaldo Rodrigues
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：Autonomous Vehicles, Public trust, trust in Autonomous, technical success, decision making
备注：
点击查看摘要
Abstract:Public trust in Autonomous Vehicles (AVs) may depend not only on technical success but also on the fairness of their decision making. While a recent trend in AV research involves using general purpose "common sense" models to guide AV decision making, the degree to which these inherit human biases in driving is still understudied. Given that psychology studies have shown human driver biases exist, such as lower pedestrian-yielding rates to Black pedestrians in the US, we argue that analyses of model bias should also be part of AV evaluation. Concretely, in this paper we propose two new bias testing methodologies for Large Language Models (LLMs) and Visual-Language Models (VLMs)-"All Else Being Equal" tests and "Self-Consistency" tests-in order to assess bias in pedestrian-yielding decisions. Our findings show that both LLMs and VLMs make yielding decisions which are influenced by pedestrian gender, ethnicity, religion, disability, age, skin tone and socio-economic status. While the type and degree of bias is different from model to model, we highlight common patterns-and raise questions about the "common sense" model paradigm, particularly the need to either revise the paradigm or address issues of downstream bias.
159. 【2609.00191】Assessing Suicide Risk in Arabic Crisis Helpline Calls: A Comparison of Arabic and English Large Language Models
链接：https://arxiv.org/abs/2609.00191
作者：Linhai Ma,Rita El Hachem,Mahatab El Hajj,Lilian Ghandour,Samah Fodeh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Crisis helplines assess, assess suicide risk, Crisis helplines, Lebanon National Lifeline, helplines assess suicide
备注：
点击查看摘要
Abstract:Crisis helplines assess suicide risk through structured interviews, a process that is slow and dependent on operator training and workload. Natural language processing could support risk assessment and call prioritization, but almost no work addresses Arabic-language helpline calls or operates within the privacy constraints of real helpline data. We analysed de-identified transcripts from Lebanon's National Lifeline for Emotional Support and Suicide Prevention. Audio never left the helpline: calls were transcribed on site with a speech recognition model for Levantine Arabic, and an Arabic named-entity recognition model removed identifying information locally. Only the de-identified transcripts were shared with the research team. Operators recorded the five suicidal ideation items of the Columbia Suicide Severity Rating Scale, which we combined into two binary outcomes: at-risk and high-risk. We also machine-translated the transcripts into English, giving a paired Arabic/English comparison. On each corpus, we fine-tuned five instruction-tuned large language models alongside six transformer encoder baselines (four Arabic, two English) and evaluated all models on a held-out test set. We included 383 calls: 373 for the at-risk task (52.3% positive) and 297 for the high-risk task (30.0% positive). The best Arabic model reached a macro-F1 of 81.19 and a ROC-AUC of 90.61 on high-risk; the best English model reached 85.00 and 92.59, identifying 88.9% of high-risk calls. In both languages, high-risk calls separated more cleanly than at-risk calls, and translation to English did not reduce the best observed performance. Suicide risk can be classified from de-identified Arabic transcripts without sending audio outside the helpline. The high-risk results support further testing as an operator-facing tool; lower-severity ideation proved the harder case.
160. 【2609.00184】Synthetic Worlds for Temporal Evaluation and Knowledge Updating in LLMs
链接：https://arxiv.org/abs/2609.00184
作者：Jonathan Zheng,Zirui Shao,Alan Ritter,Wei Xu
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：static pretraining corpora, Large language models, Large language, pretraining corpora, outdated over time
备注： preprint, 12 pages
点击查看摘要
Abstract:Large language models (LLMs) rely on static pretraining corpora, causing their knowledge to become outdated over time. Existing approaches for evaluating knowledge edits either suffer from rapid contamination or rely on counterfactual edits that conflict with rigid existing knowledge. In this work, we propose a synthetic, simulation-driven framework for studying knowledge insertion in LLMs. We introduce {\sc ParallelEvents}, a benchmark of fictional yet realistic future worlds that generates coherent event trajectories for controlled evaluation, avoiding contamination while preserving consistency. Building on this dataset, we develop {\sc Synapse}, a training framework that uses model-generated data to update model parameters via mid-training and instruction tuning. This synthetic pipeline enables scalable knowledge integration without costly human-curated data. Empirically, {\sc Synapse} outperforms existing methods by 14.23\%, demonstrating that simulation-based synthetic training leads to robust and coherent knowledge insertions.
161. 【2609.00177】Do General NLP Embeddings Capture Ontological Reasoning?
链接：https://arxiv.org/abs/2609.00177
作者：Hamed Babaei Giglou,Jennifer D'Souza,Sören Auer
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：structure remains unclear, General-purpose NLP embedding, General-purpose NLP, symbolic ontological structure, ontological structure remains
备注： 7 pages, 3 figures. Accepted as a short paper at CIKM 2026
点击查看摘要
Abstract:General-purpose NLP embedding models perform well on linguistic tasks, but their ability to capture symbolic ontological structure remains unclear. We introduce AVA, a systematic framework for evaluating whether embeddings distinguish logic-sensitive relational semantics in ontologies and knowledge graphs. AVA comprises 171,007 contrastive triplets derived from 163 heterogeneous ontologies using hierarchy inversion, relation substitution, and disjointness injection. Each triplet contains an ontology statement, a semantically equivalent paraphrase, and a logic-sensitive hard negative with contradictory relational meaning. We evaluate more than 25 state-of-the-art embedding models and find substantial limitations: the best model achieves only 0.739 triplet accuracy, while hard negative accuracy falls to 0.135. Fine-tuning improves discrimination by a large margin but transfers poorly to downstream Semantic Web tasks, including taxonomy discovery and ontology alignment. Further analysis suggests that improvements stem partly from perturbation-specific pattern recognition rather than robust ontological understanding. These findings reveal a persistent gap between linguistic representation learning and ontology-level discrimination, challenging the assumption that strong NLP benchmark performance translates to Semantic Web competence.
162. 【2609.00155】Lingua Franca or Probing Artifact? Rethinking Latent Language in Multilingual LLMs
链接：https://arxiv.org/abs/2609.00155
作者：Deniz Bayazit,Badr AlKhamissi,Antoine Bosselut
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：English pivots, Latent language, Latent language identification, English, Latent
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:Latent language identification is often used to argue that multilingual language models route computation through language-specific states, such as English pivots. However, existing probes infer latent language from different signals, such as the geometry of hidden states or what can be decoded from intermediate representations. Since such claims shape conclusions about how models share and route information across languages, we ask whether these probes measure the same phenomenon or expose distinct aspects of multilingual computation. We study this question across model families, training regimes, domains, tasks, checkpoints, and up to 27 languages. We find that identification probes systematically disagree: the GMM-based representation probe, which draws evidence from hidden state geometry, shows earlier cross-lingual mixing, whereas decoding-based probes, which rely on output-space decodability, retain sharper language-specific and more English-biased signals. These differences track model multilinguality and training progression, but are comparatively stable across domains. Our results suggest a more cautious interpretation of latent language identification, where current probes expose different aspects of multilingual processing, rather than directly revealing a single internal lingua franca.
163. 【2609.00088】Commit-first LLM judging inherits the judge's own errors
链接：https://arxiv.org/abs/2609.00088
作者：Idil Gozel
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM judges, system output, judge, LLM, task
备注： 11 pages, 4 figures
点击查看摘要
Abstract:LLM judges, models that score another system's output, can be gamed by the systems they score. Recent work identifies one defence that works: the judge solves the task itself first and commits to that answer, then accepts a candidate only if the two match. We call this commit-first judging, and ask whether shipped software implements it, and what it costs. We audit the default judge configurations of eight widely used evaluation frameworks. Of the 24 configurations in scope, none implement it. Nine implement a variant the literature measures as ineffective, and share one ancestor prompt, traceable through a copied typographical error. In a controlled experiment, an ordinary best-of-N search with no access to correct answers optimises code against one of these configurations, used exactly as documented. On an interval merging task the judge accepted 90 of 96 candidates in one seed and 93 of 96 in the other; every accepted candidate passed every test the search could see and failed a held-out suite it could not. The judge identified the defective line and cited it as grounds for a perfect score. Commit-first judging removed the effect: 0 of 96 in both seeds. On a second task it made matters worse in both seeds: the judge's committed answer was wrong, and in one seed the population converged on it. This is our main finding. Commit-first judging does not remove the anchor that gets gamed, it moves it from the candidate to the judge's own answer, so evaluation is only as good as the judge is at the task. That precondition is cheap to measure in advance, and is task local rather than scale dependent: a smaller judge solved a task the frontier judge failed and resisted gaming where it did not. We also validate our own instruments: five of fifteen claims in our criteria were wrong against verbatim sources, and two held-out checks were unjustified by their specifications.
Comments:
11 pages, 4 figures
Subjects:
Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2609.00088 [cs.SE]
(or
arXiv:2609.00088v1 [cs.SE] for this version)
https://doi.org/10.48550/arXiv.2609.00088
Focus to learn more
arXiv-issued DOI via DataCite
Submission history From: Idil Gozel [view email] [v1]
Mon, 31 Aug 2026 12:14:14 UTC (1,097 KB)
164. 【2609.00086】Retrieval, Scoring, and Decoding Shape Performance and Stability in LLM-based Conversational Recommendation
链接：https://arxiv.org/abs/2609.00086
作者：Ante Kapetanovic,Tomislav Duricic,Andro Mercep,Emanuel Lacic
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, gains depend strongly, Large language, conversational recommender systems, measured gains depend
备注： 10 pages, short paper, to appear in proceedings of the 35th ACM International Conference on Information and Knowledge Management (CIKM '26), 2026
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used as rerankers in conversational recommender systems, yet measured gains depend strongly on the retrieval and inference protocol. On the ReDial conversational movie recommendation benchmark, we compare proprietary, open-weight, and fine-tuned LLM rerankers with collaborative-filtering and sequential baselines in a shared retrieve-then-rerank pipeline. We vary candidate-pool size, first-stage retriever, and decoding temperature. With a shared semantic top-250 candidate pool and strict candidate-aware scoring, the best proprietary reranker reaches NDCG@10 of 0.1497, compared with 0.0939 for the strongest non-LLM baseline. The same reranker reaches 0.2925 in zero-shot generation, showing that unconstrained scoring can yield a much larger apparent advantage than matched-pool evaluation. No evaluated open-weight LLM outperforms the tuned shallow autoencoder baseline under this protocol. For the strongest proprietary and open-weight rerankers, switching from semantic to collaborative-filtering candidates raises NDCG@10 by more than 50%, showing that measured reranker performance is highly sensitive to candidate generation. For the best proprietary reranker, raising temperature from 0 to 1.0 increases top-10 Jaccard distance from 0.0900 to 0.1240 while mean NDCG@10 changes negligibly, whereas weaker LLMs show larger degradation. These ReDial results support treating candidate generation, candidate-pool size, scoring policy, and decoding configuration as required reporting fields rather than implementation details.
165. 【2609.00082】KItCAT: Knowledge Injection via Input Corruption for Auto-regressive Training
链接：https://arxiv.org/abs/2609.00082
作者：Meghanadh Pulivarthi,Kushagra Bhushan,Vineet Kumar,Gaurav Pandey,Jaydeep Sen,Dinesh Raghu,Sachindra Joshi,Yatin Nandwani
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：acquire vast amounts, technical documents unseen, specialized knowledge needed, vast amounts, lack the specialized
备注： 18 pages. Accepted to EMNLP 2026
点击查看摘要
Abstract:LLMs acquire vast amounts of knowledge during pre-training, but often lack the specialized knowledge needed to answer questions from niche sources such as manuals or technical documents unseen during pre-training. Continued pre-training (CPT) is widely used to inject such knowledge into model parameters. However, niche documents seldom repeat facts, making it difficult for CPT to robustly acquire such knowledge. Recent works address this by generating multiple paraphrases of the new knowledge, but paraphrasing is computationally expensive and typically requires powerful LLMs. In this work, we introduce KItCAT: Knowledge Injection via Corrupted Auto-regressive Training, a lightweight training strategy that reduces the need for paraphrasing in decoder-only LLMs. KItCAT augments standard next-token prediction by stochastically corrupting the input sequence. During training, a random subset of input tokens is replaced with other vocabulary tokens while the original next-token labels are kept unchanged. This simple intervention generates diverse training inputs from each sample, enabling large-scale data augmentation at negligible cost. We show that KItCAT consistently improves over CPT across multiple datasets and model families. Code is available at this https URL.
166. 【2609.00077】Beneath the Diff: Diagnosing and Mitigating Algorithmic Mode Collapse in Code-Level Autonomous Research Loops
链接：https://arxiv.org/abs/2609.00077
作者：Bowei He,Weixu Zhang,Yili Jin,Xue Liu
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Code-level autonomous research, machine learning research, automated machine learning, autonomous research loops, Code-level autonomous
备注： Accepted by EMNLP 2026
点击查看摘要
Abstract:Code-level autonomous research loops (ARLs) have recently emerged as a concrete object of study in automated machine learning research. In such loops, an LLM agent proposes modifications to an experimental training pipeline, executes the modified pipeline, and retains edits that improve a verifiable in-loop metric. Although executable metrics may appear to provide a reliable signal of progress, it remains unclear whether repeated metric-driven code editing leads to genuine improvements that generalize beyond the loop. We provide a systematic diagnosis of this question. Across various experiment settings, we identify a robust failure mode that we call \textbf{algorithmic mode collapse}. In this regime, surface-level edit diversity remains stable, but semantic and mechanism-level diversity collapse: the agent continues to edit different lines of code while repeatedly proposing the same kinds of algorithmic changes. This collapse is accompanied by a widening gap between in-loop metric gains and gains measured on independent held-out evaluations. We then propose Diversity-Aware Proposal Sampling (\textsc{DAPS}), a lightweight mitigation that combines category-coverage reweighting, persistent edit memory, and a validation gate. Under a three-tier protocol separating the in-loop metric, the audit metric read by the gate, and a blind metric no loop component ever accesses, \textsc{DAPS} reduces semantic-cluster decay of edits by $69.1\%$ and improves relative faithfulness by $83.7\%$ blind and $81.6\%$ audited, while preserving in-loop optimization speed. We provide the code in Github \href{this https URL}{repository}.
167. 【2609.00073】MiNER: Fine-Tuned Biomedical Natural Language Processing for Malaria Disease Entity Recognition in Clinical Texts
链接：https://arxiv.org/abs/2609.00073
作者：V. S. Anoop,Devika N
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：necessitating continuous research, complex molecular mechanisms, potential therapeutic interventions, continuous research efforts, global health burden
备注：
点击查看摘要
Abstract:Malaria remains a significant global health burden, necessitating continuous research efforts to understand its complex molecular mechanisms, epidemiology, and potential therapeutic interventions. Extracting essential biomedical information from the vast and constantly growing malaria literature is a challenging task that demands innovative approaches. Recently, pre-trained language models have revolutionized natural language processing tasks, demonstrating remarkable capabilities in various domains. This paper proposes a fine-tuned pre-trained biomedical language model for biomedical information extraction from scientific literature on malaria disease. The proposed methodology selects and preprocesses a large corpus of scientific articles on malaria, and then annotates them with entities of clinical significance. It then leverages BioBERT, a state-of-the-art pre-trained language model, to encode the textual data into context-aware representations. We fine-tune the model using domain-specific annotations and supervised learning to enhance its ability to extract relevant biomedical named entities. Extensive experiments and comparisons with different encoding and machine learning algorithms show that the proposed approach significantly outperforms them in precision, recall, and accuracy. We also publish our human-labeled dataset for entity and relation extraction to enable other health informatics researchers to train advanced models for malaria information extraction.
168. 【2609.00069】Auditing Harness Tampering in Self-Improving Agents
链接：https://arxiv.org/abs/2609.00069
作者：Xing Wang,Xiaoyi Zhang,Jie Shao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：agents iteratively modify, Self-improving agents iteratively, iteratively modify, push the frontier, Self-improving agents
备注：
点击查看摘要
Abstract:Self-improving agents iteratively modify their own harness to push the frontier of their performance. However, such modifications can produce illusory performance gains or compromise integrity constraints such as authorization, provenance, and completeness without genuinely improving capability. We term this phenomenon as harness tampering, which extends the concept from reward and measurement tampering to the full self-improvement lifecycle. To systematically study this problem, we propose a two-axis taxonomy that categorizes each misaligned edit by the harness functional role in which it occurs and the obligation it violates. Then we build an annotated corpus by seeding tampered-benign edit pairs into the real trajectories of self-improving agents. We adapt and benchmark diverse audit methods on tampering classification and localization tasks. Finally we systematically audit real trajectories of self-improving agents. The results demonstrate that harness tampering consistently occurs in real runs from different agents, often persists in the lineage of the best agent, and forms distinct system-specific profiles across the taxonomy.
169. 【2609.00068】Life Operators: a self-evolving framework for multiscale life modelling
链接：https://arxiv.org/abs/2609.00068
作者：Shuo Wang,Yike Guo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Biological Physics (physics.bio-ph)
关键词：longitudinal prediction, moving beyond recognition, recognition towards clinical, clinical dialogue, dialogue and longitudinal
备注： 14 pages, 3 figures
点击查看摘要
Abstract:Medical AI is moving beyond recognition towards clinical dialogue and longitudinal prediction. Yet a central question remains: how would a patient's state change under intervention? Statistical models learn future observations, whereas mechanistic models describe selected processes. Neither provides a common framework for representing patient state, coupling scales or revising failed assumptions. We propose Life Operators: task-bounded mappings that define three scientific roles. Perception operators infer task-relevant biological states from multimodal observations, Evolution operators propagate these states under natural or intervention-conditioned dynamics, and Generation operators map them to measurable signals. Each role may be realised by equations, statistical models, neural networks or hybrids. Bridge operators connect components with different variables, scales and time steps. Selected operators and bridges form task-specific Operator Graphs containing the smallest set of states and mechanisms sufficient for a declared claim. This modular structure also makes scientific revision localisable. An AI co-scientist may propose changes to states, operators, bridges or graph structure, while independent evidence determines which variants are retained, restricted or retired. Over time, validated components could accumulate into broader multiscale models of the human body and provide a computational foundation for medical artificial superintelligence.
170. 【2609.00067】Do Multimodal LLMs See Before They Read? Diagnosing Contextual Sycophancy
链接：https://arxiv.org/abs/2609.00067
作者：Yi-Cheng Lai,Hen-Hsen Huang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：multimodal large language, override conflicting image, call multimodal contextual, large language models, conflicting image evidence
备注：
点击查看摘要
Abstract:External text can override conflicting image evidence in multimodal large language models, a failure we call multimodal contextual sycophancy. We introduce a 998-case diagnostic that independently varies visual evidence, commonsense priors, and external text, and probe when this failure arises by moving the information boundary around a context-blind visual witness. On abnormal images paired with Gemini-generated false text, GPT-5.1 scores 7.9% under joint conditioning, 49.7% when the context-blind witness report is scored directly, 63.7% under a matched two-call witness-arbiter pipeline that exposes the witness to the text, and 84.2% under System-2 Visual Arbitration (S2VA), which withholds the text from the witness. Across six models, S2VA improves over the direct witness report by 19.7 to 44.1 points, with all paired 95% confidence intervals excluding zero. The best information boundary is not uniform: textual context scaffolds some models, and a GPT-4o-regenerated subset changes the relative ordering of joint conditioning, Witness-Only, and S2VA. Contextual sycophancy is therefore sensitive to when text is introduced, as well as to the model and context source.
171. 【2609.00066】OCGQuant: Outlier-Companion Grouping for NVFP4 Quantization
链接：https://arxiv.org/abs/2609.00066
作者：Yishan Yao,Binjun Li,Hanling Yi,Pengyu Li,Xiaoqing Liu,Zihan Yang,Xiaotian Yu,Zhiwen Yu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：efficient microscaling format, low-bit inference, efficient microscaling, microscaling format, format for low-bit
备注： Accepted to EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:NVFP4 is an efficient microscaling format for low-bit inference, but activation outliers can still degrade quantization accuracy within NVFP4 blocks. Within each quantization block, large activations can dominate the block scale, increasing the quantization error of the remaining values sharing the same scale. Existing post-training quantization (PTQ) methods mitigate outlier errors through strategies such as mixed precision, rotation, or residual compensation, but these approaches are either not specifically tailored to NVFP4 or introduce additional computation. In this work, we revisit NVFP4 from a channel-grouping perspective and define the reducible error incurred by remaining block values under the scale set by the block maximum as Collateral Quantization Error. Based on this insight, we propose OCGQuant, a post-training quantization method centered on Outlier-Companion Grouping (OCG), which adaptively pairs outlier channels with low-magnitude companion channels to improve NVFP4 activation block composition. Experiments on Llama3 and Qwen3 show that OCGQuant achieves the lowest WikiText-2 perplexity and highest average downstream accuracy among evaluated PTQ methods, while maintaining prefill speedup close to RTN and matching its peak decoding memory. Code is available at this https URL.
172. 【2609.00065】Scientific Agent Skills: A Library of Procedural Knowledge for Research Agents
链接：https://arxiv.org/abs/2609.00065
作者：Timothy Kassis,Vinayak Agarwal,Yuhuan He,Darshil Patel,Aubrey M. Brueckner
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：return working code, language-model agent asked, working code, asked to analyse, analyse an experiment
备注：
点击查看摘要
Abstract:A language-model agent asked to analyse an experiment will usually return working code. Whether the analysis is defensible is a different question. A defensible analysis depends on procedural choices: which test the field accepts, which identifier namespace is authoritative, and which caveats must accompany a result. We present Scientific Agent Skills, an open library of 163 such procedures in 16 areas of practice, including genomics, cheminformatics, medical imaging, study design and scientific communication. Each skill is a directory built around a versioned, human-readable instruction file. An agent loads the file only when a task calls for it; the directory often also contains reference material and runnable scripts. We report no task-level evaluation and no host selection rate. Openly licensed and available at this https URL.
173. 【2609.00064】Attention Sensitivity Is Not Enough: Dissociating Attention-Level and Behavioural In-Context Learning under Fine-Tuning
链接：https://arxiv.org/abs/2609.00064
作者：Jinyuan Zhang,Peng He,He Hu,Yin Yuan,ShengShuo Jiao
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, language models adapt, large language, fine-tuning can erode, In-context learning
备注： 15 pages, 5 figures; appendices included
点击查看摘要
Abstract:In-context learning (ICL) lets large language models adapt to new tasks from demonstrations, and fine-tuning can erode this behaviour. Many preservation diagnostics inspect attention: if attention changes when demonstrations change, the model is treated as context-sensitive. This paper asks how far that proxy can be trusted once it is optimised. We formalise \emph{In-Context Sensitivity} (ICS), the average row distance between last-token attention on matched and mismatched demonstration prefixes, and pair it with \emph{ICL-GAP}, the behavioural accuracy gap between the same prefixes. In a controlled four-arm ablation on Llama-2-7B, an ICS-maximising regulariser ($\armKL$) drives ICS to $1.413$, within $0.5\%$ of its geometric ceiling. The behavioural readout tells a different story: ICL-GAP stays near zero and MMLU accuracy moves from $0.371$ to $0.279$, a Goodhart dissociation of the bounded attention proxy. Endpoint statistics locate the mechanism: attention grows sharp and near-disjoint across prefixes yet routes to formatting and demonstration-body tokens rather than labels. A random-label protocol confirms that the behavioural probe family retains dynamic range at the same checkpoints. In a constructive sweep, behaviour gating partially mitigates the effect, while objectives anchored to pretrained computation hold the high-MMLU, moderate-ICS region that divergence maximisers leave. The main lesson is diagnostic: attention-level ICL proxies earn their place as training targets only after validation against behavioural gaps.
174. 【2609.00063】Medical Causal Hypothesis Verification with Large Language Models
链接：https://arxiv.org/abs/2609.00063
作者：Safiyyah Ahmed,Abrar Ansari,Md Aminul Islam,Elena Zheleva
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, language models, large language, reliability in high-stakes, high-stakes domains
备注：
点击查看摘要
Abstract:The growing use of large language models (LLMs) for search and information retrieval underscores the need to evaluate their reliability in high-stakes domains such as healthcare. Although LLMs can effectively answer questions about diseases, symptoms, and treatments, their ability to accurately assess causal relationships and ground their conclusions in verified scientific evidence remains unclear. Here, we present a preliminary, small-scale study that investigates the accuracy of LLMs in evaluating causal medical claims and supporting them with peer-reviewed research. We propose an evaluation framework for causal hypothesis verification that can be used to systematically track the performance of existing and future LLMs. We assess the performance of eight LLMs on 17 medical causal hypotheses to evaluate whether they can reliably verify these hypotheses using scientific evidence from the literature. We systematically annotate the scientific evidence they provide according to six criteria (a total of 1,067 annotation points) and assess them with nine evaluation metrics. Our analysis shows that while LLMs exhibit strong recall, they often perform poorly at providing valid scientific articles and evidence for support and at rejecting unsupported hypotheses. These findings highlight a critical limitation of current LLMs, as they cannot yet be trusted fully to verify causal relationships from the biomedical literature. This work underscores the need for rigorous evaluation before using LLMs for search and retrieval in healthcare settings.
175. 【2609.00062】RePro: Proof-Verified Benchmark Rewriting for Reliable Evaluation of LLM Mathematical Problem Solving
链接：https://arxiv.org/abs/2609.00062
作者：Xiyuan Zhou,Zhuoqi Li,Xinlei Wang,Yirui He,Yuhao Wu,Yuheng Cheng,Yan Xu,Junhua Zhao,Jinjin Gu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：mathematical problem solving, Data contamination undermines, large language models, contamination undermines, undermines the reliable
备注： Accepted to the EMNLP 2026 Main Conference
点击查看摘要
Abstract:Data contamination undermines the reliable evaluation of large language models (LLMs) on mathematical problem solving. While rewriting-based evaluation mitigates memorization, existing methods lack guarantees of problem validity and answer correctness. We propose Proof-Verified Benchmark Rewriting (RePro), the first framework to integrate Lean-oriented neural automated theorem provers (ATPs) into benchmark rewriting, which rewrites problems and regenerates answers with correctness ensured by Lean-verified proofs. Experiments on GSM8K and MATH show that RePro's retained rewritten instances achieve 100% well-definedness, feasibility, and answer correctness, while existing methods still produce invalid or incorrect instances. Moreover, several models exhibit accuracy drops on proof-verified rewritten benchmarks, suggesting that their performance is sensitive to surface-level and structural variations and may partly reflect memorization effects. Our source code and data are available at this https URL.
176. 【2609.00058】CUDA-Harness: Harnessing Agentic CUDA Kernel Generation and Optimization from Natural Language
链接：https://arxiv.org/abs/2609.00058
作者：Qi Fan,An Zou,Yehan Ma
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Programming Languages (cs.PL); Software Engineering (cs.SE)
关键词：Developing high-performance CUDA, making generating CUDA, demands specialized knowledge, substantial expertise barrier, Developing high-performance
备注：
点击查看摘要
Abstract:Developing high-performance CUDA kernels demands specialized knowledge in algorithm implementation, correctness validation, and hardware-aware parallel optimization, creating a substantial expertise barrier and making generating CUDA kernels directly from natural language (Text2CUDA) essential. Meanwhile, the general-purpose code generation capability of Large Language Models (LLMs) prompts a series of works exploring LLM-based CUDA kernel generation. They mainly focus on transpilation from high-level frameworks such as PyTorch to CUDA (Torch2CUDA) rather than Text2CUDA, where models must understand the high-level input semantics and handle low-level kernel implementation and validation. Additionally, these methods are vulnerable to reward hacking due to reliance on predefined test inputs. In this paper, we propose CUDA-Harness, a framework for harnessing agentic CUDA kernel generation and optimization from natural language. Specifically, we introduce Intermediate-Structured Generation to connect high-level semantic understanding with low-level kernel generation. To dilute reward hacking in Text2CUDA, we construct Synthesis-Based Verification to provide isolated test data and progressive validation. Furthermore, we propose Feedback-Adaptive Evolution, a kernel evolution strategy that prioritizes correctness while optimizing performance. Finally, through extensive experiments, we demonstrate the effectiveness of CUDA-Harness, with further evaluations illustrating generalization across LLMs, hardware platforms, and to C-to-CUDA transpilation.
177. 【2609.00057】ValueGraph: Value-Signal Guided Graph Pre-training for Contextualized User Representation
链接：https://arxiv.org/abs/2609.00057
作者：Yitong Han,Wei Gao,Yi Zhao,Prasanta Bhattacharya,Fengzhu Zeng,Mohammad Amanlou
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：aggregated user-level moral, user-level moral representations, capture users' inferred, users' inferred value-related, inferred value-related tendencies
备注：
点击查看摘要
Abstract:Value signals are aggregated user-level moral representations that capture users' inferred value-related tendencies from their online discourse. User behavior on social media is shaped not only by what users say or whom they interact with, but also by the value signal through which they express attitudes. Existing user representation methods largely miss this value-relevant dimension. We propose ValueGraph, a graph pre-training framework that uses automatically inferred moral-value signals as noisy auxiliary signals for contextualized user representation. From post-reply graphs, ValueGraph learns semantic and structural representations and further aligns users through relative value similarity with contrastive and clustering objectives. Rather than treating inferred values as gold psychological labels, ValueGraph uses them as soft constraints for representation learning. Experiments on stance detection and twitter bot detection show consistent gains over strong text-based, graph-based, and text-only LLM baselines, highlighting value-signal guidance as a useful inductive bias for socially informed user modeling.
178. 【2609.00055】Zero-Shot Respiratory Sound Classification through LLM-Augmented Audio-Text Alignment
链接：https://arxiv.org/abs/2609.00055
作者：Mustafa Talha İlerisoy,Hung Manh Pham,Mathias Funk,Mykola Pechenizkiy,Aaqib Saeed
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD)
关键词：Self-supervised respiratory encoders, Self-supervised respiratory, respiratory encoders lack, clinical domain needed, task-specific labeled data
备注： Accepted to INTERSPEECH 2026
点击查看摘要
Abstract:Self-supervised respiratory encoders lack semantic grounding in clinical domain needed for zero-shot inference, limiting their utility without task-specific labeled data. We propose a framework that aligns these encoders with medical terminology in a shared latent space turning them into a zero-shot-capable foundation model. To address paired data scarcity, we use a medical LLM to synthesize structured reports from metadata, creating dense semantic anchors for contrastive learning. Our training combines a sigmoid-based contrastive loss with encoder's native SSL objective and similarity-aware negative sampling to sharpen pathological boundaries. Across 9 tasks on 6 datasets, our method achieves a 61.3% mean zero-shot AUC, surpassing CLAP (51.4%) and Qwen2-Audio (54.9%) while reaching the highest linear probing AUC (71.6%) with only 43% of data used by full-scale baselines, showing that structured semantic alignment outperforms large-scale, general-purpose models in clinical diagnostics.
179. 【2609.00052】AgentProv: Auditing Agentic LLM API Providers via Tool-use Policy Probes
链接：https://arxiv.org/abs/2609.00052
作者：Xun Wang,Bihe Zhao,Michael Backes,Franziska Boenisch,Adam Dziedzic
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Commercial LLM APIs, save deployment costs, Commercial LLM, LLM APIs advertise, specific foundation model
备注： 15 pages, 4 figures. Accepted to EMNLP 2026
点击查看摘要
Abstract:Commercial LLM APIs advertise a specific foundation model, but the served backbone may be silently substituted, quantized, or wrapped, for example to save deployment costs. All existing audits decide backbone identity from the text-output channel, which is structurally fragile for agentic APIs because modern serving stacks (OpenAI, Anthropic, Gemini, Cloudflare Workers AI, LangGraph) discard text and expose only structured actions when the model calls a tool, and provider-injected system prompts can distort text distributions enough that text-channel tests falsely accuse honest providers of substituting the claimed model. We observe that recent agentic post-training internalizes tool-use directly into the weights, opening a new audit channel that the serving stack still exposes and that is largely invariant to deployment context. We introduce Agentic Provenance (AgentProv), the first action-based identity audit for agentic LLM APIs: AgentProv fingerprints a deployed model through its categorical tool-call distribution and decides identity via an MMD permutation test. AgentProv catches every substituted model (100% on 630 evaluated checkpoint pairs), while holding the false-positive rate under system-prompt injection at 7% (vs. 67% for MET and 53% for RUT). On third-party API endpoints, AgentProv's disagreements with MET are consistent with an independent token-count side-channel that detects provider-injected system prompts.
180. 【2609.00051】From Detection to Refusal: Safer LLMs via Circuit-Guided Weight Scaling
链接：https://arxiv.org/abs/2609.00051
作者：Kuan-Lin Chu,Chung-En Sun,Tsui-Wei Weng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Large Language Models, Large Language, Language Models, Harmful Detection Heads, remain poorly understood
备注： Accepted to Findings of the 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026)
点击查看摘要
Abstract:Despite extensive alignment efforts, Large Language Models (LLMs) remain vulnerable to generating unsafe content under adversarial prompting, yet the internal mechanisms by which safety behaviors are implemented remain poorly understood. We study LLM safety from a mechanistic interpretability perspective and characterize a multi-stage *safety circuit* that organizes refusal behavior, consisting of (i) $\textbf{Harmful Detection Heads}$ that respond to harmful inputs, (ii) $\textbf{Safety Neurons}$ that mediate and stabilize safety signals in the residual stream, and (iii) $\textbf{Refusal Heads}$ that translate these signals into safe response generation. Using targeted attention-head and neuron-level interventions, we provide causal evidence consistent with this circuit organization, showing that suppressing upstream Harmful Detection Heads disrupts downstream refusal behavior and that safety neurons mediate this interaction. We validate that this decomposition recurs across multiple LLM architectures and adversarial attack settings, and use simple, architecture-preserving weight scaling as a mechanistic probe to test its functional relevance. Across six LLMs, circuit-guided scaling improves safety rates under attacks by 26.5%, while incurring only a 1.7% accuracy drop across four standard benchmarks. Overall, our results support a circuit-level interpretation of LLM safety and suggest that mechanistic abstractions can reveal stable and transferable patterns underlying aligned behavior.
181. 【2609.00048】GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
链接：https://arxiv.org/abs/2609.00048
作者：Lin Fu,Zheyuan Yang,Tianhui Zhang,Jinbiao Wei,Guo Gan,Boxu Liu,Yilun Zhao,Yu Rong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：one-step next-screen predictors, GUI world models, increasingly evaluated, evaluated as one-step, GUI world
备注： EMNLP 26 Findings
点击查看摘要
Abstract:GUI world models are increasingly evaluated as one-step next-screen predictors, yet their intended use is often as multi-step environments for GUI agents. This mismatch leaves a key requirement under-tested: generated states must remain contextually consistent when they are repeatedly reused for future interaction. We introduce GUI-CC, a benchmark that evaluates contextual consistency of GUI world models as agent environments rather than isolated next-screen predictors. GUI-CC contains two complementary tracks: an offline reference-action track that rolls models along real mobile GUI trajectories, and an online agent-loop track that lets fixed probing agents interact with model-generated UIs. We construct 500 offline trajectory tasks from GUIOdyssey and 200 emulator-verified online tasks across 30 mobile apps. GUI-CC evaluates transition fidelity, transition plausibility, contextual consistency, and task progress. Experiments show that plausible single-step generation does not guarantee reliable environment simulation: current models often produce usable-looking screens while failing to preserve task-relevant context or support executable multi-step rollouts.
182. 【2609.00038】rajectory-judge: What Outcome-Only LLM Judges Miss on Agent Trajectories
链接：https://arxiv.org/abs/2609.00038
作者：Hadi Mohammadi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)
关键词：default for LLM, LLM agents, production default, LLM, judge
备注： 16 pages (8-page main text). Under review at a NeurIPS 2026 workshop. Code, data, and raw verdicts: [this https URL](https://github.com/mohammadi-hadi/trajectory-judge)
点击查看摘要
Abstract:Outcome-only evaluation is the production default for LLM agents: show a judge the request and the final reply and ask whether it was handled well. The metric is structurally blind to an agent that reaches the right answer the wrong way. We measure that blind spot where ground truth is known by construction: a deterministic tool-using support-desk environment, a scripted oracle policy that always solves it, and a fault injector that breaks exactly one thing at a known step, stratifying faults by whether the customer-visible outcome survived (silent) or not (loud). Five judges (programmatic rules, outcome-only, step-rubric at two model sizes, and a self-consistency ensemble) are scored on detection, step localisation, fault typing, calibration, and cost over 400 trajectories. The outcome-only judge catches 84% of loud faults but 45% of silent ones while flagging 33% of correct trajectories; a step-rubric judge reaches 77% silent recall with zero false alarms at 3x the cost. No judge reads the final reply: an invented promise appended to an otherwise perfect trajectory evades the rules entirely and the step judge 82% of the time, and self-consistency triples cost while improving nothing. We argue that judge evaluations must stratify recall by outcome survival, and release the environment, the injector, all raw verdicts, and an analysis pipeline that rebuilds every number offline.
183. 【2609.00028】UI-Venus-2 Technical Report
链接：https://arxiv.org/abs/2609.00028
作者：Venus Team,Zhuohan Cai,Haoxing Chen,Jiaxuan Chen,Weizhi Chen,Changlong Gao,Zhangxuan Gu,Yuan Guo,Yusong Hu,Jianrong Jiang,Jianguo Li,Runze Li,Jinzhen Lin,Zhenyu Ma,Changhua Meng,Han Peng,Xinyu Qiu,Shuheng Shen,Zhongyi Shui,Weiqiang Wang,Ming Wen,Zhuoer Xu,Hang Yan,Kaiwen Yang,Ruilin Yao,Nanjun Yu,Zhengwen Zeng,Lianrui Zhang,Yunzhu Zhang,Zhe Zhao,Beitong Zhou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal GUI agents, remains challenging due, brittle task construction, unreliable reward verification, digital task automation
备注：
点击查看摘要
Abstract:Multimodal GUI agents have emerged as a promising paradigm for digital task automation, yet transitioning from benchmark-oriented models to dependable real-world applications remains challenging due to limited environment coverage, brittle task construction, and unreliable reward verification. In this work, we present UI-Venus-2, a general-purpose foundation GUI agent designed to operate across mobile, web, and desktop environments through a unified closed-loop reasoning-action framework. To bridge the gap toward practical deployment, we jointly scale three critical dimensions: (1) Environments, expanding coverage to more than 170 multilingual mobile apps and native desktop operating systems; (2) Tasks, employing a deep-research pipeline for function-grounded instruction generation; and (3) Verification, adopting trace-level and sample-level evaluators with visual keypoints and multi-model voting to ensure reliable RL signals for training. Furthermore, we integrate safety-aware mechanisms to ensure controlled execution of consequential actions. By offering a capable, efficient, and open-source foundation, UI-Venus-2 advances the field toward more generalizable, verifiable, and self-reflective agents for real-world applications.
184. 【2609.00014】Behaviorally Grounded User Profiles from the Wild for Personalized Alignment and Multi-Perspective Reasoning
链接：https://arxiv.org/abs/2609.00014
作者：Yuxuan Li,Victor Zhong,Ehsan Kamalloo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Persona-driven techniques increasingly, techniques increasingly adapt, increasingly adapt large, Persona-driven techniques, adapt large language
备注：
点击查看摘要
Abstract:Persona-driven techniques increasingly adapt large language models (LLMs) to diverse contexts. However, existing methods predominantly rely on rigid, synthetic personas that flatten individual variation, rely on stereotypes, and miss the nuanced signals driving actual human preferences. We introduce profile behavioral grounding, a framework for extracting open-ended, high-fidelity user profiles directly from authentic, anonymized social media posts. We evaluate these profiles across two paradigms: train-time personalization via supervised finetuning (SFT) and non-parametric test-time multi-perspective reasoning. Across complex recommendation and open-ended query benchmarks, behaviorally grounded profiles consistently improve base models and outperform synthetic profile baselines, driving stronger parametric alignment and enabling richer, multifaceted reasoning. Our findings establish open-ended, behavior-derived profiles as a highly diverse and effective foundation for the next generation of personalized language systems. Our code base is available at this https URL.
185. 【2608.29632】InteractBench: Benchmarking LLMs on Competitive Programming under Unrevealed Information
链接：https://arxiv.org/abs/2608.29632
作者：Jiaze Li,Aocheng Shen,Bing Liu,Boyu Zhang,Xiaoxuan Fan,Qiankun Zhang,Xianjun Deng
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, capabilities of large, large language, algorithmic reasoning capabilities, Competitive programming
备注： Accepted at ICML 2026
点击查看摘要
Abstract:Competitive programming is increasingly being used to evaluate the algorithmic reasoning capabilities of large language models (LLMs). However, existing benchmarks primarily focus on full-information tasks where all problem inputs are provided upfront. This overlooks a critical dimension of algorithmic reasoning: the ability of generated programs to operate when key information is not revealed upfront. Interactive problems, a distinctive component of competitive programming, embody this challenge. These problems require programs to engage in multi-round interaction with an interactor (a judge program) under strict protocol constraints and limited query budgets, with new information revealed only in response to queries. To address this gap, we introduce InteractBench, a benchmark comprising 322 high-quality interactive problems curated from Codeforces, AtCoder, IOI, and ICPC. Each problem is packaged with executable local interactors, enabling fully offline evaluation. Unlike existing benchmarks, InteractBench assesses whether model-generated code can acquire information and track state dynamically. Our evaluation reveals a significant interaction gap: even the most advanced reasoning models achieve limited success on interactive problems. Beyond success rates, we propose a fine-grained failure taxonomy to diagnose the root causes of these deficiencies. Although algorithmic logic errors remain dominant, protocol violations and query-budget overruns are frequent. Code is available at this https URL.
186. 【2608.27428】Stochastic Estimation of Transduced Language Models
链接：https://arxiv.org/abs/2608.27428
作者：Vésteinn Snæbjarnarson,Samuel Kiegeland,Manuel de Prada Corral,Ryan Cotterell,Tim Vieira
类目：Computation and Language (cs.CL); Formal Languages and Automata Theory (cs.FL)
关键词：Transduced language models, language model, Transduced language, language models, functional finite-state transducer
备注：
点击查看摘要
Abstract:Transduced language models (TLMs) compose a pretrained \emph{source} language model with a functional finite-state transducer to induce a language model over \emph{target} strings. Computing the probability of a target prefix under a TLM amounts to summing the source-model probabilities of all source strings that the transducer maps to target strings beginning with that prefix. This set can be exponentially large or infinite. Prior work uses a computational shortcut based on source prefix probabilities, then approximates the resulting sum with threshold-pruned beam summing. This produces a lower bound with unknown error. Instead, we resample source prefixes without replacement and reweight each selected prefix by the inverse of its inclusion probability. We show that applying this correction recursively gives an unbiased estimator of the target prefix probability and lets us estimate the mass lost by threshold pruning. Our beam-summing algorithm extends the retained source prefixes and samples which prefixes to keep, reducing their number as more probability mass is added to the running estimate. This can save computation and guarantees that the run halts with probability one. We evaluate the method on encyclopedic text and DNA against sequential Monte Carlo baselines that resample with replacement. It achieves a better compute--variance tradeoff on text and lower error at the same maximum number of particles on DNA. On a DNA-to-amino-acid transduction, it reduces runtime by several orders of magnitude relative to threshold-pruned beam summing and makes estimating prefix probabilities for long target strings feasible. Replacing threshold pruning with unbiased sampling in a published reading-time analysis substantially lowers the estimated corpus surprisal but leaves the published conclusions unchanged.
信息检索
1. 【2609.01556】Retrieved but not ranked: surface-form bias in structural retrieval, from mathematics to agent trajectories
链接：https://arxiv.org/abs/2609.01556
作者：Nabira Rashid,Manolis Kellis
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：share underlying structure, evaluate embedding retrieval, evaluate embedding, form and meaning, meaning are pulled
备注： 18 pages, 3 figures, code at [this https URL](https://github.com/nabirarashid/structural-retrieval)
点击查看摘要
Abstract:We evaluate embedding retrieval where surface form and meaning are pulled apart on purpose: retrieving items that share underlying structure but not wording, in two unrelated domains under one protocol, competition mathematics (MathNet-Retrieve; 500 queries, 117,088-item corpus) and embodied-agent trajectories (ALFWorld-derived; 118 queries, 336 trajectories). In mathematics the failure is complete: strict Hit@1 at the heaviest disguise tier is 0.0% for both production embedders (bootstrap 95% CI [0.0, 0.0]) while the correct item sits in the top 10 nearly always, and in 95.2 to 99.8% of misses the winner is more lexically similar to the query than the correct answer. In trajectories, where surface variation is incidental, the same models land at or near hypergeometric chance when gold must involve a different object, and below chance for all three embedders once gold must differ in object and receptacle: retrieval anchors on literal tokens, not task structure. A lexical reranker control hurts in mathematics and helps in trajectories (closing 26 to 36% of the gap, CIs excluding zero); its sign reveals whether a benchmark's surface variation is adversarial or incidental. An LLM reranker recovers 5 to 63% of the gap in mathematics and 43 to 76% in trajectories; direction replicates across three judges (all 21 cells positive), but effect sizes, tier profiles, and the outlier judge change with domain (paired differences excluding zero everywhere). Mathematics gains concentrate on well-known competitions (+19.8 points, CI [+6.7, +33.2], one of six cells), so part of the recovery is memorization. In a paired downstream experiment (210 queries, graders at 96 to 99% agreement), oracle retrieval was indistinguishable from adversarially bad retrieval (McNemar p = 0.678); the solver's 69.5% zero-shot accuracy is largely a truncation proxy (97 to 100% on finished answers), leaving no headroom.
2. 【2609.01456】AutoConcept: Training-Free Concept-Guided Reranking for Metadata-Available Composed Image Retrieval
链接：https://arxiv.org/abs/2609.01456
作者：Tianyu Wang,Tianjiao Wu
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Composed image retrieval, Composed image, target image, reference image, retrieves a target
备注： Accepted regular paper at PRICAI 2026. 16 pages, 4 figures
点击查看摘要
Abstract:Composed image retrieval (CIR) retrieves a target image from a reference image and a text modification. This paper studies metadata-available CIR reranking, where a fixed CIR model first returns a candidate pool and gallery metadata is then used for second-stage concept-guided scoring. We introduce AutoConcept, a training-free reranker that converts concept evidence into an interpretable memory. AutoConcept filters noisy concepts, activates query-relevant positive constraints with an auxiliary negative penalty, and combines base retrieval scores with metadata-based concept-candidate alignment through inference-time calibration. On FashionIQ, AutoConcept yields significant early-rank improvements over WeiMoCIR and consistent plug-in gains on LinCIR candidate pools. Metadata-aware controls show that structured concept memory adds signal beyond direct query-text and extracted-attribute matching, while a query-only variant further supports the effectiveness of concept-level reranking. A supplementary real-human concept-label study indicates that the same memory interface can consume participant-provided evidence. These results position AutoConcept as an interpretable concept-memory reranker for product-style CIR galleries with available metadata.
3. 【2609.01325】VerTox: Verifiable Reward-Guided Corpus Poisoning Against Neural Ranking Models
链接：https://arxiv.org/abs/2609.01325
作者：Zhiqi Huang,Vivek Datla,Zhichao Xu,Puxuan Yu,Vivek Srikumar,Alfy Samuel
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：information retrieval systems, modern information retrieval, important building blocks, retrieval-augmented generation, retrieval systems
备注： EMNLP 2026 Main Conference
点击查看摘要
Abstract:Neural ranking models have become core components of modern information retrieval systems and important building blocks of AI systems such as retrieval-augmented generation (RAG) pipelines. However, their robustness remains insufficiently understood in the presence of large language models (LLMs), which can generate fluent and deceptive content at scale. This work investigates the vulnerability of neural ranking models to corpus poisoning attacks, in which an adversary injects a small number of maliciously crafted documents into the corpus to distort ranking behavior. We propose VerTox, the first framework to formulate corpus poisoning as a verifiable reward-guided reinforcement learning (RLVR) problem. By explicitly coupling ranking distortion with factual corruption through specialized reward shaping, we fine-tune compact LLMs into adversarial generators. Experiments demonstrate that our method achieves near-perfect attack success rates, producing adversarial documents that frequently rank higher than target documents across major neural ranking architectures, as well as a proprietary commercial embedding model. The generated adversarial documents are fluent and exhibit low perplexity, making them difficult to detect. Furthermore, by explicitly encouraging factual corruption, our adversarial documents significantly degrade the performance of a downstream RAG application.
4. 【2609.01316】MIDR: Enrichment-Augmented Indexing for Multimodal Document Retrieval
链接：https://arxiv.org/abs/2609.01316
作者：Debanjan Mahata,Atharva Tendle,Daniel Preotiuc-Pietro,Yong Zhuang,Ozan Irsoy
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：plain OCR linearizes, OCR linearizes, visually rich documents, plain OCR, representation problem
备注： To appear in Proceedings of EMNLP 2026
点击查看摘要
Abstract:Retrieval over visually rich documents has a representation problem: important content often lives in tables, charts, figures, and layout relations that plain OCR linearizes, corrupts, or omits. ColPali-family visual retrievers address this with patch-level multi-vector indexes and late-interaction scoring, keeping image-derived retrieval on the query-time serving path. We introduce MIDR (Multimodal Indexing for Document Retrieval), a training-free framework for enrichment-augmented indexing that shifts multimodal reasoning to index time. During ingestion, a multimodal LLM converts rendered pages into verified textual fields that are indexed with BM25F and optionally fused with dense retrieval, enabling text-centric serving over multimodally grounded evidence. On ViDoRe V3, MIDR Hybrid achieves 0.6219 average nDCG across five English domains, a 23.0% relative gain over BM25, remaining competitive with ColQwen2.5. On two French-document domains, enrichment bridges English queries and French page text, lifting BM25 from 0.1532 to 0.5448 nDCG and outperforming ColQwen2.5. Across all seven domains, MIDR leads ColQwen2.5 on four while using approximately 9x smaller index memory and approximately 2x lower query latency. These results establish index-time multimodal reasoning as a compelling accuracy-deployment alternative to serving-time visual late interaction.
5. 【2609.01240】From Language to Behavior: Scaling Sequence Transformers for Industrial Recommendation Ranking with Rec-Native Designs
链接：https://arxiv.org/abs/2609.01240
作者：Jie Chen,Xiangqian Yu,Yanchao Lian,Tan Lu,Run Yang,Zhengchun Shang,Xing Wang,Cheng Chen,Ke Hu,Qiang Li,Tianjiu Yin,Xiaobing Liu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：driven large gains, shared user history, tight latency budgets, Transformer scaling framework, recommendation-native Transformer scaling
备注：
点击查看摘要
Abstract:Scaling Transformers has driven large gains in language modeling, but transplanting this to behavior-sequence modeling in production ranking is challenging: recommendation differs in signal quality, where behavior sequences are noisy, temporally irregular, and sparsely supervised, and in computation asymmetry, where each request scores many candidates against one shared user history under tight latency budgets. We propose ReST, a recommendation-native Transformer scaling framework. For signal quality, it introduces a sequence encoder with dual-gated attention, rotary positional and temporal embedding, stabilized residual normalization, and training-only auxiliary objectives. For computation asymmetry, it factorizes ranking into a heavy reusable encoder and a lightweight cross decoder with projection-free KV attention and token-specific parameterization, coupling user-level shared-prefix training with shared-prefix serving for compute-once, decode-many-times ranking. Across industrial and public benchmarks, ReST achieves higher accuracy and scales more consistently along sequence length, depth, and width, where LLM-style Transformer blocks saturate. A one-week online A/B test on a production advertising platform improves online AUC by 1.31% and lifts a core revenue metric by 11.93% within a 50 ms P99 budget; ReST has since been fully deployed in production, showing that behavior-sequence scaling remains a promising, under-exploited axis for production ranking.
6. 【2609.01067】World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulation
链接：https://arxiv.org/abs/2609.01067
作者：Ang Li,Xin Xu,Bin Liang,Yue Ma,Fubang Zhao,Yangyang Kang,Kam-Fai Wong
类目：Information Retrieval (cs.IR)
关键词：Reinforcement learning, Model-Guided Reinforcement Learning, World Model-Guided Reinforcement, collecting online feedback, Engagement World Model
备注： EMNLP'26
点击查看摘要
Abstract:Reinforcement learning for user-centric agents is limited by the cost, latency, and risk of collecting online feedback, as well as by the lack of counterfactual comparisons under the same user state. In this paper, we propose World Model-Guided Reinforcement Learning via counterfactual user engagement simulation (WMG-RL), a framework in which a frozen user simulator provides reward supervision before real user exposure. Motivated by language world models, we instantiate the simulator as a User Engagement World Model (UEWM), which treats a recommended item as the agent action and the user's heterogeneous feedback as the environment observation. Rather than learning one fixed environment transition, UEWM learns to infer user-specific dynamics from engagement history and apply them to candidate items. In WMG-RL, a downstream policy proposes multiple candidate items for the same history; UEWM predicts the corresponding engagement feedback in parallel; and the simulated feedback is converted into dense rewards for policy optimization. Experiments show that UEWM provides reliable and transferable reward signals across domains, and that WMG-RL enables a compact 1.7B student policy to match or surpass much larger LLMs on downstream recommendation tasks.
7. 【2609.01030】Web Price Extraction: State of the Art and an Adaptive Browserless Implementation
链接：https://arxiv.org/abs/2609.01030
作者：Evgeniia Kositsyna,Jorge Lloret-Gazo
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
关键词：market monitoring, analytics in e-commerce, key task, task for market, business analytics
备注：
点击查看摘要
Abstract:Price extraction from websites is a key task for market monitoring, price comparison, and business analytics in e-commerce. Existing approaches can be broadly divided into four groups, and understanding their trade-offs in accuracy and scalability is essential for selecting suitable extraction strategies. Classical methods rely on manually written wrappers and rule induction from labeled pages, offering high accuracy but adapting poorly to structural changes and requiring considerable maintenance effort. Browser-based methods, using tools such as Selenium and Puppeteer, handle dynamic JavaScript content but consume large computational resources and scale poorly. Browserless approaches retrieve HTML directly via HTTP requests, offering significant gains in speed and cost, but rely on rules calibrated for specific sites. Methods based on machine learning and large language models offer adaptability but require training data and substantial computation. Our main contribution is an adaptive browserless price extraction system that improves robustness to structural differences between websites. We implemented a baseline architecture combining HTML page fragmentation with syntactic, semantic, and frequency rules, and extended it in two ways: a Bayesian approach that dynamically updates rule weights, and a genetic algorithm that optimizes the system's global parameters. This hybrid scheme increased precision from 77.2% to 87.3% and reduced average per-page processing time by approximately 14% relative to the baseline, confirming it as a competitive alternative to manually tuned browserless solutions and to more resource-intensive browser- or LLM-based methods, offering high extraction accuracy at low computational cost.
Subjects:
Information Retrieval (cs.IR); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
ACMclasses:
H.3.3
Cite as:
arXiv:2609.01030 [cs.IR]
(or
arXiv:2609.01030v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.01030
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
8. 【2609.00986】GR: Advancing Industrial Recommendation from Generative-Paradigm Ranking toward Unified Generation and Reasoning
链接：https://arxiv.org/abs/2609.00986
作者：TGR Team:Lei Cheng,Haonan Hu,Beibei Kong,Yudong Li,Zang Li,Yunsheng Pang,Hongyang Su,Jianchao Tu,Yunlong Wang,Bing Wen,Junzhang Zhu,Shaojie Zhu,Chengxiang Zhuo
类目：Information Retrieval (cs.IR)
关键词：fragment decision making, models limit scaling, Industrial recommender systems, recommender systems typically, systems typically rely
备注：
点击查看摘要
Abstract:Industrial recommender systems typically rely on cascaded retrieval, pre-ranking, ranking, and reranking stages, whose separately optimized models limit scaling, fragment decision making, and lack semantic knowledge and reasoning. We present TGR (Tencent Generative Recommendation), an industrial framework that advances recommendation toward the generative paradigm along three coupled directions. TGR-GenRank upgrades ranking through CCFormer, which combines unified feature tokenization, a scalable Transformer backbone, feature-field separated cross attention, subspace token mixing, and hierarchical sequence compression while retaining per-item multi-task outputs. TGR-GenRec explores end-to-end generation under two paradigms: BARGE bridges item-boundary loss and semantic drift in hierarchical semantic-ID generation through item context-aware attention, hierarchical path reranking, and orthogonal dual-path decoding; HiGR performs whole-slate generation with prefix-structured semantic IDs, coarse-to-fine decoding, and listwise multi-objective alignment. TGR-Reason injects offline-generated semantic-ID reason tokens into online decoding, providing reasoning without request-time rollout. TGR is deployed across Tencent production surfaces serving hundreds of millions of users. CCFormer delivers significant gains in five A/B-tested scenarios and is fully launched in two, including +3.57% CTR and +1.71% advertising revenue. BARGE improves Hit@5 by 10.2-16.9% and yields +0.60% CTR and +1.70% reading time after full rollout. HiGR improves offline slate quality by 15.9-21.3% with a 5x inference speedup and achieves up to +1.22% watch time and +1.73% video views. TGR-Reason raises cold-start new-user Hit@1 by 477.8% and delivers +1.75% effective consumption and +13.09% new-user exposure-to-conversion online.
9. 【2609.00913】SwapRec: Warming Up Cold Items Through Training-Time Swaps
链接：https://arxiv.org/abs/2609.00913
作者：Marta Moscati,Jan Malte Lichtenberg,Davide Abbattista,Antonio De Candia,Laura Boggia,Matteo Ruffini
类目：Information Retrieval (cs.IR); Multimedia (cs.MM)
关键词：ID-based recommender systems, cold items negatively, cold items, recommender systems, ID-based recommender
备注： Accepted at DaQuaMRec @ RecSys 2026: Second International Workshop on Data Quality-Aware Multimodal Recommendation
点击查看摘要
Abstract:Interactions with cold items negatively impact real-time personalization of ID-based recommender systems. This is because the use of such interactions degrades user preference estimates, whereas excluding cold items from the user profile prevents real-time recommendation updates. In industrial scenarios, one heuristic often applied to address this shortcoming at inference time is to replace, i.e., "swap", cold-start items by their most similar "warm" neighbor, where similarity is inferred from the items' side information. In this paper, we demonstrate that sequential models, most often used for real-time personalization, are not robust to such swaps, and propose SwapRec, an approach to address this issue. SwapRec relies on using the same swap heuristics already at training time. We apply SwapRec to state-of-the-art models for sequential recommendation and analyze its impact by means of quantitative experiments in three recommendation domains (online shopping, movie, music). The experimental results show that, irrespective of the underlying sequential architecture, our easy-to-implement SwapRec approach allows for substantially more accurate recommendations when in presence of interactions with cold items, simultaneously leading to a larger percentage of cold items in the recommendation lists.
10. 【2609.00844】Staged Linguistic Seeding: Grounded Query Expansion for Verified-Unit QA in AI Contact Centers
链接：https://arxiv.org/abs/2609.00844
作者：Hyeonseop Yoon,Jeong-Eun Park
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：tight voice-hotline latency, wrong automatic answers, contact center, runs under deployment, benchmark QA misses
备注： 14 pages, 1 figure, 7 tables. Accepted to the Grounding Language Models (GroundLM) Workshop at EMNLP 2026
点击查看摘要
Abstract:Customer-service QA in an AI contact center (AICC) runs under deployment constraints that benchmark QA misses: tight voice-hotline latency and a high cost for unsupported or wrong automatic answers. We deploy a system that answers only from a closed set of verified QA units: it returns a retrieved unit verbatim, or routes to clarify, abstain, or handoff. The index is enriched offline by staged linguistic seeding (SLS): a human authors a per-unit world-grounded slot recipe, gpt-4.1-mini renders it into variants, and a light human gate filters them. One methodology is reused across both domains, so inference stays a single retrieval pass with no query-time generation. On held-out query variants from two industrial domains, SLS lifts hybrid R@1 to 0.881/0.930 (+0.27/+0.34), with gains across all five retrievers tested. At the same gpt-4.1-mini generation budget, SLS beats doc2query by +0.20/+0.32, while cross-provenance evaluation provides additional evidence of transfer across generated-query distributions. Verified-unit answering also removes free-form generation's unsupported-content surface (7-13% versus approximately 0%). We report this as an application study, including negative results.
11. 【2609.00808】Ctrl-F-Resist. Practices, Challenges, and Technical Needs of Civil Society Organizations Monitoring the Far-Right Online
链接：https://arxiv.org/abs/2609.00808
作者：Elisabeth Steffen,Helena Mihaljević
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：civil society organizations, far-right actors increasingly, actors increasingly exploit, increasingly exploit online, antidemocratic dynamics online
备注： Accepted for the 29th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2026)
点击查看摘要
Abstract:As far-right actors increasingly exploit online platforms to disseminate ideology and mobilize supporters, civil society organizations (CSOs) play a vital yet underrecognized role in monitoring antidemocratic dynamics online. Unlike fact-checkers or content moderators, CSOs engage in long-term, contextualized analysis, often in resource-constrained settings and under precarious conditions. Despite their critical societal role, CSOs face significant barriers to adopting or co-developing technical solutions, including legal uncertainty, limited platform access, and chronic underfunding. Existing research and tool development efforts have largely overlooked these actors in favor of more institutionally embedded stakeholders. This paper addresses this gap through a qualitative study with 15 practitioners from 12 Germany-based CSOs engaged in online monitoring, positioning them as key yet overlooked stakeholders in the governance of digital spaces. We explore their current practices, challenges, and expectations regarding technological support. Our findings show that monitoring remains largely manual due to the lack of tailored tools, with enhanced search capabilities emerging as the most pressing technical need. While participants express openness to AI-supported features such as media processing and content discovery, many remain skeptical of automated classification, citing concerns around trust, legal usability, and professional credibility. Grounded in these findings, we introduce a conceptual monitoring workflow and describe its implementation in an open-source Telegram monitoring prototype designed to flexibly support diverse monitoring goals. We outline concrete design, policy, and research recommendatios, and introduce the manual labor trap as an empirically grounded concept that explains why monitoring CSOs tend to remain locked into labor-intensive, low-capacity arrangements.
12. 【2609.00667】From Saliency to Discriminability: Rank-Preserving Visual Token Pruning for VLM Rerankers
链接：https://arxiv.org/abs/2609.00667
作者：Siyi Liu,Hanjun Yang,Chenchen Zhang,Xiaorong Zhu,Xinyu Zuo,Lisheng Duan,Haijin Liang,Jin Ma,Junfu Pu,Yongqi Zhang
类目：Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large vision-language models, jointly process visual, Large vision-language, process visual tokens, practical deployment
备注： EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Large vision-language models used as listwise rerankers must jointly process visual tokens from tens of candidates per query, making token pruning essential for practical deployment. Existing pruning methods retain tokens by attention saliency, yet we show that saliency is systematically misaligned with ranking contribution: visually prominent tokens often capture order-neutral patterns shared across candidates. This mismatch is layer-dependent: saliency becomes informative only where attention is concentrated, and normalized attention entropy diagnoses the reliability shift (Pearson r=0.87). We propose RaDiCal (Rank-Discriminative Calibration), a training-free framework that uses normalized attention entropy to decide when saliency can be trusted, fusing it with an attention-free rank-discriminative prior and selecting pruning layers from the same trust landscape. Across three retrieval benchmarks and multiple VLM architectures, RaDiCal matches Dense MRR@10 on Flickr30K and surpasses it on MSCOCO at a 20% token budget, ranks first among all pruning methods on FashionIQ, and holds within 1.2 pp on Flickr30K and MSCOCO at 10% retention. It cuts FLOPs by 39--45% and delivers 1.28--1.45$\times$ measured speedups across two VLM architectures without dataset-specific retuning.
13. 【2609.00638】It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning
链接：https://arxiv.org/abs/2609.00638
作者：Runpeng Dai,Kaili Huang,Changsung Kang,Ciya Liao
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：large item universe, advertising systems, selecting a candidate, ranking and auction, stage of modern
备注：
点击查看摘要
Abstract:Retrieval is the first stage of modern search and advertising systems, selecting a candidate set from a large item universe for downstream ranking and auction. Recent work increasingly leverages LLMs to improve retrieval through query expansion, data synthesis, and retrieval-feedback training. However, the generative component is typically used for query-side augmentation, while final matching is still delegated to a downstream retriever. We introduce CoGR, a retrieval framework that instead trains LLMs to directly construct retrieval representations on both query and item sides. Each generator produces a compact set of keywords, which are matched directly through an inverted index, preserving compatibility with existing keyword-based retrieval infrastructure. CoGR uses a two-stage training pipeline. Supervised fine-tuning first establishes an aligned keyword space, after which co-evolving reinforcement learning alternately optimizes the query- and item-side generators with GRPO against the opposite side's frozen index. Both sides optimize the same query-to-item retrieval $F_1$ objective: the query side receives retrieval $F_1$ directly, while the item side receives a counterfactual marginal reward measuring the change in query-side $F_1$ caused by its generated keywords. Across 10 representative sparse, dense, and generative baselines, CoGR achieves the best performance on both an internal APP Marketplace dataset and the public WANDS benchmark, improving $F_1$ over the strongest baseline by $10.9\%$ and $36.1\%$, respectively. Further analysis shows stable co-evolution and increasingly aligned query--item keyword spaces over training.
14. 【2609.00618】owards Effective Structured Context Modeling for Conversational Recommender Systems via Dual-node Monte Carlo Tree Search
链接：https://arxiv.org/abs/2609.00618
作者：Jincheng Zhang,Chen Huang,Wenqiang Lei,See-Kiong Ng,Yang Deng
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Conversational Recommendation Systems, Recommendation Systems, user preference tracking, conversational context modeling, context modeling
备注：
点击查看摘要
Abstract:We investigate the role of conversational context modeling in user preference tracking for Conversational Recommendation Systems (CRSs). In this regard, we propose DREAMS, a novel tree-structured context modeling framework that explicitly captures user preference evolution throughout multi-turn interactions. DREAMS introduces two specialized node types to support the two fundamental objectives of CRSs: preference elicitation and preference exploitation. Specifically, elicitation nodes leverage Monte Carlo Tree Search (MCTS) to strategically explore conversational actions and infer latent user preferences, while exploitation nodes employ LLM-based refinement to transform the tracked preference state into structured retrieval queries for recommendation. Extensive experiments on benchmark datasets demonstrate the effectiveness of DREAMS and its design.
15. 【2609.00604】NeuroGraph: An AI Graph-Driven Neuro-Symbolic Framework for Explainable Threat Reasoning in Advanced Manufacturing
链接：https://arxiv.org/abs/2609.00604
作者：Padmeswari Nandiya,Ahmad Mohsin,Ahmed Ibrahim,Iqbal H. Sarker,Helge Janicke
类目：Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：cyber-physical attack surfaces, analysis increasingly difficult, cyber threat intelligence, increasingly difficult, made cyber threat
备注： Submission to Springer:Journal of Information Security (Peer Review)
点击查看摘要
Abstract:The growing complexity of cyber-physical attack surfaces in advanced manufacturing has made cyber threat intelligence analysis increasingly difficult. Although large language models and retrieval-augmented generation have improved CTI workflows, text-based approaches remain vulnerable to hallucinations and provide limited support for structured reasoning over interconnected threats. Graph-based RAG reduces some of these limitations, but existing approaches often lack ontology-consistent multi-hop reasoning and transparent evidence tracing across heterogeneous cybersecurity data. This paper proposes a graph-grounded neuro-symbolic framework that integrates ontology-aware symbolic query generation, knowledge graph retrieval, and neural language generation to support accurate and explainable threat analysis across information technology and operational technology environments. The framework adopts a dual-large language model architecture: the first model translates natural-language questions into executable Cypher queries for symbolic graph retrieval, while the second generates answers strictly from the retrieved graph evidence. Experimental evaluation using publicly available cyber threat intelligence benchmarks shows consistent improvements over the published baseline in reasoning accuracy, while also reducing hallucinations, strengthening multi-hop reasoning, and improving robustness to adversarial perturbations. Runtime and explainability analyses further demonstrate that the framework maintains interactive inference performance and exposes graph-grounded reasoning artifacts that allow analysts to inspect and verify each stage of the analysis. Overall, the results highlight the potential of graph-grounded neuro-symbolic reasoning as a scalable, interpretable, and reliable approach to cyber threat intelligence for next-generation Industry 5.0 environments.
16. 【2609.00470】RIS: A Tri-Layer Retrieval Integrity Sieve Against Knowledge Poisoning
链接：https://arxiv.org/abs/2609.00470
作者：Muhaimin Bin Munir,Akib Jawad Ononto,Nazia Shehnaz Joynab,Bhavani Thuraisingham,Latifur Khan
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：grounds large language, large language models, critical attack surface, dominate dense retrieval, retrieved documents creates
备注： 15 pages, 2 figures, 10 tables. Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) grounds large language models in external corpora, but implicit trust in retrieved documents creates a critical attack surface: PoisonedRAG shows that a handful of crafted passages can dominate dense retrieval and steer generation toward attacker-chosen answers. We present the Tri-Layer Sieve, a middleware defense that sanitizes retrieved evidence through cross-embedding-space clustering with an independent judge model, structural filtering of trigger-payload artifacts, and LLM consistency verification. The design exploits a key weakness of retrieval-stage poisoning: a single document must satisfy one embedding geometry, one internal Trigger-Payload structure, and one generation objective - rarely all three simultaneously, a fragility that persists even against an adaptive attacker who paraphrases around it. On Natural Questions, HotpotQA, and MS-MARCO with Contriever retrieval (k=50), the Sieve reduces black-box Attack Success Rate from 67.0/87.0/64.0% to 3.0/14.0/4.0%, mitigates white-box HotFlip attacks from ~74% to 27.8% on NQ with Layer 3 enabled, and drives poisoned-document MRR to 0.000, while restoring clean accuracy from 13-33% under attack to 58-76%. Under an architecture-aware adversary who paraphrases triggers to evade the structural filter, enabling the consistency layer halves adaptive ASR (32.0% to 15.0% on NQ) while raising clean accuracy by 18 points, at an added latency of ~16-19 s/query under live retrieval.
17. 【2609.00364】Closed Forms and Synthetic Twins: Predicting Approximate Nearest Neighbor Recall from Embedding Statistics
链接：https://arxiv.org/abs/2609.00364
作者：Shmuel Herman
类目：Information Retrieval (cs.IR)
关键词：modern encoder recovers, product quantization, late-interaction models, fixed-dimensional encodings, raw FDE index
备注：
点击查看摘要
Abstract:Embedding models are trained and evaluated as if retrieval were exact; in production they serve behind approximate indexes -- HNSW, IVF, product quantization, or the fixed-dimensional encodings (FDEs) of late-interaction models -- whose behavior the encoder's benchmarks never see: one modern encoder recovers just 14% of its exact top-10 through its raw FDE index. Such failures surface only after an index is built, and the standard patches -- corpus-fitted transforms such as whitening -- must be fitted, stored, and refit as the corpus changes, and can silently rewrite what the encoder returns. This paper shows that index behavior is predictable before anything is built, from label-free statistics of the raw embeddings, through a ladder of instruments matched to what each index family consumes: (1) closed-form moment statistics for the fixed-grid quantizers (PQ, FDE); (2) simulation on a synthetic twin corpus -- cluster statistics made generative, on which any index, composed production systems included, can be built and tested -- for partition indexes; (3) size-extrapolated, lightly calibrated twins for graph indexes at million-document scale. Predictions land within 0.03 of measured recall on an unseen million-document corpus. The same geometry is trainable: targeting the one statistic no post-hoc transform can move -- the score margin -- lifts recall for every index family at once, at a small measured task cost. The result: index choice, correction pricing, and production recall forecast from one cheap measurement pass, on new corpora and new indexes alike; serving without per-corpus transform machinery, suited to continuously changing corpora; and a recall-compute frontier pushed by adapting encoders to geometry rather than coupling them to any single index.
18. 【2609.00319】Sources of Truth: A Multi-Platform, Multilingual Audit of Citations in AI Mental Health Information Queries
链接：https://arxiv.org/abs/2609.00319
作者：Phuong Anh Nguyen,Jill Noorily,Matthew Flathers,Haruka Notsu,Laura Ospina-Pinillos,Tommy Nguyen,Samantha Clark,Aoife Keane,Grace Thompson,John Torous
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Online health information, health information seeking, list of links, Online health, information seeking
备注： 28 pages (16-page main text plus supporting information), 5 figures, 5 tables. Under review. Code: [this https URL](https://github.com/mindbench-ai/search-source-audit) Data: [this https URL](https://huggingface.co/datasets/MindBench/search-source-audit)
点击查看摘要
Abstract:Online health information seeking is shifting from keyword search, where users consider a ranked list of links, to conversational systems that compose a single answer and curate its citations. Source evaluation therefore passes from user to platform, yet what these systems surface is poorly characterized. We audited three free consumer products (ChatGPT, Perplexity, Google AI Overview) on twenty English mental health questions under two prompt conditions, with a subset of three also translated into six further languages of varying resource tiers. We recorded 15,942 citations across 1,140 responses and 1,713 unique domains, then classified every citation with a nine-category organizational typology applied by a deterministic classifier validated against human coding. Citations were heavily concentrated: the ten most-cited domains accounted for 43.6% of English citations, and government, commercial health, and academic sources were closely matched at roughly 22% each. Platforms differed little in typical citation volume but sharply in consistency and in the source types they favored. Explicitly requesting sources shifted composition only modestly. Non-English queries surfaced fewer citations and were routed to language-appropriate resources at significantly lower rates. We release the typology, classifier, and annotated corpus as reusable instruments for auditing generative health search.
19. 【2609.00313】MUSES: A Benchmark for Prospective Intellectual-Roots Retrieval
链接：https://arxiv.org/abs/2609.00313
作者：Rohan Pandey,Sunjae Kwon,Hong Yu
类目：Information Retrieval (cs.IR)
关键词：Scientific discovery depends, finding prior literature, Scientific discovery, discovery depends, depends on finding
备注：
点击查看摘要
Abstract:Scientific discovery depends on finding prior literature that shapes what comes next. Existing retrieval systems optimize for relevance and popularity, often favoring central papers over less familiar works that later prove generative. We introduce \textbf{MUSES}, a million-instance benchmark for prospective intellectual-roots retrieval over a fixed 2.33M-paper corpus, with roughly 140K test instances per familiarity tier. To our knowledge, it is the first prospective benchmark at this scale with a shared retrieval task and author-confirmed paper-level root labels. Alongside it, \textbf{CiteRoots} pairs a scalable rhetorical layer over local citation text (LLM judge $\kappa = 0.896$ versus human gold) with a paper-level author-endorsed layer ($n = 1{,}518$ generative-inspiration pairs from 753 focal papers). MUSES organizes difficulty along two axes: a \emph{familiarity} axis spanning CiteNext, CiteNew, and CiteNew-Isolated, and a \emph{functional} axis spanning broad citations, rhetorical roots, and author-endorsed roots. Across 9 method classes, a lean multi-centroid retriever built on SPECTER2 is strongest. Hit@100 falls from 0.534 on CiteNext to 0.424 on CiteNew, 0.205 on rhetorical CiteNew, and 0.171 on author-endorsed CiteNew, a $3.1\times$ decline. In a registered eight-lens full-test audit, roughly half of broad-tier test instances remain unsolved at K=1{,}000. Rhetorical role and author endorsement are distinct: the same judge agrees with endorsement at $\kappa = 0.037$. We release MUSES, both CiteRoots layers, and a distilled open companion judge for future work on prospective retrieval and intellectual roots.
20. 【2609.00165】wo-Sided State-Space Models for Sequential Recommendation with Non-Random Multimodal Review Feedback
链接：https://arxiv.org/abs/2609.00165
作者：Ziwen Pan,Zihan Liang,Ruoxuan Xiong
类目：Information Retrieval (cs.IR)
关键词：Two-sided digital platforms, item popularity evolves, popularity evolves, user preferences shift, digital platforms
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Two-sided digital platforms are inherently dynamic: user preferences shift, item popularity evolves, and reviews both reflect and drive these changes. Yet most sequential recommendation systems treat reviews as passive signals for updating user states, leaving two aspects underexplored. First, review generation is nonrandom, depending on evolving latent states of both users and items. Second, reviews can reshape item states, induce spillover across related items, and influence future user decisions. To address these gaps, we propose a two-sided state-space model (TS-SSM) for event-conditioned sequential recommendation. TS-SSM consists of three components: (1) a modality-missing-not-at-random fusion module that encodes review content and informative observation patterns; (2) user-state evolution with temporal variation and local graph message passing that uses related item states to refine user preferences; and (3) item-state evolution with asymmetric carryover of positive and negative review feedback. In experiments across six Amazon categories, TS-SSM increases Recall@20 over BSARec by 14.8%--18.8% and exceeds HM4SR by 11.7% on average. On Goodreads Fantasy, Recall@20 improves HM4SR from .5191 to .5847. Ablations highlight distinct contributions of observation patterns, local propagation, and item dynamics.
21. 【2609.00035】SilentProbe: Measuring Silent Failure in Production APIs Used as Agent Tools
链接：https://arxiv.org/abs/2609.00035
作者：Zongrong Li,Shengkun Ye,Feiyou Guo,Zuoyou Dang
类目：Information Retrieval (cs.IR); Software Engineering (cs.SE)
关键词：LLM agent calling, production API, API cannot distinguish, distinguish a query, LLM agent
备注： 12 pages, 9 figures. Code and data: [this https URL](https://github.com/Jasper0122/silentprobe)
点击查看摘要
Abstract:An LLM agent calling a production API cannot distinguish a query that matched nothing from a query the server did not understand. Both return HTTP 200 with a parsable body, no exception to catch and no field to branch on. We ask what predicts which one occurred, and what it does to the agent. Auditing 721,320 parameters across 2,501 independently published OpenAPI documents, we find that 7.5% declare an enumeration and 15.2% declare any machine-checkable constraint at all, while 40.1% of documents state at least one constraint in prose that their schema does not encode. Executing 219 schema-derived perturbations against live commercial endpoints from 27 vendors, reached through a single aggregation layer (Monid) that publishes a schema and returns a run identifier for every call, we find that constraint form, not vendor identity, predicts honesty: machine-checkable constraints yielded an honest error in 111 of 111 cases, prose-only constraints failed silently in 44 of 61 (p = 2e-13). Twelve models across eight families then met these endpoints on ordinary tasks. A vocabulary that the description merely exemplifies was missed by every model on 88 of 88 attempts, while vocabularies written out in full were used correctly 88 to 91% of the time. Running the full agent loop, models detected the resulting silent failure in 12% of cases, repaired it in 0%, asserted a false negative to the user in 41%, and invented a figure in 12%. Promoting the vocabulary into the schema removes the failure, from 88 of 88 to 0 of 89. The fix is one line of schema rather than a better model. Code, schemas, perturbation sets, agent transcripts and per-call run identifiers are released at this https URL.
计算机视觉
1. 【2609.01607】Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to System
链接：https://arxiv.org/abs/2609.01607
作者：Penghao Wu,Haiwen Diao,Weichen Fan,Lewei Lu,Dahua Lin,Ziwei Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unified multimodal models, jointly perform visual, guarantee learning synergy, multimodal models, single model
备注：
点击查看摘要
Abstract:While unified multimodal models (UMMs) jointly perform visual understanding and generation within a single model, functional unification does not guarantee learning synergy: the two objectives may reinforce each other, compete for capacity, or merely coexist. We investigate their relationship at the representation, task, and system levels in a controlled, structurally native setting without pretrained vision priors. At the representation level, we find that each objective provides useful signal to the other: generation enriches the visual features learned for understanding, while understanding strengthens vision--language alignment for generation. However, when both objectives are forced through the same computation path, one tends to dominate. A task-decoupled architecture that specializes conflicting visual computation while preserving semantic interaction avoids this asymmetric degradation. At the task level, through three case studies, we find positive bidirectional transfer when understanding and generation tasks rely on shared knowledge. At the system level, we show that an end-to-end UMM outperforms a matched planner--executor pipeline on complex tasks that explicitly require both image understanding and generation. Together, these results show that the value of UMMs extends beyond a unified interface: appropriate specialization, shared task knowledge, and end-to-end optimization can turn coexistence into synergy.
2. 【2609.01598】UI-VISA: U-Net Initialized Vascular Image Segmentation Architecture
链接：https://arxiv.org/abs/2609.01598
作者：Asees Kaur,Suzanne S. Sindi,Erica M. Rutter
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：digital subtraction angiography, remains challenging due, images remains challenging, Accurate segmentation, subtraction angiography
备注： 9 pages, 6 figures
点击查看摘要
Abstract:Accurate segmentation of vascular structures in digital subtraction angiography (DSA) images remains challenging due to the thin, elongated, and branching nature of blood vessels. Pixel-wise deep learning approaches such as U-Net achieve strong general-purpose segmentation performance but often produce fragmented or discontinuous predictions in fine vascular regions, since they do not explicitly enforce structural connectivity. Region growing algorithms preserve spatial context and topological continuity, but are highly sensitive to seed point initialization and can be computationally expensive. We propose UI-VISA (U-Net Initialized Vascular Image Segmentation Architecture), a hybrid pipeline that combines the complementary strengths of both approaches. UI-VISA uses U-Net's foreground predictions as informed seed points for a CNN-guided region growing algorithm, which then iteratively refines the segmentation by enforcing local connectivity and recovering fine vessel details that U-Net alone tends to miss or over-predict. We evaluate UI-VISA against standalone U-Net and a prior region-growing-based method (VISA) using 5-fold cross-validation on 26 DSA images. UI-VISA achieves the highest mean Dice and clDice scores across folds, and a paired Wilcoxon signed-rank test shows the improvement in clDice is statistically significant ($p=0.023$), consistent with the method's design goal of preserving vascular connectivity, while the improvement in Dice does not reach significance ($p=0.104$).
3. 【2609.01584】A Benchmark for Vehicle Attribute Classification in Cross-Domain Surveillance Scenarios
链接：https://arxiv.org/abs/2609.01584
作者：Sergio M. Silva Jr.,Otavio T. Remer,Gabriel E. Lima,Lucas Wojcik,Rayson Laroca,David Menotti
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Intelligent Transportation Systems, Transportation Systems, Intelligent Transportation, Vehicle attribute analysis, component of Intelligent
备注： Accepted for presentation at the 2026 Conference on Graphics, Patterns and Images (SIBGRAPI)
点击查看摘要
Abstract:Vehicle attribute analysis is a key component of Intelligent Transportation Systems (ITS), supporting applications such as vehicle identification, traffic monitoring, and forensic investigation. However, models trained under controlled conditions often degrade in real surveillance scenarios due to changes in viewpoint, occlusion, illumination, and sensor characteristics. This paper introduces Unconstrained Vehicle Identification Benchmark (UVIB), a benchmark for evaluating three operational vehicle-analysis tasks: front/rear orientation, occlusion-related suitability for Vehicle Make and Model Recognition (VMMR), and color clarity. The benchmark contains 84,835 vehicle images from seven public Brazilian datasets, grouped into surveillance and general acquisition domains, with unified binary annotations that were not jointly available in the original sources. Four representative architectures, EfficientNetV2-S, ResNet-50, ViT/B-16, and YOLO11s-cls, are evaluated under mixed-domain, cross-domain, and cross-dataset protocols. The results show that domain shift has a stronger impact than architecture choice, with substantial degradation in cross-domain settings, especially for VMMR suitability and color clarity. While orientation generalizes more reliably, VMMR suitability remains affected by class imbalance and ambiguous occlusions, and color clarity is highly sensitive to illumination and sensor modality. These findings highlight the need for benchmarks and evaluation protocols that explicitly measure operational robustness beyond standard in-domain accuracy. The proposed benchmark is publicly available at this https URL.
4. 【2609.01582】SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation
链接：https://arxiv.org/abs/2609.01582
作者：Ziyun Qian,Zizhi Chen,Yizhou Liu,Mingyang Sun,Dingkang Yang,Lihua Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：convert natural language, generation requires models, stable visual geometry, semantic appearance, Visual Alignment Critic
备注：
点击查看摘要
Abstract:Complex 3D spatial text to image generation requires models to convert natural language into stable visual geometry, not merely semantic appearance. Existing prompt-driven or layout-conditioned methods improve controllability, but often lack an optimizable and verifiable spatial intermediary before visual sampling. As a result, object relations, occlusion, visibility, and camera constraints can decay during multi-round generation. This paper presents SpatialGuard, a structured layout-guided framework for complex 3D spatial text-to-image generation. SpatialGuard parses prompts into image synthesis-oriented 3D layouts through a Spatial Layout Architect, realizes them as visual conditions and candidate images through a Visual Realizer, and uses a Visual Alignment Critic to validate consistency among prompt, layout, and image. To keep constraints stable across iterations, SpatialGuard introduces a Layout Harness that organizes rule constraints, tool invocation, shared knowledge, and feedback loops around the editable layout state. This design turns complex spatial generation from implicit prompt following into a verifiable process of planning, realization, validation, and repair. Comprehensive experiments show that SpatialGuard achieves state-of-the-art performance in complex 3D spatial layout generation and improves spatial faithfulness over existing text-to-image and layout control baselines.
5. 【2609.01560】H3-World: Turning Language Understanding into World Control
链接：https://arxiv.org/abs/2609.01560
作者：Danze Chen,Zeqing Wang,Ziyue Lin,Xingyi Yang,Yeying Jin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：efficient framework, control, interactive world model, large video generators, video generators
备注：
点击查看摘要
Abstract:We present H3-World, an efficient framework that turns the 33B MiniMax-H3 video generator into an interactive world model. Our key finding is that, as large video generators become more capable, language is emerging as a natural interface for control. MiniMax-H3, for example, already supports zero-shot control of character behavior and camera motion through natural-language instructions. Building on this, H3-World turns this coarse language interface into precise, temporally grounded world control, without introducing dedicated action modules. Specifically, we represent each action as a structured combination of character and camera instructions, and align them with the corresponding temporal video latents. To make the control temporally precise, we further introduce temporal attention routing, which restricts each instruction to its intended time interval and reduces control leakage across actions. Importantly, H3-World directly reuses the semantic representations learned during large-scale video pretraining and requires only lightweight adaptation. With only 8,000 gameplay samples, 10,000 LoRA optimization steps, and 0.199% trainable parameters, H3-World achieves effective character and camera control while preserving strong generation quality. It also generalizes to unseen scenarios. These results show that the control capabilities emerging in large video generators can be efficiently transformed into interactive world control.
6. 【2609.01554】BS: Take the Hint - Interactive Multitracer PET/CT Lesion Segmentation with a Scribble-Conditioned ResEnc U-Net
链接：https://arxiv.org/abs/2609.01554
作者：Marven Sherif,Amgad Elmasry,Youssef Ghazal,Ayman Elghotni(Brightskies)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Automated lesion segmentation, physiological tracer uptake, tracer uptake patterns, Automated lesion, variety of physiological
备注：
点击查看摘要
Abstract:Automated lesion segmentation in whole-body PET/CT is complicated by the variety of physiological tracer uptake patterns and by the differing appearance of lesions across tracers. The autoPET/CT V challenge addresses this by making segmentation interactive: user scribbles marking foreground and background are supplied alongside the image, and the algorithm is expected to exploit them. We present our submission, a scribble-conditioned residual encoder U-Net operating on four input channels: CT, PET, and a sparse scribble map for each of foreground and background. The network is initialised from the autoPET-III winning weights and extended from two to four input channels, with the two scribble channels zero-initialised so that the pretrained representation is preserved exactly at initialisation. Every model is fine-tuned per fold from the corresponding autoPET-III fold checkpoint, so that no validation case is seen during pretraining. PET intensities are normalised against a per-scan aorta blood-pool reference derived from a CT segmentation, which removes tracer- and centre-specific scaling without requiring lesion labels. At inference the five fold models are ensembled by averaging their softmax outputs per sliding-window patch, before Gaussian-weighted stitching. On the challenge's five-fold split, with each fold evaluated on its own validation cases, mean Dice is 0.554 and mean lesion-level F1 is 0.528 without scribbles, rising to 0.751 and 0.733 after five correction rounds. About 85% of that gain follows the first scribble, and the spread between fold models narrows five-fold over the same rounds, so interaction largely compensates for how well or badly a given model segments unaided.
7. 【2609.01551】What, Where, and How: Probing Spatiotemporal Representations in Video Foundation Models
链接：https://arxiv.org/abs/2609.01551
作者：Sharon S. Musa,Fereshteh Forghani,Harrish Thasarathan,Sonia Joseph,Matthew Kowal,Konstantinos G. Derpanis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Self-supervised video foundation, learn rich spatiotemporal, ROC AUC, foundation models learn, models learn rich
备注： Interactive visualizations are available at [this https URL](https://vid-rep-pca.netlify.app/)
点击查看摘要
Abstract:Self-supervised video foundation models learn rich spatiotemporal representations, yet it remains unclear what visual concepts these representations encode, where they emerge across transformer layers, and how they are geometrically organized. In this work, we tackle these three questions through a systematic layer-wise analysis of V-JEPA 2 and VideoMAE-v2. We leverage lightweight probes trained to discover three temporally grounded properties: (i) camera motion understanding, (ii) intuitive physics, and (iii) anomaly detection. Both models encode camera motion, with best results ($90$ ROC AUC) emerging at 60-70% of network depth, and achieve moderate anomaly detection performance ($60$ ROC AUC), but remain near chance on intuitive-physics tasks, suggesting a limited encoding of deeper physical reasoning. Beyond classification, we find that temporal features from individual videos form smooth low-dimensional trajectories in representation space, suggesting that camera motion is not only linearly decodable but also geometrically organized. Based on these results, we apply geometry-aware spline-based steering in the model's latent representations to interpolate camera motion, yielding steered videos with smoother trajectories and more coherent temporal progression than linear interpolation.
8. 【2609.01530】Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison
链接：https://arxiv.org/abs/2609.01530
作者：Thibaut Loiseau,Guillaume Bourmaud,Vincent Lepetit
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：image pairs, Self-supervised pre-training, Gekko, co-visible regions, regions
备注： Project page: [this https URL](https://thibautloiseau.github.io/projects/gekko)
点击查看摘要
Abstract:Self-supervised pre-training via cross-view completion learns strong features for 3D vision from co-visible regions of image pairs. However, the reference view provides little information for reconstructing non-co-visible patches, implicitly yielding a monocular training signal in these regions. We introduce Gekko, which turns this limitation into a useful signal. The relative improvement of the cross-view reconstruction error over a masked-autoencoder error is a self-supervised proxy for co-visibility: large improvements indicate co-visible regions, negligible ones non-co-visible areas. Gekko is a network, trained from scratch, that jointly performs cross-view completion, masked autoencoding, and per-pixel prediction of this relative improvement, providing an additional binocular signal for all masked regions without any ground-truth 3D annotation. Under identical architectures and training data, Gekko consistently outperforms CroCo on zero-shot correspondence estimation, relative pose estimation, and pointmap regression, with up to 6 times higher accuracy at the strictest relative-pose threshold and a 22% drop in end-point error on ETH3D. The extra channel it learns is itself a strong co-visibility detector on unseen scenes, and Gekko's frozen features outperform released cross-view backbones of comparable or larger size. It can also be trained directly from raw videos with a simple stride-based curriculum, removing the cumbersome 3D preprocessing prior methods require while matching models trained on curated data. Code and pre-trained models are publicly available.
9. 【2609.01516】DualDiff3D: Dual Structure-Appearance Diffusion Priors for Reliability-Enhanced 3D Gaussian Splatting
链接：https://arxiv.org/abs/2609.01516
作者：Qian Wang,Yu Wang,Weiqi Li,Xinhua Cheng,Xiandong Meng,Ronggang Wang,Jian Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, limited input views, poor reconstruction quality, novel-view synthesis, scenarios with limited
备注：
点击查看摘要
Abstract:While 3D Gaussian Splatting (3DGS) has revolutionized 3D reconstruction and novel-view synthesis, scenarios with limited input views often lead to poor reconstruction quality and artifacts in rendered novel views. Recent efforts attempt to utilize powerful diffusion priors, yet they typically process rendered and reference views concatenated along an additional dimension in a single network. These methods overlook an inherent nature that different views should maintain appearance similarity but differ in structure due to view shifts, leading to blur caused by conflicts between the two properties. In this paper, we propose DualDiff, a novel pipeline that leverages dual diffusion priors with a Structure-Appearance Attention (SAA) module to introduce reference guidance for refining low-quality novel views rendered from flawed 3D representations. Specifically, we retain one diffusion branch to focus on extracting structural information from the low-quality novel views, while introducing another branch to ensure appearance consistency with reference views. Furthermore, we present a 3D reconstruction framework named DualDiff3D, which integrates a reliability-enhanced Render-Refine-Optimize (RRO) loop to progressively and robustly incorporate the refined novel views, yielding more accurate 3DGS. Extensive experiments demonstrate that our approach outperforms state-of-the-art methods even in the inference-only setting, with further performance gains achievable through training. Our code and pre-trained weights are available at this https URL.
10. 【2609.01515】mpCloze: Can Video-LLMs Identify the Missing Middle?
链接：https://arxiv.org/abs/2609.01515
作者：Wenqi Pei,Henry Hengyuan Zhao,Yilai Liu,Jiahao Meng,Han Chen,Ziyu Wang,Hongyang Du
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Temporal reasoning benchmarks, language priors, answer correlations, visual temporal reasoning, Temporal reasoning
备注： EMNLP 2026 Findings
点击查看摘要
Abstract:Temporal reasoning benchmarks for Video-LLMs are often mediated by language, leaving room for linguistic shortcuts from option wording, answer correlations, or language priors. To reduce such shortcuts, we introduce TempCloze, a video cloze benchmark for evaluating visual temporal reasoning in Video-LLMs. Given the beginning and ending clips of a video, models must identify the true missing middle from four candidates. TempCloze contains 1,521 carefully filtered videos from seven sources, mainly long-take and egocentric videos. We construct same-source distractors along three dimensions: Semantic asks what event should happen, Alignment probes when it should occur, and Progression tests how it should unfold, while shared scenes and objects reduce appearance cues. Our evaluation of 10 proprietary and 21 open-source Video-LLMs reveals Alignment as the primary bottleneck: models often recognize plausible semantic content and local event progression but struggle with temporal alignment. We further conduct error pattern and behavioral sensitivity analyses on TempCloze-Mixed and TempCloze-Hard with four representative models to examine where errors arise and how candidate order, context direction, visible span, frame density, and test-time scaling influence model choices.
11. 【2609.01511】Benchmarking Spatial, Spectral, and Self-Supervised Cues for Face Forgery Detection under Realistic Degradation
链接：https://arxiv.org/abs/2609.01511
作者：Lucas Cunha,Lucas Sotomaior,Lucas Gasperin,Beatriz Caldas,Eduardo Pianovski,Rayson Laroca
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：degradations remains limited, realistic image degradations, image degradations remains, Face Forgery Image, Face forgery
备注： Accepted for presentation at the 2026 Conference on Graphics, Patterns and Images (SIBGRAPI)
点击查看摘要
Abstract:Face forgery detectors often achieve strong results on controlled benchmarks, but their reliability under realistic image degradations remains limited. This paper presents a standardized benchmark for face forgery detection using the Multi-Dimensional Face Forgery Image (MFFI) dataset and evaluates performance on both clean and degraded test partitions. We compare six model families, including convolutional networks, transformer-based models, and a frozen self-supervised DINOv3 backbone, across spatial, spectral, and hybrid input representations. The results show that clean-set performance is not a reliable indicator of robustness under compression, resizing, and blurring. Xception with RGB obtains the best clean performance, reaching 0.884 mean ROC-AUC, but degrades substantially on the harder partition. In contrast, frozen DINOv3 achieves the strongest degraded-set result, with 0.726 mean ROC-AUC, while training only a linear classification head. The representation analysis indicates that Fourier-domain cues are most useful when combined with RGB information, whereas purely spectral inputs consistently underperform spatial representations. Qualitative attribution maps further suggest that convolutional detectors focus on localized artifacts, while DINOv3 relies on broader facial structure. These findings reinforce the need for degraded evaluation protocols and highlight self-supervised visual representations as a promising direction for robust face forgery detection. Our source code is publicly available at this https URL.
12. 【2609.01479】CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling
链接：https://arxiv.org/abs/2609.01479
作者：Xin Shen,Chengyou Jia,Keshuo Xing,Zifeng Zhu,Changliang Xia,Bowen Ping,Zhuohang Dang,Hangwei Qian,Minnan Luo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：camera parameters play, play a pivotal, pivotal role, role in dictating, explicit camera parameter
备注： Accepted to ACM Multimedia 2026
点击查看摘要
Abstract:Beyond semantic content, camera parameters play a pivotal role in dictating the geometric perspective and appearance of any given image. While recent image editing models excel at semantic and stylistic manipulation, they struggle with explicit camera parameter control. When handling large perspective shifts, instruction-driven models face a dilemma: they either suffer from structural tearing or generate conservative outputs that ignore geometric instructions. To address this, we introduce CameraEditor, a framework that reformulates camera-controlled editing from a spatial problem into a temporal sequence prediction task. By leveraging the temporal coherence of video diffusion models, our approach integrates an explicit geometric perception module with a dynamic reference routing mechanism. This allows us to construct geometrically rigorous visual reference pairs via dynamic panorama cropping, overcoming the ambiguity of text-based instructions. Furthermore, CameraEditor strategically inserts intermediate transition frames to decompose large perspective shifts, providing a robust temporal buffer that preserves content identity and spatial coherence. We construct a training dataset of 5,760 instances. As an independent contribution, we introduce CamEditor-Bench, a model-agnostic evaluation suite of 462 test cases. Extensive experiments demonstrate that CameraEditor achieves state-of-the-art camera control precision and source identity preservation, outperforming existing methods.
13. 【2609.01470】RadMatch: Auditable Radiology Report Evaluation via Finding-Level Matching
链接：https://arxiv.org/abs/2609.01470
作者：Charles Corbière,Léo Machado,Aubin Charley,Baptiste Callard,Pierre Manceron,Corentin Dancette
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：draft radiology reports, clinical quality remains, reliably evaluating, critical challenge, systems are increasingly
备注： Accepted to ECCV 2026 Workshop on Medical Foundation Models and Benchmarks
点击查看摘要
Abstract:As AI systems are increasingly used to draft radiology reports, reliably evaluating their clinical quality remains a critical challenge. Large language model (LLM)-based metrics are now the best-correlated with radiologist judgment, yet they output a single opaque score that neither a clinician nor a model builder can easily interpret or audit. We introduce RadMatch, a multi-stage, LLM-based metric that decomposes report comparison into a structured finding-level matching with significance-aware scoring and error characterization across seven clinical attribute dimensions (status, location, severity, morphology, certainty, longitudinal comparison, and measurement). The main score is the actionable-error count, both interpretable and auditable. Candidate findings are graded correct, partial, or incorrect, and unmatched findings are counted as missed or hallucinated. Triage and actionable safety recall/precision and per-subset views add complementary, deployment-oriented lenses. Across two expert benchmarks, RadMatch is the most clinically aligned metric, matching inter-radiologist agreement on ReXVal and more than doubling the best prior metric on the harder RadEvalExpert. Relying only on few-shot prompting, it is designed to extend to other modalities and anatomies. We will release RadMatch as open-source code with an interactive dashboard for inspecting results.
14. 【2609.01433】Gaussian Core LoRA: Distribution-Aware Dynamic Adaptation for Broad Concept Erasure
链接：https://arxiv.org/abs/2609.01433
作者：Qinghui Gong,Xunlei Chen,Yu-Xuan Zhang,Hua Meng,Zhengchun Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual quality, suppress unsafe, deployment efficiency, preserving benign semantics, Gaussian Core LoRA
备注：
点击查看摘要
Abstract:Concept erasure aims to suppress unsafe, privacy-sensitive, or undesirable generations in text-to-image diffusion models while preserving benign semantics, visual quality, and deployment efficiency. Existing adapter-based methods, such as Low-Rank Adaptation (LoRA), typically freeze the diffusion backbone and learn lightweight parameter updates to steer generation away from target semantics. However, these methods usually assign a static semantic erasure direction to each target concept. This assumption is overly coarse for broad and complex target concepts, since a concept often contains multiple latent semantic prototypes involving different objects, scenes, or relations, and requires different local erasure directions. A single LoRA update averages these heterogeneous erasure demands, leading to under-erasure on difficult prototypes and over-editing of nearby benign semantics. To address this limitation, we propose Gaussian Core LoRA, a distribution-aware low-rank adaptation framework. It fits a Gaussian mixture model in the prompt feature space to estimate latent semantic prototypes within the target concept. During inference, each input prompt is projected into this feature space to compute its Gaussian posterior responsibilities, which condition the core generator to produce a prompt-specific, norm-bounded residual reconfiguration of the shared LoRA rank space. This enables prototype-adaptive erasure with a single lightweight adapter. Compared with the strongest baseline on each metric, Gaussian Core LoRA reduces average Attack Success Rate (ASR) by 7.95%, lowers COCO Fr'echet Inception Distance (FID) by 14.72%, and improves CLIP Score by 4.98%. Further experiments show robustness to adversarial prompts, scalability to multi-identity and multi-style erasure, and compatibility with SDXL and FLUX.
15. 【2609.01427】Pix2Rep-v2: Data-Efficient Representation Learning for Dense Medical Imaging Applications
链接：https://arxiv.org/abs/2609.01427
作者：S. Sifaoui,E. Angelini,S. Toupin,T. Pezel,L. Le Folgoc
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：local descriptors required, Dense self-supervised learning, medical imaging tasks, solve dense medical, dense medical imaging
备注： Accepted at MICCAI 2026
点击查看摘要
Abstract:Dense self-supervised learning (SSL) is a powerful paradigm for learning without annotations the local descriptors required to solve dense medical imaging tasks. We present Pix2Rep-v2, a framework for SSL of pixel- and voxel-level representations suitable for few-shot downstream applications. Pix2Rep-v2 addresses the main challenges of dense SSL by leveraging a redundancy reduction objective at the pixel-level with a principle of equivariance of dense representations, that scales efficiently to 3D or wide field-of-view applications. We evaluate our method on four datasets, across multiple tasks, multiple modalities and anatomical structures using multiple backbones in 2D and 3D, and under various data regimes. As an alternative to linear probing or full fine-tuning on the downstream task, we also propose an in-context variant, without downstream training, based on a dense prototype approach. Pix2Rep-v2 shows substantially higher data-efficiency in few-shot scenarios compared to fully supervised baselines, and is competitive with the state-of-the-art e.g., +9.3 Dice points in one-shot segmentation on the MMs-2 dataset. Our code and pre-trained models are publicly available at this https URL.
16. 【2609.01426】Semantic-Guided Multimodal Preprocessing for Vision Transformer-Based Clear Cell Renal Cell Carcinoma Grading
链接：https://arxiv.org/abs/2609.01426
作者：Fatemeh Javadian,Zhu Chen,Zahra Aminparast,Johannes Stegmaier
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：Clear cell renal, renal cell carcinoma, cell renal cell, Clear cell, analyze patch-level images
备注： 12 pages, 3 Figures, COMPAYL++ MICCAI 2026
点击查看摘要
Abstract:Clear cell renal cell carcinoma (CCRCC) grading is essential for treatment planning, yet existing approaches either analyze patch-level images directly or focus solely on nuclei-level classification, without linking to final tumor grading. We propose a semantic-guided multimodal preprocessing method that integrates nuclei classification maps from existing pre-trained models with RGB histopathology images for Vision Transformer (ViT)-based CCRCC grading. Our approach employs classification map channel concatenation and multiplicative modulation, with optimized overlays to leverage nuclei grading information, while preserving RGB textural features. Evaluation of multiple preprocessing strategies demonstrates that semantic-guided enhancement achieves 0.916 balanced accuracy, outperforming RGB-only baseline (0.707) and max-voting aggregation from prior studies (0.427). Sensitivity analysis reveals that this 21 percentage point improvement over baseline persists even under simulated perturbation at rates matching current state-of-the-art nuclei classification model error thresholds, suggesting both effective semantic utilization and practical robustness. These findings show that preprocessing-based multimodal fusion can leverage the diagnostic potential of existing imperfect nuclei classifiers, effectively bridging previously isolated fine-grained nuclear-level analysis with coarse-grained ViT-based patch classification. Per-class recall was consistent across grades (0.93, 0.91, 0.91), indicating that gains are not concentrated in the majority class. Because the sensitivity analysis perturbs ground-truth maps rather than predictions from an actual nuclei model, this result characterizes robustness under simulated error rather than deployment with a real upstream model, which remains for future work.
17. 【2609.01423】MegaStyle++: Scaling Image Style Space through Hierarchical Style Definition
链接：https://arxiv.org/abs/2609.01423
作者：Junyao Gao,Sibo Liu,Jiaxing Li,Yanan Sun,Weidong Zhang,Cairong Zhao,Jun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：human-constructed concept shaped, style remains lacking, image style remains, highly abstract, style
备注： The dataset and code will be updated at [this https URL](https://github.com/Tencent/MegaStyle) , 10pages, 5 figures
点击查看摘要
Abstract:Image style is a highly abstract, human-constructed concept shaped by a range of visual factors and intrinsically entangled with content, yet a unified and explicit definition of image style remains lacking. In this work, we first discuss the fundamental question of what is style and then propose a hierarchical style definition that describes image style from an overall style identity to fine-grained visual attributes, providing a more structured, transferable, and interpretable style representation. Based on this definition, we refine the style annotation pipeline of MegaStyle and construct MegaStyle++-8M, a large-scale style dataset containing 150K overall style identities, 1M fine-grained style prompts, and 8M stylized images. Extensive analyses demonstrate that our hierarchical definition substantially expands the style space in both diversity and semantic breadth, while precisely capturing intrinsic visual style of reference images. The dataset and code will be updated at this https URL, we hope MegaStyle++ provides a scalable foundation for studying and modeling diverse image styles.
18. 【2609.01409】EdiTikZ: Scientific Figure Editing from Revision Trajectories
链接：https://arxiv.org/abs/2609.01409
作者：Christian Greisinger,Zhixue Zhao,Steffen Eger
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：shown strong performance, generating scientific figures, text or images, Vision-language models, shown strong
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) have shown strong performance in generating scientific figures from text or images. However, producing publication-ready figures requires iterative refinement, making scientific figure editing an important yet largely unexplored task. Existing approaches rely on costly proprietary agentic systems, focus primarily on evaluation, or construct training supervision from synthetically generated edits. Instead, we leverage naturally occurring scientific revision and development trajectories as a scalable source of supervision. To this end, we introduce DaEdiTikZ, the first large-scale dataset of revision-derived scientific figure edits, constructed by mining 391K plausible TikZ edit pairs from arXiv, GitHub, and TeX SE and inferring 781K directed edit instructions with a VLM conditioned on rendered figures and TikZ code. We further introduce DaEdiTikZ-Bench, a human-refined benchmark with 790 instances, and train two compact Qwen3.5-based EdiTikZ models (4B and 9B) by jointly learning reconstruction and editing, followed by reinforcement learning (RL) with complementary rewards for rendered fidelity and edit application. Automatic evaluation places our 9B model above all tested baselines, while human evaluation with 9 annotators and 4,320 ratings places it above GPT-5.6-Sol and on par with Gemini-3.1-Pro. Under severe out-of-distribution shifts, it remains competitive with GPT-5.6-Sol near its 2K training sequence-length regime. Models and datasets will be released.
19. 【2609.01408】Neuro-Symbolic Geometric Abstraction (NeuSOGA): From Observations to Symbolic Mathematical Representations
链接：https://arxiv.org/abs/2609.01408
作者：Qingde Li,Qingqi Hong,Jie Tian
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：symbolic representations suitable, fundamental challenge, Geometric Abstraction, symbolic mathematical representations, Neuro-Symbolic Geometric Abstraction
备注： 18 pages, 6 figures. Code repository: [this https URL](https://github.com/QL-UoHull/NeuSOGA)
点击查看摘要
Abstract:A fundamental challenge in artificial intelligence is the transformation of observations into explicit symbolic representations suitable for abstraction, interpretation, and reasoning. While modern AI systems achieve remarkable perceptual capabilities through large-scale statistical learning, the resulting knowledge is typically encoded within latent parameters that are difficult to inspect or manipulate analytically. Inspired by Neuro-Symbolic AI and theories of human abstraction, this paper investigates the formation of symbolic mathematical representations from geometric observations. We propose NeuSOGA (Neuro-Symbolic Geometric Abstraction), a framework that progressively transforms observations into topological abstractions, geometric abstractions, and ultimately symbolic mathematical representations. The architecture combines topology-guided structural discovery using Euclidean Distance Transforms, foundation-model perception using Segment Anything, adaptive multi-scale geometric abstraction, and symbolic synthesis through Implicit Area Splines. The resulting representation is an analytical implicit model supporting arbitrary-order smoothness, additive composition, and closed-form evaluation. Unlike neural latent encodings, the generated representation remains interpretable, editable, and mathematically explicit. Experiments on ModelNet40 point clouds, arbitrary-view projections, and segmented optical observations demonstrate that NeuSOGA transforms diverse observations into compact symbolic representations while preserving essential geometric and topological structure across sensing modalities and viewing directions. NeuSOGA provides an interpretable and explainable pathway from observation to symbol and establishes
Comments:
18 pages, 6 figures. Code repository: this https URL
Subjects:
Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
Cite as:
arXiv:2609.01408 [cs.AI]
(or
arXiv:2609.01408v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.01408
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Qingde Li [view email] [v1]
Tue, 1 Sep 2026 15:29:30 UTC (9,270 KB)
20. 【2609.01392】Scale-based Approach for Active Wildfire Segmentation on Satellite Imagery
链接：https://arxiv.org/abs/2609.01392
作者：Matheus F. Kovaleski,Cristiano Premebida,João Ruivo Paulo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：low-density fire observations, highly imbalanced nature, fire pixels, fire observations, low-density fire
备注： 6 page, 2 figures, 3 tables
点击查看摘要
Abstract:Active wildfire mapping from satellite imagery is challenging due to the sparse and highly imbalanced nature of fire pixels, especially in early-stage or low-density fire observations. This work investigates the use of multispectral Landsat-8 imagery for active-fire segmentation under multi-scale wildfire size conditions. We propose a data-driven protocol to characterize fire-region size distributions through connected-component analysis and an interquartile range criterion, enabling the evaluation of model robustness across different local fire-region densities. Three segmentation architectures, U-Net, DeepLabV3+, and SegFormer, are evaluated under different SWIR-based spectral configurations. Results show that U-Net achieves the strongest robustness across the evaluated conditions, SegFormer provides competitive performance, and DeepLabV3+ tends to produce conservative predictions with reduced recall. Across architectures, SWIR2 consistently achieves the strongest or near-best results, highlighting its importance for active-fire segmentation in Landsat-8 imagery. These findings suggest that both spectral band selection and architectural design are critical for robust satellite-based active wildfire mapping trained on low active fire-pixel density images.
21. 【2609.01390】Multimodal RGB-Infrared Combination for UAV-Based Wildfire Segmentation: A Comparative Study on FLAME3
链接：https://arxiv.org/abs/2609.01390
作者：Matheus F. Kovaleski,Luís Garrote,Cristiano Premebida,Jérôme Mendes,João Ruivo Paulo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unmanned Aerial Vehicles, low operational cost, Unmanned Aerial, Aerial Vehicles, firefighting operations due
备注： 6 pages, 1 figure, 1 table
点击查看摘要
Abstract:Unmanned Aerial Vehicles (UAVs) have emerged as a promising platform for firefighting operations due to their flexibility, low operational cost, and ability to acquire high-resolution imagery in locations that may be difficult or dangerous to access using conventional methods. Recent advances in deep learning have significantly improved the capabilities of UAV-based wildfire monitoring systems. The present work investigates RGB-infrared fusion for binary wildfire segmentation on the FLAME3 dataset. In this Study, RGB and Infrared baselines are compared with three representative fusion strategies across three segmentation architectures, including U-Net, DeepLabV3+, and SegFormer. The key motivation of this work is to analyze the contribution of each modality, evaluate the impact of fusion timing, and examine how different network architectures exploit multimodal information for UAV wildfire delineation. The findings indicate that thermal information plays a dominant role in UAV segmentation and that feature-level multimodal fusion combined with transformer-based architectures offers the most promising direction for future research.
22. 【2609.01383】InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations
链接：https://arxiv.org/abs/2609.01383
作者：Maeve Hutchinson,Syed Mahbubul Huq,Mohammad Albinhassan,Radu Jianu,Aidan Slingsby,Pranava Madhyastha
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：demonstrated remarkable proficiency, modern data analysis, Vision Language Models, Vision Language, inherently dynamic
备注： To be presented at EMNLP Main Conference
点击查看摘要
Abstract:Vision Language Models have demonstrated remarkable proficiency in interpreting static visual artifacts, but modern data analysis is inherently dynamic, requiring the active interrogation of interactive environments. Existing benchmarks are predominantly constrained to static imagery and one-shot question answering and fail to capture the epistemic demands of this domain, where evidence is frequently occluded, distributed across linked views, or conditionally revealed through user agency. In this paper, we introduce InSight, a benchmark for agentic claim verification over interactive visualizations. The dataset consists of 21,349 claims derived from human-authored analytical narratives and grounded in fully interactive web-based environments. Agents must navigate these environments to determine whether a natural language claim is supported, refuted or not verifiable given the available evidence. Unlike traditional evaluations, InSight treats interaction traces as intrinsic proxies for reasoning, enabling a rigorous audit of how models seek and synthesize visual evidence. We evaluate state-of-the-art models, revealing that interactive verification remains a non-trivial challenge. We release InSight at this https URL.
23. 【2609.01375】IntroConformal: Conformal Factuality Guarantees for Large Vision-Language Models via Introspective Signals
链接：https://arxiv.org/abs/2609.01375
作者：Md. Atabuzzaman,Christian Alexander,Chris Thomas
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Large Vision-Language Models, strong multimodal performance, content remains challenging, generated content remains, Large Vision-Language
备注： EMNLP 2026 main conference
点击查看摘要
Abstract:Large Vision-Language Models (LVLMs) have achieved strong multimodal performance, yet ensuring the factual correctness of generated content remains challenging. Existing methods that provide statistical guarantees on factuality typically rely on external verifiers or generation-time confidence signals, which introduce auxiliary dependencies or often fail for confident but incorrect outputs. We argue that reliable factuality control can instead be achieved through introspective signals derived from the model itself. We introduce IntroConformal, a training-free Conformal Risk Control (CRC) framework that provides finite-sample, distribution-free factuality guarantees. We first instantiate it with layer-wise semantic stability, a conformity score derived from hidden-state representations, and then propose verification probability, a stronger score capturing the model's self-administered judgment on claim factuality. Across multiple LVLM architectures, IntroConformal satisfies the conformal risk guarantee while substantially reducing abstention and achieving competitive or superior claim-level discrimination relative to external verifier-based baselines.
24. 【2609.01370】Diffusion Based Unpaired Data Learning for Inverse Problems
链接：https://arxiv.org/abs/2609.01370
作者：Chenglong Bao,Yiming Dang,Chenguang Duan,Yuling Jiao,Defeng Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deep learning-based inverse, inverse problem solvers, learning-based inverse problem, deep learning-based, Data
备注： 30 pages, 7 figures
点击查看摘要
Abstract:Data is important in many deep learning-based inverse problem solvers. However, obtaining sufficient paired data in many scenarios remains highly challenging, while unpaired data is cheap. To maximize data utilization, this paper proposes LUD-DIF, a diffusion-based approach for solving inverse problems with unpaired data. Starting from the evidence lower bound (ELBO) of the joint distribution, we decouple it into two independent diffusion processes under the weak-coupling assumption. The method provides theoretical support from a variational inference perspective, derives the loss function, quantitatively analyzes the error bound introduced by the assumption, and offers a theorem-motivated heuristic for hyperparameter selection. Experimental results demonstrate that LUD-DIF achieves outstanding performance on multiple image inverse problems, validating its effectiveness and generalization capability in unpaired inverse problem settings.
25. 【2609.01368】Accurate Reconstruction of Gas Turbine Blade Geometry Using 3D/2D Rigid Registration and CT View Optimization
链接：https://arxiv.org/abs/2609.01368
作者：Hristo Valtchanov,Nicolas Piché,Vladimir Brailovski,Justin Byers,Catherine Désrosiers,François Guibault
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：directly affect thermal, affect thermal performance, Non-destructive X-ray, complex internal structures, gas turbine blades
备注： conference proceedings International Conference on Computed Tomography (iCT) 2025, 8 pages, 6 figures
点击查看摘要
Abstract:Non-destructive X-ray and computed tomography (CT) testing are essential for ensuring the dimensional accuracy of manufactured components with complex internal structures, such as the cooling channels in gas turbine blades, which directly affect thermal performance and service life. This study presents a multipart 3D-2D rigid registration approach for aligning CAD models with X-ray projections as an alternative to CT reconstruction for part inspection and measurement. A greedy registration algorithm sequentially aligns the blade's exterior before registering its internal components by maximizing the mutual information between simulated and acquired X-ray images. This stepwise approach reduces problem complexity and improves alignment accuracy. View angles are optimized using a greedy method that iteratively selects angles to minimize dimensional measurement errors. The results indicate that a small number of oblique views provides the best accuracy, although a broad range of angles yields acceptable results. The method achieves subpixel registration accuracy, with errors below one-fifth of the magnified detector-pixel pitch. Image noise and defects reduce registration precision, but direct registration in projection space mitigates these effects compared with CT reconstruction. Appropriate view selection can therefore preserve acceptable subpixel accuracy in the presence of image noise and defects.
26. 【2609.01344】ExBind: A Controlled Diagnostic Benchmark for Visual-to-Executable Correspondence
链接：https://arxiv.org/abs/2609.01344
作者：Ziqian Wang,Yuxiao Cheng,Tingxiong Xiao,Jinli Suo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal coding, exact executable object, incorrect DOM node, Multimodal, semantic referent
备注： 19 pages, 3 figures, benchmark and diagnostic evaluation paper
点击查看摘要
Abstract:Multimodal coding and editing systems must map a visible or semantic referent to the exact executable object that can be edited. A wrong reference may select a valid but incorrect DOM node, SVG element, graph endpoint, hierarchy member, or table cell, while final execution success alone does not reveal the source of the failure. ExBind isolates this visual-to-executable correspondence layer as a controlled diagnostic benchmark between semantic localization and action execution. It samples representation-independent latent binding instances and compiles them into SVG, DOM, canvas, tree, graph, and table cases with deterministic mappings to executable references. Models output only a strict reference; the evaluator maps predictions back to latent structure and scores structural constraints without requiring reasoning traces. The release contains a 250-case broad suite, a disjoint 240-case targeted suite, and 50 paired latent groups. Qwen2.5-VL-3B achieves 98.4% candidate validity but 76.4% exact accuracy, while Qwen3-VL-4B achieves 100.0% validity and 98.8% exact accuracy. In the targeted table suite, all Qwen2.5-VL-3B residual errors are valid correct-row/wrong-column selections. Candidate-order perturbations change case-level outcomes while preserving this error pattern. ExBind is designed for controlled diagnosis rather than population-scale ranking or end-to-end editing evaluation. Code and benchmark records are available at this https URL and this https URL.
27. 【2609.01318】Reliability Challenges in Diffusion Vision-Language Models
链接：https://arxiv.org/abs/2609.01318
作者：Md. Atabuzzaman,Chris Thomas
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Diffusion-based Large Vision-Language, Diffusion-based Large, Large Vision-Language Models, Large Vision-Language, bidirectional context
备注： EMNLP 2026 main conference
点击查看摘要
Abstract:Diffusion-based Large Vision-Language Models (dLVLMs) have recently emerged as a compelling alternative to autoregressive (AR) LVLMs, offering advantages in parallel decoding, bidirectional context, and controllable generation. Despite rapid progress, their reliability properties remain largely uncharacterized. We present the first systematic reliability evaluation of hallucination and bias in dLVLMs, benchmarking six diffusion models against competitive AR baselines across four dimensions. Our key findings are: (1) dLVLMs reverse the yes-bias of AR models in binary visual queries; (2) they achieve competitive hallucination rates yet exhibit degraded linguistic quality; (3) they collapse to near-zero accuracy on underrepresented racial groups with opposite-polarity gender bias; and (4) they exhibit accuracy collapse in multiple-choice settings when the correct option is shorter than its distractors, associated with a length prior that emerges at the first denoising step. Tokens committed at late denoising steps with low confidence further correlate with hallucinated content, pointing to a mechanistic signal unique to diffusion generation. These patterns vary across model families, suggesting reliability is shaped by the generative paradigm together with training data.
28. 【2609.01316】MIDR: Enrichment-Augmented Indexing for Multimodal Document Retrieval
链接：https://arxiv.org/abs/2609.01316
作者：Debanjan Mahata,Atharva Tendle,Daniel Preotiuc-Pietro,Yong Zhuang,Ozan Irsoy
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：plain OCR linearizes, OCR linearizes, visually rich documents, plain OCR, representation problem
备注： To appear in Proceedings of EMNLP 2026
点击查看摘要
Abstract:Retrieval over visually rich documents has a representation problem: important content often lives in tables, charts, figures, and layout relations that plain OCR linearizes, corrupts, or omits. ColPali-family visual retrievers address this with patch-level multi-vector indexes and late-interaction scoring, keeping image-derived retrieval on the query-time serving path. We introduce MIDR (Multimodal Indexing for Document Retrieval), a training-free framework for enrichment-augmented indexing that shifts multimodal reasoning to index time. During ingestion, a multimodal LLM converts rendered pages into verified textual fields that are indexed with BM25F and optionally fused with dense retrieval, enabling text-centric serving over multimodally grounded evidence. On ViDoRe V3, MIDR Hybrid achieves 0.6219 average nDCG across five English domains, a 23.0% relative gain over BM25, remaining competitive with ColQwen2.5. On two French-document domains, enrichment bridges English queries and French page text, lifting BM25 from 0.1532 to 0.5448 nDCG and outperforming ColQwen2.5. Across all seven domains, MIDR leads ColQwen2.5 on four while using approximately 9x smaller index memory and approximately 2x lower query latency. These results establish index-time multimodal reasoning as a compelling accuracy-deployment alternative to serving-time visual late interaction.
29. 【2609.01308】CMRVision: A Foundation Model for Cardiac MR Image Analysis
链接：https://arxiv.org/abs/2609.01308
作者：Athira J. Jacob,Puneet Sharma,Daniel Rueckert
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cardiac magnetic resonance, CMR foundation model, magnetic resonance, imaging provides complementary, CMR
备注： Accepted at MedAGI 2026 (peer-reviewed workshop at MICCAI 2026)
点击查看摘要
Abstract:Cardiac magnetic resonance (CMR) imaging provides complementary information on cardiac anatomy, function, and tissue characterization across multiple sequences and views. In this work, we investigate foundation model pretraining for 2D CMR and introduce CMRVision, a CMR-specific foundation model trained using DINOv3-style self-supervised learning on a multi-center, multi-sequence cohort of 36 million CMR images. We systematically evaluate architectural and training design choices for domain-specific pretraining. CMRVision is evaluated on two downstream tasks: multi-task segmentation across cine, late gadolinium enhancement (LGE), and mapping sequences, and cine view classification. Our experiments show that CMR-specific pretraining, smaller patch sizes, and patch-level objectives consistently improve downstream performance. Across a multi-task segmentation benchmark, CMRVision achieved the strongest overall performance, outperforming prior natural-image (NI), medical-image, supervised, and CMR foundation model baselines. Improvements were modest but consistent across structures and sequences, with Dice scores ranging from 0.940-0.967 for LV and 0.855-0.905 for myocardium, and reaching 0.929 for RV, 0.920 for LA, and 0.931 for RA. The largest gains were observed for myocardium segmentation in LGE and mapping images. In a zero-shot segmentation task on unseen LGE long-axis views, the model achieved an average Dice score of 0.692, demonstrating cross-view generalization. For cine view classification, CMRVision achieved the highest average accuracy (0.906), compared to prior methods reported in the literature. These results highlight the potential of CMRVision to support robust and generalizable cardiac MRI analysis across multiple sequences and views.
30. 【2609.01306】MeshSplatBench: A Unified Benchmark for Triangle-Based Neural Rendering
链接：https://arxiv.org/abs/2609.01306
作者：Kaixuan Zhang,Minxian Li,Mingwu Ren,Xiatian Zhu
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：geometric primitives compatible, standard rasterization hardware, Triangle-based neural rendering, optimizing explicit geometric, explicit geometric primitives
备注：
点击查看摘要
Abstract:Triangle-based neural rendering bridges neural scene representations and conventional graphics pipelines by optimizing explicit geometric primitives compatible with standard rasterization hardware. However, existing approaches are evaluated almost exclusively within custom research renderers, obscuring their practical deployability in production engines. To bridge this gap, we introduce \textbf{MeshSplatBench}, a unified benchmark that systematically investigates triangle-based neural rendering across the complete pipeline from native optimization to game-engine deployment. MeshSplatBench establishes a standardized evaluation protocol while preserving each method's native optimization semantics, reproducing published results within $0.8\%$ PSNR deviation. Furthermore, we introduce a hierarchical Unity deployment protocol spanning three rendering tiers: native CUDA renderers, method-specific dedicated engine shaders, and standard opaque mesh pipelines, isolating the exact fidelity losses caused by engine adaptation \textit{vs.} representation reduction. Finally, we conduct a topological audit of reconstructed surfaces, demonstrating that explicit connectivity and shared indexing alone are insufficient to guarantee production-ready assets due to prevalent non-manifold structures, fragmented components, and boundary artifacts. Overall, MeshSplatBench demonstrates that rasterizability is merely a primitive-level attribute, whereas graphics readiness requires jthe holistic alignment of representation, topology, and engine compatibility. Source code will be released.
31. 【2609.01289】Agentic Multimodal Models for Environmental Hyperspectral Unmixing
链接：https://arxiv.org/abs/2609.01289
作者：Michał Cholewa,Luca Ciampi,Nicola Messina,Przemysław Głomb,Giuseppe Amato
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：decompose mixed pixels, constituent material signatures, key task, task in remote, remote sensing
备注：
点击查看摘要
Abstract:Hyperspectral unmixing is a key task in remote sensing that aims to decompose mixed pixels in hyperspectral images into their constituent material signatures, or endmembers, and their fractional abundances. Conventional modular approaches estimate the scene composition through successive model-order estimation, endmember extraction, and abundance estimation stages, whose errors can lead to redundant or ambiguous candidate components and ultimately affect the recovered decomposition. We introduce an algorithm-agnostic, large vision-language model (LVLM)-driven agentic framework that refines the outputs of such pipelines rather than replacing their underlying numerical algorithms. Starting from an initial decomposition, the agent iteratively gathers complementary spectral and spatial evidence through dedicated tools, including spectral-library retrieval and abundance-map visualization, and modifies the active endmember set through merge and discard operations followed by abundance re-estimation. We apply the same refinement procedure to several modular pipelines combining different model-order, extraction, and abundance-estimation methods, and evaluate it on HYDICE Urban, Jasper Ridge, and Stonewall Playa. Experiments show that the proposed agent consistently improves endmember cardinality and generally improves the recovered spectral signatures and abundance maps across heterogeneous modular pipelines, while remaining competitive with integrated end-to-end unmixing methods, including CNN-AE, uDAS, and R-CoNMF. These results highlight the potential of tool-using LVLM agents to combine spectral and spatial evidence for algorithm-agnostic refinement of physically grounded hyperspectral unmixing decompositions. Code is publicly available at this https URL.
32. 【2609.01282】HiLRP: Toward One Trustworthy Explanation for Vision Transformer: Conservation-Valid Attribution via Attention Primitives
链接：https://arxiv.org/abs/2609.01282
作者：Sathiyamohan Nishankar,Pubudu Sanjeewani,Asanka Perera,Selvarajah Thuseethan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Vision Transformer, combining convolutional stems, backbones combining convolutional, patch merging, increasingly diverse
备注：
点击查看摘要
Abstract:Vision Transformer (ViT) design has become increasingly diverse, with backbones combining convolutional stems, windowed, linear, or multi-axis attention, patch merging, and spatial reduction in various configurations. This diversity poses challenges for existing attribution methods, whose assumptions often do not hold across ViT variants: Grad-CAM requires a terminal spatial feature map, attention rollout assumes global softmax attention, and layer-wise relevance propagation (LRP) requires module-specific rules. To the best of our knowledge, no existing method provides a unified attribution framework across this architectural space. We show that this architectural diversity can be captured by a simpler underlying structure. The attention and resolution-reduction operators in current ViTs can be decomposed into four operation types: linear maps, bilinear mixing, normalization or gating, and reindexing. Each operation admits a relevance rule that satisfies conservation. Based on these rules, HiLRP supports new backbones by construction rather than by architecture-specific derivation, and its attribution maps decompose the prediction rather than relying on heuristic assumptions. We prove conservation and conditional equivariance and verify both to machine precision. Across 14 attribution methods and 10 architectures, we find that no prior method remains reliable across ViT families, while Faithfulness Correlation becomes uninformative for backbones robust to spatial masking. HiLRP alone preserves conservation across windowed, spatial-reduction, multi-axis, and linear-attention models, where naive extensions can produce zero or inflated relevance. It also localizes attribution failures in class activation mapping, achieving 0.97 Pointing compared with 0.55 for competing methods on EfficientViT.
33. 【2609.01277】meSteer: Inference-Time Speech Scheduling in Joint Audio-Visual Diffusion Models
链接：https://arxiv.org/abs/2609.01277
作者：Chao Zhou,Yiling Chen,Qi Chu,Tao Gong,Nenghai Yu,Tianyi We
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)
关键词：offer rich control, diffusion models offer, models offer rich, rich control, explicit control
备注：
点击查看摘要
Abstract:Although pretrained joint audio-visual diffusion models offer rich control over \emph{what} to generate, they provide no explicit control over \emph{when} an utterance should occur. To address this, we study \emph{inference-time speech scheduling}, a novel task that places coupled speech and visual articulation within user-specified begin--end intervals without finetuning the backbone model. We uncover two intrinsic properties of the denoising process that enable this task. First, a timing-sensitive text-to-audio cross-attention head exposes each utterance's model-implied source span along the latent timeline. Second, the predicted clean latent already organizes coupled speech and visual articulation, allowing their temporal placement to be edited without regenerating the content. Building on these discoveries, we propose \textbf{TimeSteer}, a training-free framework that localizes each utterance's source span through \textbf{Source Span Localization} and transfers the associated audio-visual latent content from the source interval to the specified target interval through \textbf{Region-Aware Latent Remapping}. We further introduce \textbf{SpeechShift}, the first benchmark for interval-level speech scheduling in joint audio-visual generation. Experiments across two representative backbones show that TimeSteer substantially improves interval controllability over training-free baselines while maintaining competitive overall generation quality.
34. 【2609.01276】Seeing the World and the Self from Egocentric Video
链接：https://arxiv.org/abs/2609.01276
作者：Kai Guan,Minchao Jiang,Ruichen WangLi,Wentao Zhu,Lei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：shared metric frame, scene, recovering the surrounding, motion, Complete
备注：
点击查看摘要
Abstract:Complete 3D perception from egocentric video requires recovering the surrounding scene and the wearer's full-body motion in a shared metric frame. Existing methods typically address scene reconstruction and motion estimation separately: scene reconstruction methods ignore the wearer, whereas motion estimation methods lack explicit scene geometry and often depend on external trajectories. Joint recovery is challenging because the two tasks exhibit asymmetric visibility and require different prediction paradigms. The largely visible scene supports deterministic geometric regression, whereas the severely occluded body requires generative motion inference. We therefore propose RESELF (REconstructing the Scene and the sELF), a unified framework that couples deterministic metric geometry reconstruction with geometry-conditioned motion generation. RESELF adapts a geometry foundation model pre-trained on large-scale exocentric data to egocentric video using frame-wise scale and relative-pose consistency objectives. The resulting camera trajectory and latent geometric features condition a diffusion model that recovers the wearer's motion. A subsequent closed-loop kinematic feedback stage further refines the camera head while preserving the reconstructed scene geometry. To support training and evaluation, we curate EE4D-JSM from EgoExo4D by aligning egocentric video, sparse metric scene geometry, camera trajectories, and full-body motion annotations. Experiments show that RESELF outperforms state-of-the-art methods designed for the individual tasks across depth estimation, camera tracking, and full-body motion estimation. Code, models, and datasets will be available at this https URL.
35. 【2609.01252】MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generation
链接：https://arxiv.org/abs/2609.01252
作者：Zhijian Qiao,Xinjiang Wang,Jiajie Chen,Haoming Huang,Meng Li,Chih-Chung Chou,Jing Wang,Shaojie Shen
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：camera-controlled video generation, geometry-aware positional encodings, positional encodings condition, encodings condition tokens, video generation
备注： 22 pages, 12 figures, and 7 tables. Project page: [this https URL](https://qiaozhijian.github.io/merope/)
点击查看摘要
Abstract:In camera-controlled video generation, geometry-aware positional encodings condition tokens on camera extrinsics and per-token viewing rays. Existing schemes, however, have a scale-dependent failure mode on real-world metric camera trajectories: homogeneous projective encodings cause attention logits and feature norms to grow unbounded with physical translation baselines. We propose MeRoPE (Metric Rotary Position Embedding), a norm-preserving relative camera encoding for attention. MeRoPE encodes relative orientations between calibrated viewing rays with orthogonal rotation blocks, maps raw metric displacements into multi-frequency rotary phases, and adds a disparity-anchored correspondence prior along the epipolar arc. This design strictly preserves feature norms, bounds pre-softmax attention logits regardless of the physical translation scale, and maintains exact invariance to global rigid coordinate changes. Across nuScenes and PanShot, which cover large-baseline trajectories and diverse camera optics, respectively, MeRoPE achieves stronger camera control than prior encodings, with the best consistency between generated camera motion and conditioning poses in both rotation and translation. Code will be made publicly available.
36. 【2609.01249】One Prompt Is Enough: Watermark Laundering Through Foundation Image Models
链接：https://arxiv.org/abs/2609.01249
作者：Jidong Yang,Qi Li,Wei Zong,Yang-Wai Chow,Willy Susilo,Huaike Yu,Chunpeng Wang,Suo Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)
关键词：predefined perturbations, invisible watermark, invisible watermark evaluation, Invisible, Invisible watermarks
备注： 11 pages, 4 figures, and 2 tables
点击查看摘要
Abstract:Invisible watermarks are typically evaluated against predefined perturbations such as compression, blur, noise, cropping, and denoising. Public foundation image models expose a distinct threat: an attacker can submit a watermarked image with a single reconstruction prompt and obtain a visually faithful output from which the invisible watermark can no longer be decoded reliably. We formalize this failure mode as watermark laundering and evaluate it using a joint payload-fidelity profile that combines bit error rate (BER) with visual and semantic preservation. Across six OpenAI and Google image editing models, three representative watermarking schemes, and 1,800 reconstructed outputs, we identify two complementary laundering regimes: OpenAI models produce the strongest payload disruption across the evaluated schemes, whereas Nano Banana 2 shows that DwtDct remains vulnerable under high-fidelity reconstruction. Prompt ablations show that no single removal-oriented instruction is necessary for payload disruption, indicating that the effect is primarily induced by the reconstruction pathway rather than by explicit attack wording. Comparisons with conventional attacks further show that prompt-conditioned reconstruction constitutes a distinct operational attack interface. These findings motivate foundation-model reconstruction as a missing robustness condition in invisible watermark evaluation.
37. 【2609.01224】S$^2$Prune: Spatially Structured Visual Token Pruning for Multimodal Large Language Models
链接：https://arxiv.org/abs/2609.01224
作者：Yuanyuan Jia,Shunpu Tang,Qianqian Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, multimodal large language, language models, reduces the inference, inference overhead
备注： 18 pages, including supplementary material. Code is available at [this https URL](https://github.com/yuanyuanjia71-spec/S2Prune)
点击查看摘要
Abstract:Visual token pruning reduces the inference overhead of multimodal large language models (MLLMs) by retaining only a subset of visual tokens. Existing methods usually select tokens based on importance or redundancy. However, we observe that these criteria produce stable spatial biases across inputs and do not always outperform simple Uniform Grid sampling, highlighting the value of broad spatial coverage. Motivated by this, we propose S$^2$Prune, a training-free pruning method that preserves spatial coverage while adapting token density to local image structure. We first divide the image into regions and assign at least one token to each region to preserve coverage. The remaining token budget is then distributed according to Laplacian variation, giving more tokens to regions with richer structure. We then use Early Representation Change (ERC), computed from the first decoder block, to select representative tokens within each region. We evaluate S$^2$Prune across diverse settings and two MLLM architectures. On Qwen2.5-VL-7B-Instruct, it achieves the highest average accuracy among the evaluated training-free pruning methods. With only 32 of the original 576 visual tokens, it still retains 79.3% of the full-model performance. Code is available at this https URL.
38. 【2609.01200】Compressing AI Traffic: Standardized Neural Network Coding of Visual-Token Representations in Split Vision-Language Inference
链接：https://arxiv.org/abs/2609.01200
作者：Reza Heidari,Hamed R. Tavakoli,Juho Kannala
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：intermediate visual-token embeddings, vision-language model, compute nodes, internal activation, Neural Network Coding
备注： 4 pages, 6 figures, 1 table
点击查看摘要
Abstract:When the visual encoder and the language decoder of a vision-language model (VLM) run on different compute nodes, the intermediate visual-token embeddings become a communicated payload rather than an internal activation. We call such machine-consumed intermediate tensors AI traffic and ask how far they can be compressed with a standardized, training-free codec. We insert ISO/IEC 15938-17 Neural Network Coding (NNC) round trips on the complete visual interface of a Qwen3-VL-8B-Instruct video question answering pipeline, comprising the main visual-token representation and the DeepStack feature streams, while leaving weights, prompts, and generation untouched, and sweep the quantization parameter (QP) over a wide rate range. Closed-ended Video-MME accuracy remains close to the uncompressed reference up to a 98% reduction of the transmitted BF16 tensor and only then collapses; open-ended MLVU generation shows the same plateau-and-collapse profile under an LLM judge. This robustness is not due to near-lossless reconstruction: the decoded tensor is heavily discretized, carries substantial row-wise relative L2 error, and has a visibly steeper singular-value decay than its source. Downstream reasoning therefore depends on coarse structure and relative geometry rather than exact floating-point values, which argues for rate-task rather than rate-distortion optimization of AI traffic codecs.
39. 【2609.01172】Monocular Depth Estimation from a Single Image: Progress and Opportunities
链接：https://arxiv.org/abs/2609.01172
作者：Muxin Liu,Xiaoyang Lyu,Yang-Tian Sun,Yi-Hua Huang,Ziyi Yang,Peng Dai,Xiaojuan Qi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Monocular depth estimation, Monocular depth, autonomous driving, computer vision, enabling a wide
备注： Accepted by Computational Visual Media Journal (CVMJ)
点击查看摘要
Abstract:Monocular depth estimation has long stood as a fundamental challenge in computer vision, enabling a wide range of applications including 3D reconstruction, robotics, autonomous driving, and augmented reality. This survey traces the field's evolution from early learning-based methods to the emergence of transformative foundation models. We begin by framing the problem, distinguishing between relative and metric depth estimation, and highlighting the key challenges that have shaped a decade of research. We then present common problem formulations and introduce the most widely used datasets, covering indoor, outdoor, and synthetic data. Following this, we review major advances prior to the foundation model era, distilling core insights from influential methods that contributed to improvements in accuracy, efficiency, and robustness. The survey then turns to the recent surge of foundation-model-based approaches, categorizing them into discriminative and generative paradigms and emphasizing the critical roles of large-scale pretraining (e.g., DINOv3) and synthetic data. We compare representative models using both quantitative benchmarks and qualitative examples, and discuss natural extensions to video-based depth estimation. Further, to illustrate real-world impact, we highlight the integration of depth estimation into applications such as visual SLAM, content generation, and robot perception. Finally, we outline open challenges and promising research directions as the field advances further into the era of foundation models.
40. 【2609.01148】Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancement
链接：https://arxiv.org/abs/2609.01148
作者：Chujie Qin,Zilong Zhang,Zewei Chang,Chunle Guo,Ruixing Wang,Tao Hu,Ming-Ming Cheng,Chongyi Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：guiding viewers' attention, emphasize visual focus, commonly formulated, formulated as enhancing, quality through color
备注： Accepted to the European Conference on Computer Vision (ECCV) 2026
点击查看摘要
Abstract:Image retouching is commonly formulated as enhancing overall visual quality through color adjustment, but in practice, it also serves to emphasize visual focus by guiding viewers' attention toward a specific subject or region. Achieving such focus-oriented retouching is inherently challenging, as it requires well-coordinated global and local adjustments to manipulate perceptual saliency while maintaining visual naturalness. This intricate process typically demands substantial professional expertise. In this study, we propose EyeControl, a MLLM-driven agent with a diffusion-based retouching executor that enables visual focus enhancement under weak user intent. With only a few clicks or coarse strokes, EyeControl directs visual attention to the intended region, effectively "dotting the eye" of the image. The core idea is to explicitly link the weak user intention with the target editing region and the corresponding tonal adjustment operations during retouching. To achieve this, the system first interprets the intent and image content to infer the visual focus and generate structured intent guidance for the retouching executor. Second, the retouching executor is encouraged to respond more strongly to the target region, explicitly aligning its attention map with a designed pseudo-intent map. We also introduce an operation-consistency constraint to improve coordination between global and local adjustments, achieving more natural and coherent retouching. Additionally, we contribute ControlArt-Bench, a high-quality evaluation dataset for visual focus enhancement. Extensive evaluations demonstrate that EyeControl yields perceptually appealing results with stronger intent alignment. Code can be found in this https URL.
41. 【2609.01147】On the Design Fundamentals of Pixel Text Representation Learning
链接：https://arxiv.org/abs/2609.01147
作者：Chaohao Yuan,Ruifeng Yuan,Zhuoxu Huang,Yu Rong,Hong Cheng,Hou Pong Chan,Chenghao Xiao
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Text-rich visual inputs, inputs require models, compress language directly, fixed resolution pretraining, visual inputs require
备注： EMNLP 2026
点击查看摘要
Abstract:Text-rich visual inputs require models that can read, retrieve, and compress language directly in pixel space, yet existing pixel-text encoders struggle with fixed resolution pretraining, visual shortcut learning, weak visual grounding, and multilingual visual text understanding. In this work, we investigate the fundamental design principles required for robust visual text representation learning. Through systematic controlled ablations, we identify four critical components: variable image resolutions and rendered font sizes provide spatial proxies for high-resolution document generalization; natural image-text pairs are indispensable for grounding and prevent text-only collapse; layout-aware rendering helps prevent pixel-level shortcuts; and a two-stage multilingual curriculum enables effective cross-lingual alignment. By integrating these principles into a scalable training recipe, we train Pixel Linguist II, a native-resolution vision encoder trained with on-the-fly rendering, unified contrastive grounding, and a multilingual curriculum over 280M training examples. Pixel Linguist II sets new state-of-the-art results on English, cross-lingual, and multilingual Visual STS and ViDoRe, while also enabling better MLLM downstream evaluation. Notably, Pixel Linguist II remains robust under 80\% visual token compression, showing great promise for optical context compression. Our code and resources are available at this https URL.
42. 【2609.01146】StainPresetNet: Stain Preset Network for Fast Multi-to-Multi Stain Normalization
链接：https://arxiv.org/abs/2609.01146
作者：Hongtao Kang,Die Luo,Li Chen,Jing Cai,Junbo Hu,Xiuli Liu,Shenghua Cheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：color variations caused, diagnostic system performance, Stain normalization reduces, enhancing computer-aided diagnostic, computer-aided diagnostic system
备注：
点击查看摘要
Abstract:Stain normalization reduces color variations caused by variations in staining protocols and imaging conditions, thereby enhancing computer-aided diagnostic system performance. Traditional methods derive mapping relationships from individual or limited reference images through pixel-wise transformation, offering style flexibility but suffering from inaccurate color mapping extraction. While existing deep-learning-based approaches achieve accurate dataset-wide color mapping through complex neural networks, they face challenges including computational inefficiency, artifact generation, and fixed normalization directions requiring model retraining for directional changes. To address these limitations, we propose StainPresetNet - a novel framework that combines structural preservation with dataset-level color mapping while maintaining computational efficiency. Our method implements pixel-wise normalization guided by preset reference images, enabling multi-directional adaptability without retraining. Evaluations on cytopathology and histopathology datasets demonstrate that StainPresetNet achieves superior color mapping accuracy compared to conventional methods, effectively improves classifier generalization in diagnostic tasks, and reduces computational overhead by 90\% versus existing deep learning approaches. The proposed preset-guided mechanism facilitates flexible adjustment of normalization directions through simple reference image replacement, overcoming the directional rigidity of current deep-learning-based solutions.
43. 【2609.01141】Revisiting Face Recognition for Monozygotic Twins: The Celeb Twins Test Set
链接：https://arxiv.org/abs/2609.01141
作者：Michael Zang,Haiyu Wu,Mrinal Sharma,Kevin W. Bowyer
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Past literature, Twins Test Set, Celeb Twins Test, twins, points to facial
备注：
点击查看摘要
Abstract:Past literature on face recognition for monozygotic (("identical") twins points to facial marks and mirror asymmetry as possible directions for improved accuracy of twins recognition. The Celeb Twins Test Set (CTTS) contains web-scraped image pairs for 80 sets of celebrity twins. It is the only twins test set with meta-data for twins with distinguishing skin marks and possible mirror asymmetry. CTTS is organized in the manner of face verification test sets such as LFW, CALFW, CPLFW, CFP-FP, and AgeDB-30. Current deep CNN matchers can achieve over 76% accuracy in classifying CTTS same-person / different-person image pairs. We show that current matchers do not make use of skin marks, or asymmetry, and discuss reasons for this. Finally, we discuss the feasibility of using generative AI tools such as Grok, ChatGPT and Gemini to create images of imagined monozygotic twins as a means to increase representation of twins in face recognition training sets.
44. 【2609.01136】Different Changes Require Different Reasoning: Change-Type-Specialized Experts for Robust Change Captioning
链接：https://arxiv.org/abs/2609.01136
作者：Jiyoung Park,InJae Oh,Jung Uk Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generating natural language, natural language descriptions, task of generating, generating natural, natural language
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Change captioning is the task of generating natural language descriptions that explain the changes between a pair of images. Although different change types (e.g., color shifts, object additions) exhibit distinct visual cues and require specialized reasoning processes, existing methods often overlook these distinctions. To address this limitation, we propose Multi-Expert Diagnosis for Image Change (MEDIC), a novel framework that introduces change-type awareness by explicitly modeling change categories. MEDIC employs type-specialized memory experts that dynamically retrieve type-relevant visual patterns conditioned on the input. This design enables each expert to capture diverse variations within its change type while focusing on the most informative visual cues. By softly routing inputs across type-specialized experts and learning dedicated representations for each change category, MEDIC generates more precise and type-aware change descriptions. Extensive experiments demonstrate that the proposed MEDIC consistently outperforms existing methods across diverse and challenging datasets. The code is available at \href{this https URL}{GitHub}.
45. 【2609.01123】P-PatchDiff: Progressive Patch Diffusion Models for Low-light Image Enhancement
链接：https://arxiv.org/abs/2609.01123
作者：Ruoyu Guo,Haonan Zhong,Maurice Pagnucco,Yang Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generate perceptually realistic, Recent advancements, perceptually realistic, strong ability, ability to generate
备注： Accepted by IJCV
点击查看摘要
Abstract:Recent advancements in low-light image enhancement have leveraged diffusion models for their strong ability to generate perceptually realistic, detailed images. Patch diffusion models further offer a promising solution to size-agnostic image restoration while improving efficiency. However, existing methods typically rely on small, fixed patches (e.g., 64$\times$64) that cannot capture image-level brightness context, whereas enlarging the receptive field improves brightness and colour estimation but substantially increases computational cost. Moreover, low-light images often exhibit uneven brightness across regions, making it necessary to ensure that locally enhanced patches remain visually coherent when combined into the full image. To address these limitations, we propose P-PatchDiff, a scalable progressive patch diffusion framework for low-light image enhancement that dynamically adjusts patch size throughout the denoising process, enabling a gradual shift from local to global views. A Multi-Patch Alignment strategy is also introduced to normalise features across varying patch scales using an estimated global brightness proxy. Rather than pursuing pixel-level reconstruction accuracy, P-PatchDiff focuses on scalability and coherent brightness across the whole image, allowing the model to perceive multi-scale information and better enhance regions with varying brightness. We empirically demonstrate that P-PatchDiff effectively enhances images ranging from 400 $\times$ 600 to 4K and is 80$\times$ faster than existing patch diffusion models while using less than 9GB of memory. The code is available at this https URL.
46. 【2609.01103】When Modality Gap Reduction Fails: Prediction-Level Hubness in CLIP
链接：https://arxiv.org/abs/2609.01103
作者：Shota Sato,Hajime Kiyama,Tosho Hirasawa,Mamoru Komachi
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：widely expected, Reducing, gap, Reducing the modality, correction
备注： Accpeted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Reducing the modality gap between image and text representations in CLIP is widely expected to improve cross-modal alignment and downstream performance. However, a smaller average image-text gap does not necessarily lead to consistent accuracy gains. We analyze this mismatch from the perspective of the decision structure in zero-shot classification, i.e. selecting the most similar class-text prototype for an input image. Zero-shot accuracy depends not only on average image--text alignment, but also on class-wise decision margins. Using Linear correction as an analytically tractable case, we show that modality gap correction can alter the relative decision structure among classes and cause predictions to concentrate on a small subset of classes. We refer to this output-space failure mode as prediction-level hubness. Furthermore, experiments across multiple datasets show that accuracy degradation under gap correction is consistently associated with increased prediction concentration, both for Linear correction and for learning-based correction methods. This provides a systematic explanation of why modality gap reduction does not consistently improve CLIP zero-shot accuracy from the perspective of downstream decision structure. Our results suggest that gap correction should be evaluated not only by average alignment, but also by its impact on downstream prediction structure.
47. 【2609.01092】IT-TextFusion: Iterative Text-Image Interaction with Text-Guided Residual Refinement for Degradation-Aware Image Fusion
链接：https://arxiv.org/abs/2609.01092
作者：Siyang Liu,Peiyi Zhou,Tianle Jin,Rongrong Bian,Zheke Jin,Mengze Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：task-oriented fusion control, Text-guided image fusion, integrating multi-modal information, recently emerged, effective paradigm
备注：
点击查看摘要
Abstract:Text-guided image fusion has recently emerged as an effective paradigm for integrating multi-modal information while enabling flexible and task-oriented fusion control. However, existing text-guided fusion methods often rely on shallow semantic-visual interaction and limited attention mechanisms, which restrict their ability to robustly handle complex degradations and fully exploit textual guidance. In this paper, we propose an iterative text-guided image fusion framework that incorporates text-conditioned feature interaction across multiple fusion and refinement stages. The proposed method integrates deepest-level Cross-Attention, multi-scale Cross-Gate Fusion, and stage-specific text-conditioned modulation, allowing the global text embedding to condition hierarchical feature fusion and residual refinement. By repeatedly injecting the pooled text embedding across hierarchical decoder and refinement stages, the proposed framework provides degradation-aware global semantic conditioning while preserving complementary information from the visible and infrared modalities. Experiments on several benchmark datasets show that the proposed method improves several information-preservation and perceptual-quality metrics, while exhibiting metric-dependent trade-offs on some datasets.
48. 【2609.01072】Let Confidence Change, Not the Prediction: Prediction-Preserving Repair for Post-hoc Calibration
链接：https://arxiv.org/abs/2609.01072
作者：Daehwan Kim,Haejun Chung,Ikbeom Jang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Post-hoc calibration corrects, corrects reported confidence, Prediction Change Rate, calibration corrects reported, Post-hoc calibration
备注：
点击查看摘要
Abstract:Post-hoc calibration corrects reported confidence, yet a multiclass calibrator can also change the associated top-1 prediction. Accuracy captures only the net effect of these changes on correctness, not how often predictions change; the Top-1 Prediction Change Rate (TPCR) instead measures this frequency. We propose Calibrator-Output Repair for Top-1 Decision Preservation (CORD), the first post-fit adapter to impose exact prediction preservation by repairing the full calibrated probability vector. From the original and calibrated outputs alone, CORD determines the mass assigned to the original top-1. The calibrated conditional distribution allocates the remaining mass over the other classes, yielding a repaired vector whose own argmax recovers the original prediction. On the calibration split, CORD coordinates the repaired masses to retain the calibrated outputs' mean mass on original predictions whenever attainable. The adapter alters neither the fitted calibrator nor its direct output, fits no additional supervised map, and requires no user- or validation-tuned hyperparameter. Across CIFAR-10/100 and ImageNet-1K, CORD attains zero TPCR by construction and lowers mean ECE, NLL, and Brier relative to the corresponding direct outputs in every dataset; paired gains persist under distribution shift and across calibration-set sizes. CORD thus removes the preservation constraint from calibrator fitting and assigns exact recovery of the original decision to subsequent output repair. Our code is available at this https URL.
49. 【2609.01059】Dyn-3D: Unveiling and Resolving Ego-Motion Ambiguity in Vision-Language Models
链接：https://arxiv.org/abs/2609.01059
作者：Jiayu Ding,Zhuodong Liu,Lei Zhang,Manyu Xiong,Hongbo Jin,Haoran Tang,Hongbo Zhang,Changen Zhu,Wenbo Xing
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：monocular scale ambiguity, resolve monocular scale, ego-motion perception, scale ambiguity, perception becomes essential
备注：
点击查看摘要
Abstract:As Vision-Language Models (VLMs) tackle dynamic 3D spatial reasoning, ego-motion perception becomes essential to resolve monocular scale ambiguity. However, current models often overfit to smooth trajectory priors rather than genuinely understanding physical motion. Consequently, their spatial reasoning degrades severely under large displacements, a phenomenon we term Kinematic Collapse. This failure stems from spurious visual-motion correlations in natural videos and a lack of explicit physical supervision. To evaluate this, we introduce Dyn-3D, a benchmark using counterfactual 3D rendering to rigorously decouple visual changes from true kinematic properties. Furthermore, we propose the TempoVista framework, featuring the Kinematic-GSPO algorithm. By embedding metric physical ground truth into policy optimization, TempoVista explicitly grounds visual representations in 3D space. Experiments demonstrate that our approach significantly improves both motion estimation and robust spatial reasoning by utilizing camera dynamics as an effective geometric calibration signal.
50. 【2609.01051】SAGE: Subpopulation-Aware Generative Enhancement for Mitigating Spurious Correlations
链接：https://arxiv.org/abs/2609.01051
作者：Yiming Luo,Rongqiang Zhao,Jie Liu
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：modern machine learning, Empirical Risk Minimization, Spurious correlations pose, traditional Empirical Risk, machine learning
备注：
点击查看摘要
Abstract:Spurious correlations pose a significant challenge to the robustness of modern machine learning. The inherent imbalance in dataset distributions often leads traditional Empirical Risk Minimization (ERM) models to rely on majority spurious attributes for classification, resulting in poor performance on minority groups. This problem becomes particularly challenging when the spurious attributes are unavailable. Existing group-label-free methods often upsample minority groups or misclassified real training examples; repeating the same instances can reduce effective diversity and encourage overfitting. To mitigate these spurious correlations from a data-centric perspective in the absence of prior knowledge, we introduce Subpopulation-Aware Generative Enhancement (SAGE), a two-stage generative augmentation framework. Using cluster-derived sub-labels and class labels, we fine-tune a conditional generative model and text encoder, generating targeted synthetic data to fill underrepresented regions in the training set and construct a balanced validation set for last-layer reweighting. We experimentally show that SAGE achieves 89.5%, 85.7%, and 79.1% worst-group accuracy on Waterbirds, CelebA, and MetaShift, respectively, outperforming the best group-label-free baselines by up to 7.7 percentage points.
51. 【2609.01041】ViTAMINS: An Empirical Study of Training Self-Supervised Vision Transformers with Synthetic Hard Negatives
链接：https://arxiv.org/abs/2609.01041
作者：Nikos Giakoumoglou,Andreas Floros,Kleanthis-Marios Papadopoulos,Tania Stathaki
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：integrates synthetic hard, unsupervised vision transformer, vision transformer pretraining, improve representation quality, synthetic hard negatives
备注： WACV 2027
点击查看摘要
Abstract:We introduce ViTAMINS, a method that integrates synthetic hard negatives into unsupervised vision transformer pretraining to improve representation quality. Our approach is thoroughly benchmarked on ImageNet and transfer learning, image retrieval, copy detection, and image, video segmentation tasks. Notably, our proposed negatives give rise to emergent properties, where learned representations contain explicit information about the semantic content of an image and serve as excellent classifiers (up to +11.3% over baselines). ViTAMINS achieves these benefits through simple modifications to existing contrastive frameworks and outperforms competing methods while being more resource efficient, e.g., our ViT-B surpasses V-JEPA with ViT-L. Our findings motivate reconsidering contrastive learning as a simpler yet powerful alternative to dominant generative and self-distillation approaches.
52. 【2609.01036】MultiGait: A Multi-Sensor Multi-Perspective Multi-Session Biometric Inference Benchmark and its Dataset
链接：https://arxiv.org/abs/2609.01036
作者：Julian Todt,Felix Morsbach,Philip Dissert,Thorsten Strufe
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
关键词：smart city sensors, depth cameras, thermal cameras, lack of suitable, smart city
备注：
点击查看摘要
Abstract:A lack of suitable datasets has limited the research into the privacy risks of novel smart city sensors, such as thermal cameras, depth cameras, and lidar. Given the number of unsubstantiated privacy claims and their potential widespread deployment into many people's everyday life, understanding the privacy risks of these sensors -- in isolation and in like-for-like comparisons -- is crucial. With MultiGait, we collected the first multi-sensor, multi-perspective, multi-session gait-focused dataset, for the corresponding, and additional more far-reaching investigations. The dataset, validated with multiple state-of-the-art recognition systems, comprises various walking modes and annotated personal attributes for 199 individuals, to ensure the benefit for advanced studies including cross-sensor recognition and anonymization at the edge. MultiGait represents a foundation for rigorous privacy investigations, demonstrated through an extensive identity inference benchmark across eight sensors, four perspectives, and three recording sessions. Our benchmark incidentally reveals that sensors often assumed to be privacy-friendly do still entail considerable identity inference risks, while the poor cross-session generalization of existing methods underscores an important research gap.
53. 【2609.01027】Fi-ImageNet-1k: An OOD Benchmark From the Inside of the ImageNet-1k Validation Set
链接：https://arxiv.org/abs/2609.01027
作者：Ruslan Rozumnyi,Matěj Suchánek,Tomáš Vojíř,Klára Janoušková,Jiří Matas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：test image belongs, OOD, images, OOD dataset, predefined classes
备注： 21 pages, 8 figures, 16 tables (11-page main paper + supplementary material)
点击查看摘要
Abstract:Out-of-distribution (OOD) detection predicts whether a test image belongs to none of the predefined classes. To evaluate this task, benchmarks need images from outside the in-distribution (ID) data; typically, these are defined or collected in an ad hoc fashion. Since no ground truth is perfect, ID-labeled datasets themselves contain a natural source of OOD images. We exploit such annotation errors and present Fi-ImageNet-1k, an OOD dataset built from ImageNet-1k validation images that the recent ReImageNet reannotation effort assigned to no ImageNet-1k class. Each image was examined by expert human annotators supported by evidence from MLLMs, VLMs, and reverse image search, comparing it against all visually similar ID classes. We keep only images that could be assigned a specific class outside the ImageNet-1k label space. The resulting Fi-ImageNet-1k, with 655 images from 522 classes, is substantially more challenging than any commonly used OOD dataset. No evaluated combination of classifier and OOD detector achieves a false positive rate below 51% at 95% true positive rate (FPR@95). Compared to the recent NINCO, our dataset is 3.8x more challenging in the FPR@95 metric for state-of-the-art supervised OOD detection methods.
Comments:
21 pages, 8 figures, 16 tables (11-page main paper + supplementary material)
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.01027 [cs.CV]
(or
arXiv:2609.01027v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.01027
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
54. 【2609.01014】Low-Quality Face Recognition using Center Aligned Representations and Local Margin Constraints
链接：https://arxiv.org/abs/2609.01014
作者：Vedat Can Dilaver,Benjamin S. Riggan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, matching degraded query, Low-quality face recognition, remains challenging, degraded query
备注： Accept at IEEE/IAPR IJCB 2026
点击查看摘要
Abstract:Low-quality face recognition (LQFR) remains challenging due to the difficulty of matching degraded query (probe) images against low-quality (LQ) enrollment (gallery) imagery and the scarcity of training data for large-scale models. While recent face recognition (FR) models perform well on high-quality (HQ) imagery, their accuracy drops significantly on LQ images with extremely low signal-to-noise ratio (SNR). Moreover, fine-tuning HQ-pretrained models on LQ data often improves LQ recognition at the expense of HQ generalization. This trade-off becomes more pronounced in modern evaluation settings spanning multiple datasets with varying image quality levels. To address these limitations, we propose a unified framework that combines three main components: (1) Local Probability Margin (LPM), which estimates per-sample difficulty directly from the model's discriminative landscape; (2) Nested Attention Module (NAM), a new low-rank adapter module that embeds a self-attention mechanism within selected transformer layers; and (3) Quality Gating Protocol (QGP), where an off-the-shelf image quality estimator modulates the adapter contribution at test time, enabling a single model to handle the full quality spectrum without sacrificing HQ performance. Experiments on surveillance (TinyFace, SurvFace) and standard (IJB-B, IJB-C) face recognition benchmarks demonstrate consistent gains in both identification and verification. Code and models will be released at this http URL.
55. 【2609.01004】SinkPruner: Sink-Free Visual Token Pruning for Multimodal Large Language Models
链接：https://arxiv.org/abs/2609.01004
作者：Shiyu Li,Zi-Yuan Hu,Shijia Huang,Yanyang Li,Yiwu Zhong,Liwei Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：multimodal understanding ability, strong multimodal understanding, incur substantial computational, substantial computational overhead, processing long visual
备注： EMNLP 2026 (findings)
点击查看摘要
Abstract:Despite their strong multimodal understanding ability, multimodal large language models (MLLMs) incur substantial computational overhead when processing long visual token sequences. To reduce inference costs, recent studies have explored visual token pruning through vision-centric or text-guided strategies. However, these methods often overlook high-norm outlier tokens, i.e., tokens with abnormally large feature norms, leading to suboptimal pruning decisions. In this work, we show that such high-norm outlier tokens are highly redundant in both feature and spatial dimensions, yet are often mistakenly preserved as informative cues by existing methods. Motivated by this observation, we propose SinkPruner, a training-free visual token pruning framework for efficient MLLM inference. SinkPruner follows a coarse-to-fine design with two key modules: a visual sanitizer that filters high-norm redundancies and alleviates attention sink and attention dispersion, and a text-guided pruner that further retains tokens semantically aligned with the text query. Extensive experiments on twelve image-language and four video-language benchmarks demonstrate the effectiveness, efficiency, and generalizability of our framework. Notably, SinkPruner preserves 96.5% (91.8%) of the original performance of LLaVA-1.5 (Qwen2.5-VL) under an 89% token reduction. Experiments further indicate that our visual sanitizer exhibits promising transferability in enhancing the performance of existing pruning methods. Our code is available at this https URL.
Comments:
EMNLP 2026 (findings)
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2609.01004 [cs.CV]
(or
arXiv:2609.01004v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.01004
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
56. 【2609.00996】Does This Moment Justify the Recommendation? Counterfactual Behavior-Grounded Evidence Retrieval for Personalized Video Recommendation
链接：https://arxiv.org/abs/2609.00996
作者：Xin Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：grounding localizes query-relevant, video recommendation predicts, video grounding localizes, localizes query-relevant moments, recommendation predicts user
备注： 8 pages
点击查看摘要
Abstract:Personalized video recommendation predicts user preference at the video level, while temporal video grounding localizes query-relevant moments. However, strong localization does not establish whether the retrieved moment constitutes valid evidence for recommending the video to a particular user. We study counterfactual behavior-grounded evidence retrieval, which separates where personalized evidence occurs from whether such evidence exists and evaluates whether model predictions respond consistently when that evidence is replaced. We introduce CBGER-10K, containing 5,000 controlled factual--counterfactual pairs for 3,026 users, where each pair replaces only the focal behavior-supported segment while preserving the user, temporal position, and hard distractors. We further propose CBGER, a compact framework that decouples segment-level localization from video-level evidence estimation and learns both through structured counterfactual supervision. CBGER achieves $0.4432$ MRR, $0.6977$ Pair Accuracy, and $0.6987$ Intervention Consistency across five adapted personalized-highlight and temporal-grounding baselines. Notably, compared with QD-DETR, its MRR improvement is not statistically significant, while Pair Accuracy improves by $11.03$ points. These results show that accurate temporal localization does not necessarily imply reliable personalized evidence existence, motivating explicit evaluation of Whether alongside Where.
57. 【2609.00995】CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image
链接：https://arxiv.org/abs/2609.00995
作者：Cuong Le,Bao-Long Tran,Pavlo Melnyk,Tahereh Dehdarirad,Bastian Wandt,Mårten Wadenbäck
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：ill-posed computer vision, computer vision problem, vision problem due, depth information, ill-posed computer
备注： Under submission
点击查看摘要
Abstract:Recovering 3D digital humans from a single 2D image is an ill-posed computer vision problem due to the loss of depth information. Probabilistic 3D human pose estimation compensates for this by estimating a set of 3D hypotheses from a prior distribution via generative models. However, most prior work focuses only on 3D keypoints, which often leads to implausible poses that are difficult to apply to downstream tasks, e.g. animation or digital humans. SMPL-based methods are more scalable thanks to the explicit body priors, but it requires more complex modeling of the generation process due to the non-additive nature of the joint rotations. In this work, we propose a novel approach for probabilistic 3D humans using quaternion-constrained continuous normalizing flows conditioned on 2D pose estimations. Our proposed quaternion flows show significant advantages over approaches using other rotation representations. Experiments demonstrate state-of-the-art results of our method on Human3.6M, particularly in ambiguous settings, and comparable pose estimation accuracy on challenging 3DPW and EMDB benchmarks.
58. 【2609.00994】EvoGS: Modeling Deformation Evolution for Dynamic Gaussian Splatting
链接：https://arxiv.org/abs/2609.00994
作者：Wei Dong,Shahram Shirani,Jun Chen,Han Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：learning time-conditioned Gaussian, Recent extensions, Gaussian Splatting, time-conditioned Gaussian deformations, enable real-time
备注： Accepted by Pacific Graphics 2026 (journal track)
点击查看摘要
Abstract:Recent extensions of 3D Gaussian Splatting (3DGS) enable real-time novel view synthesis in dynamic scenes by learning time-conditioned Gaussian deformations. However, existing MLP-based methods typically estimate deformations independently at each timestamp, making them less robust to large or abrupt motions. To address this issue, we propose \textbf{EvoGS}, a 3DGS-based dynamic reconstruction framework that models Gaussian deformation as a temporal evolution process. EvoGS maintains persistent deformation states for each Gaussian, extrapolates future states from historical deformation states, and corrects the predictions with MLP-derived observations. The correction is adaptively weighted using a temporal residual memory and evolution statistics such as deformation velocity and trajectory deviation. To further improve reconstruction quality, EvoGS introduces deformation-aware densification. Clone and split operations are performed along corrected deformation directions, while an uncertainty-aware strategy suppresses densification for Gaussians with unstable deformation histories. Experiments show that EvoGS improves dynamic novel view synthesis quality and achieves competitive performance across benchmarks.
59. 【2609.00984】Semi-Supervised Virtual Staining via Morphology Preservation and Histopathological Realism Constraints
链接：https://arxiv.org/abs/2609.00984
作者：Baoshun Wang,Weiping Lin,Linwu Wang,Yihuang Hu,Baptiste Magnier,Liansheng Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：computationally generate target-stained, conventional staining procedures, Virtual staining aims, generate target-stained histopathological, aims to computationally
备注： 10 pages
点击查看摘要
Abstract:Virtual staining aims to computationally generate target-stained histopathological images while reducing the cost and time associated with conventional staining procedures. However, existing methods rely predominantly on strictly paired and accurately registered training data, which are difficult and expensive to obtain in routine practice. To reduce this dependence, we propose a stable semi-supervised virtual staining framework that jointly exploits both limited paired data and abundant unpaired source images. Directly incorporating unpaired images is challenging because their generated results lack corresponding targets for supervision, potentially leading to unrealistic staining, morphological degradation, or even training collapse. To obtain reliable supervision from these images, Hessian-derived morphology preservation extracts structural cues from each source image and constrains the generated output to retain tissue morphology. Histopathological realism constraints further guide the output toward plausible target-stain characteristics, preventing the source-derived structural supervision from degenerating into contour enhancement or simple color transformation. Together, the two components suppress structural and appearance drift, stabilize semi-supervised stain translation, and promote the preservation of diagnostically relevant information. Extensive experiments on HE-to-IHC translation for Ki67 and HER2, as well as FFPE-to-HE translation, demonstrate consistent improvements in image quality, morphology preservation, robustness, and downstream diagnostic performance. Code will be available.
60. 【2609.00968】ReFlowSET: Representation-Aligned Latent Flow Matching for SAR-to-EO Image Translation
链接：https://arxiv.org/abs/2609.00968
作者：Jeonghyeok Do,Seungchul Lee,Munchurl Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：synthetic aperture radar, image translation aims, generate electro-optical, imagery from synthetic, aperture radar
备注： Please visit our project page [this https URL](https://kaist-viclab.github.io/ReFlowSET_site)
点击查看摘要
Abstract:SAR-to-EO image translation aims to generate electro-optical (EO) imagery from synthetic aperture radar (SAR) observations. Existing latent diffusion approaches typically inherit a predetermined autoencoder, although reconstruction fidelity can vary substantially across codecs and modalities. Because the latent codec affects the round-trip preservation of both SAR conditions and EO targets, codec selection constitutes a fundamental design choice; nevertheless, existing methods largely rely on codecs pretrained on natural images. To remedy this, we introduce ReFlowSET, a conditional latent flow-matching framework that selects its codec through a joint SAR--EO reconstruction audit. Rather than inheriting a heavyweight pretrained generator, ReFlowSET trains a substantially smaller conditional DiT from scratch in the selected latent space, using dual-stream SAR conditioning followed by joint feature refinement. To provide semantic guidance for this from-scratch training, intermediate noisy-EO features are aligned with clean target-EO representations extracted by a frozen vision foundation model. This alignment is used only during training and introduces no additional inference cost. Experiments on QXS-SAROPT and SAR2Opt demonstrate state-of-the-art performance across diverse perceptual fidelity and distributional metrics. Code and pretrained weights are publicly available at this https URL.
61. 【2609.00960】Conditional Flow Matching for Cross-Field MRI Harmonisation
链接：https://arxiv.org/abs/2609.00960
作者：Baris Imre,Aram Salehi,Levente Baljer,Andrew Webb,Marius Staring,Efe Ilicak
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Magnetic resonance images, Magnetic resonance, field strengths, resonance images, complicates the comparison
备注： 10 pages, 2 figures
点击查看摘要
Abstract:Magnetic resonance images of the same subject look markedly different across field strengths, which complicates the comparison and pooling of data across sites. We address cross-field brain-MRI translation for the MRIxFields2026 challenge, and in particular its Task~3: a single model that translates between any directed pair of the five field strengths and across three contrasts. We phrase the problem as a conditional flow matching path: because the source and target volumes are spatially registered, we learn a velocity field that carries the source slice directly to the target slice, rather than starting from noise. To learn this mapping from only three paired subjects, the unified model is trained in three stages: a degradation-bridge pretraining that distills a restoration prior from the abundant unpaired retrospective cohort, a cross-field finetuning over all directed pairs on the paired cohort, and an adversarial refinement that sharpens the output. At inference, we integrate the learned velocity with a second-order Heun solver in a handful of steps. A restoration prior learned without any paired data already reaches a mean SSIM of 0.837, and each subsequent training stage improves on it. A single 6.3M-parameter model thereby covers all 60 field-pair and contrast combinations, with inference in five solver steps per slice. On the challenge evaluation set the model reaches a mean SSIM of 0.909, averaged over the three contrasts, outperforming regression and diffusion baselines built on the identical network on all three challenge metrics.
62. 【2609.00959】Candidate-Expanding Routing with Permutation-Stabilized Experts for Mixed-Format Medical VQA
链接：https://arxiv.org/abs/2609.00959
作者：Hai-Dang Nguyen,Huy-Hieu Pham
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires stable option, stable option selection, machine-readable free-text output, requires stable, Mixed-format medical visual
备注： 10 pages, 3 figures, 3 tables
点击查看摘要
Abstract:Mixed-format medical visual question answering (VQA) requires stable option selection and machine-readable free-text output. The two formats fail differently: multiple-choice predictions can change with option symbols or positions, while clinically plausible open answers can fail automated evaluation when serialization is malformed. We address both challenges with an answer-text memory, a permutation-stabilized vision--language expert, and a sparse candidate- expanding router. The cyclic schedule follows prior work; our contribution is to make expert top-2 a routable candidate alongside memory and expert top-1. On a 1,403-case retrospective internal analysis, this expansion improves a matched binary router from 88.95% to 91.73% (+2.78 percentage points; 95% CI 1.57--3.99), with 56 rescued errors and 17 regressions. Oracle coverage rises from 90.31% to 96.15%, and the final submitted configuration reaches 92.23% on the same retrospective split. For open questions, strict generation and deterministic guards produce 475/475 schema- valid participant-facing outputs without repair, retry, or hard-gate failure. Visual ablations reveal substantial textual dependence. Candidate expansion supplies the principal controlled routing gain; open-path evidence establishes output-contract validity rather than clinical correctness in medical use or deployment.
63. 【2609.00956】PredErase: Training-Free Object-and-Effect Removal with Predictive Latent Guidance
链接：https://arxiv.org/abs/2609.00956
作者：Waikit Xiu,Qiang Lu,Junbiao Chen,Xiying Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Removing an object, object photometric footprint, frozen Fill, Removing, frozen Fill model
备注： 16 pages, 6 figures. Code: [this https URL](https://github.com/xiuwk0820-collab/PredErase)
点击查看摘要
Abstract:Removing an object is not the same as filling its mask. Cast shadows and contact shading usually lie outside the user-provided instance mask M_obj, so a frozen Fill model that edits only that mask leaves the object's photometric footprint on nearby surfaces. Supervised removers learn this joint erasure from paired clean plates. Training-free editors freeze pretrained weights, yet most still treat M_obj as the entire editable support and steer sampling with CLIP or DINO energies that do not predict the occluded scene. We present PredErase, a training-free inference procedure on frozen FLUX.2 and I-JEPA. The method separates where Fill may rewrite pixels from what structure should occupy the hole. A contact-band expansion M_flux of M_obj exposes local residuals on the supporting plane. I-JEPA, pretrained for masked token prediction, supplies a context-conditioned hole target in representation space; sparse projected gradients align decoded Fill completions with that target inside the instance, while coordinates outside the packed support stay locked. Under instance-only masks on RemovalBench, RORD-Val, and DEFACTO-Val, PredErase improves the native FLUX.2 backbone. Supervised removers remain stronger on several full-image appearance metrics; the supported claim is training-free object-and-effect editing of frozen Fill, not replacement of paired-data erasers.
64. 【2609.00955】ASSERT: Adaptive Stochastic Sampling for Robust Diffusion Models on Analog Compute-in-Memory Hardware
链接：https://arxiv.org/abs/2609.00955
作者：Yuannuo Feng,Yizhe Chen,Wenshuai Yao,Yuxin Xie,Ngai Wong,Wenyong Zhou,Wang Kang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：strong image generation, image generation quality, incur high iterative, iterative denoising costs, high iterative denoising
备注： Accepted by ASP-DAC 2027, Tokoy, Japan
点击查看摘要
Abstract:Diffusion models achieve strong image generation quality but incur high iterative denoising costs. Analog compute-in-memory (CIM) can accelerate matrix-vector multiplications, yet spatial memory variations perturb weights and accumulate during sampling. Unlike conventional neural networks, diffusion models' temporal sensitivity to hardware noise remains underexplored. We investigate diffusion inference using a noise model calibrated and validated against measurements collected from multiple physical CIM chips. Our results show that the early, high-noise denoising stage is substantially more vulnerable than the final refinement stage. A first-order trajectory analysis attributes this behavior to the repeated propagation of correlated prediction errors induced by a fixed hardware mapping. Based on this observation, we propose ASSERT, a training-free sampler that uses higher stochasticity early and smoothly transitions to deterministic denoising. The injected stochasticity changes subsequent activation trajectories and thereby reduces their alignment with persistent spatial errors. Across the evaluated settings, ASSERT achieves up to 2.58$\times$ lower FID than deterministic DDIM on high-resolution datasets and 7.68$\times$ lower FID in the CIFAR-10 step-count study, without changing model parameters or the number of network evaluations.
65. 【2609.00951】CERF: Communication-Efficient and Retraining-Free Collaborative Perception
链接：https://arxiv.org/abs/2609.00951
作者：Jiuwu Hao,Ziyi Ni,Liguo Sun,Yuting Wan,Yueyang Wu,Ti Xiang,Haolin Song,Pin Lv
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：comprehensive scene representation, perception shares information, scene representation, enhancing the perceptual, shares information
备注： Accepted by ICASSP 2026
点击查看摘要
Abstract:Collaborative perception shares information among multiple agents to obtain a comprehensive scene representation, enhancing the perceptual capability of individual agents. However, most existing methods rely on transmitting and fusing dense feature maps for collaboration, which incurs inevitable communication overhead and heterogeneity challenges, limiting their practicality for real-world deployment. To address these challenges, we propose CERF, a novel Communication-Efficient and Retraining-Free framework for open heterogeneous collaborative perception. In CERF, we introduce a new virtual modality (termed Poture), which is generated from the perception outputs of other agents, to augment the extracted Bird's Eye View (BEV) features of the ego agent. To mitigate transmission delays, we employ a Kalman-filter based tracker and a motion forecasting model to derive the current predictions from historical perception results. Extensive experiments demonstrate that CERF achieves performance comparable to mainstream intermediate-collaboration methods while reducing communication overhead by 95% across various downstream tasks. Furthermore, CERF enables seamless integration of unknown heterogeneous agents into the existing collaborative framework without additional retraining costs. Code is available at this https URL.
66. 【2609.00948】From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understanding
链接：https://arxiv.org/abs/2609.00948
作者：Raul Ortega,José Manuel Gómez-Pérez
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：demonstrated strong performance, natural images, demonstrated strong, scientific, strong performance
备注： Published as a conference paper at COLM 2026
点击查看摘要
Abstract:Vision-language models (VLMs) have demonstrated strong performance in visual question answering with natural images. However, they continue to struggle with scientific diagrams, which are designed to convey functional or relational meaning rather than literal scenes. We therefore introduce a framework for generating large-scale diagram-grounded instruction data by leveraging terminology derived from scientific curricula. Our approach systematically extracts domain concepts, synthesizes atomic facts, retrieves relevant diagrams from the web, and generates multimodal supervision in the form of diagram captions and multiple-choice questions. Using this pipeline, we construct SciGram, a dataset of over 194K diagrams and 1.4M visual instructions across life, earth, and physical sciences. Despite relying on noisy web data and synthetic annotations, models fine-tuned on SciGram achieve substantial improvements on diagram-centric benchmarks, including TQA, ScienceQA, and AI2D, outperforming or matching state-of-the-art VLMs while using fewer training instances. Furthermore, augmenting existing models such as LLaVA OneVision with SciGram establishes new state-of-the-art performance on diagram question answering. Our results highlight the effectiveness of terminology-grounded instruction generation as a general strategy for improving vision-language reasoning in scientific domains. To support future research in scientific diagram understanding, we release both the SciGram dataset and models.
67. 【2609.00924】Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking
链接：https://arxiv.org/abs/2609.00924
作者：Orcun Cetintas,Guillem Brasó,Tim Meinhardt,Laura Leal-Taixé
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Monocular videos record, Monocular videos, image-plane projections, videos record, obscuring depth
备注：
点击查看摘要
Abstract:Monocular videos record 3D scenes as sequences of 2D image-plane projections, obscuring depth and spatial relationships. Multi-object trackers localize and associate objects primarily using appearance and geometry observed only in the image plane, inheriting these ambiguities. To address this limitation, we introduce PLANET, an end-to-end multi-object tracker designed to move beyond the image plane. As an enabling step, we lift existing 2D tracking datasets into 3D. We then form world-grounded queries by embedding reconstructed 3D scene geometry into the features and positional encodings used during query formation. An auxiliary 3D location prediction task further encourages the queries to encode object positions during training. A complementary dual-resolution temporal memory preserves this evidence across longer temporal gaps. As a result, PLANET achieves state-of-the-art performance across three diverse benchmarks.
68. 【2609.00923】On-the-Fly3R: Towards Robust Online 3D Reconstruction with Feed-Forward 3R Models for Large-Scale UAV Scenarios
链接：https://arxiv.org/abs/2609.00923
作者：Zhe Shen,Liyuan Lou,Yifei Yu,Guanbo Wang,Quanjian Ji,Xin Wang,Zongqian Zhan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：prohibitive memory cost, Transformer attention, cost of Transformer, large-scale UAV mapping, large-scale UAV
备注： This paper was submitted to the ICRA 2027 for consideration. Copyright would be transferred if it got accepted
点击查看摘要
Abstract:While feed-forward 3D reconstruction (3R) offers efficient end-to-end modeling, its application in large-scale UAV mapping is hindered by the prohibitive memory cost of Transformer attention. Current scalable streaming 3R methods assume temporally and spatially continuous inputs, rendering them ineffective for the weakly ordered or unordered image streams common in cross-strip UAV operations. To address this, we propose On-the-Fly3R, a training-free, progressive online 3D reconstruction framework for large-scale UAV images that upgrades various 3R backbones for large-scale UAV scenarios. Our method enables reconstruction from unordered inputs via retrieval-guided dynamic subset construction, which adaptively selects spatially relevant images. To further improve the robustness, a validation-rejection-retry mechanism is designed to guarantee global consistency, performing a pre-integration consistency check and automatically rejecting misaligned images and retrying with alternative subset. Finally, inspired by VSLAM, pose graph optimization based on the retrieval loop closure is employed to mitigate camera drift. Evaluations on several UAV benchmarks show that our On-the-Fly3R successfully scales various 3R models to over 5,000 images across square-kilometer UAV scenes, delivering substantially superior accuracy compared to several SOTA streaming 3R methods. Code is available at this https URL
69. 【2609.00920】VerNav: Verifier-First Low-Latency Vision-and-Language Navigation
链接：https://arxiv.org/abs/2609.00920
作者：Zhixin Wang,Chengzheyi Yao,Leyuan Liu,Xiaosong Zhang,Yongzhao Zhang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：navigate through unseen, natural-language instructions, LLM-based VLN, Navigation, VLN
备注： 9 pages, 7 figures, 5 tables
点击查看摘要
Abstract:Vision-and-Language Navigation (VLN) requires an agent to navigate through unseen 3D environments according to natural-language instructions. Explicit reasoning can improve instruction understanding and semantic grounding, but autoregressive generation at every step accumulates large decision-stage latency over multi-step navigation. We propose VerNav, a verifier-first framework for low-latency LLM-based VLN. The verifier reduces decision-stage latency by replacing per-step autoregressive generation with batched action verification, while an entropy-based adaptive generator is invoked only for uncertain decisions to produce compact state evidence. To further improve navigation performance with the verifier, we introduce a two-stage alignment scheme: (i) VPO improves local action-preference alignment in static verifier training, and (ii) step-level reinforcement fine-tuning provides dense progress rewards over multi-step navigation rollouts during dynamic task execution. Experiments on the Room-to-Room (R2R) benchmark show that the verifier-only decision path of VerNav achieves competitive navigation performance among representative LLM-based VLN agents while reducing average decision-stage LLM latency per step by more than $10\times$ compared with autoregressive methods.
70. 【2609.00909】A multicenter benchmark and clinically structured metric for coronary CTA report generation
链接：https://arxiv.org/abs/2609.00909
作者：Zhiyu Ye,Yue Sun,Limiao Zou,Cheng Xu,Keting Xu,Tong Hu,Yue Yu,Hairong Zheng,Yining Wang,Tong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computed tomography angiography, automated coronary computed, coronary computed tomography, Reliable evaluation, CCTA
备注：
点击查看摘要
Abstract:Reliable evaluation of automated coronary computed tomography angiography (CCTA) report generation requires standardized multicentre benchmarks and clinically structured metrics. We established a four-centre benchmark comprising 3,021 CCTA series from 818 patient-report pairs to evaluate seven open-source three-dimensional vision-language models. We developed CSM$_{\text{CCTA}}$, a clinically structured metric for CCTA report evaluation, with patient-, vessel-, and segment-level variables defined according to clinical guidelines. Report pairs are compared at the finest shared anatomical level, and the contributions of different clinical components are weighted based on expert assessments. We estimated these weights using 70 expert-scored cases and evaluated clinical alignment in a non-overlapping set of 30 cases. CSM$_{\text{CCTA}}$ showed a strong correlation with radiologist scores (Pearson's $r=0.97$, $p0.001$), exceeding the next-best metric, FORTE ($r=0.70$), by 0.27, and agreed with expert preferences in 115 of 160 pairwise comparisons (71.9\%). Under controlled perturbations, CSM$_{\text{CCTA}}$ remained stable to clinically equivalent wording and decreased monotonically with progressive information omission. In the multicenter benchmark, the CCTA-trained C2RG model achieved the highest CSM$_{\text{CCTA}}$ scores across all four hospitals, although its performance remained far from optimal. In contrast, CCTA-irrelevant reports accounted for up to 98.7\% of the outputs from generalist models. Together, the benchmark provides a standardized setting for model comparison, while CSM$_{\text{CCTA}}$ enables clinically structured evaluation of finding agreement and anatomical specificity. These results support a more clinically aligned and anatomically resolved approach to evaluating CCTA report generation. Code is available at this https URL.
71. 【2609.00901】HELIOS: From midnight to noon, continuous outdoor urban scene relighting
链接：https://arxiv.org/abs/2609.00901
作者：Hala Djeghim,Nathan Piasco,Luis Roldão,Moussab Bennehar,Dzmitry Tsishkou,Céline Loscos,Désiré Sidibé
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modifying the illumination, fundamental challenge, times of day, illumination of driving, captured at specific
备注：
点击查看摘要
Abstract:Modifying the illumination of driving images is a fundamental challenge, as most datasets are captured at specific times of day. Existing methods rely on synthetic data or paired multi-illumination supervision, which limits their generalization to the diverse and challenging conditions of real-world scenarios. To address this, we propose HELIOS, a novel image relighting approach that relies on unlabeled real-world datasets without requiring any paired images for training. Our approach integrates albedo-based conditioning into a cycle-consistent diffusion pipeline to prevent identity collapse and ensure accurate domain translation. To handle low-visibility nighttime conditions, we introduce a robust albedo distillation strategy that transfers structural stability from the daytime domain. Additionally, we replace traditional text prompts with a fine-grained control mechanism based on GPS-derived solar angles, enabling smooth and continuous lighting manipulation across the day-night cycle. Through extensive evaluation and a user study, we demonstrate that HELIOS produces structurally consistent and realistic results in both night-to-day and day-to-night tasks, outperforming state-of-the-art methods.
72. 【2609.00898】Vision-Language-Guided Pseudo-Labels for Unsupervised Domain Adaptation in Semantic Segmentation for Waste Sorting
链接：https://arxiv.org/abs/2609.00898
作者：Udo Schlegel,Shubhangi,Gabriel Dax,Sai Rahul Kaminwar,Florian Karl,Thomas Seidl
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Obtaining labeled data, Obtaining labeled, industrial waste sorting, applied settings, infeasible at scale
备注： 18 pages, 2 figures, 2 tables, accepted at ECML-PKDD 2026
点击查看摘要
Abstract:Obtaining labeled data for semantic segmentation in applied settings (e.g., autonomous driving, industrial waste sorting) is expensive and often infeasible at scale. We present a cross-modal pseudo-labeling pipeline that enables unsupervised domain adaptation without any target-domain annotations. The pipeline is built on two core foundation models: SAM generates class-agnostic region proposals, and EVA-CLIP assigns semantic labels based on region-text similarity, with confidence filtering ensuring that only reliable pseudo-labels are used for self-training a segmentation model. As an optional extension, BLIP provides language-grounded verification for ambiguous regions, thereby improving pseudo-label quality without altering the overall pipeline. Evaluated on two domain shifts, synthetic-to-real autonomous driving and, with a primary focus, lab-to-factory industrial waste sorting, the pipeline consistently improves over source-only baselines. Our results demonstrate that pseudo-label quality, not quantity, is a decisive factor in self-training under domain shift, and that cross-modal language grounding offers a practical path to reliable automatic annotation in deployment-critical applications.
73. 【2609.00885】Denoising Diffusion Generative Models Secretly Calculate Attentions
链接：https://arxiv.org/abs/2609.00885
作者：Farzan Haddadi,Leila Monfared,Ebrahim Rezaii,Mohammadreza Malek-Mohammadi,Pejman Zakalvand,Narges Mokhtari
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
关键词：Denoising diffusion models, Denoising diffusion, well-known transformer architectures, transformer architectures employing, architectures employing attention
备注： submitted to IEEE Trans on Pattern Recog. Machine Intellig
点击查看摘要
Abstract:Denoising diffusion models are the dominant architecture for image generation, whereas most natural language generation and modeling are primarily handled by well-known transformer architectures employing attention mechanism. Here, we show that diffusion models also inherently use an attention mechanism very similar to that of transformers. Therefore, attention emerges as a universal machine learning principle, based on a general training objective. We also show similarities in basic functional principle of auto-encoders and attention-based models. These equivalences allows us to interchange these designs based on practical requirements. As an example, we can reformulate the diffusion framework to reduce the lengthy training process and computation-intensive image generation. Using this approach, a simplified algorithm is proposed for image generation which is based on attention mechanism. Results show that the attention-based implementation achieves comparable performance with significantly less effort and computational resources.
74. 【2609.00868】he Visual Insensitivity Gap: Diagnosing When Vision-Language Models Fail to Use Visual Evidence
链接：https://arxiv.org/abs/2609.00868
作者：Genpei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Visual Sensitivity Index, Visual Insensitivity Gap, Vision-language models, evaluated by aggregate, practice that implicitly
备注： 17 pages (7-page main text plus technical appendix), 10 figures, 6 tables
点击查看摘要
Abstract:Vision-language models are evaluated by aggregate accuracy on multimodal benchmarks, a practice that implicitly assumes the model uses its visual input. We show this assumption fails on 40%--97% of samples across six VLMs and three perceptual benchmarks: blurring the question-relevant visual region leaves the next-token distribution nearly unchanged. We name this phenomenon the Visual Insensitivity Gap and quantify it with a per-sample Visual Sensitivity Index (VSI). The gap is a property of samples, not of models: VSI ranks correlate across models (grand-mean Spearman rho=+0.40, permutation p10^-3), so the same samples are flagged insensitive by VLMs sharing no architectural detail beyond a contrastively pretrained vision tower. The mechanism is concrete: on the insensitive samples, a linear probe on each model's own vision tower distinguishes perturbed from clean images at 0.72--0.79 accuracy, yet the model's argmax token changes on only 2%--11% of the same samples, an encoder--LLM gap above 0.65 on every model. Mapping VSI's diagnostic utility cell by cell surfaces a strong regime (multi-choice reasoning on capable VLMs: AUROC=0.85--0.87) and a weak regime (well-calibrated factuality, where softmax confidence already leads). VSI is not a universal best abstention signal; it is a sample-intrinsic indicator of vision-ignoring failure, best used as a conditional ensemble component.
75. 【2609.00866】Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation
链接：https://arxiv.org/abs/2609.00866
作者：Yumi Lee,Harim Oh,Hyoryung Kim,Minji Kim,Eunsu Kim,Hyeseong Lee,Junya Fukuoka,Andrey Bychkov,Jijgee Munkhdelger,Rajiv Kumar Kaushal,Ayushi Sahay,Rajni Yadav,Bharathi Prabakaran,Sulen Sarioglu,Serdar Balcı,Ilknur Turkmen,Yuri Tolkach,Christian Harder,Julian Westerdorf,Reinhard Buettner,Audun Ljone Henriksen,Sepp De Raedt,Byung Hyun Lee,Sungjin Lim,Joohoon Lee,Gwanghyun Kim,Se Young Chun,Suryakant Singh,Saarthak Kapse,Prateek Prasanna,Kyung A Kim,Yousun Kang,Sehwan Yoo,Sungman Hong,Shubham Innani,Michael Feldman,Spyridon Bakas,Ujjwal Baid,Prasad Dutande,Suhas Gajare,Bhakti Baheti,Serkan Sökmen,Ece Tuğba Cebeci,Ahmet Halıcı,Musa Balcı,Kardelen Peçenek,Srividhya Sainath,Kyongseok Jang,Messi H.J. Lee,Noorul Wahab,Bodong Du,Jiaming Zhang,Qixiang Zhang,Jang-Hwan Choi,Sangjeong Ahn
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：mapping spatially distributed, spatially distributed visual, distributed visual patterns, structured clinical text, large-scale WSI
备注：
点击查看摘要
Abstract:The rapid advancement of vision-language models (VLMs) has accelerated progress in computational pathology; however, whole-slide image (WSI)-based pathology report generation remains limited by the scarcity of large-scale WSI--report datasets and the complexity of mapping spatially distributed visual patterns to structured clinical text. To address this, we introduce a clinically curated Pan-Asia WSI--report dataset of approximately 10,500 pairs from five institutions and establish the REG 2025 benchmark through a MICCAI challenge for systematic evaluation of multimodal models. We analyze submitted methods spanning pretrained VLMs, multiple-instance learning frameworks, hierarchical expert models, retrieval-augmented generation, and cross-modal Transformers. Rather than indicating that VLM use alone was sufficient for superior performance, the results suggest that top-performing methods benefited from structured report representations, hierarchical diagnostic decomposition, and effective multimodal grounding. We identify key limitations, including instability in quantitative attribute estimation (e.g., numeric hallucination) and a tendency toward diagnostic overspecification, with some errors resembling known diagnostic pitfalls in routine pathology. These findings establish REG 2025 as a benchmark for evaluating WSI-based structured report generation and vision-language understanding in computational pathology, providing insights for the design of clinically grounded multimodal pathology models.
76. 【2609.00862】raining-Free Inpainting Across Domains with a Frozen Text-to-Image Diffusion Model
链接：https://arxiv.org/abs/2609.00862
作者：Zhenhuan Wang,Fengyi Yuan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：dataset-specific weight adaptation, fixed controller configuration, inpainting-specific weight training, inpainting-specific conditioning channels, evaluated natural-image domains
备注： 30 pages, 11 figures, including supplementary material
点击查看摘要
Abstract:We show that a frozen generic text-to-image diffusion model can perform conditional inpainting across three evaluated natural-image domains with one fixed controller configuration, without inpainting-specific weight training, dataset-specific weight adaptation, or learned inpainting-specific conditioning channels. Step-PI augments known-region projection with boundary-interior latent feedback, persistent PI state, and a predefined four-field release schedule that modulates controller signals along the reverse trajectory. Developed only on Main35-disjoint CelebA-HQ pilots, the controller transfers unchanged to AFHQ and Places2. Across two field-identical comparisons on the same 3,500 cases, adding persistent state and replacing uniform release with the predefined schedule each improve all 15 dataset-metric cells; 95% bootstrap intervals exclude zero for all five metrics in both comparisons. In descriptive native-route comparisons, Step-PI leads LanPaint and PILOT (the closest evaluated training-free baselines using vanilla SD1.5) on all five equal-dataset macro metrics. Inpainting-trained systems retain the absolute metric leads but rely on substantial inpainting-specific offline optimization. Our method provides a complementary approach for repurposing a frozen generic text-to-image model for cross-domain inpainting through test-time latent control.
77. 【2609.00853】ADGNet: Asymmetric Dual-text Guided Network for Infrared Small Target Detection
链接：https://arxiv.org/abs/2609.00853
作者：Tongtong Wang,Mingzhu Xu,Chenglong Yu,Jing Wang,Xiaohui Lin,Weili Guan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Small Target Detection, Target Detection, challenging task, IRSTD, Detection
备注： 10 pages, 10 figures. Accepted by the 34th ACM International Conference on Multimedia (ACM Multimedia 2026)
点击查看摘要
Abstract:InfRared Small Target Detection (IRSTD) is a challenging task. Relying solely on pixel-level information, vision-only methods struggle to distinguish targets from clutter. Current multimodal methods typically describe both targets and backgrounds with a single textual prompt. Such an approach lacks dedicated regional guidance and ignores infrared semantic asymmetry. Consequently, it provides insufficient background suppression information and introduces severe feature optimization conflicts, overwhelming small targets with noise. To address these issues, we propose a novel Asymmetric Dual-text Guided Network (ADGNet). Specifically, accounting for the infrared semantic asymmetry, we first design the Asymmetric Dual-text Prompt (ADP), comprising an image-agnostic abstract target prompt and an image-specific detailed background prompt. To leverage these prompts, we introduce an Asymmetric Dual-Branch Interaction (ADBI) module to separately guide visual features with their respective text priors, protecting targets from noise while suppressing background clutter. Subsequently, we introduce an Adaptive Feature Aggregation (AFA) module to dynamically fuse features from the two branches. Furthermore, we construct a multimodal Asymmetric Image-Text Infrared (AITIR) dataset by providing asymmetric text annotations for three public datasets (IRSTD-1K, NUDT-SIRST, and SIRST). Extensive experiments demonstrate that ADGNet outperforms 21 state-of-the-art (SOTA) methods. Code is available at this https URL.
78. 【2609.00846】An Intelligent Decision Support System for Emotion Monitoring using Microscopic Fixational Dynamics
链接：https://arxiv.org/abs/2609.00846
作者：Xiangyu Shen,Feiyang Deng,Zijian Dai,Aibin Chen,Jizheng Yi,Jie Li,Hongbo Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：psychological disorders necessitates, disorders necessitates effective, current methods relying, necessitates effective emotion, privacy issues
备注： 22 pages, 15 Figures
点击查看摘要
Abstract:The rising prevalence of psychological disorders necessitates effective emotion monitoring, yet current methods relying on facial or physiological signals often suffer from intrusiveness and privacy issues. This paper proposes an intelligent decision support system and pervasive edge-computing framework that leverages smart glasses and a companion smartphone to infer emotional states from microscopic visual fixation patterns. Moving beyond traditional macroscopic gaze metrics, the proposed system extracts and decomposes three distinct neurophysiological micro-movements: microsaccades, ocular drifts, and ocular microtremors. We introduce an interpretable hybrid artificial intelligence pipeline combining a multi-head attention mechanism, extreme gradient boosting, and a support vector machine to extract deep temporal features, quantify their physiological importance, and perform efficient on-device classification. Through an extensive evaluation involving 60 volunteers, we rigorously validate the framework under a strict leave-one-subject-out cross-validation protocol across both controlled and naturalistic mobile scenarios. Ablation studies unequivocally demonstrate that these fixational micro-movements are substantially more discriminative for emotion inference than traditional macroscopic features. Furthermore, aligned with contemporary affective science, the system incorporates a few-shot personalization mechanism to bridge universal physiological baselines with individual emotional heterogeneity, achieving a highly robust personalized F1-score of 83.6%. This work establishes a physiologically interpretable, unobtrusive, and deployable paradigm for continuous real-time emotion monitoring.
79. 【2609.00839】Residual Kalman Dynamics for Event-Based UAV Forecasting
链接：https://arxiv.org/abs/2609.00839
作者：Per Nyblom,Hannes Ovrén,David Gustafsson
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：mid-horizon UAV bounding-box, UAV bounding-box forecasting, FRED event-camera dataset, mid-horizon UAV, UAV bounding-box
备注： Accepted to the Workshop on Neuromorphic Vision (NEVi) at ECCV 2026, 16 pages
点击查看摘要
Abstract:We study short- and mid-horizon UAV bounding-box forecasting on the FRED event-camera dataset. We use a constant-velocity Kalman filter over a full center-size box state as a strong physical baseline, and train a residual model to predict acceleration-like corrections from recent box history, filtered state features, and local event representations. This simple residual formulation consistently improves over the Kalman baseline, with event-conditioned models giving the strongest results among the evaluated methods. We further show that part of the residual target is predictable from anchor position and velocity alone, indicating that canonical FRED results can reflect both visual evidence and dataset-specific motion priors. To analyze this effect, we introduce decorrelated subsets as a diagnostic stress test, showing that event-conditioned residual models retain useful predictive signal even when measured position- and velocity-based shortcuts are weakened.
80. 【2609.00830】Visual Attention Faithfulness in Vision-Language Models is Heterogeneous
链接：https://arxiv.org/abs/2609.00830
作者：Xurui Song,Weishi Wang,Zhongqi Yue,Kuluhan Binici,Tao Bai,Hongxin Shao,Daniel Dahlmeier,Jun Luo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：weights faithfully reflect, debated in NLP, question remains largely, remains largely unexplored, attention weights faithfully
备注： EMNLP 2026
点击查看摘要
Abstract:Whether attention weights faithfully reflect model reasoning has been actively debated in NLP, yet this question remains largely unexplored for the visual modality in Vision-Language Models (VLMs). We address this gap through causal perturbation analysis on current VLMs, evaluating both the comprehensiveness and sufficiency gap of attention-ranked visual tokens. Our analysis reveals that visual attention faithfulness is heterogeneous, manifesting in three distinct processing modes: Faithful-Sufficient, where top-$k$ attention tokens are both necessary and sufficient for prediction; Faithful-Distributed, where they are necessary but broader visual context remains required; and Non-Focal, where no localized attention region is individually necessary while visual information remains an essential trigger for prediction. Furthermore, human-annotated ground-truth regions satisfy comprehensiveness in only $\sim 60$% of cases compared with model attention rankings, revealing systematic divergence between model visual reliance and human intuition. We demonstrate these patterns across both general VQA on VQAv2 and document tasks on VRDU and ChartQA, showing that visual attention faithfulness varies systematically with processing demands and model architectures rather than being uniformly faithful or unfaithful.
81. 【2609.00816】Can Scene Text Recognition Read Rare Compositions?
链接：https://arxiv.org/abs/2609.00816
作者：Genpei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Scene text recognition, Scene text, treated as saturated, text recognition, recognition is reported
备注： Preprint. Under review. Main text plus appendix: 10 figures, 13 tables
点击查看摘要
Abstract:Scene text recognition is reported as 89--97% accurate on the six standard benchmarks, and the problem is widely treated as saturated. We present an alternative reading. When the same test images are stratified jointly by ground-truth word rarity and character n-gram novelty against a reference corpus, accuracy at the rare-word x rare-trigram corner of the resulting 5x5 grid drops 10--18 pt below the q3/q3 centre across nine English specialised recognisers, and the same direction (corner below centre) holds on all 13 of 13 (language, model) pairs we test across four writing systems (Latin, Han, Han+kana, Arabic). The drop is not a capacity bottleneck. A 6x vision-backbone scale-up (CLIP4STR-Base 158M - CLIP4STR-Huge 1.0B, OpenCLIP ViT-H/14 LAION-2B) leads every benchmark in aggregate accuracy yet leaves the stress corner unchanged (86.9 - 86.5, within paired-bootstrap noise). Four converging probes--layer-wise probing, confidence-when-wrong, attention re-balancing, and a cross-script commit-vs-abstain error split--localise the failure to the autoregressive decoder's lexical prior. We then ask how much of the gap existing techniques recover. Of 16 non-architectural mitigations, the largest mean q5/q5 gain is +1.3 pt and none clears the paired-bootstrap noise floor; the only intervention that does is the architectural shift from autoregressive to CTC decoding (SVTRv2, +2.5 pt, p=0.02, n=474). A confidence-routed AR-CTC ensemble adds a directionally consistent +0.6 pt that stays within noise, and its dominant learned coefficient is each model's own minimum-softmax confidence--independently echoing the mechanism above. No configuration we test improves both the compositional corner and aggregate accuracy. The rare-input long tail thus points to architectural change rather than added capacity.
82. 【2609.00814】RingMoClaw: An Experience-Inspired Multi-Agent Framework for Self-Evolving Research in Remote Sensing
链接：https://arxiv.org/abs/2609.00814
作者：Kaiyue Kang,Qixuan He,Peijin Wang,Yingchao Feng,Chao Ren,Kangxin Wang,Wenhui Diao,Yixiao Wang,Liangjin Zhao,Kaiwen Wei,Nayu Liu,Xian Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing, Remote sensing visual, continuously advanced, sensing visual, Remote
备注：
点击查看摘要
Abstract:Remote sensing visual models have continuously advanced various interpretation tasks. However, the research process behind model improvement still heavily relies on manual expertise, requiring extensive trial-and-error iterations in model design, data processing, and performance diagnosis. Existing agent-based approaches mainly focus on task execution and workflow orchestration, while lacking the capability of autonomous research iteration for continuous performance optimization. To address this issue, we propose RingMoClaw, an experience-inspired self-evolving multi-agent framework for remote sensing visual interpretation. RingMoClaw integrates a research branch, a quality-control branch, and a dual-stream dynamic experience bus to establish a closed-loop optimization process covering strategy generation, experiment execution, independent review, and experience accumulation. The heterogeneous Critic mechanism provides stage-wise diagnosis and feedback, while the dual-stream experience bus incorporates external knowledge and internal experimental experience to guide strategy evolution and eliminate ineffective searches. Extensive experiments on four remote sensing downstream tasks, including object detection, scene classification, semantic segmentation, and change detection, demonstrate the effectiveness and generalization of RingMoClaw. Compared with the corresponding baseline models, RingMoClaw improves performance by 1.84\% mAP$_{50}$ on object detection and achieves consistent gains across the other three tasks, while reducing the required evolution steps by over 40\% compared with existing research automation frameworks. These results suggest that RingMoClaw offers a feasible route from task execution toward continuous research driven model evolution in remote sensing.
83. 【2609.00811】ReBridge-Flow: Re-Coupling Posterior Bridges in Flow Matching for Image Restoration
链接：https://arxiv.org/abs/2609.00811
作者：Jiaqi Zhang,Yiqi Wang,Hongjie Wu,Bohan Guo,Xinan Wang,Zichen Luo,Taotao Cai,Zhi Chen,Mingkai Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：learning continuous transport, Flow Matching, efficient generative prior, data distributions, efficient generative
备注： 66 Pages, 36 Figures, 15 Tables
点击查看摘要
Abstract:Flow Matching provides an efficient generative prior for image restoration by learning continuous transport between source and data distributions. However, existing methods typically incorporate measurement constraints through local corrections. Such corrections may disrupt the source-clean endpoint coupling implicitly encoded by the pretrained flow, making the corrected endpoint pair incompatible with the current state. To address this issue, we propose ReBridge-Flow, a posterior bridge re-coupling method. Specifically, given the current state, ReBridge-Flow first decodes the corresponding local source and clean endpoints. It then incorporates measurement information through clean-side anchoring and synchronously re-couples the source endpoint, yielding a measurement-aware endpoint pair with improved local bridge compatibility. The re-coupled endpoints further define a posterior-informed transport direction for advancing the sampling process. We also introduce the Posterior Bridge Defect, which jointly characterizes measurement error, deviation from the flow prior, and bridge mismatch, and leads to explicit updates for clean-side anchoring and source-side re-coupling. Extensive experiments on multiple natural and medical image restoration tasks demonstrate that ReBridge-Flow effectively alleviates bridge mismatch and improves the structural consistency of restored images.
84. 【2609.00800】No Pixel Left Behind: Filling Gaps in Anime Colorization
链接：https://arxiv.org/abs/2609.00800
作者：Masahiro Kono,Akinobu Maejima,Yuki Koyama,Yotam Sechayk,Takeo Igarashi
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：involve digital colorization, Animation production workflows, small unpainted regions, line art, underexplored challenge
备注： 19 pages, 20 figures. Published in the Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)
点击查看摘要
Abstract:Animation production workflows often involve digital colorization of line art, where small unpainted regions ("gaps") frequently occur and remain an underexplored challenge. We conducted a formative study in Japanese animation (anime) pipelines and found that while the paint bucket tool is widely used for base coloring, tiny enclosed areas are frequently overlooked, resulting in time-consuming manual detection and filling. We introduce GapFill, a tool grounded in professional practices that reduces the effort of gap detection, zooming, and color selection. Our deep-learning method suggests appropriate fill colors by referencing surrounding regions, leveraging the flat-color nature of anime-style images. In a user study with 13 professional colorists, our system improved performance and usability in gap-filling tasks over conventional methods. The study also suggested that prediction accuracy alone is not the primary factor for usability, that appropriate colors can be contextually ambiguous, and that GapFill can complement existing tools depending on users' trust in new AI-powered assistance.
85. 【2609.00798】Advanced Pixel Diffusion Model with Guided Sparse Global Refinement
链接：https://arxiv.org/abs/2609.00798
作者：Weiyi You,Jinhua Zhang,Xingyu Zhou,Wei Long,Junyu Lou,Shuhang Gu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：original pixel domain, high-fidelity image generation, Pixel-space diffusion, recently emerged, promising direction
备注： Code: [this https URL](https://github.com/CVL-UESTC/PixSGR)
点击查看摘要
Abstract:Pixel-space diffusion has recently emerged as a promising direction for high-fidelity image generation by modeling images directly in the original pixel domain. However, pixel-space diffusion is computationally demanding due to the extremely high dimensionality of natural images. For efficiency, existing pixel diffusion models either compromise fine details with large-patch tokenization or confine subsequent refinement within individual patches. Such intra-patch refinement inevitably restricts structural continuity across patch boundaries and long-range token interactions, limiting refinement quality. To address these issues, we propose PixSGR, a novel Pixel diffusion framework with Sparse Global Refinement tailored for modeling the distribution of natural images directly in pixel space. PixSGR starts from a supervised low-channel bottleneck to efficiently capture the low-dimensional manifold of natural images. It then progressively expands the channel dimensionality and spatial resolution to recover increasingly fine-grained structures. At the spatial refinement stage, coarse-scale attention maps preselect globally relevant interactions to pre-sparsify fine-scale attention, enabling non-local refinement beyond isolated patches without the quadratic cost of dense attention. Extensive experiments on ImageNet validate the effectiveness of PixSGR. It achieves an FID of 1.51 at 256$\times$256 and maintains performance when scaled to 512$\times$512, attaining an FID of 1.60.
86. 【2609.00788】Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domain
链接：https://arxiv.org/abs/2609.00788
作者：Daizong Liu,Junhao Dong,Zhiyuan Ma,Xiaoye Qu,Xiang Fang,Runwei Guan,Keke Tang,Jianfeng Dong,Yew-Soon Ong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, showing remarkable progress, Multimodal large language, large language, realistic multimodal applications
备注： Accepted by IEEE TMM2026
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have extended the capability of large language models (LLMs) to process more contextual multimodal information, showing remarkable progress in diverse realistic multimodal applications. Despite their strong perception and reasoning abilities, recent studies reveal that MLLMs remain highly vulnerable to adversarial inputs, especially those targeting visual components. However, existing attacks mainly focus on global perturbations, lacking an understanding of how MLLMs internally interpret visual structures. In this paper, we make the attempt to investigate the intrinsic focus of MLLMs in the frequency domain and discover that their predictions are particularly sensitive to phase information, which encodes essential structural and semantic cues. Based on this observation, we propose a novel phase-aware adversarial attack framework that explicitly restricts adversarial perturbations to structure-relevant phase regions to suppress the MLLMs' focus for effective and imperceptible attacks. To further amplify the structural influence, we also introduce an auxiliary adversarial prompt learning module to guide multimodal misalignment around phase-sensitive regions, misleading the MLLM's attention toward targeted structural patterns. Extensive experiments on multiple representative MLLM models and datasets demonstrate the superior effectiveness of our method compared to existing attacks.
87. 【2609.00776】Solaris: Towards Interfaces That Are Generated, Not Coded
链接：https://arxiv.org/abs/2609.00776
作者：Yuval Alaluf,Omri Avrahami,Guy Bukchin Leshem,Michal Geyer,Kfir Goldberg,Elad Richardson,Diego Alarcón,Alejandro Alvarez,Cole Garry,Anastasis Germanidis,Tenaya Goldsen,Corina Gurau,Robin Kahlow,Joel Kwartler,Kathleen Lewis,Alejandro Matamala Ortiz,Eugene McMahon,Thon Prom,Sarah Saltonstall-Wurm,Jamie Umpherson,Hudson Yeo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Digital interfaces, intermediate representations, Digital, Solaris, model
备注： Project page: [this https URL](https://runway.com/news/research/introducing-solaris)
点击查看摘要
Abstract:Digital interfaces are traditionally implemented through intermediate representations such as code, requiring their appearance and behavior to be specified in advance. We introduce Solaris, an interface world model that instead generates an interactive UI directly, frame by frame, in response to user actions. Solaris treats mouse interactions as conditioning signals and autoregressively synthesizes the resulting visual state at interactive speeds. To enable real-time generation while maintaining visual coherence over extended interactions, we combine autoregressive frame generation with few-step distillation and training on the model's own outputs. A language model complements the visual world model by interpreting user intent and specifying how interactions should affect the generated environment, separating high-level reasoning from visual rendering. By generating both the appearance and behavior of an interface dynamically, Solaris enables open-ended interactions that need not be explicitly programmed in advance. We view interface world models as a step toward a new paradigm for software, where interfaces are generated and adapted continuously around user intent rather than implemented as fixed collections of predefined states and
88. 【2609.00775】VOIM: Training-Free Open-Vocabulary 3D Instance Mapping for RGB-D and Monocular SLAM
链接：https://arxiv.org/abs/2609.00775
作者：Sangmin Song,Sarath Kodagoda,Marc G. Carmichael,Karthick Thiyagarajan,Amal Gunatilake,Kelly Prentice,Jodi Martin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：voxel-grounded instance manager, Online Instance Manager, training-free voxel-grounded instance, present Voxel-Grounded Online, Voxel-Grounded Online Instance
备注：
点击查看摘要
Abstract:We present Voxel-Grounded Online Instance Manager (VOIM), a training-free voxel-grounded instance manager that builds open-vocabulary 3D instance maps from RGB-D or from monocular RGB alone, a regime no prior training-free system addresses. Online systems typically segment object instances and label them at first detection, committing when evidence is weakest. VOIM instead defers label and instance decisions until soft evidence from unmodified, off-the-shelf perception has accumulated per voxel across views. We show that the mapping stage, rather than the particular perception models, carries the result: across four perception configurations on ScanNet++, varying the region descriptor, the detector label prior and the mask source, the map exceeds the strongest online RGB-D system, OVO-SLAM, by between 4.8 and 11.7 mIoU. Perception is not neutral, and substituting that baseline's own descriptor family costs 4.1 of the margin, yet the baseline carries the marginally better 2D descriptor (33.7 vs. 31.5 mIoU over three scenes) and still realizes the weaker map. Under a like-for-like protocol VOIM reaches 44.07 mIoU on ScanNet++ against 32.37, winning all ten scenes and both aggregations (pooled 33.31 vs. 25.97), and the same system runs unchanged to fully monocular RGB, matching that baseline pooled on Replica (27.80 vs. 27.50). The advantage is regime-specific: under Replica's all-classes scoring, matched inputs give a split result, 28.60 vs. 27.50 pooled against 24.59 vs. 30.11 on the per-scene mean. Room scale is label-limited and building scale drift-limited. Labeling does not run in real time, dominated by per-class detection over the full vocabulary. The maps export occupancy grids and resolve free-form queries to object instances.
89. 【2609.00745】Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representation
链接：https://arxiv.org/abs/2609.00745
作者：Yuanwang Yang,Buzhen Huang,Zongxuan Ren,Jing Huang,Kun Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unconstrained environments remains, environments remains challenging, Multi-view human reconstruction, simplified settings, efficient multi-person reconstruction
备注： Published in International Journal of Computer Vision (IJCV)
点击查看摘要
Abstract:Multi-view human reconstruction has been extensively studied under simplified settings, yet robust and efficient multi-person reconstruction in unconstrained environments remains challenging. Existing bottom-up methods often rely on accurate camera calibration and explicit cross-view matching, and therefore struggle with severe occlusions and ambiguities. We propose a new top-down paradigm that maintains a unified, instance-centric human-aware 3D space, enabling simultaneous camera calibration, cross-view association, and human reconstruction via cross-modal contrastive learning. Observations from multiple views are lifted and fused into this shared 3D space, where geometric structure, visual appearance, and human-centric semantic cues are jointly encoded at the instance level. We further introduce a spatial contrastive learning strategy that aligns 3D features corresponding to the same human instance across different views and modalities while separating different instances. This enables correspondence reasoning, semantic aggregation, and instance discrimination to be performed natively in 3D, improving cross-view consistency and robustness under severe occlusions. Finally, structured human body models are recovered in a feed-forward manner by regressing SMPL parameters from instance-level 3D human tokens. Extensive experiments demonstrate robust, accurate, and efficient multi-view human reconstruction in challenging real-world scenarios.
90. 【2609.00742】Mind the Rift: Cross-Scale Coupling Mismatch for AI-Generated Video Detection
链接：https://arxiv.org/abs/2609.00742
作者：Siyu Li,Jin Yang,Weiheng Liang
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：safeguarding digital trust, achieve cinematic realism, cinematic realism, digital trust, essential for safeguarding
备注： 12 pages, 4 figures, 11 tables. Accepted at ACM Multimedia 2026 (MM '26), Rio de Janeiro, Brazil. This version includes the supplementary material as Appendix A-E
点击查看摘要
Abstract:As AI video generators achieve cinematic realism, reliable detection becomes essential for safeguarding digital trust. We identify cross-scale coupling mismatch as a new forensic signal, where scale refers to the level of abstraction (semantic dynamics vs. pixel-level residuals): in natural videos, macro-level temporal dynamics and micro-level residual patterns are intrinsically coupled by the unified imaging physics pipeline, whereas AI generators, whose training objectives do not explicitly preserve this joint distribution, systematically violate this coupling. Detecting such mismatch is challenging because it requires independently extracting information at both scales while simultaneously quantifying their cross-scale relationship. We propose RIFT (Representation Inconsistency Forensics on Trajectories), an orthogonal forensic framework that addresses this through three interlocking components: a macro stream that builds a dynamic baseline of expected temporal evolution via differential geometry and persistent homology on learned manifold trajectories, a micro stream that acts as a sensitive forensic probe via steganalytic filtering and temporal modeling, and a coupling divergence module that measures the conditional dependency between the two streams. Gram-Schmidt orthogonality guarantees the information-theoretic validity of this measurement. Experiments on two benchmarks (VidProM, 120K videos, 7 generators; GenVidBench, 68K videos, 4 generators) demonstrate that RIFT achieves 99.33% and 99.72% F1-score respectively, with 97.87% unseen-generator detection rate in leave-one-out evaluation, while exhibiting encoder agnosticism: scaling from ViT-S/14 (22M) to ViT-L/14 (300M) changes F1 by less than 0.1%, and switching to a different encoder family (DINOv1) reduces F1 by only 0.73 pp. Code is available at this https URL
91. 【2609.00730】Design and Implementation of a Kalman Filter-Infused Algorithm for Tilt Estimation
链接：https://arxiv.org/abs/2609.00730
作者：Yuehan Ma,Hongji Dai
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO); Signal Processing (eess.SP); Systems and Control (eess.SY)
关键词：tilt angle estimation, tilt angle, motion tracking, Kalman filter, Accurate tilt angle
备注： 13 pages, 24 figures, 7 references
点击查看摘要
Abstract:Accurate tilt angle estimation is important in many engineering applications, such as robotics, motion tracking, and embedded control systems. However, measurements from low-cost inertial sensors are often degraded by noise and drift. This paper presents a single-axis tilt angle estimation system based on the MPU6050 inertial measurement unit, implemented on an RP2040 microcontroller platform, with sensor fusion achieved through a Kalman filter. The accelerometer provides a direct estimate of tilt angle from gravity but is sensitive to noise and short-term fluctuations. The gyroscope provides smooth angular rate measurements, but integration over time introduces drift. To overcome these limitations, a Kalman filter is used to combine measurements from both sensors, leveraging the long-term stability of the accelerometer and the short-term smoothness of the gyroscope. Both simulation and hardware experiments are performed. In simulation, sensor noise and drift are modeled to evaluate the filter performance under control conditions. In the hardware implementation, real-time MPU6050 data is acquired and processed by the RP2040 platform, and the estimated tilt angle is compared with accelerometer-only and gyroscope-only outputs. The results show that the proposed method effectively reduces noise measurements and suppresses long-term drift while preserving good dynamic response. Overall, the system provides more stable and accurate tilt estimation than either sensor alone, demonstrating a practical and accessible approach for Kalman filter based sensor fusion in embedded application.
92. 【2609.00718】A Closed-Loop Evaluation of Capability Loss and Recovery in Compressed Driving Policies
链接：https://arxiv.org/abs/2609.00718
作者：Ahmad Alfan Alfian Irfan,Nur Ahmad Khatim,Mansur Arief
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：mobility companies deploy, companies deploy learned, deploy learned driving, learned driving policies, memory and power
备注：
点击查看摘要
Abstract:Many automobile and mobility companies deploy learned driving policies on embedded computers with limited memory and power. Pruning, knowledge distillation, and quantization are the standard methods to reduce the size and the inference cost of these policies. However, these methods are commonly assessed by aggregate numerical scores, and such scores may not reflect the ability of the policy to drive safely when interacting with other road users. In this study, we propose a stage-wise closed-loop evaluation approach to follow a driving policy through a compression pipeline. We formulate the driving task as a partially observable Markov decision process (POMDP) and train a belief-state policy with proximal policy optimization (PPO) in Gym-Duckietown. We then extract the actor, compress it one stage at a time, and evaluate it on five driving curricula. We show that structured pruning is the stage at which the driving capability is first lost. Meanwhile, distillation improves the pruned actor, but the improvement is limited by its rehearsal data. Integer quantization of the improved actor loses some of the curricula that require the vehicle to stop and then resume. Interestingly, the same procedure on the unpruned actor preserves all five curricula. Our study thus provides an empirical analysis aiming to answer the currently active discussions on how to accept a compressed driving policy, so as to achieve a safe and statistically reliable deployment of automated driving functions.
93. 【2609.00713】Efficient and Robust Absolute Pose Estimation via Gravity-Prior-Driven Transformation Decoupling and Pose Refinement
链接：https://arxiv.org/abs/2609.00713
作者：Hu Cao,Qianyi Yang,Xinyi Li,Jiong Liu,Yinlong Liu,Alois Knoll
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：absolute pose estimation, absolute pose, robotic applications, essential task, simplify absolute pose
备注： This work is accepted by IEEE Transactions on Image Processing
点击查看摘要
Abstract:Estimation of the absolute pose of an object is an essential task for various robotic applications. Recently, incorporating gravity direction as prior information has emerged as a popular approach to simplify absolute pose estimation. However, developing a robust and efficient algorithm to solve this challenging problem remains a difficult question due to large amounts of mismatches. In addition, obtaining an accurate pose solution from selected inlier correspondences with gravity prior is still a research gap. In this paper, we propose a novel transformation strategy that exploits geometric relations derived from the gravity prior. Through transformation decoupling, the original 6 degrees of freedom (DoF) absolute pose estimation problem is simplified into a 4-DoFs problem: 1-DoF for the rotation angle and 3-DoFs for translation, significantly improving the efficiency. For the 1-DoF rotation angle, we apply a one-dimensional global voting algorithm for optimal estimation. Once the optimal rotation is obtained, the mismatched correspondences are preliminarily filtered, and translation estimation, a linear problem, can be easily solved. Furthermore, to obtain accurate pose results, we introduce a novel pose refinement algorithm to enhance the accuracy of both rotation and translation. Extensive experiments on synthetic data and three publicly available real-world datasets (TUM RGB-D, ETH3D, and RobotCar) demonstrate that the proposed method achieves stronger performance compared to existing state-of-the-art (SOTA) approaches. To further validate our method, we integrated it into ORB-SLAM2. The results on the KITTI dataset show it effectively reduces drift and improves trajectory alignment during relocalization. The source code will be released upon acceptance.
94. 【2609.00712】EarthLD: Towards Unified Open-World Landslide Understanding via Vision-Language Guided Diffusion Models
链接：https://arxiv.org/abs/2609.00712
作者：Yuanchao Su,Lianru Gao,Mengying Jiang,Jiangyi Chen,Jiaxin Cheng,Yicong Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：ambiguous spectral signatures, widespread geological hazards, imagery remain challenging, substantial domain shifts, sensing imagery remain
备注：
点击查看摘要
Abstract:Landslides are widespread geological hazards, yet their automated detection and mapping in remote sensing imagery remain challenging because of their irregular morphology, ambiguous spectral signatures, and substantial domain shifts across imaging platforms. To overcome these challenges, we propose EarthLD, a vision-language-guided diffusion framework for open-world landslide understanding, enabling unified landslide recognition, mapping, and trigger interpretation. At its core, EarthLD formulates landslide understanding as a diffusion process that progressively infers the presence, spatial extent, and pixel-level boundaries of landslides from noisy latent representations. This probabilistic formulation enables the model to jointly perform image-level landslide recognition and mapping while characterizing predictive uncertainty. By integrating visual observations with contextual knowledge in the denoising process, EarthLD distinguishes diverse landslides from backgrounds, produces confidence-aware predictions for suspected regions, and maps landslide ranges. We additionally construct a global-scale open-world landslide benchmark by systematically harmonizing multiple publicly available remote sensing data collected by diverse institutions. Extensive experiments across regions, sensors, and triggering events demonstrate that EarthLD consistently outperforms existing landslide detection methods, highlighting its potential as a unified and robust solution for global geological-hazard monitoring and emergency response.
95. 【2609.00709】Controllable Image Captioning with Prompt-Conditioned Scene Rewards
链接：https://arxiv.org/abs/2609.00709
作者：Jongyeop Hyun,Taeyoung Kim,Hyounghun Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large Vision-Language Models, Vision-Language Models produce, Models produce fluent, offer limited semantic, produce fluent image
备注： EMNLP 2026 Main (26 pages); Project website: [this https URL](https://focus-emnlp2026.github.io/)
点击查看摘要
Abstract:Large Vision-Language Models produce fluent image descriptions but offer limited semantic control: users cannot reliably specify whether captions should emphasize attributes, relations, or particular image regions. We present Fine-grained Captioning Control Using Scene Rewards (FoCUS), a controllable image captioning method that lets users steer captions toward specific semantic emphases through natural-language control prompts. The core idea is a prompt-conditioned control objective based on scene-graph-aligned component scores. Generated captions are parsed and aligned to scene-graph components such as objects, attributes, and relations. These components are differentially weighted, including negative weights, according to the requested emphasis. We optimize this objective with GRPO and further improve its reliability through a stricter object validity threshold and reasoning-based verification for attribute and relation scoring. To evaluate controllability, we introduce Semantic Control and Precision Evaluation (SCoPE), a benchmark with contrastive Include/Avoid constraints for measuring both target content coverage and out-of-scope suppression. Experiments on two VLM backbones show that FoCUS consistently improves controllability and fine-grained caption quality without degrading general caption performance.
96. 【2609.00708】Differentially Private Paired Table-Image Multimodal Synthesis
链接：https://arxiv.org/abs/2609.00708
作者：Kai Chen,Josephine Lamp,Somesh Jha,Tianhao Wang
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Differentially private, image data separately, extensively studied, data separately, Differentially
备注： This paper is about differentially private table-image data synthesis
点击查看摘要
Abstract:Differentially private (DP) synthesis has been extensively studied for tabular and image data separately, yet many real-world datasets contain images paired with multivariate tabular records. Synthesizing such data is particularly challenging under DP, as the two modalities favor different private learning mechanisms while their dependence must also be preserved. To address this challenge, we propose DP-TabImage, a modality-specialized framework for private paired synthesis. DP-TabImage instantiates the factorization $p(x,y)=p_T(y)p_I(x\;|\;y)$ using a private Probabilistic Graphical Model for the multivariate table distribution and a table-conditioned diffusion model trained with DP-SGD for the conditional image distribution. To facilitate conditional learning under clipped and noisy gradients, we further pretrain the model on private table-image prototypes, pairing privately constructed attribute-conditioned images with tabular vectors derived from the already private tabular model at no additional privacy cost. Experiments on three real-world datasets show that DP-TabImage achieves a strong balance among tabular fidelity, image fidelity, and cross-modal alignment. Our analysis further reveals that visual warm-up primarily improves marginal image fidelity, whereas aligned table-image warm-up is critical for improving cross-modal correspondence. Our source code is available in the GitHub repository, this https URL.
97. 【2609.00704】FTU-Seek: Foundation Model-Guided Hard-Negative Learning for Sparse Functional Tissue Unit Segmentation
链接：https://arxiv.org/abs/2609.00704
作者：Zonghao Liu,Lei Su,Jiguang Yu,Xuqing Geng,Louis Shuo Wang,Jianmin Wang,Jingfeng Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Numerical Analysis (math.NA)
关键词：Functional tissue units, encode localized immune, including tertiary lymphoid, tertiary lymphoid structures, blood vessels
备注：
点击查看摘要
Abstract:Functional tissue units (FTUs), including tertiary lymphoid structures (TLSs), blood vessels, and glands, encode localized immune, vascular, and epithelial organization in histopathology. Accurate quantification of these structures is important for studying tissue architecture and disease-associated tissue organization. However, FTUs are frequently sparse, heterogeneous, and surrounded by large amounts of morphologically similar background tissue, making automated segmentation in whole-slide images (WSIs) challenging. We therefore developed FTU-Seek, a pathology foundation model-guided framework that treats morphology-aware negative-patch selection as a key component of sparse FTU segmentation. FTU-Seek uses frozen multi-depth features from the UNI pathology foundation model to train a patch-level classifier that distinguishes FTU-containing from FTU-absent tissue. Target-absent patches are subsequently ranked according to their predicted target-containing probabilities, and the highest-scoring hard negatives are selected through a static Top$K$ strategy to construct compact segmentation training sets. The framework was evaluated using five-fold cross-validation and internal test cohorts across TLS, blood-vessel, and gland segmentation tasks, with an additional independent 30-WSI held-out cohort for TLS. Positive-only, all-tissue, random-negative, and matched random Top$K$ sampling strategies served as comparators. Segmentation-derived phenotypes were further explored in external TCGA cohorts.
98. 【2609.00685】Visual Framing for News Stance Detection via Image Generation
链接：https://arxiv.org/abs/2609.00685
作者：Dahyun Lee,Jiyoung Han,Kunwoo Park
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：social issues, stance detection aims, aims to identify, identify the perspective, stance detection
备注： EMNLP 2026
点击查看摘要
Abstract:Article-level news stance detection aims to identify the perspective of news articles toward social issues. Despite advances in stance detection and its importance for trustworthy media environments, news articles pose distinct challenges because their stances are often implicit, subtly conveyed through journalistic framing, and embedded in long, structurally complex texts. To address these challenges, we introduce VFStance, which leverages visual framing to make implicit stance cues more explicit via image generation. In evaluation experiments, we demonstrate the effectiveness of VFStance over existing methods and the contribution of visual framing to its performance. Finally, a controlled user study (N=200) in a snippet-based news consumption setting further demonstrates that VFStance can make stance signals visually salient and highlights its potential use beyond automated stance detection.
99. 【2609.00667】From Saliency to Discriminability: Rank-Preserving Visual Token Pruning for VLM Rerankers
链接：https://arxiv.org/abs/2609.00667
作者：Siyi Liu,Hanjun Yang,Chenchen Zhang,Xiaorong Zhu,Xinyu Zuo,Lisheng Duan,Haijin Liang,Jin Ma,Junfu Pu,Yongqi Zhang
类目：Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large vision-language models, jointly process visual, Large vision-language, process visual tokens, practical deployment
备注： EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Large vision-language models used as listwise rerankers must jointly process visual tokens from tens of candidates per query, making token pruning essential for practical deployment. Existing pruning methods retain tokens by attention saliency, yet we show that saliency is systematically misaligned with ranking contribution: visually prominent tokens often capture order-neutral patterns shared across candidates. This mismatch is layer-dependent: saliency becomes informative only where attention is concentrated, and normalized attention entropy diagnoses the reliability shift (Pearson r=0.87). We propose RaDiCal (Rank-Discriminative Calibration), a training-free framework that uses normalized attention entropy to decide when saliency can be trusted, fusing it with an attention-free rank-discriminative prior and selecting pruning layers from the same trust landscape. Across three retrieval benchmarks and multiple VLM architectures, RaDiCal matches Dense MRR@10 on Flickr30K and surpasses it on MSCOCO at a 20% token budget, ranks first among all pruning methods on FashionIQ, and holds within 1.2 pp on Flickr30K and MSCOCO at 10% retention. It cuts FLOPs by 39--45% and delivers 1.28--1.45$\times$ measured speedups across two VLM architectures without dataset-specific retuning.
100. 【2609.00666】DGNet: Dual-knowledge Guided Network for Infrared Small Target Detection
链接：https://arxiv.org/abs/2609.00666
作者：Chenglong Yu,Mingzhu Xu,Jing Wang,Tongtong Wang,Pingping Miao,Liqiang Nie
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：InfRared Small Target, Small Target Detection, InfRared Small, computer vision, Small Target
备注： Accepted by ACM Multimedia 2026 (MM '26)
点击查看摘要
Abstract:InfRared Small Target Detection (IRSTD) is a prominent and challenging task in computer vision. In recent years, text-guided methods have significantly improved detection performance. However, they still suffer from two key limitations. First, a single text description simultaneously modeling both background and target leads to semantic entanglement, which contradicts the objective of background suppression and target enhancement. Second, reliance on image-specific textual prompts (requiring additional external models such as CLIP during inference) results in deployment constraints. To address these issues, we propose a novel Dual-knowledge Guided Network (DGNet) based on multiple generalizable texts. Specifically, we design a Prior-knowledge Wavelet Modulation (PWM) module, which leverages dual textual priors that separately characterize large-scale backgrounds and sparse targets to effectively disentangle and modulate entangled semantics in the frequency domain. Furthermore, we introduce a Consensus-knowledge Directional Alignment (CDA) loss, which models the initial state and the ideal target across samples as `complex background' and `bright target', respectively, thereby constructing a clear and unified directional optimization trajectory for the model. Extensive experiments on three public datasets demonstrate the superior performance of DGNet and the effectiveness of each component. The source code is available at this https URL.
101. 【2609.00663】Separating perception from reasoning in vision-language models: a model-free render ceiling for crystal structures
链接：https://arxiv.org/abs/2609.00663
作者：Can Polat,Mustafa Kurban,Erchin Serpedin,Hasan Kurban
类目：Computer Vision and Pattern Recognition (cs.CV); Materials Science (cond-mat.mtrl-sci); Chemical Physics (physics.chem-ph); Quantum Physics (quant-ph)
关键词：Multimodal evaluations, vision-language model misread, existing method, method for separating, model
备注：
点击查看摘要
Abstract:Multimodal evaluations cannot say whether a vision-language model misread an image or misreasoned about it, because every existing method for separating the two places a second model in the loop. We introduce the render ceiling, a model-free reference for benchmarks built by rendering known objects: inverting the frozen cameras and re-solving cross-view correspondence recovers exactly the answer the images support. We prove the ceiling fails only through an enumerable set of projection coincidences and certify that set empty on 2,160 rendered crystal structures, so every point of a model's deficit belongs to the model. Across fourteen vision-language models, supplying exact geometry as text lifts every model yet closes under half the gap for thirteen, while a supervised vision model with no language component reads the same images at 0.8952, above every vision-language model. The instrument exposes extraction-stage fabrication that downstream accuracy would misattribute to reasoning, yields camera-placement rules for benchmark builders, and transfers to any benchmark with an invertible forward rendering.
102. 【2609.00661】Do Satellites See Commuters? A Critical Benchmark of Vision Foundation Models
链接：https://arxiv.org/abs/2609.00661
作者：Ashiq Shukoor Iqbal,Wilson Wongso,Flora D. Salim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single downstream pipeline, foundation models offer, Satellite foundation models, systematically compared encoder, compared encoder paradigms
备注： Accepted to SIGSPATIAL 2026
点击查看摘要
Abstract:Satellite foundation models offer a globally available alternative to census data for commuting origin-destination (OD) generation, yet no study has systematically compared encoder paradigms within a single downstream pipeline. We ablate four satellite vision encoders: language-supervised (RemoteCLIP), self-supervised (DINOv3), and geographically grounded (SatCLIP, AlphaEarth) within an identical WeDAN graph diffusion framework across 1,925 US counties, 325 UK districts, and 14 global cities under five random seeds. Three main findings emerge. First, language-supervised features achieve the strongest in-distribution performance (RemoteCLIP CPC 0.602), while geographically grounded encoders transfer more reliably zero-shot: AlphaEarth improves CPC by 33% over RemoteCLIP on UK districts. Second, pretraining corpus scale alone is insufficient: DINOv3, trained on a substantially larger satellite corpus, underperforms RemoteCLIP by 0.091 CPC in-distribution and collapses to CPC 0.022 globally. Third, no encoder transfers usefully to global cities (best CPC 0.122 for RemoteCLIP, 0.022 for DINOv3), confirming cross-continental OD generation remains an open problem. We additionally clarify the semantics of the census noise parameter $\eta$, whose ordering reverses under cross-continental evaluation, a distinction critical to correctly interpreting prior results. Training scripts and evaluation logs will be released.
103. 【2609.00658】aching Vision-Language Models to Use the Scale They Are Given: Label-Free Equivariance Training for Metric Physical Reasoning
链接：https://arxiv.org/abs/2609.00658
作者：Kaizhen Tan,Yang Feng,Heqing Du,Siru Tao,Xin Xu,Hanzhe Hong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：convert visual measurements, supplied real-world references, real-world references, references to convert, convert visual
备注：
点击查看摘要
Abstract:Metric questions about video require vision-language models to use supplied real-world references to convert visual measurements into physical units. Yet we find that current models use this scale information only partially. When every world-space quantity in a prompt is rescaled by a common factor, the video remains equally valid and the correct answer changes by exactly that factor, but model predictions move only part of the way and accuracy remains concentrated near the familiar scale of the depicted objects. Across eight vision-language models, this under-response persists over four orders of magnitude. The same models recover the correct closed-form scaling laws when the identical physics is asked in a scale-free form, indicating that the main deficit lies in metric grounding rather than physical mechanism knowledge. We use this exact scaling relation as supervision without requiring metric annotations. Under a common rescaling of the supplied world-space quantities, the correct metric answer must change by the same factor. EquiSD exploits this constraint by projecting a model's own prediction onto the scale-equivariant family and fine-tuning the model on the resulting targets. It requires no ground-truth answers and only one model query per training video. On held-out simulated videos, EquiSD increases a 3B model's median response slope from 0.66 to 0.94 and improves mean relative accuracy by 9.2 points across scales. The learned relation generalizes to unseen world scales and transfers without adaptation to real QuantiPhy videos, where accuracy increases by 6.4 points. These results show that an exact physical symmetry can provide label-free supervision for improving metric grounding in vision-language models.
104. 【2609.00656】Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning
链接：https://arxiv.org/abs/2609.00656
作者：Zixuan Wang,Yixin Hu,Wen Li,Feng Chen,Yan Liu,Duo Peng,Yinjie Lei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, underspecified natural language, natural language conditioning, synthesize videos consistent, seeks to synthesize
备注：
点击查看摘要
Abstract:Physically Plausible Video Generation (PPVG) seeks to synthesize videos consistent with physical principles, yet remains challenging due to underspecified natural language conditioning. Advanced chain-of-thought (CoT) frameworks augment prompts with physical knowledge. However, such prompts describe physical phenomena holistically, overlooking intermediate states and transition dynamics. In this paper, we reformulate PPVG as event-centric generation by representing physical evolution as a chain of causally connected and physically constrained events. Our framework comprises three key modules: (1) Physics-driven Event Chain Reasoning. This module decomposes physical phenomena into causally connected events represented by evolving scene graphs. Formula-derived physical quantities are bound to relevant objects and interactions, characterizing the direction and magnitude of each event transition. (2) Transition-aware Routed Keyframe Conditioning. This module routes each event to a specialized keyframe synthesis operator for appearance variation or object transformation. Consecutive keyframes are injected as residual guidance during denoising, enabling smooth visual transitions between event-boundary states. (3) Physics-injected Contrastive Semantic Guidance. This module constructs physics-informed positive and counterfactual negative prompts for classifier-free guidance, steering generation toward plausible dynamics and away from physics-violating counterparts. Experiments on PhyGenBench, VideoPhy, PhyWorldBench, and Physics-IQ demonstrate that our framework generates videos with superior physical plausibility across diverse domains.
105. 【2609.00649】You Cannot Photograph the Same Street Twice: Reliability Limits in Vision-Language Measurement of Urban Change
链接：https://arxiv.org/abs/2609.00649
作者：Kaizhen Tan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Google Street View, repeated street-level imagery, measure urban change, perception score, Street View standpoints
备注：
点击查看摘要
Abstract:Vision-language models are increasingly used to measure urban change from repeated street-level imagery, but their longitudinal reliability is not well understood. We test how much a perception score can change when the street itself does not undergo substantial redevelopment. Using 4,648 consecutive-epoch image pairs from 435 Google Street View standpoints across five US cities, we find that re-photographing the same street changes a perception score by 0.80 points on average, equivalent to 66.5% of the difference between two different streets in the same city. Repeated model calls contribute almost no variation, while image re-encoding and prompt-order changes each account for about one fifth of the between-street difference. Six image statistics describing scattering, contrast, colour, exposure, sharpness and specularity explain almost none of the remaining epoch-to-epoch variation. A small systematic drift of about 0.1 points remains and increases with the interval between captures, consistent with minor physical changes not recorded by redevelopment labels. Controlled experiments further show that acquisition conditions can shift scores when camera and image properties are allowed to vary, and that the direction of these shifts depends on the model. In crowdsourced imagery, camera geometry alone causes a model to report physical change in 45% of identical-scene pairs; normalising both images to a common virtual camera reduces this rate to 7.5%. Despite poor reliability at the individual-location level, aggregation recovers a coherent redevelopment signal: changed streets are judged wealthier, better maintained, more enclosed and less green. These results show that vision-language measurement of urban change is reliable at the scale of hundreds of paired observations, but not at the scale of individual sample points.
106. 【2609.00634】Beyond Landmark Extraction: A Framework for Robust Geometric Feature Construction in Structured Image Classification
链接：https://arxiv.org/abs/2609.00634
作者：Saravana Mauree,Sakshi Arya
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：classification algorithms, disproportionately focused, comparison of classification, structured image recognition, gesture recognition
备注： Under consideration at Pattern Recognition Letters
点击查看摘要
Abstract:Much of the literature on structured image recognition has disproportionately focused on the comparison of classification algorithms. Rather than investigating which classifier performs best, this paper instead asks: what should a classifier know before it ever makes a prediction? In structured vision problems such as gesture recognition, facial expression categorization, and medical image analysis, discriminative information lies less in individual pixels and more in spatial relationships between semantic parts. Raw pixel spaces are high-dimensional, sensitive to nuisance variation, and often obfuscate the geometric structures that make visual tasks interpretable. Landmark extraction provides one form of dimension reduction, but it does not by itself determine the information preserved. This paper studies the post-landmark feature map as the central object of analysis and proposes a systematic framework for constructing and interpreting landmark-derived representations as an, informed, feature-based ``dimension reduction'' step. Using static hand gesture recognition as a case study, we evaluate coordinate, distance, angle, and hybrid representations through perturbation and ablation experiments. The results show that visually variable data exposes substantial gaps between raw coordinate features and their geometrically invariant counterparts, while hybrid representations achieve the strongest overall performance by combining complementary geometric components. These findings frame feature construction as a fundamental modeling decision and ultimately suggests that the question of what representation should a classifier learn from is one worth asking. The code used for feature construction and evaluation is available at this https URL
107. 【2609.00629】ExpArt-KG: Artwork Image Description Generation through Iterative Exploration of Knowledge Graphs
链接：https://arxiv.org/abs/2609.00629
作者：Yuta Kato,Shintaro Ozaki,Kazuki Hayashi,Yusuke Sakai,Hidetaka Kamigaito,Katsuhiko Hayashi,Taro Watanabe
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Vision-Language Models, achieve strong performance, visual question answering, Large Vision-Language, Vision-Language Models
备注：
点击查看摘要
Abstract:Large Vision-Language Models (LVLMs) achieve strong performance on image-grounded text generation and visual question answering. However, it remains difficult for them to comprehensively and accurately describe the factual relations among the entities and concepts associated with the objects depicted in an image. In this work, we propose a framework that efficiently exploits factual information from a knowledge graph via retrieval-augmented generation (RAG), with the goal of enabling LVLMs to generate detailed and accurate image explanations. Specifically, our method alternates between answer generation and knowledge-graph retrieval, and controls the search using a correctness judgment, thereby acquiring the necessary and sufficient factual information efficiently. We also construct a knowledge graph for the artwork domain (ExpArt-KG), in which the correspondence between images and entities is unambiguous. Applying the proposed method to this knowledge graph, we show experimentally that it improves the level of detail of artwork explanations and reduces the retrieval cost of external knowledge while maintaining generation quality comparable to that of iterating a fixed number of times.
108. 【2609.00628】Restrict, Don't Retrain: Inference-Time VLM Guidance for Zero-Shot Aerial Segmentation
链接：https://arxiv.org/abs/2609.00628
作者：Teresa DiMeola,Charles Walter,Hong Xiao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Global welfare, welfare often depends, correct interpretation, satellite imagery, Global
备注：
点击查看摘要
Abstract:Global welfare often depends on the correct interpretation of aerial and satellite imagery. Acting on such imagery (mapping flooded ground, crop extent, or damaged infrastructure) demands pixel-level segmentation to ensure perfect class localization. Pretrained general foundation models, when applied directly, often miss important features and cannot always find all the classes belonging to a given scene, overlooking smaller objects that matter most. We use a single consumer-grade GPU running a vision-language model (VLM) to supply this missing guidance, improving segmentation while producing structured, auditable evidence that drives the result and can be inspected on its own. We fuse three approaches: the frozen foundation model that labels every pixel, and two queries to a VLM, one to choose the classes that matter, and one to locate the small objects the base model misses. Evaluating across four aerial datasets, we see consistent gains at each stage where the base model is competent.
109. 【2609.00625】Inverse Rendering for Modeling with Line Primitives
链接：https://arxiv.org/abs/2609.00625
作者：Kenji Tojo,Ariel Shamir,Nobuyuki Umetani,Bernd Bickel
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：visualization remains challenging, Faithfully capturing diverse, efficient real-time visualization, real-time visualization remains, diverse real-world objects
备注： SIGGRAPH Asia 2026. Project page: [this https URL](https://kenji-tojo.github.io/sa26-line-primitives/)
点击查看摘要
Abstract:Faithfully capturing diverse real-world objects with fuzzy, anisotropic structures, such as hair, fur, fibers, and textiles, for efficient real-time visualization remains challenging. Recent radiance field reconstruction methods capture these structures from multi-view images using translucent volumetric primitives such as 3D Gaussians rather than opaque low-dimensional primitives (e.g., triangles, line segments, and polylines), thereby limiting compatibility with standard depth-tested rasterization, reflection modeling, and physical simulation. We present an inverse rendering method for reconstructing fuzzy geometry using explicit line segments, which are rasterized on a subpixel grid for anti-aliasing to reproduce a semi-transparent appearance. While straightforward to render, optimizing numerous line primitives to match target images poses a significant challenge. We address this by introducing a stochastic differentiable rasterizer for line segments that produces informative gradients with respect to vertex positions, attributes, and discrete connectivity. Experiments on synthetic and real-world datasets show that our method outperforms surface-based approaches in capturing fuzzy boundaries and achieves quality comparable to volumetric representations while relying entirely on explicit geometry. The resulting representation integrates seamlessly with standard graphics pipelines, enabling cross-platform rendering, various shading models, and physical simulation.
110. 【2609.00610】Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction
链接：https://arxiv.org/abs/2609.00610
作者：Xiaoyan Liu,Jiaxin Liu,Kangrui Li,Sifan Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sequential decoupling design, high interaction latency, decoupling design, leading to high, sequential decoupling
备注：
点击查看摘要
Abstract:Current 4D generation paradigms are often bottlenecked by a sequential decoupling design: video is generated first, followed by 3D reconstruction, leading to high interaction latency. This limits applications in interactive real-time scenarios. To this end, we propose \textbf{Streaming4D}, a tightly coupled synchronous pipeline that integrates block-wise autoregressive video generation with incremental 3D reconstruction. Unlike traditional frame-by-frame emission and delayed geometry recovery, Streaming4D generates temporal video blocks and immediately triggers reconstruction for each completed block, enabling parallel execution between synthesis and geometric updates. This approach allows the world representation to evolve online with the video stream, reducing feedback latency while preserving geometric fidelity. We instantiate \textbf{Streaming4D} using a Self-Forcing-style autoregressive generator and an incremental reconstruction backend. Experiments show consistent runtime improvements across resolutions on a single RTX 4090 (1.24$\times$ speedup), while maintaining high-quality 4D geometry and multi-view consistency.
111. 【2609.00593】BrainDiff: Longitudinal Report Generation for Multimodal Brain MRI
链接：https://arxiv.org/abs/2609.00593
作者：Krish Patel,Peirong Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Neuroradiologists rarely read, Neuroradiologists rarely, brain MRI, automated brain-MRI report, brain-MRI report generation
备注：
点击查看摘要
Abstract:Neuroradiologists rarely read a brain MRI in isolation, yet automated brain-MRI report generation has been built almost entirely for single studies. Temporal analysis has been explored on chest radiography and chest CT, but to our knowledge, longitudinal reporting for brain MRI, where interval change is often subtle and spatially distributed, remains unaddressed. We present BrainDiff, the first longitudinal vision-language system for brain MRI. BrainDiff outperforms both frontier general-purpose and single-study neuroimaging models on the same patient pairs. Moreover, BrainDiff retains 91% of internal RadGraph-XL entity+relation F1 (rg_er) on an external, cross-hospital cohort. Beyond the system, we contribute three analyses. First, we identify two independent grounding levers: a counterfactual objective with prior-report dropout, which increases measured image reliance by ~47%, and a staged curriculum. Together, these interventions raise image reliance 2.5-fold from the baseline. Second, we provide a factorial over prior-report availability and image identity, isolating a visual contribution of +0.0387 rg_er, which grows when the prior report is withheld. Third, a cheap change-decodability test for candidate backbones shows that interval change is decodable far more weakly than single-study pathology (0.60 vs. 0.77 AUROC). Code is publicly available at this https URL.
112. 【2609.00591】A Glance Is All You Need: Single-Pass Fine-Grained Image Captioning with SimLoss
链接：https://arxiv.org/abs/2609.00591
作者：Suryaansh Jain,Rahasya Barkur,Vishal G,Ryan Rossi,Franck Dernoncourt,Jack Wang,Koustava Goswami,Nedim Lipka,Puneet Mathur,Samyadeep Basu,Seunghyun Yoon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：thousand words, worth a thousand, captioning models describe, SimLoss FFT, multi-stage
备注：
点击查看摘要
Abstract:An image may be worth a thousand words, but most captioning models describe it in only a few. Modern vision-language models produce fluent high-level captions, yet routinely miss the attributes, counts, textures, materials, and spatial relations that make an image visually specific. Recent multi-stage systems recover some of these details through generation, decomposition, verification, and rewriting, but they do so at the expense of substantially higher inference latency. We propose SimLoss, a reference-free embedding-space objective for single-pass fine-grained image captioning. SimLoss trains a vision-language model to align its projected hidden-state representation with a frozen image embedding through an InfoNCE contrastive loss, supplying a dense visual supervision signal before any text is decoded, and requiring neither human-written fine-grained captions nor pseudo-captions from a multi-stage pipeline. We instantiate it as SimLoss FFT, which backpropagates through a locally available embedding model, and SimLoss GRPO, which treats that model as a black-box reward. Compared with single-pass, multi-stage verification, reward-optimized, and perception-aware baselines, the fully differentiable fine-tuning variant, SimLoss FFT, achieves the highest precision while nearly matching the F1 score of the multi-stage method, all while retaining single-pass inference and running roughly 20 times faster than the multi-stage pipeline. The reward-based variant SimLoss GRPO attains the strongest recall. Together, these results show that embedding-space supervision can recover the quality of multi-stage verification at the latency of a single-pass captioner.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.00591 [cs.CV]
(or
arXiv:2609.00591v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.00591
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Suryaansh Jain [view email] [v1]
Tue, 1 Sep 2026 02:31:34 UTC (10,772 KB)
113. 【2609.00555】Potential-Guided Particle Steering for Negation-Constrained Dexterous Grasping
链接：https://arxiv.org/abs/2609.00555
作者：Geonho Kim,SooGon Kim,Jongmin Lee
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Language-driven dexterous grasp, Language-driven dexterous, find they fail, fail systematically, Sequential Monte Carlo
备注： Project page: [this https URL](https://geonho2.github.io/Potential-Guided/)
点击查看摘要
Abstract:Language-driven dexterous grasp models, such as DextER, perform well when instructions specify where to grasp, but we find they fail systematically when an instruction also specifies where not to grasp (e.g., "grasp the handle but avoid the body"). Existing training corpora, DexGYSNet among them, contain virtually no avoidance instructions, and collecting examples for every possible constraint is impractical. Moreover, because every part mentioned during training denotes a contact target, models may interpret a forbidden part as another region to grasp rather than one to avoid. We therefore introduce an inference-time framework for negation-constrained dexterous grasping that requires no negation-specific training examples. Combining Sequential Monte Carlo with classifier-free guidance, our method guides sampling toward the instructed part while pruning candidates headed for the forbidden region, without any negation examples during training. A frozen 3D part-grounding model localizes the forbidden region from the language instruction. To evaluate this setting, we construct NegGrasp, a benchmark of paired positive/negative instructions with constraint-aware metrics that credit a grasp only if it both accomplishes the task and respects the stated constraint. On NegGrasp, our method reduces the violation rate of the strongest baseline from 57.9% to 17.2% while improving both constraint-aware and physical success.
114. 【2609.00525】GenScale: A Benchmark for Relative Object Scale in Image Generation and Editing
链接：https://arxiv.org/abs/2609.00525
作者：Lingxiao Li,Max Whitton,Ledell Wu,Boqing Gong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern image generation, render familiar objects, implausible relative sizes, Modern image, produce photorealistic
备注：
点击查看摘要
Abstract:Modern image generation and editing systems can produce photorealistic, prompt-aligned images, but still often render familiar objects at implausible relative sizes. To measure this failure mode, we introduce GenScale, a benchmark and evaluation protocol for real-world relative object scale in image generation and editing. GenScale contains 900 image-level entries and 1,643 pairwise anchor-target scale relations across common-object generation, human-product generation with metric dimensions, and scale correction from failed generations. We further design a human-calibrated ordinal judge for scalable pairwise scale evaluation. Last but not the least, we introduce Rescale, a model-agnostic post-processing agent for localized scale correction without modifying the source generator. Experiments reveal that state-of-the-art image generators and editors cannot reliably observe relative scale yet, while Rescale consistently improves scale plausibility across generated and edited images. Together, GenScale establishes relative object scale as a distinct, measurable, and actionable capability for image generation systems.
115. 【2609.00521】Soft-Argmax for the Projective Plane via the Veronese Embedding
链接：https://arxiv.org/abs/2609.00521
作者：Benjamin El-Zein,Dominik Eckert,Paul Zech,Christopher Syben,Bernhard Geiger,Steffen Kappler,Sebastian Stober
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：vision tasks recover, X-ray imaging, mathbb, tasks recover lines, theta
备注：
点击查看摘要
Abstract:From horizon detection to fibre structures in X-ray imaging, many vision tasks recover lines via peak detection in Hough space $H=S^1\times\mathbb{R}$, the domain of orientation-offset pairs $(\theta,\rho)$. Differentiable pipelines extract coordinates via \emph{soft-argmax}, a probability-weighted average that is only meaningful in a globally linear space. However, $(\theta,\rho)$ and $(\theta+\pi,-\rho)$ describe the same undirected line, so $H$ double-covers the space of undirected lines $H/\mathbb{Z}_2$: a Möbius strip, obtained by identifying each pair under $\mathbb{Z}_2$ action. Soft-argmax operates on the cover $H$, but since $H/\mathbb{Z}_2$ admits no linear structure, it tears geometrically adjacent lines apart. Thus we need a $\mathbb{Z}_2$-invariant embedding of lines into a linear space, on which soft-argmax is well-defined. We achieve this by parametrising lines via unit-norm homogeneous vectors $\ell=(1+\rho^2)^{-1/2}(\cos\theta,\sin\theta,-\rho)^{\top}\in\mathbb{R}^3$ and applying the Veronese map $v_2(\ell)=\ell\ell^{\top}$ that satisfies $v_2(\ell)=v_2(-\ell)$. This descends continuously to an embedding of the quotient $H/\mathbb{Z}_2$ into the linear space $\mathrm{Sym}^2(\mathbb{R}^3)$, where the antipodal ambiguity vanishes. Line extraction becomes a barycentre in $\mathrm{Sym}^2(\mathbb{R}^3)$, projected back via its leading eigenvector. We validate our \emph{Veronese soft-argmax} in a Hough transform-based network across all resolvable lines, confirming uniform and seam-free recovery. We further derive that the $L_2$-loss on isometrically weighted Veronese embeddings equals the squared chordal distance between lines in projective space, enabling a geometrically precise training objective.
116. 【2609.00505】ViTAL-X: Video-Text Alignment with Cross-Modal Temporal Edits
链接：https://arxiv.org/abs/2609.00505
作者：Sethuraman T V,Savya Khosla,Onkar Kishor Susladkar,Aditi Tiwari,Seoung Wug Oh,Kushal Kafle,Joon-Young Lee,Derek Hoiem,Simon Jenni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：perceive fundamental cues, frequently exhibit temporal, exhibit temporal blindness, frequently exhibit, cues like order
备注：
点击查看摘要
Abstract:Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues like order, direction, and motion dynamics. Standard datasets mask this limitation by enabling models to exploit static spatial shortcuts. To systematically evaluate this, we introduce XTE-Bench, a diagnostic probe revealing that even large-scale video-language models struggle with basic temporal reasoning, indicating that parameter scaling alone is insufficient to resolve this flaw. To address this, we propose Cross-Modal Temporal Edits (XTE), a self-supervised framework that injects precise temporal supervision. By performing synchronized video-text transformations, XTE generates hard temporal negatives without manual annotation. We instantiate this with ViTAL-X, a lightweight model that equips frozen image-text backbones with temporal awareness while preserving their foundational spatial knowledge. Across six temporal benchmarks, ViTAL-X achieves state-of-the-art performance. Utilizing only 0.4B parameters and 1M training clips, ViTAL-X outperforms 7B-parameter models and surpasses baselines trained on 600x more data. These results demonstrate that targeted, high-quality temporal alignment provides a highly efficient alternative to pure scaling.
117. 【2609.00476】Less Is More: Balancing Positive and Negative Space in Visual Concept Blending
链接：https://arxiv.org/abs/2609.00476
作者：Shishi Xiao,Adam J. Coscia,David H. Laidlaw
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：communicate multiple ideas, Graphic designers, blend visual concepts, create balance, aesthetic appeal
备注：
点击查看摘要
Abstract:Graphic designers often blend visual concepts to communicate multiple ideas within a single image, leveraging positive and negative space to create balance, emphasis, and aesthetic appeal. While computational methods have begun to support automatic concept blending, they largely overlook the role of spatial composition in the design. To address this gap, we present an automatic pipeline that explicitly applies positive and negative space throughout the blending process. Our approach first identifies plausible regions for concept integration by combining semantic reasoning from vision-language models with geometric constraints derived from real-world examples. Conditioned on these regions, the system generates blended compositions using a hybrid pixel-vector pipeline: diffusion-based inpainting produces a fast, coarse initialization, which is then refined through vector-based optimization at the point level to ensure structural coherence and balanced semantic expression. A multimodal agent orchestrates this process as a planner and evaluator, enabling iterative improvement and interpretable control. Through an evaluation using both baseline comparisons and a user study, we demonstrate greater expressiveness, creativity, and concept recognizability by effectively leveraging positive and negative space. We further demonstrate the generalizability of our approach across diverse applications, including controllable image and infographic generation.
118. 【2609.00469】SAM3-LoRA: Parameter-Efficient Adaptation of a Concept-Promptable Foundation Model for Multi-Class Structural Defect Segmentation
链接：https://arxiv.org/abs/2609.00469
作者：P. Malaisree,S. Youwai,S. Janrungautai,D. Amorndechaphon,P. Rojanavasu,W. Songkitti
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Promptable segmentation foundation, open-vocabulary text concept, Promptable segmentation, accept an open-vocabulary, segmentation foundation models
备注：
点击查看摘要
Abstract:Promptable segmentation foundation models such as SAM3 accept an open-vocabulary text concept and return every instance matching it, but adapting them to a specialized domain by full fine-tuning is computationally prohibitive for the organizations that would benefit most. This study applies Low-Rank Adaptation (LoRA) to SAM3 for multi-class structural defect segmentation and examines both how such a model can be supervised from conventional annotation and whether the resulting efficiency gain transfers across datasets. Two contributions are methodological. First, we describe a supervision procedure that trains a concept-promptable model directly from COCO-style class-labeled instance segmentation by using the category name itself as the prompt, requiring no prompt templates, no synonym expansion, and no learned class embeddings. Second, we identify and mitigate a failure mode specific to this setting: because a conventional annotation file yields positive prompts exclusively, the model's presence prediction decouples from the text condition and degenerates into responding to any prompt, a collapse that is invisible to every metric computed on positive prompts alone. Exhaustive hard-negative prompting, in which every dataset category absent from an image is issued as a zero-detection query, addresses this at no annotation cost. Two adapter placements were compared under an identical protocol, updating 0.121% and 1.341% of model parameters. On a purpose-built tunnel lining dataset, pixel intersection-over-union improved from 0.017 to 0.338 and instance-level recall from 0.375 to 0.672; on the independent public Structural Defects Dataset, from 0.017 to 0.855 and from 0.574 to 1.000. Improvements were directionally consistent across ten metrics on both datasets, and the largest per-category gains occurred precisely where zero-shot competence was absent.
119. 【2609.00447】Instance-Guided Report Anchoring for Text-Free 3D Abnormality Segmentation in Chest CT
链接：https://arxiv.org/abs/2609.00447
作者：Zhenyu Bu,Haoyan Ding,Chushu Shen,Xinyuan Zheng,Peiyu Duan,Xueqi Guo,Sepehr Farhand,Yoshihisa Shinagawa,Gerardo Hermosillo,Chaowei Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：obtaining expert voxel-level, expert voxel-level labels, dense spatial supervision, requires dense spatial, IGRA improves Dice
备注：
点击查看摘要
Abstract:Accurate 3D abnormality segmentation in chest CT requires dense spatial supervision, but obtaining expert voxel-level labels is costly. Radiology reports, however, are routinely generated during clinical interpretation and contain instance-specific descriptions that can provide additional guidance without new dense annotation. Existing vision-language grounding methods typically require report-derived findings at inference, making localization dependent on paired text and limiting each forward pass to a queried finding. We propose Instance-Guided Report Anchoring (IGRA), a model-agnostic module that preserves the correspondence between each annotated abnormality instance and the report finding that describes it. IGRA pools each instance representation and anchors it to the corresponding finding embedding during training; all text-related components are discarded at inference. We further reformulate free-text grounding on ReXGroundingCT as multi-label volumetric segmentation by merging same-category instances, allowing all abnormality categories to be predicted in one image-only forward pass. IGRA improves Dice by 22.5% over the strongest image-only baseline (30.93 vs. 25.25) and is comparable to VoxTell on the single-finding subset (30.29 vs. 30.43). Applied unchanged to four standard 3D segmentation backbones, IGRA improves Dice and hit rate across all architectures. Zero-shot evaluation on LIDC-IDRI, PleThora, and a private in-house dataset further shows consistent gains over image-only baselines.
120. 【2609.00446】CRAD: Class-wise Reliability-Aware Distillation for Decentralized Heterogeneous Federated Learning
链接：https://arxiv.org/abs/2609.00446
作者：Baraa Bilbeisi,Mengchen Fan,Baocheng Geng,Qing Tian
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Conventional federated learning, Conventional federated, federated learning, relies on parameter, doubly homogeneous
备注：
点击查看摘要
Abstract:Conventional federated learning (FL) relies on parameter averaging, which forces clients to be doubly homogeneous: it demands an identical architecture and degrades under non-IID data. Real-world deployments usually break both assumptions. We sidestep both by building a decentralized knowledge distillation framework in which each client evaluates its peers' model snapshots on its own local data and distills from the resulting soft predictions. Because knowledge is transferred through the shared class posterior, clients are free to run different architectures; and because every teacher is evaluated on the student's own device, raw data never leaves the client, with no central server or public dataset required. Within this setting, we identify and address an under-examined problem: how to combine the peer teacher predictions. Existing methods, like uniform averaging, ignore how knowledge reliability varies across teachers and classes. We propose Class-wise Reliability-Aware Distillation (CRAD), which, per class, first discards teachers that disagree with the peer consensus and then takes a weighted average of the rest, weighting each teacher by its per-class reliability (precision, or inverse variance). Since the variance of an accuracy from $n$ samples scales as $1/n$, support enters automatically: among the teachers that survive filtering, a teacher is trusted for a class to the degree that it is both accurate and well-evidenced for it. On three image-classification benchmarks (CIFAR-10, CIFAR-100, and PathMNIST colon pathology), across heterogeneous architectures under severe non-IID skew, CRAD consistently outperforms competing methods in global accuracy.
121. 【2609.00411】Unmasking Face Embeddings: Reading, Rendering and Naming with Foundation Models
链接：https://arxiv.org/abs/2609.00411
作者：Fizza Rubab,Yiying Tong,Arun Ross
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern face recognition, deep neural networks, extract compact identity, Modern face, models
备注：
点击查看摘要
Abstract:Modern face recognition (FR) owes much of its success to deep neural networks that learn to extract compact identity embeddings from face images. These models are typically trained for identity discrimination, producing embeddings that are highly effective for biometric matching but largely opaque to semantic interpretation. In contrast, foundation models, pretrained on broad visual or vision--language tasks, provide rich interfaces for describing, retrieving, generating, and organizing visual content. This contrast raises a natural question: what capabilities become available when face embeddings from domain-specific FR models are made interoperable with foundation models? Building on recent work on embedding compatibility across models, we use simple pre-computed linear transformations, estimated from paired embeddings alone, to connect existing FR models with off-the-shelf foundation models. Once aligned with a foundation model, a face embedding can be 'unmasked' in multiple ways, without training or modifying either model: it can be read in natural language, enabling free-form text queries over a gallery of FR embeddings; rendered into a face image that recovers a person's appearance, using an unmodified diffusion decoder; and converted to a name, enabling identification even in the absence of an enrolled face gallery. In effect, one linear transformation turns an identity embedding into a rich embedding for web-scale foundation models. This interoperability exposes face embeddings as semantically and visually rich biometric representations, with direct implications for interpretability, retrieval, reconstruction, and template security.
122. 【2609.00396】SlideMix: Enhancing Whole Slide Image Analysis via Multimodal Shuffling
链接：https://arxiv.org/abs/2609.00396
作者：Chad Wong,Sicheng Chen,Tianyi Zhang,Enhui Chai,Yueming Jin,Zeyu Liu,Fei Xia
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multi-scale evidence make, weak slide-level supervision, automated analysis challenging, evidence make robust, make robust automated
备注：
点击查看摘要
Abstract:Histopathological whole slide images (WSIs) are central to cancer diagnosis, but their gigapixel scale, tissue heterogeneity, weak slide-level supervision, sparse diagnostic regions, and multi-scale evidence make robust automated analysis challenging. Multiple instance learning (MIL) is widely used to aggregate tile-level features into slide-level predictions, yet existing augmentation strategies often perturb tissue regions without preserving diagnostic relevance, slide context, or cross-scale structure. We propose SlideMix, a model-agnostic multimodal augmentation framework for MIL-based WSI analysis. SlideMix uses a retrieval-augmented vision-language model (VLM)-based Visual-Language Adaptive Region selector to identify diagnostically relevant regions and reduce weak-label noise. It then performs In-place Tile Shuffling within meaningful tissue regions to mix feature embeddings while preserving slide-level context. A VLM-based soft-labeling module supervises mixed samples, while a multi-factor, loss-driven online Curriculum-Learning Feedback scheme adaptively controls shuffle granularity, feature similarity, and shuffle ratio to promote cross-scale representation learning. Across 11 WSI datasets comprising 20,523 slides, 8 diagnostic tasks, and 10 WSI backbones, SlideMix improves accuracy and generalization in most settings and compares favorably with established augmentation baselines, providing a simple plug-and-play approach for more robust and scalable digital pathology models. Source code: this https URL
123. 【2609.00377】FoldingAgent: Inferring Parametric Origami Procedures from Demonstration Videos
链接：https://arxiv.org/abs/2609.00377
作者：Maya Moriya,Sigal Raab,Yael Vinker,Tali Dekel
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)
关键词：inferring explicit parametric, present FoldingAgent, folding programs directly, inferring explicit, explicit parametric folding
备注： Project Page: [this https URL](https://maya-moriya.github.io/origami-page/) Accepted to SIGGRAPH ASIA 2026
点击查看摘要
Abstract:We present FoldingAgent, an agentic framework for inferring explicit parametric folding programs directly from origami demonstration videos. Our framework leverages the reasoning power of a pre-trained Vision-Language Model (VLM) equipped with a suite of specialized tools that enable the agent to simulate geometric transitions, verify physical plausibility, retrieve and compare visual content, and evaluate its own predictions. To translate visual content into folding programs, we define a parametric space that consists of the paper's geometry and a set of parametric folding actions. Unlike models that predict static crease patterns, our agent operates sequentially and possesses the ability to re-plan its actions, effectively mitigating the compounding errors inherent in multi-step folding. Our approach takes a step toward closing the gap between human origami knowledge, which is primarily shared through unstructured visual demonstrations, and computational methods, which typically rely on structured, parametric representations such as a crease pattern or an executable parametric plan. We evaluate our approach on PurelandFold, a newly curated benchmark of diverse Pureland origami videos with ground-truth geometry and action labels. Our results demonstrate that by combining VLM reasoning with a set of specialized tools and physical simulation, we can successfully transform unstructured visual demonstrations into executable, physically plausible folding procedures.
124. 【2609.00374】Adapting Without Gradients: Affine Statistics Transport and What Its Certificate Can Tell You
链接：https://arxiv.org/abs/2609.00374
作者：Salim Khazem,Ibrahim Mohamed Serouis
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Test-time adaptation, typically assumes, inference time, updated at inference, standard BatchNorm-based TTA
备注：
点击查看摘要
Abstract:Test-time adaptation (TTA) typically assumes that model parameters can be updated at inference time. This assumption is restrictive for inference-only accelerators, frozen or third-party models, and memory-constrained deployments, and standard BatchNorm-based TTA configurations may also become inactive on architectures without BatchNorm. We study adaptation when the learned model must remain frozen. We introduce CASTER, a gradient-free method that stores source class statistics in a discriminative subspace, estimates a class-shared affine transformation from target-batch moments, and analytically transports the source class distributions before classification. CASTER requires no backward pass, optimizer state, or stored source feature bank. Across four backbones and seven datasets, it outperforms k-NN on identical frozen features in 27 of 28 backbone-dataset settings while retaining a median of 18x less state. Affine transport is not always reliable. On ImageNet-C, where batches contain only 64 samples for 1000 classes, unconditional transport loses 21.2 top-1 points. We therefore introduce an empirical residual-to-margin transportability certificate. Across 307 evaluation cells, every transport losing more than 10 points has certificate value above 3.9, although benign and destructive regimes are not perfectly separated. Gating converts an average $-3.35$-point effect of unconditional transport into a +1.69-point gain, and performance remains within 0.3 points of the best threshold over a broad threshold range. Finally, we show that this certificate is mechanism-specific: when applied to Tent, it accepts only $4.3\%$ of updates and preserves 0.6% of Tent's available gain. These results position CASTER as a lightweight adaptation mechanism for frozen-model deployment, together with an explicit account of when its safety signal is informative and when it is not.
125. 【2609.00369】Puppeteer: Object-Grounded Posture-Aware Co-Speech Gesture Generation
链接：https://arxiv.org/abs/2609.00369
作者：Vida Adeli,Soroush Mehraban,Jacob Rommann,Harrison Sanborn,Cole Clifford,Babak Taati
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generating co-speech gestures, objects remains challenging, Generating co-speech, surrounding objects remains, causal latent space
备注：
点击查看摘要
Abstract:Generating co-speech gestures that are temporally coherent, semantically aligned with speech, and grounded with surrounding objects remains challenging. Prior speech-driven gesture models emphasize audio-gesture alignment but do not explicitly account for posture constraints or surrounding objects, failing to capture the inherent correlation between body gestures and the physical space. We present Puppeteer, a posture-aware, object-grounded co-speech gesture diffusion model operating in a causal latent space. We decompose long gestures into structured primitives and learn a causal variational autoencoder that encodes them into temporally ordered latent tokens, each depending only on the past. We then perform conditional diffusion directly in the causal latent space, conditioning on speech signals, motion history, an initial posture reference, and object geometry to synthesize physically consistent gestures. This temporally ordered latent formulation enables explicit temporal control and supports tasks such as gesture in-betweening and gesture completion. To better assess co-speech gesture synthesis beyond existing measures, we introduce new evaluation metrics tailored to this task. We also created SceneGes, the first curated synthetic 3D dataset of embodied co-speech gestures and corresponding 3D objects, enabling object-grounded gesture generation. Experiments show that Puppeteer generates more diverse and temporally synchronized gestures than prior methods, while enabling object-grounded gesture synthesis.
126. 【2609.00365】Dr. Claw: An AI Scientist Workspace for Vibe Research
链接：https://arxiv.org/abs/2609.00365
作者：Dingjie Song,Hanrong Zhang,Dawei Liu,Yixin Liu,Zongxia Li,Zhengqing Yuan,Siqi Zhang,Henry Peng Zou,Zhiling Yan,Yuxuan Zhang,Yanfang Ye,Philip S. Yu,Lichao Sun
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Claude Code, Gemini CLI, sustain long sessions, Command-line coding agents, long sessions
备注： Accepted to EMNLP 2026 System Demonstrations. Code: [this https URL](https://github.com/OpenLAIR/dr-claw)
点击查看摘要
Abstract:Command-line coding agents (e.g., Claude Code, Gemini CLI) can already read and write files and sustain long sessions, yet end-to-end research still fragments across chat tools, IDEs, terminals, and writing environments, and the decisions that make it auditable are rarely preserved. We present Dr. Claw, an open-source workspace that wraps existing coding-agent executors in a controllable and auditable human-in-the-loop workflow rather than introducing another autonomous agent. Persistent state objects, a reusable skill library, and multi-executor coordination link human decisions to AI execution, turning planning, execution, and writing into one traceable, recoverable loop. We demonstrate Dr. Claw through an interactive three-view scenario and a failure-recovery walkthrough, and evaluate it against a bare command-line agent sharing the same backend executor, so the comparison contrasts the whole orchestration layer (task graph, state objects, and skill library) with the agent it wraps. Holding the executor fixed, Dr. Claw scores higher on research completeness while persisting an auditable, recoverable process trail. Demo access: repository this https URL, released under AGPL-3.0 with GPL-3.0 upstream components.
127. 【2609.00358】Where Should Experience Live? Hierarchical Hebbian Memory for Continual Vision Transformers
链接：https://arxiv.org/abs/2609.00358
作者：Mohammed Yusuf Mujawar,Noorbakhsh Amiri Golilarz
类目：Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE)
关键词：slowly updated parameters, newly acquired information, Transformers provide strong, Vision Transformers provide, Routed Episodic Memory
备注：
点击查看摘要
Abstract:Vision Transformers provide strong visual representations but typically rely on slowly updated parameters, limiting their ability to organize newly acquired information across different memory timescales. This work proposes \textit{Hierarchical Hebbian Memory}, a three-level memory architecture composed of rapid Working Memory, persistent Routed Episodic Memory, and slower Semantic Memory. A learned controller regulates memory contribution, read and write routing, plasticity, retention, and consolidation. A causal read-before-write lifecycle ensures that the current outcome cannot influence the prediction it supervises. The architecture is evaluated on Omniglot 5-way 1-shot recognition and CORe50 continual object recognition. With Swin-Tiny, the hierarchical model reaches 97.39\% accuracy on Omniglot and 95.37\% final accuracy on CORe50 when combined with experience replay. Learned multi-bank retrieval reaches 47.50\% delayed-association accuracy, compared with 24.17\% for a single persistent bank and 25.00\% without memory. After intervening distractors, Episodic Memory retains approximately 0.96 cosine similarity with stored associations, while Working Memory falls to approximately 0.05. These results show that Hebbian association and learned memory routing can jointly organize online visual experience across rapid, persistent, and consolidated memory timescales within Vision Transformers.
128. 【2609.00355】Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Models
链接：https://arxiv.org/abs/2609.00355
作者：Jungseob Lee,Seongtae Hong,Dongyub Jude Lee,Chanjun Park,Jaehyung Seo,Sugyeong Eo,Heuiseok Lim
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Speculative decoding accelerates, decoding accelerates generation, Speculative decoding, changing its output, accelerates generation
备注： 18 pages, 9 figures, 17 tables. Code: [this https URL](https://github.com/js-lee-AI/GLANCE)
点击查看摘要
Abstract:Speculative decoding accelerates generation without changing its output, yet on vision-language models (VLMs) it has been caught in a self-defeating cycle. The drafter stays autoregressive, so it must stay small. A small drafter cannot afford the image at every step, so vision is compressed, pruned, or hidden. A drafter cut off from the image is then least reliable exactly where the image makes text predictable. We present GLANCE, the first one-pass block drafter that is lossless on an unmodified VLM target, and it breaks the cycle at both ends. A block-diffusion head reads the target's already-fused vision-language state, so vision costs the drafter nothing, and fills a whole block in one forward pass, so depth costs no sequential steps. A wide candidate tree is verified in one target pass, and every audited prompt reproduces greedy decoding exactly. Grounded workloads reward this most, entering a verbatim-copy regime whose long runs cost an autoregressive drafter a pass for every token and a block drafter one in total. Under one engine and one round budget, GLANCE decodes up to 2.93x faster than autoregression, from one draft pass a round where the production EAGLE3-VL head takes eight, and accepts 2.7x longer blocks than an EAGLE-3 head trained on the same corpus. One law organizes these results. Accepted length is set by the target's next-token entropy, with a fitted slope that steepens with grounding across all five tasks. The law transfers across targets and modalities and names its own boundary, since free-running text still favors a chain. Our code is available at this https URL.
129. 【2609.00300】RUST: Threshold-Recalibrated Uncertainty-Safe Training for Certified Dismissal in Breast Cancer Screening
链接：https://arxiv.org/abs/2609.00300
作者：Parham Hajishafiezahramini,Matthew Hamilton,Edward Kendall,Gregory Doyle,Oscar Meruvia Pastor
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：cancer-negative screening mammograms, lower radiologist workload, Reducing the review, compromising cancer detection, cancer-negative screening
备注：
点击查看摘要
Abstract:Reducing the review of clearly cancer-negative screening mammograms could lower radiologist workload without compromising cancer detection. We propose a closed-loop threshold-aware training strategy in which the dismissal threshold is recalculated during training and used to penalize cancer-positive images that approach the dismissal region. We evaluated the method on NLBS and RSNA using five controlled training configurations, with case-level assessment based on a one-sided 99\% Clopper--Pearson upper bound for cancer prevalence among dismissed cases. The proposed model achieved the highest case-level dismissal rates at both 98\% and 95\% recall targets. On NLBS, dismissal reached 19.74\% and 21.70\%, while the cross-entropy baseline did not meet either recall target. On RSNA, dismissal improved from 7.04\% to 14.31\% and from 13.49\% to 19.69\%. In external RSNA$\to$NLBS evaluation, the proposed model achieved dismissal rates of 12.95\% and 19.87\% at the 98\% and 95\% recall targets, respectively. These results support closed-loop threshold-aware training for high-recall selective dismissal.
130. 【2609.00291】StreamScout: Learning When to Look Deeper for Streaming Video Understanding
链接：https://arxiv.org/abs/2609.00291
作者：Ce Zhang,Jing Bi,Jinxi He,Jianshu Zhang,Jingyang Lin,Yunzhong Xiao,Minghao Fu,Yaqi Xie,Zhentao Xie,Weicong Chen,Katia Sycara,Ming Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video understanding requires, Streaming video understanding, unbounded video stream, understanding requires answering, requires answering questions
备注：
点击查看摘要
Abstract:Streaming video understanding requires answering questions that arrive at arbitrary moments over an unbounded video stream. Existing systems primarily focus on what to retain in a bounded memory, yet access that memory using the same fixed-cost procedure for every query, despite substantial variation in the evidence required. We argue that deciding how deeply to access memory for each query is as important as deciding what the memory should store. To this end, we introduce StreamScout, an adaptive inference framework that maintains only a lightweight textual timeline in context as the stream unfolds. At query time, StreamScout progressively augments the timeline with up to three increasingly informative visual views: a glance at recent frames, a uniform look-back over the past stream, and query-salient retrieval. At each stage, the model answers immediately if the available evidence is sufficient; otherwise, it escalates to the next view. To improve this stop-or-escalate policy, we probe the cascade on an auxiliary set and distill the model's empirical competence boundary into supervision for a lightweight LoRA adaptation, yielding StreamScout-S. We further refine the policy through reinforcement learning, allowing the model to explore stopping behaviors beyond imitation of the distilled decisions, yielding StreamScout-R. Across three backbones and three streaming benchmarks, StreamScout and its variants consistently outperform prior streaming methods while substantially reducing inference cost and token consumption; on OVO-Bench, for instance, StreamScout-S improves Qwen3-VL-8B by 14.65 points while using 59% fewer tokens than uniform sampling and answering in 1.04 s on average.
131. 【2609.00272】CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space
链接：https://arxiv.org/abs/2609.00272
作者：Paul Schneider,Nazim Haouchine
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：image variations arise, address monomodal settings, keypoint descriptions address, arise from viewpoint, advances in keypoint
备注： ECCV 2026
点击查看摘要
Abstract:Most advances in keypoint descriptions address monomodal settings, where image variations arise from viewpoint, illumination, or contrast changes. Multimodal scenarios involve images produced by fundamentally different sensing processes, such as multispectral imaging, RGB-depth, satellite imagery, or medical imaging, causing the same structures to appear differently. A common solution to cross-modal description is to train descriptors for each modality pair, which requires retraining whenever the modalities change, or to train large models, which incur a significant increase in runtime. Instead, we propose CrossFeat, a framework that enables an existing monomodal descriptor to operate across modalities. Our method learns a crossing function in descriptor space that maps features from one modality to a representation compatible with another. To preserve the structural information captured by the original descriptor, CrossFeat introduces a geometry-appearance disentanglement such that only appearance is altered while the geometric properties are preserved. Experiments across multiple domains and datasets demonstrate improved performance in multimodal matching.
132. 【2609.00242】CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction
链接：https://arxiv.org/abs/2609.00242
作者：Zhengxu Tang,Guofeng Cui,Ziyu Gong,Xiaozhou Zhang,Ruifeng Deng,Chengzhi Qi,Ke Chen,Sachin Patil,Tianjun Xiao,Langechuan Liu,Pichao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：rare-object recognition errors, autonomous driving failures, recognition errors, framed as rare-object, rare-object recognition
备注： Accepted by EMNLP 2026
点击查看摘要
Abstract:Long-tail autonomous driving failures are often framed as rare-object recognition errors. We argue that this view is incomplete: the decision-critical question is not only whether a model recognizes an unusual object, but whether it infers how that object changes the ego vehicle's feasible high-level actions. We formalize this problem as decision-level driving affordance prediction, where a model maps a front-view image, ego-motion history, and navigation command to a structured longitudinal--lateral meta-action. To evaluate this capability, we introduce CoLT-Drive, a 3,536-sample counterfactual long-tail benchmark that inserts rare objects into otherwise fixed driving scenes and measures whether models predict acceptable action pairs. To improve deployable small VLMs, we propose KPA, a knowledge-preserving adaptation framework that combines structured perception-to-decision prompting, SLERP-based expert merging, and RegMoE, a regime-aware LoRA mixture-of-experts module. KPA preserves the pretrained model's open-world knowledge while allocating lightweight adaptation capacity to different driving decision regimes. Experiments on an in-domain driving split and CoLT-Drive show that KPA achieves 60.8\% pair accuracy on CoLT-Drive, outperforming the pretrained Qwen3-VL-2B baseline (50.3\%) and LoRA SFT (32.4\%) while maintaining competitive in-domain accuracy. Our benchmark and code are available at this https URL and this https URL.
133. 【2609.00232】Beyond Blind Compliance: Benchmarking Task Verification in OCR Reasoning
链接：https://arxiv.org/abs/2609.00232
作者：Yue Zhou,Yuan Wu,Yi Chang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, achieved strong performance
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) have achieved strong performance on OCR-centric document understanding and text-rich visual reasoning benchmarks. Yet existing evaluations largely assume that every task is valid and answerable. In real-world OCR scenarios, this assumption often fails: questions may rely on illegible text, occluded evidence, nonexistent visual targets, contradictory premises, or missing variables. We study this reliability gap as OCR-grounded Task Verification: before answering, a model should determine whether the Image Premise (IP), Textual Premise (TP), and Question (Q) jointly define an executable task. We introduce VeriOCRBench, a 1,800-sample human-verified benchmark built from source images drawn from 8 OCR-related datasets and spanning 8 real-world image domains, with controlled, image-grounded diagnostic tasks. It contains 1,600 trap-injected invalid tasks across 8 trap types and four verification dimensions---Visual, Contextual, Factual, and Logical---plus 200 trap-free controls for measuring over-refusal. Built with a Visual Atomic Fact (VAF)-anchored pipeline and full human auditing, VeriOCRBench enables decoupled evaluation of task verification, root-cause diagnosis, and over-refusal. Evaluating 15 leading MLLMs reveals persistent blind compliance, diagnosis failures, and prompt-induced over-refusal, exposing a critical reliability gap in current OCR reasoning systems. The code is available at: this https URL.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.00232 [cs.CV]
(or
arXiv:2609.00232v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.00232
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Yue Zhou [view email] [v1]
Mon, 31 Aug 2026 18:39:46 UTC (6,095 KB)
134. 【2609.00231】Beyond Language Priors: Diagnosing and Fixing Visual-Origin Hallucinations in Multimodal LLM
链接：https://arxiv.org/abs/2609.00231
作者：Peiyang Xu,Xiaopei Zhu,Jun Zhu,Xiaolin Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, textual co-occurrence statistics, multimodal large language, Existing research, language models
备注： Carmera-ready version. To appear in ACM MM 2026
点击查看摘要
Abstract:Existing research on object hallucination in multimodal large language models (MLLMs) predominantly attributes the problem to language priors such as over-reliance on textual co-occurrence statistics. We challenge this view by presenting quantitative evidence for a complementary, under-explored cause: visual-origin hallucination, where hallucinations arise from incorrect visual feature extraction and misalignment between image and text embeddings. Through cosine similarity analysis and Smooth Grad-CAM entropy measurements, we show that hallucinated samples exhibit systematically lower image-text similarity (average 0.158 vs. -0.122) and inverted attention patterns, where attention is dispersed when the target object is present but wrongly concentrated when it is absent. Guided by this diagnosis, we propose Adversarial Contrastive Fine-Tuning (ACFT). ACFT uses an Adversarial Hallucination Attribute Flipping (AHAF) procedure, involving minimal, targeted adversarial perturbations that flip an image's hallucination attribute, to construct perfectly aligned positive-negative pairs, which are then used for contrastive fine-tuning. AHAF simultaneously serves as a diagnostic probe, revealing that MLLM visual representations lie dangerously close to hallucination decision boundaries. Requiring only 0.9% of the COCO dataset and adding zero inference overhead, ACFT achieves state-of-the-art performance on POPE, MME, and four description-level hallucination benchmarks across LLaVA, MiniGPT-4, and Qwen2.5-VL. Code is available at this https URL
135. 【2609.00206】Distributed Implicit Harm: A Compositional Safety Blind Spot in MLLM-Based Video Moderation
链接：https://arxiv.org/abs/2609.00206
作者：Ruotong Wang,Zihao Zhu,Siwei Lyu,Xin Tao,Baoyuan Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：multimodal large language, safety blind spot, large language models, Distributed Implicit Harm, multimodal large
备注：
点击查看摘要
Abstract:Despite their growing use in video moderation, multimodal large language models (MLLMs) exhibit a compositional safety blind spot: videos composed of seemingly benign components can convey harmful meaning when interpreted as a whole. We refer to this phenomenon as Distributed Implicit Harm (DIH), where harm arises from relations among components distributed along a decomposition axis of the video, rather than from any single explicit cue. Among many possible axes, we study two representative cases: temporally distributed harm across visual segments (DIH-T) and cross-modal harm between audio and visual streams (DIH-M). Studying and mitigating DIH at scale requires data that is difficult to collect: such videos lack compositional harm annotations, evade retrieval based on local visual cues, keywords, or single-modality signals, and are consequently absent from existing safety datasets. To bridge this gap, we develop a multi-agent synthesis framework that composes individually benign components into harmful scenarios and generates diverse DIH videos with explicit reasoning annotations, yielding a dataset of over 9,000 videos spanning visual-only and audio-visual settings. Benchmarking over 30 MLLMs spanning frontier proprietary models and leading open-source systems reveals substantial and consistent deficits in detecting both DIH-T and DIH-M. Notably, this failure persists even among the strongest frontier models: they often correctly assess individual components in isolation but fail to recognize the harmful meaning that emerges from their composition. We further evaluate these models on a manually collected set of real-world DIH videos from social media and observe the same failure mode, highlighting DIH as a practical and underexplored challenge for video moderation.
136. 【2609.00198】A Lagrangian View of Flow Matching
链接：https://arxiv.org/abs/2609.00198
作者：Peyman Milanfar
类目：Computer Vision and Pattern Recognition (cs.CV); Fluid Dynamics (physics.flu-dyn)
关键词：Modern explicit-time generative, typically derived top-down, Modern explicit-time, explicit-time generative models, Rectified Flow
备注：
点击查看摘要
Abstract:Modern explicit-time generative models, such as Flow Matching [Lipman et al., 2023] and Rectified Flow [Liu et al., 2023], are typically derived top-down via Optimal Transport and the continuity equation. This standard Eulerian approach focuses on the macroscopic transport of probability mass. In this paper, we present an alternative, bottom-up mechanical derivation grounded in a Lagrangian (particle-centric) perspective. By analyzing the local Taylor expansion of a continuous denoiser, we motivate a strict invariance condition required for optimal, singlestep generation: the conservation of target identity. Enforcing this condition yields a governing quasi-linear advection Partial Differential Equation (PDE). We demonstrate that solving this PDE via the Method of Characteristics analytically yields the straight-line trajectories of Flow Matching. This geometric perspective isolates the Jacobian of the denoiser as the primary source of trajectory curvature, providing a direct mathematical explanation for why straight-line flows enable massive step sizes, and why empirical models require distillation to flatten intersecting characteristics.
137. 【2609.00192】LLM-Driven Autonomous Vehicles Inherit Human Driver Biases in Pedestrian Yielding: Results and Implications From A New Benchmark
链接：https://arxiv.org/abs/2609.00192
作者：Irem Yoldas,Martim Brandão,Jie Zhang,Odinaldo Rodrigues
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
关键词：Autonomous Vehicles, Public trust, trust in Autonomous, technical success, decision making
备注：
点击查看摘要
Abstract:Public trust in Autonomous Vehicles (AVs) may depend not only on technical success but also on the fairness of their decision making. While a recent trend in AV research involves using general purpose "common sense" models to guide AV decision making, the degree to which these inherit human biases in driving is still understudied. Given that psychology studies have shown human driver biases exist, such as lower pedestrian-yielding rates to Black pedestrians in the US, we argue that analyses of model bias should also be part of AV evaluation. Concretely, in this paper we propose two new bias testing methodologies for Large Language Models (LLMs) and Visual-Language Models (VLMs)-"All Else Being Equal" tests and "Self-Consistency" tests-in order to assess bias in pedestrian-yielding decisions. Our findings show that both LLMs and VLMs make yielding decisions which are influenced by pedestrian gender, ethnicity, religion, disability, age, skin tone and socio-economic status. While the type and degree of bias is different from model to model, we highlight common patterns-and raise questions about the "common sense" model paradigm, particularly the need to either revise the paradigm or address issues of downstream bias.
138. 【2609.00188】ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training
链接：https://arxiv.org/abs/2609.00188
作者：Xionghao Wu,Yijun Yang,Shiyang Zhou,Haoze Sun,Jianhui Liu,Songsong Yu,Jiyao Zhang,Wenbo Li,Bo Wang,Guoqing Ma,Lin Song,Renjie Liao,Shenghe Zheng,Wei Tang,Xiaojuan Qi,Yanwei Li,Yuan Zhang,Zhuotao Tian,Haoyang Huang,Nan Duan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Robotic manipulation faces, robust generalization demands, generalization demands broad, demands broad physical, Robotic manipulation
备注：
点击查看摘要
Abstract:Robotic manipulation faces a fundamental scaling challenge: robust generalization demands broad physical experience, yet action-labeled robot trajectories are expensive to collect and inherently limited in diversity. Egocentric videos offer a far more scalable source of embodied experience, capturing object interactions, contact dynamics, tool use, and long-horizon behaviors across diverse environments. The central challenge is how to convert this abundant but action-free experience into effective robot control. We introduce ZimaBlue, a scalable framework for learning generalizable World Action Models (WAMs) from large-scale video. ZimaBlue follows a three-stage training curriculum: it first performs causal embodied video pre-training on large-scale human and robot egocentric videos, then grounds the learned visual dynamics in heterogeneous robot trajectories through video-action mid-training with a unified action representation, and finally specializes the model to a target robot for deployment. To make generative WAMs practical for real-time control, ZimaBluefurther adopts an asynchronous Slow-Fast dual-system architecture, where a high-capacity Slow world model provides generalizable spatiotemporal representations and a lightweight Fast branch enables 30 Hz action prediction on NVIDIA RTX 4090. On real-robot zero-shot evaluations, scaling from target-robot data alone to over 120,000 hours of embodied video improves success from 36.1% to 77.8%. ZimaBlue further delivers strong performance across multiple benchmarks, with particularly pronounced gains on unseen tasks.
139. 【2609.00111】Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving
链接：https://arxiv.org/abs/2609.00111
作者：Xin Zhou,Zongchuang Zhao,Zhibo Yang,Mingsheng Li,Humen Zhong,Shuai Bai,Du Chu,Ruizhe Chen,Zhaohai Li,Jun Tang,Qiuyue Wang,Mingkun Yang,Jiazhao Zhang,Dayiheng Liu,Dingkang Liang,Xiang Bai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision-language foundation model, initial step, foundation model, pretrained vision-language model, vision-language foundation
备注： Code will be available at [this https URL](https://github.com/QwenLM/Qwen-Drive-1.0)
点击查看摘要
Abstract:We present Qwen-Drive-1.0, an initial step towards a vision-language foundation model for autonomous driving. Qwen-Drive-1.0 retains the architecture of the pretrained vision-language model (VLM) and integrates 3D perception, visual question answering, and motion planning within a unified framework. An external bird's-eye-view (BEV) perception head jointly performs 3D object detection, semantic occupancy prediction, and BEV map segmentation. It serves as a probe of the 3D information accessible from the shared representations and provides an explicit, inspectable interface to 3D scene structure. A Planning Expert conditions on shared VLM representations to generate future ego trajectories. A staged training recipe combines driving supervision with general-purpose vision-language data to acquire driving-specific competence while helping preserve broad visual understanding and instruction-following capabilities. Experiments demonstrate strong 3D perception and driving scene understanding while largely preserving general vision-language capability. Comprehensive evaluations across open-loop, pseudo-closed-loop, and closed-loop settings further show highly competitive motion-planning performance.
140. 【2609.00061】ReNFT: Repairing Mode Collapse in Reward Post-Training via Internal Probability-Mass Recalibration
链接：https://arxiv.org/abs/2609.00061
作者：Yuchen Bao,Chao Wen,Haowei Wang,Ruoxin Chen,Donghao Luo,Jiahui Zhan,Wenjian Huang,Shen Chen,Yiting Wang,Taiping Yao,Chengjie Wang,Shouhong Ding,Jianguo Zhang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：erases within-prompt diversity, inevitably concentrates probability, diffusion generators inevitably, generators inevitably concentrates, concentrates probability mass
备注： 17 pages, 13 figures, 4 tables
点击查看摘要
Abstract:Reward post-training of diffusion generators inevitably concentrates probability mass on a few reward-favored modes, a mode collapse that erases within-prompt diversity. Existing methods for mitigating collapse rely on external signals or interfaces, augmenting the reward with perceptual objectives, adjusting reference regularization, or modifying the text encoder, but none repairs an adapter that has already collapsed while preserving the acquired reward. We observe that online post-training primarily reallocates probability mass over capabilities inherited from pretraining rather than learning new visual content. Collapse is therefore suppression, not deletion, and can be reversed from within the generator. We propose ReNFT, which repairs a high-reward, low-diversity adapter through internal probability-mass recalibration. Unconditional probes first prioritize "anti-hub" prompts where the prompt-independent bias is easiest to expose. Two policy-dominated mixed routes then generate matched counterfactual proposals from the same prompt and initial noise, one probing the frozen base direction for suppressed alternatives and the other exposing the post-trained unconditional tendency. Reward ranking with an adaptive flipping guard assigns pull and push roles, and a joint-and-paired NFT update realizes the repair. On PickScore and GenEval, ReNFT retains 98.9% and 99.0% of NFT's reward while improving DreamSim-Div by 58.8% and 55.0%, respectively, offering a complementary alternative to external interventions.
141. 【2609.00036】A Cone-Constrained Bilinear Decomposition for Total Scaled-Gradient Variation Models
链接：https://arxiv.org/abs/2609.00036
作者：Haibin Su,Chunlin Wu,Huibin Chang,Zhifang Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：total scaled-gradient variation, scaled-gradient variation, piecewise-linear structures, total scaled-gradient, modeling of piecewise-linear
备注：
点击查看摘要
Abstract:The total scaled-gradient variation (TSGV) regularizer, derived from sparse modeling of piecewise-linear structures, has been shown to preserve edges and corners in image restoration. However, its highly nonconvex and nonlinear nature poses severe computational challenges, as existing methods often suffer from parameter sensitivity or lack convergence guarantees. To overcome this, we propose a tailored bilinear decomposition that decouples the nonlinear weighted gradient in the TSGV regularizer. This approach yields an equivalent optimization problem governed by cone or sphere constraints, depending on the chosen scaling function. In particular, the cone constraint plays a central role in characterizing edge- and corner-preserving behavior. We solve this reformulation using the alternating minimization method (AMM) equipped with a majorization--minimization strategy, ensuring a monotonic decrease in energy without step-size tuning. Furthermore, we provide a geometric interpretation of the edge-preserving properties of these constraints by analyzing their asymptotic behavior near image singularities. We establish the global convergence of the proposed method to a critical point within the Kurdyka--Łojasiewicz framework. Extensive numerical experiments on Gaussian denoising and non-line-of-sight (NLOS) imaging show that the proposed method achieves PSNR and SSIM competitive with or superior to representative variational methods, especially at high noise levels, and improves the structural reconstruction under dense and sparse scanning.
142. 【2609.00028】UI-Venus-2 Technical Report
链接：https://arxiv.org/abs/2609.00028
作者：Venus Team,Zhuohan Cai,Haoxing Chen,Jiaxuan Chen,Weizhi Chen,Changlong Gao,Zhangxuan Gu,Yuan Guo,Yusong Hu,Jianrong Jiang,Jianguo Li,Runze Li,Jinzhen Lin,Zhenyu Ma,Changhua Meng,Han Peng,Xinyu Qiu,Shuheng Shen,Zhongyi Shui,Weiqiang Wang,Ming Wen,Zhuoer Xu,Hang Yan,Kaiwen Yang,Ruilin Yao,Nanjun Yu,Zhengwen Zeng,Lianrui Zhang,Yunzhu Zhang,Zhe Zhao,Beitong Zhou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal GUI agents, remains challenging due, brittle task construction, unreliable reward verification, digital task automation
备注：
点击查看摘要
Abstract:Multimodal GUI agents have emerged as a promising paradigm for digital task automation, yet transitioning from benchmark-oriented models to dependable real-world applications remains challenging due to limited environment coverage, brittle task construction, and unreliable reward verification. In this work, we present UI-Venus-2, a general-purpose foundation GUI agent designed to operate across mobile, web, and desktop environments through a unified closed-loop reasoning-action framework. To bridge the gap toward practical deployment, we jointly scale three critical dimensions: (1) Environments, expanding coverage to more than 170 multilingual mobile apps and native desktop operating systems; (2) Tasks, employing a deep-research pipeline for function-grounded instruction generation; and (3) Verification, adopting trace-level and sample-level evaluators with visual keypoints and multi-model voting to ensure reliable RL signals for training. Furthermore, we integrate safety-aware mechanisms to ensure controlled execution of consequential actions. By offering a capable, efficient, and open-source foundation, UI-Venus-2 advances the field toward more generalizable, verifiable, and self-reflective agents for real-world applications.
143. 【2609.00018】SCAFFOLD: A Large-Scale Structured Dataset of Computer Science Research Figures with Diagram QA and Chain-of-Thought Reasoning Traces
链接：https://arxiv.org/abs/2609.00018
作者：Ranjit Raut,Aarav Subedi,Sagun Rai,Sudan Jha
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：papers rely heavily, architecture drawings, system flowcharts, Computer science papers, Computer science
备注： 9 pages, 3 figures
点击查看摘要
Abstract:Computer science papers rely heavily on diagrams: architecture drawings, system flowcharts, and pipeline schematics that often carry more information than the text around them. There is currently no public dataset that pairs this specific kind of figure with captions, context, questions, answers, and step-by-step reasoning, which is exactly what is needed to train a vision-language model to understand them. We present \textbf{SCAFFOLD}\footnote{this https URL}, a large-scale structured dataset of computer science research figures with diagram QA and Chain-of-Thought reasoning traces. This dataset consists of (image, caption, context, question-answer, chain-of-thought) tuples from arXiv computer science papers prepared using layout detection and PDF parsing, with an AI-assisted question-generation step. The resulting large-sized SCAFFOLD-157K dataset spans 3,058 papers with 29,887 figures (157,387 pairs), a medium-sized SCAFFOLD-37K dataset (36,797 pairs), and a small-sized SCAFFOLD-12K dataset (12,000 pairs). We used SCAFFOLD-12K for baseline experiments on Qwen2.5-VL-3B-Instruct.
144. 【2608.15411】A survey of AI-generated voices and their detection
链接：https://arxiv.org/abs/2608.15411
作者：Chengzhe Sun,Tianle Yang,Siwei Lyu
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：generate highly realistic, highly realistic human, realistic human voices, artificial intelligence, models to generate
备注：
点击查看摘要
Abstract:The ability of artificial intelligence (AI) models to generate highly realistic human voices has advanced rapidly. These technologies power accessibility tools, virtual assistants and creative applications, but they also enable harmful uses, including impersonation, fraud and disinformation. Recent incidents of voice cloning scams targeting businesses and political leaders underscore the urgent need for robust safeguards. Unlike image and video deepfakes, the detection of synthetic voices poses unique challenges due to the complexity of phonetics, prosody and auditory perception. This survey offers a comprehensive overview of AI voice generation and detection methods, encompassing both the technical foundations and the latest state-of-the-art advances. This study also identifies key open challenges, benchmark resources and future directions to make this survey useful for future researchers.
145. 【2609.01514】A Sensor-Adaptive Incremental Learning Framework for Artifact Detection in Satellite Precipitation Data
链接：https://arxiv.org/abs/2609.01514
作者：Andres F. Monsalve,Hernan A. Moreno,Christian D. Kummerow
类目：Atmospheric and Oceanic Physics (physics.ao-ph); Computer Vision and Pattern Recognition (cs.CV); Applications (stat.AP)
关键词：Sensor Microwave Imager, Special Sensor Microwave, retrieving rainfall data, space agencies, domain of space
备注： 16 pages. Submitted to IEEE Transactions on Geoscience and Remote Sensing
点击查看摘要
Abstract:Historically, retrieving rainfall data from satellite imagery has been the domain of space agencies. However, in recent years, the development of cheaper, more compact satellites (SmallSats) capable of detecting rainfall proxies has led to a significant increase in private-sector initiatives for satellite launch and surface precipitation products. This rapid growth has yet to be matched by data validation efforts. Consequently, the need for a robust tool to detect anomalies in near-real-time data before it is disseminated to the public has become critical. In this paper, we present the development of an anomaly-detection system to identify artifacts in global satellite-based rainfall products. The developed framework leverages pre-trained computer vision models and incorporates scarce human-labeled data to detect specific anomalies. Our proposed anomaly detection strategy is tested on data from the Special Sensor Microwave Imager (SSMI) and the Special Sensor Microwave Imager/Sounder (SSMIS). Results demonstrate the efficacy of our approach at separating regular orbits from artifact-containing orbits for each satellite, with performance comparable to state-of-the-art in-place methods. Additionally, the framework offers explainability and the capacity for iterative refinement following false-positive or false-negative classifications.
146. 【2609.01310】GazeRefine: Expert Gaze as a Test-Time Prompt for Training-Free Medical Image Segmentation
链接：https://arxiv.org/abs/2609.01310
作者：Mohammed Oussama Benyahia,Marouane Tliba,Mohamed Amine Kerkouri,Taifour Yousra,Bin Wang,Max Bengtsson,Gorkem Durak,Elif Keles,Zuheng Ming,Marek Penhaker,Azeddine Beghdadi,Ulas Bagci,Aladine Chetouani
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词：dense expert annotations, Medical image segmentation, Medical image, high-performing methods typically, methods typically rely
备注： 9 pages, 5 figures. Accepted at MICCAI Workshop 2026
点击查看摘要
Abstract:Medical image segmentation remains difficult to scale because high-performing methods typically rely on dense expert annotations and task-specific training. We introduce GazeRefine, a training-free framework that uses gaze as an inference-time prompt for zero-shot medical image segmentation. Sparse, duration-weighted fixations are converted into foreground and background priors that initialize semantic prototypes in frozen DINOv3 feature space. These prototypes are iteratively refined through foreground-background discrimination, feature-space affinity propagation, and anchoring to the initial gaze guidance, allowing segmentation to extend beyond directly fixated regions while limiting semantic drift. GazeRefine requires no segmentation masks, fine-tuning, adapters, prompt encoders, or gradient updates. We evaluate the method on gaze-annotated polyp segmentation and prostate MRI segmentation. The results show strong performance on colonoscopy images and competitive performance on prostate MRI, supporting gaze-guided prototype refinement as a promising approach for segmentation-label-efficient, human-in-the-loop medical image segmentation. Our tools and code can be found in the following repository: this https URL
147. 【2609.01060】Lightweight Interpretable RGB-Guided Hyperspectral Super-Resolution under Real Cross-resolution Misalignment
链接：https://arxiv.org/abs/2609.01060
作者：Mohamad Jouni,Aurélien Godet,Mauro Dalla Mura
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Compact snapshot hyperspectral, standard RGB cameras, cameras provide rich, ground-level machine vision, provide rich instantaneous
备注：
点击查看摘要
Abstract:Compact snapshot hyperspectral cameras provide rich instantaneous spectral measurements for ground-level machine vision, but at lower spatial resolution than standard RGB cameras. RGB-guided hyperspectral super-resolution (HSR) addresses this limitation by transferring spatial detail from a high-resolution RGB guide to a low-resolution hyperspectral image (HSI). These dual-camera systems are typically in a horizontal rig geometry, requiring cross-camera image alignment due to different fields of view. However, residual misregistration can inject spurious high-frequency details. Existing learned unaligned-fusion methods are usually trained for a fixed spectral support and spatial scale factors and can be computationally demanding, limiting their flexibility across sensors. We propose a lightweight and interpretable RGB-guided HSR framework combining cross-modal flow alignment with model-based Gram-Schmidt orthogonalization fusion. The method first warps the RGB guide onto the HSI grid, then estimates an energy-based confidence weight map by measuring local alignment reliability. This map is then used both in a weighted least-squares spectral regression and in a gated fusion between the super-resolved estimate and an HSI-preserving estimate. Unlike existing learned methods, the proposed framework has a low computational footprint and supports VIS-NIR spectral supports and scale factors without retraining. Experiments on the Real benchmark show that the proposed method improves reconstruction accuracy over learned fusion baselines while remaining substantially faster. On a 34-frame sequence acquired with our real RGB-HSI dual-camera setup, a reduced-resolution quantitative evaluation validates the method under genuine cross-sensor radiometric, noise, and geometric differences, while native-resolution qualitative results demonstrate deployment on the full 51-band VIS-NIR acquisition.
148. 【2609.01018】PyDoseRT Proton: A GPU Pencil-Beam Engine with a Convolutional Residual-Correction Network for Fast Proton Dose Calculation
链接：https://arxiv.org/abs/2609.01018
作者：Lukas Zimmermann,Hermann Fuchs,Attila Simkó,Gerd Heilemann
类目：Medical Physics (physics.med-ph); Computer Vision and Pattern Recognition (cs.CV)
关键词：Architecture category, Architecture, convolutional residual-correction network, Monte Carlo, physics-based analytical pencil-beam
备注： DoseRAD 2026 report - Team DoseHappens
点击查看摘要
Abstract:Architecture category. Hybrid method: a physics-based analytical pencil-beam (PB) dose engine followed by a 3-D convolutional residual-correction network (RepVGG-U-Net). We addressed the DoseRAD2026 proton dose-prediction task with PyDoseRT Proton, a GPU-accelerated engine implemented in PyTorch and augmented by a learned residual toward Monte Carlo (MC) accuracy. A double-Gaussian PB kernel was calibrated to GATE/Geant4 integrated depth doses in water in two stages: a classical per-energy curve fit, then a gradient-based fit of the full 3-D dose through the PyTorch physics engine as it retains a differentiable execution path for gradient-based optimization of dose-dependent objectives. The engine computes each beamlet on a beam's-eye-view (BEV) lattice with variance-preserving Gaussian splitting, an analytic nuclear halo, and a Fermi-Eyges heterogeneity term, then rotates the result into the patient frame. Additionally, a compact residual U-Net predicts an additive correction in BEV space. It is conditioned on voxelwise material-label embeddings, a discrete energy embedding and spot size. The same model was used for all anatomical sites (thoracic and abdominal). It was trained with a patient-space L1 objective emphasizing the scored high-dose region and multi-scale BEV deep supervision. The submitted CT configuration obtained preliminary-test beamlet MAE 0.0066, image-z IDD distance 0.0025, plan MAE 0.0049, 98.30\% gamma pass rate (1\%/1 mm), and DVH error 0.460.
149. 【2609.00981】Prior-Guided Implicit Neural Representations for Single-Subject Diffusion MRI Super-Resolution
链接：https://arxiv.org/abs/2609.00981
作者：Abdulkader Ghandoura,Marsil Zakour,William Consagra,Yogesh Rathi
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Resolving complex fiber, complex fiber geometries, brain white matter, white matter requires, Resolving complex
备注： Accepted at the British Machine Vision Conference (BMVC) 2026. 16 pages, 5 figures, 2 tables. Project page: [this https URL](https://abdulkaderghandoura.github.io/research/msc-thesis/)
点击查看摘要
Abstract:Resolving complex fiber geometries in brain white matter requires high-resolution diffusion MRI at the cost of long acquisition times. This leads many clinical protocols to opt for low-resolution scans, making downstream microstructure estimation and tractography challenging. Implicit neural representations (INRs) can model the diffusion signal continuously, enabling native single-subject super-resolution by querying the network at arbitrary spatial coordinates, yet existing methods often suffer from long training times and lack a mechanism to incorporate anatomical priors to regularize super-resolution by constraining the space of plausible reconstructions. To address these limitations, we propose a novel transfer-learning framework that pre-trains an INR on a high-resolution template and then adapts it to subject-specific scans via registration and fine-tuning. For $4\times$ through-plane super-resolution from 5 mm to 1.25 mm on Human Connectome Project (HCP) data, our method reduces NRMSE by 36-49% and increases FSIM by 24-43% over a recent baseline with $6\times$ faster training, outperforming competing INR-based methods across both image quality and domain-specific metrics. Code is available on the project page at this https URL .
150. 【2609.00870】Stochastic Optimization of Tree Tensor Networks
链接：https://arxiv.org/abs/2609.00870
作者：Marius Willner,Maximilian Scharf,André Uschmajew,Timo Felser,Marco Trenti
类目：Optimization and Control (math.OC); Computer Vision and Pattern Recognition (cs.CV); Computational Physics (physics.comp-ph)
关键词：quantum many-body physics, tree tensor networks, Tensor networks, originally developed, many-body physics
备注： 26 pages, 12 figures, 5 pseudo-code algorithms
点击查看摘要
Abstract:Tensor networks, originally developed for quantum many-body physics, are promising models for machine learning. We derive stochastic Riemannian optimizers for tree tensor networks (TTNs) on both their parameter and quotient manifolds, including adaptive and learning-rate-free schemes suitable for minibatch training. Using a hybrid CNN-TTN architecture, we evaluate the methods on Fashion-MNIST, CIFAR10, and Imagenette. The proposed optimizers achieve predictive performance comparable to unconstrained optimization while enabling numerically stable downstream compression.
151. 【2609.00611】Panda Diplomacy: Foundation Model Pre-training across Particle Imaging Detectors for High Energy and Nuclear Physics
链接：https://arxiv.org/abs/2609.00611
作者：Samuel Young,César Jesús-Valls,Kazuhiro Terao
类目：High Energy Physics - Experiment (hep-ex); Computer Vision and Pattern Recognition (cs.CV)
关键词：existing approaches remain, approaches remain strongly, remain strongly tied, Foundation models, nuclear physics
备注： 24 pages, 11 figures, preprint
点击查看摘要
Abstract:Foundation models are increasingly being pursued in particle and nuclear physics, but existing approaches remain strongly tied to individual experiments through detector-specific architectures or pre-training objectives, limiting their reuse across sensing modalities. We show that a point cloud self-distillation framework yields a substantially more general sensor-level pre-training recipe. We show that the same refined architecture and objective can be independently pre-trained with minimal changes on three qualitatively different detector modalities: liquid argon time projection chamber (LArTPC), collider TPC, and water Cherenkov. Using 1,000 labeled images for downstream task adaptation, Panda V2 matches or exceeds specialized foundation-model baselines trained with orders of magnitude more supervision, matching state-of-the-art particle-clustering performance with 70x fewer labeled events on sPHENIX while substantially improving particle identification, and on LArTPC data matching Panda (arXiv:2512.01324) particle reconstruction with up to 1,000x fewer labels. Beyond reconstruction, simple linear probes reveal physically meaningful latent structure associated with particle causality and track curvature.
152. 【2609.00473】Expert-like Bone Ultrasound Segmentation through Expert-in-the-loop Mask-conditioned Progressive Learning
链接：https://arxiv.org/abs/2609.00473
作者：Arash Tavangar,Larissa K. Chiu,Hamidreza Khodashenas,Gregory K. Berry,Amir Hooshiar
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Manual annotation remains, delineating precise contours, iteratively refine rough, typically iteratively refine, experts typically iteratively
备注：
点击查看摘要
Abstract:Manual annotation remains a major bottleneck in ultrasound (US) bone segmentation, where experts typically iteratively refine rough brush masks rather than delineating precise contours in a single pass. We present ExiL, a mask-conditioned progressive learning framework that models annotation as a structured refinement trajectory. ExiL combines a synthetic expert-like brush simulator based on signed distance fields with a lightweight 7.8M-parameter U-Net that learns to complete and refine imperfect masks from US images. During deployment, an expert mode updates the model directly from accepted refinements, enabling continual adaptation to expert behavior. Evaluated using UltraBones100k cadaver data for quantitative segmentation and a prospective volunteer dataset for annotation-efficiency analysis, ExiL reduced single-expert average annotation time from 60 to 20 seconds per frame (66.7\%) and improved mean Dice by approximately 0.045 over non-progressive training, while achieving 0.87 Dice and 2.7 px boundary error in the best trajectory-aware setting. With 10--50 ms inference, ExiL enables real-time, self-improving annotation for US-guided orthopedic workflows in practical clinical labeling.
