本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新639篇论文，其中：
- 自然语言处理99篇
- 信息检索20篇
- 计算机视觉110篇
自然语言处理
1. 【2609.05405】WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data
链接：https://arxiv.org/abs/2609.05405
作者：Ji Soo Lee,Xilun Chen,Pierce Chuang,Ashish Shenoy,Jason Wei,Dohwan Ko,Hyunwoo J. Kim,Benoit Corda
类目：Computation and Language (cs.CL)
关键词：Recent advances, existing benchmarks rarely, sensing enable continuous, enable continuous monitoring, continuous monitoring
备注：
点击查看摘要
Abstract:Recent advances in wearable sensing enable continuous monitoring of physiological and behavioral signals, yet existing benchmarks rarely evaluate whether AI systems can reason over a real user's longitudinal wearable record. We introduce WearableQA, a benchmark comprising 4,084 10-option multiple-choice questions constructed from the wearable time series, blood biomarkers, and demographics of 200 real users, each with up to 500 days of daily measurements. WearableQA preserves authentic wearable distributions that include device noise and inter-individual variability. To evaluate distinct reasoning capabilities, we introduce 16 question types organized along two complementary axes: data versus health reasoning, which distinguishes computation over longitudinal measurements from physiological interpretation; and single- versus cross-signal reasoning, which separates reasoning about individual signals from the integration of multiple signals. To construct reliable questions at scale, we adopt a dual-grounding framework that combines literature-grounded physiological findings with statistically validated population-grounded physiological patterns. This enables the capture of meaningful relationships observed in real-world wearable data. Evaluation of 14 proprietary and open-source LLMs demonstrates that WearableQA effectively differentiates model capabilities, with performance ranging from 19.6% to 72.9% against a 10% chance baseline. Moreover, WearableQA remains far from solved: most models achieve accuracies below 60%. Overall, WearableQA provides a realistic and diagnostic benchmark for evaluating LLM reasoning over real-world wearable data.
2. 【2609.05401】Same Trajectory, Contradictory Rewards (ROBORMBENCH): Paraphrase Fragility in Vision Language Reward Models
链接：https://arxiv.org/abs/2609.05401
作者：Wonje Jeung,Sangyeon Yoon,Hyesoo Hong,Yoonjun Cho,Dongjae Jeon,Bumjun Kim,Jean Oh,Youngjae Yu,Albert No
类目：Robotics (cs.RO); Computation and Language (cs.CL)
关键词：equivalent goal descriptions, semantically equivalent goal, requires paraphrase invariance, role requires paraphrase, Vision-language models
备注：
点击查看摘要
Abstract:Vision-language models are increasingly used as reward functions for robotic learning, but this role requires paraphrase invariance: the same trajectory should receive the same reward under semantically equivalent goal descriptions. We show that current VLM reward models often violate this property. Paraphrasing the instruction alone can substantially change predicted progress scores, and can even flip identical robot behavior between failure and success. To measure this failure mode, we introduce ROBORMBENCH, a benchmark with 2,390 real-robot trajectories, ground-truth progress labels, and 21,673 verified paraphrases spanning lexical, syntactic, and action-goal rewrites. Across proprietary and open-source VLMs, paraphrase-induced instability is widespread and severe, grows under more divergent rewrites, and is not reliably reduced by scale or explicit reasoning. Dedicated reward models trained with trajectory-grounded supervision are substantially more stable. These results show that paraphrase robustness is a core requirement for reliable VLM-based reward modeling in robotics.
3. 【2609.05395】Multi-Step Tool-Calling over Korean Open Public APIs: A Benchmark and a Data-Synthesis Recipe
链接：https://arxiv.org/abs/2609.05395
作者：Dain Kim,Eungi Cho,Kyumin Kim,Shinyeong Noh,Kyuseong Lim
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：on-premise LLM agents, Data-sovereignty regulations increasingly, regulations increasingly require, chain multiple tool-calls, increasingly require public
备注： 30 pages, 7 figures, 26 tables. Accepted to EMNLP 2026 Industry Track
点击查看摘要
Abstract:Data-sovereignty regulations increasingly require public institutions to deploy open-source, on-premise LLM agents that chain multiple tool-calls across live government APIs. However, open-source models consistently underperform in this multi-step setting, and no existing benchmark measures the gap. We introduce the Korean Open Public API Benchmark (KOPA-Bench), comprising 145 real-world tasks. To close this gap, we present EDGE, an Execution-grounded Dynamic Graph for tool-calling data synthEsis driven by live execution. EDGE builds a graph of how each tool's output can feed another's input, keeps only the links that succeed when actually called against the live APIs, and traverses these verified links to synthesize executable multi-step trajectories. Fine-tuned via GRPO on the resulting dataset, our 9B model nearly matches the untuned 27B model from the same family, improving substantially not only on KOPA-Bench but also on the BFCL benchmark.
4. 【2609.05339】Does Your Agent's Memory Survive a Model Upgrade? A Controlled Study of Memory Portability
链接：https://arxiv.org/abs/2609.05339
作者：Ankit Goyal,Jaideep Ray
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：upgrades are routine, notes, Model upgrades, Model, memory
备注： 18 pages, 3 figures, 7 tables, under review
点击查看摘要
Abstract:Model upgrades are routine; memory migrations are not. An agent can keep the same memory store and still forget: a new model may interpret old notes differently, mixed embedding versions may break retrieval, and repair may fail without the original evidence. We compare memory as the same history is preserved verbatim for long-context reading (LC-RAW), divided into chunks for retrieval-augmented generation (RAG), compressed by a model into natural-language notes (NOTES), or normalized into a fixed-schema knowledge graph (KG-fixed). The study uses 48 synthetic histories with randomized answer codes, exact scoring, and two open-weight models with sub 10 billion parameters. Our measurements show that fixed-schema structures transfer reliably, with KG-fixed accuracy changing by only $+0.0004 \pm 0.0020$ following a writer swap. Conversely, compressed NOTES exhibit high model coupling, with accuracy shifting asymmetrically by $+9.91$ or $-13.28$ percentage points depending on the specific migration direction. In RAG systems, partial embedding migrations using a 50/50 mixed index capture only a 4.96-point accuracy improvement, forfeiting the majority of the 11.90-point gain achieved through full re-embedding. Diagnostic decomposition attributes 80% ($0.467 \pm 0.014$) of the NOTES accuracy deficit to information lost during initial construction, whereas retrieval failures drive 81% ($0.364 \pm 0.012$) of the RAG deficit. Finally, store-only repair of NOTES fails to reach a 90% performance recovery target in all 48 test cases, whereas retaining the raw source history enables successful recovery in 34 of 48 cases for one tested direction. These findings highlight the necessity of direction-specific migration testing, strict embedding space isolation, and the retention of source histories for memory repair.
Comments:
18 pages, 3 figures, 7 tables, under review
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
ACMclasses:
I.2.7; I.2.11; H.3.3
Cite as:
arXiv:2609.05339 [cs.AI]
(or
arXiv:2609.05339v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.05339
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
5. 【2609.05333】chnical Manual for a Toolkit for Measuring Contextual Individuation in Transformer Language Models
链接：https://arxiv.org/abs/2609.05333
作者：José Luciano Verçosa Marques,Frederico Jorge Heitmann,Daniel Omar Perez,Marcelo Vinicius de Paula,Tárcio André dos Santos Barros
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：transformer language model, language model assigns, embedding layer, context-independent vector, transformer language
备注： 29 pages, 2 figures (one with 2 subfigures), 1 table. Toolkit, source code, and corpora archived separately on Zenodo (see Section 9)
点击查看摘要
Abstract:A transformer language model assigns a single, context-independent vector to a word type at its embedding layer, yet is widely believed to individuate that word's occurrences by context in its later layers. Testing this belief cleanly requires a construct that holds the word form fixed while its context and intended sense vary in a controlled, labeled way. This manual documents an open toolkit built around such a construct, which we call a bridge form: a single written word that recurs, unchanged, across two or more subject domains with a different sense in each. We describe, and justify, every stage of the pipeline: the declarative specification of bridge forms and their source domains, corpus acquisition from Wikipedia, occurrence localization, layer-wise representation extraction, a domain-pairwise silhouette measurement of separation in the model's representation space, and a paired visualization protocol. Each design choice is presented together with the methodological failure mode it is meant to avoid (sense contamination from overly broad category labels, the multi-group bias of the silhouette coefficient, subword-tokenization misalignment, and axis-comparability artifacts in dimensionality-reduced plots, among others). This manuscript is a methodological and implementation reference: it does not report or interpret empirical outcomes of running the toolkit on any particular model or bridge-form set. The toolkit, its full source, and the corpora used to exercise it are archived separately (Section 9) under a persistent identifier, and are intended to be cited as an instrument by studies that use it to produce and interpret empirical results.
6. 【2609.05314】Large Language Models for HVAC Operations in Building Energy Systems: A Critical Review of Methods, Applications, and Deployment Readiness
链接：https://arxiv.org/abs/2609.05314
作者：Alexander Neubauer,Tianzhen Hong,Han Li,Mengbo Yu,Amin Darbandi,Yannick Fürst,Martin Kriegel
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Systems and Control (eess.SY)
关键词：heterogeneous point naming, automation systems generate, systems generate rich, generate rich sensor, rich sensor data
备注： 38 pages, 9 figures, 16 tables. Submitted to Energy and Buildings
点击查看摘要
Abstract:Building automation systems generate rich sensor data yet remain insight-poor because heterogeneous point naming, missing metadata, and fragmented documentation obstruct their operational use. This systematic review analyses and codes 66 peer-reviewed studies on large language models (LLMs) for HVAC operations published between 2023 and March 2026. Each study is classified across five application families and three LLM method families and assessed for evidence realism, deployment readiness, and the responsibility boundary between the LLM and physical HVAC decisions. The corpus is concentrated in building energy modelling (BEM, 32 of 66 papers), while load forecasting remains too sparse for subfield-level conclusions. Only four studies reach pilot-level evidence, and none reports sustained operational deployment. No study was classified as ready-now for industry adoption; three were near-term and 63 research-only. Nevertheless, several bounded, human-in-the-loop uses merit near-term trials, including point-name normalisation, document-grounded operator support, BEM workflow assistance, and advisory interfaces around physics-based controllers. Conventional machine learning (ML), model predictive control (MPC), reinforcement learning (RL) and ontology-based tools remain more adopted for high-frequency control, short-horizon numerical forecasting, and well-posed ontology mapping, while autonomous agentic operation and unvalidated occupant proxies remain research-stage. Current evidence therefore supports LLMs primarily as semantic and workflow layers rather than autonomous HVAC controllers. Future work should prioritise field-validated benchmarks, orchestration evaluation under operational constraints, and LLM-MPC/RL architectures with bounded latency and verifiable safety properties.
7. 【2609.05296】LexFlip: A Dissociation Diagnostic for Legal Meaning Preservation Metrics
链接：https://arxiv.org/abs/2609.05296
作者：Gaurab Baral
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：simplified legal clause, legal force, simplified legal, legal clause, legal force moves
备注： 6 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Does a simplified legal clause still say what the original said? The checks in current use cannot establish that it does: requiring an identical pair to score highest and an unrelated pair lowest moves lexical overlap and legal force together, so any monotone function of token overlap satisfies both. Our remedy is a dissociation, an item holding surface form fixed while legal force moves. We release LexFlip, 373 minimal perturbations of Quebec statutory French that reverse legal force while preserving 0.93 of the tokens, with a harness scoring metrics, regressors and prompted judges alike. The seven embedding and BERTScore metrics we test spend only 0.022 to 0.039 of their identical-to-unrelated range on such an edit, against 0.670 for bidirectional NLI, the one family the identical-pair check would disqualify. On FrJudge, against a measured human ceiling of r=0.597, a bare length feature outscores every semantic metric and has the lowest margin we measure.
8. 【2609.05262】Self-Supervised Lexical Representation Learning for Fast, Large-Scale Phylogenetic Inference
链接：https://arxiv.org/abs/2609.05262
作者：Tim Wientzek
类目：Computation and Language (cs.CL)
关键词：substantial computational cost, scale remains constrained, labor-intensive manual annotation, cognacy judgments required, global scale remains
备注： 27 pages, 3 figures
点击查看摘要
Abstract:Computational phylogenetics has become an essential tool in historical linguistics, yet its application at a global scale remains constrained by two factors: the labor-intensive manual annotation of cognacy judgments required for character-based methods and the substantial computational cost of inference on large datasets. This paper introduces a fully self-supervised contrastive learning framework that learns lexical representations directly from raw IPA-transcribed wordlists, without requiring cognacy annotations, alignments, or additional expert input. The model employs a dual contrastive objective: a word-level loss that organizes phonetically similar forms into a coherent space, and an auxiliary language-level loss that encourages the lexical space to reflect broader phonological properties of languages. From the resulting word representations, pairwise language distances are derived and used to infer a global phylogenetic tree of 3,399 language varieties. The inferred tree achieves a generalized quartet distance (GQD) to the Glottolog reference tree competitive with multiple baselines, while requiring only minutes of computation on a standard notebook GPU. Furthermore, the same representations capture diachronic concept stability: variance in pairwise distances across languages yields stability rankings that correlate significantly with established rankings. Ablation studies confirm that both the language-level objective and the use of phonetic feature vectors improved the inferred trees topology with regards to GQD. The framework thus provides a computationally efficient and fully automatic alternative for large-scale phylogenetic inference and offers a unified representation supporting downstream analyses at both the language and concept level.
9. 【2609.05221】A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR
链接：https://arxiv.org/abs/2609.05221
作者：Thi Kim Trang Vo,Nam Tien Le,Thi Kim Nguyet Vo,Minh Khang Tran,Duy Phuong Tran
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large language models, Large language, show strong reasoning, strong reasoning ability, weakly grounded
备注：
点击查看摘要
Abstract:Large language models (LLMs) show strong reasoning ability, but their explanations can remain inconsistent, weakly grounded, or difficult to verify. We propose a verifier-guided explainable reasoning framework for transparent educational question answering that combines gold-anchored QLoRA, task-aware symbolic routing, and group-relative RLVR. Qwen2.5-3B-Instruct is first adapted with field-weighted QLoRA supervision anchored to authoritative answers. A lightweight router then assigns logic problems to a FOL/Z3 verifier and physics problems to a formula- and unit aware symbolic solver. Verifier feedback is further used to support candidate evaluation, self-revision, and reward construction during RLVR. Candidate responses are evaluated along three complementary dimensions: P1 for answer correctness, P2 for evidence or unit consistency, and P3 for reasoning depth and explainability. At inference, gold-free self-consistency aggregates multiple candidate responses before an optional question-only physics verifier performs conservative system-level correction. On 438 held-out examples, RLVR increases P3 from 50.68% to 72.20%, while hybrid P1 remains approximately stable at 55.94%. Self-consistency improves model only P1 from 48.86% to 50.23%, with symbolic verification providing the remaining hybrid gain. These results indicate that RLVR primarily strengthens explicit reasoning structure, while symbolic verification complements the neural policy by improving answer reliability at the system level.
10. 【2609.05189】Can Large Language Models Anticipate Behavioral Responses to Social Policies? A Case of Pension Enrollment Prediction among China's Flexible Workers
链接：https://arxiv.org/abs/2609.05189
作者：Yumiao Li,Peixin Liu,Donglin Di,Chen Li,Runhuan Feng
类目：Computation and Language (cs.CL)
关键词：widely acknowledged challenge, Assessing the impacts, challenge for policymakers, impacts of social, widely acknowledged
备注： 16 pages, 9 figures; includes supplementary material. Code and reproduction materials: [this https URL](https://github.com/liym22/FlexPension-LLM)
点击查看摘要
Abstract:Assessing the impacts of social policy changes is a widely acknowledged challenge for policymakers. Econometric methods can be unreliable when extrapolating to hypothetical scenarios, while field pilot programs are highly costly. In this paper, we propose using large language models (LLMs) as policy-assessment tools adapted from general-purpose models. We present FlexPension-LLM, the first domain-specialized large language model for a hierarchical pension-enrollment prediction task among flexible workers in China, and introduce DKI-RDistill, which injects policy-grounded cues into the prompt, including Probit-derived marginal effects and hukou-province pension rules. The method then uses LoRA/SFT to distill rationale-augmented supervision into an open-weight MoE student, with teacher errors corrected by regenerating those cases under ground-truth labels. On a CHFS 2019 blind split, FlexPension-LLM achieves 0.9316 Composite F1, surpassing its Claude Sonnet 4.5 teacher and 15 of 17 baselines, and is statistically indistinguishable from Claude Opus 4.6. Across four external surveys, it averages 0.7549 Composite F1 and shows the narrowest performance range among the strongest systems. Component analysis shows that gains come mainly from policy-grounded cue injection and error-filtered supervision, while rationales provide decision traces that can be checked against policy rules.
11. 【2609.05175】Measuring the Novelty of Biomedical Papers Using the Latent Distances between Knowledge Units
链接：https://arxiv.org/abs/2609.05175
作者：Yi Zhao,Heng Zhang,Yuzhuo Wang,Wenqing Wu,Tong Bao,Chengzhi Zhang
类目：Digital Libraries (cs.DL); Computation and Language (cs.CL)
关键词：scientific papers, central concern, concern in research, knowledge units, Measuring the novelty
备注：
点击查看摘要
Abstract:Measuring the novelty of scientific papers is a central concern in research evaluation and scientometrics. From a recombination perspective, prior studies have largely focused on the co-occurrence of knowledge units to assess the novelty of scientific papers. However, these studies often overlook other relationships between knowledge units. This narrow view may result in inaccurate or incomplete evaluations of novelty for scientific papers. To fill this gap, this study introduces a comprehensive novelty measurement that incorporates three types of relationships between knowledge units: network, semantic, and hierarchical. These relationships are used to quantify the latent distances among knowledge units. Using a dataset of 142,036 articles published in PLoS ONE and a validation dataset from the H1 Connect platform, our results demonstrate that (1) each relationship type captures distinct latent distances between MeSH terms; (2) compared to the widely used indicators proposed by Uzzi et al. (2013), our measures show stronger alignment with peer judgements; and (3) combining all three distance metrics yields more effective identification of novel papers than using any single perspective alone.
12. 【2609.05152】Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG
链接：https://arxiv.org/abs/2609.05152
作者：Shuyu Guo,Shuo Zhang,Zhaochun Ren
类目：Computation and Language (cs.CL)
关键词：Retrieval-Augmented Generation, enhances language models, degrades inference efficiency, uncompressed RAG, lengthy retrieved context
备注：
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) enhances language models with external knowledge, but the lengthy retrieved context inflates the input and degrades inference efficiency. Soft context compression encodes each document into a substantially shorter embedding sequence. However, most existing approaches are trained by distilling outputs from uncompressed RAG systems, inherently limiting their performance relative to the original model. To address this limitation, we propose DEX-Comp, a two-stage training recipe: Pure Distillation warm-starts the compression model on the uncompressed RAG's correct responses only, and Hard Exploration then runs reinforcement learning solely on queries the uncompressed RAG fails, forcing the model to explore computation patterns better suited to compressed representations. On five open-domain QA benchmarks at retrieval depths from top-5 to top-30, DEX-Comp compresses retrieved contexts by $16\times$ and accelerates inference by $4\times$--$24\times$, while achieving performance comparable to or exceeding the uncompressed RAG baseline across retrieval depths. Ablations and evaluations across diverse datasets and backbones further confirm the contribution of each stage and the generalization of our approach.
13. 【2609.05151】Large Language Models with At Most One Spike per Neuron
链接：https://arxiv.org/abs/2609.05151
作者：Zhuoya Zhao,Parsa Omidi,Aref Jafari,Richard Naud
类目：Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL)
关键词：sparse event-driven computation, inherent sparse event-driven, Leveraging their inherent, spiking neural networks, energy-efficient large language
备注：
点击查看摘要
Abstract:Leveraging their inherent sparse event-driven computation, spiking neural networks (SNNs) offer a promising path toward energy-efficient large language models (LLMs). Time-to-first-spike (TTFS) coding generates at most one spike per neuron within a time window, yielding extremely low firing rates. However, conventional TTFS SNNs are restricted to specific structures, making it challenging to encode certain blocks in LLM -- such as layer normalization and matrix multiplication --using TTFS. To overcome this limitation, we introduce a reference-based strategy specifically to encode the four core LLM components: embedding layers, layer normalization, attention-related operations and dropout. We construct a fully TTFS-based SNN architecture and train it end-to-end. Experiments on modern LLMs like BERT and GPT-2 demonstrate that our approach achieves performance comparable to ANN counterparts on natural language understanding and common-sense reasoning, while a clear gap remains on language modeling perplexity. To the best of our knowledge, this is the first work to scale a spiking LLM to 1.5 billion parameters using TTFS coding. We also report an estimate of spike-related energy; this is a spike-count proxy under an established cost model rather than a measurement on neuromorphic hardware.
14. 【2609.05149】From Vision to Language: Investigating Causal Information Flow in Multimodal Decision-Making
链接：https://arxiv.org/abs/2609.05149
作者：Davide Testa,Hugh Mee Wong,Alessandro Lenci,Bernardo Magnini,Albert Gatt
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：evidence requires tracing, visual evidence requires, commonly evaluated, evidence requires, requires tracing
备注： Accepted at Findings of EMNLP 2026
点击查看摘要
Abstract:Vision-Language Models are commonly evaluated through their final predictions, but understanding whether these decisions are grounded in visual evidence requires tracing how visual information contributes to language-based decisions. With this purpose in mind, we investigate cross-modal information flow in a video-based generative multiple-choice-like setting by applying a layer-wise causal intervention on video-text attention pathways. We target spatial, causal, and temporal visual reasoning. Our results show that visual information is mainly integrated while the model processes the candidate answer options, which serve as the primary textual grounding sites for the final decision. We further show that nouns play an important role as semantic anchors during multimodal enrichment, while verbs are more relevant when temporal relations are processed. Finally, we identify a distinct pattern in temporal reasoning, suggesting that VLMs struggle to reconstruct sequential information across video frames, but we remark that such fragility may also reflect linguistic biases associated with specific temporal expressions used for defining the relation between events within a scene.
15. 【2609.05143】A Human-in-the-Loop Framework for AI-Assisted Scoring in Large-Scale Writing Assessment
链接：https://arxiv.org/abs/2609.05143
作者：María Eugenia Curi,Germán Capdehourat,Isabel Amigo,Magdalena Romano,Rosana Serra,Adrián Silveira,Andrés Peri
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, artificial intelligence, integration of artificial, large language, opened new opportunities
备注： 25 pages, 8 figures
点击查看摘要
Abstract:The integration of artificial intelligence (AI), particularly large language models (LLMs), into educational assessment has opened new opportunities to enhance the efficiency and scalability of grading processes. This study presents the design and validation of an AI-assisted scoring framework for written responses in a large-scale national assessment. The proposed approach focuses on short written texts of approximately 150-200 words and incorporates a human-in-the-loop strategy to preserve assessment quality while reducing manual workload. The study is grounded in a real operational context, using data from two recent editions of a nationwide test, each comprising approximately 5,000 student responses. We analyze the alignment between AI-generated scores and human raters across multiple rubric dimensions, as well as the impact of the proposed decision flow on pass/fail outcomes. Results show moderate to high agreement between the model and human evaluations in most dimensions, supporting the feasibility of AI assistance in this setting. Moreover, the proposed correction workflow identifies cases where human review is most valuable, enabling a more efficient allocation of expert effort. The findings suggest that AI-assisted scoring can be safely integrated into large-scale assessment processes only when combined with carefully designed human oversight. The paper concludes by discussing practical implications for deployment in national assessment systems and outlining future research directions, including longitudinal monitoring of model-human alignment and the analysis of potential cognitive bias introduced by AI-supported review workflows.
16. 【2609.05139】NS-ST-GraphRAG: Neuro-Symbolic Spatio-Temporal GraphRAG for Literary Knowledge Processing
链接：https://arxiv.org/abs/2609.05139
作者：Zheng Kui Lin
类目：Computation and Language (cs.CL)
关键词：distinctive information-processing challenge, literary narratives pose, retrieval-augmented generation, distributed across chapters, relations evolve
备注： Submitted to Information Processing and Management
点击查看摘要
Abstract:Long-form literary narratives pose a distinctive information-processing challenge for retrieval-augmented generation: relevant evidence is distributed across chapters, relations evolve over narrative time, and correct answers may depend jointly on temporal, spatial, and relational constraints. We propose NS-ST-GraphRAG, a neuro-symbolic spatio-temporal GraphRAG framework that integrates ontology-guided extraction, deterministic constraint checking, dual temporal coordinates, spatial scene attributes, and dynamic sub-graph retrieval. Instead of retrieving from a single corpus-level graph, the framework selects the graph state valid for the temporal and spatial scope of a query and grounds generated answers in traceable evidence. We further introduce Red-Chamber-QA, to our knowledge the first open multi-hop question-answering benchmark for classical Chinese literature, with time-, space-, and general-question categories, per-part evidence spans, and deterministic shortcut controls. On a 120-question held-out split, NS-ST-GraphRAG achieves mechanical answer reproduction of 0.733 versus 0.675 for the frozen window baseline and 0.083 for a closed-book model (McNemar exact p = 0.092, directionally favorable but not significant); semantic-judge accuracy is 0.866 versus 0.850. The pre-specified constrained-category condition of H2 is not supported by the delivered comparison. These results show how temporal graph representation, constrained extraction, and auditable evaluation integrate into a unified framework for verifiable knowledge processing over long-form narrative.
17. 【2609.05099】Improving Language Identification for Code-Switched Utterances with Integer Linear Programming
链接：https://arxiv.org/abs/2609.05099
作者：Joanna Radoła,Josep Maria Crego,François Yvon
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Automatic identification, Language Models, utterances remains, causing such texts
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Automatic identification of code-switched (CS) utterances remains a challenge for language identification (LID) systems, causing such texts to be underrepresented in the training data of Large Language Models. In this paper, we revisit MaskLID, a state-of-the art approach for CS identification, which requires no training and detects arbitrary language combinations. We make three main contributions: (a) we reveal, and address, a major issue of MaskLID: its overreliance on word-level language association scores; (b) we reformulate the underlying optimization algorithm as an Integer Linear Program, enabling us to experiment with a large set of clear and interpretable constraints; (c) each of these improvements vastly improves the baseline system, as we illustrate in experiments involving 10~diverse languages, where we observe a strong boost in performance on CS benchmarks. We release our code and data for reproducibility.
18. 【2609.05088】Measuring AI Accountability Through Argumentation Analysis: Can Model Reasoning Withstand Scrutiny?
链接：https://arxiv.org/abs/2609.05088
作者：Daan R. Henselmans,Derck W.E. Prinzhorn,Arno Libert
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：oversight methods rely, truth for validation, behavior is contested, methods rely, oversight methods
备注： 27 pages (19 main text + appendix and references), 5 figures, 6 tables. Accepted for publication in the Paris Journal of AI and Digital Ethics (2026); presented at PCAIDE 2026
点击查看摘要
Abstract:AI oversight methods rely on ground truth for validation, but what constitutes appropriate AI behavior is contested. This leaves evaluation of moral reasoning in LLMs and debate-based oversight implicitly avoiding realistic ambiguity. We investigate an alternative standard designed to function despite such ambiguity: structural quality of the defence a model can mount for its verdicts in response to critical questions, measured through a four-phase dialectical protocol grounded in Walton's theory of argumentation schemes and Govier's criteria for argument cogency. The protocol is adaptive to different frames of reasoning, extends beyond multiple-choice framing, and treats both the reasoning that precedes a verdict and its post-hoc justification. Across nine frontier models and 200 high-ambiguity MoralChoice items -- $6,778$ judge-scored cells, validated against $89.6\%$ inter-judge agreement on the binary failure judgment -- models defend their reasoning well above the rubric minimum on every dimension. Failure mass concentrates on grounds and sufficiency, and correlates with epistemic hedging rather than argument length. Reasoning is better defended than post-hoc justification, on every model and every Govier dimension. The scheme a model presents in its justification differs from the one it reasoned with on a substantial share of dilemmas ($\geq 20\%$ per model), despite value-based practical reasoning dominating both tracks. The protocol catches strictly indefensible defences (self-contradiction, false premises), and it surfaces difficulties in characterizing the role of retraction in AI alignment, suggesting a need for more situated evaluations.
19. 【2609.05079】ruthInsightBench: An Evidence-Grounded Benchmark for Automated Evaluation of Open-Ended Scientific Discovery Agents
链接：https://arxiv.org/abs/2609.05079
作者：Zhibo Yang,Chen Zhang,Yuewei Zhang,Hao Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：write research reports, Autonomous coding agents, research reports, Autonomous coding, increasingly proposed
备注： 27 pages, 7 tables, 5 figures
点击查看摘要
Abstract:Autonomous coding agents are increasingly proposed as AI-scientist systems that conduct analyses and write research reports, but executing a prescribed analysis is not the same as making a discovery. Existing benchmarks are configured for reproduction: tasks, data, and rubrics are built around a hidden target study, and recovery of its result is rewarded. We present TruthInsightBench, a benchmark configured for discovery. Its 40 blind tasks, drawn from 40 peer-reviewed studies across 10 scientific domains, expose only a neutral scientific objective and frozen data; source conclusions, expected values, and analysis paths are withheld, leaving the agent to determine what claim the data support. A fixed LLM-based judge scores the evidentiary maturity of an agent's own claims along six dimensions, operationalized as 29 artifact-grounded items, with automated, deterministic aggregation and no per-instance human grading, so evaluation can be repeated automatically as agents evolve. On one frozen base model, four coding agents form a narrow plateau (58.4-60.3 of 100) with no statistically reliable pairwise separation: they execute and document analyses competently, with comparatively strong evidence auditability and novelty, but largely lack the discriminating acts that establish a trustworthy claim (controls, robustness, falsifiability, and cross-dataset generalization). The bottleneck is scientific judgment rather than coding, and genuine discovery remains out of reach. TruthInsightBench makes this gap a measurable target; data and scoring code are at this https URL.
20. 【2609.05074】Influence Score and Transformers interpretability: Measure of the Effective Impact of Attention Heads at inference time
链接：https://arxiv.org/abs/2609.05074
作者：Lisa Bouger,Yannick Teglia,Philippe Loubet Moundi
类目：Computation and Language (cs.CL)
关键词：Transformer-based models designed, prompt injection detection, Transformer-based models, injection detection, prompt injection
备注：
点击查看摘要
Abstract:We propose an influence score to quantify the contribution of attention heads to classification decisions in Transformer-based models designed for prompt injection detection. The score combines directional influence on the logits with structural contribution within the residual stream, enabling a multi-scale analysis at the head, layer, and network levels. Applied to a DeBERTa model specialized for prompt injection detection, our framework reveals distinct decision behaviours between correct and erroneous predictions. Our method provides an effective compromise between fine-grained circuit analysis and global output-based methods, and offers a systematic way to study decision mechanisms in Transformer classifiers.
21. 【2609.05069】A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support
链接：https://arxiv.org/abs/2609.05069
作者：Chang Xia,Leilei Ouyang,Huimin Wang,Yong Zhao,Kang Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, single-turn question-answer format, Large language, single-turn question-answer, question-answer format
备注： 13 pages, 6 figures
点击查看摘要
Abstract:Large language models (LLMs) show potential for medical tasks, but their single-turn question-answer format does not reflect how clinical diagnosis is performed in practice. As a result, they remain limited in complex diagnostic settings. We developed Debate-Mixture-of-Agents (DMoA), a novel multi-agent framework that structures role-based interaction to support iterative diagnostic reasoning. Base models and DMoA were evaluated on 297 rare disease cases and 1,719 challenging cases. Across both datasets, DMoA improved most likely diagnosis accuracy by 10.21 percentage points and safety rate by 11.36 percentage points over GPT-4o baseline. Ablation experiments showed that the gains were not simply due to the use of more models or longer outputs, but also reflected the contribution of the structured workflow. Further analyses examined how framework design, base model choice, and token budget affected performance. DMoA performed better with a 4*2 structure, stronger base models, and a larger token budget. These findings demonstrate the potential of DMoA for clinical tasks and suggest further investigation of multi-agent frameworks.
22. 【2609.05059】Repeated Queries Exhaust an LLM's Brand Recommendations but Not Its Sources
链接：https://arxiv.org/abs/2609.05059
作者：Dmitrij Żatuchin
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：buying questions exhaust, model brand recommendations, brand recommendations depends, language model brand, repeated identical buying
备注： 6 pages, 2 figures, 2 tables, code, per-cell tables and data pointers at [this http URL](http://github.com/Rankfor/rankfor-open) (research/recommendation-saturation)
点击查看摘要
Abstract:Whether repeated identical buying questions exhaust a language model's brand recommendations depends on retrieval. Across 300 question-engine cells (50 questions, six engines, 15 runs each, open extraction over 1,470 adjudicated organizations), the five engines answering without web search were still adding never-seen brands at run 15 in 86-92% of cells, with median repertoires of 15-31 organizations; the one retrieval-enabled engine closed its list (median 8 organizations, 64% of cells still adding), matching four earlier deep cells where web-search runs saturated by run ten. Cited-domain accumulation keeps rising at every horizon tested: four deep cells were still adding domains at run 24 with 59-84% of the Chao2 lower-bound estimate observed, and 44% of the retrieval engine's breadth cells were still adding domains at run 15. A single run shows 62-77% of the five-run brand set, and across engines the median question draws 38 organizations, of which a median of 15 appear in exactly one engine. Estimators are exact rarefaction and Chao2 richness; a parallel fixed-roster extraction reproduces flat curves on identical responses, so roster-bounded tracking manufactures plateaus that open extraction removes.
23. 【2609.05043】EuroAlpaca: Task-Preserving Localisation of Instruction Data for European Languages
链接：https://arxiv.org/abs/2609.05043
作者：Aleix Sant,Jordi Luque,Carlos Escolano
类目：Computation and Language (cs.CL)
关键词：extend English instruction-tuning, degrading models trained, English instruction-tuning data, Machine translation, creating corrupted training
备注：
点击查看摘要
Abstract:Machine translation (MT) offers a scalable way to extend English instruction-tuning data to multiple languages, but it can distort task-critical constraints and required outputs, creating corrupted training examples and degrading models trained on such data. We introduce EuroAlpaca, a task-preserving localisation pipeline and near-parallel resource covering 50 European languages and regional varieties, together with European-IFEval, a multilingual benchmark for verifiable instruction following. Depending on the example, our pipeline applies field-wise MT while preserving task-critical content or reconstructs a task-equivalent target-language instance, followed by validation of cross-field coherence and target-language consistency. Across LoRA experiments with four LLMs, training on directly translated data improves ROUGE-L and F-BERT on the Aya Evaluation Suite, but reduces accuracy on European-IFEval by 29.8% relative to the unadapted baseline. In contrast, adaptation with EuroAlpaca improves accuracy by 12.9% over the same baseline, reversing the degradation caused by direct MT, while also achieving the highest ROUGE-L and F-BERT scores on Aya. These results show that preserving task semantics is essential for multilingual instruction tuning.
24. 【2609.05037】How do LLMs Evaluate Perceived Moral Agency? Investigating Moral Decision-Making in Human-Artificial Agents Interactions
链接：https://arxiv.org/abs/2609.05037
作者：Fernanda Mansilla,Aloysius Tok,Bahia Guellaï,Farah Benamara,Nancy F. Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：requiring moral advice, roles requiring moral, moral agency, attribute moral agency, roles requiring
备注： 43 pages, 14 figures, 29 tables. Preprint under review
点击查看摘要
Abstract:As LLMs take on roles requiring moral advice, understanding how they attribute moral agency becomes critical. Humans possess moral agency, the capacity to make ethically guided decisions and bear responsibility for their consequences, a well-established construct in moral psychology. Yet as artificial agents (AAs) such as robots, drones, and disembodied AI systems become increasingly embedded in smart city environments, the question of whether and how moral agency is attributed to them takes on new urgency. This paper presents, to the best of our knowledge, the first empirical study comparing how humans and LLMs evaluate perceived moral agency (PMA) across human and autonomous artificial agents varying in embodiment, situated in plausible smart city scenarios. Using an adaptation of a validated PMA scale, we applied a protocol to 190 human participants as well as various LLMs. Our evaluation reveals higher perceptions of moral agency in humans than in AAs. However, when facing moral dilemmas in concrete scenarios, LLMs reason outward from the situation, prioritizing harm severity and contextual urgency over any stable assessment of the agent itself, amplifying a context-sensitivity also present in human raters. These findings are particularly relevant as LLMs become increasingly involved in everyday moral decisions.
25. 【2609.05036】Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignment
链接：https://arxiv.org/abs/2609.05036
作者：Arno Libert,Derck W.E. Prinzhorn,Daan R. Henselmans
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：human norms, adhere to human, system behavior expresses, alignment requires, coherent policy
备注： Accepted for publication in the Paris Journal of AI and Digital Ethics (2026); presented at PCAIDE 2026
点击查看摘要
Abstract:AI alignment requires AI systems to adhere to human norms, values, or intentions. Under value pluralism there is no correct target, but a shared prerequisite is that the system's behavior expresses a coherent policy: a mapping from situations to verdicts that is invariant while a situation's morally relevant features are preserved, and sensitive when they change. We introduce four structural conditions for such coherent policies: verdict stability, monotonicity, decisiveness, and Pareto viability. Together they measure a form of moral competence that is evaluable from behavior alone, without reference to a moral standard or expert baseline, forming a structural floor for alignment rather than a normative target. We demonstrate the methodology on three simulated deployments featuring LLM-based agents facing moral dilemmas. Evaluating nine frontier models under a factorial design of five paraphrases, five escalation levels, and three dominance conditions, we show no model expresses a coherent policy across the three deployments: surface-form perturbation alone produces verdict-rate shifts of up to $99$ percentage points at a single escalation level, and a model's success on one scenario does not predict its competence on another. This suggests LLM-based agents are not currently the kind of object to which alignment can meaningfully apply.
26. 【2609.05025】Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection
链接：https://arxiv.org/abs/2609.05025
作者：Renato Vukovic,Hsien-chin Lin,Carel van Niekerk,Benjamin Ruppik,Michael Heck,Shutong Feng,Nurul Lubis,Milica Gasic
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：model generates outputs, language model generates, fine-tuned language models, factually incorrect, incorrect or unsupported
备注： Accepted to GroundLM EMNLP 2026 Workshop
点击查看摘要
Abstract:Hallucination-where a language model generates outputs that are factually incorrect or unsupported by the source-is a major challenge for both prompted and fine-tuned language models. Detecting hallucinations is difficult due to the opaque reasoning processes of LLMs, which often provide little insight into why a model's output may be inaccurate. In this work, we investigate whether an LLM can use an alternative, low level, symbolic competence such as SQL for unsupervised hallucination detection in some high level task. For this, we make an LLM build an SQL database from reference documents. This SQL database is then used for reasoning over the reference and the sampled response in a hallucination detection pipeline that is grounded in the database, thereby providing a neurosymbolic checkup. On RAGTruth and DiaHalu hallucination detection datasets, we find that our approach improves on direct prediction and competes with state-of-the-art hallucination detection methods, while not requiring domain-specific fine-tuning. Instead it relies on a low-level general competence already present in LLMs. This warrants further investigation of low-level LLM competences in neurosymbolic approaches.
Comments:
Accepted to GroundLM EMNLP 2026 Workshop
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
Cite as:
arXiv:2609.05025 [cs.CL]
(or
arXiv:2609.05025v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.05025
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
27. 【2609.05022】MoirfEolas and CríochScore: Developing Resources for and the Evaluation of Tokenization Alignment with Irish Morphology
链接：https://arxiv.org/abs/2609.05022
作者：Jane Adkins,Abigail Walsh,Brian Davis,Elaine Uí Dhonnchadha
类目：Computation and Language (cs.CL)
关键词：morphological boundaries present, morphological boundaries, Irish, evaluation measures, Unigram Language Model
备注： Accepted as a non-archival poster at the Second Tokenization Workshop (TokShop) at COLM 2026
点击查看摘要
Abstract:This paper presents new tokenization resources for Irish and evaluation measures of alignment with the morphological boundaries of the language. We present MoirfEolas, a dataset of over 35,000 Irish words mapped to their respective eclipses, prefixes and suffixes as well as an evaluation metric CríochScore, that evaluates the alignment of tokenizations with the morphological boundaries present in MoirfEolas. We evaluate common tokenization algorithms using CríochScore as well as intrinsic metrics present in the tokenization literature. We find that the Unigram Language Model aligns with Irish morphology more often than the other algorithms evaluated. We also find trade-offs between morphological-alignment of tokenization with both compression as well as vocabulary efficiency, providing practical insights for Irish natural language processing development. This dataset contributes towards combating the Irish language's low-resource status; moreover, the construction process reported in this paper can be emulated by other languages to create specialised morphological resources.
28. 【2609.04999】BIT.UA at BioASQ 14B: Modular Retrieval with pg_textsearch and Qdrant, and Agent-Based Answer Generation
链接：https://arxiv.org/abs/2609.04999
作者：André Ribeiro,Rúben Garrido,Alexander Christiansen,Richard A. A. Jonker,Sérgio Matos
类目：Computation and Language (cs.CL)
关键词：biomedical question answering, University of Aveiro, BioASQ Task, Task B challenge, question answering
备注： 1 figure, 15 tables, 25 pages
点击查看摘要
Abstract:This paper describes the participation of the this http URL team from the University of Aveiro in the 14th edition of the BioASQ Task B challenge on biomedical question answering. Building on our previous submissions, we introduced a substantially refactored and modular codebase, and made significant changes to both the retrieval and generation components of the pipeline. For Phase~A document retrieval, we replaced the PyTerrier PISA index with PostgreSQL-based pg\_textsearch for BM25 retrieval and adopted Qdrant for dense embedding indexing, enabling more efficient storage and GPU-accelerated similarity search. We explored HyDE-based query expansion alongside a Context-1 retrieval strategy. A new reranker training pipeline was developed, incorporating dense retrieval for negative sampling. For Phases A+ and B answer generation, we introduced an LLM-as-a-judge framework and a novel agent quorum mechanism, where multiple agents with diverse prompts debate and iteratively converge on a consensus answer using adaptive document retention. We also participated in the snippets generation subtask for the first time. Our systems achieved competitive results across all batches, with Phase~A systems achieving MAP ranks of 5 (Batch~1,3). We discuss the impact of these architectural changes, lessons learned, and outline directions for future work including SPLADE and ColBERT integration. All code is openly available: this https URL.
29. 【2609.04971】BeaconKV: Key-Value Cache Compression Guided by Beacon Queries for Efficient Large Reasoning Model Inference
链接：https://arxiv.org/abs/2609.04971
作者：Janghyeon Kim,Minsoo Kim,Kyuhong Shim,Jungwook Choi
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Large Reasoning Models, exceeding GPU capacity, achieve superior problem-solving, exceeding GPU, GPU capacity
备注： ICML 2026. Code: [this https URL](https://github.com/aiha-lab/BeaconKV)
点击查看摘要
Abstract:Large Reasoning Models (LRMs) achieve superior problem-solving through extended Chain-of-Thought (CoT) generation, but the resulting key-value (KV) cache grows linearly with sequence length and creates severe memory bottlenecks, often exceeding GPU capacity for long reasoning traces. Existing KV cache compression methods rely on recent queries to estimate future token importance, implicitly assuming these serve as reliable proxies for future attention patterns. We demonstrate that this assumption fails in long-horizon reasoning: certain decoding steps generate Thought Revisiting Tokens (TRT) that re-attend to distant previous context, such as task-solving plans formulated early in the trace. Through systematic analysis, we discover that queries corresponding to the TRT cluster into a small number of similarity groups in the embedding space. Based on this insight, we propose BeaconKV, a training-free KV cache compression method that maintains beacon queries, compact representatives for each global query cluster, to anticipate which KV pairs will be revisited without storing the entire query history. Across four open-source LRMs and diverse reasoning benchmarks, BeaconKV generally outperforms existing compression methods, achieving up to $5.8\times$ memory reduction while nearly preserving full cache accuracy and improving throughput by over $4.3\times$.
30. 【2609.04962】Why We Care About Understanding: Competence through Predictive Compression
链接：https://arxiv.org/abs/2609.04962
作者：Matthieu Queloz,Pierre Beckmann
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：heavily compressed form, Gregory Chaitin dictum, heavily compressed, understanding, Gregory Chaitin
备注：
点击查看摘要
Abstract:What is the relation between understanding and compression, and why does human understanding take such a heavily compressed form? Across information theory, machine learning, and AI research, a substantial tradition identifies understanding with compression-a thought captured in Gregory Chaitin's dictum that "comprehension is compression." Philosophers, by contrast, have characterized understanding in terms of grasping connections, giving explanations, and handling novelty. This paper bridges the two pictures through three interlocking theses. The first concerns the concept of understanding: it serves as an efficient proxy for a distinctive form of robust competence, enabling us to identify whom to trust and whom to learn from. The second concerns the state of understanding: to understand a domain is to possess a mental model of its relational structure that enables prediction, and what enables prediction enables compression, because what becomes predictable need not be stored separately. Compression is therefore not identical with comprehension, but its representational shadow. The third concerns the characteristically human form of understanding: the fiduciary and transmission functions highlighted by the first thesis impose pressures of demonstrability and transmissibility that drive human understanding toward principled simplicity. The resulting framework explains both the appeal and the limits of compressionist accounts of understanding while shedding light on the inscrutability of AI systems.
31. 【2609.04959】Discourse Dependency: A Continuous Criterion for Translation Difficulty
链接：https://arxiv.org/abs/2609.04959
作者：Ahrii Kim,Chanjun Park,Seong-heum Kim
类目：Computation and Language (cs.CL)
关键词：Recent calls, harder machine translation, machine translation benchmarks, calls for harder, harder machine
备注： Accepted to EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Recent calls for harder machine translation benchmarks have not clarified what difficulty should mean. We argue that one meaningful and currently unmeasured axis is referential reach, the distance a segment must look back into its document to resolve the entities and pronouns it contains. We formalize this as discourse dependency (DDP), a metric-free, source-side measure computed from named entity re-mentions and pronominal coreference. Validated against gold coreference, DDP errs one-sidedly in 99.2% of segments, so a high-DDP segment is certified to require long-range context. Applying DDP to WMT24++ and WMT25 shows that both are heavily skewed toward low-DDP segments, which domain labels do not distinguish. Building on DDP, we compare five context injection strategies in an English-Korean post-editing setup, varying context size and selection. As DDP grows, no strategy keeps pace with human post-editing. On segments with DDP = 15 raters prefer human translations, while automatic metrics register no difference. As frontier systems saturate aggregate scores, DDP shifts evaluation from how well models score to how far they can reach.
32. 【2609.04898】RefactorPlatform: An Open-Source Harness for Controlled Evaluation of Repository-Scale Refactoring Agents
链接：https://arxiv.org/abs/2609.04898
作者：Aziz Ben Amor,Drish Mali,Mann Acharya,Vijayasri Iyer,Sébastien Bratières
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：altering program behavior, Repository-scale refactoring requires, existing harness isolates, requires coding agents, determine agent success
备注： Accepted at EMNLP 2026 System Demonstrations
点击查看摘要
Abstract:Repository-scale refactoring requires coding agents to propagate a single change across many interdependent files without altering program behavior, yet to our knowledge no existing harness isolates the design choices that determine agent success on this task. We present RefactorPlatform, an open-source evaluation harness that holds the environment fixed and varies each design axis explicitly: model backbone (via OpenRouter and GitHub Copilot CLI), execution regime (baseline, retrieval-augmented, and multi-agent), and prompt specificity. Each run executes in an isolated workspace with live terminal streaming, per-task logging of tokens, diffs, and transcripts, AST-based verification, and exportable telemetry for audit and reproduction. Demonstrating the platform on 100 multi-file RefactorBench tasks across four model families, we illustrate the analyses it supports: AST-aware chunking outperforms naive token-window chunking by 25-30% across prompt modes, whereas naive retrieval falls below the retrieval-free baseline; a lean retrieval-augmented single agent (86%) beats the sub-agent configuration we evaluated (66%) on matched tasks with no task passing under delegation that fails under retrieval; and retrieval's accuracy gains absorb its token overhead, leaving cost per successful refactoring unchanged. RefactorPlatform is open-sourced to make refactoring-agent evaluation reproducible and auditable.
33. 【2609.04895】Cache-Aware Joint Router Adaptation for Memory-Efficient MoE Inference
链接：https://arxiv.org/abs/2609.04895
作者：Zhenhe Wu,Yaping Jin,Qinghua Xing,Hang Zhou,Wei He,Xianjie Wu,Xianfu Cheng,Jian Yang,Hanting Chen
类目：Computation and Language (cs.CL)
关键词：exceeds GPU memory, causing repeated weight, GPU memory, exceeds GPU, repeated weight transfers
备注：
点击查看摘要
Abstract:Mixture-of-Experts (MoE) models activate only a small subset of experts per token, but the full expert set often exceeds GPU memory, causing repeated weight transfers during decoding. We formulate expert-cache management as a model-side algorithmic problem and propose a cache-aware post-training framework that jointly adapts the MoE backbone and lightweight auxiliary cache routers while preserving the native Top-K expert-selection rule at inference. Its update-only mode, Temporal Router, predicts same-layer reuse and retains experts for future tokens without proactive loading. The full Spatio-Temporal Router adds a Spatio Router that uses the causal predecessor's hidden state to refine the temporal cache before target-layer access. We evaluate both modes on Qwen3 and GPT-OSS across GSM8K, MATH, and CommonsenseQA. Temporal Router consistently improves cache hit rate and reduces expert-weight traffic over matched LM-only baselines. On Qwen3, Spatio-Temporal Router achieves the best load-adjusted efficiency across three tasks, improving adjusted hit rate by 1.15--18.03 points and reducing traffic by 4.6--53.3% relative to the strongest evaluated prefetching baseline; results on GPT-OSS are competitive but task-dependent. An auxiliary-only ablation preserves baseline accuracy but yields modest cache gains, whereas joint post-training produces larger improvements. Sensitivity analyses show that cache capacity controls transfer demand, while the refinement budget governs the trade-off between pre-access coverage and proactive traffic.
34. 【2609.04855】CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict Mediation
链接：https://arxiv.org/abs/2609.04855
作者：Suhyun Lee,Wenxuan Zhang,W. Quin Yow,Yang Deng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, culturally grounded conflicts, requires deciding, large language, grounded conflicts
备注：
点击查看摘要
Abstract:Cross-cultural mediation by large language models (LLMs) requires deciding both when to intervene and how to respond in culturally grounded conflicts. Progress on this problem has been limited by the lack of (1) mediation datasets with measurable downstream effects and (2) principled metrics for evaluating intercultural stance change. To address these gaps, we introduce CC-Mediation, a cross-cultural mediation benchmark of $1{,}661$ ten-turn dialogues grounded in the Developmental Model of Intercultural Sensitivity (DMIS), containing culturally grounded conflicts, mediation interventions, and post-intervention trajectories. We further propose two DMIS-based evaluation metrics: Trajectory AUC, which measures the persistence of intercultural improvement over time, and a signed Wasserstein-1 distance, which measures the magnitude and direction of shifts in intercultural stance. Both metrics show strong agreement with human judgment of DMIS-grounded stance shift. Using CC-Mediation, we find that current LLMs have limitations on both axes: intervention timing (when) failure stems from a positional prior that ignores dialogue content, while mediation strategy (how) failure arises from a late-layer elicitation collapse rather than a knowledge deficit.
35. 【2609.04842】MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain
链接：https://arxiv.org/abs/2609.04842
作者：Sourav Malakar,Harshit Nigam,Akash Ghosh,Sriparna Saha,Amlan Chakrabarti,Saptarsi Goswami,Priti Singh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：enabling timely diagnosis, personalized treatment, health over time, enabling timely, timely diagnosis
备注：
点击查看摘要
Abstract:Time-series data in clinical settings is crucial for capturing dynamic changes in a patient's health over time, enabling timely diagnosis, personalized treatment, and early detection of critical events. However, the development of clinically reliable and linguistically inclusive medical AI systems remains a significant challenge, primarily due to the lack of multimodal, multilingual, and time-series-grounded benchmarks that reflect the complexity of real-world clinical scenarios. To fill this gap, we present MMTClinic, a benchmark designed to evaluate large language models (LLMs) on complex reasoning and question-answering tasks involving clinical time-series. MMTClinic combines text, medical images, and multivariate physiological signals and includes 30,000 QA pairs (15,000 multiple choice questions (MCQs) and 15,000 open-ended questions) across five languages: English, Hindi, Bengali, Marathi, and Tamil. These questions cover three important clinical tasks---mortality prediction, heart rate forecasting, and SOFA score estimation. We evaluate 13 state-of-the-art LLMs in zero-shot, few-shot, and chain-of-thought settings. Our evaluation reveals notable differences in model performance across tasks, languages, and modalities, highlighting current limitations in clinical reasoning capabilities. MMTClinic provides a valuable resource for advancing multilingual, multimodal, and time-series-aware medical AI research. The dataset will be made publicly available on successful acceptance of the work.
36. 【2609.04841】MABPD: Multi-Agent Bias Probing Detection via Structured Argument Debate
链接：https://arxiv.org/abs/2609.04841
作者：Garvit Joshi(1),Stavya Dhyani(1),Jasmine(1),Arun Chauhan(1) ((1) Graphic Era University, Dehradun, India)
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：subtle linguistic cues, traditionally required large, resist single-model detection, Media bias, required large annotated
备注： 20 pages, 6 figures. Accepted to the EMNLP 2026 Main Conference. Code: [this https URL](https://github.com/Subaru-5999/MABPD)
点击查看摘要
Abstract:Media bias in news articles operates through subtle linguistic cues---loaded language, selective framing, and strategic omission---that resist single-model detection and have traditionally required large annotated corpora for supervised training. We ask whether structured multi-agent deliberation can serve as a principled, training-free alternative to supervised classification for this task. We introduce MABPD (Multi-Agent Bias Probing Detection), a pipeline in which three specialized LLM agents analyze an article from complementary perspectives and resolve disagreements through a Structured Argument Debate (SAD) protocol. SAD implements a domain-motivated asymmetric burden of proof---biased claims without grounded textual evidence carry zero weight---combined with role-weighted voting and post-consensus verification, replacing task-specific supervised decision boundaries with explicit deliberative structure. Ablation confirms that this structured deliberation, not mere agent parallelism, drives performance: removing the debate module reduces F1 by up to 10.6 points. On the BABE benchmark (4,121 expert-annotated sentences), MABPD achieves 83.4% macro F1 on the held-out test split---within 0.7 percentage points (pp) of the supervised SOTA (MAGPIE, 84.1% macro F1; Horych et al., 2024)---without any task-specific training or threshold tuning on annotated data. Cross-dataset evaluation on the SemEval 2019 HyperPartisan corpus (644 articles) yields 75.0% zero-shot accuracy, within 7.2 pp of the supervised SOTA accuracy (82.2%; Kiesel et al. 2019), confirming transfer across annotation regimes. We release the full pipeline and evaluation code.
37. 【2609.04835】On Epistemic Diversity in Large Language Models
链接：https://arxiv.org/abs/2609.04835
作者：Elisabeth Kirsten,Nicole Krämer,Muhammad Bilal Zafar
类目：Computation and Language (cs.CL)
关键词：retrieve information, epistemic diversity, Large language models, answer questions, epistemic
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used not only to retrieve information, but to answer questions, explain, teach, and support inquiry. In such settings, evaluation cannot be exhausted by accuracy or alignment alone. A system may give a correct answer while still narrowing users' access %to knowledge. to alternative valid answers, explanations, or reasoning routes. Drawing on the broader notion of epistemic diversity in philosophy and social epistemology, we formalize it in the context of LLMs as the range of valid answers, explanations, and reasoning routes that an LLM exposes to users. We argue that epistemic diversity is a useful evaluation dimension for settings where LLMs are used to support knowledge-intensive tasks. We propose a preliminary framework for conceptualizing and measuring epistemic diversity in LLMs, and operationalize it in two domains. We find that frontier LLMs often exhibit epistemic narrowness, repeatedly collapsing large valid answer spaces onto small canonical subsets. These findings suggest that LLM evaluation should move beyond accuracy-oriented paradigms and treat epistemic diversity as an important dimension of model capability.
38. 【2609.04824】Generating Constructive Feedback on Stories via Reinforcement Learning
链接：https://arxiv.org/abs/2609.04824
作者：Maja Stahl,Timon Ziegenbein,Henning Wachsmuth
类目：Computation and Language (cs.CL)
关键词：storytelling abilities, crucial for creative, creative writers, writers to refine, refine their storytelling
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Constructive feedback is crucial for creative writers to refine their storytelling abilities. Since receiving feedback from human experts is often costly and time-intensive, large language models (LLMs) offer a scalable and efficient alternative as automatic writing assistants. Despite their potential, research indicates that LLM-generated feedback is often generic, lacks actionability, and fails to identify which writing issue is most critical. To address these limitations, we present a reinforcement learning approach that steers LLMs to generate constructive feedback without the need for ground-truth feedback. We train our model using group relative policy optimization (GRPO) with a novel multi-component reward function aiming at constructiveness: it prioritizes feedback that is uniquely tailored to the story, helps to improve story quality, and addresses the most critical writing issue. In automatic and human evaluation across three story corpora, our approach outperforms state-of-the-art LLMs (including Gemini) and competitive baselines. We find that providing actionable suggestions is the main driver of feedback constructiveness.
39. 【2609.04823】Reinforcement Learning for improving Large Language Models' Catalan text simplification capabilities
链接：https://arxiv.org/abs/2609.04823
作者：Arnau Ayguadé Domingo,Stefan Bott,Horacio Saggion
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：language processing techniques, broader natural language, natural language processing, automatic text simplification, Large Language Models
备注： Accepted at CLEAR-TEXT 2026: Readability and text simplification workshop at the International Conference Computational Linguistics in Bulgaria (CLIB 2026)
点击查看摘要
Abstract:Although automatic text simplification (ATS) is critical for accessibility, its progress has not matched the rapid evolution of broader natural language processing techniques. This paper investigates the application of reinforcement learning (RL) to improve the quality of ATS for low-resource languages using Large Language Models (LLMs). The paper introduces a novel reward function, designed to guide LLMs toward a targeted simplification style with Group Relative Policy Optimization (GRPO), that combines the SARI metric with specific penalty components. The effectiveness of GRPO with this reward function is motivated and demonstrated by post-training IberianLLM-7B-Instruct on the ASSET dataset. After post-training on the English ASSET, the model's ATS performance improves on two curated Catalan benchmarks while also successfully suppressing previously observed negative behaviors. Cross-lingual transfer learning is explored by translating ASSET into Catalan and Spanish and post-training the model on each version, but these fail to show a significant improvement on the out-of-domain benchmark.
40. 【2609.04819】A Systematic Comparison of Multilingual Interpretability Methods Reveals Anisotropy-Driven Failures
链接：https://arxiv.org/abs/2609.04819
作者：Oskar Holmström,Marcel Bollmann,Marco Kuhlmann
类目：Computation and Language (cs.CL)
关键词：Multilingual language models, interpretability methods claim, Multilingual language, develop shared cross-lingual, language models develop
备注：
点击查看摘要
Abstract:Multilingual language models develop shared cross-lingual representations, and various interpretability methods claim to quantify this sharing. These methods have been developed largely in isolation, and when they disagree, it is unclear whether the disagreement reflects a property of the model or an artifact of the measurement. We compare four sharing metrics (CKA, ANC, GMM dominance per token, and ILO) across 21 base models from five families (125M-14B parameters) and correlate each with cross-lingual transfer on five downstream tasks. We find that the metrics differ in their quantification of cross-lingual sharing in these models and suggest that the disagreement traces to anisotropy, the tendency of representations to cluster in a narrow cone of the embedding space. Only ILO's correlation with cross-lingual transfer (Spearman's $\rho = 0.90$) survives controls for model size, family, and per-task variation. We therefore recommend ILO as the primary sharing metric, to be reported alongside anisotropy diagnostics.
41. 【2609.04808】Recurrence Is Not Enough: Causally Validating Multilingual SAE Translation Features in Gemma 2 and 3
链接：https://arxiv.org/abs/2609.04808
作者：Giang Son Nguyen,Nhi Ngoc-Yen Nguyen,Wray Buntine,Dung D. Le
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Sparse autoencoder, steer language-model behavior, Gemma, language context plays, explain and steer
备注： Accepted to BlackboxNLP 2026 Special Track
点击查看摘要
Abstract:Sparse autoencoder (SAE) features are increasingly used to explain and steer language-model behavior, but it remains unclear whether a feature found in one language context plays the same causal role when processing prompts in another language. We study this question using translation-initiation features (Wu et al., 2026). We reproduce the SAE feature discovery method from Wu et al. in Gemma 2 and extend it to multilingual settings that vary prompt language, source language, and target language. We then test whether features that recur across settings affect translation behavior by amplifying or ablating their activations during inference. We also examine whether the method can be applied to Gemma 3. In both models, we observe an identical finding: although we can find more than 20 features that activate frequently across all discovery settings, causal validation shows that nearly all have small or inconsistent effects. In contrast, one feature -- Gemma 2's (L10, 5717) and Gemma 3's (L20, 2456) -- consistently improves COMET scores when amplified and degrades them when ablated across 23 language settings. These results show that feature recurrence can overstate cross-lingual transfer, while identifying a language-agnostic translation-initiation direction in Gemma 2 and Gemma 3.
Comments:
Accepted to BlackboxNLP 2026 Special Track
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.04808 [cs.CL]
(or
arXiv:2609.04808v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.04808
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
42. 【2609.04792】Can Activation Steering Capture Multidimensional Authorship Style?
链接：https://arxiv.org/abs/2609.04792
作者：Hieu Tran,Calvin Bao,Marine Carpuat
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：controlling LLM generation, controlling LLM, LLM generation, well-defined attributes, shown promise
备注： EMNLP 2026
点击查看摘要
Abstract:Activation steering has shown promise for controlling LLM generation along well-defined attributes, but it remains unclear whether it can handle the multidimensional and hard-to-define nature of authorship style. We ask whether structured contrastive prompting along rhetorically-motivated dimensions can construct rich style representations directly in activation space, bypassing the need for natural language style descriptors or dedicated training. We find that the resulting directions share a common authorship backbone while conflicting on aspect-specific residuals that carry genuine stylistic signal, explaining why naive aggregation fails. We operationalize this in Aspect-Aware Activation Steering (A3S), a training-free framework that merges per-aspect contrastive directions with interference-aware aggregation and tunes steering strength per instance. A3S improves authorship style transfer where it is genuinely multi-aspect, outperforms a trained baseline in preference evaluations on out-of-domain benchmarks, and keeps target-exemplar overlap consistently low.
43. 【2609.04773】Persistent Teacher Anchoring for Tool-Using Agents
链接：https://arxiv.org/abs/2609.04773
作者：Hyun Bin Park(1),Kyungho Song(2),Sangmin Lee(1),Du-Seong Chang(1) ((1) Sogang University, (2) University of Michigan, Ann Arbor)
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：on-policy knowledge distillation, LLM post-training, common in LLM, knowledge distillation, on-policy knowledge
备注： 16 pages, 4 figures, 8 tables. Accepted at EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Distillation is common in LLM post-training, where on-policy knowledge distillation (OPKD) uses student-generated trajectories to prepare the student for downstream RL. At each state, the student matches a next-token distribution supplied by the teacher. As the rollout enters states the teacher would not visit, the teacher-student distribution gap can accumulate. In tool use, this gap becomes consequential because student-written calls execute before supervision and their observations shape later prefixes. Proposer-verifier generation addresses this drift by letting the teacher decide which student-proposed text is retained during generation. Existing formulations govern text but leave tool execution outside their scope. We propose Persistent Teacher Anchoring (PTA), a student-induced but teacher-committed rollout construction. PTA retains chunk-level verification and adds turn-level commitment, allowing a call to reach the environment only after the teacher has verified the entire turn. Treating verified chunks as atomic generation units, we introduce persistent lookahead, which fills idle rollout capacity by advancing future samples and carrying unfinished ones across student updates under the fixed verifier. Across Search-R1-style retrieval and DeepEyes-style perception RL, applying PTA before downstream RL improves macro best@4 by 2.5 and 2.8 points over OPKD under the same downstream RL budget, while lookahead improves throughput by 24%.
44. 【2609.04755】Vectorizing Classical Tamil: Representation Learning for Verse-Commentary Pairs
链接：https://arxiv.org/abs/2609.04755
作者：Amrit Gopinath,Sangeetha Sivanesan
类目：Computation and Language (cs.CL)
关键词：Classical Tamil source, Classical Tamil, technical grammatical prose, Tamil source sections, information representation learning
备注： 8 pages, 5 figures, 6 tables
点击查看摘要
Abstract:We construct a corpus of 1,262 verse-commentary (urai) pairs from five Classical Tamil source sections, ranging from technical grammatical prose to modern paraphrase, and ask what information representation learning can recover. We train recurrent and Transformer encoders, a Siamese-style pair-matching network, an mBART-style encoder-decoder, and a decoder-only language model. Each analysis is interpreted against an appropriate control on the same data. TF-IDF provides a strong no-training lexical retrieval baseline, alongside representation analyses and generation controls for the learned models. A fixed string containing the 25 most frequent commentary words scores higher on generation overlap than the decoder-only model. Canonical correlation reaches 1.000 on Gaussian noise at these sample sizes, token-F1 spans only about 0.02-0.20 on this corpus, and the encoder-decoder continues to lower training loss for sixteen epochs after validation loss has begun to rise. One narrow result remains: the decoder-only model prefers authentic word order in 107 of 112 minimal-pair comparisons (95.5%), but does not reproduce held-out commentary content. We release the extraction and evaluation protocol; redistribution of the source commentaries remains subject to permission.
45. 【2609.04753】Beneath the Surface of Chains-of-Thought: A Mechanistic Interpretation of Reasoning Operations in LLMs
链接：https://arxiv.org/abs/2609.04753
作者：Seogyeong Jeong,Jaehui Hwang,Dongyoon Han,Geonmo Gu,Alice Oh,Taekyung Kim
类目：Computation and Language (cs.CL)
关键词：diverse functional operations, goal decomposition, problem formulation, unfolds through diverse, diverse functional
备注： To appear in EMNLP 2026 Main Conference. 43 pages, 14 figures, 19 tables
点击查看摘要
Abstract:Reasoning in large language models unfolds through diverse functional operations, such as problem formulation, goal decomposition, and deduction. Although these operations are explicitly distinguished in text, little is known about how they are geometrically organized in representation spaces. To this end, we investigate whether distinct reasoning operations exhibit corresponding geometric structure in hidden representations. We find that operations are separable in held-out representations, with separability peaking in middle layers, and verify that this structure is not explained by lexical or positional confounds. Across layers, token-wise operation-alignment becomes more distributed over spans, while identical surface tokens are represented differently depending on the operation of its surrounding chunk. Attention-masking interventions further show that operation-aligned representations at chunk onset depend on preceding reasoning context. Consequently, our work demonstrates that language models maintain representational correspondence between linguistic reasoning expressions and their internal geometric structures. Code and project materials are available at this https URL.
46. 【2609.04720】Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models
链接：https://arxiv.org/abs/2609.04720
作者：Minji Kim,Jihyoung Jang,Hyounghun Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Vision-language models, withholding compliance, Vision-language, non-compliance, compliance
备注： EMNLP 2026 Main Conference (43 pages). Code and dataset available at [this https URL](https://github.com/mz-kim/KoNA)
点击查看摘要
Abstract:Vision-language models (VLMs) are expected to respond helpfully to appropriate requests while withholding compliance with requests that are incorrect, unsafe, infeasible, or unanswerable. However, existing benchmarks predominantly evaluate non-compliance at the level of the query as a whole, assuming that each request either warrants compliance or requires withholding compliance. In practice, real-world queries can contain a mixture of answerable content and components for which compliance should be withheld. In this paper, we introduce KoNA, a benchmark for evaluating selective non-compliance in VLMs across five categories: False Premise, Visual Inaccessibility, Universal Unknown, Task Feasibility, and Safety. Each task evaluates two capabilities: query-level non-compliance and component-level non-compliance under paired single and compound queries. Our evaluation across diverse VLMs shows that models often fail to refuse, correct, or abstain appropriately, and these failures become more pronounced when queries require selective non-compliance. To address this challenge, we fine-tune VLMs using KoNA examples that require selective non-compliance, together with a fully answerable set that should receive direct answers. Our fine-tuned models achieve substantial improvements in non-compliance accuracy while largely maintaining performance on fully answerable tasks. These results suggest that the fine-tuned models can distinguish between answerable components and those requiring non-compliance and respond in a task-appropriate manner.
47. 【2609.04714】Refuse without Refusal: A Structural Analysis of Safety-Tuning Responses for Reducing False Refusals in Language Models
链接：https://arxiv.org/abs/2609.04714
作者：Minji Kim,Hyounghun Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：aligning large language, large language models, fundamental challenge, challenge in aligning, aligning large
备注： EMNLP 2026 Main Conference (38 pages); Code available at [this https URL](https://github.com/mz-kim/RwR)
点击查看摘要
Abstract:Striking a balance between helpfulness and safety remains a fundamental challenge in aligning large language models. To achieve this balance, models should refuse harmful queries (e.g., "How do I shoot someone?") while remaining responsive to benign inputs, even those superficially resembling harmful queries (e.g., "Where can I shoot a good photo?"). However, models often struggle to distinguish genuinely harmful queries from benign queries that contain superficially risky language, resulting in false refusals. In this paper, we address the issue by decomposing a response in the safety-tuning dataset into two distinct components: (i) a boilerplate refusal statement and (ii) a rationale explaining the refusal. Our experiments and analyses show that refusal statements impede accurate discrimination between harmful and benign queries by inducing reliance on superficial cues. In contrast, training solely on rationales reduces false refusals while maintaining a comparable level of safety performance. Rationale-Only benefits also appear in our ICL configuration and remain compatible with the evaluated inference-time mitigation methods. The results emphasize the necessity of precisely curated, fine-grained safety supervision datasets and outline directions for constructing aligned agents that better reconcile helpfulness with safety.
48. 【2609.04708】How Do Language Models Represent and Use Phonological Information for Allomorph Selection?
链接：https://arxiv.org/abs/2609.04708
作者：Sangwoo Kim,Sangah Lee
类目：Computation and Language (cs.CL)
关键词：reliably produce morphemes, structure of words, trained on tokenized, tokenized text, text that obscures
备注： Accepted to EMNLP 2026
点击查看摘要
Abstract:Language models are trained on tokenized text that obscures the sound structure of words, yet they reliably produce morphemes whose form is phonologically conditioned. It remains unclear whether they rely on item-specific memorization or rule-like generalization and, if the latter, how that generalization is implemented. We therefore ask whether this phonological condition is represented within language models and how it is causally used for allomorph selection. For the English indefinite article a/an, we show that the phonological condition is encoded along a single linear direction in trigger-token embeddings, that this direction causally drives article selection in token-level wug tests, and that, at the article-prediction position, the model forecasts the upcoming trigger token and uses the forecasted trigger's phonological feature to choose the article. We then ask whether this rule-like generalization extends beyond English article selection, both to allomorph selection in other languages and to explicit phonological judgment. Together, these results provide a mechanistic account of phonologically conditioned allomorph selection in language models, and dissociate this generation-time ability from explicit metalinguistic judgments.
49. 【2609.04689】Retinal OCTA Phenotyping with LLM Reporting for Alzheimer's Disease
链接：https://arxiv.org/abs/2609.04689
作者：Progga Paromita Dutta,Jeba Maliha,Md Rafiul Kabir
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：established assessment methods, Early identification, remains challenging, population-scale screening, challenging because established
备注： 4th IEE International Conference on Artificial Intelligence, Blockchain, and Internet of Things, (AIBThings)
点击查看摘要
Abstract:Early identification of Alzheimer's disease (AD) remains challenging because established assessment methods can be costly, resource-intensive, or unsuitable for population-scale screening. Optical coherence tomography angiography (OCTA) provides non-invasive visualization of retinal microvasculature, but existing approaches often require diagnostic labels and provide limited measurement-level interpretation. We present an explainable OCTA pipeline that integrates annotation-aware vessel segmentation, layer-specific vascular biomarker extraction, label-free phenotyping, and measurement-grounded LLM reporting. Using 117 ROSE-1 images from 39 subjects, we apply annotation-matched segmentation models to superficial vascular complex (SVC), deep vascular complex (DVC), and combined SVC+DVC representations. The models achieve ROC-AUC values of 0.916-0.970 and Dice scores of 0.695-0.781. Six density and fractal-dimension biomarkers form subject-level profiles for exploratory clustering. Analysis of nine held-out subjects identifies an internally consistent lower-density, lower-fractal-dimension phenotype, although the absence of diagnostic labels prevents clinical interpretation. Reports generated using GPT, Gemini, and Llama are evaluated for measurement grounding, citation faithfulness, and diagnostic caution. Overall, the framework provides a transparent, non-diagnostic connection between retinal vascular measurements, exploratory phenotyping, and evidence-linked interpretation for Alzheimer's research.
50. 【2609.04676】Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generation
链接：https://arxiv.org/abs/2609.04676
作者：Jongkyung Shin,Inkyu Lee,Chiehyeon Lim
类目：Computation and Language (cs.CL)
关键词：persona-based dialogue generation, dialogue context, resulting in unnatural, persona-based dialogue, persona
备注： Accepted to EMNLP 2026 (Main)
点击查看摘要
Abstract:In persona-based dialogue generation (PDG), LLMs often overuse persona attributes by incorporating them regardless of dialogue context, resulting in unnatural responses. Despite its practical significance, the underlying causes remain unexplored, with no method to mitigate this problem or metric to assess the appropriateness of persona use. To address these issues, we first conduct a comprehensive analysis of LLM-based PDG, revealing that LLMs exhibit a systematic bias to incorporate all given persona attributes, and that existing metrics fail to capture contextual appropriateness. Building on these findings, we propose Self-CONtrastive Persona Overuse Suppression (SCONPOS) to mitigate overuse by directly intervening in LLMs' internal representations at the prompt encoding stage, without requiring any response generation. We further propose the Persona Appropriateness Score (PAS), a novel metric that penalizes both overuse and underuse. Experimental results demonstrate that SCONPOS systematically reduces overuse, and PAS captures the contextual appropriateness of persona use.
51. 【2609.04653】Choosing the Right Language Mode at Inference Time for Multilingual Reliability
链接：https://arxiv.org/abs/2609.04653
作者：Ekata Mitra,Ameeta Agrawal
类目：Computation and Language (cs.CL)
关键词：Multilingual large language, large language models, Multilingual large, stronger English-centric representations, large language
备注： Accepted in Findings of EMNLP 2026
点击查看摘要
Abstract:Multilingual large language models often struggle to reason in low- to mid-resource languages. Prior work has shown that translation can improve multilingual reasoning by helping models access stronger English-centric representations. This raises a central question: How much translation is needed for multilingual large language models to reason reliably, and when does more translation instead trigger interference and overconfidence? Using LLaMA and Qwen models, we run extensive experiments varying text scope and language mode (target-only, English-only, bilingual) to evaluate both accuracy and reliability. Our results reveal a clear trade-off: English context often improve understanding and recover errors caused by non-English comprehension, yet adding redundant bilingual context intensifies interference. We address this trade-off with Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that (i) performs Expected Calibration Error (ECE)-aware routing and prompt fusion, and (ii) uses a mid-layer Risk Index (RI) to gate sequential reasoning, allocating compute only when it is likely to help and suppressing harmful bilingual redundancy. Across two model families, RAAI enhances accuracy by 25-37.7% on low-resource languages and lowers calibration error by approximately 3-6%, with the most pronounced benefits in the lowest-resource language tiers.
Comments:
Accepted in Findings of EMNLP 2026
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.04653 [cs.CL]
(or
arXiv:2609.04653v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.04653
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
52. 【2609.04648】ConsensusBench: Benchmark of Consensus Nodes for LLM Reasoning via Outcome Reward Densifying
链接：https://arxiv.org/abs/2609.04648
作者：Shi-Qi Yan,Chao-Hong Tan,Qian Chen,Wen Wang,Xiangang Li,Zhen-Hua Ling
类目：Computation and Language (cs.CL)
关键词：large language models, Group Relative Policy, Relative Policy Optimization, language models, Group Relative
备注：
点击查看摘要
Abstract:Reinforcement learning (RL) has become one of the primary paradigms for reasoning enhancement of large language models (LLMs). In particular, Group Relative Policy Optimization (GRPO) and related algorithms have demonstrated strong performance with outcome-level rewards. However, these methods depend solely on the final answer, without feedback regarding which intermediate steps contribute to success or failure. As task complexity and reasoning trajectory length increase, such sparse final-answer rewards become increasingly insufficient. To address this limitation, we introduce ConsensusBench, a novel dataset designed to provide rule-based process-level signals. We posit that a correct final answer relies on a small set of intermediate conclusions throughout the reasoning process, which can be seen as a verifiable sub-outcome. We identify these sub-outcomes by filtering correct trajectories from N rollouts and clustering semantically equivalent intermediate statements. We call these clustered statements as Consensus Nodes. By integrating a rule-based process reward derived from these nodes into GRPO-style algorithms, we develop a new reinforcement learning signal named ConsensusPR. It directly reduces the reward sparsity of outcome reward across long reasoning trajectories. To facilitate systematic process-level evaluation, we introduce three metrics to our benchmark: Final Answer Accuracy (Acc), Node Coverage Rate (NCR), and Tokens per Node (TPN). Experiments across AIME 2024, AIME 2025, GSM8K, MATH-500, and our ConsensusBench demonstrate that the proposed method consistently surpasses GRPO-style approaches, highlighting the practical value of consensus nodes in guiding reasoning.
53. 【2609.04647】CAGE: Coherence-Aware Graph Encoding for Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2609.04647
作者：Tong Qi,Jingyu Wu,Youbing Yin,Spencer Hong,Daben Liu,Erin Babinsky
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Traditional Retrieval-Augmented Generation, Traditional Retrieval-Augmented, Retrieval-Augmented Generation, assembling context sets, systems score
备注：
点击查看摘要
Abstract:Traditional Retrieval-Augmented Generation (RAG) systems score each passage independently against the query, assembling context sets that may be individually relevant yet collectively incoherent. We introduce Coherence-Aware Graph Encoding (CAGE), a reranking framework that models "between-chunk coherence" across four dimensions: Intra-Domain Relevance, Noise Resistance, Informational Bonding, and Factual Consistency. Our pipeline transforms retrieved passages into directed heterogeneous entity graphs, amplifies factual anchors via min-out-degree reweighting, encodes structural patterns through a Relational Graph Convolutional Network, and fuses inter-chunk coherence with query relevance for final ranking. Evaluated across four multi-hop benchmarks, CAGE matches or outperforms strong baselines including monoT5 in Recall@5 on bridge-dominated datasets and consistently improves downstream Exact Match, demonstrating that structurally coherent context yields more precise answers even when retrieval recall is comparable or lower.
54. 【2609.04645】Latent-Aligned Reasoning for Multimodal Recommendation
链接：https://arxiv.org/abs/2609.04645
作者：Jiarui Jin,Anyang Ji
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Vision-Language Models, term cross-modal dilution, signals progressively attenuate, demonstrated remarkable capabilities, fundamental challenge persists
备注：
点击查看摘要
Abstract:Multimodal Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding, yet a fundamental challenge persists when applying them to recommendation: as representations propagate through multi-step reasoning, both visual and textual signals progressively attenuate - a phenomenon we term cross-modal dilution. To address this, we propose LARK (Latent-Aligned Reasoning frameworK), a two-stage latent reasoning framework with complementary alignment mechanisms within a single VLM. In the first stage, learnable latent tokens are interleaved with multi-step chain-of-thought (CoT) reasoning and explicitly aligned with a frozen vision encoder, serving as visual checkpoints that preserve perceptual details throughout the reasoning chain. In the second stage, the latent representations are projected via a bridge MLP and trained with item-to-item contrastive learning; to prevent the reasoning semantics from fading, intermediate features are aligned with the CoT hidden states from the first stage, anchoring the final embeddings to the model's own reasoning output. Experiments on three public benchmarks and one industrial dataset show that LARK achieves state-of-the-art performance across multiple recommendation architectures, with controlled ablations confirming the distinct contribution of each component.
55. 【2609.04637】racing Audio Grounding and Answer Selection in Audio LLMs
链接：https://arxiv.org/abs/2609.04637
作者：Hyebin Cho,Suho Yoo,Jihoo Jung,Joon Son Chung
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)
关键词：Large Language Models, Audio Large Language, Large Language, Language Models, Audio Large
备注： Preprint
点击查看摘要
Abstract:Audio Large Language Models (Audio LLMs) have advanced in audio understanding, yet they can still predict the answer by reasoning from textual cues or linguistic priors rather than the provided audio. A common remedy is to train models on data whose answers cannot be inferred from text alone. This approach can improve performance, but what changes within the model remains unclear. In this paper, we ask what must happen inside the model for the audio to actually determine the answer. Our findings are threefold. (1) Replacing the audio with silence or unrelated audio causes substantially larger performance degradation in the trained model than in the pretrained model. (2) Acoustic information most strongly shapes the model's representations of the answer choices in early-to-middle layers, while training mainly increases the influence of audio information on the final prediction in middle-to-late layers. (3) The weights learned during training have their largest impact in specific layer bands. Together, these results provide a mechanistic account of how training strengthens the use of acoustic evidence in Audio LLMs.
56. 【2609.04598】PetQA: Benchmarking Veterinary Knowledge and Clinical Reasoning
链接：https://arxiv.org/abs/2609.04598
作者：Taegyun Kim,Youngwook Ham,Jungwook Rhim,Ju-Hyun An,Sungkyu Park,Kunwoo Park
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Korean long-form question-answering, large vision-language models, evaluating veterinary knowledge, Korean long-form, large vision-language
备注： EMNLP 2026
点击查看摘要
Abstract:We introduce PetQA, a Korean long-form question-answering (QA) benchmark for evaluating veterinary knowledge and clinical reasoning in large language models (LLMs) and large vision-language models (LVLMs). PetQA contains 10,076 text-only and 8,751 multimodal QA pairs derived from real-world questions about dogs and cats, paired with answers from expert veterinarians. Its test split, PetQA-Bench, further includes annotations for question types and clinical conditions. We evaluate eighteen models using ROUGE, BERTScore, and LLM-as-a-judge metrics for factuality and helpfulness under three settings: zero-shot inference, retrieval-augmented generation (RAG), and supervised fine-tuning (SFT). The benchmarking results provide an overview of the strengths and limitations of current models in addressing veterinary clinical queries and highlight the need for more effective adaptation methods to develop clinically reliable AI systems for veterinary care. To facilitate broader use, we additionally provide translated versions of PetQA-Bench in five languages.
57. 【2609.04585】JLIR: A Julia-Native MLIR-Inspired Intermediate Representation with Automatic JACC Kernel Extraction
链接：https://arxiv.org/abs/2609.04585
作者：Narasinga Rao Miniskar,Seyong Lee,Keita Teranishi,Jeffrey S Vetter
类目：Programming Languages (cs.PL); Computation and Language (cs.CL)
关键词：made reusable compiler, reusable compiler infrastructure, compiler infrastructure practical, Intermediate Representation, domain-specific computation
备注：
点击查看摘要
Abstract:The Multi-Level Intermediate Representation (MLIR) has made reusable compiler infrastructure practical for domain-specific computation. However, MLIR's strong compile-time type requirements and low-level (C++) extension model can be a poor match for high-level, dynamically specialized languages such as Julia. MLIR has several drawbacks for dynamic programming languages in terms of the type system and level of abstraction. It is thus extremely challenging for non-compiler or scientific computing users to introduce new programming abstractions and express algorithm implementations in a form that remains both natural and optimizable. As a result, library interfaces for linear algebra, mesh processing, partial differential equations, and related domains often sit outside the compiler optimization path. We present JLIR (Julia-native Level Intermediate Representation), a Julia-native intermediate representation framework that brings the main benefits of MLIR-style multi-level, dialect-oriented compilation into the Julia ecosystem while remaining usable as ordinary Julia code. JLIR represents Julia programs before low-level lowering, supports extensible operations and transformation passes through Julia's language mechanisms, and allows partially typed programs to remain transformable until concrete types are known. The framework includes built-in dialects for arithmetic, control flow, functions, structured loops, and memory operations, and it also includes a lightweight mechanism for adding new domain operations without modifying the core system. To demonstrate JLIR's capabilities, we applied it to automatic Julia for Accelerators (JACC) kernel generation.
58. 【2609.04582】When Do Internal Probes Beat Reading the Answer? Miscalibrated Readouts and Behavior-Concealed Knowledge in Language Models
链接：https://arxiv.org/abs/2609.04582
作者：Gnaneswar Villuri,Hashmath Shaik,Alex Doboli
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：single semantic edit, half valid, half corrupted, asked to verify, semantic edit
备注：
点击查看摘要
Abstract:A 0.6B language model, asked to verify 1,200 logical conclusions (half valid, half corrupted by a single semantic edit), answers YES every time. Judged by behavior it discriminates nothing; linear probes on its hidden states read the correct verdict at 0.96 AUC, transferring to unseen logical structures and separating foils built from exactly the words of the true conclusion (0.90). We ask where the verdict is lost, and find the dominant failure is a single scalar. The verdict survives to the model's own output logits (margin AUC 0.89) along a well-aligned readout direction; a saturated decision threshold, offset by +4.6 sigma, erases it. The diagnosis generalizes: across 90 semantic-label configurations of a five-model, three-family factorial, behavioral accuracy collapses onto a single function of threshold offset (Spearman -0.93) while margin ranking moves far less. Across a 13x scale range, internal knowledge saturates while free-form behavior is non-monotone: an 8B model underperforms its 4B sibling through an answer-channel failure rather than the threshold; forced-choice accuracy is monotone. The diagnosis is actionable: a one-parameter correction, never fit on evaluated structures, repairs behavior from 50% to 81% (0.6B); calibrated margin decoding recovers 94% at 8B; few-shot prompting works the same way, recentering the threshold (+4.6 sigma to 0.0 sigma) while preserving ranking. Comparing probe to margin separates three regimes: concealed, miscalibrated, and undetected. On a maze task built so foils carry no surface cues, the audit correctly reports the third. In the standard generation setting, answer-surface features and heuristic labels reproduce published probing results without any internal access.
59. 【2609.04579】Does the Selected Object Reach the Reader? Auditing Identity Handoffs in Grounded Language-Model Pipelines
链接：https://arxiv.org/abs/2609.04579
作者：Siddharth Vohra,Runmin Jiang,Xiaomo Li,Min Xu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Grounded language-model pipelines, Grounded language-model, evidence to answer, language-model pipelines, object
备注： 15 pages, 1 figure, 23 tables. Accepted to the GroundLM Workshop (Grounding Language Models: Learning Faithfully and Efficiently) at EMNLP 2026
点击查看摘要
Abstract:Grounded language-model pipelines can be divided into three stages: selecting an object, retrieving passages for it, and using that evidence to answer. If the selected object must reach the reader, losing it breaks the handoff. Benchmark recall checks the dataset-linked object, which can differ. We audit 600 HybridQA questions across three selector families. On 1,463 resolvable records where the selected object matches the dataset-traced passage, exact key lookup and exact title matching return the object every time. With every ranked rule given the same decoded selected title, body-only BM25 omits it on 389 records (26.6%) at cutoff five, while hybrid retrieval with reranking omits it on 14 (1.0%). The two identities differ on 329 of 1,792 resolvable records. With original-question rankings, their top-five checks disagree on 106 records (5.9%). Frozen reader comparisons associate the aligned object's presence with 28.6 to 31.0 points higher exact match. In a deliberately selected 64-item cohort, removing that passage sharply lowers exact match, while removing a similar-length comparison passage does not reproduce the drop. We release the Returned-Object Profile (ROP), an executable record of the target, returned-ID field, cutoff, membership rule, and complete expected population, with data and an offline replay.
60. 【2609.04565】Extremely Sparse Supervision Incentivizes Reasoning Ability
链接：https://arxiv.org/abs/2609.04565
作者：Zhishuai Liu,Xingzi Xu,Mehmet Saygin Seyfioglu,Pan Xu,Karim Bouyarmane
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, demonstrate increasingly strong, Large language, language models demonstrate, models demonstrate increasingly
备注：
点击查看摘要
Abstract:Large language models demonstrate increasingly strong reasoning capabilities through effective post-training. Yet, prevailing post-training methods optimize over massive numbers of tokens, implicitly assuming that effective learning must be token-intensive. We revisit this assumption in the on-policy distillation (OPD) setting, which naturally admits dense teacher supervision at every generated token. Using the Qwen3 family, we discover a counter-intuitive phenomenon: reasoning can be effectively incentivized by an extremely small fraction of generated tokens--as few as one or two tokens per reasoning trajectory, corresponding to only 0.05% of all tokens. Surprisingly, this sparse supervision in most cases matches or surpasses full-token training in improving reasoning ability, despite excluding the vast majority of generated tokens from the training objective. This phenomenon is consistently observed across nine teacher--student configurations spanning different model scales on mathematical reasoning tasks, and is further validated on coding reasoning, Llama models and Proximal Policy Optimization (PPO)-based reinforcement learning with verifiable reward (RLVR). Interestingly, such extremely sparse supervision may be closer to the natural learning process: rather than correcting every step word by word, one reflects on a few critical reasoning steps, updates prior understanding, and continues the trial-and-error, avoiding micro-level corrections while remaining remarkably effective. Overall, our results challenge the assumption that effective post-training must be token-intensive and point to a new direction for understanding and designing more efficient post-training algorithms.
61. 【2609.04556】Rhythms of Work: Multi-Scale Interpretation of Human Behavioral Traces for Workplace Agents
链接：https://arxiv.org/abs/2609.04556
作者：Lin Ai,Scott Counts
类目：Computation and Language (cs.CL)
关键词：understanding agentic systems, Runtime traces, agentic systems, central substrate, substrate for understanding
备注：
点击查看摘要
Abstract:Runtime traces are becoming a central substrate for understanding agentic systems, yet interpretation has focused largely on what the agent did. Workplace agents face the complementary problem: interpreting the human activity that surrounds them. Hours of low-level events carry rich evidence about a user's state but are too granular to reason over directly, and flattening them into one stream or compressing them into a single embedding both treat "summarize the user's behavior" as if it had one correct answer. We argue instead that behavioral interpretation is resolution-dependent: the same trace should admit multiple addressable interpretations at different temporal resolutions. We construct a multi-resolution vocabulary of semantically normalized operators, recurring motifs, coherent episodes, and day-level rhythms, each preserving the structure salient at its own horizon. Applied to 667 million human-attributed events from a large commercial productivity suite (50,000 users, 100 organizations), it yields 120 operator types, thousands of motifs, 25 episode types, and five day-rhythm archetypes. We validate it on real telemetry: re-running the entire pipeline on a disjoint 2,000-user sample recovers the same taxonomy (structural stability), and on held-out users the full representation forecasts a user's next episode more accurately than a flat-operator baseline, a 17% relative macro-F1 gain (predictive validity), so the abstractions preserve future-relevant information rather than merely describe it. A controlled resolution ablation then shows that no single level is optimal across questions: different agent-facing questions about the same trace are best answered at different resolutions. Behavioral trace interpretation for agents should therefore be multi-resolution and query-conditioned: an agent should access the temporal grain a question needs, not one universal summary.
62. 【2609.04539】A Calibrated Reflection Approach for Enhancing Confidence Estimation in LLMs
链接：https://arxiv.org/abs/2609.04539
作者：Umesh Bodhwani,Yuan Ling,Shujing Dong,Yarong Feng,Hongfei Li,Ayush Goyal
类目：Computation and Language (cs.CL)
关键词：deploying Large Language, Large Language Models, Large Language, outputs versus seek, deploying Large
备注： Published at TrustNLP 2025 (NAACL 2025 Workshop)
点击查看摘要
Abstract:A critical challenge in deploying Large Language Models (LLMs) is developing reliable mechanisms to estimate their confidence, enabling systems to determine when to trust model outputs versus seek human intervention. We present a Calibrated Reflection approach for enhancing confidence estimation in LLMs, a framework that combines structured reasoning with distance-aware calibration technique. Our approach introduces three key innovations: (1) a Maximum Confidence Selection (MCS) method that comprehensively evaluates confidence across all possible labels, (2) a reflection-based prompting mechanism that enhances reasoning reliability, and (3) a distance-aware calibration technique that accounts for ordinal relationships between labels. We evaluate our framework on diverse datasets, including HelpSteer2, Llama T-REx, and a proprietary conversational dataset, demonstrating its effectiveness across both conversational and fact-based classification tasks. This work contributes to the broader goal of developing reliable and well-calibrated confidence estimation methods for LLMs, enabling informed decisions about model trust and human judgement.
63. 【2609.04526】Scale-QLoRA: Code-Invariant Adapter Merging for Native 4-bit Microscaling LLMs
链接：https://arxiv.org/abs/2609.04526
作者：Tung-Ling Li,Jiale Huang,Lee-Chi Wang,Janaki Ram Gotei
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：runtime adapter per-forward, adapter per-forward overhead, single standalone checkpoint, standard deployment practice, LoRA adapter
备注：
点击查看摘要
Abstract:Merging a LoRA adapter into its base model is standard deployment practice: it removes the runtime adapter's per-forward overhead and leaves a single standalone checkpoint any serving stack can load. On a native 4-bit microscaling checkpoint (NVFP4, MXFP4) that step stops being free. The merged weights must be written back through a quantizer, which re-derives the checkpoint's discrete E2M1 code plane (roughly 90% of the artifact's bytes), so the deployed artifact becomes coupled to one quantization convention, and every later code-touching event in its lifecycle can move it. Done naively the step is worse than fragile: it deletes the adaptation, by up to 39 pp, because against an already-on-grid base the reconstruction optimum is that base. Scale-QLoRA instead adapts only the native per-block scale field, trains those scales on the deployment grid, and freezes every E2M1 code. Within a fixed native format, scale grid, block layout and code plane, merging is then a bit-exact identity and the merged artifact is code-invariant. Across four models and four tasks, Scale-QLoRA and merge-aware QAT-LoRA are both accuracy-lossless, so we claim no accuracy ordering between them; they differ structurally, in that QAT-LoRA re-derives the code plane through a quantizer while Scale-QLoRA preserves it exactly. That difference is what the lifecycle prices: nearest-rounding implementations disagree by about a point on the measured task, and more extreme rule mismatches can drive the weight-space artifact to ~0%, which we report as a sensitivity bound rather than a deployment frequency. Preserving the code plane also drops the weight-space straight-through estimator from training (3.9x per step on the dense 8B model) and enables exact rollback, code-plane deduplication, and a ~125x faster scale-only task swap.
64. 【2609.04511】LentEx: Generalizable Latent Entity Extraction via Synthetic Data and Instruction-Tuned LLMs
链接：https://arxiv.org/abs/2609.04511
作者：Umesh Bodhwani,Yuan Ling,Cibi Chakravarthy Senthilkumar,Shujing Dong,Yarong Feng,Hongfei Li,Ayush Goyal
类目：Computation and Language (cs.CL)
关键词：methods fall short, free text-an area, Latent entity extraction, extraction methods fall, entity extraction methods
备注： Published in IJCNN 2025. ©2025 IEEE
点击查看摘要
Abstract:Latent entity extraction (LEE) tackles the challenge of identifying implicit, contextually inferred entities within free text-an area where traditional entity extraction methods fall short. In this paper, we introduce LentEx, a novel framework for latent entity extraction that leverages synthetic data generation and instruction fine-tuning to optimize smaller, efficient large language models (LLMs). Latent entities, which are often abstract and thematic, are crucial for applications such as retrieval-augmented generation (RAG), customer persona analysis, and knowledge graph enrichment. LentEx addresses the scarcity of labeled datasets by employing a template-based approach to generate diverse, contextually rich synthetic data, ensuring high variability and alignment with real-world distributions. To our knowledge, LentEx is the first to systematically approach LEE through the lens of LLMs. LentEx demonstrates significant performance improvements across multiple tasks, notably surpassing state-of-the-art models on the MTEB Clustering Benchmark. Furthermore, our methodology enables robust generalization to unseen domains, making LentEx highly applicable in real-world NLP tasks, including RAG and clustering, thereby establishing a new paradigm for latent entity understanding and extraction in natural language processing.
65. 【2609.04495】Rethinking Indirect Prompt Injection as a Test-Time Search Problem
链接：https://arxiv.org/abs/2609.04495
作者：Duong M. Nguyen,Joon Sik Kim,Blazej Manczak,Vaikkunth Mugunthan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：indirect prompt injection, formulate indirect prompt, prompt injection, formulate indirect, indirect prompt
备注：
点击查看摘要
Abstract:We formulate indirect prompt injection as a test-time search over a task-dependent attack surface induced by the environment, user task, and injection task. To operationalize this formulation, we introduce an agentic attacker with a dedicated search harness that performs environment reconnaissance, structured reasoning over attack strategies, and adaptive evaluation using victim-agent feedback. Across heterogeneous tasks, we find that increasing attacker test-time compute improves vulnerability discovery and exploitation, while ablations show that explicit strategy management is important for avoiding redundant search and sustaining gains at larger budgets. These results suggest that agentic security evaluations should characterize both the attacker's search procedure and compute budget, rather than treating attack success as a budget-independent property of the victim. More broadly, our findings identify the attacker's adaptive search over the system attack surfaces as an important and underexplored security risk for tool-using agents.
66. 【2609.04489】owards Understanding Pause Token Fine-Tuning Dynamics: A Mode Retention Perspective
链接：https://arxiv.org/abs/2609.04489
作者：Jaehyeon Kim,Suhwan Kim,Nakyung Lee,Yeongoon Kim,Jimin Seo,Giho Lee,Jungwoo Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Pause-token methods improve, methods improve LLM, Pause-token methods, inserting special tokens, improve LLM reasoning
备注： 24 pages, 4 figures, 19 tables
点击查看摘要
Abstract:Pause-token methods improve LLM reasoning by inserting special tokens into sequences. Prior work explains these gains through computational expressivity. However, there is relatively little investigation into the training dynamics of pause tokens. We explore how pause tokens reshape the training dynamics of fine-tuning. Two controlled pilots expose distinct asymmetries. On a synthetic continual-learning task, masked pauses overwrite a previously-learned distribution roughly 4x less at matched final adaptation (H1, mode retention); on a synthetic math-reasoning probe, the boundary-adjacent token comes to encode substantially more downstream-step information (H2, non-myopic compression). We formalize a training rule consistent with both - Masked Boundary Pause (MBP), pause tokens placed at reasoning-step boundaries with their loss masked. Across 1B-8B Qwen and Llama models, MBP consistently improves reasoning, achieving gains of up to 6 points on math and 2.5 points on code, while preserving general language understanding abilities. We further demonstrate that this mode-preserving strategy extend gains to GRPO. These results recast pause tokens as a training-dynamics intervention on the retention-adaptation trade-off, rather than merely an inference-time computation device.
67. 【2609.04486】Uncertainty Signals for Network Intent Translation: Risk Ranking and Ambiguity Localization
链接：https://arxiv.org/abs/2609.04486
作者：Ala' A. Alsamarneh,Omar Alhussein
类目：Networking and Internet Architecture (cs.NI); Computation and Language (cs.CL)
关键词：Intent-based networking realization, Intent-based networking, networking realization starts, low-level network configurations, translating high-level intents
备注：
点击查看摘要
Abstract:Intent-based networking realization starts by translating high-level intents into low-level network configurations. Recent approaches have shifted toward LLM-based translation. Despite promising results, most studies focus on translation accuracy and overlook risks associated with deploying the resulting configurations. In this work, we investigate the pre-deployment translation risk of LLM-generated configurations by analyzing the model's uncertainty. We propose to use two uncertainty signals, namely sampling-based predictive uncertainty for translation-risk ranking and token-level entropy for ambiguity-source localization. We evaluate these signals on an ambiguity-controlled test set across different context types and sampling budgets, using a Llama-3.1-8B-Instruct model fine-tuned for intent translation on a vendor-specific switch platform (Juniper EX3300). The results demonstrate that predictive uncertainty provides a useful signal for ranking translations by risk across context types and sampling budgets, albeit with substantial miscalibration under less informative contexts. Moreover, we show that parameter-token entropy correlates with parameter-sourced ambiguity and keyword-token entropy correlates with description-sourced ambiguity. These results indicate the potential of using uncertainty signals in an LLM-generated configuration deployment pipeline, where predictive uncertainty can support selective deployment, while token-level entropy can identify sources of ambiguity.
68. 【2609.04485】Cultural Misalignment in Large Language Models: Detection, Measurement, and Mitigation Through Targeted Fine-Tuning
链接：https://arxiv.org/abs/2609.04485
作者：Antoni Czolgowski,Abel Iyasele
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：normalized Wasserstein distance, Survey Wave, World Values Survey, quantify distributional misalignment, normalized Wasserstein
备注： 33 pages, 14 figures. Extended version of a paper published in the proceedings of OSSConf 2026, Zilina, Slovakia. Code and data: [this https URL](https://github.com/AntoniCzolgowski/llm-cultural-bias)
点击查看摘要
Abstract:We evaluate three open-weight LLMs (Gemma3-12B from the USA, Bielik-11B-v3 from Poland, and Qwen3-4B from China) against World Values Survey Wave 7 data for 63 demographic personas across three countries, using normalized Wasserstein distance to quantify distributional misalignment. Contrary to expectations, no model favors its home country: the Chinese-built Qwen3-4B performs worst on its own Chinese population (W1 = 0.436, the highest misalignment in the entire model x country matrix). Targeted LoRA fine-tuning on the five worst-case personas, requiring fewer than 1,200 training pairs and under 15 minutes on a single GPU, reduces bias by 16.8% for Bielik-11B (p_Bonf = 0.002, d = -4.4) with all five targets improving. However, country-level decomposition reveals that fine-tuning redistributes rather than removes bias: Bielik's worst-case personas swap entirely from American to Chinese elderly, with zero overlap between pre- and post-correction sets. To our knowledge, this is the first study to target worst-case demographic personas with LoRA fine-tuning for cross-cultural bias mitigation.
69. 【2609.04484】Patterns of Priming in Production: Lexical, Semantic and Structural Alignment in Language Model Generation
链接：https://arxiv.org/abs/2609.04484
作者：Giulia Pucci,Ruizhe Li,Arabella Sinclair
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：paper investigates structural, preceding structural context, structural context influences, context influences sentence, language model
备注： EMNLP 2026 Findings
点击查看摘要
Abstract:This paper investigates structural priming in language model (LM) production, examining how preceding structural context influences sentence completion. While prior work has demonstrated priming effects in comprehension of structural alternations, it remained unclear whether these persist in production, where, when generating, an LM samples from many possible continuations at each step. We address this question through a series of controlled sentence-completion experiments on dative constructions. In line with prior work, we find that LMs are susceptible to structural priming, particularly in sentences that are semantically coherent. In terms of priming magnitude, we find that while there is a greater relative increase of double-object datives against our baselines, in line with inverse frequency effects, there is a larger absolute increase in prepositional-objects, the more frequently produced construction. Finally, we not only observe that structural priming is boosted by lexico-semantic coherence, but that structurally primed completions display greater levels of lexico-semantic repetition. Taken together, our evidence supports the view that structural priming in LMs operates across multiple levels of linguistic representation, facilitating, and facilitated by syntactic, lexical, and semantic alignment. Code: this https URL.
70. 【2609.04482】Safety for Whom? Boundary-Aware Self-Distillation for Controlled LLM Safety Refusal
链接：https://arxiv.org/abs/2609.04482
作者：Alejo López-Ávila,Iker García-Ferrero,Jezabel Garcia,Antonio Tiene,Román Orús
类目：Computation and Language (cs.CL)
关键词：subject harmful, topic-level question, Safety, refusal, Safety alignment
备注： 22 pages, 14 figures
点击查看摘要
Abstract:Safety alignment is usually posed as a topic-level question: is this subject harmful? Deployments ask a narrower one. A civics tutor and a public-sector assistant may share a base model yet need different boundaries inside the same topic, refusing targeted political manipulation while still answering factual questions about the same election. We formulate this as narrow-boundary safety and introduce an offline self-generated framework combining controlled topic generation, coverage repair, in-distribution compensation data, and harmful-benign pairs for training and evaluation. Single-shot generation leaves 19.88% of prompts without accepted refusal traces, whereas escalating retries leave 0.20%. On political persuasion with Qwen3-8B, training on refusal data completed through Escalate increases target-domain refusal from 9.47% to 84.75% and reduces the mean unsafe-response rate across three broader harmfulness benchmarks from 26.26% to 0.14%, but increases XSTest over-refusal from 2.00% to 74.00%. In a separate matched comparison, replacing external responses with verified target-model responses reduces over-refusal from 15.20% to 5.20%. Boundary-pair data reduces comply-side over-refusal on held-out pairs from 32.94% to 4.16%, while harmful-side refusal decreases only from 91.88% to 87.72%. These results show that data composition controls the safety and usability trade-off, and that safety alignment should be evaluated on both sides of the intended refusal boundary.
71. 【2609.04463】Shared circuits predict whether LLMs generalize across formats in arithmetic reasoning
链接：https://arxiv.org/abs/2609.04463
作者：Andrea Gregor de Varda,Sana Pandey,Pengrui Han,Jacob Andreas,Evelina Fedorenko
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：including arithmetic reasoning, solve numeric arithmetic, generalizing across superficial, effortless for humans, numeric arithmetic problems
备注：
点击查看摘要
Abstract:In many forms of reasoning, including arithmetic reasoning, generalizing across superficial changes in input format is effortless for humans: anyone who can solve 2+5 can also solve 'two plus five'. In contrast, LLMs are more brittle to surface variations of the prompts: for example, they solve numeric arithmetic problems almost perfectly but are substantially less accurate on verbal renditions of the same problems. Here, we ask whether generalization across formats can be predicted from the models' internals. Using attribution patching, we first independently localize the circuit that each model recruits to solve numeric arithmetic problems (2+5) vs. verbal ones, in three languages: English ('two plus five'), Spanish ('dos más cinco'), and Italian ('due più cinque'); then, we test whether overlap with the model's own numeric circuit predicts its generalization to the verbal formats. Indeed, we find support for this idea at three levels: circuit overlap accounts for the relative difficulty of the three verbal formats, for which models generalize best, and for which items are solved correctly, rivaling supervised probes while requiring no labeled data.
72. 【2609.04453】When Load-Balancing Goes Too Far: Expert Pruning in Over-Dispersed Mixture-of-Experts Models
链接：https://arxiv.org/abs/2609.04453
作者：Berkcan Kapusuzoglu,Connor Pryor,Sangwoo Cho,Supriyo Chakraborty,Shi-Xiong Zhang,Sambit Sahu,Milind Naphade
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：assuming router probabilities, router probabilities provide, reliable importance signal, low-importance experts identified, removing low-importance experts
备注： 22 pages, 7 figures. Preprint
点击查看摘要
Abstract:Expert pruning reduces the memory and serving cost of Mixture-of-Experts (MoE) models by removing low-importance experts identified by the router, assuming router probabilities provide a reliable importance signal. We observe that this assumption breaks down under over-dispersed routing, a regime associated with aggressive load-balancing during training, in which tokens are distributed nearly uniformly across experts and importance signals collapse. In this regime, perplexity does not predict downstream task accuracy: on gpt-oss-20B, the lowest-perplexity pruning configuration yields the worst mathematical reasoning, while the highest-perplexity configuration preserves it. This does not occur under standard routing (e.g., Mixtral-8x7B-Instruct), where perplexity and accuracy degrade together. Pruning under over-dispersed routing also exposes a capability trade-off in which no single scoring metric dominates: activation-aware scoring preserves mathematical reasoning but severely degrades knowledge-intensive science (an 18-point gap on GPQA), whereas frequency-based scoring exhibits the reverse. We propose Minimax Expert Score Allocation (MESA), a domain-aware method that iteratively boosts importance scores for experts serving whichever domain is currently worst-affected, minimizing worst-case domain degradation rather than average accuracy. At 25% expert pruning MESA achieves the smallest worst-case degradation across domains, outperforming activation-aware baselines on 7 of 11 benchmarks at a correspondingly reduced memory footprint, and it generalizes to gpt-oss-120B, Gemma-4-26B-A4B, and OLMoE-1B-7B. Our results indicate that over-dispersed routing is a qualitatively distinct pruning regime in which standard assumptions fail, and that recognizing it is a prerequisite for principled expert pruning of load-balanced MoE models.
73. 【2609.04452】RILOGUE: A Trilingual Spoken Dialogue Fact-Checking Benchmark with Evidence and Paired Audio
链接：https://arxiv.org/abs/2609.04452
作者：Chaewan Chun,Meruyert Aristombayeva,Jiyoung Choi,Mahjabin Nahar,Delvin Ce Zhang,Dongwon Lee
类目：Computation and Language (cs.CL)
关键词：Modern misinformation, clean written claims, Automatic Speech Recognition, spoken dialogue fact-checking, clean written
备注： To appear in EMNLP 2026
点击查看摘要
Abstract:Modern misinformation is often heard before it is read, yet fact-checking systems are still evaluated mainly on clean written claims. Spoken dialogue remains different even when systems operate on transcripts: claims may be distributed across speakers and turns, depend on prior context, and become harder to verify when Automatic Speech Recognition (ASR) errors distort the available text. Prior spoken dialogue fact-checking resources are small, English-centric, or focused on annotation rather than end-to-end benchmarking, leaving no large multilingual benchmark with paired speech and turn-level labels. We introduce TRILOGUE (TRIlingual spoken diaLOGUE fact-checking), a large-scale trilingual benchmark of source-grounded spoken dialogues in English, Russian, and Kazakh. It contains nearly 12K dialogues, 187K turns, and 390 hours of paired audio with ASR transcripts and word-level timestamp alignments across all three languages, including nearly 5K human-recorded Russian and Kazakh dialogue files. TRILOGUE supports claim check-worthiness detection, source-article evidence retrieval, and claim verification with claim-only, gold-evidence, and retrieved-evidence inputs. Baselines show that ASR degradation and cross-lingual transfer remain challenging, especially for Kazakh, while retrieved source evidence substantially narrows the gap to gold-evidence verification.
74. 【2609.04445】Conformity Breaks Conformal Prediction
链接：https://arxiv.org/abs/2609.04445
作者：Yibo Hu,Hanyu Su
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：model scores answers, unanimously assert, LLM answers, wrong answer, LLM
备注： 19 pages, 6 figures, 11 tables. Code: [this https URL](https://github.com/yibo-hu-lab/conformity-breaks-conformal)
点击查看摘要
Abstract:A conformal certificate can be valid when an LLM answers alone and invalid when the same LLM sees peers that unanimously assert a wrong answer. The question is unchanged; the model's score for the correct answer changes. We call this a score-mechanism shift: clean calibration certifies how the model scores answers alone, but not how it scores them under peer pressure. We show that this shift silently breaks conformal prediction in multi-agent LLM systems. Across open-weight models and multiple-choice QA tasks, coverage falls from a calibrated 90% to 74% under unanimous-wrong peers at the standard alpha = 0.10 operating point. The average hides a sharper failure: by targeting the low-confidence items the certificate still covers, an attacker nearly halves coverage on that subgroup, from 87% to 47%, while the monitored average remains much higher. The failure also reaches the decision layer: a system that should escalate when uncertain can instead become confident enough to act on the attacker's wrong answer. Standard conformal fixes do not solve the problem, because the question distribution has not changed; the model's scoring behavior has.
75. 【2609.04442】GRACE: Graph-Grounded Reflective Agent Copilot Engine for Expert-in-the-Loop Knowledge Expansion
链接：https://arxiv.org/abs/2609.04442
作者：John Seon Keun Yi,Joshua R. Minot,Dokyun Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：high-stakes settings frequently, settings frequently generate, frequently generate plausible, Large language models, Large language
备注： AKBC Workshop @ EMNLP 2026
点击查看摘要
Abstract:Large language models deployed in high-stakes settings frequently generate plausible but ungrounded claims. Standard retrieval-augmented generation (RAG) pipelines offer limited remedy, since they retrieve isolated passages without tracking cross-document evidence relationships or quantifying uncertainty. We introduce GRACE (Graph-grounded Reflective Agent Copilot Engine), a framework that deconstructs LLM responses into atomic claims and grounds them against trusted knowledge priors within a weighted bipartite graph. Edge weights encode the closeness of each claim to the priors, enabling weighted centrality analysis that classifies claims as Grounded, Refuted, or Boundary. Such classification identifies not just hallucinations but also novel or contested claims at the frontier of the model's knowledge. To efficiently allocate human or agent resources, we formulate a Return on Attention (RoA) objective that defers a claim to expert review only when its priority-weighted uncertainty exceeds the cost of verification. Claims verified by experts are promoted to new evidence anchors, closing a validator-LLM evolutionary loop that expands the knowledge base across iterations. We evaluate GRACE across multiple language models and on datasets spanning both general and domain-specific knowledge. Our results show that our knowledge base serves as a reliable foundation for retrieval that outperforms RAG baselines, and that the RoA framework efficiently selects valuable boundary knowledge for expert verification. These findings demonstrate that graph-structured representations combined with expert-in-the-loop verification can mitigate hallucination at the system level rather than at the generation level. Code available at this https URL
76. 【2609.04434】What Attention Recalls and Recurrence Controls in Hybrid Language Models
链接：https://arxiv.org/abs/2609.04434
作者：Kirill Afendulev,Alexey Dontsov,Elena Tutubalina,Anton Korznikov
类目：Computation and Language (cs.CL)
关键词：channel remains unclear, fixed-size recurrent state, recurrent state, Hybrid language models, remains unclear
备注： Accepted to Findings of EMNLP 2026. 13 pages, 3 figures, 8 tables. Code: [this https URL](https://github.com/kirillTerra/split-prefill)
点击查看摘要
Abstract:Hybrid language models combine attention with a fixed-size recurrent state, but the role of each channel remains unclear. We introduce two cache-level interventions. Split-prefill keeps only the KV cache or only the recurrent state from a prefilled context, then generates an answer. State-swap pairs the KV cache from one context with the recurrent state from another in a single forward pass. On Qwen3.5 and Falcon-H1, the two channels split sharply by function. Exact retrieval survives only through attention (64-98% of full accuracy) and collapses to zero through recurrence. Output language and persona reverse the pattern: both survive recurrence (70-80% and 3-5x) while KV-only drops to ~1% language accuracy. State-swap confirms this causally: the answer takes its value from the KV side and its language from the recurrent side. Recurrent-only generation also accepts words that were never in the context but share meaning or parts with seen items. Attention provides a lookup over what was said; the recurrent state shapes how the model says it next.
77. 【2609.04409】A Systematic Evaluation of Cross-Lingual Consistency Enhancement Methods in Multilingual Language Models
链接：https://arxiv.org/abs/2609.04409
作者：Jirui Qi,Mingyang Wang,Hinrich Schütze,Raquel Fernández,Arianna Bisazza
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：improve cross-lingual consistency, Multilingual language models, produce inconsistent answers, semantically equivalent questions, Multilingual language
备注： Preprint. All code and datasets will be released upon publication
点击查看摘要
Abstract:Multilingual language models often produce inconsistent answers to semantically equivalent questions across languages, motivating methods to improve cross-lingual consistency (CLC). However, existing methods are typically evaluated using different models, tasks, and protocols, leaving their relative strengths unclear. In this work, we present a unified evaluation of representative CLC-enhancement methods for question answering, spanning inference-time interventions and post-training approaches across three model families and three closed-form benchmarks. The results show that post-training methods are generally more reliable, with direct distribution alignment consistently improving CLC across all model-dataset combinations, while other methods are more sensitive to answer format and the breadth of language coverage. Notably, cross-domain transfer is limited unless source and target tasks share similar output formats. We further investigate whether CLC enhancement hurts models' ability to respond differently *when needed*, that is, when asked culture-dependent questions. Across two benchmarks of culturally diverse question answering, we find no systematic degradation in controlled closed-form evaluation, whereas open-ended generation reveals occasional accuracy reductions, particularly for non-English responses. Our work highlights the need to evaluate CLC enhancement for both cross-domain robustness and culturally appropriate variation, informing future work in post-training and benchmark development.
78. 【2609.04404】he Anatomy of an ASR Hallucination
链接：https://arxiv.org/abs/2609.04404
作者：Hamees Sayed,Apoorv Singh,Kumar Aman,Akshat Mandloi
类目：Computation and Language (cs.CL)
关键词：ASR systems, speech they receive, ASR, broader grounding failure, longer adequately guided
备注：
点击查看摘要
Abstract:ASR systems sometimes produce fluent text that is unrelated to the speech they receive. We view these hallucinations as one possible consequence of a broader grounding failure, in which the transcript is no longer adequately guided by the audio. To understand where this failure becomes possible, we study two independently trained Conformer-Large recognizers - one CTC and one RNN-T - under environmental degradation and speaker-background shift. In both models, the final encoder stage emerges as a critical boundary: bypassing the final block causes divergence on nearly every utterance, whereas bypassing middle blocks has little effect. At this same stage, the representations become more compact, text becomes readable by the trained decoder, and grapheme information becomes explicit. Importantly, the intervention produces garbled or repetitive output rather than fluent fabrication. Our result therefore identifies a mechanistic precondition for hallucination - the failure to produce adequately grounded output - not the complete origin of naturally occurring hallucinations. Together, the results reveal a consistent terminal-stage dependency for grounded recognition across two decoder families and multiple distribution shifts.
79. 【2609.04391】Evaluation of Phonetic Encoding Algorithms on Transcription Datasets
链接：https://arxiv.org/abs/2609.04391
作者：Can Özbey,Emre Kaplan,Berkin Deniz Kahya
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Rand Index measure, International Phonetic Alphabet, Rand Index, encoding algorithms conform, Index measure
备注： 17 pages, 3 figures, 5 tables
点击查看摘要
Abstract:In this work, a novel evaluation scheme built on a generalized variant of the Rand Index measure, namely, the Hüllermeier-Rifqi Index, is proposed in order to assess how well phonetic encoding algorithms conform to word-based transcriptions in IPA (International Phonetic Alphabet) notation. For this objective, the discordance score is obtained by calculating the absolute difference between the pairwise similarity values of ground-truth transcriptions and those of corresponding phonetic encodings, which are computed using normalized edit distance as a permutation dependent string metric. The resulting score is subsequently adjusted with respect to that of a random string generator incorporating the same alphabet as the encoder under consideration. A wide range of phonetic encoders were evaluated as such on multi-lingual transcription datasets along with their recall capabilities based on the collision rate. The validity of the proposed scheme is further supported by its applicability in measuring the orthographic transparency of a language when the writing system is viewed as an inherent phonetic representation.
80. 【2609.04384】You Really Didn't Get That? Benchmarking Social Pragmatic Inference for Indirect and Playful Chinese Online Comments
链接：https://arxiv.org/abs/2609.04384
作者：Shiwei Hong,Junjie Ma,Emma Jiren Wang,Ethan Z. Rong,Siying Hu,Haichang Li,Ziying Wang,Zhicong Lu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：Chinese online comments, indirect and playful, playful language, hard to interpret, Chinese online
备注： Accepted to the 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026), Main Conference
点击查看摘要
Abstract:Chinese online comments often convey social meaning through indirect and playful language that is hard to interpret without context. Existing evaluations largely organize items around predefined phenomena or controlled pragmatic categories, leaving open whether models can distinguish plausible readings of what a naturally occurring comment is doing in a particular exchange. We introduce a benchmark for evaluating whether LLMs can recover such situated pragmatic meanings. From more than 200,000 public Chinese social media interaction records, we construct 4,735 human-validated diagnostic items, each pairing a target comment with reconstructed preceding context and plausible misreadings. We evaluate eight LLMs as both question writers and solvers in a cross-writer setting. The task is challenging: the strongest model achieves 81.42% leave-writer-out accuracy. Across all eight models, the mean leave-writer-out accuracy is 68.70% while human accuracy was 90.8%. Case analysis shows that models often recognize broad irony or playfulness while misidentifying the mechanism or interactional move.
81. 【2609.04366】VERGE: Verification-Enhanced Refinement for Grounded Extraction of Early-Onset Colorectal Cancer Symptoms in Clinical Notes
链接：https://arxiv.org/abs/2609.04366
作者：Nikkie Hooman,Monarch Nigam,Amy E. Hughes,Rasmi G. Nair,Mehak Gupta
类目：Computation and Language (cs.CL)
关键词：including symptom duration, structured encounter data, colorectal-cancer risk factor, established colorectal-cancer risk, support early detection
备注：
点击查看摘要
Abstract:Early-onset colorectal cancer is increasing among younger adults, yet red-flag symptoms in this age group have no evidence-based guidelines for follow-up testing, and structured encounter data do not capture the detail needed to support early detection and inform follow-up, including symptom duration, context, and fam- ily history, an established colorectal-cancer risk factor. This study aimed to develop and evaluate an automated method for extracting six red-flag symptoms and family-history risk status from free-text clinical notes. We developed VERGE, an agentic workflow in which an initial label and evidence are proposed using retrieval-augmented generation, then passed through a bounded verification- refinement cycle that checks textual grounding and clinical validity, corrects and rechecks a claim until resolved or a limit is reached, and escalates unresolved claims for human review. VERGE was evaluated on 4,033 clinician-labeled note-finding pairs against a single-agent baseline, a rule-based clinical language-processing baseline, and an alternative underlying language model. Compared with the single-agent baseline, VERGE reduced false positive find- ings, improving precision from 0.764 to 0.849 and MCC from 0.681 to 0.730, a balanced gain across the precision-recall trade-off, and resolved most flagged errors autonomously, with human review required for only 1.5 percent of claims. These results indicate that a bounded, verification-based workflow can reduce unnecessary positive findings without sacrificing the ability to detect true ones. This approach offers a path toward more reliable and trustworthy clinical language-processing tools to support colorectal cancer risk assessment in younger patients.
82. 【2609.04362】Knowing When Not to Answer: Pseudo-Ensembles for Abstention in Music Audio-Language Models
链接：https://arxiv.org/abs/2609.04362
作者：Aanya Maheshwari,Vatsal Raina
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：Music audio-language models, audio-language models, model, multiple-choice questions, entropy
备注： 11 pages, 4 figures, 3 tables
点击查看摘要
Abstract:Music audio-language models are evaluated almost entirely by accuracy on multiple-choice questions. This protocol forces the model to commit to an option, so a lucky guess looks the same as real musical understanding. What is missing is a way to tell when the model does not know the answer, so that it can abstain instead of guessing. The usual solution, an ensemble of independently trained models, is far too expensive here, which leaves the entropy of a single predictive distribution as the only available confidence signal. We instead build pseudo-ensembles from one pretrained model by perturbing its input in ways that cannot change the correct answer, then averaging the resulting distributions over the options. Our main construction simply shuffles the order in which the candidate answers are presented; we also study ensembles built from corrupted audio and from swapped option labels. A pseudo-ensemble gives several predictive distributions per question, so it supports the full family of ensemble-based uncertainty measures (entropy of the expected distribution, expected entropy, and their difference, the mutual information) rather than entropy alone. Evaluating TinyMU on MuChoMusic, we find that averaging over four option orderings raises accuracy from 55.7% to 59.2%, and that the resulting uncertainty measures rank the model's errors better than the single-pass entropy baseline, reducing the area under the error retention curve from 0.293 to 0.261. All of this costs a few extra forward passes and no retraining, which makes abstention practical for compact music audio-language models.
83. 【2609.04350】Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors
链接：https://arxiv.org/abs/2609.04350
作者：Vivian Nguyen,Lillian Lee,Elizabeth A. Olson,Cristian Danescu-Niculescu-Mizil
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：positive outcomes, counselors, cs.CL, moments, learn
备注： To be presented at EMNLP 2026. Code available at [this http URL](http://convokit.cornell.edu)
点击查看摘要
Abstract:How do people learn to become better conversationalists? This question is especially important in the context of mental-health counseling, where conversational skills are essential, yet volunteer counselors often have limited access to supervision and structured feedback. Understanding how counselors develop their ability to steer conversations toward positive outcomes -- and identifying early which counselors are (not) on track to improve -- can help prioritize support for the counselors who need it most. In this work, we introduce the task of predicting, early in a conversationalist's career, whether they will eventually improve at steering conversations toward positive outcomes, and demonstrate the feasibility of this task in the case of volunteer mental-health crisis counselors. Our central insight is that people may struggle with particular kinds of moments in a conversation, and that what is especially revealing of their likelihood of future improvement is how they learn to handle those moments over time. We operationalize this insight by designing a method that identifies the types of moments a counselor initially struggles with, captures how they adapt their response when they re-encounter similar moments in subsequent conversations, and learns which early adaptations predict improvement months or even years later. While this future-prediction task is challenging, our counselor-adaptation approach yields better results than baselines that learn directly from the conversation transcript.
Comments:
To be presented at EMNLP 2026. Code available at this http URL
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
Cite as:
arXiv:2609.04350 [cs.CL]
(or
arXiv:2609.04350v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.04350
Focus to learn more
arXiv-issued DOI via DataCite</p>
84. 【2609.04344】SharedSAE: One Feature Dictionary Across Language Models
链接：https://arxiv.org/abs/2609.04344
作者：Daniil Ognev,Célian Vasson,Lijie Hu,Kentaro Inui,Benjamin Heinzerling
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Sparse autoencoders, labelling are typically, typically repeated, SAE training, Sparse
备注：
点击查看摘要
Abstract:Sparse autoencoders (SAEs) are widely used to interpret language model activations, but SAE training and latent labelling are typically repeated for every model. Here, we show that a single shared SAE can replace a collection of dedicated per-model SAEs. Our method, SharedSAE, combines a shared dictionary with model-specific encoder-decoder pairs. Unlike the closest prior method, which discards activation magnitudes and requires all models at inference, SharedSAE instead normalizes only selection scores, preserving magnitudes, and uses model dropout for single-model inference. We train SharedSAE on four 1B-scale base language models spanning distinct families and tokenizers. Despite sharing its latents across models, SharedSAE retains 96.6% of dedicated SAEs' mean explained variance; its latent activations exhibit cross-model correlations 1.8 times as high as separate SAEs aligned post-hoc, and its latent descriptions transfer across models. After the dictionary is frozen, new models can be efficiently adapted to it, achieving near-dedicated-SAE reconstruction quality while reusing the shared latent descriptions.
85. 【2609.04343】A Removal Based Approach to Improve LLM Faithfulness at Test-Time
链接：https://arxiv.org/abs/2609.04343
作者：Qinglan Luo,S M A Nahian,John Guttag,S. Mazdak Abulnaga,Katie Matton
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, auditing model behavior, important tool, tool for auditing
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for consequential decisions, making their explanations an important tool for auditing model behavior. Unfortunately, these explanations can be unfaithful, failing to reflect the actual reasoning underlying the model's decisions. We consider a setting in which an LLM provides both an answer and an explanation in response to a question. We identify two distinct dimensions of unfaithful explanations: incompleteness, meaning that the explanation omits factors that influence the answer, and unsoundness, meaning that the explanation cites factors that did not influence the model's answer. Existing approaches to improving LLM faithfulness include training-time methods, which require access to model weights and extensive computational resources, and test-time methods that largely focus on addressing unsoundness. We introduce a test-time approach that directly targets incompleteness. We remove from the input the concepts not credited in the model's explanation and re-query the model on the reduced input. This eliminates unmentioned influences while preserving the influence of mentioned concepts. Across two datasets, multiple model families, and two independent faithfulness metrics, our approach improves explanation faithfulness compared to both standard prompting and prompting to encourage faithfulness. Our method is model-agnostic and can be applied at inference time without modifying model parameters, providing a flexible mechanism for reducing hidden influences and improving the reliability and safety of LLM-assisted decision making.
86. 【2609.04336】MedProb: Probing Internal Representations of Vision-Language Models for Medical Question Answering
链接：https://arxiv.org/abs/2609.04336
作者：Erfan Nourbakhsh,Ke Yang,Anthony Rios
类目：Computation and Language (cs.CL)
关键词：visual question answering, complex multi-agent pipelines, require medical fine-tuning, Medical visual question, question answering
备注： Accepted to EMNLP Findings 2026
点击查看摘要
Abstract:Medical visual question answering (Med-VQA) is often assumed to require medical fine-tuning, large models, or complex multi-agent pipelines. We revisit this assumption with \textbf{MedProb}, a lightweight probing framework that predicts multiple-choice Med-VQA answers from frozen VLM representations without free-text generation. Across PATH-VQA, SLAKE, and VQA-RAD, MedProb recovers substantially more answer-relevant signal than prompting and performs stronger than medical VLMs and agentic systems. Probing also reduces the apparent gap between small and large models compared to prompting, suggesting that smaller VLMs contain more recoverable Med-VQA signal than generation-based evaluation reveals. Across 14 matched general-purpose and medical VLM pairs, medical adaptation does not consistently improve this linear decodability. Finally, free-text generation exhibits an answer-position bias of up to 10 percentage points, whereas MedProb also has positional bias, however, it is impacted differently than prompting. Our main results target the multiple-choice/multiclass Med-VQA setting; we additionally show the probe can be extended to open-ended generation via a rejection-sampling scoring procedure.
87. 【2609.04303】Abstraction Agent
链接：https://arxiv.org/abs/2609.04303
作者：Boning Li,Longbo Huang
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT)
关键词：groups strategically similar, scaling game-solving algorithms, strategically similar private, Information abstraction, similar private states
备注：
点击查看摘要
Abstract:Information abstraction, which groups strategically similar private states into a tractable number of buckets, is essential for scaling game-solving algorithms to large imperfect-information games. Constructing effective abstractions, however, has traditionally required domain-specific evaluators such as hand-strength calculators or equity estimators, which demand expert knowledge and engineering effort and are unavailable for most less-studied games. We propose the Abstraction Agent, a zero-shot pipeline that uses a large language model (LLM) to discover continuous strategic features from a natural-language game description, score private states on these features, and cluster them into abstraction buckets, without any game-specific evaluator, training data, or game-tree traversal during abstraction construction. The pipeline runs in four phases: feature discovery with calibration anchors, batched private-state scoring, correlation-based feature selection, and $k$-means clustering. The resulting abstractions reduce lifted-strategy exploitability by up to 62% relative to an expected-hand-strength baseline on heads-up no-limit Texas hold'em (HUNL) turn endgames, and beat a scalar rank baseline at every granularity on ROVER Trials, an original game absent from any pretraining corpus. Beyond these quantitative benchmarks, the pipeline transfers with unchanged prompts to four-card Pot-Limit Omaha, HUNL preflop and flop, and Riichi Mahjong, where the discovered features track each game's recognized strategic concepts. This is structured knowledge elicitation: converting implicit strategic knowledge in LLM parameters into explicit numerical features for downstream algorithmic computation. The code is available at this https URL.
88. 【2609.04298】Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation
链接：https://arxiv.org/abs/2609.04298
作者：Lin Shi,Haowei Lin,Zixuan Zhu,Xiaoyue Zhou,Xiang Li,Xiangning Lin,Yaxuan Deng,Han Xu,Yuangang Li,Shanda Li,Zizhao Chen,Hanwen Xing,Harsh Raj,Bo Chen,Quan Shi,Steven Dillmann,Yipeng Gao,Puneesh Khanna,Ruofan Lu,Chao Beyond Zhou,Michael Yang,Robert Zhang,Siyuan Chai,Jiayu Chang,Yizhao Chen,Xiaokun Chen,Yiwei Dai,Wenting Yang,Hange Liu,Minghao Liu,Zihan Wang,Adnan El Assadi,Benedikt Stroebl,E. Kelly Buchanan,Han Meng,Junwei He,Longxuan Yu,Radin Shayanfar,Yukyung Lee,Zhikang Dong,Allen G Hart,Anjiang Wei,Anurag Kashyap,Arpandeep Khatua,Audrey Jixin Zheng,Chengrui Ma,David Heineman,Dubing Chen,Hai-Anh Trinh,Haishuo Fang,Hefan Zhang,Hui Shen,Issa Sugiura,Jiankai Sun,Jiechao Gao,Junhong Lin,Junnan Li,Kai Yang,Lei Hsiung,Maoyu Wang,Mengze Tang,Nabil Omi,Negin Raoof,Nicholas Edwards,Octavia Guo,Orfeas Menis Mastromichalakis,Pengliang Ji,Przemysław Hejman,Qi Qi,Qunshu Lin,Richard Zhuang,Rui Yang,Ruichen Zheng,Ryan Marten,Shaghayegh Fazliani,Shizheng Hou,Sicong Jiang,Sijie Li,Song Bian,Terry Yue Zhuo,Tianqing Wu,Tom Tang,Wanjia Zhao,Weihao Xuan,Wenhua Liang,Xian Liu,Xin Lan,Xuan Zhang,Xuandong Zhao,Yanchuan Tang,Yifan Jiang,Yijiang Li,Yitong Guan,Yizhi Li,Yonghui Liu,Yuheng Tang,Yujun(Audrey)Mao,Yunfei Zhao,Yuxin Wang,Yuxuan Tang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：require complex environments, Evaluating agents, growing number, require complex, complex environments
备注：
点击查看摘要
Abstract:Evaluating agents on the growing number of agentic benchmarks is challenging because they often require complex environments and agent integrations. We introduce Harbor Adapters, a unified evaluation infrastructure for agentic benchmarks. Our work makes three contributions. First, we develop benchmark adapters that port more than 80 benchmarks to evaluate arbitrary agents, and validate them through rigorous code review and parity experiments. Second, we conduct a large-scale evaluation of 8 models spanning capability tiers across 54 benchmarks; every model is run with Terminus-2 and with one of 3 native harnesses. This enables a broader analysis of agent capabilities and failure modes than was previously possible. Third, we introduce Harbor-Index, a curated set of 82 difficult, diverse, and high-quality tasks spanning 29 benchmarks, refined from the adapted suite through difficulty filtering, AI and human audit, and an audit-and-fix loop. Harbor-Index preserves the challenge and breadth of large-scale agentic evaluations while being affordable to run; no evaluated model-harness configuration exceeds 30% pass rate, and the strongest (GPT-5.5 with Codex) reaches 28.0%. We release the adapters, evaluation results, in-depth analysis, and Harbor-Index as open-source artifacts to support more reliable and comprehensive evaluation of language-model agents.
89. 【2609.04290】Evidence Integration in Large Language Models
链接：https://arxiv.org/abs/2609.04290
作者：Sebastien Kawada,Manolis Kellis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：remains largely unclear, form remains largely, retrieval-augmented generation, supplied by tools, largely unclear
备注： 114 pages, 16 figures, 38 tables
点击查看摘要
Abstract:Despite increasing reliance on LLMs that reason with external evidence supplied by tools, retrieval-augmented generation, other agents, and users, how LLMs integrate such evidence into decisions they have already begun to form remains largely unclear. We present a distributional theory in which evidence shifts the receiver's distribution of initial answers, driven by a receiver prior weight and a candidate evidence tilt, leading to three predictions. First, candidates more probable to the receiver are more persuasive. Second, receivers more readily integrate characteristic errors of their own than foreign errors from different sources. Third, identical evidence can improve weaker models and harm stronger ones. We confirm these over ten million trials, twelve LLMs from four families, and eight domains, four of them scientific discovery tasks in the physical and life sciences: quantum mechanics, physics, genetics, and molecular biology. The law also yields a receiver-relative reliability frontier: receiver-congruent errors depress performance more steeply than random errors of the same rate. LLMs also integrate candidates even after internally verifying their invalidity (93-100% with propositional constraints; up to 99.4% on held-out physical and life-sciences reasoning), demonstrating evidence integration is a receiver-specific control policy over existing distributions, determined by receiver properties rather than scalar trust in the evidence source. Causal interventions show candidate integration is implemented late in the network, as a structured sequence of steps admitting external candidate answers, promoting them, and transporting them into the answer state. Representations of verification are decodable but have little causal impact on answers. A J-lens decomposition shows the state underlying verbalized verification is fully dissociable from that underlying candidate integration.
90. 【2609.04289】Memory as transformation: LETHE, a self-referential gan-inspired architecture
链接：https://arxiv.org/abs/2609.04289
作者：Francesco Vitucci,Anthony Di Furia,Francesco Scagliola
类目：Computation and Language (cs.CL)
关键词：Temporal Hierarchical quasi-Equilibrium, sonic-oblivion system implemented, Temporal Hierarchical, Hierarchical quasi-Equilibrium, Generative Adversarial Networks
备注： Accepted at XXV CIM - Colloquio di Informatica Musicale, L'Aquila, 2026
点击查看摘要
Abstract:LETHE (Latent-parameter Evolution with Temporal Hierarchical quasi-Equilibrium) is a self-referential sonic-oblivion system implemented in SuperCollider. It adopts the formal vocabulary of Generative Adversarial Networks in a closed configuration without external datasets or supervision after initialization. Audio is processed by a 3 x 3 mixing matrix built around two delay lines; its nine coefficients and two delay times evolve through the interaction of a five-feature linear discriminator and a random-perturbation optimizer analogous to single-sample REINFORCE. The discriminator compares current energy behavior with an archive of the initial state and guides parameter updates. Circular, fixed, and live sources can be mixed independently. Across fixed and circular sessions with an ablation control, the active generator is necessary for parametric evolution ($\Delta c_{22}=0.000$ in all 15 ablation sessions). Situated in the tradition of self-referential electroacoustic music, LETHE delegates the sonic outcome to an adaptive closed loop whose parametric space is defined by the composer.
91. 【2609.04280】EVOHARNESSBENCH: Can Your Agents Keep Pace with an Evolving Harness?
链接：https://arxiv.org/abs/2609.04280
作者：Zixuan Ke,Vaidehi Patil,Haizhou Shi,Yang Li,Ye Liu,Sarath Shekkizhar,Anurag Koul,Jiayu Wang,Xuan Phi Nguyen,Semih Yavuz,Mohit Bansal,Shafiq Joty
类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL)
关键词：Modern LLM-based agents, Modern LLM-based, LLM-based agents operate, harness, agents
备注： [this https URL](https://mas-orchestra.salesforceresearch.ai/evoharness/)
点击查看摘要
Abstract:Modern LLM-based agents operate through a harness of tools, reusable skills, and specialist agents that shapes what they observe and what they can do. In practice, this harness continually evolves as new capabilities are added. We introduce EVOHARNESSBENCH, a benchmark for evaluating agents under controlled harness evolution across three axes (tools, skills, and agents). Unlike existing continual-learning benchmarks for agents, which typically place non-stationarity (i.e., what changes over time) in the task stream while keeping the harness fixed, EVOHARNESSBENCH places non-stationarity in the externally supplied harness itself. It contains 17 multi-stage harness streams constructed deterministically from verifier-based benchmarks, comprising 802 tasks, 520 tools, 42 skills, and 62 agents. We evaluate two complementary settings corresponding to the central challenges of harness evolution: deployment evaluation, which isolates retention of previously accessible competence as the harness expands, and self-evolving adaptation evaluation, which tests whether accumulated experience remains useful as new capabilities are introduced. Our results reveal three persistent gaps. First, harness expansion alone can degrade performance on previously solved tasks, producing harness-induced forgetting. Second, gains from self-evolving adaptation remain inconsistent across stages of harness evolution, capability axes, and environments. Third, retention and adaptation can pull in different directions: preserving earlier competence does not necessarily improve adaptation to newly introduced capabilities, and vice versa. These results establish harness evolution as a distinct challenge for building agents that can keep pace with an evolving harness while preserving previously effective behavior.
92. 【2609.04272】Evaluating Large Language Models for Forced Outage Risk Prediction: Benefits and Comparison to Machine Learning
链接：https://arxiv.org/abs/2609.04272
作者：Christos Petridis,Zoran Obradovic,Mladen Kezunovic
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：weather-related forced outages, labeled training data, large language models, study examines, examines the ability
备注：
点击查看摘要
Abstract:This study examines the ability of large language models (LLMs) to predict the risk of weather-related forced outages in the distribution grid in a zero-shot framework, without labeled training data. The problem is formulated as a binary severity classification task across three forecast horizons (3h, 6h, 12h), using six years of outage records and high-resolution weather data for a utility service area in central Texas. Four zero-shot LLMs are benchmarked against two supervised classifiers across two input configurations: one using current weather observations and the other using weather forecast data. Results show that supervised models outperform LLMs on macro-F1 and precision, while newer LLM generations achieve competitive scores. Beyond accuracy, LLMs offer complementary strengths in actionable reasoning and geographic scalability, suggesting that combining them with supervised models may be the best practice.
93. 【2609.04270】Reviewer Capability Governs Rejection Targeting, Not Repair Skill: Evidence from LLM Execute-Review-Revise Pipelines
链接：https://arxiv.org/abs/2609.04270
作者：Faizan Tanveer
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Multi-agent LLM pipelines, LLM pipelines increasingly, Multi-agent LLM, pipelines increasingly assign, LLM pipelines
备注： 6 pages, 5 tables. Code and data: [this https URL](https://github.com/faizan-tnvr004/llm-reviewer-capability)
点击查看摘要
Abstract:Multi-agent LLM pipelines increasingly assign roles, including execution and verification, to models of different capability tiers. This is done because running a flagship model at every stage is expensive. Previous literature has established that verification stages are not always beneficial, but holds reviewer capability roughly fixed relative to the executor. We vary it. We replace the reviewer with models spanning a capability range down to one that cannot solve the problems at all, and measure the outcome of every individual rejection. This is done across a constant set of 100 olympiad mathematics problems. A cross-family mid-tier reviewer improves final accuracy by 12 percentage points, from 52 to 64 percent (p = 0.0005), with zero damaged answers. Same-model self-review attains the highest error-detection rate of any condition (0.85 recall) yet yields no significant gain: it rejects 2.1 times as often for a third the repair rate (15 against 43 percent, p = 0.0074) and falsely rejects 35 percent of its own correct answers against 2 percent for the cross-family reviewer (paired p = 0.000015). The low damage rate of self-review proves to be an artifact of revision inertia rather than reviewer quality: of 18 falsely rejected correct answers, the three where the executor complied all became wrong, while the fifteen it ignored survived unchanged. Below a capability floor the role becomes inert: our weakest reviewer changed zero of 100 final answers while doubling token cost. These findings describe a single executor-reviewer configuration on 100 problems and should be read as a controlled pilot rather than a general claim about verification stages.
Comments:
6 pages, 5 tables. Code and data: this https URL
Subjects:
Software Engineering (cs.SE); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
ACMclasses:
I.2.11
Cite as:
arXiv:2609.04270 [cs.SE]
(or
arXiv:2609.04270v1 [cs.SE] for this version)
https://doi.org/10.48550/arXiv.2609.04270
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
94. 【2609.04263】Quality Recovery for Quantized KV Caches via Low-Rank Attention Adaptation
链接：https://arxiv.org/abs/2609.04263
作者：Seifeldin Abdellatif
类目：Hardware Architecture (cs.AR); Computation and Language (cs.CL)
关键词：Low-bit key, resulting quality loss, quality loss depends, autoregressive decoding, memory required
备注：
点击查看摘要
Abstract:Low-bit key--value (KV) caches reduce the memory required for autoregressive decoding, but the resulting quality loss depends on the model and quantizer. We keep the quantizer fixed and distill the floating-cache model's behavior into low-rank Q/K/V projection updates while the student executes a physically packed incremental cache. Across three seeds, 4-bit affine-cache adapters recover $54.24\%\pm2.47\%$ of the held-out perplexity gap on TinyLlama-1.1B and $75.96\%\pm4.04\%$ on Gemma-4-12B. On the same frozen NF4 Llama-3.1-8B base, one validation-selected run per quantizer recovers $60.42\%$ under KIVI K2V2 and $37.61\%$ under KVarN K4V2, while preserving 180-case associative retrieval. Gemma's score on an official 4K/8K RULER subset rises from 42.80 with the unadapted 4-bit cache to 48.33 after adaptation (46.15 floating), with substantial task heterogeneity. Finally, a 2-bit rank--token sweep reduces TinyLlama's 2-bit PPL from 576.10 to $11.4000\pm0.0059$ across three seeds, versus 10.3988 floating, but restores only 11--12 of 180 retrieval cases. These results show that low-rank projection adaptation can recover held-out quality across fixed cache formats, while perplexity recovery need not restore long-context retrieval.
95. 【2609.04223】How Much Does Corpus Choice Change Dependency-Distance Estimates?
链接：https://arxiv.org/abs/2609.04223
作者：Sirui Chen
类目：Computation and Language (cs.CL)
关键词：independently compiled corpora, Dependency-distance estimates derived, Dependency-distance estimates, compiled corpora, routinely treated
备注： 18 pages, 3 figures. Preprint
点击查看摘要
Abstract:Dependency-distance estimates derived from a single corpus are routinely treated as properties of a language, yet this assumption has not been tested across independently compiled corpora. We compared mean dependency-distance estimates across 38 same-language treebank pairs from Universal Dependencies v2.18, using concordance correlation, Bland-Altman analysis, and a twelve-specification multiverse design. Cross-treebank agreement was moderate at best: substituting one treebank for another reversed nearly 40 percent of pairwise language orderings, and treebank choice accounted for roughly 29 percent of between-group variance. This disagreement substantially exceeded within-treebank sampling error and persisted across all twelve preprocessing specifications. Nevertheless, every treebank confirmed dependency-length minimization (normalized ratio below 1). The data are more consistent with MDD as a corpus-conditioned composite of grammatical, register, and annotation factors than as a stable language-level parameter: the qualitative DLM universal survives corpus substitution, but the ordinal cross-linguistic ranking does not.
96. 【2608.24726】Arbitrary Polygon Oscillator: Generalizing Polygonal Synthesis to Arbitrary Shapes, Morphing, and Three-Dimensional Polyhedra
链接：https://arxiv.org/abs/2608.24726
作者：Antonio Argentieri,Francesco Scagliola
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：constant angular velocity, adopts constant arc-length, system adopts constant, Polygonal synthesis generates, proposed system adopts
备注： Accepted at 29th International Conference on Digital Audio Effects September 1 - 4, 2026 MIT, Cambridge, MA, USA
点击查看摘要
Abstract:Polygonal synthesis generates audio by traversing the perimeter of a polygon with a phasor; prior work uses a constant angular velocity, whereas the proposed system adopts constant arc-length (perimeter) velocity. Existing formulations operate on regular, parametrically defined polygons, producing smooth timbral transitions within a single family of shapes. This paper generalizes polygonal synthesis around a unified arc-length engine: vertex data of any origin feed the same DSP pipeline. First, we adapt the oscillator to accept arbitrary vertex configurations from an external buffer, opening the possibility for a broad class of closed polygons -- regular, irregular, or star-shaped -- to function as a waveform generator. Second, a hybrid interpolation algorithm enables smooth morphing between polygons with unequal vertex counts, passing through intermediate shapes that have no parametric description. Third, we extend the paradigm to three dimensions: a convex polyhedron rotated about three axes is sliced by a fixed horizontal plane, and the resulting cross-section yields a continuously variable polygon controlled by the solid's orientation. The system runs in RNBO (Cycling~'74) with a geometry caching strategy that avoids per-sample recomputation. Antialiasing combines a four-point polyBLAMP correction derived from runtime Bézier tangents with adaptive oversampling, adapting the correction geometrically to general vertex configurations without per-shape analytical derivation.
Comments:
Accepted at 29th International Conference on Digital Audio Effects September 1 - 4, 2026 MIT, Cambridge, MA, USA
Subjects:
Sound (cs.SD); Computation and Language (cs.CL)
ACMclasses:
H.5.5
Cite as:
arXiv:2608.24726 [cs.SD]
(or
arXiv:2608.24726v1 [cs.SD] for this version)
https://doi.org/10.48550/arXiv.2608.24726
Focus to learn more
arXiv-issued DOI via DataCite</p>
97. 【2609.04232】Automatic Speech Recognition for Multilingual Oral History Research
链接：https://arxiv.org/abs/2609.04232
作者：Sidney Wong,Chelsea Wong She,Eda Tang,Tiana Marshall Wong,Debbie Sew Hoy,Chelsea Wong
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
关键词：heritage language preservation, community-led heritage language, Automatic Speech Recognition, Cantonese language revitalisation, paper offers
备注： This preprint reflects an updated version of the manuscript prepared for Interspeech 2026, incorporating revisions based on reviewer feedback
点击查看摘要
Abstract:This paper offers a unique perspective on how speech technologies are being adopted by community-led heritage language preservation and revitalisation initiatives. As a community-led language maintenance strategy, oral histories play a crucial role in Cantonese language revitalisation in New Zealand. The development of Automatic Speech Recognition (ASR) toolkits, such as Whisper, have expedited what has often been a resource and time-intensive process of transcribing oral history collections. However, there is limited research into the effectiveness of ASR toolkits when applied to code-switched language contexts. Based on Word Error Rate (WER), the best performing Whisper model configuration achieved a WER of 12.10 at the expense of accurately transcribing unsupported non-English segments. However, Whisper remains a useful tool by providing a first-pass transcription using only 1% of the estimated time otherwise needed for manual transcription.
98. 【2609.04222】GEPARD - Generative, Prosody-aware, Autoregressive text-to-speech model for Realtime Dialogue
链接：https://arxiv.org/abs/2609.04222
作者：Denis Pavlov,Ulanbek Abdurazakov,Nursultan Bakashov
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
关键词：Realtime Dialogue, real-time spoken dialogue, spoken dialogue, present GEPARD, model for Realtime
备注： Technical Report. 37 pages, 11 figures, Demo samples, code, and open weights: [this https URL](https://huggingface.co/nineninesix/gepard-1.0) ; [this https URL](https://github.com/nineninesix-ai/gepard-inference) . Affiliation: Nineninesix, Inc
点击查看摘要
Abstract:We present GEPARD (Generative, Prosody-aware, Autoregressive text-to-speech model for Realtime Dialogue), a streaming text-to-speech model for real-time spoken dialogue. GEPARD generates speech autoregressively with an LLM backbone - text and audio embeddings are trained together in a single decoder-only model - and decodes it to a waveform with an FSQ-based neural codec, streaming audio chunk-by-chunk as text arrives. Our central goal is a TTS architecture served by a standard LLM engine (vLLM) without modifying its compute kernels. This defines the overarching design principle: the backbone is a standard full-attention transformer, while all non-trivial auxiliary mechanisms - zero-shot voice cloning, text augmentation, and classifier-free guidance - are moved out of the autoregressive decode loop into prefill, or distilled directly into the weights. On streaming end-to-end inference, a single stream reaches a Real-Time Factor of about 0.067 (roughly 15x faster than real-time); under 256 concurrent streams the system reaches an aggregate speedup of about 204x on a single server-class GPU. We detail: (1) system-level solutions for vLLM-native serving; (2) the "short register" (1-2 word) failure mode of autoregressive speech decoders, with diagnostic probes and a mitigation; and (3) distillation of two-pass classifier-free guidance over text into single-pass weights via Direct Preference Optimization (DPO).
Comments:
Technical Report. 37 pages, 11 figures, Demo samples, code, and open weights: this https URL ; this https URL . Affiliation: Nineninesix, Inc
Subjects:
Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
Cite as:
arXiv:2609.04222 [eess.AS]
(or
arXiv:2609.04222v1 [eess.AS] for this version)
https://doi.org/10.48550/arXiv.2609.04222
Focus to learn more
arXiv-issued DOI via DataCite</p>
99. 【2609.04206】Auditing Bias and Safety in Voice AI Customer Care
链接：https://arxiv.org/abs/2609.04206
作者：Vignesh Ethiraj,Ashwath David
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Sound (cs.SD)
关键词：increasingly mediate customer, mediate customer care, customer care interactions, customer care voice, systems increasingly mediate
备注：
点击查看摘要
Abstract:Voice AI systems increasingly mediate customer care interactions where caller presentation cues such as accent, affect, fluency, and urgency are available alongside the service request. Existing fairness and safety evaluations cover speech recognition disparities, spoken dialogue bias, and voice agent capability, but rarely treat customer care voice agents as stateful, multi turn, tool mediated systems where harm can appear as additional burden before any final denial occurs. We formalize a validation gated audit framework for such systems. The framework (i) separates native speech to speech, cascaded ASR to language model to TTS, and hybrid tool mediated architectures; (ii) uses matched service facts across controlled caller presentation conditions; (iii) validates fact invariance, presentation cues, artifacts, and acoustic measurements before inference; and (iv) records both material outcomes and path to service burden. We define the research problem, methodology, seven validation gates, a six family metric set, and claim boundaries for an active industry evaluation program. We illustrate the framework with a fully synthetic worked example of a refund dispute audit instance. Production system results are excluded from this release; public reporting is gated by the validation protocol.
信息检索
1. 【2609.05339】Does Your Agent's Memory Survive a Model Upgrade? A Controlled Study of Memory Portability
链接：https://arxiv.org/abs/2609.05339
作者：Ankit Goyal,Jaideep Ray
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：upgrades are routine, notes, Model upgrades, Model, memory
备注： 18 pages, 3 figures, 7 tables, under review
点击查看摘要
Abstract:Model upgrades are routine; memory migrations are not. An agent can keep the same memory store and still forget: a new model may interpret old notes differently, mixed embedding versions may break retrieval, and repair may fail without the original evidence. We compare memory as the same history is preserved verbatim for long-context reading (LC-RAW), divided into chunks for retrieval-augmented generation (RAG), compressed by a model into natural-language notes (NOTES), or normalized into a fixed-schema knowledge graph (KG-fixed). The study uses 48 synthetic histories with randomized answer codes, exact scoring, and two open-weight models with sub 10 billion parameters. Our measurements show that fixed-schema structures transfer reliably, with KG-fixed accuracy changing by only $+0.0004 \pm 0.0020$ following a writer swap. Conversely, compressed NOTES exhibit high model coupling, with accuracy shifting asymmetrically by $+9.91$ or $-13.28$ percentage points depending on the specific migration direction. In RAG systems, partial embedding migrations using a 50/50 mixed index capture only a 4.96-point accuracy improvement, forfeiting the majority of the 11.90-point gain achieved through full re-embedding. Diagnostic decomposition attributes 80% ($0.467 \pm 0.014$) of the NOTES accuracy deficit to information lost during initial construction, whereas retrieval failures drive 81% ($0.364 \pm 0.012$) of the RAG deficit. Finally, store-only repair of NOTES fails to reach a 90% performance recovery target in all 48 test cases, whereas retaining the raw source history enables successful recovery in 34 of 48 cases for one tested direction. These findings highlight the necessity of direction-specific migration testing, strict embedding space isolation, and the retention of source histories for memory repair.
Comments:
18 pages, 3 figures, 7 tables, under review
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
ACMclasses:
I.2.7; I.2.11; H.3.3
Cite as:
arXiv:2609.05339 [cs.AI]
(or
arXiv:2609.05339v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.05339
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
2. 【2609.05160】Students' Perception of Big Data Engineering in Higher Education Curricula: Expectations, Interest and Ethical Implications
链接：https://arxiv.org/abs/2609.05160
作者：Ioana-Georgiana Ciuciu,Petrescu Manuela-Andreea
类目：Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：Big Data Engineering, Big Data, Bioinformatics Master programs, Engineering course integrated, Data Engineering
备注：
点击查看摘要
Abstract:The study investigates students' interest and expectations in a Big Data Engineering course integrated with a Master curricula, as well as ethical implications of using Big Data. An anonymous online survey was conducted with 42 of the 67 students enrolled in the Big Data course offered to Computer Science and Bioinformatics Master's programs. The responses were analyzed and interpreted using thematic analysis, highlighting interesting aspects related to students' expectations, interest, and their perspective of the ethical implications of working with Big Data. The study concludes that, even though there is significant difference in students' background, the majority are interested in learning Big Data, for practical and personal reasons related to the potential for career growth and their passion for the field. The main expectation expressed is related to enhancing their knowledge related to Big Data via practical activities. All students demonstrate awareness of potential ethical threats related to security and privacy, while Computer Science students are aware of the possibility of introducing bias in data during acquisition and analysis and of potential abusive data usage.
3. 【2609.05116】Beyond Maintenance Manual Multimodal RAG: Suggesting What Tool
链接：https://arxiv.org/abs/2609.05116
作者：Seongjun Ha,Md Rashedul Islam
类目：Emerging Technologies (cs.ET); Information Retrieval (cs.IR)
关键词：pages remains time-consuming, remains time-consuming, locating the relevant, hundreds of pages, pages remains
备注：
点击查看摘要
Abstract:Aircraft technicians are required to consult the maintenance manual (MM) for nearly every task, and locating the relevant procedure across hundreds of pages remains time-consuming. Multimodal retrieval augmented generation (MRAG) has been proposed to address this, allowing technicians to retrieve procedures, together with the accompanying figures, through natural-language queries. However, retrieval alone does not tell the technicians which tools the task requires. The MM identifies special tools only when the corresponding step is reached, and it does not state hand tool requirements at all; to select hand tools, technicians are required to find the hardware dimension from the illustrated parts catalog (IPC) and infer the right tool from it. We therefore propose MRAG-SWAT, an extension of the MRAG pipeline that returns the required hand tools and special tools alongside the retrieved procedure. The framework was implemented for the Lycoming IO-360-N1A engine and demonstrated on eight test queries. By presenting the correct tools together with the procedure, MRAG-SWAT may help reduce repeated trips to the tool crib, prevent damage to aircraft caused by improper tool selection, and thereby avoid additional maintenance tasks and support continued airworthiness.
4. 【2609.05110】Embedding Surgery: Localized Updates for Adaptive Ranking Correction in Dense Retrieval
链接：https://arxiv.org/abs/2609.05110
作者：Maddalena Amendola,Antonio Mallia,Raffaele Perego
类目：Information Retrieval (cs.IR)
关键词：modern search engines, retrieval-augmented generation pipelines, recommendation platforms, core components, components of modern
备注： Accepted at the 35th ACM International Conference on Information and Knowledge Management (CIKM 2026)
点击查看摘要
Abstract:Dense retrieval systems are core components of modern search engines, recommendation platforms, and retrieval-augmented generation pipelines. They encode documents and queries into dense embeddings, enabling efficient semantic search via vector similarity. However, because document embeddings are computed offline and stored in static indexes, these systems struggle to adapt to user feedback or evolving search intent. To address this limitation, we introduce \emph{embedding surgery}, a lightweight approach for adaptive ranking correction in dense retrieval. The method applies localized, minimal updates to selected document embeddings at query time, guided by editorial feedback, user interactions, or pseudo-labels from large language models. We formulate embedding surgery as a convex optimization problem that enforces ranking constraints while minimizing modifications to the affected document representations. We integrate embedding surgery into standard dense retrieval pipelines and evaluate it on TREC Deep Learning, TREC Robust, TREC CAsT, and MS MARCO benchmarks. Results show consistent improvements (e.g., up to +60.64\% relative improvement in nDCG@10 on DL-Hard under editorial feedback), even under noisy or shifting feedback, with low computational cost and without disrupting the global structure of the embedding space. Extensive experiments show that ranking corrections propagate to semantically related queries and that embedding updates can be applied safely and efficiently to scalable Approximate Nearest Neighbor indexes via simple in-place overwriting, without requiring costly index reconstruction. Finally, embedding surgery complements query adaptation methods such as CoRocchio, yielding additional gains while being more robust to noisy feedback.
5. 【2609.05063】Beyond Co-purchase Relation: Evolution of Complementary Recommendations at Allegro
链接：https://arxiv.org/abs/2609.05063
作者：Aleksandra Osowska-Kurczab,Klaudia Nazarko,Eliška Kosturová,Lidia Wojciechowska,Michał Bień
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：camera body, professional camera, matching lens, generic tripod, customer adds
备注： Recsys 2026: OARS workshop
点击查看摘要
Abstract:When a customer adds a professional camera to their cart, should the system suggest a matching lens, a generic tripod, or another camera body? Complementary Product Recommendation is vital for comprehensive basket building, yet standard models often fail to distinguish between items that are merely bought together and those that truly work together. In this paper, we present AlleCompanion: a production-scale retrieval framework deployed at this http URL that transforms noisy behavioural signals into precise semantic compatibility. We mitigate the intrinsic noise in large-scale co-purchase traffic by combining data-level filtering heuristics with a category-constrained Two Tower architecture. Within this framework, the Category Adapter guides the model in the embedding space, constraining candidates within logically complementary boundaries. Since modelling authentic user behaviour at scale is inherently difficult, we introduce ComCat, a multi-source Complementary Categories Mapping. ComCat acts as a translational layer that distils meaningful patterns from noisy traffic into a maintainable and controllable solution, integrating expert rules, human-in-the-loop feedback, LLM-based reasoning, and statistical mining. Our experimental results demonstrate that combining explicit category-level constraints with neural architectures effectively filters out co-purchase noise to surface recommendations that satisfy real-world user needs. Serving over 20 million active users monthly, the framework delivers significant uplifts in attributed GMV for organic discovery and drives substantial revenue growth in sponsored placements.
6. 【2609.05059】Repeated Queries Exhaust an LLM's Brand Recommendations but Not Its Sources
链接：https://arxiv.org/abs/2609.05059
作者：Dmitrij Żatuchin
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：buying questions exhaust, model brand recommendations, brand recommendations depends, language model brand, repeated identical buying
备注： 6 pages, 2 figures, 2 tables, code, per-cell tables and data pointers at [this http URL](http://github.com/Rankfor/rankfor-open) (research/recommendation-saturation)
点击查看摘要
Abstract:Whether repeated identical buying questions exhaust a language model's brand recommendations depends on retrieval. Across 300 question-engine cells (50 questions, six engines, 15 runs each, open extraction over 1,470 adjudicated organizations), the five engines answering without web search were still adding never-seen brands at run 15 in 86-92% of cells, with median repertoires of 15-31 organizations; the one retrieval-enabled engine closed its list (median 8 organizations, 64% of cells still adding), matching four earlier deep cells where web-search runs saturated by run ten. Cited-domain accumulation keeps rising at every horizon tested: four deep cells were still adding domains at run 24 with 59-84% of the Chao2 lower-bound estimate observed, and 44% of the retrieval engine's breadth cells were still adding domains at run 15. A single run shows 62-77% of the five-run brand set, and across engines the median question draws 38 organizations, of which a median of 15 appear in exactly one engine. Estimators are exact rarefaction and Chao2 richness; a parallel fixed-roster extraction reproduces flat curves on identical responses, so roster-bounded tracking manufactures plateaus that open extraction removes.
7. 【2609.05025】Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection
链接：https://arxiv.org/abs/2609.05025
作者：Renato Vukovic,Hsien-chin Lin,Carel van Niekerk,Benjamin Ruppik,Michael Heck,Shutong Feng,Nurul Lubis,Milica Gasic
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：model generates outputs, language model generates, fine-tuned language models, factually incorrect, incorrect or unsupported
备注： Accepted to GroundLM EMNLP 2026 Workshop
点击查看摘要
Abstract:Hallucination-where a language model generates outputs that are factually incorrect or unsupported by the source-is a major challenge for both prompted and fine-tuned language models. Detecting hallucinations is difficult due to the opaque reasoning processes of LLMs, which often provide little insight into why a model's output may be inaccurate. In this work, we investigate whether an LLM can use an alternative, low level, symbolic competence such as SQL for unsupervised hallucination detection in some high level task. For this, we make an LLM build an SQL database from reference documents. This SQL database is then used for reasoning over the reference and the sampled response in a hallucination detection pipeline that is grounded in the database, thereby providing a neurosymbolic checkup. On RAGTruth and DiaHalu hallucination detection datasets, we find that our approach improves on direct prediction and competes with state-of-the-art hallucination detection methods, while not requiring domain-specific fine-tuning. Instead it relies on a low-level general competence already present in LLMs. This warrants further investigation of low-level LLM competences in neurosymbolic approaches.
Comments:
Accepted to GroundLM EMNLP 2026 Workshop
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
Cite as:
arXiv:2609.05025 [cs.CL]
(or
arXiv:2609.05025v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.05025
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
8. 【2609.04981】A Tree-based RAG Framework for Evidence-Intensive QA via Adaptive Planning and Topology-Aware Evidence Gathering
链接：https://arxiv.org/abs/2609.04981
作者：Songeun Lee,Kyungjin Min,Injae Na,Suyeong Lee,Chiyoung Kim,Woohwan Jung
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Recent structured RAG, methods leverage tree, RAG methods leverage, Recent structured, structured RAG methods
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Recent structured RAG methods leverage tree- or graph-based reasoning structures to improve multi-hop QA. However, they face key limitations in evidence-intensive QA, where answering a question requires synthesizing information scattered across dozens or even hundreds of documents: structural rigidity, which limits adaptive reasoning expansion, and topology-ignorant evidence gathering, which prevents effective integration of evidence across different reasoning nodes. To address these issues, we propose APT-RAG, an Adaptive Planning and Topology-aware evidence gathering RAG framework. Adaptive planning dynamically expands the reasoning structure based on question dependencies and evidence requirements, while topology-aware evidence gathering improves evidence coverage through sibling evidence reuse, direct retrieval, and evidence aggregation from child nodes. We further introduce evidence-guided batched answer generation to reduce significant generation overhead in evidence-intensive QA. In the experiments on evidence-intensive QA benchmarks, APT-RAG outperforms existing structured RAG methods. Our code is available at this https URL.
9. 【2609.04961】SAM-D2Q: Aligning Multimodal Doc2Query with Search Demand and Conversion for E-commerce
链接：https://arxiv.org/abs/2609.04961
作者：Hui Zhou,Jian Hui Ji,Lei Ma,Rong Xiao,Xiaoyi Zeng
类目：Information Retrieval (cs.IR)
关键词：fully cover diverse, cover diverse user, diverse user expressions, suffers from vocabulary, vocabulary mismatch
备注： Accepted by CIKM2026 Oral Full Paper
点击查看摘要
Abstract:E-commerce search often suffers from vocabulary mismatch between user queries and merchant-authored product titles, since short titles cannot fully cover diverse user expressions or visual product attributes. Although Doc2Query alleviates this issue by generating pseudo-queries for document expansion, traditional methods are text-only and not optimized for e-commerce business objectives. As a result, they may produce semantically plausible but commercially ineffective expansions and miss key attributes present in product images. To this end, we propose E-commerce Search-Aligned Multimodal Doc2Query (SAM-D2Q), a business-aligned multimodal document expansion framework for e-commerce search under Boolean retrieval constraints. SAM-D2Q consists of three stages: (1) task-adapted multimodal supervised fine-tuning to enhance vision-language understanding of product titles, images, and user queries; (2) multimodal data augmentation to improve perception of key visual attributes and expansion coverage; and (3) reinforcement-learning-based preference alignment toward search business objectives, encouraging the model to generate pseudo-queries that better match user intent and commercial value. Offline experiments show that SAM-D2Q substantially improves retrieval performance over traditional Doc2Query methods. Deployed in the AliExpress production search system, SAM-D2Q improves online business metrics, increasing GMV by +3.38% and Pay Count by +2.27%.
10. 【2609.04882】AtomRec: Evolving Atomic Memory for Agentic Recommendation
链接：https://arxiv.org/abs/2609.04882
作者：Peiyu Hu,Weihai Lu,Siying Gu,Zhuodong Liu,Zhaokai Luo,Yuean Niu,Zhiyong Wang,Jia Wang
类目：Information Retrieval (cs.IR)
关键词：large language models, Agentic recommender systems, systems use large, large language, language models
备注：
点击查看摘要
Abstract:Agentic recommender systems use large language models to maintain semantic memory and support evidence-aware recommendation. However, existing memory mechanisms often compress user and item information into coarse summaries and connect them with scalar collaborative links, making it difficult to preserve fine-grained preference stages or retrieve interpretable evidence as user interests evolve. We propose \textsc{AtomRec}, an agentic recommender with evolving atomic collaborative memory. \textsc{AtomRec} represents user and item memories as structured atomic units, builds semantic links across related memories, and evolves related historical fields when new interactions arrive. During recommendation, it retrieves linked memories as multi-hop evidence paths rather than isolated neighbor summaries, allowing collaborative signals to support grounded ranking. Experiments on four public benchmarks show that \textsc{AtomRec} consistently outperforms state-of-the-art agentic and memory-augmented baselines, with around 8.5\% average relative improvement across metrics.
11. 【2609.04862】Personalized Task Dependency Graphs for Mitigating Signal Erosion in Multi-Task Recommendation
链接：https://arxiv.org/abs/2609.04862
作者：Fuyuan Liu,Tiandeng Wu,Yaqun Fang,Wei Zhou,Zehao Zhou,Wenping Chen,Qishun Mei,Jiaxin Zhou,Heng Chang,Yi Cao,Jiandong Ding
类目：Information Retrieval (cs.IR)
关键词：Optimizing multiple conversion, Optimizing multiple, rigid architectures, core challenge, erosion in rigid
备注： Accepted at CIKM 2026
点击查看摘要
Abstract:Optimizing multiple conversion objectives is a core challenge in industrial recommendation, often limited by signal erosion in rigid architectures. Existing Multi-Task Learning (MTL) methods typically enforce uniform dependency strengths across a static conversion funnel, overlooking how task correlations naturally vary based on item characteristics. Hierarchical message passing along these fixed chains leads to cumulative signal attenuation, which degrades performance on sparse, deep-funnel objectives. To address this, we propose the Personalized Task Dependency Graphs (PTDG). While respecting necessary physical causal constraints (e.g., Click - Pay), PTDG dynamically "rewires" the intensity of dependency pathways for each item via low-rank approximation to ensure structural robustness. We implement a GCN-based propagation with hard causal masking to establish adaptive information shortcuts. Additionally, we introduce an Adaptive Progressive Masking (APM) strategy that decouples shared parameters according to task sparsity, helping to stabilize optimization. Experiments on KuaiRand1K and an industrial dataset show that PTDG significantly improves AUC on sparse conversion tasks by up to 1.45%, while maintaining comparable performance on dense objectives. Online A/B testing shows PTDG improves Conversion Rate (CVR) by 1.2% and effective Cost Per Mille (eCPM) by 1.9% relative to the baseline.
12. 【2609.04813】Inventory-Grounded Policy-Level Optimization for Training-Free AI Search
链接：https://arxiv.org/abs/2609.04813
作者：Wei Zhou,Tiandeng Wu,Jiandong Ding,Zhufeng Fan,Yi Cao
类目：Information Retrieval (cs.IR)
关键词：updated product catalog, frequently updated product, Early in deployment, system typically operates, product catalog
备注： Accepted at the EMNLP 2026 Industry Track
点击查看摘要
Abstract:Early in deployment, an AI search system typically operates over a frequently updated product catalog, so the available items and their properties cannot be treated as stable knowledge that can be encoded in fixed prompts or strategies. Fine-tuning, reinforcement learning, and static prompt patches fit poorly: labels are scarce, rewards drift with inventory, model releases are costly, and prompt fixes quickly stale. We present Inventory-Grounded Policy-Level Optimization (IGPO), a training-free approach for fixed AI search pipelines. IGPO separates policy from environment facts: it learns Policy Guidelines for acting on runtime inventory evidence rather than memorizing available items. Online, IGPO grounds each query by probing the inventory and constructing an inventory portrait, then injects relevant Policy Guidelines into the retrieval and selection prompts. Offline, stochastic rollouts are grouped by query -- mixed outcome groups directly yield contrastive signal, and an inventory-guided exploration loop distinguishes missed retrieval routes from cases where no matching support is found under the observed inventory evidence. Since May 2026, IGPO has been deployed in a commercial smart-assistant AI search system. A 14-day online A/B test of the complete IGPO treatment shows a 3.17% relative CTR lift and a 38.9% reduction in audited bad cases.
13. 【2609.04658】VizIt: A multi-view framework for exploring single-cell, spatial, and genetic data online
链接：https://arxiv.org/abs/2609.04658
作者：Chenhang Christopher Zhang,Yanqing Lou,Jie Yuan,Mingming Lu,Jacob Parker,Himanshu Chintalapudi,Zechuan Lin,Clemens R. Scherzer,Yuxuan Hu,Ruifeng Hu,Xianjun Dong
类目：Information Retrieval (cs.IR); Genomics (q-bio.GN)
关键词：studies increasingly require, exploration remains fragmented, increasingly require data, Multi-omic studies increasingly, complementary biological perspectives
备注：
点击查看摘要
Abstract:Multi-omic studies increasingly require data to be examined from complementary biological perspectives, yet interactive exploration remains fragmented across modalities and tools. We present VizIt, an open-source framework for multi-view exploration of single-cell and spatial transcriptomic, epigenomic and genetic data. VizIt connects gene-, cell type-, condition-, spatial-, genomic region- and variant-centered views, enabling seamless navigation across biological perspectives. We demonstrate VizIt through the Parkinson's Cell Atlas, a customizable interactive multi-omic resource.
14. 【2609.04647】CAGE: Coherence-Aware Graph Encoding for Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2609.04647
作者：Tong Qi,Jingyu Wu,Youbing Yin,Spencer Hong,Daben Liu,Erin Babinsky
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Traditional Retrieval-Augmented Generation, Traditional Retrieval-Augmented, Retrieval-Augmented Generation, assembling context sets, systems score
备注：
点击查看摘要
Abstract:Traditional Retrieval-Augmented Generation (RAG) systems score each passage independently against the query, assembling context sets that may be individually relevant yet collectively incoherent. We introduce Coherence-Aware Graph Encoding (CAGE), a reranking framework that models "between-chunk coherence" across four dimensions: Intra-Domain Relevance, Noise Resistance, Informational Bonding, and Factual Consistency. Our pipeline transforms retrieved passages into directed heterogeneous entity graphs, amplifies factual anchors via min-out-degree reweighting, encodes structural patterns through a Relational Graph Convolutional Network, and fuses inter-chunk coherence with query relevance for final ranking. Evaluated across four multi-hop benchmarks, CAGE matches or outperforms strong baselines including monoT5 in Recall@5 on bridge-dominated datasets and consistently improves downstream Exact Match, demonstrating that structurally coherent context yields more precise answers even when retrieval recall is comparable or lower.
15. 【2609.04645】Latent-Aligned Reasoning for Multimodal Recommendation
链接：https://arxiv.org/abs/2609.04645
作者：Jiarui Jin,Anyang Ji
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Vision-Language Models, term cross-modal dilution, signals progressively attenuate, demonstrated remarkable capabilities, fundamental challenge persists
备注：
点击查看摘要
Abstract:Multimodal Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding, yet a fundamental challenge persists when applying them to recommendation: as representations propagate through multi-step reasoning, both visual and textual signals progressively attenuate - a phenomenon we term cross-modal dilution. To address this, we propose LARK (Latent-Aligned Reasoning frameworK), a two-stage latent reasoning framework with complementary alignment mechanisms within a single VLM. In the first stage, learnable latent tokens are interleaved with multi-step chain-of-thought (CoT) reasoning and explicitly aligned with a frozen vision encoder, serving as visual checkpoints that preserve perceptual details throughout the reasoning chain. In the second stage, the latent representations are projected via a bridge MLP and trained with item-to-item contrastive learning; to prevent the reasoning semantics from fading, intermediate features are aligned with the CoT hidden states from the first stage, anchoring the final embeddings to the model's own reasoning output. Experiments on three public benchmarks and one industrial dataset show that LARK achieves state-of-the-art performance across multiple recommendation architectures, with controlled ablations confirming the distinct contribution of each component.
16. 【2609.04574】MURAL: Multimodal Uncertainty-aware Recommendation via Adaptive edge Learning
链接：https://arxiv.org/abs/2609.04574
作者：Ahmad Mousavi(Department of Mathematics and Statistics American University),Majid Alikhani(Independent Researcher),Yeon-Chang Lee(Department of Computer Science and Engineering Ulsan National Institute of Science and Technology),Roberto Corizzo(Department of Computer Science American University),Yeganeh Abdollahinejad(Department of Biosystems and Agricultural Engineering Michigan State University)
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG); Social and Information Networks (cs.SI)
关键词：Graph Neural Networks, Multimodal Graph Neural, Neural Networks, augmenting sparse interaction, Graph Neural
备注：
点击查看摘要
Abstract:Multimodal Graph Neural Networks have become standard for recommendation by augmenting sparse interaction data with content features. Yet current architectures face two bottlenecks: structural rigidity, from a reliance on static precomputed similarity graphs that cannot adapt to evolving preferences; and semantic fragility, where noisy modality signals are indiscriminately fused, distorting the collaborative signal. We propose MURAL (Multimodal Uncertainty-aware Recommendation via Adaptive edge Learning), a unified framework that shifts multimodal recommendation from fixed structural augmentation to dynamic topology discovery. To address structural rigidity, an Adaptive Edge Learner combines a differentiable retrieval-augmented strategy with an approximate nearest neighbor search to discover latent item-item correlations that are both semantically adaptive and computationally scalable (O(NlogN)). To address semantic fragility, an Uncertainty-Aware Fusion module models the aleatoric uncertainty of heterogeneous modalities, dynamically down-weighting unreliable features while prioritizing high-confidence signals as a defense against cross-modal noise. We further employ a contrastive teacher-student alignment that anchors modality-specific representations to stable behavioral signals, ensuring optimization stability without gradient leakage. Experiments on large-scale benchmarks including TikTok and Amazon show that MURAL significantly surpasses both structural and generative state-of-the-art baselines, achieving superior accuracy while offering interpretability through domain-specific modality dominance and robustness under extreme data corruption.
17. 【2609.04504】BioSync: Transformer-Based Cross-Modal Fusion for a Multimodal Physiological Digital Biomarker
链接：https://arxiv.org/abs/2609.04504
作者：Seyed Mahmoud Sajjadi Mohammadabadi
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：devices provide partial, mobile devices provide, provide partial, noise-sensitive views, physiological state
备注：
点击查看摘要
Abstract:Cardiac, neural, behavioral, and speech measurements from wearable and mobile devices provide partial, noise-sensitive views of physiological state. BioSync combines these measurements into the \textbf{BioSync Index (BSI)}, a continuous composite digital biomarker defined under the BEST framework. The model applies multi-head self-attention to modality tokens and adds a linear branch whose hypothesis class includes standard feature concatenation. This architecture is motivated by latent-variable measurement theory and by the possibility that joint observations contain information unavailable from individual modalities. We evaluated BioSync on two literature-informed synthetic cohorts: a four-modality cognitive-decline cohort using HRV, EEG, actigraphy, and speech, and a metabolic-autonomic cohort structured around the public AI-READI wearable schema. In the cognitive cohort, BioSync and concatenation obtained AUCs of 0.928 and 0.926, respectively. In the metabolic cohort, BioSync obtained accuracy/F1 of 0.764/0.766, compared with 0.756/0.758 for concatenation. The BSI correlated with latent severity in both cohorts ($r=0.91$ and $r=0.68$). A pure-attention ablation obtained cognitive-cohort AUC 0.911, locating the increase to 0.928 in the combined wide-and-deep architecture. With matched modality-dropout training, BioSync led concatenation at five of six cognitive-cohort corruption rates and at the highest metabolic-cohort rate. Its cognitive-cohort AUC was also higher than five published digital-biomarker reference values, although differences in datasets and tasks preclude a controlled benchmark claim. Comparison with single-modality, early-fusion, and late-fusion designs across six prespecified criteria identifies the model's computational properties; validation on real cohorts remains necessary.
18. 【2609.04391】Evaluation of Phonetic Encoding Algorithms on Transcription Datasets
链接：https://arxiv.org/abs/2609.04391
作者：Can Özbey,Emre Kaplan,Berkin Deniz Kahya
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Rand Index measure, International Phonetic Alphabet, Rand Index, encoding algorithms conform, Index measure
备注： 17 pages, 3 figures, 5 tables
点击查看摘要
Abstract:In this work, a novel evaluation scheme built on a generalized variant of the Rand Index measure, namely, the Hüllermeier-Rifqi Index, is proposed in order to assess how well phonetic encoding algorithms conform to word-based transcriptions in IPA (International Phonetic Alphabet) notation. For this objective, the discordance score is obtained by calculating the absolute difference between the pairwise similarity values of ground-truth transcriptions and those of corresponding phonetic encodings, which are computed using normalized edit distance as a permutation dependent string metric. The resulting score is subsequently adjusted with respect to that of a random string generator incorporating the same alphabet as the encoder under consideration. A wide range of phonetic encoders were evaluated as such on multi-lingual transcription datasets along with their recall capabilities based on the collision rate. The validity of the proposed scheme is further supported by its applicability in measuring the orthographic transparency of a language when the writing system is viewed as an inherent phonetic representation.
19. 【2609.04269】Corporate-Family Resolution Is Not a String-Matching Problem: A Public Benchmark Stratified by Name Visibility
链接：https://arxiv.org/abs/2609.04269
作者：Harshit Gupta
类目：Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：credit exposure aggregation, supplier records belong, spend consolidation, credit exposure, sanctions screening
备注： 21 pages, 8 tables. Benchmark, full adjudication log, and code reproducing every number: [this https URL](https://github.com/harshitg93/corpfam-benchmark)
点击查看摘要
Abstract:Deciding whether two supplier records belong to the same corporate family is a prerequisite for spend consolidation, credit exposure aggregation and sanctions screening. It is usually treated as entity matching, but the tasks differ: a family link connects records that are deliberately different entities, and the evidence often appears in neither record. We introduce CorpFam, a public benchmark of 54,864 candidate pairs over 10,307 corporate families, derived from 6,638,350 US federal award records in which every supplier self-reports its ultimate parent to a government registry. Pairs are stratified by name visibility: whether the names are identical after normalisation, share a distinctive token, or share none. Because strata have positive rates from 10.2% to 97.3%, we report per-stratum recall, base-rate invariant, rather than F1, which is not. The strongest of 5 matchers recovers 100.0% of identical pairs and 4.2% of invisible ones; no method exceeds 4.7% on the latter. The failure begins before matching. Blocking decides which pairs a matcher sees, and we evaluate 7 schemes spanning phonetic keys, attribute keys that ignore the name, and semantic nearest neighbours. None reaches three percent on invisible pairs, and their union recovers 6.8%. 93.2% of these links never enter the candidate set, so no matching-stage improvement can reach them. The links are real: against SEC Exhibit 21 subsidiary schedules, which share no provenance with procurement registration, 64.2% of invisible links are corroborated, against 0.16% under permuted parents and 0.41% against the same parent's wrong exhibit: two unrelated nulls agreeing to within 0.25 points. Corporate-family resolution is a retrieval problem misfiled as a matching problem; the intervention point is candidate generation, not ranking. The benchmark, adjudication log, and code reproducing every number are released.
20. 【2609.04255】SAGE: Semantic Attribute Graphs for Multi-Entity Visual Retrieval
链接：https://arxiv.org/abs/2609.04255
作者：Yongjoo Kim,Mincheol Kwon,Seonga Choi,Minseung Lee,Kyeong-Jin Oh,Hyunyoung Lee,Yunsu Choi,Jungbeom Lee
类目：Information Retrieval (cs.IR)
关键词：relevance depends, Dense document images, Dense document, Semantic Dilution, document images
备注： EMNLP 2026 (Main); Project: [this https URL](https://all4nothing.github.io/SAGE-project/)
点击查看摘要
Abstract:Dense document images often contain many fine-grained visual and textual entities whose relevance depends on a user query. Standard vision-language retrievers encode cropped regions with a single vector, which can mix distinct entity signals and obscure the evidence needed for fine-grained retrieval. We call this failure mode Semantic Dilution and quantitatively show that it degrades entity-level retrieval as a function of entity density. To mitigate it, we propose SAGE, a training-free framework that parses semantic entities from dense document images, represents them as hierarchical graph nodes with multi-vector embeddings, and retrieves query-relevant evidence through iterative entity-level subgraph matching. We also introduce DEAR, a dataset of 1,055 query--image pairs sourced from product detail pages, where each query requires retrieving and comparing multiple fine-grained entities from visually dense inputs across four question types of increasing complexity. Experiments show that SAGE substantially reduces semantic dilution and outperforms patch-level and OCR-based retrieval baselines on DEAR, achieving a Recall@3 of 0.849 and a generation score of 2.746 on multi-entity visual comparison queries. Our code is available at this https URL.
计算机视觉
1. 【2609.05416】WorldSculpt: Generating Compositional Worlds from Grounded Videos
链接：https://arxiv.org/abs/2609.05416
作者：Muyao Niu,Jixuan He,Ruihan Yu,Lian Fu,Yonghao Yu,Zheng-Hui Huang,Yifan Zhan,Fengbo Lan,Yongtao Ge,Yinqiang Zheng,Kaipeng Zhang,Zhixiang Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：study the problem, problem of generating, densely cluttered scenes, scenes, cluttered scenes
备注： Homepage: [this https URL](https://alaya-lab.github.io/WorldSculpt/;) Github: [this https URL](https://github.com/AlayaLab/WorldSculpt)
点击查看摘要
Abstract:We study the problem of generating a compositional 3D representation of a cluttered scene containing hundreds of objects. The goal is to represent the scene as a collection of individual object meshes placed in a shared world frame, as required by downstream applications such as gaming, AR/VR, simulation, and robotics. This task is challenging in densely cluttered scenes, where objects heavily occlude one another and each view reveals only a fraction of their geometry. Geometry-based approaches typically reconstruct the scene as a single representation and leave incomplete geometry in occluded regions, while existing compositional methods with generative priors are largely limited to relatively simple scenes. We show that complex scenes with hundreds of objects can instead be generated compositionally by adapting a strong single-object 3D generative prior to multi-view observations. We instantiate this paradigm with Pixal3D, extending it with a multi-view conditioning pathway that grounds object generation in multiple posed observations. Although the model is finetuned entirely on single objects in canonical space, it generalizes to large scenes with severe occlusion without any scene-level training, demonstrating the feasibility and scalability of this paradigm. We further introduce UE-MeshyScene, a photorealistic benchmark of densely cluttered scenes with hundreds of objects, per-object annotations, and ground-truth meshes. Across single-object, controlled multi-object, and UE-MeshyScene evaluations, our method consistently outperforms prior approaches, with larger gains as scene complexity and occlusion increase. Finally, we demonstrate broader applicability by converting generated 3DGS worlds, such as Marble and HY-World 2.0, into compositional mesh scenes.
2. 【2609.05415】UniMate: One Unified Model to Animate Diverse Skeletons
链接：https://arxiv.org/abs/2609.05415
作者：Linzhan Mou,Jiahui Lei,Zhiyang Dou,Chenyue Cai,Chaoyue Song,Adam Finkelstein,Szymon Rusinkiewicz
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：Recent advances, deliver animation-ready, remains a bottleneck, advances in automatic, automatic rigging
备注： SIGGRAPH Asia 2026. Project page: [this https URL](https://linzhanmou.com/unimate/)
点击查看摘要
Abstract:Recent advances in automatic rigging now deliver animation-ready 3D assets at scale, yet generating the motion to drive them remains a bottleneck. Existing learned animators are topology-constrained: they rely on category-specific templates or require per-skeleton fine-tuning and reference motions at inference. We present UniMate, a unified foundation model that synthesizes articulated motion for arbitrary skeletons from a rigged 3D asset and a text prompt, with no test-time optimization or per-skeleton retraining. UniMate introduces a topology-aware diffusion transformer, which integrates skeletal topology into attention via three mechanisms: (1) a graph-aware attention bias from pairwise joint relations and geodesic distances; (2) a spectral rotary position embedding generalizing RoPE to arbitrary kinematic trees via the graph Laplacian; and (3) a global topological conditioner attention-pooled from the rest-pose skeleton. We also curate UniML3D, 13,006 motion sequences spanning bipedal, quadrupedal, avian, marine, insectoid, serpentine, and articulated rigid objects with unified canonicalization and text pairing. Trained on this dataset, UniMate outperforms state-of-the-art baselines in quality, generalization, and efficiency, and supports zero-shot cross-topology transfer, in-betweening, expansion, and text-guided editing. Our project page is available at this https URL.
3. 【2609.05400】A Generalizable Feature Extractor for Alzheimer's-Related Brain MRI Tasks
链接：https://arxiv.org/abs/2609.05400
作者：Reza Rajabli,D. Louis Collins
类目：Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：train deep learning, properly train deep, deep learning models, transfer learning, deep learning
备注： 26 pages (excluding the references section), 7 figures (excluding sub-figures)
点击查看摘要
Abstract:When there is not enough labeled data to properly train deep learning models, transfer learning can help. We still do not fully understand how effective it is in neuroimaging, especially for Alzheimer's disease research. It is also not clear if these transferred models can work on new datasets without being retrained for each specific task. We evaluate whether a compact, supervised pretrained model can serve as a reusable foundation model for downstream neuroimaging tasks. We freeze the 7.18 million weights of a 3D CNN previously trained for brain-age prediction, and adapt it to each task using Low-Rank Adaptation (LoRA), requiring only ~1% additional trainable parameters. We evaluate generalizability in six experiments. Adapting the model to classify cognitively normal versus Dementia on ADNI gave an AUC of 0.964 on held-out folds (Experiment #1). Applying that adapted model unchanged to OASIS-3, with no retraining, gave an AUC of 0.871 (Experiment #2). Reusing its output logit together with age and a cognitive score distinguished stable from progressing MCI with an AUC of 0.828 (Experiment #3). Adapting the same backbone to predict amyloid positivity from structural MRI gave an AUC of 0.804 (Experiment #4). Finally, the same approach estimated ICV-normalized hippocampal and white matter hypointensity volumes directly from the T1w image, with R^2 of 0.80 and 0.91 respectively, tasks normally addressed with much larger U-Net networks (Experiments #5 and #6). A compact model supervised on brain age can therefore serve as a reusable backbone, adapting to each task with ~1% additional parameters and transferring to an unseen cohort without any training. Our findings suggest that a carefully trained brain age model can serve as an effective foundation model for Alzheimer's related tasks, even under strict data constraints.
4. 【2609.05399】From Interpretability Methods to Interpretable Models
链接：https://arxiv.org/abs/2609.05399
作者：Julien Colin,Nuria Oliver,Thomas Serre
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：feature visualization, computer vision, vision has assembled, circuit-based methods, methods
备注：
点击查看摘要
Abstract:More than a decade in, explainable AI (XAI) for computer vision has assembled a mature toolbox: attribution, feature visualization, concept-based, and circuit-based methods. Yet almost all of the field's effort has gone into building and comparing these methods, and little into the question they were meant to answer---how interpretable are our models, and are we making progress as they evolve? We argue for shifting the field's focus from methods to models, along two complementary lines. One is already within reach: existing tools let us characterize and compare what different models represent and compute. The other is harder, and largely neglected: whether a model can actually be understood by the humans who rely on it---the independent evaluators on whom trust and certification depend, not the experts confirming what they already expect. It can only be measured, not inferred. We review why the toolbox is mature enough to support both, survey the thin body of work comparing models, draw a parallel to systems neuroscience, and close with a model-centric XAI agenda.
5. 【2609.05397】CrossDepth: Geometry-Constrained Attention for Generalizable Multi-View Surround Depth Estimation
链接：https://arxiv.org/abs/2609.05397
作者：Samer Abualhanud,Max Mehltretter
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：autonomous driving, surrounding environment, core requirement, requirement for autonomous, Reliable
备注：
点击查看摘要
Abstract:Reliable 3D understanding of the surrounding environment is a core requirement for autonomous driving. Multi-view surround camera rigs provide broad scene coverage, but the spatially adjacent images typically overlap only minimally. Consequently, the depth of most pixels must be inferred from monocular appearance cues. These cues can appear differently across images and may therefore be interpreted differently by the depth estimation model. We target two main sources of cross-image inconsistency: differences in camera intrinsics and the limited receptive field of each image. We address the former by conditioning the features on per-pixel camera-aware ray embeddings, enabling the network to account for camera-dependent variations in monocular cues. We address the latter by extending each pixel's context beyond its own image through cross-image attention constrained to geometrically plausible regions, derived from the calibrated rig setup. The model is trained in a fully self-supervised manner based on photometric consistency. Evaluations on DDAD and nuScenes show improved overall depth accuracy and cross-image depth consistency over state-of-the-art self-supervised methods under in-domain and cross-domain evaluation. Code is available at this https URL.
6. 【2609.05388】hink-Verify-Revise: Neuro-Symbolic Visual Reasoning with Vision-Language Models and Dynamic Logic Tensor Networks
链接：https://arxiv.org/abs/2609.05388
作者：Homayoun Afshari,Pietro Basci,Alessandro Russo,Lia Morra
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reasoning tasks require, apply formal relational, purely symbolic approaches, symbolic approaches handle, Logic Tensor Network
备注： Accepted at the MARS2 Workshop @ ECCV 2026
点击查看摘要
Abstract:Visual reasoning tasks require a system to jointly perceive visual content and apply formal relational constraints---a combination that neither pure neural nor purely symbolic approaches handle well in isolation. This paper proposes a Neuro-Symbolic (NeSy) framework that closes this gap by tightly coupling a Vision-Language Model (VLM) for automatic First-Order Logic (FOL) rule induction with a Dynamic Logic Tensor Network (D-LTN) for differentiable rule verification, in a closed iterative feedback loop. The VLM receives a small set of labelled visual examples and proposes candidate FOL rules conforming to a strict grammar (Think); the D-LTN is automatically assembled from these rules at runtime and evaluates them grounding on CNN-produced visual embeddings (Verify); and verification failures are fed back to guide the VLM's next hypothesis (Revise). Evaluated on the ViSudo-PC benchmark across four visual domains (MNIST, EMNIST, KMNIST, FMNIST), the system induces valid Sudoku constraint rules using only three training examples as visual context. The proposed method achieves AUC scores matching or outperforming previous methods (NeuPSL, LTN), showing the potential for automatic rule discovery through VLM. Code is available at this https URL.
7. 【2609.05382】Reflection-aware Generative Novel View Synthesis
链接：https://arxiv.org/abs/2609.05382
作者：GeonU Kim,Shin Dong-Yeon,Tae-Hyun Oh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：multi-view diffusion, view synthesis, NVS, reflection-aware method, mirror
备注： ECCV2026, Project page: [this https URL](https://kim-geonu.github.io/Ref-GeNVS/)
点击查看摘要
Abstract:We propose Ref-GeNVS, a training-free, reflection-aware method for generative novel view synthesis (NVS) in mirror scenes. Existing multi-view diffusion models often fail to recognize the mirror in the scene and cannot exploit reflected content for scene generation. To fix this issue without additional training, our key idea is to treat a mirror image as two complementary views. From input images, we estimate the mirror plane and reflect camera poses to form virtual views. Based on this virtual view setup, we propose a two-stage generation method consisting of Mirror-gated attention and Reflection injection, which enables reflection-consistent NVS by explicitly leveraging reflection relationships in a multi-view diffusion model. Ref-GeNVS inherits the strong generalizability of the multi-view diffusion backbone, while it does not require finetuning. On synthetic and real scenes including mirrors, Ref-GeNVS outperforms recent generative NVS methods by generating reflection-consistent and contextually coherent novel views, revealing scene structure visible only through mirrors. Project page: this https URL
8. 【2609.05376】What Matters, When? Diagnosing and Improving Conditional Visual Grounding in Visuomotor Imitation Policies
链接：https://arxiv.org/abs/2609.05376
作者：Vivek Chavan,Pengtao Xie,Yahuan Shi,Oliver Heimann,Kevin Haninger,Jörg Krüger
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：visually similar objects, Visuomotor imitation policies, in-distribution visual conditions, achieve high performance, imitation policies
备注： Accepted as an extended abstract at the DexHAND Workshop, ECCV 2026. Non-archival, non-proceedings. 4 pages, 2 figures, 2 tables
点击查看摘要
Abstract:Visuomotor imitation policies can achieve high performance under in-distribution visual conditions yet fail when visually similar objects or receptacles are introduced. We study this behavior as a problem of conditional visual grounding: the visual target required for successful control changes with the manipulation phase and, in more complex tasks, with the observed task state. Using Action Chunking with Transformers (ACT), we systematically introduce distractor objects and receptacles with controlled color and shape similarity and localize failures to picking and placement. We find that distractor sensitivity is specific to both the type of visual similarity and the manipulation stage. Guided by this diagnosis, we evaluate distractor augmentation, phase-dependent attention regularization, and appearance-based visual prompting as complementary interventions for improving target selection while preserving spatial information required for control. These interventions substantially improve robustness in simulation and on a physical UR3e. We further examine the same failure pattern in a pretrained vision-language-action policy on a state-conditioned instrument-handling task, where the observed state of a medical instrument determines the correct destination. Together, the results show that visual distractors can cause incorrect object or destination selection even when the underlying manipulation skill remains intact, and that explicitly improving target selection can substantially recover performance across distinct visuomotor policy-learning regimes.
9. 【2609.05369】owards Neuro-Symbolic Procedural Reasoning for Long-Horizon Vision-Language-Action Manipulation
链接：https://arxiv.org/abs/2609.05369
作者：Vivek Chavan,Yahuan Shi,Oliver Heimann,Kevin Haninger,Jörg Krüger
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：procedures requiring persistent, requiring persistent task, short manipulation skills, execute short manipulation, long-horizon procedures requiring
备注： Accepted as an oral presentation at the X-Reason Workshop, ECCV 2026. Non-archival extended abstract. 6 pages, 2 figures, 1 table
点击查看摘要
Abstract:Vision-language-action (VLA) models can execute short manipulation skills, but remain brittle in long-horizon procedures requiring persistent task state, dependency-aware reasoning, conditional decisions, and reliable grounding. We investigate a neuro-symbolic framework that combines learned VLA control with explicit task graphs and multimodal procedural memory. Task graphs encode action dependencies, valid transitions, and branch conditions, while memory maintains the active step, completed actions, textual context, and task-relevant visual evidence. Together, these structures guide object selection, destination grounding, subgoal dispatch, and verification of expected state transitions. Human demonstrations provide additional spatial and temporal guidance through gaze or saliency cues. To isolate their effect on policy learning, our initial study bypasses cross-view gaze transfer and directly annotates pseudo-gaze in robot-view teleoperation videos. The resulting guidance is used during VLA fine-tuning and inference. We study two long-horizon manipulation domains, workspace clearing and surgical-instrument handling, which require ordered execution, visually grounded decisions, and conditional branching. We evaluate correct-object and destination selection, subtask completion, task progress, step-order consistency, complete-task success, and procedural or execution mistakes. This work positions structured symbolic reasoning and demonstration-derived visual guidance as complementary mechanisms for reliable long-horizon VLA manipulation.
10. 【2609.05351】MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation
链接：https://arxiv.org/abs/2609.05351
作者：Mohanad Albughdadi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Earth Observation, Earth Observation, Earth Observation representation, Recent advances, accommodate heterogeneous sensors
备注： Submitted to IEEE Transactions on Geoscience and Remote Sensing
点击查看摘要
Abstract:Recent advances in Earth Observation representation learning accommodate heterogeneous sensors and missing observations, often through larger architectures. We present MEOX (Multimodal Earth Observation with eXperts), a multimodal masked autoencoder with a 2.939 million-parameter encoder and 3.115 million parameters in total. Sensor-specific adapters, explicit validity signals, and a shared sparse-expert block preserve modality-dependent processing before a learned patch-wise fusion. Four metadata tokens then accompany a single spatial sequence through fourteen further encoder blocks. Shared expert projections with private low-rank residuals constrain parameter growth, while rotary attention supports downstream spatial grids different from pretraining. The model is pretrained on 1.228 million MMEarth64 samples using modality-balanced masked reconstruction and structured sensor dropout. Frozen transfer is evaluated on six GEO-Bench tasks at both 64 and 224 pixels. The model reaches 64.42% mean intersection-over-union on cashew segmentation at 64 pixels and 90.56% average accuracy on EuroSAT at 224 pixels, exceeding the corresponding reported CSMoE results. BigEarthNet finetuning reaches 72.95% micro-average precision. Routing diagnostics distinguish expert participation, spatial dependence, modality association, and functional contribution. A held-out WorldCover probe measures a 0.64-percentage-point benefit from metadata, while retrieval separates same-sensor semantics from cross-sensor alignment. These results demonstrate sensor-flexible representation learning and strong task transfer using a compact parameter budget.
11. 【2609.05334】Lightweight Vision Transformer Compression for On-Device Plant Disease Detection in Resource-Constrained Agricultural Field Conditions
链接：https://arxiv.org/abs/2609.05334
作者：Mahadev Sunil Kumar,Bhavika Gondi,Desaisetty Venkata Satya Sai Swapnith,Gangireddy Rahul Jogi,Sudheesh Manalil,Arnab Raha,Amitava Mukherjee,Parthasarathy Seethapathy,G. Gopakumar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：economically significant crops, Capsicum annuum, India most economically, significant crops, expert intervention
备注：
点击查看摘要
Abstract:Chilli (Capsicum annuum) is one of India's most economically significant crops, yet its productivity is persistently threatened by diseases that are difficult to identify without expert intervention. While Vision Transformers (ViTs) have achieved high classification accuracy, their large computational footprint makes deployment on resource constrained devices challenging. Existing compression approaches typically address pruning, quantization, and knowledge distillation in isolation, leaving the potential benefits and interactions of their combined application insufficiently explored. We propose a unified Vision Transformer compression framework that combines Hessian-Balanced Adaptive Block Pruning (H-BAC), guided by second-order sensitivity estimation, with quantization and attention-based knowledge distillation. To systematically identify the most effective configuration within each compression family, each technique is first evaluated independently through controlled ablation studies, after which the best-performing components are integrated into a sequential deployment pipeline tailored to real-world agricultural constraints. On a chilli 3-class village-split dataset with a genuine cross-village, cross-device out-of-distribution test split, the resulting compressed models match or exceed the 95.13% FP32 baseline's accuracy, alongside 74-98% model size reduction, and the fully integrated compression pipeline achieves a 54.5x size reduction (327.42 MB to 6.01 MB) at 95.13 +/- 2.32% accuracy across four tested configurations. A direct comparison further reveals that, on this dataset, a directly-trained student of the same final size, without pruning or distillation, reaches comparable accuracy of 94.87%, at the same 6.01 MB INT8 size, indicating where H-BAC and knowledge distillation are, and are not yet shown to be, worth their computational cost.
12. 【2609.05324】RoboSPA: Can VLA Models Go Beyond Simple Scenes and Short-Horizon Tasks?
链接：https://arxiv.org/abs/2609.05324
作者：Zhenxuan Fan,Bo Zhang,Yutong Lin,Yuqian Yuan,Juekai Lin,Liang Liang,Zhuoyi Huang,Wenqiao Zhang,Juncheng Li,Siliang Tang,Jun Xiao,Yueting Zhuang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：shown promising progress, language-conditioned robotic manipulation, textbf, VLA models, shown promising
备注： Accepted at the EMNLP 2026 Main Conference
点击查看摘要
Abstract:Vision-Language-Action (VLA) models have shown promising progress in language-conditioned robotic manipulation. However, existing datasets and benchmarks mainly evaluate task completion under predefined settings, offering limited insight into model reasoning under increasing spatial and procedural complexity. We introduce \textbf{RoboSPA} (\textbf{Robo}t \textbf{S}patial-\textbf{P}rocedural \textbf{A}ssessment), a large-scale robotic manipulation dataset and benchmark for diagnosing embodied reasoning in VLA models. \texttt{RoboSPA} focuses on two core dimensions, Fine-Grained Spatial Reasoning and Long-Horizon Procedural Planning, covering 10 task categories and 56 base tasks. Each task is instantiated across five difficulty levels, yielding 280 variants with increasing spatial ambiguity and procedural complexity. We collect 527K trajectories across multiple embodiments and diverse scenes. Beyond binary success rate, \texttt{RoboSPA} introduces diagnostic metrics for more detailed evaluation. Experiments on representative VLA models show that current systems still struggle with complex spatial relations, precise low-level execution, and memory-intensive planning. These results establish \texttt{RoboSPA} as a challenging diagnostic benchmark for developing more capable, reliable, and generalizable embodied agents. Our data and code are available at this https URL.
13. 【2609.05323】Scalable Detection of Fossil Palynomorphs in Multifocal Digital Microscopy Images
链接：https://arxiv.org/abs/2609.05323
作者：Abbas Shaikh,Praise Mayor,Patrick Ainlay-Vazquez,Aditya Viswanathan,Teon Golden,Eric Zhang,Ingrid C. Romero,Alexander E. White,Scott Wing,Arko Barman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：important high-resolution records, organic-walled fossils, ancient ecosystems, records of past, past climates
备注：
点击查看摘要
Abstract:Palynomorphs (microscopic, organic-walled fossils such as pollen, spores, and dinoflagellates) are important high-resolution records of past climates and are critical to the study of ancient ecosystems. Existing methods rely on manual analysis of high-resolution, multifocal digital microscopy images, which is slow and time-consuming and requires researchers to compromise on the scale of their investigations. To the best of our knowledge, our work proposes the first ever scalable end-to-end pipeline for automated palynomorph detection in whole slide images that addresses this bottleneck through: (1) efficient methods for decomposing and compressing digitized multifocal microscope slide images into tractable 2-dimensional tiles for analysis; (2) benchmarking modern object detection models, including RF-DETR, for the detection of palynomorphs, achieving an AP@50 of 0.879; (3) an efficient algorithm for the synthesis of detection outputs across large-scale, high-resolution images; and (4) an I/O optimization resulting in faster inference time. Our methods drastically reduce the time required for palynomorph detection in a single slide from often days of manual inspection to under one hour of automated analysis, enabling palynological research at a substantially greater scale.
14. 【2609.05320】Adaptive Gated Deepfake Detection for Low-Resolution and Resource-Constrained Environments
链接：https://arxiv.org/abs/2609.05320
作者：Vaishnavi Sen,Cody Laurie,Rashida Hasan
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：computationally expensive architectures, fixed inference paths, Deepfake detection, expensive architectures, resource-constrained settings
备注：
点击查看摘要
Abstract:Deepfake detection models often rely on high-quality inputs, fixed inference paths, and computationally expensive architectures, limiting their use in low-resolution and resource-constrained settings. This paper proposes AdaGate-DF, an adaptive gated deepfake detection framework that uses image-quality cues to route samples through a dual multi-exit system so high-quality images can exit earlier and save compute. We evaluated AdaGate-DF against MaD-CoRN, DefakeHop++, and ShuffleNetV2 on two benchmark datasets (Celeb-DF and FaceForensics++) under multiple configurations to test image resolution dependence and training and inference efficiency. On Celeb-DF, AdaGate-DF achieves an AUC of 0.9370, outperforming MaD-CoRN and DefakeHop++ while maintaining a low inference latency. Resolution-based testing shows consistent improvement as input resolution increases, reaching an AUC of 0.9708 at 384 by 384. The FaceForensics++ results highlight that AdaGate-DF remains effective under class imbalance, following competitive results with evaluated models. Overall, AdaGate-DF demonstrated a practical balance between detection performance, uncertainty-aware prediction, and computational efficiency for variable-quality deepfake detection.
15. 【2609.05303】Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution
链接：https://arxiv.org/abs/2609.05303
作者：Liqian Yang,Xingchi Chen,Xinfeng Gui,Xiangyong Cao,Qianxin Yi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high-resolution hyperspectral image, low-resolution hyperspectral image, high-resolution multispectral image, multispectral image fusion, hyperspectral image
备注：
点击查看摘要
Abstract:Hyperspectral and multispectral image fusion (HMIF) aims to reconstruct a high-resolution hyperspectral image (HR-HSI) by combining the fine spatial details of a high-resolution multispectral image (HR-MSI) with the rich spectral information of a low-resolution hyperspectral image (LR-HSI). Recent advances in implicit neural representations (INRs) have enabled flexible coordinate-based modeling for HMIF; however, existing INR-based approaches may not fully capture fine-grained spatial structures and rich spectral dependencies. Moreover, the LR-HSI and HR-MSI are primarily incorporated through degradation-consistency constraints, leaving their complementary information underexploited. To address these limitations, we propose Two-Stage Reconstruction with Implicit Tensor Neural Representation (TSR-ITNR), a unified self-supervised framework integrating representation refinement and observation-guided calibration. In Stage 1, TSR-ITNR learns an implicit Tucker representation and refines its low-rank spatial coefficient tensor and spectral basis to better capture fine spatial structures and interband correlations. A fixed pretrained denoiser further provides a deep prior for the preliminary reconstruction. In Stage 2, parameter-free calibration derives complementary and noninterfering corrections from both observations to recover information insufficiently captured in Stage 1. Theoretical analysis establishes the geometry-preserving property of spectral refinement and the orthogonal complementarity of calibration. Extensive experiments on multiple benchmark datasets demonstrate strong quantitative, visual, and spectral reconstruction performance without ground-truth HR-HSI supervision. Beyond conventional reconstruction metrics, we further assess the effectiveness of TSR-ITNR using downstream semantic segmentation accuracy.
16. 【2609.05255】Compact Neural Appearance Models for Efficient Gaussian Splatting
链接：https://arxiv.org/abs/2609.05255
作者：Florian Hahlbohm,Jorge Condor,Linus Franke,Martin Eisemann,Marcus Magnor
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Gaussian Splatting typically, Explicit primitive-based radiance, Gaussian Splatting, primitive-based radiance fields, Splatting typically model
备注： Project page: [this https URL](https://fhahlbohm.github.io/efficient-gaussian-appearance)
点击查看摘要
Abstract:Explicit primitive-based radiance fields such as 3D Gaussian Splatting typically model view-dependent appearance using low-order spherical harmonics (SH). Although efficient to evaluate, SH coefficients dominate per-primitive storage and memory traffic, while their band-limited basis restricts angular detail. We present a thorough, end-to-end comparison of SH and recent spherical appearance models and introduce an implicit alternative that decodes compact per-primitive latent codes using a tiny shared MLP. We integrate all models into the same optimized pipeline, fusing their forward and backward passes into a differentiable CUDA rasterizer and provide a portable WebGL viewer for laptop and mobile GPUs. Our evaluation across reconstruction quality, memory use, and optimization and rendering performance shows that recent spherical models offer the strongest overall quality-efficiency trade-off. Our neural representation is the most compact model evaluated and, compared to third-degree SH, reduces the per-primitive appearance footprint from 192 to 28 bytes, accelerates optimization by 1.3$\times$, while improving reconstruction quality. We further analyze how appearance parametrization shapes optimization, identifying differences in recovered geometry and the tendency of expressive models to absorb non-static scene content. Together, our framework and analysis provide practical guidance for replacing SH beyond what image metrics alone can capture.
17. 【2609.05242】Few-Shot Video Recognition via Hierarchical Metric Learning
链接：https://arxiv.org/abs/2609.05242
作者：Jiaxin Zhang,Haoran Gao,Xizhan Gao,Zihao Dong,Tingwei Wang,Sijie Niu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：annotated video samples, unseen action categories, recognize unseen action, Few-shot action recognition, aims to recognize
备注：
点击查看摘要
Abstract:Few-shot action recognition (FSAR) aims to recognize unseen action categories with only a small number of annotated video samples. Recent works typically apply single-prototype supervision at the network output and fail to sufficiently exploit rich cross-frame global spatial information in videos. Even existing multi-level metric schemes only impose parallel prototype constraints on intermediate layers, without progressive supervision along the full feature pipeline, which results in limited generalization ability of the learned class prototypes. Inspired by this, we present a novel method, hierarchical metric learning for few-shot action recognition (HML-FSAR). First, a spatial-enhanced module is developed to capture cross-frame global spatial representations. Combined with temporal MHA, heterogeneous alignment, spatial-temporal feature fusion and dictionary learning modules, it constructs the complete feature processing pipeline. Second, a hierarchical metric learning (HML) strategy is embedded into HML-FSAR. Composed of center metric, alignment metric, contrastive metric, dictionary metric and prototype metric, HML imposes progressive multi-stage complementary constraints from frame-level representations to final class prototypes, so as to jointly optimize feature compactness, heterogeneous spatial-temporal alignment, inter-class discriminability and anti-noise robustness. The proposed HML-FSAR method is validated on five widely-used FSAR datasets, and experimental results fully demonstrate its effectiveness.
18. 【2609.05239】Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents
链接：https://arxiv.org/abs/2609.05239
作者：Daniel Davila,Ravikumar Balakrishnan,Mike Cochran
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-Language Model, present a system, diagnostic agent, agent for adapting, VLM directly inspects
备注：
点击查看摘要
Abstract:We present a system that uses a Vision-Language Model (VLM) as a diagnostic agent for adapting a detect-to-track pipeline to a new target domain without access to target-domain labels. Rather than optimizing against annotated metrics, the VLM directly inspects rendered tracking outputs, identifies visual failure modes, and recommends parameter updates through an iterative tuning loop. We first demonstrate that ground-truth-supervised hyperparameter transfer can be brittle. On MOT17-MOT20, applying a source-derived oracle configuration reduces mean HOTA by 0.090, from a target-domain ceiling of 0.357, to 0.267. Without using any target-domain labels, our VLM-based tuner recovers 67.8% of this lost headroom, finishing within 0.029 HOTA of the target ceiling; on the highest-density target sequence, it recovers up to 86.7%. We further show that label-free Bayesian optimization with handcrafted proxy objectives struggles under large domain shifts and can degrade configurations that are already strong. In contrast, the VLM tuner acts selectively: when its visual diagnosis reveals no clear failure mode, it declines to modify the configuration, preserving performance on easy transfers while improving hard ones. Finally, we characterize the conditions under which this approach succeeds, namely, when domain shift manifests through exposed detection-level parameters, versus where it is less effective, such as MOT17-DanceTrack, where the source oracle is already near-optimal.
19. 【2609.05234】Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements
链接：https://arxiv.org/abs/2609.05234
作者：Yijia Chen,Boyu Wei,Xuanhua Yin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：produce predictable image, coefficient changes produce, produce predictable, sliders, propose Measured Sliders
备注： 15 pages, 5 figures, 2 tables
点击查看摘要
Abstract:Continuous sliders are useful only when coefficient changes produce predictable image changes. Yet most diffusion sliders derive their axes from text or learned representations, leaving their scales disconnected from observable image properties. Consequently, we cannot tell in advance which attributes are learnable, compare control strengths directly, or anticipate interference when multiple controls are combined. We propose Measured Sliders, a framework that defines continuous controls through closed-form differentiable image measurements. A common measurement space unifies the pipeline. Before training, an observability test identifies usable supervision. During training, a measurement-guided objective learns target movement while suppressing non-target changes. After training, decoded calibration expresses controls in comparable units of realized image change. Multiple LoRA branches are stored in one checkpoint and composed without training on joint activations. Across SDXL and FLUX.1-dev, the resulting controls are ordered, selective, and composable. On 553 prompts, lighting direction reaches rho = 0.995 and 98.9% monotone sweeps. A five-attribute checkpoint achieves average selectivity 2.59, compared with 1.50 for the strongest baseline, and preserves every requested direction in 96.7% of pair and 86.1% of triple compositions. The observability test also separates every subsequently successful measurement from the failed candidate. Overall, image-space measurement provides a common basis for learning, diagnosing, calibrating, and composing continuous generative controls.
20. 【2609.05224】First Things First: Teaching LLM-Based Agents to Prioritize Must-Haves before Nice-to-Haves
链接：https://arxiv.org/abs/2609.05224
作者：Tianjie Ju,Xinyue Xu,Wanxuan Sun,Lingxiao Diao,Gongshen Liu,Zhuosheng Zhang,Cheng Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, multimodal large language, fueled significant enthusiasm, Recent progress, language models
备注： Accepted at EMNLP 2026 (Findings)
点击查看摘要
Abstract:Recent progress in multimodal large language models (MLLMs) has fueled significant enthusiasm in their potential to act as autonomous agents for real-world tasks. However, scenarios requiring agents to fulfill users' complex, structured requirements remain largely underexplored. In this work, we examine reasoning tasks under three distinct requirement scenarios: (i) Must-have requirements uniquely determine a unique feasible solution; (ii) Multiple answers satisfy the must-have requirements and are prioritized via the nice-to-have requirements; and (iii) No candidate solution satisfies the must-have requirements, in which case the agent should abstain from generating a response. We evaluate state-of-the-art MLLMs on 3,649 carefully constructed problems that reflect realistic service scenarios, including e-commerce, booking, and map-based or ride-hailing. Our evaluation reveals that existing MLLMs exhibit catastrophic failures in all scenarios. They frequently misinterpret task requirements, violate must-have requirements, and produce invalid solutions. To address this critical gap, we propose First Things First Reinforcement Learning FTF-rl that explicitly optimizes reasoning over multi-priority user requirements. Experimental results show that our method substantially improves the task success rate compared to strong baselines. Moreover, FTF-rl yields general effectiveness on popular logical and mathematical reasoning tasks, including LogicVista, MathVision, and InfoQA. Our findings suggest that enhancing requirement-aware reasoning capability provides a simple yet effective pathway to improve generalization of MLLM agents. Code and dataset are available at this https URL.
21. 【2609.05210】BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors
链接：https://arxiv.org/abs/2609.05210
作者：Vincent Leroy,Philippe Weinzaepfel,Lojze Zust,Yohann Cabon,Jérome Revaud
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：traditional bundle adjustment, bundle adjustment, pixel matching, Recent hybrid, combine the robustness
备注： ECCV'26
点击查看摘要
Abstract:Recent hybrid Structure-from-Motion (SfM) systems combine the robustness of feed-forward 3D reconstruction with the accuracy of traditional bundle adjustment (BA) with pixel matching. They are usually the best performing methods however their scalability and usability remains limited since estimating dense correspondences between views is prohibitively costly, especially considering time constraints inherent to online applications like Visual SLAM (VSLAM). In this paper, we introduce a regularized BA framework that leverages a fast multi-view matcher and monocular priors for initialization and regularization. In contrast to existing systems, our unified approach seamlessly supports both online VSLAM and offline reconstruction from unordered image collections within the same optimization framework and sharing common hyperparameters for all tasks. Extensive experiments across both domains demonstrate improved performance and speed tradeoffs over traditional, feed-forward, and hybrid baselines. Notably for VSLAM, our uncalibrated method outperforms all previous calibrated approaches.
22. 【2609.05182】Conserved Immune Topology Improves Pathology Foundation Model Generalization for Cross-Cancer MSI-H Prediction
链接：https://arxiv.org/abs/2609.05182
作者：Dasari Naga Raju
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multiple instance learning, instance learning achieve, learning achieve competitive, achieve competitive accuracy, remains unresolved due
备注： Accepted at the ECCV 2026 Workshop on Medical Foundation Models and Benchmarks (MedFM-Bench). 15 pages, 2 figures
点击查看摘要
Abstract:Pathology foundation models integrated with multiple instance learning achieve competitive accuracy within single-cancer cohorts, yet cross-cancer generalization remains unresolved due to organ-specific histological and architectural differences. In this paper, we propose Conserved Immune Topology (CIT), a lightweight spatial representation for cross-cancer MSI-H prediction that augments foundation-model embeddings with biologically motivated immune descriptors. CIT uses unsupervised clustering to identify immune-associated tiles, then encodes tertiary lymphoid structures, peritumoral immune reactions, multi-scale tumor-infiltrating lymphocyte density, and immune-tumor mixing from frozen foundation-model embeddings and tile coordinates without requiring annotations or target-domain data. The proposed method was evaluated under cross-site and cross-cancer settings using CPTAC-COAD and TCGA-STAD cohorts, which introduce scanner variability, distribution shifts, and organ-specific architectural variations. Zero-shot cross-cancer transfer with CIT increased TransMIL AUC from 0.6627 to 0.7161, an absolute gain of 0.0534 (p=0.003), with consistent improvements across all three MIL aggregators. These results suggest that spatial immune topology provides potentially an organ-invariant representation for MSI-H prediction, supporting cross-cancer generalization of pathology foundation models.
23. 【2609.05174】SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis
链接：https://arxiv.org/abs/2609.05174
作者：Yuqing Yang,Alexander Schmatz,Zhaozhao Ma,Changkyu Choi,Robert Jenssen,Shujian Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：safety-critical clinical decision-making, clinical decision-making, crucial requirement, requirement in AI-based, safety-critical clinical
备注： 30 pages, 10 figures
点击查看摘要
Abstract:Explainability is increasingly seen as a crucial requirement in AI-based medical diagnosis, particularly in safety-critical clinical decision-making. Most existing explainability methods in healthcare operate in a post-hoc manner and are predominantly designed for unimodal data, which limits their applicability in increasingly prevalent multimodal diagnostic settings. This paper addresses the problem of self-explainable multimodal diagnosis by formulating it within the information bottleneck (IB) framework. We propose a unified learning paradigm that jointly optimizes predictive performance and modality-specific explainability by identifying the most informative elements inside each modality that contribute to diagnostic decisions. To enable tractable and stable optimization, we employ a matrix-based Renyi's $\alpha$-order entropy functional under the assumption of sufficiently expressive encoders. Extensive experiments on representative medical datasets spanning heterogeneous modalities demonstrate that the proposed method consistently achieves strong diagnostic performance, including an absolute accuracy improvement of 9.1 percentage points on the iCTCF dataset. Moreover, the learned explanations provide transparent and modality-aware insights into feature relevance, thereby improving both the explainability and generalization.
24. 【2609.05171】WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing
链接：https://arxiv.org/abs/2609.05171
作者：Hui Zhang,Zongkai Liu,Liqiang Niu,Juntao Liu,Han Li,Zhen Cao,Wenchao Chen,Chengduo Zhao,Fandong Meng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：require external world, external world knowledge, prompts require external, advanced rapidly, require external
备注：
点击查看摘要
Abstract:Image generation and editing models have advanced rapidly, yet remain unreliable when prompts require external world knowledge. Bounded and long-tail parametric knowledge prevents direct or reason-then-generate approaches from recovering the required facts and visual appearances. Existing agentic generation and editing methods mitigate this limitation with retrieval tools, yet remain constrained by insufficient visual verification, overloaded policy models, and weak integration of retrieved textual and visual evidence. To address these limitations, we present WeAgent-MMGenEdit, a full-stack recipe including a multimodal harness, a scalable data construction pipeline, a comprehensive benchmark, and post-training methods for the agent policy and image backend. We first introduce WeAgent-Harness, a multimodal runtime with persistent evidence management and dedicated verification and integration tools that organize retrieved multimodal evidence into a dense carrier. Upon this, we develop a scalable pipeline for prompt synthesis and agentic trajectory collection, yielding 23K supervised trajectories and 14.7K RL tasks with three-layer verifiable checklists. We further introduce WeBench-MMGenEdit, a bilingual benchmark covering both knowledge-intensive image generation and multi-image editing. Finally, a two-sided post-training recipe based on SFT and RL improves the agent policy and image backend. Together, WeAgent-MMGenEdit enables a 30B-total/3B-active policy to outperform similarly sized policy models and approach the performance of a 1T-parameter agent.
25. 【2609.05149】From Vision to Language: Investigating Causal Information Flow in Multimodal Decision-Making
链接：https://arxiv.org/abs/2609.05149
作者：Davide Testa,Hugh Mee Wong,Alessandro Lenci,Bernardo Magnini,Albert Gatt
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：evidence requires tracing, visual evidence requires, commonly evaluated, evidence requires, requires tracing
备注： Accepted at Findings of EMNLP 2026
点击查看摘要
Abstract:Vision-Language Models are commonly evaluated through their final predictions, but understanding whether these decisions are grounded in visual evidence requires tracing how visual information contributes to language-based decisions. With this purpose in mind, we investigate cross-modal information flow in a video-based generative multiple-choice-like setting by applying a layer-wise causal intervention on video-text attention pathways. We target spatial, causal, and temporal visual reasoning. Our results show that visual information is mainly integrated while the model processes the candidate answer options, which serve as the primary textual grounding sites for the final decision. We further show that nouns play an important role as semantic anchors during multimodal enrichment, while verbs are more relevant when temporal relations are processed. Finally, we identify a distinct pattern in temporal reasoning, suggesting that VLMs struggle to reconstruct sequential information across video frames, but we remark that such fragility may also reflect linguistic biases associated with specific temporal expressions used for defining the relation between events within a scene.
26. 【2609.05114】VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps
链接：https://arxiv.org/abs/2609.05114
作者：Sunesh Praveen Raja Sundarasami,Taehyoung Kim,Johannes Scherer,Tomaž Cotič,Sivasubiramaniam Subbiah,Andreas Greiner,Paul Spannaus,Sebastian Houben
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：increasingly constructed automatically, increasingly constructed, constructed automatically, robotics by integrating, Semantic
备注：
点击查看摘要
Abstract:Semantic 3D maps are increasingly constructed automatically for aerial robotics by integrating learned semantic predictions into 3D representations. While this avoids costly manual 3D annotation, errors in the perception and mapping pipeline can persist in the resulting map, reducing its reliability for downstream autonomous tasks. Existing 3D semantic map refinement methods either rely on the original observations, treat occupancy as part of the prediction problem, or apply non-learned local regularization to completed maps. Instead, we study post-hoc semantic correction, asking whether semantic accuracy can be recovered directly from the completed map while keeping its geometry and occupancy fixed. We introduce \method, a graph-based model that corrects voxel labels based on local geometry and neighboring semantic information. To obtain training pairs, we corrupt contiguous regions of annotated OccuFly maps according to class confusions observed in upstream maps. We evaluate \method on completed OccuFly maps generated from predictions of four independently trained 2D segmentation models. \method consistently improves mIoU by 4.23--5.00 percentage points, with gains broadly distributed across the evaluated semantic classes and particularly strong improvements for tree, roof, and wall. Results on an independently reconstructed out-of-distribution aerial scene further suggest that the learned correction can transfer beyond the environments seen during training.
27. 【2609.05091】raining-Free Logical and Structural Anomaly Detection via Calibrated Fusion
链接：https://arxiv.org/abs/2609.05091
作者：Changyi Li,Miao Yu,Kai Dong,Yu Xiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：distinct defect families, local texture corruptions, violate global rules, Industrial anomaly detection, Industrial anomaly
备注： Accepted by PRCV 2026
点击查看摘要
Abstract:Industrial anomaly detection must handle two distinct defect families: structural anomalies, which manifest as local texture corruptions, and logical anomalies, which violate global rules on object count, composition, or arrangement. Existing detectors typically favor one family at the expense of the other. In particular, training-free methods effectively exploit frozen representations but lack an explicit notion of object count, while methods that reason about counts usually rely on category-specific component modeling. We show that counting ability can be introduced into training-free anomaly detection without additional training or part-level supervision. Our key idea is a normal-set calibration that aligns heterogeneous anomaly cues using statistics from normal images, enabling their direct fusion within a unified training-free framework. Built upon this calibration, our detector combines complementary frozen cues to address both logical and structural anomalies. On MVTec-LOCO, our method achieves image-level AUROCs of 89.0 and 95.9 on logical and structural anomalies, respectively, yielding a 92.5 average---the best among training-free detectors in our comparison. It remains competitive with methods requiring network training or part annotations, while its structural variant matches PatchCore on MVTec-AD (99.1 image-AUROC), suggesting that the proposed calibration generalizes beyond logical anomaly detection.
28. 【2609.05070】MultiAttenGastro: Multi-Dimensional Attention Augmentation for Gastrointestinal Endoscopy Classification
链接：https://arxiv.org/abs/2609.05070
作者：Sadhana Devarajan,Praveen Kumar Chandaliya,Dhruvin Jashvant Kumar Shah,Kishor Upla,Kiran Raja
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automated gastrointestinal, classification requires models, natural-image pretraining, requires models, models that generalize
备注： 17 Pages, 2 Figures, CVIP2026
点击查看摘要
Abstract:Automated gastrointestinal (GI) endoscopy classification requires models that generalize across diverse modalities and class distributions, often far from natural-image pretraining. We propose MultiAttenGastro, a plug-and-play attention framework with parallel 1-D channel, 2-D spatial, and 3-D contextual heads, and present the first systematic cross-dataset evaluation across eight CNN and transformer backbones on five public GI datasets (80 backbone--dataset runs). We find that attention effectiveness is not universal but tracks the representational gap between ImageNet features and the target distribution: MultiAttenGastro improves 6 of 8 backbones on Kvasir-Capsule (14-class WCE, large gap; best macro F1 98.33\%), is uniformly negative on the small-gap Kvasir-v2 benchmark (0/8), and shows mixed outcomes on datasets with intermediate gap. Five-seed ablation on the strongest case (Kvasir-Capsule, ConvNeXt-Tiny) shows this improvement is directionally consistent, but not statistically decisive (paired $t$: $p=0.47$; Wilcoxon: $p=0.63$), and that individual attention heads are not uniformly beneficial in isolation only their combination yields a positive mean effect. Centered Kernel Alignment (CKA) analysis links this pattern to representational redundancy: low inter-head CKA under large domain gaps coincides with the framework's only consistent gains, while high redundancy under small gaps coincides with its losses. We report these results, including the non-significant margins, as evidence for when and why multi-dimensional attention helps GI endoscopy classification, rather than as a claim that MultiAttenGastro is a strictly superior architectural choice.
29. 【2609.05066】Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection
链接：https://arxiv.org/abs/2609.05066
作者：Changyi Li,Yu Xiao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：manual annotation capacities, critical research frontier, surveillance data outpaces, data outpaces manual, outpaces manual annotation
备注： Accepted by PRCV 2026
点击查看摘要
Abstract:As the scale of video surveillance data outpaces manual annotation capacities, weakly supervised video anomaly detection (WSVAD) has emerged as a critical research frontier. Most existing approaches formulate WSVAD within a Multiple Instance Learning (MIL) framework that relies on rigid, hand-crafted temporal priors to supervise anomaly scoring. However, such formulations exhibit limited adaptability to the wide variation in anomaly durations and temporal dynamics observed in real-world videos, often leading to unstable or unreliable snippet-level predictions. To address this limitation, we propose an adaptive temporal modeling framework for WSVAD that explicitly accounts for variations in video dynamics across multiple temporal granularities. First, we introduce a Temporal Refinement Module (TRM) that leverages dynamic positional encoding and a learnable class token to model long-range temporal dependencies while distilling a stable global video-level representation. Second, to capture anomalous events with varying frequency and duration, we develop an adaptive Event Segmentation Module (ESM) that identifies event boundaries through temporal discontinuity analysis and aggregates snippet features into discriminative event-level representations. Finally, for snippet-level and event-level predictions, we propose an adaptive similarity-based fusion strategy that dynamically integrates anomaly scores into video-level predictions, replacing fixed top-k aggregation heuristics with global semantic relevance. Extensive experiments on two benchmarks demonstrate that the proposed framework consistently outperforms state-of-the-art methods.
30. 【2609.05049】Efficient Multi-Timescale Event Representations for Feed-Forward Object Detection
链接：https://arxiv.org/abs/2609.05049
作者：Fredrik Lundell,Per-Erik Forssen,Mårten Wadenbäck,Astrid Lundmark
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous systems require, systems require robust, require robust low-latency, robust low-latency perception, rapidly changing scene
备注： Accepted to the Workshop on Neuromorphic Vision (NEVi) at ECCV 2026, 16 pages
点击查看摘要
Abstract:Autonomous systems require robust low-latency perception under rapidly changing scene dynamics and challenging illumination. In event cameras object detection commonly relies on recurrent architectures to accumulate sparse temporal information over time. This work investigates how temporal information can be encoded directly within the event representation. We propose a confidence-normalized continuous multi-timescale representation based on logarithmic B-spline temporal encoding together with a geometry-aware local confidence mechanism that exploits the spatial structure of event generation. Using a fixed feed-forward EventCenterNet detector, we show that the proposed representations consistently outperform the compact CSTR representation on PEDRo and Gen1 datasets. We further introduce a recursive exponential-polynomial approximation that enables efficient event-by-event updates while largely preserving detection performance. These results demonstrate that carefully designed event representations can capture a substantial portion of the temporal information learned through recurrent temporal modeling, providing a promising foundation for efficient feed-forward, event-driven, and future neuromorphic object detection.
31. 【2609.05038】PuTR-CouT: Counting-by-Tracking in Camera-Trap Image Sequences
链接：https://arxiv.org/abs/2609.05038
作者：Fagner Cunha,Juan G. Colonna,Eulanda M. dos Santos
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：key ecological modeling, ecological modeling tasks, require counting individual, camera trap images, Species identification
备注：
点击查看摘要
Abstract:Species identification in camera trap images has been widely studied, but key ecological modeling tasks such as species abundance or density estimation also require counting individual animals. However, the lack of counting labels in most datasets and low frame rates (typically ~1 frame per second) make sequence-level tracking and count estimation particularly challenging. In this work, we present PuTR-CouT, a counting-by-tracking framework built on a transformer-based learned association mechanism for sequence-level animal counting in camera trap images. To address the scarcity of annotated tracking data, we generate synthetic training data by exploiting structural priors, such as static backgrounds and short temporal bursts, to heuristically create pseudo-tracking labels in a weakly supervised manner. The resulting tracker associates detections across frames, using these tracks to estimate per-species counts. We also refine the MaxBoxCount heuristic used by the top solutions of the iWildCam 2021 challenge as a strong baseline, setting the highest score reported to date. When evaluated on the iWildCam 2021 benchmark, our framework PuTR-CouT delivers competitive counting results compared to the improved MaxBoxCount, with the added capability of multi-species predictions and track-level verification.
32. 【2609.05028】Compositional Reward Models for Conditional Medical Image Generation
链接：https://arxiv.org/abs/2609.05028
作者：Aayush Kumar Tyagi,Prathosh A.P.,Mausam
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires domain expertise, Acquiring high quality, annotation is expensive, time consuming, Acquiring high
备注：
点击查看摘要
Abstract:Acquiring high quality annotated medical image data is critical for training deep learning models; however, annotation is expensive, time consuming, and requires domain expertise. Conditional diffusion models, such as ControlNet, offer an alternative by generating images conditioned on semantic masks and text. However, existing approaches fail to capture fine grained properties (e.g., intensity and texture), as well as semantic consistency expected by domain experts, limiting their effectiveness for downstream tasks. Recent attempts to address these issues using reinforcement learning fine-tuning remain limited due to the reliance on a single scalar reward, which conflates diverse failure modes and provides weak corrective signals. We propose PRISM, a Compositional Reward Model (CRM) framework for conditional medical image generation. Instead of assigning a single reward, we decompose image quality into verifier grounded stages, each evaluating a distinct aspect of correctness from fine to coarse properties, including low level attributes (intensity and texture), structural alignment with conditioning inputs, and high level semantic fidelity. These stage wise rewards are composed through a Hierarchical Constrained Propagation (HCP) mechanism that enforces a fine to coarse notion of correctness, ensuring that lower level deficiencies are resolved before higher level rewards are accrued, preventing easier objectives from masking critical failures. We evaluate PRISM across three datasets spanning diverse medical imaging tasks: PanNuke (multi-class cell segmentation), CeDeM (villi/crypt detection and measurement), and ISIC (skin lesion classification). Training downstream models with data generated by PRISM yields improvements over closest baselines, including a 2.3% increase in mDice on PanNuke, a 8.5% reduction in Mean Relative Error (MRE) on CeDeM, and increases ISIC F1 by 5.9%.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.05028 [cs.CV]
(or
arXiv:2609.05028v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.05028
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
33. 【2609.04984】mporal Residual Neural Radiance Fields for Monocular Video Dynamic Human Body Reconstruction
链接：https://arxiv.org/abs/2609.04984
作者：Tianle Du,Jie Wang,Xiaolong Xie,Wei Li,Pengxiang Su,Jie Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single multilayer perceptron, vision and graphics, multilayer perceptron, number of approaches, computer vision
备注： Published in Journal of Electronic Imaging, 2024
点击查看摘要
Abstract:In the field of computer vision and graphics, high-quality reconstruction of the human body in static scenes has been achieved in recent years by a single multilayer perceptron (MLP) in a number of approaches. However, MLPs have capacity limitations, requiring substantial training time and computational resources for dynamic scene reconstruction. And the quality of reconstruction is significantly constrained. This paper proposes a method for effectively processing complex spatiotemporal signals in dynamic scene human 3D modeling. The proposed method uses Temporal Residual Neural Radiance Fields to achieve novel view rendering and new pose synthesis of human this http URL address the problem of representing temporal signals in video sequences, we construct a temporal residual field which is not related to the MLP architecture. Secondly, to improve reconstruction efficiency, we propose an integrated approach that reduces trainable parameters and accelerates rendering, thereby enhancing the network's feature representation capability. Finally, we design a multi-dimensional loss function to accurately measure the loss between predicted and actual spatial pixel values. The experimental results show that our proposed approach improves the peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) accuracy metrics compared to the latest representative methods. It maintains similar accuracy to Anim-NeRF and Neural Body while achieving a nearly 780-fold increase in time efficiency.
34. 【2609.04976】RefDiT: Local Attribute Guidance in Reference-Based Image Generation
链接：https://arxiv.org/abs/2609.04976
作者：Rameshwar Mishra,Srikrishna Karanam,A V Subramanyam
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reference image, Personalization models generate, global style derived, reference, produce images aligned
备注：
点击查看摘要
Abstract:Personalization models generate new images guided by a few subject references, while style transfer methods aim to produce images aligned with a global style derived from a reference image. Recent approaches perform well when the reference image contains a single object, effectively capturing a global style that encompasses all implicit attributes. However, when applied to complex real-world scenes containing multiple objects with distinct attribute characteristics, these methods, due to their global-level guidance, fail to localize relevant elements in the reference image. The global guidance restricts their ability to generate new images based on the local attributes in the reference image. Moreover, existing methods typically employ a single identifier token to capture all details from the reference, resulting in a lack of individual, attribute-level control. Motivated by these limitations, we propose RefDiT, a novel framework for reference-guided image generation. RefDiT takes as input a reference image, a text prompt, and an optional user-provided guidance context. RefDiT employs local region guidance using the attributes of local elements. It constructs an attribute-aware conditioning signal from the reference image by performing attribute-level decomposition of the identifier token and performs context adjustment in the inference prompt to train low-rank adapter (LoRA) blocks of a diffusion transformer (DiT)-based generative model. RefDiT learns the correspondence between identifier tokens and local regions in the reference image, enabling more effective local guidance.
35. 【2609.04965】ARC-Loc: Leveraging Azimuthal Ray Convergence as a Geometric Cue for Direct Cross-View Localization
链接：https://arxiv.org/abs/2609.04965
作者：Hyeongsik Kim,Mincheol Kim,Heejoon Moon,Je Hyeong Hong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：external depth foundation, depth foundation models, estimates the pose, Cross-view localization, geo-referenced satellite image
备注： Accepted to ECCV2026
点击查看摘要
Abstract:Cross-view localization (CVL) estimates the pose of a ground image by matching it to a geo-referenced satellite image. To bridge the extreme viewpoint gap, mainstream pipelines rely on Bird's-Eye-View (BEV) transformations or 2D-to-3D lifting. However, deriving 3D structures from a single ground image is fundamentally ill-posed, causing these methods to endure geometric distortions and computational costs during 3D lifting or BEV projection. Furthermore, relying on external depth foundation models to resolve this introduces latency and remains susceptible to noisy predictions. In this work, we present a different approach inspired by a human navigation technique called resection, that can perform direct ground to satellite image matching and localization without relying on external depth foundation models. The key insights of our method are that (i) ground keypoints can be translated into azimuthal rays on the satellite map, and (ii) these rays ideally converge at the user location. Exploiting this geometric constraint through direct line-to-point correspondences, we introduce a minimal Azimuthal Ray Convergence (ARC) solver to identify the intersection, alongside an ARC loss to optimize the matching network. By eliminating dependencies on computationally heavy BEV transformations and external depth foundation models, our approach achieves faster, memory-efficient inference, while its explicit feature matching ensures straightforward compatibility with existing frameworks. Experiments on VIGOR and KITTI demonstrate that ARC-Loc maintains competitive localization accuracy compared to recent approaches, highlighting its practicality.
36. 【2609.04958】MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision
链接：https://arxiv.org/abs/2609.04958
作者：Zijie Zhu,Weiren Cai,Yizhou Wang,Zhenjie Yang,Yide Liu,Jiahao Chen,Guanqi He
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Recovering camera, robot learning, hand motion, activity understanding, augmented reality
备注：
点击查看摘要
Abstract:Recovering camera and hand motion in world coordinates from egocentric video is a key capability for activity understanding, robot learning, and augmented reality. Existing systems typically decompose this problem into separate stages for camera motion, depth, hand reconstruction, and trajectory refinement, resulting in substantial computational overhead and preventing the joint modeling of camera and hand motion. We introduce MINT (Minting IN-the-Wild Trajectories), the first foundation model that directly produces complete world-space two-hand trajectories from ego-centric RGB video. From a single shared spatiotemporal video representation, MINT jointly predicts the camera trajectory, camera-frame hand states, and per-frame hand presence, and then produces world-space hand motion via explicit coordinate transformations. Training such a model at scale is challenging, since paired world-space camera and hand annotations are scarce. We therefore develop an open-source labeling EGOPIPELINE that converts large collections of public egocentric videos into structured camera-and-hand trajectory supervision. MINT is first pretrained on these large-scale pseudo-labels and then fine-tuned on a small set of high-quality joint annotations. Across public benchmarks, MINT achieves [xxx] improvement in world-space hand trajectory accuracy, [xxx] improvement in camera trajectory estimation, and [xxx] faster end-to-end trajectory generation than the labeling pipeline, while generalizing zero-shot to unseen egocentric datasets. We release the model, training and inference code, labeling pipeline, and a curated 1,021-hour egocentric trajectory dataset.
37. 【2609.04948】VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition
链接：https://arxiv.org/abs/2609.04948
作者：Jiangang Zhu,Zheng Wang,Bin Zhu,Yi-Ping Phoebe Chen,Jingjing Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：largely attributed, textbf, dominant paradigm, presumed ability, Deep Ensemble Distillation
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Multi-expert models have become the dominant paradigm for long-tailed learning, largely attributed to their presumed ability to benefit from expert diversity. However, we revisit this central assumption and reveal that diversity induced by logit adjustment or explicit regularizers does not guarantee better ensemble accuracy. Our work suggests that multi-expert models benefit more from variance reduction than diversity maximization. We introduce \textbf{VICAL}, a \textbf{VI}cinal \textbf{C}onsistency \textbf{AL}ignment framework that improves long-tailed recognition not by enforcing expert diversity, but by reducing prediction variance. Specifically, our approach comprises two key components: Self-Consistency Learning and Deep Ensemble Distillation. Self-Consistency Learning discourages reliance on unstable high-frequency information, smoothing the local loss landscape and mitigating overfitting, especially for tail classes. Deep Ensemble Distillation promotes cross-expert low-frequency semantic agreement using a low-resolution view, thereby sidestepping optimization conflicts with established knowledge. Extensive experiments on CIFAR-LT, ImageNet-LT, and iNaturalist 2018 show that VICAL consistently outperforms state-of-the-art methods, validating the effectiveness of our consistency-driven design. Our code is available at \href{this https URL}{VICAL}.
38. 【2609.04947】MCPO: Modality-Contrastive Preference Optimization for Multimodal Chain-of-Thought Compression
链接：https://arxiv.org/abs/2609.04947
作者：Guangheng Yang,Zhenliang Ni,Zhenkai Wu,Han Shu,Juan Feng,Wenming Yang,Jie Hu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：demonstrated remarkable capabilities, solving complex tasks, demonstrated remarkable, remarkable capabilities, capabilities in solving
备注：
点击查看摘要
Abstract:Recently, multimodal large-scale reasoning models have demonstrated remarkable capabilities in solving complex tasks through long Chains-of-Thought (M-CoT). However, excessively long reasoning trajectories incur substantial computational costs and significant KV-cache pressure. Existing CoT compression and alignment paradigms mainly rely on static rules or single-dimensional preferences, lacking fine-grained cross-modal constraints; as a result, they are prone to inducing visual laziness and hallucinatory reasoning. To address these issues, we propose Modality-Contrastive Preference Optimization (MCPO), a highly sample-efficient two-stage length-compression method that requires fewer than 900 training samples. In the compression stage, we introduce a step-level Normalized Cross-Modal Mutual Information (NCMI) pruning algorithm, which automatically identifies and removes visual-independent reasoning steps by comparing the reasoning discrepancies between with-image and no-image contexts. This significantly reduces redundancy and hallucinatory content in the reasoning chains. In the alignment stage, the model first undergoes supervised fine-tuning to achieve domain-adaptive initialization, followed by optimization using an asymmetric multimodal length-controlled preference loss. This objective adopts a highly nonlinear odds-ratio formulation that provides steep gradients in the with-image context to reinforce length constraints for preferred trajectories, while applying a scaled, flat-gradient linear difference in the no-image context to maintain modality consistency, thereby achieving stable cross-modal preference alignment. Extensive experiments on mainstream base models such as Qwen3-VL-Thinking show that our method can reduce CoT length by up to 69.5% and achieve up to 3.34x end-to-end inference speedup while preserving original accuracy.
39. 【2609.04942】Learning 3D Editing without Paired Supervision via Generative Prior Distillation
链接：https://arxiv.org/abs/2609.04942
作者：Hao Wen,Weibin Yun,Hongxing Fan,Haotian Lu,Rui Chen,Zehuan Huang,Lu Sheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：interactive content creation, paired training data, high-quality paired training, content creation, significant bottleneck
备注： 18 pages, 14 figures
点击查看摘要
Abstract:Instruction-guided 3D editing is essential for interactive content creation, yet it faces a significant bottleneck: the severe scarcity of high-quality paired training data. Existing approaches attempt to bypass this by either relying on slow test-time optimization or training on pseudo-pairs constructed via complex pipelines, which often introduce structural drift and geometric artifacts. In this paper, we propose a novel framework that learns feed-forward 3D editing without paired 3D supervision via Generative Prior Distillation. Instead of relying on ground-truth 3D pairs, our core idea is to distill visual, semantic, and geometric knowledge from powerful foundation models directly into a 3D editing model. Specifically, through a differentiable rendering pipeline, we supervise the 3D representation using two complementary signals: a 2D visual prior from an image editing model at the main editing view, and a semantic prior from a Vision-Language Model at novel views to ensure strict instruction following and source identity preservation. Crucially, to address the geometric collapse and multi-view inconsistencies inherent in 2D projection supervision, we introduce a 3D-aware Distribution Matching regularization. Acting as a geometric prior, this term operates in the 3D latent space, constraining the edited output to remain within the manifold of realistic 3D assets defined by a pretrained image to 3D teacher model. Extensive experiments demonstrate that our method achieves superior instruction fidelity and cross-view consistency, significantly outperforming state-of-the-art baselines. Our project is available at: this https URL.
40. 【2609.04939】LensStyle: Learning the Optical Aesthetics for Controllable Stylized Lens Effect Rendering
链接：https://arxiv.org/abs/2609.04939
作者：Yachuan Huang,Liwen Xiao,Liao Shen,Qiwen Wang,Huiqiang Sun,Zhiyu Pan,Zhiguo Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unique optical style, camera unique optical, lens effect rendering, photographs are deeply, deeply influenced
备注：
点击查看摘要
Abstract:The visual aesthetics of photographs are deeply influenced by lens characteristics such as aperture shape, optical vignetting and optical diffraction, which together define a camera's unique optical style. Existing lens effect rendering methods primarily focus on accurately simulating the blur transition from small to large apertures but overlook the stylistic aspects of lens effects. As a result, they fail to produce diverse bokeh effects under large apertures or capture distinctive photographic phenomena such as starbursts that emerge under small apertures. In this work, we introduce LensStyle, a unified framework for controllable stylized lens effect rendering that explicitly models lens aesthetics through joint continuous-discrete control. Our model incorporates a Dual-Path Controller that disentangles continuous optical parameter modulation (e.g., focus distance and blur strength) from discrete lens-style conditioning (e.g., circular, polygonal, donut, cat-eye, and starburst effects), enabling fine-grained, interpretable, and physically grounded lens manipulation within a single unified framework. To support model training, we curate a comprehensive MultiLens dataset containing multi-lens image pairs synthesized under real optical constraints. Extensive experiments demonstrate that LensStyle achieves superior realism, controllability, and aesthetic quality compared with existing lens effect rendering approaches and diffusion-based image editing models, advancing computational photography toward multiple-lens-style simulation.
41. 【2609.04921】One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation
链接：https://arxiv.org/abs/2609.04921
作者：Arka Pal,Rajesh Kumar,Hannes Eriksson,Rémi Lacombe,Arvid Laveno Ling,Ankit Gupta,Maciej Wozniak
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：joint future trajectories, Diffusion probabilistic models, capture the multi-modal, interaction-rich distribution, future trajectories
备注： Accepted at ECCV 2026 workshop. Arka and Rajesh have equal contribution
点击查看摘要
Abstract:Diffusion probabilistic models can capture the multi-modal, interaction-rich distribution of joint future trajectories in driving scenes. We show that a single pretrained diffusion traffic model can serve two complementary roles in the autonomous driving development loop: as an ego motion planner, and as a controllable generator of safety-critical scenarios for stress-testing the planners. On the planning side, we introduce a Single-Stream Dual-Stream (SSDS) diffusion-transformer decoder that fuses scene context via joint attention rather than late cross-attention, improving closed-loop performance on nuPlan. We further propose Decoupled Annealing Posterior Sampling with Energy (DAPSE), a training-free guidance scheme that injects arbitrary energy functions at the clean-sample level, avoiding the first-order approximation errors while requiring no auxiliary networks. Beyond planning, we leverage the same diffusion model as a controllable scenario generator to create realistic long-tail driving interactions for closed-loop evaluation. Through inference-time guidance, selected agents are steered toward safety-critical behaviors, including aggressive cut-ins, lead-vehicle braking, and combined longitudinal-lateral interactions, while preserving realistic traffic behaviors. Evaluated in closed-loop nuPlan simulations with independent black-box planners, the generated scenarios expose failure modes that remain hidden under standard benchmarks. Although the SSDS-based planner achieves stronger nominal performance, it experiences larger degradation under these challenging scenarios, demonstrating that benchmark superiority does not necessarily translate to robustness. These results demonstrate that a single learned traffic prior can simultaneously improve motion planning and provide a realistic framework for systematic planner robustness evaluation.
42. 【2609.04911】ourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image
链接：https://arxiv.org/abs/2609.04911
作者：Xin Zhang,Yabo Chen,Zixuan Duan,Haibin Huang,Chi Zhang,Feng Xu,Xuelong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Interactive visual world, Interactive visual, visual world models, world models, video world models
备注：
点击查看摘要
Abstract:Interactive visual world models must distinguish observation from physical intervention. Camera motion reveals new surfaces, whereas intervention changes object motion, contact, and deformation. Current video world models are largely driven by appearance priors and often lose physical or spatial consistency over long horizons. We present TourPhysics, an online framework initialized from a single image and a declarative physical configuration. TourPhysics extends PhysOmni, our ACM Multimedia 2026 work, from finite physics-grounded video synthesis to persistent exploration and manipulation. TourPhysics combines deterministic simulation with video generation while assigning separate roles to simulator state, geometric evidence, generator controls, and appearance memory. For each action, the simulator computes a finite physical and camera trajectory before the corresponding observation is generated. Accepted observations publish the terminal state and update the appearance memory and subsequent generator controls, while the committed state and simulator geometry remain fixed throughout synthesis and retry. We further separate the simulator geometry used for projection and visibility from the relative depth used to condition the generator. A reference-anchored memory retrieves accepted static appearance through geometric cross-view correspondence and incorporates it through a bounded residual that reverts to the native path when no valid correspondence exists. On simulator-defined camera tours and object manipulations, TourPhysics follows prescribed camera and object trajectories more closely than the evaluated baselines, preserves the input scene, and reduces appearance drift during long-horizon revisits.
43. 【2609.04906】Methane Detection On Board Satellites from Unorthorectified Imagery
链接：https://arxiv.org/abs/2609.04906
作者：Luca Marini,Maggie Chen,Hala Lamdouar,Laura Martínez-Ferrer,Dr C. P. Bridges,Giacomo Acciarini
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：potent greenhouse gas, greenhouse gas, climate change, potent greenhouse, major driver
备注：
点击查看摘要
Abstract:As a potent greenhouse gas, methane is a major driver of climate change. Its effective mitigation relies on timely detection. Conventional detection methods rely on orthorectification to correct geometric distortions and matched filters to enhance plume signals, which are steps designed for ground processing and poorly suited to onboard execution. We introduce UnorthoDOS, a dataset and approach for training machine learning models directly on unorthorectified hyperspectral imagery, bypassing both orthorectification and matched-filter products. Our U-Net models trained on unorthorectified data approach the performance of models trained on orthorectified data (IoU 16.91% vs. 18.47% on all plumes), while both substantially outperform the mag1c matched-filter baseline (IoU 4.76%). We further demonstrate the feasibility of onboard deployment: FP16 compression halves model size with under 0.3% output deviation. The trained ML models and two ML-ready datasets -- orthorectified and unorthorectified hyperspectral imagery from the EMIT sensor -- are publicly available at this https URL, with code at this https URL.
44. 【2609.04903】InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyond
链接：https://arxiv.org/abs/2609.04903
作者：Yihan Zhou,Zikai Huang,Yuyang Yu,Xuemiao Xu,Cheng Xu,Shengfeng He
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：framework for generating, duet singing performances, duet performance requires, Unlike solo singing, singing head animations
备注：
点击查看摘要
Abstract:We present InterSing, a framework for generating realistic 3D head animations for duet singing performances. Unlike solo singing, duet performance requires each singer to balance individual expressiveness with intermittent interaction at musically salient moments, such as phrase boundaries, synchronized rhythms, and call-and-response passages. Because these interactions are sparse and rhythm-dependent, existing audio-driven animation methods and conversational interaction models do not adequately capture their structure. Our key insight is that duet coordination can be represented as a time-varying signal that reflects how strongly performers engage with one another throughout a song. Based on this observation, we introduce interaction logits, an interpretable latent representation that models the degree of cross-performer engagement at each time step. We learn these logits using weak supervision and use them to condition an interaction-aware diffusion model jointly driven by audio features and interaction dynamics. This formulation enables unified multi-mode generation, spanning independent motion, coordinated behavior, and smooth transitions between them. Experiments show that InterSing generates realistic and expressive singing head animations with stronger coordination and musical alignment than existing methods, while preserving each performer's characteristic motion style. We further demonstrate that the same formulation generalizes to multi-singer performances and provides intuitive control over when and how performers engage.
45. 【2609.04902】Sound-based Multi-Person 3D Pose Estimation
链接：https://arxiv.org/abs/2609.04902
作者：Yusuke Oumi,Yuto Shibata,Go Irie,Akisato Kimura,Yoshimitsu Aoki,Mariko Isogawa
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO); Sound (cs.SD)
关键词：acoustic, pose, Human Pose Estimator, multi-person, Sound-based Multi-person Human
备注： Accepted at ECCV 2026, Project Page: [this https URL](https://oumi03.github.io/sound-mhpe/)
点击查看摘要
Abstract:Can we recover the 3D poses of multiple people using only sound? This paper presents the first attempt to estimate multi-person 3D poses solely from acoustic signals. Estimating the poses of multiple individuals using acoustic signals is inherently challenging due to the superposition of motion-dependent signal variations. Unlike single-person scenarios, the presence of multiple subjects leads to overlapping acoustic signatures, making it difficult to attribute specific signal changes to an individual's pose. Furthermore, the complexity is compounded by inter-person reflections, which introduce intricate propagation delays that obscure the temporal motion-acoustic relationship. To address these issues, we propose SoundMHPE (Sound-based Multi-person Human Pose Estimator), a novel encoder-decoder framework consisting of two key components. First, the Acoustic Multi-scale Encoder captures diverse temporal and fine-grained frequency features to isolate subtle acoustic signatures from complex, overlapping signals. Second, the Temporal Pose Decoder employs an attention mechanism to disentangle multi-person information across successive frames. By jointly accounting for temporal dynamics and inter-person dependencies, this component precisely reconstructs frame-wise individual poses. To validate our approach, we constructed the 6-hour Acoustic Multi-person Pose (AMP) dataset consisting of 432K synchronized frames of multi-person pose and acoustic data, and demonstrated that our SoundMHPE outperforms baseline models. Project page: this https URL
46. 【2609.04886】SimFuse3D: Source-Guided Target Simulation and Confidence-Guided Multi-Stage Localization Reweighting for Cross-Platform 3D Object Detection
链接：https://arxiv.org/abs/2609.04886
作者：Yongchun Lin,Xinliang Zhang,Yun Zou,Zhixuan Xiao,Liang Lei,Jianya Guo,Yuqiang Zhai,Xiaofeng Wang,HaiKuo Xu,Haoang Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：viewpoint alter object-level, LiDAR unsupervised domain, object-level point distributions, alter object-level point, unsupervised domain adaptation
备注： 9 pages, 5 figures. Submitted to IEEE Robotics and Automation Letters
点击查看摘要
Abstract:Changes in sensor height and viewpoint alter object-level point distributions, making cross-platform LiDAR unsupervised domain adaptation (UDA) difficult. Self-training uses labeled source scans and unlabeled target scans, yet a retained prediction may provide a useful target location while enclosing sparse foreground returns, background clutter, or points inconsistent with the predicted box. We refer to this mismatch as box-point inconsistency. We introduce SimFuse3D, which preserves the target placement and repairs the associated pseudo-object using measured geometry from labeled source scans. Object Memory retrieves a compatible labeled source instance. Target Simulation places its ground-truth box at the target location, aligns its points with the target viewing geometry, and filters the aligned crop to approximate the target observation. Confidence-Guided Multi-Stage Localization Reweighting (CMLR) maps each target pseudo-object confidence score to a bounded weight shared by RPN localization and R-CNN box regression. All components operate only during adaptation, leaving the detector architecture and inference graph unchanged. Across six cross-platform transfers, SimFuse3D exceeds Pi3DET-Net on every reported AP metric and ranks first among the compared adaptation methods on nearly all metrics. On nuScenes-to-KITTI, it ranks first among the compared adaptation methods with both evaluated detectors.
47. 【2609.04860】Mitigating Performance Discrepancy in Cross-Domain 3D Class-Incremental Learning
链接：https://arxiv.org/abs/2609.04860
作者：Jinge Ma,Gautham Vinod,Bruce Coburn,Jui-Feng Chi,Siddeshwar Raghavan,Fengqing Zhu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：autonomous driving, plays a crucial, crucial role, role in real-world, real-world applications
备注： 29 pages
点击查看摘要
Abstract:3D perception plays a crucial role in real-world applications such as autonomous driving, robotics, and AR/VR. In practical scenarios, 3D perception models need to continually adapt to newly emerging 3D object categories, making class-incremental learning (CIL) particularly important. However, unlike 2D images, 3D point clouds are inherently heterogeneous: objects from the same class may not only come from the clean CAD domain, but also from RGB-D camera scans of varying quality, video reconstructions, or even corrupted observations. We discover that such heterogeneity introduces a new challenge beyond catastrophic forgetting: the degree of performance degradation can vary substantially across domains, a phenomenon we term performance discrepancy. To investigate this problem, we establish the Domain3D-CIL training and evaluation protocol, which contains point cloud categories from heterogeneous domains. We further adapt a wide range of mainstream CIL methods to the 3D modality. The results demonstrate that this performance discrepancy consistently appears across these baselines. To mitigate this issue, we introduce PolyMem, an exemplar-free approach that implicitly models rich high-order statistics of the feature distribution to enhance cross-domain robustness. Experiments demonstrate that our method effectively alleviates the performance discrepancy while improving the model's performance across domains. Code will be made publicly available upon acceptance.
48. 【2609.04846】LetOccVote: Learning Weakly Supervised 3D Occupancy through Consensus
链接：https://arxiv.org/abs/2609.04846
作者：Chi Zhang,Qi Song,Feifei Li,Jie Li,Rui Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision foundation models, occupancy prediction reduces, reliance on costly, foundation models, prediction reduces
备注：
点击查看摘要
Abstract:Weakly supervised 3D occupancy prediction reduces the reliance on costly 3D annotations by learning from 2D pseudo-labels generated by vision foundation models. However, existing methods typically use these imperfect pseudo-labels directly as supervision, making occupancy learning vulnerable to erroneous geometric and semantic targets. We observe that agreement across repeated observations provides an inexpensive and reliable cue for assessing pseudo-label reliability. Based on this observation, we propose \textbf{LetOccVote}, a weakly supervised Gaussian-based occupancy framework that leverages cross-frame voting to improve both geometric and semantic supervision. For geometry, Depth Vote exploits cross-frame geometric agreement to refine supported pseudo depth and reject contradictory estimates before volumetric lifting and depth supervision. For semantics, Semantic Vote aggregates pseudo-semantic observations in a shared 3D space to identify reliable and contested evidence, strengthening reliable semantic supervision while filtering unreliable pseudo-label segments. The entire framework is trained solely with 2D pseudo-label supervision without requiring 3D occupancy annotations. On Occ3D-nuScenes, LetOccVote achieves 53.27 IoU and 20.39 mIoU, establishing state-of-the-art performance among methods with 2D pseudo-label supervision.
49. 【2609.04837】PAPT++: Risk-Aware Adversarial Tuning and Generation for Single Domain Generalization
链接：https://arxiv.org/abs/2609.04837
作者：Zhipeng Xu,De Cheng,Xinyang Jiang,Lingfeng He,Huaijie Wang,Dongsheng Li,Nannan Wang,Xinbo Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Single domain generalization, labeled source domain, Single domain, unseen target domains, source domain
备注： 29 pages
点击查看摘要
Abstract:Single domain generalization (SDG) aims to learn a model from one labeled source domain that generalizes to unseen target domains. A common strategy is to enrich the source distribution with augmented or generated samples, and recent text-to-image (T2I) diffusion models provide a strong generative prior for this purpose. However, diversity alone is insufficient for robust generalization, because useful generated samples should also capture variations that the current classifier finds difficult. Motivated by distributionally robust optimization (DRO), we define a semantic ambiguity set in the class-conditional generative space of a pretrained T2I model and search it for samples with high classification loss under the current classifier. To this end, we introduce PAPT++, a risk-aware adversarial generation-training framework for SDG. PAPT++ first learns diverse semantic reference images for each class through image-text alignment and intra-class diversity regularization. These references then serve as denoising targets during classifier-guided diffusion synthesis, reducing semantic drift while guiding generation toward challenging variations. The generated samples are combined with the source data to update the classifier, and the updated classifier guides the next synthesis round in return. In this way, PAPT++ progressively exposes the classifier to challenging yet semantically consistent variations. Extensive experiments on standard SDG benchmarks demonstrate the superiority of the proposed PAPT++ method and the effectiveness of its main components.
50. 【2609.04827】Weather-Conditioned Depth Anything
链接：https://arxiv.org/abs/2609.04827
作者：Zhaoming Xu,Chan-Wei Hu,Kuan-Ru Huang,Zihao Zhu,Renjie Li,Yang Zhou,Zhengzhong Tu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Monocular depth estimation, Monocular depth, depth estimation foundation, achieved remarkable performance, achieved remarkable
备注：
点击查看摘要
Abstract:Monocular depth estimation foundation models, such as the Depth Anything series, have achieved remarkable performance across diverse domains. However, they still suffer from critical failures under adverse weather conditions, such as fog, rain, snow, or at night. To address this, we present Weather-Conditioned Depth Anything (DA-W), a framework that explicitly disentangles style from content for weather-robust depth estimation. Specifically, we introduce a Style Filter trained on a curated mix of real and synthetic degradation datasets to extract content-independent, degradation-aware weather embeddings. This style embedding is then injected into the Depth Anything backbone using a parameter-efficient, zero-initialized adapter. Such a lightweight modulation allows a single unified model to robustly adapt to diverse conditions, including fog, rain, snow, and low-light, while avoiding catastrophic forgetting of its core generalization abilities in normal conditions. We train the adapter using a pseudo-label distillation and alignment strategy. Our comprehensive experiments demonstrate that our proposed DA-W achieves state-of-the-art robust depth estimation, improving AbsRel by an average of 3.7% on our curated weather benchmarks, while matching or slightly outperforming performance on standard clean benchmarks. Our project page is available at this https URL.
51. 【2609.04807】CoLMIN: LLM-based Multi-Decision Path Negotiation for Cooperative Autonomous Driving
链接：https://arxiv.org/abs/2609.04807
作者：Zhe Huang,Zhaoxin Fan,Shuo Wang,Wenjun Wu,Xuan Zhao,Min Liu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrating significant potential, Multi-vehicle cooperative autonomous, improving traffic safety, cooperative autonomous driving, Multi-vehicle cooperative
备注：
点击查看摘要
Abstract:Multi-vehicle cooperative autonomous driving enhances the safety and reliability of autonomous driving systems through information sharing among connected vehicles, demonstrating significant potential for improving traffic safety. LLM-based approaches leverage strong reasoning capabilities of LLMs to enable effective inter-vehicle negotiation and improve cooperative driving performance. However, driving decisions in complex traffic scenarios are inherently multi-solution in nature. As a result, existing negotiation-based methods often converge prematurely to suboptimal solutions, hindering consensus formation and limiting the practical deployment of cooperative autonomous driving systems. To address this challenge, we propose CoLMIN, the LLM-based multi-decision path negotiation framework for cooperative autonomous driving, achieving stable decision consensus through multi-decision path negotiation and reflective reasoning. To achieve stable and high-quality consensus in cooperative autonomous driving, CoLMIN consists of three key components: (i) an LLM-based Multi-Intent Negotiation module (LMin), which adopts a Negotiator-Evaluator paradigm and generates multiple candidate driving intentions for joint evaluation; (ii) an Evaluation-based Shallow Reflection Module (ESRM), which analyzes negotiation outcomes and provides feedback to guide subsequent negotiations, thereby accelerating consensus formation; and (iii) an LLM-based Deep Reflection Module (LDRM), which performs long-term reflection over negotiation histories to mitigate cognitive fixation and prevent the system from converging to suboptimal solutions. Experimental results in the CARLA simulation environment demonstrate that CoLMIN significantly outperforms existing methods in challenging interactive driving scenarios.
52. 【2609.04802】Linguistic Trajectory Encoding for Efficient Long-Horizon Spatial Memory in Embodied Agents
链接：https://arxiv.org/abs/2609.04802
作者：Tianyidan Xie,Shenyi Wang,Qiang Tang,Mingjie Wang,Zhicheng Qiu,Xuanfu Li,Zhan Xu,Jian Yang,Lanjun Wang,Zili Yi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Embodied agents performing, Embodied agents, objects remain queryable, Embodied, performing long-horizon tasks
备注：
点击查看摘要
Abstract:Embodied agents performing long-horizon tasks require a memory representation in which the state transitions of dynamic objects remain queryable in natural language across hours-to-days observation horizons. Existing systems either drop fine-grained motion (clip-level video-language embeddings), keep it only as raw coordinates (geometric SLAM), or organise it around immediate task context (agent working memories). None of them gives the agent a per-object timeline whose state transitions are themselves queryable in language. Our key contribution is \textbf{Linguistic Trajectory Encoding} (LTE), which compresses dynamic object motion histories via a hybrid representation combining natural language descriptions, sparse spatial anchors, and visual anchors. LTE adapts compression to motion complexity by anchoring periods without reliable observations to the last seen location, while representing motion with geometric waypoints and linguistic descriptions to preserve accuracy. To evaluate these capabilities across extended time horizons, we construct the \textbf{Spatial Memory Benchmark} (SMB) from EgoLife multi-day recordings, targeting capabilities absent in existing benchmarks: semantic trajectory retrieval and long-horizon object retrieval. On SMB, the LTE-based system achieves $45.3\%$ success in semantic trajectory retrieval and $48.7\%$ in long-horizon object retrieval, outperforming structured-memory and VLM baselines (best prior: $31.9\%$ and $34.4\%$). LTE achieves trajectory compression by factors of $8.7\times$ to $26.1\times$ with sub-second query latency on $24$\,h video. On Ego4D natural-language queries, the system reaches $28.75\%$ / $55.10\%$ R@1/R@5, $+15.80$ / $+31.30$ pts over EgoVLPv2.
53. 【2609.04800】Intrinsic Temporal Adaptation of CLIP for Partially Relevant Video Retrieval
链接：https://arxiv.org/abs/2609.04800
作者：Hyun Seok Seong,Woojin Jun,SuBeen Lee,Jae-Pil Heo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Partially Relevant Video, Partially Relevant, Relevant Video Retrieval, Relevant Video, text query
备注： EMNLP 2026 paper
点击查看摘要
Abstract:Partially Relevant Video Retrieval (PRVR) aims to retrieve untrimmed videos that contain moments relevant to a text query. Since the target moment occupies only a portion of the video, PRVR requires retrieval based on fine-grained understanding beyond coarse video-level matching. However, existing methods often rely on frozen CLIP frame features, which lack temporal understanding. Even with recent progress in parameter-efficient CLIP adaptation, video-level predictions can still be supported by imprecise frame-level evidence. In this paper, we propose an Intrinsic Temporal Adaptation (ITA) framework for PRVR. First, our Backbone-Internal Temporal Adaptation allows the last few visual transformer layers to attend over groups of neighboring frames. This provides temporally aware frame embeddings while keeping CLIP frozen and training only adaptation parameters. Second, we introduce Affinity-Weighted Gradient Propagation to address the weakly supervised nature of PRVR, softly aggregating top-$k$ frames based on text-frame affinities and propagating learning signals to multiple query-relevant frames. Our method achieves state-of-the-art performance on PRVR benchmarks, demonstrates robust cross-dataset transfer, and retrieves substantially more accurate frame-level evidence within ground-truth query-relevant moments. Our code is available at this http URL.
54. 【2609.04791】An Attention-Guided Global and Local Fusion Framework for Lesion-Focused Image Classification
链接：https://arxiv.org/abs/2609.04791
作者：Mst Shafia Tasnima,Md Samaun Elaheea,Tanjim Taharat Aurpab,Md Musfique Anwar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：core analytical challenge, convolutional neural networks, conventional convolutional neural, dilute signal relevance, process entire images
备注：
点击查看摘要
Abstract:Lesion-focused image classification presents a core analytical challenge, as discriminative signals are often sparse, spatially dispersed, and easily obscured by background noise, while conventional convolutional neural networks (CNNs) process entire images uniformly and may dilute signal relevance. This study hypothesizes that adaptive fusion of global contextual information and lesion-focused local information can improve classification performance compared with using either representation independently. We propose a three-branch, attention-guided deep learning framework built on Densely Connected Convolutional Network-121 (DenseNet-121) to improve feature attribution, interpretability, and classification reliability. The architecture consists of a global branch that learns representations from full images, followed by Gradient-weighted Class Activation Mapping (Grad-CAM) to generate attention maps that highlight prediction-relevant regions and produce masked inputs, and a local branch enhanced with a Convolutional Block Attention Module (CBAM) to extract refined spatial and channel-wise features from these focused regions. An adaptive fusion branch integrates global and local representations by learning instance-specific weights, allowing dynamic prioritization between contextual and localized information. The framework is evaluated on a synthetic Spot Pattern Dataset (SSPD) and three benchmark datasets, including skin lesion, guava leaf, and grape leaf image datasets, where the fusion branch outperformed the individual global and local branches, reaching 97.75% accuracy on the skin lesion dataset and 99.64% on the guava leaf dataset. The results highlight the value of attention-guided architectures in healthcare analytics by improving model transparency, strengthening feature relevance, and supporting more reliable data-driven decision-making in medical image analysis.
55. 【2609.04784】CLON: Cue-Calibrated Linguistic Object Onboarding for Zero-Shot 6D Pose Front-Ends
链接：https://arxiv.org/abs/2609.04784
作者：Seojin Ji,Yoojin Kwon,Hyung-Sin Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：semantically plausible distractors, estimation pipelines increasingly, pipelines increasingly rely, preserve partially visible, partially visible true
备注： 8 pages, 5 figures
点击查看摘要
Abstract:Zero-shot 6D pose estimation pipelines increasingly rely on strong downstream pose solvers, but their performance is often limited by the front-end: object proposals must preserve partially visible true positives while rejecting semantically plausible distractors. We introduce Cue-Calibrated Linguistic Object Onboarding (CLON), a front-end requiring no task-specific training for new objects. Given rendered templates of the onboarded object set, CLON constructs a linguistic semantic memory for top-down proposal generation and object-set cue weights for calibrated proposal scoring. The linguistic memory guides SAM 3 toward high-recall proposals for onboarded objects, while cue weights are computed once from the onboarded object set before scene inference and kept fixed during online scoring. On seven BOP-Classic-Core datasets, CLON improves detection AP by 8.1 percentage points (pp), segmentation AP by 6.2 pp, and downstream 6D pose AR by up to 4.1 pp over CNOS and SAM-6D front-ends.
56. 【2609.04781】CoMLP: Cooperatively-Gated MLPs for Fine-Grained Cross-Modal Information Fusion in Medical Image Segmentation
链接：https://arxiv.org/abs/2609.04781
作者：Mingyuan Meng,Shuchang Ye,Mingjian Li,Zhenyu Zhao,Jinman Kim,Lei Bi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：medical image segmentation, fine-grained cross-modal information, medical image, cross-modal information fusion, Multi-modal medical images
备注：
点击查看摘要
Abstract:Multi-modal medical images and clinical reports provide complementary anatomical, functional, and semantic information for medical image segmentation. Effectively exploiting these heterogeneous sources requires fine-grained cross-modal information fusion that preserves subtle spatial details while capturing semantic dependencies across modalities. Existing fusion approaches frequently rely on cross-attention, whose computational burden increases rapidly with spatial resolution, making dense cross-modal interaction difficult on high-resolution feature maps, particularly for volumetric medical images. In this work, we propose CoMLP, a cooperatively-gated MLP module for fine-grained cross-modal information fusion in medical image segmentation. CoMLP models cross-modal dependencies through cooperative cross-gating, built upon complementary regional and dilated MLP interactions, to capture local and global cross-modal dependencies. We further develop a multi-source fusion architecture in which CoMLP performs both inter-image fusion across imaging modalities and vision-language fusion between visual features and textual reports, enabling heterogeneous information to be integrated without relying on dense cross-attention. Extensive experiments on five medical segmentation benchmarks, covering 2D/3D images, clinical reports, multiple imaging modalities, and diverse anatomical regions, demonstrate consistent improvements over state-of-the-art multi-modal and language-guided segmentation methods. Ablation studies further show that fine-grained interaction at high spatial resolutions and complementary local-global fusion are critical to the performance gains. These results demonstrate the potential of MLP-based interaction as an effective alternative for fine-grained cross-modal information fusion in medical image segmentation.
57. 【2609.04775】LUMIN: Lightweight Universal Manufacturing Inspection Network for Anomaly Detection
链接：https://arxiv.org/abs/2609.04775
作者：Pengfei Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：anomaly detection faces, Industrial anomaly detection, Farthest Point Sampling, Farthest Point, anomaly detection
备注： 10 pages, 5 figures
点击查看摘要
Abstract:Industrial anomaly detection faces two engineering bottlenecks: memory bank construction latency and inference efficiency. Traditional sampling algorithms (Farthest Point Sampling, K-Means, etc.) rely on numerous backbone forward passes and iterative distance computations, with construction times ranging from minutes to hours; heavy computation components such as multi-scale feature extraction struggle to meet the millisecond-level real-time requirements of production lines. This paper focuses on sampling efficiency and inference optimization for industrial deployment with two core contributions: (1) PSP (Plugin Sampler Pipeline)---a four-stage adaptive memory bank sampling pipeline based on 18-dimensional pixel metadata and five complementary visual plugins. PSP completes all sampling with zero backbone forward passes; coarse filtering is sub-second numerical sorting, and metadata extraction is a one-time offline cost. PSP supports progressive deployment and incremental updates. (2) Two engineering optimization strategies---parallel memory bank similarity computation (reducing inference memory and latency by over 95\%) and stratified pixel sampling for large-scale evaluation (reducing computation time by 20$\times$ while keeping metrics stable). As a vehicle for validation, we introduce LUMIN (Lightweight Universal Manufacturing Inspection Network) with extreme segmentation-head compression, systematically exploring the accuracy-efficiency frontier against strong baselines. Experiments on five benchmarks demonstrate that PSP matches state-of-the-art sampling accuracy at near-random construction cost (341$\times$ faster than FPS), while inference optimizations reduce evaluation time by 20$\times$ with negligible accuracy loss.
58. 【2609.04751】SeamFlow: Structure-Aware Flow Matching on Edge Probabilities for Artist-Like UV Unwrapping
链接：https://arxiv.org/abs/2609.04751
作者：Yuming Zhao,Zangyueyang Xian,Qijian Zhang,Rendong Liang,Qin Jia,Ying He,Junhui Hou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computer graphics, unwrapping are fundamental, surface cutting, semantic coherence, Abstract
备注： Accepted by Siggraph Asia 2026
点击查看摘要
Abstract:3D surface cutting and UV unwrapping are fundamental problems in computer graphics. Traditional geometric optimization methods mainly focus on reducing parameterization distortion, but they often overlook visual semantic coherence in seam layouts. Recent autoregressive generative methods improve semantic coherence, yet limited perception of mesh topology often causes inaccurate local cuts. To address these limitations, we introduce SeamFlow, a novel generative framework for 3D surface cutting. We reformulate the discrete mesh-cutting problem as continuous flow matching in a high-dimensional edge-probability space. Through continuous relaxation, SeamFlow learns a deterministic mapping from a Gaussian prior to a target seam-probability distribution. An evolution network couples local topological tokens with global shape priors and guides smooth probability flow through Ordinary Differential Equation solving. Compared with existing autoregressive generative frameworks, SeamFlow improves topology awareness through edge tokenization while eliminating both 3D spatial projection errors and artificial sequential-order bias. Extensive experiments demonstrate that SeamFlow achieves exceptional semantic coherence and remarkably low parameterization distortion. The project page is this https URL.
59. 【2609.04741】Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding
链接：https://arxiv.org/abs/2609.04741
作者：Tsung-Chih Chiang,Hsuan-Kung Yang,Jou-Min Liu,Ting-Ru Liu,Chun-Wei Huang,Quan Kong,Chun-Yi Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：leverage vision-language models, natural language queries, methods leverage vision-language, Recent zero-shot, vision-language models
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Recent zero-shot 3D visual grounding methods leverage vision-language models (VLMs) to localize objects in 3D scenes from natural language queries. However, these methods typically rely on heuristic rules to select which camera views are provided to the VLM, often prioritizing object visibility rather than grounding relevance. We present IVSGround, a framework that learns Influential View Selection for VLM-based 3D visual grounding. Instead of using fixed heuristics, a lightweight view selector is trained to identify views that provide discriminative evidence for grounding. To obtain supervision signals, we generate training signals using feedback from a reasoning VLM through a two-stage rejection sampling process. During inference, the learned selector predicts query-conditioned influential views for each candidate object, which are then evaluated by a frozen reasoning VLM through comparative grounding. Experiments on ScanRefer and NR3D show that IVSGround consistently improves grounding accuracy over existing zero-shot pipelines, demonstrating that selecting where to look is crucial for effective 3D visual grounding. Project page: this https URL
60. 【2609.04726】Bridging Modalities and Tasks: A Unified Hierarchical ViT for SAR-to-Optical Translation and Semantic Segmentation
链接：https://arxiv.org/abs/2609.04726
作者：Siyuan Liu,Xuze Zhang,Yongshun Wang,Licong Pan,Hang Liu,Huihui Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Synthetic Aperture Radar, Synthetic Aperture, Aperture Radar, observation capabilities, Synthetic
备注：
点击查看摘要
Abstract:Synthetic Aperture Radar (SAR) images have all-weather, day-and-night observation capabilities. However, compared with optical images, their speckle noise and non-intuitive scattering mechanism limit the interpretability of the images. Generative models for SAR-to-optical (S2O) conversion can improve visual interpretability, but existing methods often ignore the constraints on semantic structure, which are necessary for downstream tasks, for the sake of visual effects. We propose a unified collaborative dual-task learning framework, termed BMT (Bridging Modalities and Tasks), that jointly optimizes S2O image translation and semantic segmentation through a shared hierarchical Vision Transformer. The framework integrates: (1) a LocalViTBlock that fuses global self-attention with spatial depthwise convolution through a learnable gating mechanism; (2) an enhanced output module combining multi-scale refinement processing, color correction and anti-aliasing, which calibrates channel-level color statistics through feature fusion; (3) a ControlNet-style conditional injection mechanism that encodes SAR wavelet features and segmentation labels into a multi-scale feature pyramid and injects them at each encoder layer through zero-initialized convolution; (4) a bounded Kendall uncertainty weighting scheme that prevents either task from dominating the shared representation. We evaluate the framework under both paired and unpaired translation settings, on the public WHU-OPT-SAR paired dataset and a self-constructed unpaired ship dataset built from HRSID and DIOR, respectively. The experimental results show that the proposed method achieves competitive S2O translation quality and semantic segmentation performance. The dataset and source code have been publicly released at this https URL.
61. 【2609.04718】HiSfM: Disambiguating Structure-from-Motion via Scaffold-Anchored Hierarchical Reconstruction
链接：https://arxiv.org/abs/2609.04718
作者：Ziding Zhao,Hainan Cui,Peilin Tao,Shuhan Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large-scale scene modeling, supporting mapping, tool for sparse, reconstruction with broad, robotics and vision
备注：
点击查看摘要
Abstract:Structure-from-Motion (SfM) is a fundamental tool for sparse 3D reconstruction with broad impact in robotics and vision, supporting mapping, localization, and large-scale scene modeling. However, conventional pipelines often fail under hard visual ambiguity caused by repeated or symmetric structures, and incur heavy computational cost due to redundant cameras and constraints. We present HiSfM, a hierarchical coarse-to-fine SfM framework that improves robustness and efficiency through scaffold construction. HiSfM first forms strong local communities using geometrical induced heuristics, then connects communities with a compact yet strong skeleton by packing edge-disjoint spanning trees (EDST) while verifying skeletal edges with a two-view disambiguator. We reconstruct a stable scaffold on this verified skeleton, serving as an anchor to capture the essence of the scene, and subsequently absorb remaining images via efficient registration and triangulation for further refinements. Experiments on ambiguity-focused benchmarks and general datasets show that HiSfM prevents ambiguity-induced failures while substantially reducing runtime compared to previous methods, and improves completeness over aggressive sparsification methods. Code is available at this https URL.
62. 【2609.04716】Counting Beyond Instances: A Benchmark for Group-Individual Object Counting
链接：https://arxiv.org/abs/2609.04716
作者：Rui Wang,Junyi Huang,Jiahui Li,Qiao Yu,Yixue Hao,Long Hu,Baoru Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual counting, aiming to estimate, commonly formulated, queried category, counting
备注： 14 pages, 9 figures
点击查看摘要
Abstract:Visual counting is commonly formulated at the instance level, aiming to estimate how many objects of a queried category appear in an image. However, real-world counting often involves higher-level semantic units formed by multiple instances, such as a bunch of grapes, a stack of plates, or a pair of shoes. This exposes a key limitation of existing counting formulations, which mainly focus on what to count, while largely overlooking at which semantic unit to count. We introduce Group-Individual Object Counting (GIC), a new setting that requires models to count both individual objects and semantic groups within a unified framework. To support this new task, we present BunchCount, a real-world benchmark with 1,330 images, 89,254 individual annotations, and 11,065 group annotations. BunchCount provides paired individual-group annotations within the same image and explicitly records containment relations between each group and its constituent individuals. Experiments on BunchCount show that current advanced counting models perform well on individual instances but fail to count semantic groups more accurately. To mitigate semantic granularity conflict, we propose a counting-unit guided relational counting framework, which exploits group-individual containment relations to regularize cross-granularity representations during training. Our method substantially improves group-level counting while better preserving individual-level counting ability, establishing a strong baseline for counting beyond instances.
63. 【2609.04709】AngelFingerprint: A Traceable, Explainable, and White-Box Stealthy Watermark for Text-Guided Image Editing
链接：https://arxiv.org/abs/2609.04709
作者：Bo-Han Kung,Futa Waseda,Ching-Chun Chang,Isao Echizen,Shang-Tse Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：raises disinformation concerns, image provenance essential, making reliable image, Text-guided diffusion editing, editing raises disinformation
备注： 15 pages
点击查看摘要
Abstract:Text-guided diffusion editing raises disinformation concerns, making reliable image provenance essential. While watermarks are commonly used for this purpose, most methods carry a fixed ID that cannot explain what was changed and which prompt produced it. Furthermore, under open-source white-box access, attackers can easily locate and remove watermarks added as separate modules. Targeting this setting, we propose AngelFingerprint, a novel watermarking framework ensuring edit traceability, explainability, and white-box stealthiness. It integrates a LoRA into the diffusion model to embed the editing prompt's CLIP text embedding directly into the model's weights. An extractor then recovers this embedding from the image pixels alone. This semantic payload explains the edit, while the weight-integrated design makes it hard to detect and isolate even under full white-box access. Two techniques make this possible: a velocity-alignment anchor that preserves edit quality, and a specially designed frequency filter that keeps the watermark imperceptible yet recoverable and robust. On the MagicBrush dataset, our extractor achieves $86\%$ top-1 accuracy in a 200-way prompt retrieval, versus $20\%$ for prompt inversion.
64. 【2609.04705】Sustainable Edge Vision via Empirically Calibrated DVFS: Eliminating Thermal Throttling on Passively Cooled Hardware
链接：https://arxiv.org/abs/2609.04705
作者：Aayush Marasini,Zhaoxian Zhou
类目：Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Deep Neural Network, sustained Deep Neural, Neural Network, Deep Neural, state-aware Dynamic Voltage
备注： 7 pages, 5 figures, 8 tables, Code, datasets, and frozen artifacts available at: [this https URL](https://github.com/Aayush-Marasini/sustained-edge-vision)
点击查看摘要
Abstract:Passive cooling eliminates the energy overhead and mechanical failure modes of fans, making it attractive for edge deployment, yet sustained Deep Neural Network (DNN) inference on passively cooled edge Systems-on-Chip (SoCs) is bottlenecked by thermal throttling. To address this, we propose an empirically calibrated, state-aware Dynamic Voltage and Frequency Scaling (DVFS) scheduler. Unlike heuristic-driven controllers, our methodology utilizes time-domain guards and absolute temperature bounds, with derivative triggers acting as safeguards against sharp thermal spikes. Evaluated on a passively cooled Raspberry Pi 5 running YOLOv8n, our scheduler eliminates all observed thermal throttling events during sustained 30-minute workloads. It outperforms a temperature-only reactive baseline by achieving a 6.8% higher frame rate (Cohen's d = 8.73) while consuming 1.9% less energy per frame. Furthermore, our optimized passive scheduling surpasses an actively cooled reference system in energy efficiency (Joules/frame), though active cooling remains superior for raw throughput. Through isolated ablations, we show that the dwell guard is necessary for run-to-run reproducibility. Finally, exploratory boundary probes indicate that the passive operating envelope closes at ambient temperatures ($\ge 27^\circ$C) where nonlinear leakage defeats DVFS-based control. These results indicate that, within the mapped envelope, correct scheduling can make mechanical cooling unnecessary for sustained edge inference on this platform.
65. 【2609.04698】LookThere! Sparse Vision by Reinforced Selection
链接：https://arxiv.org/abs/2609.04698
作者：Sreehari Rammohan,Yousef Yassin,Anthony Fuller,Junfeng Wen,Carl Vondrick,Evan Shelhamer
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Vision transformers typically, transformers typically treat, Vision transformers, computer vision, equally important
备注：
点击查看摘要
Abstract:Vision transformers typically treat every image token as equally important, yet for most tasks in computer vision only a fraction are needed. Adaptive computation methods accelerate inference by choosing which tokens to process, but existing methods struggle at extreme sparsity and require heuristics that may not generalize like token diversity and attention scores. We address these limitations with LookThere, achieving a new pareto frontier in performance-compute trade-offs through an end-to-end reinforcement learning framework that jointly trains a shallow input selector and a deep representation extractor. The selector learns where to look and the extractor learns what to see, together saving computation by selecting only what is worth processing for a given task without relying on auxiliary signals. We show that LookThere only selects the task-specific input, excelling at sparse recognition in high-resolution settings (traffic signs, billiards), and maintaining accuracy with as little as 0.2% of the input. It generalizes across tasks and models, including global recognition (ImageNet classification), local recognition (ADE20K segmentation), zero-shot classification (by distillation), and regression (counting). Across all settings, LookThere surpasses state-of-the-art selection to provide a general and scalable framework for specialized and efficient adaptive computation.
66. 【2609.04690】Enhancing Multimodal Emotion Recognition via Multi-Feature Encoding and Attention-Based Fusion
链接：https://arxiv.org/abs/2609.04690
作者：Xu Lin,Ke Wang,Hui Kang,Xinying Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：attracted growing interest, growing interest due, Multimodal emotion recognition, emotion recognition, Multimodal emotion
备注： 15 pages, 6 figures, 6 tables. Pre-peer-review version. The final published version appears in ICONIP 2025, Lecture Notes in Computer Science, vol. 16312, pp. 142-157 (2026)
点击查看摘要
Abstract:Multimodal emotion recognition has attracted growing interest due to its importance in human-computer interaction, remote education, and healthcare. This paper proposes a novel multimodal emotion recognition framework that integrates rich audio and visual feature extraction with an attention-based fusion strategy. For audio, we extract three complementary feature types: semantic embeddings from Wav2Vec2, MFCC features, and statistical acoustic descriptors such as pitch, energy, and rhythm. These are aligned and fused via a BiLSTM to capture temporal dependencies. For video, we propose a ResNet50-BiLSTM architecture that combines deep residual learning and sequential modeling to extract expressive spatiotemporal features from facial sequences. To enhance multimodal synergy, we introduce a feature-level fusion mechanism based on multi-head attention, allowing the model to adaptively weigh contributions across modalities. Experiments conducted on the MELD and IEMOCAP datasets demonstrate that our model significantly outperforms baselines in both accuracy and robustness. Furthermore, ablation studies show that the attention-based fusion strategy significantly improves performance in unbalanced data settings. Our findings suggest that the proposed framework effectively captures diverse emotional cues from speech and visual expressions, and offers a practical and generalizable approach for real-world multimodal emotion recognition tasks.
67. 【2609.04689】Retinal OCTA Phenotyping with LLM Reporting for Alzheimer's Disease
链接：https://arxiv.org/abs/2609.04689
作者：Progga Paromita Dutta,Jeba Maliha,Md Rafiul Kabir
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：established assessment methods, Early identification, remains challenging, population-scale screening, challenging because established
备注： 4th IEE International Conference on Artificial Intelligence, Blockchain, and Internet of Things, (AIBThings)
点击查看摘要
Abstract:Early identification of Alzheimer's disease (AD) remains challenging because established assessment methods can be costly, resource-intensive, or unsuitable for population-scale screening. Optical coherence tomography angiography (OCTA) provides non-invasive visualization of retinal microvasculature, but existing approaches often require diagnostic labels and provide limited measurement-level interpretation. We present an explainable OCTA pipeline that integrates annotation-aware vessel segmentation, layer-specific vascular biomarker extraction, label-free phenotyping, and measurement-grounded LLM reporting. Using 117 ROSE-1 images from 39 subjects, we apply annotation-matched segmentation models to superficial vascular complex (SVC), deep vascular complex (DVC), and combined SVC+DVC representations. The models achieve ROC-AUC values of 0.916-0.970 and Dice scores of 0.695-0.781. Six density and fractal-dimension biomarkers form subject-level profiles for exploratory clustering. Analysis of nine held-out subjects identifies an internally consistent lower-density, lower-fractal-dimension phenotype, although the absence of diagnostic labels prevents clinical interpretation. Reports generated using GPT, Gemini, and Llama are evaluated for measurement grounding, citation faithfulness, and diagnostic caution. Overall, the framework provides a transparent, non-diagnostic connection between retinal vascular measurements, exploratory phenotyping, and evidence-linked interpretation for Alzheimer's research.
68. 【2609.04649】ReaDiT Guidance: Control for Image and Video Generation using Diffusion Transformer Features
链接：https://arxiv.org/abs/2609.04649
作者：Jay Mahajan,Chang Liu,Rauf Makharov,Viraj Shah,Alexander Schwing,Svetlana Lazebnik
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diffusion Transformer, present DiT Readout, internal feature representations, ReaDiT Guidance, ReaDiT Guidance naturally
备注：
点击查看摘要
Abstract:We present DiT Readout (ReaDiT) Guidance, a lightweight framework for controlling generation with Diffusion Transformer (DiT) models via their internal feature representations. ReaDiT Guidance uses features from a single DiT block to steer the generative process according to spatial targets - like depth, pose, or edge maps - provided at test time. Furthermore, since modern text-to-video models are largely built on DiT backbones, ReaDiT Guidance naturally extends to video generation, enabling camera and motion control. Experimental results demonstrate that our approach achieves competitive or improved results compared to existing feature-based and off-the-shelf adapter-based approaches while requiring fewer parameters.
69. 【2609.04646】Importance-Aware Low-Rank Distillation of Diffusion Transformers
链接：https://arxiv.org/abs/2609.04646
作者：Denis Zavadski,Sebastian Heid,Damjan Kalšan,Stefan Roth,Carsten Rother
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：scale poses challenges, architecture for high-quality, efficient deployment, dominant architecture, scale poses
备注：
点击查看摘要
Abstract:Diffusion Transformers (DiTs) have emerged as a dominant architecture for high-quality text-to-image generation, yet their scale poses challenges for efficient deployment. While truncated singular value decomposition (SVD) is a principled tool for parameter reduction, evidence from large language models (LLMs) suggests that naive low-rank approximation can cause catastrophic failure. In contrast, we find that truncated SVD in DiTs produces smooth degradation even under substantial global compression, with redundancy distributed across projection matrices throughout the whole network rather than concentrated in a few transformer blocks. Building on these insights, we introduce SVDtrunc, a two-step block-level compression scheme, first allocating ranks across blocks and compressing the least important ones via truncated SVD under a global parameter budget, and then fine-tuning all blocks with modular knowledge distillation and a rectified-flow objective. We apply SVDtrunc to this http URL across compression levels ranging from 40-90% of the original parameter count. Across three benchmarks, GenEval, HPSv2, and DPG, we outperform all competing approaches. Notably, and in contrast to prior work, we retain near-full performance at 68% and remain competitive even at 57% of the original parameter budget. Furthermore, we show that SVDtrunc complements step distillation and achieves strong results even without fine-tuning, positioning it as a practical continuation of efficiency improvements beyond diffusion step reduction for large-scale generative models. Project page: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.04646 [cs.CV]
(or
arXiv:2609.04646v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.04646
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
70. 【2609.04645】Latent-Aligned Reasoning for Multimodal Recommendation
链接：https://arxiv.org/abs/2609.04645
作者：Jiarui Jin,Anyang Ji
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Multimodal Vision-Language Models, term cross-modal dilution, signals progressively attenuate, demonstrated remarkable capabilities, fundamental challenge persists
备注：
点击查看摘要
Abstract:Multimodal Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding, yet a fundamental challenge persists when applying them to recommendation: as representations propagate through multi-step reasoning, both visual and textual signals progressively attenuate - a phenomenon we term cross-modal dilution. To address this, we propose LARK (Latent-Aligned Reasoning frameworK), a two-stage latent reasoning framework with complementary alignment mechanisms within a single VLM. In the first stage, learnable latent tokens are interleaved with multi-step chain-of-thought (CoT) reasoning and explicitly aligned with a frozen vision encoder, serving as visual checkpoints that preserve perceptual details throughout the reasoning chain. In the second stage, the latent representations are projected via a bridge MLP and trained with item-to-item contrastive learning; to prevent the reasoning semantics from fading, intermediate features are aligned with the CoT hidden states from the first stage, anchoring the final embeddings to the model's own reasoning output. Experiments on three public benchmarks and one industrial dataset show that LARK achieves state-of-the-art performance across multiple recommendation architectures, with controlled ablations confirming the distinct contribution of each component.
71. 【2609.04603】An Evaluation Framework for Generating Multi-View Images of a Person in a Scene
链接：https://arxiv.org/abs/2609.04603
作者：Mahir Majid,Young Kyung Kim,Guillermo Sapiro
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：image-editing Diffusion Transformers, Recent generative image-editing, generative image-editing Diffusion, Diffusion Transformers, demonstrate impressive semantic
备注： 8 pages, 3 figures
点击查看摘要
Abstract:Recent generative image-editing Diffusion Transformers (DiTs) demonstrate impressive semantic editing capabilities but still struggle with spatially consistent camera angle changes. A primary bottleneck in training foundation models to execute free-form, promptable camera angle changes is the lack of specialized training data. While multi-view datasets exist for generic 3D environments and objects, there remains an absence of paired, multi-view datasets featuring human subjects at fixed locations in natural scenes, including frontal and side-profile views. Capturing such multi-camera data in unconstrained environments is logistically challenging and unscalable. In this paper, we first experiment with multiple state-of-the-art image editing models to create this data synthetically, but find that the outputs are frequently prone to hallucinations involving how much the subject's head turns relative to the background, often producing inconsistent environments. To address this issue, we propose the Head Scene Rotation Difference (HSRD) metric to quantitatively evaluate camera movements around a person. The proposed metric operates by decoupling camera movement from localized head pose manipulation. As demonstrated by the extensive experimentation, HSRD provides the pipeline necessary to evaluate 3D spatial parallax for a person in a scene, paving the way to reliably construct high-quality multi-view synthetic datasets.
72. 【2609.04598】PetQA: Benchmarking Veterinary Knowledge and Clinical Reasoning
链接：https://arxiv.org/abs/2609.04598
作者：Taegyun Kim,Youngwook Ham,Jungwook Rhim,Ju-Hyun An,Sungkyu Park,Kunwoo Park
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Korean long-form question-answering, large vision-language models, evaluating veterinary knowledge, Korean long-form, large vision-language
备注： EMNLP 2026
点击查看摘要
Abstract:We introduce PetQA, a Korean long-form question-answering (QA) benchmark for evaluating veterinary knowledge and clinical reasoning in large language models (LLMs) and large vision-language models (LVLMs). PetQA contains 10,076 text-only and 8,751 multimodal QA pairs derived from real-world questions about dogs and cats, paired with answers from expert veterinarians. Its test split, PetQA-Bench, further includes annotations for question types and clinical conditions. We evaluate eighteen models using ROUGE, BERTScore, and LLM-as-a-judge metrics for factuality and helpfulness under three settings: zero-shot inference, retrieval-augmented generation (RAG), and supervised fine-tuning (SFT). The benchmarking results provide an overview of the strengths and limitations of current models in addressing veterinary clinical queries and highlight the need for more effective adaptation methods to develop clinically reliable AI systems for veterinary care. To facilitate broader use, we additionally provide translated versions of PetQA-Bench in five languages.
73. 【2609.04592】Hidden In Plain Gaze: Gaze Representations as Privacy Controls for Utility and Re-identification Risk in XR
链接：https://arxiv.org/abs/2609.04592
作者：Cory Ilo,Brendan-David John,Doug A. Bowman
类目：Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词：Intelligent extended reality, Intelligent extended, infer user intent, reveal biometric identity, extended reality
备注：
点击查看摘要
Abstract:Intelligent extended reality (XR) systems increasingly use eye and head tracking to infer user intent, task, and attention, but the same signals can also reveal biometric identity. We study whether gaze data representation choice can serve as a lightweight privacy control at feature extraction, before adding perturbation or formal privacy mechanisms. Using the egocentric HoloAssist dataset, we compare three gaze representations under matched model capacity: raw gaze, spatial attention heatmaps, and engineered eye-movement features. We evaluate each representation on action recognition as task utility and closed-set user re-identification as privacy leakage. Representation choice substantially changes the privacy-utility tradeoff. Engineered features retain roughly 85% of raw gaze's action-recognition accuracy while reducing re-identification by about an order of magnitude, to roughly four times the chance rate across 206 identities. This reduction attenuates rather than eliminates identity leakage, and the differences across representations show that abstraction alone does not guarantee privacy. Engineered features expose interpretable and auditable structure, giving designers a transparent privacy lever that complements mechanisms such as differential privacy.
74. 【2609.04590】Dual-Part Multi-Lateral Branched Network for Multi-Class Segmentation in Cardiovascular Catheterization Angiograms
链接：https://arxiv.org/abs/2609.04590
作者：Olatunji Omisore,Ahmed Elazab,Ali Shahidinejad,Fariza Sabrina
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：Catheterisation image processing, image processing requires, Catheterisation image, processing requires segmentation, accurate and explainable
备注：
点击查看摘要
Abstract:Catheterisation image processing requires segmentation models that are fast, accurate and explainable. While most of the existing studies usually focus on binary segmentation, there is a recent demand for simultaneous segmentation of multiple structures found in catheterization scenes. In this study, a dual-part MLBNet architecture is designed with multi-lateral encoder blocks and multi-head decoder branches for class-aware segmentation in cardiovascular catheterization scenes. Lateral branches in the encoder enables repeated feature extraction to learn diverse shared representations, while multiple decoder heads are used to introduce class-skewed branches that specialize in different structural properties in catheterization scenes. To analyze the performances of the dual-part MLBNet architecture, several multi-class segmentation angiogram data obtained during cardiovascular catheterization in phantom models, synthetic human-simulated aorta, and animal model are used for model training and evaluation. Results obtained showed the dual-part models could effectively separate guidewire, catheter, vessels and background pixels to their classes of memberships with high probability. The results demonstrate that all models were able to distinguish the dominant background class from foreground structures with high overall accuracy.
75. 【2609.04555】DART: Depth-as-Target Pretraining for Surgical Vision Foundation Models
链接：https://arxiv.org/abs/2609.04555
作者：John J. Han,Adam Schmidt,Muhammad Abdullah Jamal,Jie Ying Wu,Omid Mohareri
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision foundation models, single pretrained backbone, Vision foundation, downstream tasks, valuable in data-scarce
备注： Accepted to BMVC 2026
点击查看摘要
Abstract:Vision foundation models (VFMs) are valuable in data-scarce domains such as surgery, where a single pretrained backbone can provide rich representations for many downstream tasks. Yet the dominant self-supervised pretraining paradigm uses only RGB images, leaving readily available complementary signals, such as depth maps, unused. This is a particular missed opportunity in surgery, where natural-image VFMs transfer poorly while the scene geometry is rich and informative. With strong off-the-shelf models now able to produce pseudo-labeled dense depth for any image corpus, we hypothesize that such signals can be folded into pretraining to learn better representations. We present DART, an RGB-D pretraining recipe that builds on DINOv2 with a simple modification: a pixel-space depth reconstruction objective applied to masked iBOT patches, supervised by pseudo-labeled depth. Depth is used only during pretraining, so fine-tuning and inference remain RGB-only. We find that this pixel-level reconstruction head improves representation quality rather than disrupting it. We further show that depth, which encodes scene geometry, is more effective as a target than alternative dense signals such as Canny edges, confirming that the gains stem from depth rather than added supervision alone. Across eight surgical benchmarks spanning segmentation, depth estimation, and image-level recognition, DART outperforms both natural-image and in-domain baselines, including a vanilla DINOv2 trained on identical data, improving dense prediction while also strengthening image-level understanding. More broadly, DART shows that freely available geometric pseudo-labels can strengthen foundation model pretraining without extra labels or added inference cost, pointing toward stronger backbones for surgery.
76. 【2609.04550】VISTA: Dense Multi-Label Classroom Coding with Vision-Language Models
链接：https://arxiv.org/abs/2609.04550
作者：Andrew Franck,Brendan Ng,Ben Fitzgerald,Zane Derrod,Chris Cianci,Chris Craney
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：published reliability statistics, leaving the noise, construct unknown, Video-language benchmarks, dataset authors
备注： DataMFM Workshop @ Computer Vision Pattern Recognition (CVPR) 2026
点击查看摘要
Abstract:Video-language benchmarks are usually constructed by the dataset authors without published reliability statistics, leaving the noise floor of the construct unknown. We argue that multimodal benchmarking benefits from methods taken from research communities that have already invested in strategies to ensure reliability. We illustrate the case with the Classroom Observation Protocol for Undergraduate STEM (COPUS): a 24-code multi-label observation instrument with a decade of peer-reviewed reliability literature. We recast COPUS as a video benchmark for multimodal foundation models, where it provides a dense set of structured labels (a 24-dimensional binary vector every 2 minutes across a 50-90 minute lecture), an externally validated vocabulary, and established literature that provides a per-code reliability target based on human evaluators. Annotations in our evaluation corpus are produced by a 5-person human-evaluator panel whose consensus matrix is our reference. We propose VISTA, a baseline that runs MiniCPM-V-4.5 over a dense sliding window, refines its per-window outputs with a lightweight multi-layer perceptron (MLP) head trained on top of the frozen backbone, and max-pools the resulting predictions onto the 2-minute COPUS grid. On three held-out chemistry lectures, VISTA reaches 80.1% restricted macro accuracy versus 74.9% for the zero-shot variant, with the largest residual errors on visually similar instructor codes and on rare audio-dependent codes. We characterize three systematic failure modes (audio-partial observability, fine-grained group-work discrimination, long-tail recall) and release the benchmark tooling, prompts and baseline code at this https URL.
77. 【2609.04545】SocioGesture: Real-Time and Adaptive Social Gesture Perception for Human-Robot Interaction
链接：https://arxiv.org/abs/2609.04545
作者：Wenjin Fu,Li-Fan Wu,Jerin Peter,Chip Huyen,Boyuan Chen,Jan Liphardt
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：explicit commands, interacting with people, people must recognize, Robots interacting, social
备注： 15 pages, 3 figures. Project page: [this https URL](https://wenjinfu.github.io/socioGesture/)
点击查看摘要
Abstract:Robots interacting with people must recognize not only explicit commands, but also social cues such as invitations, refusals, and unavailability. In real deployments, these cues must be inferred from noisy onboard perception under partial occlusion, changing viewpoints, and strict latency constraints. We present SocioGesture, a real-time adaptive social gesture perception system for human-robot interaction (HRI). SocioGesture uses a compact confidence-aware body-hand skeleton representation and a lightweight dual-stream model that fuses body motion with hand articulation for low-latency onboard recognition. To improve deployment robustness, we train the model with occlusion-aware skeleton corruption, exposing it to missing hands, occluded arms, and temporally unstable keypoints without increasing the inference cost. On a social gesture dataset collected in mixed indoor-outdoor HRI scenarios, SocioGesture achieves strong held-out-subject recognition, substantially improves robustness under structured joint occlusion, and runs in real time on a robot-mounted edge device. During deployment, uncertain interaction segments are saved for offline labeling and adaptation, enabling SocioGesture to expand its gesture vocabulary while preserving performance in the original classes. These results demonstrate a practical path toward robust, efficient, and adaptive social perception for interactive robots.
78. 【2609.04501】EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis
链接：https://arxiv.org/abs/2609.04501
作者：Kamrul Hasan,Mehedi Hasan Raju,Oleg V. Komogortsev
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)
关键词：emerging behavioral modality, robust EMB systems, EMB systems require, Eye movement biometrics, dynamics contain distinctive
备注： 20 pages, 3 tables, 3 figures
点击查看摘要
Abstract:Eye movement biometrics (EMB) is an emerging behavioral modality for user authentication, particularly in virtual- and augmented-reality systems, where gaze dynamics contain distinctive subject-specific features. However, robust EMB systems require diverse, high-quality gaze recordings that are expensive to collect and often unavailable at the scale needed for model development. Generative models can mitigate data scarcity, but existing methods either synthesize generic gaze behavior or personalize signals primarily by identity, without jointly representing the user's task and subjective state. Consequently, generated signals may appear visually realistic while failing to retain the behavioral properties required for biometric applications. To address this limitation, we propose EyeMakeYou, a multi-conditional denoising diffusion framework for subject-specific, high-frequency gaze synthesis. EyeMakeYou generates 5-s, 1000-Hz bivariate gaze-velocity sequences from an identity-removed reference trajectory and conditions the denoising process on an identity embedding, a task embedding, and self-reported ratings of overall difficulty, mental tiredness, and eye tiredness. Its objective combines diffusion noise prediction and identity preservation with multi-resolution spectral, drift-consistency, and event-weighted local-smoothness losses. Experiments on GazeBase show that EyeMakeYou achieves higher median spatial accuracy and greater real--synthetic similarity in the embedding feature space than the existing generative approaches, while retaining selected task-dependent associations between subjective reports and oculomotor features. These findings support conditional diffusion as a practical approach for augmenting gaze datasets for biometric and interactive applications.
79. 【2609.04500】STyMo: Fast and Controllable Few-Shot Motion Style Transfer
链接：https://arxiv.org/abs/2609.04500
作者：Jose Luis Ponton,Alexander Winkler,Ladislav Kavan,Yuting Ye,Petr Kadlecek
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：require large stylized, Supporting a wide, creating diverse virtual, large stylized datasets, wide variety
备注： Project webpage: [this https URL](https://joseluisponton.com/stymo-project-page/)
点击查看摘要
Abstract:Supporting a wide variety of motion styles is critical for creating diverse virtual characters, but current methods either require large stylized datasets or pre-trained models that cannot generalize beyond their training distribution. We present STyMo, a few-shot approach that learns motion style from only seconds of paired data and trains in one to two minutes. Our key insight is to decompose style into two components: a static component capturing time-invariant posture, and a temporal component capturing frame-wise dynamics. This decomposition yields an interpretable system where posture intensity, temporal exaggeration, and per-body-region style can be adjusted at runtime. Furthermore, the reduction in required training data and computation time structurally permits an iterative authoring workflow. To ensure robustness on arbitrary inputs, we further introduce a stylizability gate that automatically prevents artifacts on out-of-distribution motions. We demonstrate results across diverse motion styles, from subtle emotional variations to exaggerated character archetypes, and release our processed paired dataset to facilitate future research.
80. 【2609.04454】opology-Aware Training and Spatial Diagnostics for Fiber Bundle Segmentation in Tracer Histology
链接：https://arxiv.org/abs/2609.04454
作者：Joselyn Romero Avila,Kyriaki-Margarita Bintsi,Ermias Habte,Julia F. Lehman,Suzanne N. Haber,Anastasia Yendiki
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Anatomic tracer studies, axon bundles project, Anatomic tracer, tracer studies reveal, injection site
备注：
点击查看摘要
Abstract:Anatomic tracer studies reveal how axon bundles project from an injection site, branch into smaller groups of axons, and course through the brain to reach their destinations. Histological data from such studies provide anatomical reference information for validating diffusion MRI tractography. However, manual annotation of the histological data is very labor-intensive, and although automated segmentation methods have been proposed, they rely mainly on pixel-overlap losses such as BCE and Dice; topology-aware loss functions have not been studied for this task. We compare BCE-Dice, clDice, Betti matching, and Topograph for fiber bundle segmentation in macaque tracer histology using a frozen DINOv3 backbone. To our knowledge, this is the first exploration of foundation-model features for this task. BCE-Dice achieved the highest Dice, while clDice achieved the highest bundle recall but poor mask overlap. Topograph had similar Dice to BCE-Dice, the lowest $\beta_0$ error, and fewer false positives than BCE-Dice and Betti matching. Fiber bundle segmentation methods are typically evaluated with a permissive rule that counts a bundle as detected given any overlap with the prediction. We show this rule does not capture oversegmentation, and that per-section TPR can be inflated by empty sections assigned perfect recall. To quantify this, we introduce Excess32, a spatial diagnostic measuring predicted pixels outside a 32-pixel tolerance band around annotated bundles. In validation, a Betti-Topograph union raises sparse-bundle TPR from 0.818 to 0.933, but worsens FDR from 0.296 to 0.509, Excess32 from 0.108 to 0.466, and area ratio from 0.94 to 3.34. These results show detection metrics alone are insufficient to characterize segmentation quality.
81. 【2609.04439】Segmentation of the aorta in 4D flow MRI using 4D convolutional kernels and learning from sparse annotations
链接：https://arxiv.org/abs/2609.04439
作者：Hinrich Rahlfs,Julio Garcia,Chiara Manini,Markus Hüllebrand,Sebastian Schmitter,Sarah Nordmeyer,Titus Kühne,Heiko Stern,Christian Meierhofer,Andreas Harloff,Sebastian Kelle,Alexander Lenz,Peter Bannas,Jeanette Schulz-Menger,Ralf F Trauzeddel,Anja Hennemuth
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high computational demands, scarce dense annotations, MRI is essential, computational demands, limited by scarce
备注： Submitted to Journal of Cardiovascular Magnetic Resonance
点击查看摘要
Abstract:Automated aortic segmentation in 4D flow MRI is essential for reproducible hemodynamic assessment but is limited by scarce dense annotations and high computational demands. We developed a fully automated 4D (3D+time) U-Net for segmenting the ascending aorta, arch, and proximal descending aorta, using a parameter-efficient hybrid 4D kernel to capture temporal context and sparse 4D labels derived from existing 2D expert contours and centerlines, thereby avoiding the need for dense 4D annotations. Training comprised 268 scans from 8 centers and 2 vendors, with evaluation on an internal test set (32 scans) and an external post-contrast set (30 scans; different site, protocol, and annotator), compared against frame-wise 3D networks and two semi-automatic references. Against time-resolved annotations, the 4D U-Net achieved Dice scores of 0.927 (internal) and 0.911 (external), versus 0.919/0.847 for the 3D U-Net, 0.893 for static PC-MRA, and 0.808 for registration-based propagation; differences were small in systole but pronounced in diastole. Agreement with expert contours for peak velocity, net flow, axial and circumferential wall shear stress, and diameters was excellent (ICC =0.954 internal, =0.980 external), while semi-automatic references performed worse. The method thus provides reproducible, time-resolved aortic segmentation for automated hemodynamic analysis and generalizes across multicenter, multivendor, and independent post-contrast data. The model is publicly available.
82. 【2609.04438】ICM-Bench: Person-Level Identity Reasoning in Multimodal Agents with Long-Term Memory
链接：https://arxiv.org/abs/2609.04438
作者：Shidu Ren,Yunze Liu,Xing Liu,Chi-Hao Wu,Enmin Zhou,Junxiao Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Long-horizon multimodal agents, Long-horizon multimodal, Long-horizon, multimodal agents, Abstract
备注： 20 pages, 6 figures, and 7 tables. Code: [this https URL](https://github.com/Shidu-Ren/ICM-Bench)
点击查看摘要
Abstract:Long-horizon multimodal agents should remember not only what happened but also who participated. This capability depends on linking recurring faces, voices, names, person-associated objects, events, and social relations to consistent identities over time. Existing long-video and multimodal-agent benchmarks measure broad memory question answering, but they do not isolate the ability to maintain recurring person identities and reason over their cross-time relations. We introduce ICM-Bench (Identity-Centric Memory Benchmark), which, to the best of our knowledge, is the first benchmark specifically designed to evaluate identity-centric reasoning over long video memories in multimodal agents. The benchmark contains 839 synthetic clips spanning 141 minutes and 1,217 open-ended questions about six recurring adults in a one-year life album. A theme-configurable pipeline generates the video collection and associates each question with its target identities and traceable supporting evidence. We compare direct caption-memory baselines, memory-augmented agents, and graph-retrieval systems. Gemini 3.1 Pro achieves the highest overall accuracy of 74.0%, yet its score falls to 60.3% on questions that require long-term identity profiles. The results show that current systems recover many event-level memories but remain less reliable when evidence must be accumulated around a stable person.
83. 【2609.04435】STEMPix: A Phase-Transition-Material-Based Pixel Sensor for Resolving Edge-Movement Direction
链接：https://arxiv.org/abs/2609.04435
作者：Md Rahatul Islam Udoy,Sumeet Kumar Gupta,Deep Jariwala,Ahmedullah Aziz
类目：Emerging Technologies (cs.ET); Computer Vision and Pattern Recognition (cs.CV)
关键词：image sensor array, CMOS-compatible image sensor, movement information inside, direction-aware edge movement, generating compact direction-aware
备注：
点击查看摘要
Abstract:This paper proposes a spatio-temporal edge-movement direction pixel (STEMPix) for generating compact direction-aware edge movement information inside a CMOS-compatible image sensor array. The proposed design targets specialized sensing applications where local boundary movement is more important than full-frame intensity reconstruction. Instead of transferring full multi-bit frames for external processing, STEMPix generates a 3-bit local edge direction code (LEDC) by combining pixel-level temporal change information with neighboring-pixel spatial edge information. We design the architecture using a two-tier organization, where the photodiode layer is separated from the computation layer to preserve light-collection area while accommodating the additional in-array processing circuitry. The proposed circuit is evaluated through HSPICE transient simulations. The estimated implementation achieves a horizontal pitch of 1.73 {\mu}m, a vertical pitch of 2.36 {\mu}m, and a geometric fill factor of 95.47%. The average active switching energy is 0.465 fJ per LEDC operation across representative edge-movement cases. The proposed STEMPix operation also supports global-shutter capture and dynamic thresholding. These results indicate that STEMPix can provide a compact and scalable front-end representation for edge-movement-aware sensing systems.
84. 【2609.04411】AquaBEV: Monocular Underwater BEV Occupancy with 3D Sonar Supervision
链接：https://arxiv.org/abs/2609.04411
作者：Trung Tien Dong,Shengji Jin,Chen Chen,Yi Sheng,Xiaomin Lin
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous underwater robots, safe navigation depends, Autonomous underwater, occupied space, robots are widely
备注：
点击查看摘要
Abstract:Autonomous underwater robots are widely used for exploration, monitoring, and inspection, where safe navigation depends on understanding the surrounding free and occupied space. Bird's eye view (BEV) occupancy provides such a representation, but predicting it from a single underwater RGB image is difficult due to limited, unreliable geometric cues from appearance alone. 3D imaging sonar offers complementary geometric measurements to supervise this task. We introduce AquaBEV, a monocular underwater occupancy model that predicts local BEV occupancy from a single RGB image, using paired 3D imaging sonar as geometric supervision during training. AquaBEV maps visual features into a calibration free polar representation and applies causal decoding along the range dimension before reconstructing the prediction in Cartesian BEV coordinates. A controlled underwater occupancy benchmark was established, adapting representative occupancy methods to the same RGB to sonar task under a unified protocol. AquaBEV achieves 31.4 Visible IoU and 38.6 Observed IoU, 4.0% and 4.3% relative improvements over the strongest transferred baseline.
Subjects:
Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.04411 [cs.RO]
(or
arXiv:2609.04411v1 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2609.04411
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
85. 【2609.04392】FAVE: Foveated Adaptive Visual Encoding for Efficient Fine-Grained Visual Understanding
链接：https://arxiv.org/abs/2609.04392
作者：Amitangshu Mukherjee,Kaushik Roy
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：costly full-image high-resolution, full-image high-resolution processing, visual encoders face, weaken such evidence, Foveated Adaptive Visual
备注： 21 pages, 6 figures, 7 tables; includes supplementary material
点击查看摘要
Abstract:Fine-grained visual understanding depends on local detail, yet visual encoders face a trade-off between costly full-image high-resolution processing and compact global encoding that can weaken such evidence. Inspired by human active vision, we separate where to look from what to encode. We focus on the latter and introduce FAVE (Foveated Adaptive Visual Encoding), a lightweight variable-resolution ViT that encodes externally selected regions at high acuity while preserving native geometry. We first isolate this encoding problem using oracle ground-truth crops in a controlled small-object regime. On ImageNet objects with a native maximum side of 96 pixels, FAVE improves Top-1 by 9.4 points over a fixed-resolution ViT on the same crop window with 12.7 times lower FLOPs. Increasing global resolution or backbone capacity does not recover the same operating point. We then integrate FAVE as a complementary local branch in FastVLM. Its local tokens are combined with FastVLM's global visual tokens, while the original global pathway and language model remain frozen. With at most 16 additional local tokens, FAVE improves TextVQA by 1.60 points and achieves a 3.3 times controlled TTFT speedup over SmolVLM2-2.2B. On GQA attribute questions, it improves FastVLM-1.5B by 1.31 points, extending the benefit beyond text while narrowing the gap to FastVLM-7B. Together, these results show that selectively allocating high-acuity local capacity provides an efficient complement to broader global representations and model scaling for fine-grained understanding of small objects, text, and attributes.
86. 【2609.04383】What Moves? Localized Motion Representations for Compositional Scene Control
链接：https://arxiv.org/abs/2609.04383
作者：Frank Fundel,Malek Ben Alaya,Thomas Ressler-Antal,Stefan Andreas Baumann,Björn Ommer
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：multiple entities move, entities move simultaneously, distinct motion patterns, exhibiting distinct motion, Real-world dynamics
备注：
点击查看摘要
Abstract:Real-world dynamics are inherently compositional: multiple entities move simultaneously within a shared scene, each exhibiting distinct motion patterns. Yet most existing video representations encode motion globally, without explicitly capturing localized motion for individual entities. Crucially, motion is defined relative to a global reference frame, including camera motion and scene layout. However, localized embeddings are often computed from cropped images or obtained by masking features after encoding, discarding the context needed to interpret motion. To address this, we introduce a promptable localized motion representation that produces persistent embeddings for user-specified regions defined by spatial masks. Rather than cropping the input or masking features, our model processes the full video and conditions motion encoding directly on the queried region. This yields temporally consistent, region-addressable embeddings that isolate local dynamics while retaining the global context required for disambiguation. We demonstrate object-level motion transfer, enabling controlled composition of dynamic scenes. Beyond generative control, our embeddings support localized action classification in multi-actor videos. Across both tasks, our approach improves controllability and outperforms global representations localized through cropping or post-hoc masking. Project Page: this https URL
87. 【2609.04381】Where Appearance Fails, Geometry Recognizes: A CAD-Free 3D Shape Prior That Complements Vision Foundation Models
链接：https://arxiv.org/abs/2609.04381
作者：Chenxi Tao,Seung-Kyum Choi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：Recognizing specific objects, labeled training set, training set recurs, conventional renderable prior, Recognizing specific
备注： 19 pages, 11 figures, 5 tables
点击查看摘要
Abstract:Recognizing specific objects onboarded without a labeled training set recurs across manufacturing and service robotics, yet the conventional renderable prior, a computer-aided-design (CAD) model, is often unavailable. Two-dimensional capture supplies no shape prior, and frozen foundation features fail on geometrically similar, low-texture industrial parts. We ask what a short object-centric scan buys for recognition beyond the captured images themselves: each object is reconstructed with 3D Gaussian Splatting (3DGS), summarized into a per-class shape prototype, and fused with frozen DINOv2 image features. First, the scan recovers the recognition value of CAD without CAD: geometry from RGB-D depth (on T-LESS), 3DGS, and CAD gives comparable recognition (tied on HOPE, within 1.6 points on T-LESS); 3DGS is only a convenient route to a point cloud. Second, the payoff is governed by how recognizable the shape is: on shape-distinctive household objects (HOPE) geometry alone reaches 0.920 versus image-only 0.832, a ceiling below which fixed-weight fusion (0.872) sits. On shape-confusable textureless industrial parts (T-LESS) the gain is modest but consistent (0.560 to 0.591 fused, above both single signals). Third, the prior is complementary, not uniformly additive: it rescues far more image failures than it breaks successes, and its benefit grows under partial occlusion. Finally, the worth lies in geometry, not rendered pixels: 3DGS renderings do not help the image side, and frozen-feature recognition is nearly lighting-invariant (within 2.5 points). The study is scoped to recognition, not the BOP pose benchmark.
88. 【2609.04369】AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognition
链接：https://arxiv.org/abs/2609.04369
作者：Shunpeng Chen,Jingyi Zhang,Changwei Wang,Shengpeng Xu,Yukun Song,Xingtian Pei,Jinzhou Lin,Li Guo,Shibiao Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual Place Recognition, retrieving database images, Visual Place, Place Recognition, query image
备注： 18 pages, 9 figures, 9 tables
点击查看摘要
Abstract:Visual Place Recognition (VPR) localizes a query image by retrieving database images of the same or nearby place, yet its robustness is often degraded by domain shifts arising from illumination, weather, seasonal changes, and dynamic occlusions. One contributing factor is the limited appearance diversity of the same place in existing training data. To address this issue, we propose AdaptVPR, a route-aware generative augmentation framework that constructs same-place hard positives for robust VPR training. AdaptVPR first uses a vision language model to parse scene attributes and estimate editing feasibility, while a rule-based scheduler determines the generation route according to editability scores and risk constraints. The generation process is decomposed into three complementary routes: the Global Appearance Route introduces global scene changes in weather, illumination, and time of day; the Local Occlusion Route inserts plausible dynamic occluders; and the Dual Route combines both types of perturbations to produce more challenging appearance shifts. Each generated candidate is evaluated using a VPR-oriented verification scheme based on geometric consistency and appearance diversity, reducing the risk of structural drift while ensuring sufficient appearance variation. Global candidates are generated once and rejected if verification fails, while Local Occlusion and Dual candidates use verification feedback for limited prompt refinement and regeneration. Using this framework, we construct AdaptCities, containing 160K verified synthetic same-place hard positives. Experiments across multiple VPR baselines and vision foundation backbones show consistent gains on standard benchmarks and substantial improvements under challenging domain shifts, with R@1 gains of up to 9.2%. The source code and data resources are publicly available at this https URL.
89. 【2609.04348】Object Concepts Emerge from Motion
链接：https://arxiv.org/abs/2609.04348
作者：Boshi Li,Xiaohui Wang,Xiaoyang Wu,Zhichao Li,Ya Yang,Naiyan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：capture semantic categories, physical-world perception, important for physical-world, methods often capture, capture semantic
备注：
点击查看摘要
Abstract:Object-centric visual representations are important for physical-world perception, but existing visual pretraining methods often capture semantic categories without preserving the identity and coherence of individual instances. We present a biologically inspired framework that learns object-centric representations for single images from raw videos. Our approach uses motion boundaries as a source of object-level grouping: off-the-shelf optical flow and clustering produce pseudo-instance masks, which supervise a single-image encoder with pixel-level pairwise metric learning. The framework requires neither human annotations nor camera calibration. We first obtain 195 million pseudo-labeled frames from 7,163 hours of driving and web videos, then expand the supervision to 421 million frames with Motion-Verified Self-Training, which combines model proposals with motion evidence. We train encoders up to Swin-H and distill the learned representations into a family of Swin backbones. Across monocular depth estimation, 3D object detection, 3D occupancy prediction, and end-to-end planning, the resulting models achieve competitive or superior performance relative to supervised and self-supervised pretraining baselines, with particularly strong transfer on geometry- and instance-sensitive tasks. These results show that motion-derived supervision can teach static image encoders to represent visual instances, providing a complementary direction for scalable visual pretraining.
90. 【2609.04325】he microscope is the mask: privileged views and labels from a cryo-ET forward model
链接：https://arxiv.org/abs/2609.04325
作者：Bogdan Toader,Kiarash Jamali,Tanmay A. M. Bharat,Sjors H. W. Scheres
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Optimization and Control (math.OC)
关键词：crowded cryo-electron tomography, limited tilt angles, tomography volumes reconstructed, cryo-electron tomography volumes, measurement operator
备注： 18 pages, 7 figures
点击查看摘要
Abstract:We explore the use of simulated data for training a model for protein annotation in crowded cryo-electron tomography volumes reconstructed from images collected at limited tilt angles and severely corrupted by the measurement operator. Firstly, we leverage the corruptions imposed by the forward model to generate domain-specific augmented paired views of the exact same scene for an invariance objective integrated into the LeJEPA self-supervised training framework. Secondly, we use additional information from the simulation pipeline such as the positions and identity of proteins in the simulated volumes to inform the architecture of the model and the loss function, so that semantic information is localised at protein positions in the resulting dense feature volume. The resulting model, CARNIVAL, is evaluated without finetuning on classification and detection tasks in real tomograms, using a benchmark dataset containing multiple protein types and two tomogram processing types. We show that CARNIVAL outperforms a state-of-the-art model trained using a contrastive objective on simulated data but without forward model-based paired views or privileged information.
91. 【2609.04283】Joint Alignment and Distillation for Video Generation via Sample-Guided Distribution Matching
链接：https://arxiv.org/abs/2609.04283
作者：Jiuzhou Lin,Junlong Wu,Fei Zuo,Huan Ouyang,Dewen Fan,Boheng Zhang,Huaiqing Wang,Jia Sun,Fan Yang,Houde Liu,Kehai Chen,Min Zhang,Tingting Gao,Han Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reinforcement Learning, Aligning video generative, extensive computational overhead, relies on Reinforcement, human preferences heavily
备注：
点击查看摘要
Abstract:Aligning video generative models to human preferences heavily relies on Reinforcement Learning (RL), which suffers from extensive computational overhead. Existing workflows typically treat RL and distillation as disconnected stages: applying RL before distillation incurs prohibitive computational costs, whereas applying RL after distillation frequently leads to model collapse. To overcome these limitations, we propose a unified, single-stage optimization framework grounded in Distribution Matching (DM). In the standard DM framework, distillation updates the model via a gradient direction that minimizes the gap between the real and fake models, guiding generations toward clarity and high fidelity. Building upon this, we introduce DM-Align, which derives a complementary gradient direction to guide the model toward human-preferred samples. Inspired by DPO and GRPO, our method leverages the distributional gap -- formulated from either preference pairs or intra-group exploration -- to directly construct this preference-guided gradient. By synergizing these two gradient directions, our approach eliminates the need for multi-step reward evaluation and complex ODE-SDE conversions inherent in traditional RL. Comprehensive experiments across multiple foundational video models demonstrate that this sample-guided framework robustly enhances both distillation quality and preference alignment, consistently outperforming both standalone variants and sequential two-stage pipelines.
92. 【2609.04282】Step Back to Move Forward: Reflection-Aware Preference Optimization for Visual Generation
链接：https://arxiv.org/abs/2609.04282
作者：Junlong Wu,Jiuzhou Lin,Jia Sun,Boheng Zhang,Huaiqing Wang,Dewen Fan,Houde Liu,Qianqian Gan,Fan Yang,Tingting Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：substantially advanced multimedia, advanced multimedia content, multimedia content synthesis, mainstream paradigm, paradigm for modern
备注：
点击查看摘要
Abstract:Diffusion models have become the mainstream paradigm for modern visual generation and have substantially advanced multimedia content synthesis, especially in text-to-image and text-to-video tasks. To further align such generative models with human preferences, reinforcement learning (RL) has recently shown strong potential as a post-training strategy. Nevertheless, existing policy gradient-based methods often explore inefficiently, making them vulnerable to local optima that may degrade semantic faithfulness and visual realism. To address these challenges, we present Reflection-Aware GRPO (RA-GRPO), a new RL-based preference alignment framework for diffusion generative models. The core idea is to improve "forward" generation by incorporating "backward" reflection during optimization. We first introduce Diffusion Reflection, which rectifies intermediate sampling trajectories by inverting the diffusion process with a weak estimator, guiding latent states toward higher-probability regions of the true data manifold. Furthermore, we introduce Counterfactual Path Synthesis to implicitly distill these rectified trajectories into the policy, enabling the model to internalize the benefits of search-based exploration without incurring inference-time overhead. Extensive experiments on T2I and T2V models demonstrate that RA-GRPO significantly outperforms existing methods, particularly in mitigating reward hacking and improving generalization. The method remains architecture-agnostic and integrates seamlessly with standard pipelines, suggesting a promising direction for stable preference alignment.
93. 【2609.04281】When Seeing Overrides Knowing: Visual Dominance and Deferral-Based Method for Personalized Safety in VLMs
链接：https://arxiv.org/abs/2609.04281
作者：Edward Sun,Yuchen Wu,Zixian Ma,Eric Hanchen Jiang,Yijia Xiao,Xiaoyuan Yi,Ranjay Krishna,Wei Wang,Jindong Wang,Aylin Caliskan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Vision-language models, high-stakes settings, increasingly deployed, deployed in high-stakes, reasonable in general
备注： Published as a main conference paper at COLM 2026
点击查看摘要
Abstract:Vision-language models (VLMs) are increasingly deployed in high-stakes settings, where a response that is reasonable in general may still be unsafe for a particular user whose medical, emotional, or situational context is unknown to the model. We study this problem of personalized safety in multimodal systems and introduce MPS-Bench, a benchmark of 5,181 scenarios from 584 real-world images across 12 high-risk domains, each paired with a hidden user profile. Evaluating eight frontier VLMs, we find that they almost always respond directly (86-99%) rather than seek missing context, and none exceeds 2.6/5 on personalized safety. To understand why these failures arise, we analyze multimodal interactions and identify visual dominance: visual information enters text representations early and suppresses textual risk signals during multimodal fusion. Causal interventions reveal a two-stage mechanism in which visual affect is first transferred into the text stream in early layers and then shapes the final decision through this altered text representation, making late-stage internal remediation unreliable. Motivated by this mechanism, we propose PRISM, a lightweight input monitor that uses bidirectional cross-modal modulation to predict when a query is likely to require deferral. PRISM achieves 0.978 AUC and strictly dominates the safety-utility Pareto frontier across all tested models.
94. 【2609.04277】FailureSpot: Label-Efficient Timestamp-Level Failure Detection for Vision-Language-Action Models
链接：https://arxiv.org/abs/2609.04277
作者：Jie Ma,Zongxi Liu,Yi Zhu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：general-purpose robotic manipulation, shown strong potential, making reliable failure, robotic manipulation, long-horizon execution
备注：
点击查看摘要
Abstract:Vision-language-action (VLA) policies have shown strong potential for general-purpose robotic manipulation, but they can still fail unpredictably during long-horizon execution, making reliable failure detection essential for safe deployment. Existing methods either rely on visual models that typically detect failures only after erroneous actions have occurred, or use lightweight proactive detectors trained on VLA internal representations. However, these proactive methods are often supervised with trajectory-level labels, causing normal pre-failure behavior in unsuccessful trajectories to be incorrectly labeled as failure. This supervision mismatch introduces label noise and limits both trajectory-level detection accuracy and precise timestamp-level failure localization. In this work, we study fine-grained timestamp-level VLA failure detection while addressing the cost of dense annotation. We propose a data-efficient framework that first leverages unlabeled VLA action chunks to construct action-derived weak supervision signals, capturing abnormal patterns such as inconsistent consecutive chunks, frozen or idle actions, and aggressive random motions. We then use active learning to select only the most uncertain trajectories for timestamp-level annotation and fine-tune the detector with these informative labels. Experiments across multiple VLA policies show that our method improves both timestamp-level and trajectory-level failure detection performance.
95. 【2609.04276】FailSAE: Towards Interpretable Failure Prediction for Vision-Language Models via Sparse Autoencoders
链接：https://arxiv.org/abs/2609.04276
作者：Jie Ma,Zongxi Liu,Yi Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：shared embedding space, achieved strong performance, Vision-language models, failure prediction, embedding space
备注：
点击查看摘要
Abstract:Vision-language models (VLMs), such as CLIP, have achieved strong performance across multimodal tasks by aligning visual and textual representations in a shared embedding space. As VLMs are increasingly used for high-stakes domains, failure prediction becomes critical for risk-aware deployment and human intervention. Existing failure prediction methods typically rely on confidence scores or auxiliary classifiers. Although these methods are effective on predicting VLM failures, they provide limited interpretability. In this work, we investigate the use of Sparse Autoencoders (SAEs) for interpretable failure prediction in VLMs. We formulate failure prediction as a classification task over sparse SAE latent activations and introduce a three-stage failure-aware training pipeline that encourages the learned latent directions to remain interpretable while becoming more informative for failure prediction. Our experiments show that the resulting framework outperforms the evaluated baselines in failure prediction. Further analysis suggests that failure-aware training encourages SAE latent directions to capture more class-specific concepts. We also use the SAE to provide a concept-level analysis of how model representations change during failures, revealing a shift from class-specific concepts toward more ambiguous or style-related concepts. Finally, we explore how the learned SAE latent directions can support runtime failure recovery.
96. 【2609.04253】AVENUE: Audio-Video EditiNg Understanding and Evaluation
链接：https://arxiv.org/abs/2609.04253
作者：Hayeon Kim,Yoojin Jang,Jaejun Yoo
类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：editing, aims to modify, modify audio, audio and video, edit types
备注：
点击查看摘要
Abstract:Audio-video (AV) editing aims to modify audio and video content according to a target prompt. Unlike single-modality editing, AV editing requires models to infer a modality-selective edit scope from the prompt alone: determining not only what should change, but also which modality should be preserved. Faithfully evaluating such models therefore requires both (i) benchmarks that span diverse edit types and modality categories, and (ii) evaluation that is itself modality-aware and sample-specific. However, existing AV editing benchmarks provide limited coverage of edit types and modality combinations, while current evaluation systems are often modality-blind and sample-agnostic, making it difficult to assess whether models faithfully preserve the unintended modality. To address these gaps, we introduce AVENUE, Audio-Video EditiNg Understanding and Evaluation, comprising two contributions: (1) a benchmark of 1,291 source clips and 7,957 editing instructions across audio-targeted, video-targeted, and AV-coupled edit types, curated and human-verified from VGGSound; and (2) a sample-specific, modality-aware evaluation framework that specifies, for each sample, both the intended change and the content that must remain intact. We evaluate representative AV editing models spanning three editing paradigms : joint, sequential, and separate, providing the first systematic analysis of modality-selectivity across paradigms. Our findings reveal a fundamental open challenge: when editing one modality, existing models frequently induce unintended changes in the other, regardless of paradigm. AVENUE provides a benchmark and modality-aware evaluation framework to drive progress toward more controllable AV editing models. Our dataset is publicly available on Hugging Face: this https URL.
97. 【2609.04250】Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue
链接：https://arxiv.org/abs/2609.04250
作者：Chengqian Ma,Wei Tao,Haoyu Zhang,Yiwen Guo
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
关键词：separate model families, co-speech motion models, spoken dialogue models, spoken dialogue model, dialogue models produce
备注： 28 pages, 4 figures, 12 tables. Project page: [this https URL](https://step-out.github.io/Motion-Omni-Page/) Code: [this https URL](https://github.com/step-out/Motion-Omni) Data: [this https URL](https://huggingface.co/datasets/ChengqianMa/Motion-Omni)
点击查看摘要
Abstract:An avatar that holds a conversation should decide what to say and to move while saying it, yet these abilities live in separate model families: spoken dialogue models produce speech without motion, and co-speech motion models produce motion only from audio handed to them. The standard remedy is a cascade that first generates the spoken response and then runs a motion model over the finished audio, which requires a second full inference pass and precludes any joint optimisation between the two. We present Motion-Omni, an end-to-end framework in which a spoken dialogue model natively outputs explicit facial expression together with hand, upper-body and lower-body motion, generated directly from the hidden states that produce the speech. Joint training is not optional here: with the speech pathway frozen, motion remains misaligned with the audio, and co-adapting the LLM, Speech Generator and Motion Generator under both objectives is what recovers alignment while retaining spoken-dialogue ability. Supervision comes from a scalable, model-agnostic pipeline that pseudo-labels consistent-voice speech responses with a replaceable motion teacher, yielding 422,856 quality-ranked pairs (1,402 hours). We further release SwDA-500 and, to our knowledge, the first public evaluation protocol for stochastic open-ended full-body spoken dialogue, matching audio across motion systems while unifying rendering, automatic metrics, human evaluation, and latency measurement. Instantiated with a Qwen2.5-7B-Instruct backbone, Motion-Omni-Q7 matches the same-audio teacher cascade to within 2% on reference-free motion metrics while responding 5.4 x faster (RTF=0.78, faster than real time), surpasses all non-teacher cascades on beat correlation and diversity, and reaches a 2.62% word error rate, the lowest among the omni-modal systems compared.
98. 【2609.04249】Encore: Infinite Audio-Video Generation with Adaptive Signal Routing
链接：https://arxiv.org/abs/2609.04249
作者：Shaohua Pan,Junbao Chen,Shengyi He,Jingfeng Xue,Wen Tao,Haocheng Feng,Siming Fan,Dongwei Pan,Yi Yang,Wei He,Hang Zhou
类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：produce well-synchronized clips, methods extend duration, methods produce well-synchronized, short durations, extend duration
备注： Accepted by SIGGRAPH ASIA 2026
点击查看摘要
Abstract:Existing audio-video generation methods produce well-synchronized clips but are limited to short durations, while long-video generation methods extend duration through chunk-based iterative synthesis yet lack audio entirely. Generating long audio-video jointly is fundamentally harder than either task alone: each chunk must simultaneously maintain video temporal coherence, audio temporal coherence, and cross-modal synchronization, whose conditioning signals enter the model through different pathways. In this work, we present Encore for long-form synchronized audio-video generation. Our key insight is to factor this challenge into: (1) local continuity handled by iterative generation with explicit cross-chunk context propagation, and (2) global consistency enforced via reference audio-video signals with shifted position embedding. Building on this design, we propose Adaptive Signal Routing (ASR), which introduces learnable attention biases within self-attention and learnable residual scales on cross-attention outputs, enabling the model to adaptively modulate the influence of each conditioning signal. Trained end-to-end for joint audio-video generation, Encore also supports infinite-length audio-to-video and video-to-audio synthesis at inference by conditioning on the ground-truth modality throughout the denoising process. Experiments on our extended VerseBench for long audio-video evaluation demonstrate that Encore significantly outperforms existing methods in both generation quality and temporal coherence. Code and data for this paper are at this https URL.
99. 【2609.05202】Real-World Multi-Modal and Longitudinal Lung Cancer Dataset
链接：https://arxiv.org/abs/2609.05202
作者：Rita Cordeiro Mendes,Maria Rita Fonseca Verdelho,Carlos Santiago,Catarina Barata
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrated strong potential, integrating heterogeneous data, heterogeneous data sources, support clinical decision-making, integrating heterogeneous
备注： Accepted at ECCV 2026 Workshop on Data Curation Augmentation in Medical Imaging
点击查看摘要
Abstract:Multi-modal learning has demonstrated strong potential in medical applications by integrating heterogeneous data sources such as medical imaging, clinical records, and genomics to improve predictive performance and support clinical decision-making. However, advances in this area are often constrained by two key challenges: the limited availability of well-curated, ready-to-use datasets that accurately reflect real-world conditions, where medical data are frequently collected inconsistently and are often incomplete; and the inherent difficulty of integrating heterogeneous data modalities. In this work, we introduce a newly curated multi-center, multi-modal, and longitudinal dataset designed to support the evaluation of a wide range of learning pipelines under realistic conditions. The dataset comprises a total of 1,365 lung cancer patients and has three imaging modalities (whole-slide images, CT scans, and PET scans), structured clinical data, transcriptomic, and longitudinal follow-up and treatment information. For each imaging modality the dataset contains more than one instance. Moreover, the dataset exhibits substantial and non-uniform missingness across modalities, making it well-suited for studying robust multi-modal fusion strategies. We further provide both uni-modal and multi-modal benchmarks on the task of 12-month overall survival prediction, disease-specific survival, as well as longitudinal benchmark of hazard prediction under severe missing data. Our results show that, despite high levels of missingness, integrating complementary modalities consistently improves predictive performance over uni-modal approaches, highlighting the value of multi-modal fusion in realistic clinical settings. The dataset and benchmark code are available at this https URL.
Comments:
Accepted at ECCV 2026 Workshop on Data Curation Augmentation in Medical Imaging
Subjects:
Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.05202 [eess.IV]
(or
arXiv:2609.05202v1 [eess.IV] for this version)
https://doi.org/10.48550/arXiv.2609.05202
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
100. 【2609.05140】Cross-dataset transportability of pediatric chest X-ray deep learning across three countries: discrimination, calibration, operating-point failure, and limited-label recovery
链接：https://arxiv.org/abs/2609.05140
作者：Nazim-E-Alam
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Background and Objective, External evaluation, evaluation of medical-imaging, separately tests discrimination, Background
备注：
点击查看摘要
Abstract:Background and Objective: External evaluation of medical-imaging AI is often collapsed into discrimination. We evaluated a computational protocol that separately tests discrimination, probability calibration, fixed operatingpoint transport, shortcut-associated signal, and limited-label recoverability for pediatric pneumonia classification across datasets from three countries. Methods: After exact-duplicate removal, 5,824 Guangzhou radiographs supported leakage-controlled source development and internal testing. A frozen three-seed DenseNet121 dual-view ensemble was evaluated zero-shot on BDCXR-3257 from Bangladesh (n = 3, 257) and an untouched harmonized VinDr-PCXR/PediCXR test cohort from Vietnam (n = 1, 077). Matched seed-42 variants tested architectural robustness. Secondary BDCXR analyses used a fixed 651-image adaptation pool and 2,606-image hold-out; 163, 326, and 651 labels represented 5%, 10%, and 20% of complete BDCXR. Results: Internal AUROC was 0.976 with 95.1% sensitivity. BDCXR and VinDr-PCXR AUROC were 0.798 and 0.742, while frozen-threshold sensitivity fell to 6.2% and 0%. Source-to-BDCXR AUROC degradation occurred for a full-image baseline (0.961 to 0.749), ungated dual-view model (0.977 to 0.766), and gated MixStyle model (0.966 to 0.789). With 163 BDCXR labels, Platt recalibration preserved AUROC while increasing held-out sensitivity to 88.3%, but specificity was 47.9% and the alert rate was 78.5%. Two hundred repeated 163-label fits confirmed sensitivity recovery but substantial specificity variability. Conclusions: Cross-dataset shifts across countries affected ranking, probability alignment, and source-defined decision behavior differently. Transport studies should evaluate these components separately and quantify the operational burden of apparent recovery.
101. 【2609.04747】BEAM3R: Beam's-eye-view architecture with Mamba-3 for implicit dose reconstruction
链接：https://arxiv.org/abs/2609.04747
作者：Chen Cheng,Michael Ferraro,James Grover,David E J Waddington,Emily Hewson
类目：Medical Physics (physics.med-ph); Computer Vision and Pattern Recognition (cs.CV)
关键词：estimation framework operating, rapid photon control, dose estimation framework, photon control point, enable accurate
备注： 14 pages, 5 figures
点击查看摘要
Abstract:To enable accurate and rapid photon control point and proton beamlet dose calculation in the DoseRAD2026 challenge, we present BEAM3R, a dose estimation framework operating in beam's-eye-view (BEV). Our core innovation combines a Mamba-3 state-space depth-sequence core with physics-based transport conditioning to model long-range depth transport without expensive 3D convolutions. BEAM3R shares a 2D CNN encoder-decoder architecture for photon and proton dose tasks, processing per-plane BEV slices. Proton beamlets are conditioned on water equivalent thickness and remaining range, encoding the parameters determining Bragg peak position. Photon models use a bidirectional Mamba-3 core to capture dose contributions from materials downstream of the calculation point, while the proton model uses a forward core with learned energy-prefix tokens and a Bragg-peak refinement module. To reduce interpolation artifacts and support high spatial resolution, we introduce axial grid alignment of BEV lattices with CT slices and an implicit super-resolution representation via sub-pixel phase packing, evaluated by a differentiable Triton-accelerated resampler that reconstructs packed cubic B-spline coefficients directly in CT space. For MRI-based tasks, synthetic CTs (sCT) are generated by a patch-based conditional GAN with a SwinUNETR backbone. On the preliminary DoseRAD2026 test set, CT-to-photon and CT-to-proton models achieved 1%/1 mm local gamma pass rates of 96.8% and 96.0%, with stratified plan-level MAEs of 0.0041 and 0.0079. Substituting sCT reduced gamma pass rates to 89.7% for photon and 75.4% proton plan level doses, with stratified plan-level MAEs of 0.0093 and 0.0336. Standardised runtimes were 23.4 s and 18.4 s for CT-to-photon and CT-to-proton prediction, increasing to 39.7 s and 42.8 s for the corresponding MRI-based pipelines.
102. 【2609.04512】Explainable Multimodal Deep Learning Integrating Imaging and Clinical Data for Oral Potentially Malignant Disorder Detection
链接：https://arxiv.org/abs/2609.04512
作者：Ruilin You,Yihan Wang,Jiabin Chen,Cherie Wink,Petra Wilder-Smith,Rongguang Liang,Bofan Song
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：potentially malignant disorders, substantial phenotypic heterogeneity, detection remains challenging, Oral potentially malignant, malignant disorders
备注：
点击查看摘要
Abstract:Oral potentially malignant disorders (OPMDs) are critical precursors to oral cancer, yet clinical detection remains challenging because of substantial phenotypic heterogeneity and overlap with benign conditions. Although image-based deep learning shows promise for automated screening, visual information alone may be insufficient in real-world settings, where diagnostic decisions also rely on patient-specific risk factors. We developed M2-OPMDNet, a multimodal deep learning framework that integrates co-registered white-light and autofluorescence intraoral images with structured clinical information for OPMD detection. A customized questionnaire was designed to capture clinically relevant risk factors and symptoms in a standardized, reproducible format for integration with image-derived features. Multiple image encoders, including conventional convolutional neural networks and foundation model-based architectures, were evaluated using a prospectively collected dataset reflecting real-world screening conditions. Model interpretability was assessed using SHapley Additive exPlanations (SHAP) to quantify feature- and modality-level contributions. M2-OPMDNet achieved an AUC of 0.952, outperforming unimodal approaches and showing improved performance for visually subtle lesions. SHAP analysis demonstrated that structured clinical variables contributed substantially to risk estimation and complemented imaging features. These results demonstrate that explainable multimodal learning combining white-light and autofluorescence imaging with structured clinical data can provide accurate, transparent, and clinically grounded OPMD detection. M2-OPMDNet offers a scalable framework for real-world oral cancer screening and decision support.
103. 【2609.04502】Fractional-Order Adaptive Motion Magnification: Phase-Reliability Weighting for Noise-Constrained Video Amplification
链接：https://arxiv.org/abs/2609.04502
作者：Alejandro Garnung Menéndez
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：boosts sub-pixel motion, band-pass filtering per-pixel, filtering per-pixel intensity, per-pixel intensity traces, amplification boosts sub-pixel
备注： 11 pages, 6 figures, 8 tables
点击查看摘要
Abstract:Eulerian video amplification boosts sub-pixel motion by band-pass filtering per-pixel intensity traces and applying a uniform gain. That gain ignores local structure, so sensor noise is amplified together with the signal, especially in textureless regions where the monogenic phase is unreliable. We propose FrAM (Fractional-order Adaptive Motion Magnification), a pipeline developed first offline and then as a causal stream. It replaces the constant temporal gain with a Grünwald--Letnikov derivative of fractional order, giving continuous control over high-frequency emphasis, and replaces the uniform spatial gain with a per-pixel weight derived from the local amplitude of the monogenic signal. On a controlled synthetic sequence split into textured and flat halves, FrAM matches the amplification of the Eulerian baseline while keeping flat-region temporal noise at the input level. The reduction holds across an eightfold range of input noise levels. Real videos show improved spatial selectivity and lower background noise in every case. The causal reformulation cuts the per-frame cost by two orders of magnitude, reaching 69\,fps at 640$\times$480.
104. 【2609.04390】Development and Evaluation of Ultrasound Image Learning Pipelines for MASLD Risk Stratification
链接：https://arxiv.org/abs/2609.04390
作者：Guangyi Zhang,Xiaohong Wang,Eugene Cheah,Peng Guo,Brian A. Telfer,Theodore T. Pierce,Anthony E. Samir
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：steatotic liver disease, dysfunction-associated steatotic liver, Metabolic dysfunction-associated steatotic, MASLD risk stratification, affects approximately
备注： 7 pages, 4 figures. Accepted and presented at IEEE EMBC 2026
点击查看摘要
Abstract:Metabolic dysfunction-associated steatotic liver disease (MASLD) affects approximately 30% of the general population. Ultrasound-based imaging, including B-mode imaging and shear wave elastography (SWE), is widely used for noninvasive fibrosis assessment; however, the role of deep learning-based ultrasound image learning for MASLD risk stratification remains insufficiently characterized. In this study, we developed and evaluated ultrasound image learning pipelines using B-mode and SWE images for fibrosis staging and identification of patients with at-risk metabolic dysfunction-associated steatohepatitis (MASH). A total of 250 ultrasound examinations, one exam per subject, were included. Model performance was evaluated using 3-fold cross-validation with area under the receiver operating characteristic curve (AUROC). End-to-end SWE image learning achieved performance comparable to operator-guided SWE across fibrosis stages. Overall, SWE-based learning consistently outperformed B-mode image learning in fibrosis staging, with AUROC improvements from 0.64 (95%CI: [0.56, 0.72]) to 0.72 (95% CI: [0.65, 0.79]) for F=2 (significant fibrosis, p=0.11), from 0.67 (95%CI: [0.58, 0.75]) to 0.78 (95% CI:[0.72, 0.85]) for F=3 (advanced fibrosis, p=0.02), and from 0.69 (95%CI: [0.56, 0.82]) to 0.80 (95%CI: [0.72, 0.89]) for F4 (cirrhosis, p=0.10). These findings highlight the potential of SWE image learning for MASLD risk stratification.
105. 【2609.04365】Ultrasound-Based Prediction of Cirrhosis Decompensation Using Large-Scale Computer Vision Models
链接：https://arxiv.org/abs/2609.04365
作者：Guangyi Zhang,Peiyun Ni,Eugene Cheah,Rajat Chandra,Peng Guo,Raymond T. Chung,Anthony E. Samir
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：limited non-invasive tools, predict its onset, represents a critical, critical transition, clinicians have limited
备注： 6 pages, 2 figures. Accepted and presented at IEEE EMBC 2026
点击查看摘要
Abstract:Decompensation represents a critical transition in the course of cirrhosis, yet clinicians have limited non-invasive tools to reliably predict its onset. In this study, we propose a novel imaging-based approach that leverages large-scale computer vision models to analyze routine abdominal ultrasound images and extract predictive features beyond those captured by traditional laboratory-based risk scores. Ultrasound is widely available, low cost, and suitable for longitudinal surveillance, making it an attractive modality for scalable risk stratification and long-term follow-up. Our framework integrates automated ultrasound data processing with modern deep learning architectures to identify patients at high risk of decompensation prior to the occurrence of clinical deterioration. This non-invasive strategy offers a practical complement to existing clinical scoring systems and may enable earlier, more proactive management of patients with compensated cirrhosis.
106. 【2609.04357】Cross-modal triage network: a multimodal deep learning framework for severity-based triage and visual explainability in chest radiographs
链接：https://arxiv.org/abs/2609.04357
作者：Zinah Ghulam,Richa Mittal,Eranga Ukwatta
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：queueing urgent examinations, Increased number, chest radiograph, scans create, queueing urgent
备注：
点击查看摘要
Abstract:Purpose: Increased number of chest radiograph (CXR) scans create a triage bottleneck, queueing urgent examinations behind routine ones. Existing AI tools are predominantly unimodal binary classifiers lacking severity awareness, and multimodal systems are rarely benchmarked against expert radiologists. To this end, we developed a multimodal deep learning framework for joint severity triage, pathology detection, and native visual explanation. Approach: We propose the cross-modal triage network (CMTN), fusing a Swin Transformer V2 visual encoder with a PubMedBERT text encoder via gated cross-attention. The CMTN was trained on 34,639 image-text pairs (12,489 patients) from MIMIC-CXR-JPG, optimizing an ordinal focal loss for four-tier severity triage and binary cross-entropy for 14 pathologies. Beyond quantitative benchmarking, attention heatmaps were evaluated against a blinded expert radiologist in a two-phase clinical audit comparing model triage output to expert severity assessment (100 cases) and grading spatial-semantic concordance (116 heatmaps). Results: The CMTN achieved strong ordinal agreement with reference labels (quadratic weighted kappa [QWK] = 0.9341, 95\% CI: 0.9219 to 0.9449) and macro-AUROC of 0.9970 across 14 pathologies, with 34~ms latency, outperforming the state-of-the-art BioViL multimodal baseline (QWK = 0.7679). However, the blinded Phase I clinical audit revealed substantially lower agreement with genuine radiologist judgment (QWK = 0.1399). Phase II found 54.3\% of heatmaps achieved clinically acceptable spatial localization. Conclusions: The CMTN demonstrated an efficient multimodal architecture for CXR triage. The divergence between algorithmic and radiologist agreement demonstrates that benchmark performance against NLP-derived labels is insufficient, highlighting the need for radiologist-labeled ground truth before clinical deployment.
107. 【2609.04274】Multi-scale Image Representation Compression
链接：https://arxiv.org/abs/2609.04274
作者：Tianhao Peng,Ho Man Kwan,Fan Zhang,Shan Liu,David Bull
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：demonstrated promising performance, overfitted image codecs, overfitted image codec, demonstrated promising, overfitted image
备注：
点击查看摘要
Abstract:Overfitted codecs have demonstrated promising performance for image and video compression. In particular, for image compression, the Cool-chic family of models has shown competitive performance against scene-agnostic models, with orders of magnitude lower decoding complexity at the cost of a longer overfitting process. However, these overfitted image codecs are not fully optimized toward the rate-distortion objective: their network weights remain in full precision during training, and the associated quantization parameters are selected in a separate post-training stage. Furthermore, their synthesis operates at a single scale, which overlooks cross-scale redundancy. In this paper, we propose MIRC, an overfitted image codec in which every coded component, including the latents, the synthesis network, and the entropy models, is quantized and entropy coded under a single rate-distortion objective, adopting the end-to-end compression pipeline of the neural video representation codec NVRC. We further introduce a multi-scale representation with cross-stage parameter sharing, which improves coding efficiency at a small transmitted overhead. On the CLIC2020 professional validation set, MIRC achieves a 10.5% BD-rate saving against VVC (VTM 22.0). Moreover, MIRC offers a family of configurations spanning 1.2 to 2.9 kMAC per pixel, so the decoding budget can be selected to match the deployment target.
108. 【2609.04273】Scalable Neural Video Representation Compression
链接：https://arxiv.org/abs/2609.04273
作者：Tianhao Peng,Ho Man Kwan,Fan Zhang,Shan Liu,David Bull
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：resolution operating points, accommodate diverse device, diverse device capabilities, multiple enhancement layers, layered bitstream consisting
备注：
点击查看摘要
Abstract:Scalable video coding (SVC) encodes a video into a layered bitstream consisting of a base layer and one or multiple enhancement layers, enabling decoding at different bitrate/quality/resolution operating points to accommodate diverse device capabilities and network conditions. Due to its practical flexibility, SVC has been incorporated into major video coding standards and has recently attracted growing interest for both scene-agnostic and scene-adaptive neural video codecs. Among the latter, Implicit neural representation (INR) based codecs achieve compression by overfitting a compact neural network to an individual video, offering fast decoding and competitive coding efficiency compared to scene-agnostic neural codecs. However, research on scalable INR-based compression remains in its infancy: these methods support scalable coding by introducing additional network layers, which couple the bitrate with the decoding complexity and also cannot achieve comparable performance with strong scalable/non-scalable codecs. In this context, this paper proposes S-NVRC, a scalable INR-based video codec that jointly supports fine-grained bitrate and decoding complexity scalability from a single embedded bitstream. It adopts a coarse-to-fine prefix for feature grids and a nested prefix for network layers, which scale bitrate and decoding complexity, respectively. The proposed S-NVRC spans a wide range of bitrate and decoding-complexity using a single encoding (training) and outperforms SHM 12.4 and the multi-layer VTM-20.0, by 43.7% and 5.6% in BD-rate on the UVG dataset, while also providing flexible complexity scalability. Implemented code will be provided.
109. 【2609.04242】raining-Free Speech-Centric Omni Understanding with Frozen VLMs
链接：https://arxiv.org/abs/2609.04242
作者：Ankan Deria,Hanoona Rasheed,Xilin He,Fahad Shahbaz Khan,Salman Khan
类目：Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：interpret spoken content, jointly interpret spoken, spoken content, temporal relationships, omni
备注： 18 Pages, 13 Tables, 3 Figures
点击查看摘要
Abstract:Audio-visual understanding remains challenging because models must jointly interpret spoken content, visual events, and their temporal relationships. Existing omni models typically introduce dedicated audio encoders and rely on expensive audio-video-text training, tightly coupling omni capability to specific VLM backbones and potentially weakening their existing visual and reasoning abilities. This raises three questions: whether native omni training is necessary for every new VLM, whether speech-centric omni capability can be added while preserving the original backbone, and where richer acoustic representations remain essential. We introduce Training-Free Omni (TFO), a plug-and-play framework that converts a frozen VLM into a speech-centric omni model without architectural modification, or multimodal re-alignment. TFO uses Whisper to extract confidence-filtered, timestamped transcripts and routes them through the VLM's existing language interface, while leaving its visual pathway unchanged. Across matched comparisons with native omni models on 56 benchmarks and 21 languages, TFO is competitive on audio-visual understanding, improves average audio-only performance across all five model settings, and achieves substantial multilingual speech gains. Freezing the VLM also generally preserves stronger image/video understanding, visual grounding, coding, mathematical reasoning, and medical question answering than the corresponding native omni checkpoints. These results show that strong speech-centric omni understanding can often be obtained through modular audio-to-language routing rather than costly backbone-specific training.
Comments:
18 Pages, 13 Tables, 3 Figures
Subjects:
Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
Cite as:
arXiv:2609.04242 [eess.AS]
(or
arXiv:2609.04242v1 [eess.AS] for this version)
https://doi.org/10.48550/arXiv.2609.04242
Focus to learn more
arXiv-issued DOI via DataCite</p>
110. 【2506.04061】Collaborative On-Sensor Array Cameras
链接：https://arxiv.org/abs/2506.04061
作者：Jipeng Sun,Kaixuan Wei,Thomas Eboli,Congli Wang,Cheng Zheng,Zhihao Zhou,Arka Majumdar,Wolfgang Heidrich,Felix Heide
类目：Optics (physics.optics); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：Modern nanofabrication techniques, Modern nanofabrication, bulky refractive surfaces, replace bulky refractive, offering the potential
备注： To appear in ACM Transactions on Graphics and to be presented at SIGGRAPH 2025
点击查看摘要
Abstract:Modern nanofabrication techniques have enabled us to manipulate the wavefront of light with sub-wavelength-scale structures, offering the potential to replace bulky refractive surfaces in conventional optics with ultrathin metasurfaces. In theory, arrays of nanoposts provide unprecedented control over manipulating the wavefront in terms of phase, polarization, and amplitude at the nanometer resolution. A line of recent work successfully investigates flat computational cameras that replace compound lenses with a single metalens or an array of metasurfaces a few millimeters from the sensor. However, due to the inherent wavelength dependence of metalenses, in practice, these cameras do not match their refractive counterparts in image quality for broadband imaging, and may even suffer from hallucinations when relying on generative reconstruction methods. In this work, we investigate a collaborative array of metasurface elements that are jointly learned to perform broadband imaging. To this end, we learn a nanophotonics array with 100-million nanoposts that is end-to-end jointly optimized over the full visible spectrum--a design task that existing inverse design methods or learning approaches cannot support due to memory and compute limitations. We introduce a distributed meta-optics learning method to tackle this challenge. This allows us to optimize a large parameter array along with a learned meta-atom proxy and a non-generative reconstruction method that is parallax-aware and noise-aware. The proposed camera performs favorably in simulation and in all experimental tests irrespective of the scene illumination spectrum.
Comments:
To appear in ACM Transactions on Graphics and to be presented at SIGGRAPH 2025
Subjects:
Optics (physics.optics); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
ACMclasses:
I.2.11; I.4; J.2
Cite as:
arXiv:2506.04061 [physics.optics]
(or
arXiv:2506.04061v1 [physics.optics] for this version)
https://doi.org/10.48550/arXiv.2506.04061
Focus to learn more
arXiv-issued DOI via DataCite
Related DOI:
https://doi.org/10.1145/3731200
Focus to learn more
DOI(s) linking to related resources</p>
