本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新611篇论文，其中：
- 自然语言处理64篇
- 信息检索18篇
- 计算机视觉90篇
自然语言处理
1. 【2609.13144】ype Diversity Enables Transformers to Generalise Compositionally
链接：https://arxiv.org/abs/2609.13144
作者：Anssi Moisio,Mathias Creutz,Mikko Kurimo
类目：Computation and Language (cs.CL)
关键词：Compositional generalisation, type diversity, structural, diversity, lexical
备注： Under review
点击查看摘要
Abstract:Compositional generalisation has been divided into lexical and structural generalisation. Previous work has found that structural generalisation is harder than lexical for Transformers. We propose that this difference is not inherent to Transformers, but due to the high diversity of lexical types and low diversity of structural types in the specific datasets of these previous works. By type diversity we mean the number of different constructors of that type, instead of, for example, the specific word combinations that might populate the structure. To test this, we vary the amounts of type diversity of lexical and structural types in previously published datasets. We create linguistically diverse variants of the COGS and SLOG datasets using Grammatical Framework. We find that type diversity correlates with compositional generalisation equally in lexical and structural test cases, supporting our hypothesis. We note a contradiction with the proposition in previous work that compound divergence explains the difficulty in compositional generalisation tasks. We further investigate the effects of other dataset properties on compositional generalisation, such as the diversity of types other than the novel test structure, and surface properties of the logical semantics format.
2. 【2609.13141】SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
链接：https://arxiv.org/abs/2609.13141
作者：Zhiwei Li,Lei Zhu,Hao Gu,Xiang Hu,Yan Wang,Haitao Mi,Sirui Han,Leo Liang,Zhijiang Guo
类目：Computation and Language (cs.CL)
关键词：Post-training attention sparsification, pretrained Transformers, Transformers by selecting, quadratic cumulative attention, cumulative attention cost
备注：
点击查看摘要
Abstract:Post-training attention sparsification reduces the quadratic cumulative attention cost of pretrained Transformers by selecting a small set of context units (tokens or blocks) for each query. Existing trainable methods usually use a lightweight selector to score context units, followed by hard Top-K selection that blocks gradients from the language modeling loss. Consequently, these methods commonly distill layer-wise dense attention distributions. Although this encourages the selector to rank context units by dense attention weights in the original model, the ranking is not directly aligned with their impact on predictions under a fixed attention budget (i.e., the number of attended context units per query), potentially wasting the limited budget on less useful units. To address this misalignment, we propose Simple Attention Sparsification (SAS), a gated sparse attention mechanism that optimizes context ranking end-to-end with the language modeling loss. The key idea is to inject the selector's continuous scores into attention logits during training, allowing the loss to update the selector through standard backpropagation. We identify several choices crucial for this simple design to work well in practice: placing the gate inside the attention softmax in log form, using normalized softmax gates to calibrate historical context against the always-retained current block, and preserving continuous selector scores so the model learns relative priorities rather than only hard selections. To support long-sequence training, we implement a memory-efficient Triton kernel that integrates SAS into FlashAttention-style computation. Across reasoning, long-context understanding, and agentic tasks, SAS consistently outperforms trainable sparse attention baselines across attention budgets, with especially large gains under tight budgets, demonstrating more effective context ranking for downstream tasks.
3. 【2609.13117】Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents
链接：https://arxiv.org/abs/2609.13117
作者：Yunqi Lu,Tyler Baumgartner,Nikhil Johri,Brandon Tai,Candice Fan,Luc Debaupte,Ruben Aguilar,Bill Wang,Yi Zhong
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Duplex Cue, Abstract, listener, Cue, Full-duplex
备注： 12 pages, 8 tables
点击查看摘要
Abstract:Full-duplex evaluation often emphasizes whether an agent keeps speaking or stops. That binary cannot express a third response humans use routinely: continuing to speak while incorporating what the listener just contributed. The contribution may be a missing word, a correction or a clarification. We introduce Duplex Cue, an evaluation of this \emph{in-turn adaptation} in full-duplex voice agents. Duplex Cue separates listener intent (backchannel, collaboration, or interruption) from speaker behavior: continuing unchanged, adapting within the turn, or yielding. Adaptation includes acknowledgment as well as content revision. In a single-model case study using 300 human-confirmed cues from unscripted English conversations, we compare recorded human responses with PersonaPlex continuations generated while replaying the listener's audio. We retain 208 pairs with the ongoing speaker active at cue onset and a scorable response in each condition. On the 66 collaborative pairs, recorded speakers adapt in 68.2\% of cases, compared with 34.8\% for PersonaPlex. The model otherwise continues unchanged (42.4\%) or yields (22.7\%). These findings show why evaluating natural voice interaction requires measuring how an agent responds to a listener's contribution as well as whether it keeps speaking.
4. 【2609.13072】MAxBench: A Multinomial Concept Recovery Benchmark
链接：https://arxiv.org/abs/2609.13072
作者：Divya Appapogu,Freya Behrens,Yonatan Belinkov,Aaron Mueller
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Fine-grained control, language model behaviors, control of language, actionable outcomes, Fine-grained
备注：
点击查看摘要
Abstract:Fine-grained control of language model behaviors (e.g., steering) is among the more actionable outcomes of interpretability research. For binary concepts such as refusal, a single direction in activation space often suffices for steering. However, many concepts are not binary: Animals and Countries contain many subcategories, each with multiple instances. For these concepts, the search space over possible representation geometries is far larger than for binary concepts; it is thus not clear what geometries are most appropriate, nor what methods are most effective at recovering them. In this work, we introduce MAxBench, a geometry-agnostic evaluation framework for multinomial concept representations based on sampling from the recovered concept representation. We use MAxBench to compare 10 localization methods (covering 5 geometry types) across 6 concepts and 4 models. Using this framework, we find that (i) affine subspaces steer more reliably and have greater recall than rank-one or linear subspaces; (ii) much of this advantage is due to better non-zero offsets rather than the choice of bases; (iii) manifold steering is competitive with the best methods when applicable; and (iv) no method consistently outperforms prompting, in alignment with prior findings on binary concepts. These findings underscore the importance of expanding the scope of interpretability research and meta-evaluation to concepts with more varied structure.
5. 【2609.13058】Expert-Space Exploration in MoE Reinforcement Learning
链接：https://arxiv.org/abs/2609.13058
作者：Hongyi He,Zhenghao Lin,Xiao Liu,Peng Cheng,Yan Lu,Yeyun Gong
类目：Computation and Language (cs.CL)
关键词：large language models, Exploration Reinforcement Learning, Reinforcement learning, central to post-training, post-training of large
备注：
点击查看摘要
Abstract:Reinforcement learning (RL) has become central to post-training of large language models. Recent advances in RL for Mixture-of-Experts (MoE) models have primarily focused on improving optimization stability and training efficiency, while treating the expert selection as a fixed component. Since routing determines the sparse computation paths that induce output distributions, expert selection offers an additional source of rollout diversity. Through empirical analysis, we find that perturbing expert routing effectively alters model output and increases rollout diversity, which is similar to increasing the decoding temperature. However, direct perturbation can activate unsuitable experts and substantially degrade rollout quality. Motivated by these observations, we introduce Expert-Space Exploration Reinforcement Learning (ESRL), an architecture-aware framework that explicitly explores the expert-routing space of MoE models. ESRL preserves high-confidence experts as anchors, and restricts stochastic routing to a plausible candidate pool, thereby retaining reliable computation paths. The perturbation strength is further adapted according to router entropy to avoid over-perturbation. To mitigate the routing mismatch introduced by perturbation, ESRL records the expert paths used during rollout and replays them during policy optimization. Experiments demonstrate that ESRL achieves the best performance across MoE backbones with top-K, top-1, and shared-expert routing, as well as across mathematics, science, and code tasks without additional sampling or computational cost. Specifically, ESRL on Qwen3-30B-A3B achieves the best among all compared methods, improving average Pass@1 and Pass@8 over GRPO by 3.2 and 4.5 percentage points, respectively. Further analyses of expert utilization and training dynamics provide insights into how exploiting MoE-specific routing structure benefits RL training.
6. 【2609.13045】Kraken: LLM-based Speech-to-Speech Translation via Low-bitrate VQ and Dual-path Source Conditioning
链接：https://arxiv.org/abs/2609.13045
作者：Hayato Futami,Hassan Shahmohammadi,Tushar Dhyani,Alkis Koudounas,Raphaël Lafargue,Yosuke Kashiwagi,Quentin Jodelet,Emiru Tsunoo
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：preserving non-linguistic information, offering the potential, advanced significantly, potential for joint, joint optimization
备注：
点击查看摘要
Abstract:Speech-to-speech translation (S2ST) has advanced significantly with speech LLMs, offering the potential for joint optimization and preserving non-linguistic information. However, these models struggle with predicting high-bitrate speech tokens in LLMs, and face the challenge of relying on S2ST training data with ideally aligned speaker identity and prosody. We propose using low-bitrate tokens based on single-layer vector quantization, trained to reconstruct self-supervised learning (SSL) features. We also employ a separate token-to-waveform decoder named Autowave-X, which is also conditioned on the source speech to improve non-linguistic transfer, thereby relaxing the training data constraints. With the integration of these techniques, we propose an S2ST model named Kraken, which augments a pre-trained LLM with speech feature inputs and the low-bitrate token outputs, followed by Autowave-X vocoder. We built the model upon Qwen3-8B and trained it using 150k hours of multilingual and multitask speech data. We demonstrated that our model exhibited better translation quality than SeamlessM4T-Large v2 and Qwen2.5-Omni, along with improved speaker and prosody transfer capabilities.
7. 【2609.13005】asks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models
链接：https://arxiv.org/abs/2609.13005
作者：Utkarsh Soni,Syed Shariyar Murtaza,Yifan Nie,Sachin Chandrasekhar,Eugene Wen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, natural language tasks, recent benchmarks suggest, achieved strong performance
备注：
点击查看摘要
Abstract:Large language models (LLMs) have achieved strong performance on a wide range of natural language tasks, and recent benchmarks suggest that they are increasingly adept at multi-hop reasoning. However, these benchmarks are typically short-horizon, requiring only a small number of retrieval or inference steps, and provide limited evidence of reliability on real-world tasks that involve following manuals spanning hundreds of pages with complex, interdependent guidelines. In this paper, we introduce Tasks over Application Manuals (TAM), a benchmark for evaluating long-horizon procedural reasoning. We construct TAM by curating real-world tasks from two domains: ICD-10-CM clinical coding (mapping medical conditions to diagnostic codes) and U.S. federal sentencing (computing crime sentencing guideline outcomes, specifically offense levels), with human-validated labels. Each task requires following an authoritative manual with tens of thousands of rules and executing a sequence of interdependent steps across different sections to produce an exact answer. We evaluate general-purpose prompting approaches, including retrieval-augmented generation, ReAct-style prompting, and an agent-harness baseline on GPT-5, and find that the best exact-match performance remains extremely low: 1% on ICD-10-CM coding and 15.5% on sentencing tasks. These results show that current benchmarks may overestimate LLM reasoning ability and miss a key challenge: reliably following long, rule-based procedures. The complete TAM data and code are publicly available.
8. 【2609.13003】Judging by the Cover: Cleaning LLM Truthfulness Benchmarks to Avoid Surface-Level Feature Leakage
链接：https://arxiv.org/abs/2609.13003
作者：Foad Namjoo,Remy Ogasawara,Amirali Abdullah,Cullen Anderson,Narmeen Fatimah Oozeer,Jeff M. Phillips
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Binary-choice truth benchmarks, Binary-choice truth, answers differ systematically, intended reasoning, differ systematically
备注： 31 pages, 4 figures. Code and data: [this https URL](https://github.com/foadnamjoo/audit-prune) and [this https URL](https://huggingface.co/datasets/foadnamjoo/audit-prune)
点击查看摘要
Abstract:Binary-choice truth benchmarks ask models to choose between a correct and an incorrect answer, but if the two answers differ systematically in surface-level features, models can exceed chance without performing the intended reasoning. We show that this failure mode is detectable and can be exploited by downstream classifiers. In TruthfulQA, a simple six-feature logistic classifier achieves substantial accuracy in separating correct from incorrect answers. We further show that similar surface-level artifacts are present in additional benchmarks. To counteract this, we developed a general mechanism to clean them by removing the most leakage-reinforcing pairs. We release a version of TruthfulQA with surface-feature leakage reduced close to chance and provide a mechanism, Audit-Prune, so that the datasets can be cleaned before release.
9. 【2609.12993】Investigating Temporal Motion Features for Pose-to-Text Indian Sign Language Translation
链接：https://arxiv.org/abs/2609.12993
作者：Manav Dhamecha,Praveen Kumar Chandaliya,Pruthwik Mishra
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Indian Sign Language, Sign Language Translation, Indian Sign, Language Translation, Sign Language
备注： 5 pages, 1 table and 2 figures
点击查看摘要
Abstract:We investigate the effect of pretrained T5 model scale and explicit motion features on pose-to-text Indian Sign Language Translation (SLT) for the WSLP 2026 Shared Task. Pose sequences are projected into the embedding space of T5 through a lightweight pose encoder, with the complete model fine-tuned to generate English text. The shared task data used for this work consists of a test set with 5,334 examples and a validation set with 5,257 examples. We compare T5-small, T5-base, and T5-large, and additionally introduce a motion-augmented variant, T5-small + Motion, that adds explicit frame-to-frame pose differences to the input representation. T5-small achieves the best BLEU and ROUGE scores among the spatial-only models, while T5-large obtains the highest chrF score. Augmenting T5-small with motion features yields the largest single improvement observed in our study, substantially improving BLEU over the spatial-only baseline and making it the strongest model overall on this metric. Our submitted system ranked 5th on the official WSLP 2026 SLT testing leaderboard. The source code and trained models are publicly available on GitHub and HuggingFace.
10. 【2609.12960】Fewer Words, Not Fewer Tokens: Measuring the Sanskrit Tokenization Penalty per Proposition
链接：https://arxiv.org/abs/2609.12960
作者：Devansh Sharma
类目：Computation and Language (cs.CL)
关键词：Sanskrit fuses case, English, fuses case, person and tense, clauses into compounds
备注： 20 pages, of which 8 are the body; 4 figures, 18 tables. Code, data pipeline and the full results snapshot: [this https URL](https://github.com/DS436/sanskrit-token)
点击查看摘要
Abstract:Sanskrit fuses case, number, person and tense into word endings and chains clauses into compounds, so it is information-dense per word. Whether that density survives subword tokenization is a separate question, to be asked per unit of meaning rather than per word. On identical FLORES-200 devtest content, Sanskrit costs 1.774-2.187 times the English tokens under deployed tokenizers with vocabularies of 200,019 ids or more, but only 1.325-1.353 times the Hindi tokens. Against a deployed English tokenizer, Sanskrit-trained BPE arms then look cheaper per proposition than English on contemporary prose (0.887). Against a matched English control, the same algorithm and vocabulary trained on the English side of the same corpus, that flip disappears: at 32,000 and 64,000 pieces all 8 matched pairs, each size-matched arm against both a pair-matched and a byte-matched control, sit above 1.0 on prose with 95% intervals excluding it. The gap closes as the vocabulary grows: at 128,000 pieces the BPE pair reads 0.983 in domain while staying above parity out of domain (1.025) and on FLORES (1.116). The ratio factorises into a character-length ratio and a tokens-per-character ratio, the second near 1 throughout: what survives matched tokenization is character-level length, which Sanskrit prose lacks over English in SLP1 (1.028) and Sanskrit verse has (0.596). The robust statement is about deployed practice: on contemporary prose and on FLORES, with the Sanskrit side in SLP1 against the deployed o200k English pivot, Sanskrit costs 1.831-2.899 English tokens per proposition under the tokenizers people actually ship. Code, the results snapshot and every table here are public.
11. 【2609.12917】PA-CDM: Position-Aware Character Detection Matching for Evaluating Handwritten Mathematical Expression Recognition
链接：https://arxiv.org/abs/2609.12917
作者：Shiliang Luo(East China Normal University)
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Handwritten mathematical expression, identical token-error counts, counts receive identical, mathematical expression recognition, token-error counts receive
备注： 8 pages, 3 figures
点击查看摘要
Abstract:Handwritten mathematical expression recognition (HMER) is conventionally scored by exact-match rates and string-similarity metrics that are blind to where an error occurs: two predictions with identical token-error counts receive identical scores whether they misplace a subscript or swap the operands of a fraction. Render-based character detection matching (CDM) aligns glyphs robustly but remains position-blind---on controlled fraction-operand swaps it scores 0.8595 where position-aware scoring yields 0.6253. Tree-edit metrics exhibit a complementary blind spot: rewrites outside the parser's normalization coverage are penalized as structural errors (0.8552 where render-based metrics score 1.0). We propose PA-CDM, a position-aware metric that couples character detection matching with position-forest encoding and divergence-level weighting; StructPerturb v2.0, a frozen benchmark of 1,340 controlled perturbation pairs across 15 type--intensity cells; and a cross-metric consistency protocol combining a sensitivity matrix, a human study, and LLM-judge calibration. In a six-annotator study, PA-CDM attains the highest correlation with human judgments among seven automatic metrics (Spearman rho=0.9535, n=990). A frontier LLM judge correlates slightly higher (rho=0.9613) but is costly, nondeterministic, and API-dependent; PA-CDM approaches it at zero marginal cost with deterministic, diagnosable behavior.
12. 【2609.12915】LLM-Enhanced Dual-Branch Learning for Large-Scale Multi-Label Text Classification
链接：https://arxiv.org/abs/2609.12915
作者：Hui Ye,Jing Zhang,Xiulong Yang,Rajshekhar Sunderraman
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large-scale multi-label text, text classification assigns, assigns a small, small subset, multi-label text classification
备注：
点击查看摘要
Abstract:Large-scale multi-label text classification assigns a small subset of relevant labels to each document from a vocabulary containing thousands or tens of thousands of candidate labels. Although pretrained language models have improved semantic text representations, most representation-based approaches center their prediction pipelines on a primary encoder or combine auxiliary features within a single ranker. The complementarity between heterogeneous language models therefore remains insufficiently explored. We propose DualMLC, a dual-branch framework that processes the same document through an autoregressive decoder-only language model and a bidirectional encoder. Each branch maintains its own representation pathway and independently estimates relevance scores over the shared label space. DualMLC combines the two score vectors through late logit fusion, allowing shared evidence to reinforce relevant labels and branch-specific evidence to compensate for limitations in the other branch's representation. DualMLC achieves state-of-the-art results on three widely used large-scale multi-label text classification benchmarks. Ablation results further confirm that integrating the heterogeneous predictors produces stronger rankings than either branch alone. The source code is publicly available at this https URL.
13. 【2609.12913】Parameter-Efficient Retrievers for Polish and European Languages
链接：https://arxiv.org/abs/2609.12913
作者：Sławomir Dadas,Rafał Poświata,Małgorzata Grębowiec,Michał Perełkiewicz
类目：Computation and Language (cs.CL)
关键词：frequent corpus updates, make large-scale indexing, low-latency serving costly, Dense retrieval systems, systems increasingly rely
备注：
点击查看摘要
Abstract:Dense retrieval systems increasingly rely on multi-billion-parameter language models, whose memory and computational requirements make large-scale indexing, frequent corpus updates, and low-latency serving costly. We present a three-stage training pipeline for developing compact and efficient retrievers that remain competitive with substantially larger models. The pipeline combines cross-lingual alignment, relational knowledge distillation, and contrastive fine-tuning. It requires no original ground-truth relevance labels, relying exclusively on supervision generated by strong embedding models and rerankers utilised as teachers. Using this pipeline, we develop PolDense and EuroDense, both supporting contexts of up to 8,192 tokens. PolDense is a family of six Polish retrievers ranging from 17M to 1B parameters. EuroDense is a 435M-parameter retriever supporting nine European languages. We conduct an extensive evaluation covering 41 Polish and 150 multilingual retrieval tasks. The results demonstrate strong quality-efficiency trade-offs. PolDense-1B outperforms the evaluated retrievers with up to 9B parameters, while the PolDense family forms the Pareto frontier across model sizes. Among the evaluated models below 1B parameters, EuroDense ranks first in both task-averaged and language-averaged performance and leads in seven of nine languages. We release all models publicly.
14. 【2609.12884】MedSNIP: Building and Benchmarking Snippet-Level Granularity for Medical Fact Verification
链接：https://arxiv.org/abs/2609.12884
作者：Hasan Iqbal,Sarfraz Ahmad,Hyunjae Kim,Sihyeon Park,Junjie Liao,Qingyu Chen,Preslav Nakov,Yuxia Wang
类目：Computation and Language (cs.CL)
关键词：medical claim correctness, correctness often depends, claim correctness, clinically incomplete claims, claim
备注： 24 pages, 21 figures, 14 tables, Published In Proceedings of The 2026 Conference on Empirical Methods in Natural Language Processing
点击查看摘要
Abstract:A medical claim's correctness often depends not on the claim alone, but on the clinical structure around it. A claim may require a lab reference range, a causal or conditional link, or patient-specific details to be judged correctly, and atom-level decomposition can fragment these dependencies, leaving the verifier with clinically incomplete claims. We reformulate medical fact-checking around snippet-level verification, where clause-grouped units preserve local clinical structure. We introduce MedSNIP-Bench, a human-annotated benchmark for snippet-level medical fact verification, and MedSNIP, an automatic snippet-generation pipeline. MedSNIP-Bench covers 276 consumer-health and clinical-vignette responses, segmented into 2,524 snippets with dual in-general and in-patient-context labels and six structural pattern codes. MedSNIP is evaluated against human snippet boundaries on MedSNIP-Bench and then used to generate snippet-level units for external corpora. Across MedSNIP-Bench, HealthFC, and MedHallu, snippet-level verification preserves or improves false-class F1, with gains concentrated where answers are long enough to fragment and where the verifier is strong enough to exploit the recovered structure. The largest merge-pattern gain is on causal-conditional clinical chains. It also reduces verifier calls by 24-73%, though the saving survives end-to-end only when decomposition is cheap, which an open-weight decomposer makes possible at no loss of chunking fidelity.
15. 【2609.12872】DuplexDrama: A Synthesized Dialogue Dataset with Scenarios, Full-Duplex Behaviors, Expressive Speech, and Sound Events
链接：https://arxiv.org/abs/2609.12872
作者：Qingxiang Guo,Wenke Fan,Shuofeng Zhao,Dawei Yang,Zhiyang Zhou,Yingxin Shang,Hongwei Cai,Zhou Wang,Weixu Wang,Lin Yang,Shuran Zhou,Yang Song
类目：Computation and Language (cs.CL)
关键词：script-aware sound events, persona-aligned emotion labels, covers four dimensions, scenario settings, expressive speech
备注： 5 pages, 5 figures, 5 tables, 18 references. Demo: [this https URL](https://dunjie5465.github.io/duplexdrama-demo/)
点击查看摘要
Abstract:We present DuplexDrama, the first synthesized spoken dialogue dataset that simultaneously covers four dimensions: (i) complete persona and scenario settings; (ii) three full-duplex behaviors (interruption, backchannel, incomplete); (iii) expressive speech with persona-aligned emotion labels; and (iv) script-aware sound events. DuplexDrama is built via a 4-stage pipeline; quality validation on both scripts and synthesized audio confirms its quality. We have produced more than 2,000 hours audio data with a 64-voice timbre pool spanning 13 personas and 5 age buckets; 3.8% of all turns carry at least one full-duplex behavior. This data has been validated through internal full-duplex model training. We will release a curated subset of 6,400 bilingual dialogues (800 h, Chinese ~500 h + English ~300 h) to advance full-duplex spoken dialogue model research. Data samples are available at our demo page and LLM-judge evaluation prompts will be released with the dataset.
16. 【2609.12791】Cognition on Graph: Navigating Massive Knowledge Space via Cognitive Cycles and Bidirectional Graph-Text Synergy
链接：https://arxiv.org/abs/2609.12791
作者：Gengxian Zhou,Jian Xu,Zichen Tang,Shiming Xiang,Haihong E,Cheng-Lin Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large Language Models, empowered Large Language, Language Models, Large Language, tackle knowledge-intensive tasks
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) has empowered Large Language Models (LLMs) to tackle knowledge-intensive tasks. However, navigating global, heterogeneous knowledge bases (large-scale knowledge graphs and text corpora) for complex reasoning remains a challenge. Existing methods typically employ reactive, graph-driven exploration strategies, which blindly follow graph topology without adapting to the question context or evolving exploration progress, and lack deep bidirectional synergy between graph and text. To address these limitations, we propose CoG (Cognition on Graph), a cognitive-inspired, training-free framework for adaptive knowledge exploration. Drawing inspiration from human problem-solving, CoG performs a continuous plan-explore-reflect cycle, where it proactively formulates investigation plans, performs dual-source retrieval, and dynamically reflects on progress to adjust strategies. Crucially, it establishes deep bidirectional synergy between structured graph and unstructured text, where entities extracted from text dynamically guide graph exploration to bridge knowledge gaps. Extensive experiments on seven multi-hop QA benchmarks demonstrate that CoG significantly outperforms state-of-the-art methods while achieving superior exploration efficiency. Our code and datasets are available at this https URL.
17. 【2609.12746】What Drives Recovery in Agentic Text-to-Cypher? LAST-CQ: An LLM Agent Self-Refinement Framework
链接：https://arxiv.org/abs/2609.12746
作者：Ioannis Prokopiou,Athanasios Aidinis,Panagiotis-Christos Kyrmpatsos,Pantelis Vikatos
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Software Engineering (cs.SE)
关键词：Agentic pipelines, rapidly expanding, produces the gain, pipelines for structured-query, unclear which part
备注： Accepted at REALM: The 2nd Workshop for Research on Agent Language Models at Empirical Methods in Natural Language Processing (EMNLP 2026), 15 pages, 3 figures, 6 tables
点击查看摘要
Abstract:Agentic pipelines for structured-query generation are rapidly expanding, but it is unclear which part of the loop produces the gain. We use LAST-CQ -- a five-agent, training-free, execution-grounded Text-to-Cypher framework -- as an instrumented testbed, running three counterfactuals over 2,471 live-database queries and six backbones spanning three vendor scale tiers. Removing correction is worth between 3.1% aggregate execution-BLEU against the single-pass system and 12.3% against a no-refinement counterfactual (up to 80.7% for the weakest backbone). Replacing schema-grounded, LLM-synthesised feedback with raw database error strings costs almost nothing (20.9% vs. 19.9% naive exact match; 0.2% end-to-end; equivalent within $\pm 0.075$ set-F1 by two one-sided tests). Spending the same call budget on parallel sampling degrades quality by 10-11%. What works is detecting failure and routing it to a retry, not the feedback sophistication or number of samples. LAST-CQ itself recovers 91.7% of queries that fail under single-pass generation, while a query that succeeds first time still costs exactly one LLM call. We also show that n-gram overlap on serialised results is not a bound in either direction: it over-scores against set equivalence on 65.9% of results while under-scoring against judged semantics. Finally, we calibrate our LLM judge against blind human labels and find it optimistic by 9 points.
18. 【2609.12686】Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size
链接：https://arxiv.org/abs/2609.12686
作者：MyungHoon Ryu,XinYu Piao,Jong-Kook Kim
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, process long contexts, including long documents, face token-level memory
备注：
点击查看摘要
Abstract:Large language models (LLMs) process long contexts, including long documents and lengthy conversations, but face token-level memory usage that increases proportionally to input length. Although model optimization and lossy prompt compression are widely used, these methods still fail to solve the long-context recall problem beyond pretrained and size-constrained context windows. This paper proposes a long-context recall method that maintains near-constant GPU memory usage as context length increases, without additional training. The main idea is to reconstruct facts using parameter activations in the LLM's feed-forward layers, which store residual vectors representing facts from the source document. Utilizing residual vectors allows the LLM to deterministically reconstruct query relevant facts without referencing the original document, preserving high fidelity and reducing memory usage without fine-tuning weights. Experimental results show that the proposed method enables answering single-fact questions in two-million-token story contexts where previous methods fail.
19. 【2609.12674】Doc2FRC: Length-Consistent Document-Level Machine Translation via Fixed-Range Chunking
链接：https://arxiv.org/abs/2609.12674
作者：Xiaotian Wang,Youyuan Lin,Zhan Shen,Hitomi Yanaka
类目：Computation and Language (cs.CL)
关键词：Advanced large language, large language models, long context windows, Advanced large, document-level machine translation
备注： To appear in Proceedings of the Eleventh Conference on Machine Translation (WMT2026)
点击查看摘要
Abstract:Advanced large language models (LLMs) with long context windows can substantially reduce input truncation in document-level machine translation (DocMT). However, direct Doc2Doc translation remains prone to n-gram repetition and progressive quality degradation. A common remedy is to segment the document into finer-grained chunks. Nonetheless, conventional rule-based chunking approaches fail to handle the length distribution mismatch between training and inference. To address this, we introduce Fixed-Range Chunking (FRC), utilizing dynamic programming to partition documents into chunks within a predefined length interval. By consistently applying FRC during training and inference, the input documents of any length are mapped to the same length distribution, substantially reducing train-test length mismatch. Centered on FRC, we propose a lightweight dual-boundary matching algorithm for chunk alignment, alongside four distinct training strategies. Experimental results show that FRC-based fine-tuning substantially improves 7B LLMs over direct Doc2Doc fine-tuning and outperforms existing DocMT methods on IWSLT2017. We further construct GlobVDoc, a 10-language test set independent of mainstream DocMT training sources, and show that FRC improves out-of-distribution document translation.
20. 【2609.12655】LifeMem: Enabling Lifelong Experience Reuse for LLM Agents
链接：https://arxiv.org/abs/2609.12655
作者：Yuli Qiu,Yutong Li,Wei Su,Zeming Liu,Wanxiang Che,Heyan Huang,Haifeng Wang,Yuang Guo
类目：Computation and Language (cs.CL)
关键词：Large language model, Large language, reusing past experience, language model agents, language model
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Large language model agents are expected to continuously adapt to new tasks and environments over their lifetime by reusing past experience. However, existing memory-based agents struggle to transfer reusable experience across environments and suffer from catastrophic forgetting as experience accumulated. To address these challenges, we propose LifeMem, a lifelong learning framework that enables agents to transfer knowledge across multiple environments. During learning, LifeMem clusters accumulated interaction trajectories based on underlying workflows to extract reusable skills. When solving a new task at inference time, the agent recalls relevant skills and trajectories to guide actions. To validate our method, we conduct experiments across 10 environments and over 13k tasks with 2k newly annotated interaction trajectories. Results show that LifeMem enables effective experience reuse in lifelong learning, achieving both reduced forgetting on learned tasks and superior cross-task transfer. Further analysis reveals that task streaming impacts learning, while consolidating structurally similar trajectories within memory boosts performance.
21. 【2609.12653】SWARM: A Multilingual Human-Annotated Dataset for Russian Propaganda Detection in Search Engine Results
链接：https://arxiv.org/abs/2609.12653
作者：Manuel Tonneau,Abhinav Dubey,Farhan Shaikh,Ilaria Vitulano,Martha Stolze,Hale Dedeoglu,Clara Riechert,Ella Kuka,Maryna Sydorova,Mykola Makhortykh,Elizaveta Kuznetsova
类目：Computation and Language (cs.CL)
关键词：Russian state propaganda, state propaganda spreads, Russian state, online spaces, Russian
备注： Accepted at the 10th Workshop on Online Abuse and Harms (WOAH 2026)
点击查看摘要
Abstract:Russian state propaganda spreads across many languages and online spaces. Yet, most computational work examines only one such space, usually social media, in one or two languages, and analyses sources rather than content. We introduce SWARM (Search-Web documents Annotated for Russian propaganda, Multilingual), a dataset of 2,183 search engine results across nine languages and diverse web domains (e.g., news, blogs, government sites), each annotated by trained coders for whether it supports a recurring Russian propaganda narrative. We benchmark a source-based blocklist, supervised classifiers, and zero-shot LLMs against these labels. The blocklist misses most propaganda-supporting documents, because such content is not confined to flagged "propaganda" outlets but also appears on mainstream ones. Content-level analysis helps, though how much depends on the model: the strongest LLM reaches a positive-class F1 of 0.73, whereas the supervised classifiers reach only about 0.5, with the smaller LLMs over-predicting support, mistaking topical relevance for endorsement. Detecting search-borne propaganda thus requires per-language, content-level evaluation, which we hope SWARM and our evaluation code enable.
22. 【2609.12623】SteerDuplex: Steerable Duplex Speech Dialogue Models
链接：https://arxiv.org/abs/2609.12623
作者：Utkarsh Tyagi,Ramaneswaran Selvakumar,Advait Gosai,Sonal Kumar,Nikhil Barhate,Isabell Sagar,Steven Li,Miheer Bavare,Daniel Quigley,Fabiola Tapia Carrillo,Jose M Patron E,Diego Macías Gutiérrez,Paul Song,Ramani Duraiswami,Dinesh Manocha,Yunzhong He
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：low-latency turn taking, reliably shift conversational, shift conversational behavior, capability remains underexplored, key capability remains
备注： 24 pages, 7 figures
点击查看摘要
Abstract:Full-duplex spoken dialogue models support low-latency turn taking, interruption handling, and backchanneling, yet a key capability remains underexplored: steerability, the ability to reliably shift conversational behavior along attributes such as tone, persona, speaking rate, and voice style in response to user instructions. We introduce a taxonomy of text- and audio-based steerability that identifies substantial gaps in current full-duplex models. To address this gap, we introduce SteerDuplex, a Moshi-based full-duplex speech model fine-tuned on natural conversations and synthetic dialogues targeting instruction following, vocal delivery, reasoning, and duplex interaction. We further apply two-stage reinforcement learning (RL) with hybrid rewards, combining verifiable interaction checks and judge-based semantic feedback to improve timing and response continuity. To evaluate full-duplex spoken steerability, we introduce SteerBench, a benchmark with 390 spoken prompts and 1,067 human-authored binary audio and text rubrics spanning tone, persona, style/accent, and speed/length. On SteerBench, supervised training improves audio-steering average pass rate by 44.5 percentage points over the strongest evaluated open baseline. On Audio MultiChallenge, task average pass rate improves by 7 points over its strongest evaluated open baseline. RL further raises source-clean interruption response from 72.5% to 82.5% and reduces synthetic pause barge-in from 26.5% to 9%. Steering and aggregate task scores remain comparable or higher, while reward probes reveal reward hacking through incomplete responses. Our model and benchmark support systematic research on spoken steerability, with reward analysis showing why timing gains must be evaluated alongside response completeness.
23. 【2609.12575】Calibrated Ambiguity in Multimodal Language Models: Humans reach for cultural references, while models describe the picture
链接：https://arxiv.org/abs/2609.12575
作者：Cody Kommers,Mingrui Ye,Evelyn Gius,Daniela Mihai,Hoyt Long,Zheng Yuan,Drew Hemment
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：systems to resolve, communication and culture, generative resource, Ambiguity, calibrated ambiguity
备注： Kommers and Ye contributed equally to this research
点击查看摘要
Abstract:Ambiguity is often treated as a bug for AI systems to resolve---but in human communication and culture, ambiguity can also be a generative resource. From humour to politics to art, people express themselves in words and images that are open enough to invite different interpretations, yet constrained enough to be interpretable. We operationalise this notion of calibrated ambiguity with a task drawn from the parlour game Dixit. We compare differences in clues generated by human vs multimodal language models, based on a novel coding rubric for calibrated ambiguity, and find that models consistently exhibit ambiguity collapse (i.e., their outputs are over-specified, leaving no room for multiple legitimate interpretations). Unlike human clues, AI-generated clues also exhibit cultural flattening; they almost never make reference to culturally-situated knowledge, even when prompted to use allusion and figurative language.
24. 【2609.12544】Meddies-PII: A Multilingual Framework for Personally Identifiable Information Extraction in Clinical De-identification
链接：https://arxiv.org/abs/2609.12544
作者：Linh Uyen Le,Christian Hoang,Huy Hoang Ha
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：personally identifiable information, accurately identifying personally, identifying personally identifiable, identifiable information, relies on accurately
备注：
点击查看摘要
Abstract:Clinical de-identification relies on accurately identifying personally identifiable information (PII). However, manually annotated datasets are costly to construct, while existing synthetic alternatives often provide limited details about their generation process or rely on relatively simple synthesis strategies. We introduce Meddies-PII-Dataset, a corpus of one million synthetic clinical documents spanning seventeen languages and nine PII labels. The documents are generated using attribute-conditioned prompts and validated through thirteen deterministic gates that enforce structural and annotation consistency. To evaluate the dataset's utility, we train Meddies-PII-Model, a BIOES token classifier, and compare it with existing PII extraction systems using exact-match entity-level F1. Meddies-PII-Model achieves the highest performance among the evaluated systems on all reported benchmarks, with a mean F1 of 0.827 across fifteen external benchmarks, compared with 0.658 for the strongest baseline. Upon acceptance, we will publicly release the dataset, benchmark suite, model, generation framework, and evaluation code to support research on multilingual clinical de-identification.
25. 【2609.12541】Agent as Policy for Robotic Manipulation
链接：https://arxiv.org/abs/2609.12541
作者：Mengzhao Jia,Yang Lin,Xixin Zhang,Zhihan Zhang,Xiaobai Liu,Meng Jiang
类目：Computation and Language (cs.CL)
关键词：environment-specific training, directly drive, task-specific or environment-specific, agent, AGP
备注：
点击查看摘要
Abstract:We demonstrate that a general-purpose agent can directly drive a physical robot throughout task execution without any task-specific or environment-specific training. We introduce Agent as Policy (AGP), which places task planning and execution under the agent's control. Given a task and a robot interface, the agent interprets visual evidence, writes executable programs, issues motion commands, and revises its actions in response to physical outcomes. This brings the agent's reasoning and programming capabilities into continuous interaction with the physical world. We study AGP across multiple real-world manipulation tasks spanning precision manipulation, dynamic motions, and deformable objects. These include assembly from human videos, block construction from goal images, die reorientation, targeted throwing, and bimanual towel folding. AGP achieves success rates of 100%, 100%, and 80% on three block construction configurations. These findings establish a path for general-purpose agents to act as robotic policies, extending their autonomy to physical manipulation through runtime reasoning, programming, and interaction.
26. 【2609.12537】he House with a Million Windows: Interactive Fiction for Narrative Restorying
链接：https://arxiv.org/abs/2609.12537
作者：Cody Kommers,Sarah G Immel,Drew Hemment,Mina Lee
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：sense-making writing entails, human storytelling, enabling the production, production of homogeneous, homogeneous outputs
备注： Kommers Immel contributed equally to this research
点击查看摘要
Abstract:AI-assisted writing can flatten meaning in human storytelling, enabling the production of homogeneous outputs without the intentional effort and sense-making writing entails. To address this challenge, we present The House with a Million Windows (HWAMW), an LLM-based interactive fiction system designed to help users explore both the breadth and depth of potential meanings within their personal stories -- drawing on a psychological paradigm called the restorying intervention. In HWAMW, users play through a text-based narrative in which they tell a story, then encounter a set of LLM-generated "windows" reframing it according to different literary styles. Empirical evidence shows that HWAMW increases users' sense of narrative identity, while an expert review explores how this effect is achieved. Our findings suggest that HWAMW facilitates restorying and offers a valuable paradigm for AI-assisted writing, wherein LLMs do not tell our stories but rather help us see greater potential in the stories we tell.
27. 【2609.12533】Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents
链接：https://arxiv.org/abs/2609.12533
作者：Zhutao Lv,Chenhao Dang,Yi Feng,Yanpei Gong,Xiaolei Wang,Junyan Ye,Conghui He,Weijia Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Real-world Earth observation, Real-world Earth, perform domain computations, Earth observation, translate high-level scientific
备注： 18 pages, 8 figures. The code and datasets of this work will be released soon
点击查看摘要
Abstract:Real-world Earth observation (EO) agents must translate high-level scientific questions into executable workflows to acquire observations, prepare data, perform domain computations, and derive conclusions from runtime evidence. Existing EO agents typically start from supplied observations, while benchmarks typically provide prepared inputs or candidate answers, leaving full-chain open-world EO execution largely untested. We present Earth-Agent-Pro, an execution-adaptive Plan-and-Execute framework using expert-authored skills to constrain planning and runtime tool use. Workflow-centered structured memory records planned steps, accepted evidence, and their dependencies, enabling repair of only the affected workflow suffix when runtime evidence invalidates a step. Separate large language model adapters use sequence-level supervised fine-tuning for planner workflow composition and node-level group relative policy optimization with locally verifiable rewards for executor tool-argument grounding. Earth-Bench-Pro instantiates 248 expert-curated task cores as 744 questions under three matched regimes. Its 248 Open-World Execution questions span RGB imagery, spectral observations, and remote sensing products, pairing high-level requests with runtime data requirements, executable trajectories, and open-ended answers grounded in execution evidence. With a shared GPT-5 backbone, Earth-Agent-Pro achieves 66.13% LLM-as-Judge accuracy, exceeding ReAct by 20.95 points in this metric and 24.44 points in Tools-In-Order. Joint adapter tuning raises Qwen3.5-9B LLM-as-Judge accuracy from 38.31% to 50.00%, an 11.69-point gain over the untuned configuration. Planning-only evaluation and execution with the reference workflow show that the adapters improve workflow composition and argument grounding, respectively. Code and datasets will be released soon.
28. 【2609.12495】Information Specialization and Constrained Synthesis in Multi-Agent LLM Forecasting: A Prospective Live-Study of the 2026 FIFA World Cup
链接：https://arxiv.org/abs/2609.12495
作者：Julian Varghese,Lucas Bickmann,Sarah Sandmann
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, specialization produces distinct, FIFA World Cup, Large language, utility remains unclear
备注： 10 pages, 3 figures, 1 table
点击查看摘要
Abstract:Large language models are being organized into multi-agent systems with specialized roles, but whether such specialization produces distinct forecasts and whether subsequent synthesis improves utility remains unclear. In this study, we carried out a live, prospective evaluation over the final 56 matches of the information-dense 2026 FIFA World Cup, keeping a frontier foundation model constant while assigning two primary forecasting agents contrasting specialist roles: a quantitative specialist focusing on structured performance statistics and a news specialist focusing on current injuries, tactics and information from press conferences. Their forecasts were then reviewed by a separate critic before being combined by a meta-agent, resulting in a sequential four-agent model. Forecasts from the betting market served as an external benchmark. The news specialist obtained the highest mean probability-weighted Top-3 utility and matched the betting market in Top-3 exact-score hits. Nevertheless, the two specialist forecasters agreed on at least two of the three scorelines in 50 out of 56 matches, and the meta-agent never generated more than one scoreline outside the specialists' forecast set. These findings show that rapidly changing, unstructured information can provide a valuable forecasting signal alongside structured statistics, whereas adding critic and meta-agent stages does not necessarily create complementary information or improve on the strongest specialist.
29. 【2609.12489】Confidence-Gated Transductive Test Generation for Code Reranking
链接：https://arxiv.org/abs/2609.12489
作者：Sungjae Lee,Youngsik Yoon,Seockbean Song,Siwei Wang,Wei Chen,Jungseul Ok
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：large language models, ranking programs generated, Test case synthesis, language models, synthesis is crucial
备注：
点击查看摘要
Abstract:Test case synthesis is crucial for evaluating and ranking programs generated by large language models (LLMs). However, constructing high-quality test cases remains challenging because reliable expected outputs are often difficult to obtain. We propose Confidence-Gated Transductive Test Generation (CoTT), which first uses an efficient inductive procedure and invokes transductive generation only when inductive confidence is low. This adaptive design improves output reliability while allocating extra computation only when needed. On code reranking benchmarks, CoTT outperforms prior baselines across the reported metrics while reducing cost relative to applying transductive generation to every input. These results show that confidence-based allocation of test-time computation provides a favorable efficiency-effectiveness trade-off with a single efficient LLM.
30. 【2609.12475】Zipbench: Low-Cost Framework for Compressing Comprehensive Benchmarks of Large Language Models
链接：https://arxiv.org/abs/2609.12475
作者：Zhongzhan Huang,Junxin Li,Guoming Ling,Yupei Lin,Shanshan Zhong,Hefeng Wu
类目：Computation and Language (cs.CL)
关键词：Comprehensive benchmark suites, large language models, improving large language, Comprehensive benchmark, language models
备注： Accepted by EMNLP 2026 main track
点击查看摘要
Abstract:Comprehensive benchmark suites are essential for improving large language models (LLMs), but many widely used benchmarks are redundant, making evaluation unnecessarily expensive. Although recent benchmark compression methods (BCMs) can mitigate this cost, many strong BCMs rely on large collections of per-sample evaluation results from numerous LLMs to identify representative samples. Building such collections is also expensive unless they are already public, making these methods difficult to extend to newly released benchmarks. To address this challenge, we present ZipBench, a simple and low-cost BCM with theoretical error and rank-consistency guarantees. ZipBench evaluates only a small set of anchor LLMs, synthesizes pseudo evaluation results to broaden coverage, learns compact sample representations, and selects a small yet representative subset. Building on it, we create ZipBench Zoo, a collection of compact versions of 100+ benchmark proxies spanning text, multimodal, and agent tasks. These benchmark achieve mean absolute errors of 0.002--0.02 and average Spearman correlations of ~0.98 with the full benchmarks. Overall, ZipBench reduces the cost of both LLM evaluation and compact benchmark construction, lowering the barrier to broad LLM research for compute-constrained researchers. The code has been released in this https URL.
31. 【2609.12471】AMDKernelVault: Large-Scale Datasets and Agentic Training for AMD GPU Kernel Optimization
链接：https://arxiv.org/abs/2609.12471
作者：Ji Liu,Saptarshi Majumder,Yiqing Huang,Wenwen Ouyang,Umang Pandey,Zeping Li,Chushi Chen,Zihao An,Puyuan Yang,Zekai Li,Sina Rafati,Ziqiong Liu,Pratik Prabhanjan Brahma,Dong Li,Zicheng Liu,Sharon Zhou,Emad Barsoum
类目：Computation and Language (cs.CL)
关键词：AMD CDNA GPUs, recent AMD CDNA, CDNA GPUs, AMD CDNA, Triton kernel corpus
备注： N pages, 3 figures, including appendix. First four authors contributed equally. Code: [this https URL](https://github.com/AMD-AGI/hip_kernel_llm_lab) Data: [this https URL](https://huggingface.co/datasets/amd/AIG-Datasets)
点击查看摘要
Abstract:We introduce AMDKernelVault, an open HIP and Triton kernel corpus and training framework for recent AMD CDNA GPUs. Existing LLM-based kernel agents are largely CUDA/NVIDIA-centric and often depend on repeated frontier-LLM calls for generation, reflection, and optimization. To address this gap, we develop HIPKernelGen and TritonKernelGen, agent-driven pipelines that transform PyTorch references into HIP or Triton kernels, compile and validate candidates under ROCm, and latency-profile them on AMD hardware. The corpus contains 62,153 execution-verified HIP kernel samples, 2,377 production-grounded ROCm Libraries QA entries, and 39,893 Triton kernels. We further train Qwen3-8B with supervised fine-tuning and execution-aware reinforcement learning as a demonstration of the corpus's utility. Under fixed evaluation budgets, it achieves the highest correctness among the compared models on PyTorch-to-HIP (34.0% Pass@1), TritonBench-G (33.2% Corr@3), and ROCmBench (41.94% Corr@3), but does not uniformly lead compilation or speed metrics. The corpus and documentation are available at this https URL, and the associated training and kernel-generation code is available at this https URL.
32. 【2609.12469】Not All Speech Is Intent: Adaptive Self-Correcting Inference Layer for Post-ASR False Wake-Up
链接：https://arxiv.org/abs/2609.12469
作者：Preeti Saraswat,Divya Neelagiri,Anil Yadav
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：False wake-up activations, wake-up activations remain, False wake-up, activations remain, remain a persistent
备注：
点击查看摘要
Abstract:False wake-up activations remain a persistent challenge in conversational AI. Speech phonetically similar to a device's wake word can produce a syntactically valid and semantically coherent ASR transcript that the assistant incorrectly executes. Most existing systems make a single intent decision in isolation, without a mechanism to learn from recurring errors over time or adapt to individual users through personalized learning. We introduce the Feedback-Driven Adaptive Self-Correcting Inference Layer (ASCIL), a complementary post-ASR correction framework that re-evaluates wake-up intent before response generation by fusing acoustic embeddings, linguistic cues, device context, and patterns from past misclassifications. ASCIL interprets implicit signals, including hesitation, disengagement, and silence, and explicit signals, including cancellation and repetition, as automatically inferred, noisy behavioral indicators of potential misclassification. These signals drive online pattern updates without manual annotation, whereas the intentional/unintentional reference labels used for offline evaluation are human-annotated. It generalizes from prior errors, applies corrective adjustments at inference time, and continuously updates in parallel with natural-language execution. Evaluated on a proprietary dataset of 3,667 interactions with human-annotated intentional/unintentional reference labels spanning 14 acoustic and contextual conditions, ASCIL achieves 54.27% relative error reduction on a session-disjoint subset constructed from baseline failures, and up to 24.39% relative error reduction at threshold 0.90 on the issue-tagged evaluation slice. These gains are achieved while improving intentional acceptance rates, with a median added latency below 60 ms in the reported benchmark.
33. 【2609.12448】GraphProfiler: Source-Linked Sensitive Attribute Inference via Personal Knowledge Graphs
链接：https://arxiv.org/abs/2609.12448
作者：Ahmed Sohair Khan,Estrid He,Chenglong Ma,Monica Wachowicz,Elham Naghizade
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：aggregating indirect cues, Sensitive attributes, inferred from user-generated, user-generated content, content by aggregating
备注： Accepted at EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Sensitive attributes such as age, income, and occupation can be inferred from user-generated content by aggregating indirect cues across many ordinary posts. LLM-based profilers can perform this aggregation automatically and with high accuracy, which makes large-scale personal attribute inference a major privacy threat. Existing LLM-based profilers, however, offer limited insight into which specific posts, concepts, and relationships made an inference possible, which is key to targeted privacy mitigation, i.e., redacting or rewriting only the few posts that actually leak an attribute, rather than perturbing entire histories. We introduce GraphProfiler, an auditable LLM-based profiler that represents each user's post history as a source-linked personal knowledge graph where nodes and edges trace back to the originating post and resolves attribute predictions to cited graph records and source texts. GraphProfiler reaches 86.7% attack success rate on the eight-attribute SynthPAI benchmark, within two points of strong text-only baselines, and 84.6% on PANDORA, while citing supporting evidence for over 98% of predictions. Our controlled ablation experiments provide evidence that the cited posts contribute to attack success, as removing them reduces the attack success rate substantially more than removing an equal number of random posts.
34. 【2609.12446】Do LLMs Trust the Accuser or the Accusation? Measuring Belief Shifts in Werewolf
链接：https://arxiv.org/abs/2609.12446
作者：Yu-Yu Yang,Ti-Rong Wu,Hung Guei,Hsing-Yu Chen,I-Chen Wu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Social-deduction games, final game outcomes, Social-deduction, rely on final, evaluate LLM agents
备注： Accepted by the 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026 Main Conference)
点击查看摘要
Abstract:Social-deduction games such as Werewolf are increasingly used to evaluate LLM agents, but existing evaluations often rely on final game outcomes. We propose a belief-shift evaluation benchmark in Werewolf for analyzing communication skills through belief updating. Using LLM-played games, we annotate suspicion and accusation messages and measure how an observing village-side model's beliefs change after each message. We evaluate 40 open-weight LLM configurations on 1,224 annotated messages. Our results show that larger models better distinguish true wolves from villagers based on game history, but accusations still strongly influence their beliefs. Models become more suspicious of the accused target and less suspicious of the accuser, especially when the accuser is trusted, even if the accuser is wolf-aligned. Larger models better resist accusations from accusers they already distrust. Overall, our findings suggest that current open-weight LLMs up to 120B parameters still struggle to integrate accusation content with source trust in strategic communication. Our benchmark and code are available at this https URL.
35. 【2609.12403】Beyond ID Embeddings: Process-Grounded Language Modeling for Cognitive Diagnosis
链接：https://arxiv.org/abs/2609.12403
作者：Minghang Liu,Yuanzhuo Wang,Qiang Qiu,Huawei Shen,Xueqi Cheng
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：personalized online learning, play a pivotal, pivotal role, role in personalized, personalized online
备注： Accepted to EMNLP 2026. 20 pages, including references and appendices
点击查看摘要
Abstract:Cognitive Diagnosis Models (CDMs) play a pivotal role in personalized online learning. Traditional CDMs rely on discrete, ID-based embeddings to represent students, exercises, and concepts. This paradigm diverges from the nature of learner cognition, where knowledge is not stored and retrieved as isolated symbols. As a result, CDMs suffer from semantic limitations when new exercises or concepts appear. In this paper, we propose a Process-aware Language Cognitive Diagnosis (PLCD) framework that uses language-derived structures as cognitive priors and response records to calibrate student posterior states. PLCD leverages large language models (LLMs) to construct concept schemas and cognitive process graphs, and uses target-conditioned semantic memory to retrieve historical responses that are relevant to each target exercise. A process-grounded Language-to-Cognition Mapper with DA-MoE experts and process-level contrastive learning then maps the textual evidence into a unified cognitive space. Experimental results show that PLCD not only outperforms traditional baselines in predicting student performance but also exhibits strong cognitive transfer capabilities. These results connect the computational power of LLMs with the psychometric goal of measuring latent knowledge states, suggesting that structured language priors calibrated by response records can improve cold-start robustness and cognitive grounding.
36. 【2609.12382】Representation-based Masked Diffusion Model
链接：https://arxiv.org/abs/2609.12382
作者：Yangrong Hu,Ding Huang,Xueyu Zhou,Jian Huang
类目：Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：Masked Diffusion Model, Masked Diffusion, Masked Diffusion Models, Representation-based Masked Diffusion, language modeling
备注： 22 pages, 2 figures, and 10 tables
点击查看摘要
Abstract:Masked Diffusion Models (MDMs) have emerged as a compelling paradigm for language modeling, offering the capability for efficient parallel text generation. However, existing parallel sampling methods typically update multiple masked tokens independently and ignore the complex mutual dependencies among the masked tokens. This independent updating mechanism lacks global coordination and might lead to incoherent outputs. To address this limitation, we propose Representation-based Masked Diffusion Model (RMDM), a framework that leverages the text representation to explicitly encode global semantics and help to parallel update tokens more precisely. Specifically, we first encode text into a continuous semantic space using a pretrained encoder and learn an invertible transformation that normalizes the representation distribution to a Gaussian prior, facilitating efficient sampling during generation. Conditioned on this latent semantic representation, we train a masked diffusion model to learn the conditional text distribution, where the representation serves as global semantic guidance to coordinate parallel token updates and faithfully approximate the target distribution. Empirical results demonstrate that RMDM significantly improves generation quality, particularly in aggressive few-step sampling regimes.
37. 【2609.12366】ORQA: An Occupation-Realistic Question and Answer Framework for LLM Professional Knowledge
链接：https://arxiv.org/abs/2609.12366
作者：Shreyas Krishnan,Serina Chang,Abhishek Nagaraj
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, present ORQA, large language, testing occupation-level knowledge, occupations
备注： 45 pages, 17 figures, 6 tables. Data, code, and an interactive dashboard at [this http URL](http://orqabench.org)
点击查看摘要
Abstract:We present ORQA, a method for testing occupation-level knowledge in large language models. Prior methods either map abstract LLM skills to occupations via task definitions or utilize expert knowledge which is difficult to obtain at scale and expensive. ORQA complements both of these methods by connecting O*NET occupations to trusted occupation-specific websites (such as regulatory agencies, licensing bodies, professional organizations, and government publications) and converting these into source-traceable question-answer pairs. A combination of an automated pipeline and human review produces a set of high quality questions about occupations. The question set created via our method covers 116 occupations from all 21 major groups in the SOC, with 480 questions sourced from 187 different websites. Each question is designed to probe a real-world skill question that is relevant to the occupation in question. We test 15 state-of-the-art frontier and open-weight models via this method. Claude Opus 4.6, GPT-5.4 and Claude Sonnet 4.6 all perform the best at approximately 58-62% while smaller open-weight models achieve approximately 33-41% performance. Performance varies significantly across occupations. Healthcare-related occupations achieve the highest performance (78%) while Office and Administrative Support achieve approximately 40%. Performance on individual occupations (e.g. Sheet Metal Workers and Fish and Game Wardens) is essentially zero. We also find that open-ended questions and weighting by wage bill do not significantly affect the ranking of models on this benchmark. We believe that leveraging existing trusted occupation-specific information to test LLM knowledge in professional domains may be a scalable and useful method for evaluating occupation-level AI performance in the future. Results and data are available at this http URL.
38. 【2609.12354】CueMem: Cue-Guided Context Reconstruction for Long-Term Conversational Memory
链接：https://arxiv.org/abs/2609.12354
作者：Changjian Wang,Rongzhen Li,Weili Guan,Shuming Shi,Quan Lu,Ning Jiang
类目：Computation and Language (cs.CL)
关键词：extended dialogue histories, answer user queries, compressed memory units, user queries, queries by recalling
备注：
点击查看摘要
Abstract:Long-term conversational agents must answer user queries by recalling information from extended dialogue histories, yet directly using the full history is costly and often unreliable, while compressed memory units may lose fine-grained evidence needed for question answering. Motivated by the reconstructive view of autobiographical memory, we propose CueMem, a cue-guided framework that treats extracted memory records as retrieval cues rather than self-contained evidence and reconstructs query-relevant dialogue context from their source turns. During memory construction, CueMem extracts fine-grained memory cues from dialogue turns and links each cue to its source turn. At query time, it retrieves query-relevant cues, maps them to source-turn anchors, and expands from these anchors over a turn graph that captures temporal proximity and semantic relatedness, reconstructing a compact evidence context from the original dialogue for LLM answer generation. Experiments on LoCoMo and LongMemEval show that CueMem consistently outperforms representative long-term memory baselines. Further analyses show that graph-based context reconstruction helps recover supporting dialogue evidence while reducing query-time input tokens and latency compared with the full-history LLM setting. These results highlight retrieval cues as an effective alternative to self-contained memory evidence for long-term conversational question answering.
39. 【2609.12353】SynthSentry: Detecting Synthetic Data Contamination in Language Model Training Data
链接：https://arxiv.org/abs/2609.12353
作者：Praveen Kumar Myakala,Ravichandra Namburi,Sowmya Keragodu Jayaramu,Sooraj George Thomas
类目：Computation and Language (cs.CL)
关键词：Large language models, models' outputs undergo, Large language, language models trained, outputs undergo model
备注： 11 pages, 3 Figures, 2026 IEEE Asia Conference on Innovation in Emerging Technology
点击查看摘要
Abstract:Large language models trained recursively on their own or other models' outputs undergo model collapse, in which distributional tails and factual accuracy deteriorate while fluency survives. Prior work diagnoses collapse after training; the actionable problem is screening a corpus of unknown provenance before training. We introduce SynthSentry, a corpus-level, model-agnostic contamination signal requiring no access to the generating model, no generation history, and no synthetic labels. The score is a distributional divergence over three statistics: lexical diversity collapse, n-gram tail truncation, and perplexity variance across reference models. We evaluate on corpora contaminated by small open-weight generators and an instruction-tuned open-weight model under a leave-one-generator-out protocol. A domain-stratified study measures false positives on naturally repetitive human text (legal, clinical, source code). The score ranks corpora by severity with little loss when whole generator families are held out. Per-domain calibration holds near its nominal false-positive budget once covariance shrinkage and a bootstrap threshold replace a naive quantile, which runs four times over budget. A downstream fine-tuning check showed no contamination-driven accuracy deficit at our scale, so whether pruning recovers one remains open; the same run shows over-pruning risk once pruning exceeds the true contamination fraction. We frame screening as a data-curation defense rather than a post-hoc diagnosis and release the scoring toolkit. All results are small-scale; scope is English-language, batch-mode corpus screening. Contamination sources are single-generation or hand-authored rather than recursively generated, so results speak to synthetic contamination generally and not to recursion depth.
40. 【2609.12341】I Am No One: Style-Aware Paraphrasing for Text Anonymization
链接：https://arxiv.org/abs/2609.12341
作者：Ahmed Sohair Khan,Estrid He,Monica Wachowicz,Elham Naghizade
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：growing privacy risk, stable stylistic fingerprints, exploiting stable stylistic, seemingly anonymized text, identifiers are removed
备注： Accepted at Interspeech 2026
点击查看摘要
Abstract:Authorship attribution models can re-identify users from seemingly anonymized text by exploiting stable stylistic fingerprints, even after explicit identifiers are removed, posing a growing privacy risk for text publishing and analytics. This risk extends to speech-derived text such as ASR transcripts of meetings and call-center conversations, where stylometric leakage can persist even after acoustic anonymization. Differential privacy-based anonymization often severely degrades text quality and utility. We propose a style-aware, prompt-driven anonymization approach that uses pretrained large language models to construct compact stylistic profiles from minimal samples and rewrite text to suppress identifiable style markers while preserving meaning. Across blog and review datasets, our approach reduces authorship attribution F1 by 60-70% while maintaining content quality and readability, substantially outperforming DP-based and non-DP baselines.
41. 【2609.12310】ESTS at WMT26: Routing-Informed Expert Pruning for Model Compression
链接：https://arxiv.org/abs/2609.12310
作者：Liu O. Martin,Lucas Bandarkar,Nanyun Peng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Model Compression Shared, Compression Shared Task, Egyptian Arabic, Simplified Chinese, Shared Task
备注： To appear in the Proceedings of the Eleventh Conference on Machine Translation (WMT 2026)
点击查看摘要
Abstract:We describe six submissions under the team name ESTS to the unconstrained WMT26 Model Compression Shared Task for English--Simplified Chinese and English--Egyptian Arabic. We submit three compression operating points per translation direction, all derived from GPT-OSS-20B. We use task-specific routing mass to rank experts and cross-lingual routing divergence to allocate retained capacity across layers, then physically remove low-importance experts. The resulting specialists are recovery-tuned on GPT-5.1-generated synthetic translation data and further compressed by applying MXFP4 quantization to the retained expert projection weights. We additionally implement a robust inference system for the instruction-conditioned WMT26 setting, including category inference, output validation, retries, segmented fallback, and source-owned JSON reconstruction. Across our six submissions, parameter counts range from 4.186B to 7.770B and packed artifact sizes from 4.55 to 6.33~GiB. Internal xCOMET-XL evaluation using GPT-5.1 pseudo-references provides an internal comparison across the submitted compression operating points.
42. 【2609.12303】Breaking the Token Ceiling: Distilling Smaller, Stronger Byte Models
链接：https://arxiv.org/abs/2609.12303
作者：Kalyani Marathe,Artidoro Pagnoni,Tomasz Limisiewicz,Margaret Li,Mike Lewis,Luke Zettlemoyer,Srinivasan Iyer
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：models, made more capable, tokenization scheme, byte, Bytes
备注：
点击查看摘要
Abstract:Small models are made more capable through distillation from a larger one that shares their tokenization scheme. However, do distilled byte and token models behave similarly in terms of scaling trends as compute and data increases? To enable this comparison, we introduce two variants to efficiently convert token logits to Byte Logits: 1) approximate: Marginalize-It, and 2) exact: End-Of-Token. We then present the first large scale study of overtraining decoder-only dense transformer models varying two dimensions simultaneously: the tokenization scheme (Tokens, Bytes, Bytes w/ eot) and the training objective (Distillation vs. Cross-Entropy), sweeping layer-parameter-matched models with roughly 1 billion parameters up to 1 trillion bytes of data. Across eight benchmarks spanning three categories: Multiple Choice QA, Language Generation, and Machine Translation, we find that Token-1B models outperform byte models (End-Of-Token-1B and Bytes-1B) in the low-FLOP regime but eventually plateau; byte models start worse yet surpass Token-1B models with more compute, reaching a higher downstream task performance ceiling. Extrapolating the average top-1 error vs. validation BPB scaling laws predicts that, asymptotically, distilled End-Of-Token-1B outperforms distilled Token-1B by up to 4%. They are also far more data efficient, matching the performance of distilled Token-1B using only one-sixth of the training data. Moreover, by operating over a small vocabulary of 256 bytes instead of on the order of 100K tokens, they circumvent the need for top-k truncation during logit dumping, while also reducing logit storage costs to roughly one-fifth. Finally, our downstream performance scaling laws predict that our distilled End-Of-Token-1B models asymptotically surpass the Llama 3.2-1B, Gemma-3-1B-pt, and Gemma 2B models on averaged downstream tasks by up to 6.5%, 8.1%, and 2.1%, respectively.
43. 【2609.12268】EAR: Entity-Aware Partitioning Approach for Retrieval-Augmented Generation Development
链接：https://arxiv.org/abs/2609.12268
作者：Cenab Batu Bora,Oylum Alatlı,Sebnem Bora,Oguz Dikenelli
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation, improve knowledge-intensive question, knowledge-intensive question answering, easy to overlook, improve knowledge-intensive
备注： 6 pages. Accepted and presented at the 2026 Innovations in Intelligent Systems and Applications Conference (ASYU 2026). To appear in the conference proceedings and IEEE Xplore
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) can improve knowledge-intensive question answering, but the first design choice is easy to overlook: how should the source corpus be partitioned into retrievable units? Fixed-size chunks often return long passages whose relation to the question is only implicit. We introduce EAR, an Entity-Aware Partitioning approach for multiple-choice question answering (MCQA). EAR extracts normalized surface anchors from the question, answer options, and corpus; retrieves local windows around matching corpus anchors; and can attach a larger parent passage through an extractive summary. We evaluate EAR on a cleaned Massive Multitask Language Understanding (MMLU)-style subset of 153 questions selected by an automatic corpus-support heuristic and using decontaminated public textbook text. Across same-protocol top-k = 3 and top-k = 8 sweeps with Mistral, Gemma, and DeepSeek, EAR entity-window reduces retrieved words by 37.5-40.2% relative to chunks. Observed accuracy changes are +5.2, +1.3, and -3.9 points at top-k = 3, and +5.9, -3.3, and -4.6 points at top-k = 8; none of the entity-window differences is statistically significant. The scoped contribution is methodological: EAR provides a compact and inspectable retrieval unit, while its rule-based anchor extractor remains domain-specific and requires separate validation before transfer.
44. 【2609.12260】HypoKG: Evidence-Disciplined Biomedical Hypothesis Generation Beyond Endpoint Knowledge
链接：https://arxiv.org/abs/2609.12260
作者：Dominic Okonkwo,Adetayo Okunoye,Ismailcem Budak Arpinar
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Quantitative Methods (q-bio.QM)
关键词：Large language models, Large language, simply produce convincing-sounding, Genes and Genomes, Kyoto Encyclopedia
备注：
点击查看摘要
Abstract:Large language models (LLMs) can generate biomedical hypotheses, but it remains unclear whether they truly reason from scientific evidence or simply produce convincing-sounding ideas. To study this, we combine three major biological databases: the Kyoto Encyclopedia of Genes and Genomes (KEGG), Rhea, and UniProt, into a unified biochemical knowledge graph and construct a benchmark of 550 paths connecting enzyme sources to rare disease endpoints, yielding 13,200 hypotheses from six LLMs under four conditions varying the biological information each model receives: source enzyme only, full biological path, or source and disease endpoint only. Hypotheses are scored using an expert-derived five-criterion rubric on a 1-5 scale per criterion. We find that models given both the source and disease endpoint often produce the highest-scoring hypotheses, showing that LLMs can generate compelling ideas from minimal information. However, these hypotheses are less grounded in the evidence. In contrast, models given the full biological path generate hypotheses more consistent with known mechanistic relationships. We call this evidence-disciplined reasoning. To confirm this effect, we shuffled intermediate path steps while keeping endpoints fixed. Evidence grounding dropped significantly (delta = -0.793, p 0.001), confirming models genuinely used path structure during reasoning. Our findings show that knowledge graphs support hypothesis generation in two ways: they identify biological endpoint pairs absent from the literature, and their mechanistic paths guide how LLMs reason between them.
45. 【2609.12254】Automated Detection and Structuring of Social Tipping Point Evidence in Climate related Documents: A Modular AI Framework
链接：https://arxiv.org/abs/2609.12254
作者：Kavindu Perera,Mohammad Abaeiani,Ekaterina Gilman,Lauri Loven,Mourad Oussalah,Tassos Kanellos,Beatrice Gobbo,Dante Adami,Nicolò Ferriani,Maximiliano Romero,Pierre Rossel,Marc Bonazountas,Christina Deligianni,Nikos Xyderis,Artur Bogucki,Lampros Argyriou,Prasasthy Balasubramanian
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：social tipping point, climate literature, literature has grown, grown faster, faster than review
备注：
点击查看摘要
Abstract:The climate literature has grown faster than review teams can read it. That gap matters most for a concept like the environmental social tipping point, the threshold at which a small change triggers rapid, self-reinforcing change in a social system. Evidence of this kind of shift is usually contained in one or two paragraphs within a longer document. As a result, existing text mining tools-which categorize entire documents by topic or highlight isolated claims-leave an expanding set of important evidence without any systematic method for discovery or organization. This paper presents an open and modular transformer-based framework that detects and structures social tipping point evidence at the passage level. The framework joins five components into a single deployable workflow: a DistilBERT boundary splitter for segmentation, an iteratively augmented RoBERTa classifier for detection, a Mistral 7B model that rewrites each detected passage for clarity, a LLaMA 3.2 3B model that rates the passage against five published social tipping point criteria, and a Milvus vector store for semantic retrieval. The system is wrapped in a Streamlit interface backed by MinIO object storage. Evaluated on a 163-passage benchmark labelled by GPT-4.1 and a 51-passage set reviewed by experts, the splitter surpassed three competing methods on a nine-metric composite score (6.137). The tuned RoBERTa model achieved 71.4 percent accuracy with a Cohen's kappa of 0.337 on the full benchmark, and 87.5 percent accuracy with a kappa of 0.742 on passages with labels, outperforming both a climate-focused model and untuned language models.
46. 【2609.12243】Chopthin-Consensus Power Sampling: A Diversity-Preserving Approach to LLM Decoding
链接：https://arxiv.org/abs/2609.12243
作者：Minoo Ahmadi,Seyedarmin Azizi,Erfan Baghaei Potraghloo,Mehdi Kamal,Massoud Pedram
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)
关键词：Sequential Monte Carlo, Inference-time power sampling, Monte Carlo, Sequential Monte, substantially improve large
备注： Accepted at the COLM 2026 Workshop on Efficient Reasoning
点击查看摘要
Abstract:Inference-time power sampling via Sequential Monte Carlo (SMC) can substantially improve large language model (LLM) reasoning without requiring post-training. However, many existing SMC approaches rely on equal-weight resampling, which can aggressively prune low-weight trajectories, discarding potentially correct reasoning paths and degrading the genealogical diversity of the search space. To address this, we introduce Chopthin-Consensus Power Sampling (CCPS). Our method applies the Chopthin resampler to LLM decoding: rather than equalizing weights and forcing unnecessary particle duplication, it enforces an upper bound on the ratio between the largest and smallest weights and carries the unequal weights forward. This targeted intervention preserves a richer set of distinct reasoning paths, keeps the weighted SMC approximation unchanged in conditional expectation, and guarantees a lower bound on the post-resampling effective sample size (ESS). To fully exploit this enriched population, we employ a semantic-majority selection mechanism that merges token-identical final trajectories, clusters semantically equivalent answers, and returns the answer supported by the largest number of distinct trajectories. Evaluating across three open-weight models and five reasoning benchmarks, we show that Chopthin increases oracle coverage in 13 of 15 settings. Combined with semantic-majority selection, CCPS matches or exceeds the final-answer accuracy of the Power-SMC baseline in 14 of 15 settings, delivering absolute gains of up to 10.6 percentage points. These findings demonstrate that diversity-preserving resampling and diversity-aware selection are complementary mechanisms for training-free LLM reasoning. Code is available at this http URL.
47. 【2609.12230】Repair Before Reinforce: Context-Augmented Knowledge Graph Reasoning for Multi-Hop Question Answering
链接：https://arxiv.org/abs/2609.12230
作者：Tharaka D. Fonseka,Niraj K. Jha
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：single isolated relation, multiple connected facts, multiple connected, retrieving a single, isolated relation
备注：
点击查看摘要
Abstract:Question-answering often requires reasoning across multiple connected facts rather than retrieving a single isolated relation. Knowledge graphs (KGs) provide a structured way to represent such facts, but training large language models (LLMs) only on isolated KG head-relation-tail triples may limit their ability to learn the surrounding context needed for multi-hop reasoning. In this work, we propose a context-augmented training framework for multi-hop question-answering. Although generally applicable, we validate the framework in the context of disease-specific KGs, extracted using a reliable KG extraction framework called GraphMERT, for Gastroparesis and Diabetes. For each primary KG triple, we attach supporting triples extracted from the same source text chunk to form a context graph (CG). This creates two supervision settings: KG-grounded supervision, which uses only the target KG triple or path, and CG-grounded supervision, which uses the target KG triple or path together with supporting context triples. We train the Qwen3-14B model using supervised fine-tuning (SFT) under both settings, producing KGModel and CGModel variants. To strengthen the lower-hop factual foundation of the models, we introduce an LLM-judged, history-aware adaptive repair pipeline that identifies unresolved one-hop failures, continually fine-tunes on targeted repair examples, and removes or quarantines problematic noisy triples. This repair stage enables the models to reach 100% accuracy on the cleaned retained one-hop validation sets. Finally, we employ reinforcement learning (RL) using lower-hop question-answer items and evaluate generalization on harder 3-hop, 4-hop, and 5-hop tasks. Across both diseases, context-augmented supervision consistently improves multi-hop performance over KG-only supervision. RL initialized from repaired SFT checkpoints yields larger and more stable gains.
48. 【2609.12191】GAUGE: When Not to Trust LLM-as-a-Judge in User-Simulated Evaluation of Task-Oriented Agents
链接：https://arxiv.org/abs/2609.12191
作者：Umesh Bodhwani,Thanh Tran,Kai Wei
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：persona-driven LLM user-simulators, selecting task-oriented LLM, LLM user-simulators converse, task-oriented LLM agents, LLM agents increasingly
备注： Accepted to EMNLP 2026 (Industry Track)
点击查看摘要
Abstract:Comparing and selecting task-oriented LLM agents increasingly relies on a low-cost offline evaluation gate: persona-driven LLM user-simulators converse with each candidate, an LLM-as-a-judge scores the transcripts, and the higher-scoring agent is promoted. We introduce GAUGE, a reusable offline protocol that measures whether this gate's ranking matches a grounded verifiable reward across 25 agents from six providers on the $\tau^2$-bench and SimulatorArena benchmarks, separating two kinds of evaluation validity that release practices conflate: ranking validity and construct validity. First, a satisfaction-success gap: satisfaction carries essentially no information about task success, as conversations rated satisfied by our blind panel are decorrelated from actual success, with 57.5% of them failing the customer's task, a pattern consistent across five rater populations, both benchmarks, and every subjective dimension we rated. Second, while the gate's ranking is robust across the broad capability span, it loses resolution among the near-equal strong agents: this decision-disagreement rate jumps from $$1% on wide-reward pairs to 31% on close pairs. The gate is thus human-validated yet mis-anchored. As a remedy, we propose a calibrate-then-trust cadence in which a judge-free completion bit is a zero-cost tripwire for truncation regressions.
49. 【2609.12162】Can LLMs in Draft-Verify-Revise Pipelines Resolve Deictic Ambiguity?
链接：https://arxiv.org/abs/2609.12162
作者：Obinna I. Ekekezie
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：common LLM orchestration, LLM orchestration pattern, scaling inference-time compute, stage LLM, LLM
备注： 86 pages including supplementary materials, 4 figures, 10 supplementary figures, 17 supplementary tables, 11 supplementary exemplars. Code and data: [this https URL](https://github.com/oekekezie/deictic-ambiguity-companion)
点击查看摘要
Abstract:Draft-verify-revise is a common LLM orchestration pattern for scaling inference-time compute. One LLM drafts, a second critiques the draft and provides feedback, and a third uses that feedback to revise the draft into the final output. As context cascades between stages, LLMs at different stages can resolve a context-dependent expression such as "previous" differently. When that happens, the expression undergoes a deictic shift, a change in what it refers to. This phenomenon was studied with a synthetic dataset of 10 base examples, each rendered in three conditions. Holding the shared components constant, the conditions varied whether the draft stage LLM (the assistant) or the verify stage LLM (the grader) resolved the expression correctly, and how much independent reasoning the revise stage LLM (the meta-evaluator) needed to determine which reading was correct. Six models from three providers were tested across 21 reasoning effort configurations using e-values for sequential testing, in a primary experiment and an ablation experiment that removed error classification labels from the grader's feedback. A separate LLM analyzed the meta-evaluator's stated rationale for each wrong verdict. Balanced accuracy (the unweighted mean of sensitivity and specificity) ranged from 0.156, below chance, to near-perfect. GPT-5.2 rose from 0.156 without reasoning to 0.942 at its highest reasoning effort level, while Gemini 3 Pro stayed above 0.94 at every level. Gemini 3 Pro at low reasoning effort outscored GPT-5.2 at xhigh reasoning effort for roughly 5% of the cost per trial. When the meta-evaluator erred, it tended to rely on surface cues rather than operational reasoning. Context engineers implementing draft-verify-revise pipelines should be wary of deictic shifts and make the intended referent explicit at each stage.
50. 【2609.12132】Population-level measures of perceived food access reveal barriers beyond geographic proximity
链接：https://arxiv.org/abs/2609.12132
作者：Teresa Groton,Benjamin rachunok
类目：Computation and Language (cs.CL)
关键词：Google Maps reviews, Food access, North Carolina, Google Maps, Food
备注：
点击查看摘要
Abstract:Food access is multidimensional, but population-level measurement still relies heavily on geography because perceived dimensions of access are difficult to measure at scale. Here, we use 25,125 Google Maps reviews from 49 grocery stores in Raleigh, North Carolina, to measure five dimensions of food access: availability, accessibility, affordability, accommodation, and acceptability. We identify review topics with unsupervised topic modeling and assign them to access dimensions using zero-shot classification, with 85.4% agreement against manual coding. The resulting store-level measures capture distinct aspects of food access and reveal barriers that geographic proximity alone does not capture. Comparisons between nearby stores in the same chain further show that identical store policies can be perceived very differently across locations, consistent with food access reflecting the fit between residents and their food environment. Perceived food access also follows systematic socioeconomic and demographic patterns that broadly parallel, but do not replicate, those observed for geographic access. These results show that online grocery reviews can provide a scalable complement to geographic measures of food access.
51. 【2609.12127】Local Edits, Global Ripples: Replay-Informed Policy Adaptation for Workflow Synthesis
链接：https://arxiv.org/abs/2609.12127
作者：Manqing Mao,Hong Wang,Samson Koelle,Jie Yuan,Zhuoer Wang,James Feng,Yanjun Lin,Daniel Edmiston,Nikki Lijing Kuang,Zhecheng Sheng,Wei Niu
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Prompt-policy editing offers, Prompt-policy editing, underlying model, offers a practical, agents that synthesize
备注： 33 pages, 20 tables, 6 figures
点击查看摘要
Abstract:Prompt-policy editing offers a practical way to improve agents that synthesize executable workflows without updating the underlying model. However, persistent prompt editing has two coupled properties. First, edit locality does not imply effect locality: an edit confined to one policy segment can ripple through downstream execution, altering behavior beyond the edited segment. Second, edit effects are composition-sensitive: edits that work in isolation can interfere after composition, causing one or both to lose their benefit or become harmful. Persistent adaptation must therefore support two distinct decisions: identifying where the policy should change from execution feedback, and determining whether the resulting edit remains safe to persist after composition. To address these challenges, we introduce RIPPLE (Replay-Informed Persistent Policy Localization and Editing), which separates where an edit is made from whether it remains safe after composition. It diagnoses failed trajectories, maps each actionable failure to a predefined policy segment, and restricts the correction to that part of the policy. RIPPLE then evaluates candidates against the same iteration-start policy to compare their isolated gains, before replaying promising edits after previously accepted updates to expose downstream effects and interactions. Only edits that remain safe under composition are retained. We evaluate RIPPLE on Flow-HO, a synthetic held-out benchmark for executable workflow synthesis. RIPPLE improves validation success by up to 23.1% and yields positive gains on two additional frozen language-model backbones, while maintaining edit efficiency and low execution cost. Targeted interaction analysis further demonstrates both properties: a segment-local tool-use edit changes downstream resource resolution and validation, while an edit beneficial in isolation becomes harmful after composition.
Comments:
33 pages, 20 tables, 6 figures
Subjects:
Computation and Language (cs.CL); Software Engineering (cs.SE)
Cite as:
arXiv:2609.12127 [cs.CL]
(or
arXiv:2609.12127v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.12127
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
52. 【2609.12122】Quantifying Consonant Contributions to Word Intelligibility via Acoustic Masking
链接：https://arxiv.org/abs/2609.12122
作者：Eunjung Yeo,Kwanghee Choi,Krupaben Kothadia,Visar Berisha,Julie M. Liss,David R. Mortensen,David Harwath
类目：Computation and Language (cs.CL)
关键词：Consonants contribute unequally, contribute unequally, consonant contribution, contribution, consonant
备注： 7 pages, 5 figures, Accepted to SLT 2026
点击查看摘要
Abstract:Consonants contribute unequally to whether a word is understood. Given the limited time available for therapy, ranking consonants by contribution to intelligibility helps prioritize intervention targets in motor speech disorders. However, measuring this contribution relies on perceptual studies that are difficult to scale. This paper presents a scalable method that measures consonant contribution using acoustic masking. We silence one consonant at a time in an isolated word and test whether an automatic speech recognition (ASR) model still recognizes the word. We define a consonant's contribution score as the proportion of its masked instances for which the word becomes misrecognized, which we refer to as the mask-induced misrecognition rate (MMR). We validate MMR against two linguistic factors previously reported to correlate with consonant contribution, namely phoneme frequency and functional load. We apply this analysis across four languages, English, Spanish, German, and Czech, using three ASR architectures, MMS (encoder-only), Whisper (encoder-decoder), and Qwen3-ASR (LLM-based). Using partial Spearman correlations, we find that phoneme frequency correlates negatively with MMR while functional load correlates positively. In other words, more frequent consonants are less disruptive when masked, whereas consonants carrying more lexical contrast are more disruptive. Further cross-language analysis shows that consonant rankings are not consistent, indicating that consonant contribution is language-dependent.
53. 【2609.12111】he Cost of Compression: A Rate-Distortion Limit on Factual Hallucination
链接：https://arxiv.org/abs/2609.12111
作者：Xi Wang,Shijia Xu,Rongfeng Guo
类目：Computation and Language (cs.CL)
关键词：closed-book question answering, closed-book question, question answering, frac, coverage problem
备注：
点击查看摘要
Abstract:Factual hallucination in closed-book question answering is often treated as a coverage problem: a model fails because the relevant fact is absent from its internal memory. This view misses a second source of error. Even when a fact has been observed, finite memory may force it to be stored only approximately. We study this effect through a simple coverage--compression model of factual recall. We consider an unstructured question-answering task with $N$ possible queries and $K$ possible answers. A learner observes $M$ training facts, compresses them into at most $B$ bits, and answers uniformly drawn test queries without retrieval. For a uniformly random ground-truth mapping, we prove $\mathcal{E} \geq \frac{M}{N}\delta^\star\!\left(\frac{B}{M}\right) + \left(1-\frac{M}{N}\right)\left(1-\frac{1}{K}\right)$, where $\delta^\star(r)$ is the inverse rate-distortion function of a uniform $K$-ary source under zero-one loss. The two terms separate compression distortion on observed facts from missing coverage on unobserved facts. The bound gives a compact way to reason about selective memory, forced compression, structure, retrieval, abstention, and long-context organization. We study the predicted signatures with theory-implied simulations and controlled fact-injection probes in modern language models that vary fact load and effective trainable memory. The result is not a complete theory of hallucination, but an information-theoretic account of a separable failure mode: lossy recall of observed facts under finite memory.
54. 【2609.12107】Extracting Dataset Mentions in Forced Displacement and FCV Documents: A Weakly Supervised Framework with LLM-Based Label Refinement
链接：https://arxiv.org/abs/2609.12107
作者：Rafael Macalaba,Aivin V. Solatorio,Patrick Michael Brock,Olivier Dupriez
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Econometrics (econ.EM)
关键词：referenced remains difficult, humanitarian organizations produce, administrative registries, support surveys, remains difficult
备注： 22 pages, 1 figure
点击查看摘要
Abstract:Development and humanitarian organizations produce and support surveys, administrative registries, and other data resources to inform research, policy, and operations, yet systematically identifying where these datasets are referenced remains difficult. Such references are dispersed across research papers, project documents, humanitarian reports, and other unstructured text, limiting both the ability to trace data use and to identify potential gaps in data availability or dissemination. We present a weakly supervised framework for adapting dataset extraction to forced displacement and Fragile, Conflict, and Violence (FCV) documents without first constructing a large manually labeled training corpus. A lightweight model trained on general research literature generates candidate dataset mentions from unlabeled domain documents, which a frontier large language model (LLM) reviews in context, validating or rejecting candidates and correcting their extraction boundaries. The resulting annotations are supplemented with targeted synthetic and contrastive examples and used to fine-tune the lightweight model for large-scale extraction. We evaluate the resulting model on an independent gold-standard benchmark of 1,706 text passages spanning research, humanitarian, and operational documents. Across the full benchmark, the model achieves 74.1\% precision and 70.5\% recall at the mention level; among passages containing dataset references, precision reaches 89.5\%. At the passage level, the model achieves 88.2\% accuracy and 88.6\% specificity in distinguishing passages with dataset references from those without them. These results demonstrate a practical approach for constructing domain-specific supervision when labeled data are limited, and provide a technical foundation for larger-scale analysis of data use and potential gaps in the displacement data landscape.
55. 【2609.12086】Creating an Atomic User Model for Personality-Aware Large Language Model Interaction
链接：https://arxiv.org/abs/2609.12086
作者：B. Sankar,Deepthika S,Pawni Yadav,Amogh A S
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, approach is single-channel, built on large, large language, expected to write
备注： 59 pages, 22 figures, 24 tables
点击查看摘要
Abstract:Assistants built on large language models are expected to write as their user would, and the dominant approach is single-channel: preferences summarised from conversation history and reinserted into context. This inverts the order of inference. Preferences are the task-dependent surface of a comparatively stable personality structure, so a system storing only preferences relearns the person whenever the task changes. First, we characterise personality seepage, where a prompt's linguistic surface carries a personality fingerprint the assistant mirrors without access to the personality behind it. Second, we propose the Atomic User Model (AUM), a human-readable representation organising a person as a stable identity nucleus with four interpretable shells (psychological, cognitive and experiential, behavioural, and social), plus cross-shell entries recording internal conflict and authenticity. Third, we treat AUM as a retrieval index over a person rather than a prompt prefix, with a pipeline where a task classifier, component-selection function and budgeted retriever return a small payload of fields at generation time. Fourth, we evaluate it with sixteen language-model-simulated participants, six style-sensitive tasks and three seeds, plus a synthetic scaling study of the retriever. Retrieving eight fields matched the style fidelity of the full user model on 23% of the context (211 tokens against 915), improved on flat preference notes by 0.24 points on a five-point scale (p 0.001, dz = 0.50), and raised forced-choice identification of the participant's own voice from 14.9% to 42.7% (25% chance). Four pre-registered controls returned null, locating the effect in the representation rather than the search over it. The benefit is largest for participants the un-personalised assistant reproduces worst (rho = -0.61, p = 0.013): personalisation is worth most to those the default serves least.
56. 【2609.12085】What Counts as a Mistake? Annotating Recitation Events in Quran Memorization Transcripts
链接：https://arxiv.org/abs/2609.12085
作者：Mohamad Al Mdfaa,Nursultan Askarbekuly,Ahmed Helaly,Ubai Sandouk,Manuel Mazzara
类目：Computation and Language (cs.CL)
关键词：Checking Quran recitation, ASR transcript requires, accepted spelling differences, Checking Quran, transcript requires distinguishing
备注：
点击查看摘要
Abstract:Checking Quran recitation from an ASR transcript requires distinguishing unresolved mistakes from repetitions, repairs, opening formulas and accepted spelling differences. We report a completed human annotation of 100 production recording cases: 348 scored units and 162 localized events across ten combined labels. An executable evaluator scores labels and word positions together. A plain diff reaches label-aware F1 0.525 and localization F1 0.826; adapted production cleaner/alignment components reach 0.518 and 0.786, with exact-span F1 0.505 for both. Correcting the adapter's word coordinates recovers all five annotated repetition events, showing why annotation interfaces must be checked before interpreting baseline failures. In a preliminary pilot, eight single 20-minute runs across three coding agents and eight models span label-aware F1 0.143 to 0.892: seven land far above every baseline, and one collapses below the naive diff from a missing normalization step. Across the six, 970 of 972 gold-event instances draw an overlapping prediction, so what remains is not detection but convention: span extent, and the labels whose boundary is stipulated by adjudication rather than visible in the text. Seven of 162 events defeat all six same-day runs, five of them one orthographic rule, and the strongest run still misses the same ones. No run annotated before building, so the pilot measures the algorithm half of the task only.
57. 【2609.11999】Is Bash All You Need? An Empirical Study of Tool Interfaces for Enterprise Digital Worker Agents
链接：https://arxiv.org/abs/2609.11999
作者：Hazel Mak,Susheel Suresh,Sahil Bhatnagar,Barry Wang,Chhaya Methani,Alejandro Gutierrez Munoz
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：general shell, typed tools, outperform specialized tools, bash, typed
备注： 13 pages, 7 figures, 12 tables
点击查看摘要
Abstract:In this study, we examine whether a general shell can outperform specialized tools on enterprise tasks. Shell-based agents have shown strong results in coding, but enterprise work also involves moving between applications and services, coordinating with coworkers, and performing professional analysis. We compare five tool interfaces on TheAgentCompany and APEX-Agents using Opus-4.8 and GPT-5.5: typed tools, typed tools plus bash, bash alone, bash with persistent agent-synthesized tools, and programmatic tool calling (PTC), which runs programs whose actions are restricted to a typed tool catalog. Bash alone outperforms typed tools on both benchmarks, improving score by 21.8-24.5 pp on TheAgentCompany and 4.8-7.4 pp on APEX-Agents while using 19-72% fewer total tokens. Adding typed tools or persistent tool synthesis to bash produces no detectable pooled score gain. PTC uses fewer tokens than direct typed calls with broadly similar task performance, but generally underperforms bash alone in both quality and cost efficiency. For enterprise practitioners, these results favor bash alone when arbitrary execution can be isolated and PTC when security or compliance policies require a fixed tool catalog.
58. 【2609.11987】Harness or Model? Isolating the Harness Effect in Agentic Coding with a Contamination-Controlled Private Suite
链接：https://arxiv.org/abs/2609.11987
作者：Mohsen Arjmandi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：autonomous software engineer, agentic coding system, coding system couples, prompts and control, software engineer
备注： 25 pages, 5 figures. Revised 8 September 2026 (telemetry correction). Code and derived data in the replication package
点击查看摘要
Abstract:An agentic coding system couples a language model to a harness: the tools, prompts and control flow that turn a chat model into an autonomous software engineer. Vendors ship harnesses tuned to their own models, and practitioners assume the vendor-native pairing solves more tasks. We measure that assumption with paired same-model contrasts on a private, contamination-controlled suite of 256 repository and post-cutoff contest tasks. The same 80 tasks ran under claude-agent-sdk and under deepagents on claude-opus-4-8, and under the openai-codex SDK and deepagents on gpt-5.5, with gemini-3.5-flash and deepseek-v3.2 as side cells. 792 of 800 planned runs were graded by an isolated oracle. Neither contrast resolves an average advantage for either harness: -1.25 pp for Opus 4.8 (48.8% vs 50.0%, task-bootstrap 95% CI [-10.0, +7.5]) and +1.25 pp for GPT-5.5 (55.6% vs 54.4%, CI [-4.4, +6.9]). The Opus average combines opposite strata: the native harness trails by 9.0 pp on the 61 repository tasks and leads by 23.7 pp on the 19 contest tasks (label-permutation p = 0.003). The partition was chosen after seeing the data and needs a designed replication. Correctness and completion also separate: 22 of 81 runs cancelled at the wall-clock ceiling had produced a passing patch. Re-priced from raw per-turn usage at frozen list prices, the neutral harness cost 1.3 to 1.6 times as much per solved task on Opus 4.8 and 1.2 times on GPT-5.5. These are observed-usage estimates. On the Anthropic account 58 runs left no usage record, and allocating that spend to either cell would move the Opus ratio between 0.7 and 2.3, so the billed ordering is unresolved. This revision corrects an August 2026 manuscript whose cost figures rested on a usage-semantics defect in our own telemetry (Section 5.1). We release the orchestrator, grading oracle, reanalysis code and derived aggregates. The tasks stay private.
59. 【2609.11970】Cortex: Content Analysis Support Software, a Resource for Qualitative Research
链接：https://arxiv.org/abs/2609.11970
作者：Ana Julia da Silva Soares,Rafael Coimbra Pinto
类目：Digital Libraries (cs.DL); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：social sciences, meanings and contexts, qualitative data analysis, human and social, deep understanding
备注： 27 pages, 3 figures
点击查看摘要
Abstract:Qualitative research is widely used in the human and social sciences, characterized by a deep understanding of phenomena through the interpretation of meanings and contexts. Among qualitative data analysis methods, content analysis stands out as a consolidated technique, which allows for the systematic description and interpretation of textual contents. However, as data volume increases, the time required for organization, reading, and categorization becomes a significant challenge, potentially delaying research development. Therefore, this work aimed to develop a web application to support content analysis, based on Bardin's methodology, targeted at academic researchers. The methodology adopted a mixed approach, combining bibliographic research on content analysis with semi-structured interviews with four experienced researchers, aiming to identify real needs and requirements. Based on these inputs, the Cortex software was developed to assist the researcher in the pre-analysis and material exploration stages, generating suggestions for indices, indicators, and categories with full traceability to original documents. The results demonstrate that Cortex is capable of guiding the researcher through the entire methodological workflow, from corpus configuration to results exportation, acting as a methodological collaborator without replacing the researcher's interpretative autonomy.
60. 【2609.11959】Space as an Interventional Invariant: Cross-Modal Predictive Geometry for Stratified Cities and Em-Spaced Intelligence
链接：https://arxiv.org/abs/2609.11959
作者：Tao Yang,Xuhui Lin,Kunyao Li,Haijiang Li
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：shared geometric container, treat spatial structure, concept across mathematics, foundational concept, fields often treat
备注：
点击查看摘要
Abstract:Space is a foundational concept across mathematics, physics, spatial cognition, urban science, and embodied intelligence, yet these fields often treat spatial structure either as a shared geometric container or as a collection of disconnected representations. Such approaches struggle to explain how heterogeneous sensory and urban processes can jointly reveal a common spatial structure, particularly when different modalities do not share the same metric or representation. This paper addresses this gap by defining space as an interventional invariant: the minimal relational structure that preserves local compatibility and the conditional laws of future observations under admissible actions. We develop a cross-modal predictive geometry that integrates local state spaces, modality-specific observation maps, an action groupoid, and a canonical predictive-state quotient, with explicit causal conditions for identifying interventional rather than merely observational structure. The key theoretical result shows that, under joint point separation, equivariance, and interventional faithfulness, the latent space is identifiable up to the centraliser of the intervention group, thereby reducing representational ambiguity to residual coordinate freedom. The framework is further extended to stratified urban systems using sheaf-valued representations, allowing geometric, physical, mobility, social, and economic layers to coexist without being reduced to a single metric. Synthetic experiments under noise evaluate equivariance, predictive sufficiency, holonomy, restriction-map recovery, cross-scale consistency, and context saturation. The resulting framework provides a unified and falsifiable foundation for spatial cognition, urban science, embodied AI, and em-spaced intelligence.
61. 【2609.11955】R2VC: Modular Fact-Checking with Retrieval, Verification, and Confidence Calibration
链接：https://arxiv.org/abs/2609.11955
作者：Dhruv Dixit,Paritosh Pandey
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, making failures difficult, automated fact checking, difficult to trust
备注： 21 pages, 15 figures
点击查看摘要
Abstract:Large language models are increasingly used for automated fact checking, but end-to-end prompting often entangles evidence retrieval, reasoning, and uncertainty estimation, making failures difficult to diagnose and confidence difficult to trust. We present R2VC, a modular retrieve, reason, verify, calibrate architecture for evidence-grounded fact checking with citations and abstention. R2VC combines hybrid sparse+dense retrieval over Wikipedia, a supervised fine-tuned and DPO-aligned generator that produces diverse structured verdict candidates, an external NLI cross-encoder for evidence-based candidate selection, and a lightweight sequence-level calibrator for confidence estimation and selective abstention. On FEVER, an 8B backbone with R2VC achieves 13.74% higher accuracy than baseline. Ablation studies show that verifier-based candidate selection and confidence calibration are the largest contributors to performance. Removing candidate selection drops FEVER accuracy to 76.24%, while removing calibration nearly doubles the Brier score to 0.161. A manual analysis of 250 errors further shows that retrieval failures, especially wrong-entity evidence, remain the dominant bottleneck. Together, these results show that modular fact-checking pipelines can substantially improve both predictive accuracy and confidence reliability in open-domain verification.
62. 【2609.11559】PRISMA-LLM: An Empirical Reporting Framework for AI-Assisted Systematic Reviews
链接：https://arxiv.org/abs/2609.11559
作者：Miguel Zabaleta,Baihan Lin
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, AI-enabled software increasingly, software increasingly participate, language models
备注：
点击查看摘要
Abstract:Large language models (LLMs) and AI-enabled software increasingly participate in systematic-review decisions, yet the information needed to audit these workflows is reported inconsistently. We analyze SciLitBench, a corpus of 888 review-automation papers with 14,726 annotations, to characterize changes in methods, review-stage use, evaluation and reported limitations. Automation has shifted toward LLM- and software-facing workflows, including stages that can alter the evidence base. Since 2023, 38.0% of software/product papers reported no evaluation, compared with 9.3% of LLM papers. Reporting coverage increased with LLM workflow complexity, yet 52% of positive-only LLM evaluations still reported an unmet reliability or performance requirement. From these patterns, we introduce PRISMA-LLM, an empirically grounded framework separating implementation disclosure from consequence-sensitive evaluation and limitation reporting.
63. 【2609.13076】MP-Bench: Evaluating Voice Agents as a Multiparty Conversation Participant
链接：https://arxiv.org/abs/2609.13076
作者：Yi-Jen Shih,Shih-Yun Shan Kuan,Guan-Ting Lin,Kai-Wei Chang,Siddhant Arora,Shu-wen Yang,Abdelrahman Mohamed,Shinji Watanabe,Hung-yi Lee,David Harwath
类目：Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：offering increasingly natural, increasingly natural human-machine, natural human-machine interactions, advanced significantly, offering increasingly
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:Conversational voice agents have advanced significantly, offering increasingly natural human-machine interactions through both cascaded and end-to-end architectures. However, while recent benchmarks extensively evaluate dyadic interactions and passive audio comprehension, they largely overlook a prevalent real-world scenario: multi-party conversations. Evaluating agents in these settings is fundamentally more challenging than in dyadic interactions due to the exponentially greater conversational complexity. For voice agents to integrate seamlessly into human group dynamics, they must not only generate contextually appropriate responses but also demonstrate a nuanced understanding of open turn-taking. To address this gap, we introduce Multiparty Bench (MP-Bench), the first benchmark specifically designed to objectively evaluate conversational speech systems as active participants within multi-party contexts. MP-Bench assesses agent behavior along two primary dimensions: turn-taking awareness and response appropriateness. Additionally, we incorporate comprehension-based question-answering tasks as a complementary evaluation. By benchmarking 12 voice agents, we find that real-time voice agents stay at or below 22% on multiparty comprehension and remain near chance on multiparty turn-taking, exposing an open challenge for real-time voice agents under multiparty scenario.
64. 【2609.12444】Diverse Minds, Divided Networks? Personality Composition, Polarization, and Collective Intelligence in LLM-Based Social Simulations
链接：https://arxiv.org/abs/2609.12444
作者：Raad Bin Tareaf
类目：Physics and Society (physics.soc-ph); Computation and Language (cs.CL)
关键词：study collective intelligence, study online polarization, large language model, language model agents, collective intelligence
备注：
点击查看摘要
Abstract:Simulated societies of large language model agents are used to study online polarization, and separately to study collective intelligence, but the two are rarely measured in the same system. It is therefore difficult to say whether a society's personality composition shapes both, or whether reducing polarization costs collective competence. We present TraitMix, an experimental design in which the Big Five composition of a simulated social network, both trait levels and trait heterogeneity, is a controlled experimental variable, and in which polarization and collective performance are measured in the same runs. Across 991 simulations of hundred-agent societies, spanning six contested topics and six language models, trait heterogeneity has the largest measured effects, acting in opposite directions on two faces of polarization: varied societies hold more dispersed opinions while being less segregated into camps, so homogeneous societies are not moderate but consensual echo chambers. Trait effects are not additive, as Agreeableness determines the sign of Openness, an interaction that replicates across models although the primary model's estimate is influence-driven. Contrary to the trade-off the study was designed to measure, no polarization measure predicts poorer collective performance, and cross-cutting interaction is the only one of four whose association with collective accuracy survives partialling on the aggregation identity. We report ablations removing two potential measurement circularities, an induction gate applied to every model, and the measures that failed them.
信息检索
1. 【2609.13073】Autonomous Research for Open-Ended Problems: A Case Study on Telecom Ticket Retrieval
链接：https://arxiv.org/abs/2609.13073
作者：Junghyun Min,Huseyin Uzunalioglu,Mohamed Trabelsi
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Science paradigm, Recent breakthroughs, potentially replacing human, replacing human roles, autonomous research
备注： 10 pages, 3 tables
点击查看摘要
Abstract:Recent breakthroughs in LLM-based systems and their abilities in problem solving and coding have allowed progress in the AI for Science paradigm, potentially replacing human roles in machine learning (ML) research. However, while several frameworks of fully autonomous end-to-end ML research have been proposed, successful implementations of them are often limited to problems with narrow search spaces, like language modeling or biomedical ML benchmarks. In this paper, we explore how autonomous research can be adapted to solve open-ended, industry-grade ML problems, by considering a case study: telecom ticket retrieval, an open-ended task with degrees of freedom in representation, architecture, and training data generation. We discover that autonomous research for open-ended problems with commercial and open-source agents shows both promise and limitations: while autonomous research can excel in narrow hyperparameter optimization, it lacks human-like intuition and creativity and requires operational overhead. Even with minimal human supervision, autonomous research can reach $90\%$ of state-of-the-art performance (0.34 vs. 0.38 Recall@1) in a much shorter time period (10 weeks vs. 10 months of human work) at a modest cost (up to \$200 per Cursor campaign). Our empirical evidence recommends that human researchers and autonomous research frameworks work together for best results in ML research.
2. 【2609.12842】MIMA: Multi-Interest Recommendation via Multi-Positive Exclusive Assignment
链接：https://arxiv.org/abs/2609.12842
作者：Xingyuan Mao,Alin Fan,Shichao Nie,Junfeng Zhang,Yan Xiao,Tao Luo,Xiaoyi Zeng
类目：Information Retrieval (cs.IR)
关键词：fine-grained candidate matching, multiple interest vectors, learned interests converge, Multi-interest recommendation represents, similar representations
备注：
点击查看摘要
Abstract:Multi-interest recommendation represents each user with multiple interest vectors for fine-grained candidate matching, yet it often suffers from interest collapse, where the learned interests converge to similar representations. We highlight the prevailing single-positive paradigm as one important factor behind this issue. Since each instance provides only one positive item, intents are optimized independently, potentially causing the same best-matching interest to be repeatedly updated toward different positives while leaving the others under-supervised. Moreover, existing methods rarely model how strongly a user activates each interest, leaving scores from different interest channels incomparable at inference. To address these problems, we propose MIMA, a Multi-Interest recommendation framework built on Multi-positive exclusive Assignment. MIMA groups items co-occurring within the same request into a positive set, generates complementary interests with a causal Transformer decoder, and exclusively assigns each positive to supervise a distinct interest via Hungarian matching, so that interest differentiation emerges from the training objective itself rather than auxiliary regularization. A lightweight routing module further estimates user-interest activation probabilities to calibrate scores across interest channels. Experiments on three public datasets and an industrial dataset show that MIMA consistently outperforms state-of-the-art baselines, and an online A/B test yields significant business gains.
3. 【2609.12791】Cognition on Graph: Navigating Massive Knowledge Space via Cognitive Cycles and Bidirectional Graph-Text Synergy
链接：https://arxiv.org/abs/2609.12791
作者：Gengxian Zhou,Jian Xu,Zichen Tang,Shiming Xiang,Haihong E,Cheng-Lin Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large Language Models, empowered Large Language, Language Models, Large Language, tackle knowledge-intensive tasks
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) has empowered Large Language Models (LLMs) to tackle knowledge-intensive tasks. However, navigating global, heterogeneous knowledge bases (large-scale knowledge graphs and text corpora) for complex reasoning remains a challenge. Existing methods typically employ reactive, graph-driven exploration strategies, which blindly follow graph topology without adapting to the question context or evolving exploration progress, and lack deep bidirectional synergy between graph and text. To address these limitations, we propose CoG (Cognition on Graph), a cognitive-inspired, training-free framework for adaptive knowledge exploration. Drawing inspiration from human problem-solving, CoG performs a continuous plan-explore-reflect cycle, where it proactively formulates investigation plans, performs dual-source retrieval, and dynamically reflects on progress to adjust strategies. Crucially, it establishes deep bidirectional synergy between structured graph and unstructured text, where entities extracted from text dynamically guide graph exploration to bridge knowledge gaps. Extensive experiments on seven multi-hop QA benchmarks demonstrate that CoG significantly outperforms state-of-the-art methods while achieving superior exploration efficiency. Our code and datasets are available at this https URL.
4. 【2609.12766】A Historical Corpus Is Not a Historical System: Auditing Hindsight Leakage in Stateful Data Discovery
链接：https://arxiv.org/abs/2609.12766
作者：Yixi Zhou,Fan Zhang,Sikun Wang,Yingfan Xu,Haipeng Zhang
类目：Information Retrieval (cs.IR)
关键词：Offline replay, Temporal Violation Rate, interaction memory unconstrained, corpus leaves interaction, leaves interaction memory
备注： 12 pages, including figures and tables
点击查看摘要
Abstract:Offline replay should estimate what a discovery system could retrieve at a historical point, yet freezing the corpus leaves interaction memory unconstrained. We formalize point-in-time (PIT) discovery through historical state $(D_t, \theta_t, M_{ i})$ and introduce a paired replay that changes only memory availability. The protocol constructs PIT and full-stream Future views from behavior-only traces and audits selected entries with a Temporal Violation Rate. Across three table-text domains, two stream regimes, two retrievers, and five seeds (216,000 rows), Future inflated Asset Recall@100 by 2.62-5.24 points; all 12 paired intervals excluded zero. With behavior-only trace memory, PIT underperformed the no-memory Stateless condition; Future masked 32.7-48.4% of that harm. For a simulated positive-feedback cache, PIT added 4.65-18.96 points over Stateless while Future added another 4.11-9.58 points. On five timestamped FreshStack topics, Future exceeded PIT by 2.72 points [1.75, 3.71]. Historical evaluation must version and validate memory with the corpus.
5. 【2609.12754】Learning the Lake: Reliable Experience for Adaptive Data Product Discovery
链接：https://arxiv.org/abs/2609.12754
作者：Yixi Zhou,Fan Zhang,Sikun Wang,Yingfan Xu,Haipeng Zhang
类目：Information Retrieval (cs.IR)
关键词：Data-product discovery searches, workloads revisit related, Data-product discovery, revisit related products, workloads revisit
备注： 11 pages, including figures and tables
点击查看摘要
Abstract:Data-product discovery searches a full lake even when workloads revisit related products and regions. Repetition permits contracted search, but similarity cannot justify a route because one omitted asset invalidates a conjunctive product. We study when serving experience can safely reduce this work. Evolving Discovery Memory records source-labelled query--product--region evidence above a fixed regional index. SafeLake separates operational familiarity, which determines how much to search, from independently calibrated product evidence, which determines where to search. The fixed-probe comparison holds the adaptive budget constant between SafeLake and Familiarity-only. On TAT-QA, product steering raises Product Recall by 0.072; ConvFinQA shows no resolved map gain, while the HybridQA sensitivity favors Familiarity-only in Full R@100. Trace-only, missing, and false feedback expose boundaries on map steering, while scope-audit agreement cannot certify the source. Across clean confirmed-feedback streams under the frozen transductive protocol, the formal controller saves 49.5--82.7% of cumulative asset exposure. Experience determines when to contract; reliable evidence determines where to contract.
6. 【2609.12679】Personalized and Trust-Aware Health Recommendation Policies for a Construction Workplace
链接：https://arxiv.org/abs/2609.12679
作者：Atefeh Mollabagher,Yogesh Gautam,Houtan Jebelli,Parinaz Naghizadeh
类目：Information Retrieval (cs.IR); Systems and Control (eess.SY)
关键词：physically demanding conditions, heat stress, face workplace risks, physically demanding, demanding conditions
备注：
点击查看摘要
Abstract:Construction workers face workplace risks such as fatigue, heat stress, and other physically demanding conditions that can negatively affect their health and safety. Although monitoring these risks is important, timely and personalized health interventions are also needed to help prevent negative impacts on workers' well-being and productivity. To this end, in this paper, we propose a model to capture the interactions between a trust-aware health recommender system and workers who differ in health and trust sensitivity. Specifically, in our proposed dynamic model, worker health evolves over time, worker trust is affected by both health and recommendation dynamics, and trust in turn affects compliance with future recommendations. Given this model, we characterize the recommender policy, including a health-based recommendation triggering threshold and the recommendation frequency. We do so using both model-based short-horizon control and model-free reinforcement learning. We then investigate how recommendation frequencies are adjusted for different workers to balance their health, productivity, and trust. Our findings provide insight into the design of personalized health recommendation policies in construction workplaces and beyond.
7. 【2609.12556】Preference-Drift-Aware Subsequence Learning and Hierarchical Context Fusion for Long-Sequence Generative Recommendation
链接：https://arxiv.org/abs/2609.12556
作者：Fei Li,Qingyun Gao,Jianzhe Zhao,Guibing Guo,Beibei Kong,Lei Cheng,Chengxiang Zhuo,Zang Li
类目：Information Retrieval (cs.IR)
关键词：methods autoregressively model, recommendation methods autoregressively, Long-sequence generative recommendation, autoregressively model, generate the next-item
备注：
点击查看摘要
Abstract:Long-sequence generative recommendation methods autoregressively model the user's interaction sequence to generate the next-item representation. Existing methods generally fall into two categories: efficient full-sequence modeling and target-aware context retrieval. Our experiments reveal that as the sequence length increases, the former incurs steadily growing computational cost while its accuracy gains quickly saturate and even degrade due to noise; the latter, though shortening the input sequence, is susceptible to noise that is semantically consistent yet preference-inconsistent, as well as to incomplete contexts. Both paradigms ignore the dynamic changes of user preferences and the cross-subsequence dependencies when handling historical information, thereby limiting accuracy and efficiency. To address these issues, we propose a preference-drift-aware subsequence learning and hierarchical context fusion for long-sequence generative recommendation. Specifically, we learn differentiable soft subsequence boundaries using multidimensional preference-drift information and aggregate items within each subsequence into preference-coherent representations via linear attention with soft assignment weights, thereby circumventing the expense of full-sequence attention. A cross-attention mechanism is then employed to capture dependencies between recent interactions and relevant subsequence contexts, mitigating noise in learning recent-item representations. Finally, a gated fusion mechanism adaptively combines the recent-item representation with the global subsequence context, allowing the resulting target representation to encode both recent and long-term preferences. Extensive experiments demonstrate that our method consistently outperforms existing baselines in both recommendation accuracy and computational efficiency.
8. 【2609.12399】OneLA: Scaling Linear-Attention Decoding to Large Beams in Generative Recommendation
链接：https://arxiv.org/abs/2609.12399
作者：Xiangrui Yang,Cheng Peng,Yunfeng Zhao,Liang Zeng,Ao Hu,Jiawei Yang,Shengzhe Wang,Jingshan Lv,Xiao Liang,Chen Yang,Jiaqiang Liu,Yiming Qiu
类目：Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR)
关键词：Generative recommendation, recurrent linear attention, relies on large-beam, candidate items, linear attention
备注：
点击查看摘要
Abstract:Generative recommendation (GR) relies on large-beam decoding to generate hundreds of candidate items, creating a new scaling challenge for recurrent linear attention. Existing linear attention serving systems either materialize a full recurrent state for every beam or repeatedly replay shared history, incurring substantial memory and traffic overhead. To address this, we present OneLA, a linear-attention decoding framework that exploits the shared prompt and short divergent suffixes of GR workloads. Specifically, OneLA represents all beam states using a single shared prompt-derived state and compact, append-only records of their divergent transitions. Using this representation, OneLA computes only the state information required at each decoding step, without reconstructing a full recurrent state for every beam. Furthermore, OneLA uses a lightweight ancestry index to track the transition records that make up each beam's history, allowing beams to be updated without moving or copying existing records. A fused GPU kernel further reuses the shared state across beams. Our analysis shows that OneLA achieves 1.54-2.46x end-to-end decode speedups while substantially reducing recurrent-state memory use and data movement.
9. 【2609.12375】ChronicleRec: Pre-training Temporally Anchored Tokens for Lifelong User Modeling
链接：https://arxiv.org/abs/2609.12375
作者：Chengkai Huang,Yubin Sheng,Liang Guo,Haoxi Liu,Junwei Pan,Shangyu Zhang,Zhixiang Feng,Chao Zhou,Chengguo Yin,Lina Yao,Haijie Gu,Jie Jiang
类目：Information Retrieval (cs.IR)
关键词：directly feeding thousands, truncation discards long-range, computationally prohibitive, crucial for industrial, industrial recommendation
备注：
点击查看摘要
Abstract:Modeling ultra-long user behavior sequences is crucial for industrial recommendation and online advertising, yet directly feeding thousands of historical actions into ranking models is computationally prohibitive, while truncation discards long-range signals. Existing lifelong-interest methods retrieve target-relevant behaviors for each candidate, coupling long-sequence modeling with candidate scoring and repeated online cost. Recent target-independent compression methods enable cached user summaries, but often append query tokens at the sequence end and use bidirectional encoding, producing unordered and redundant summaries that overlook temporal structure. We propose ChronicleRec, a pre-train-and-transfer framework that compresses an ultra-long behavior sequence once into a chronologically ordered set of Chronicle Tokens. ChronicleRec applies a recency-aware multi-granularity merge, preserving recent behaviors while coarsening distant history. It then interleaves query tokens with the merged sequence and uses a causal encoder, so each query summarizes only the history before its temporal anchor. A multi-horizon design masks different recent-history windows across parallel branches to learn complementary long-range interests. The compressor is pre-trained with a mask-and-predict objective that reconstructs held-out recent behaviors from compressed older history, aligning historical signals with near-present intent. Since Chronicle Tokens are target-independent, they can be cached per user, decoupling ultra-long sequence modeling from online candidate scoring. Experiments on KuaiRand and Tencent AdLive show that ChronicleRec outperforms recent-window and single-pass compression baselines while approaching full-attention performance. Token analyses reveal temporally organized and complementary representations, and a seven-day online A/B test confirms significant production gains.
10. 【2609.12270】Recommendation Retrievers Need Verifiers: Universal Generative Reranking for Sequential Recommendations
链接：https://arxiv.org/abs/2609.12270
作者：Benyu Zhang,Qiang Zhang,Rui Li,Qunshu Zhang,Devansh Tandon,Neeraj Bhatia
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：multi-stage systems produce, downstream rankers, recommenders in multi-stage, multi-stage systems, systems produce
备注：
点击查看摘要
Abstract:First-stage recommenders in multi-stage systems produce a ranked candidate list from which a limited prefix is forwarded to downstream rankers. Because each forwarded item must be processed by more expensive ranking stages, this shortlist cannot be arbitrarily large. The first-stage objective is therefore high coverage of relevant items within the forwarded prefix, commonly measured by Recall@$k$. A relevant item may be available deeper in the retrieved list but absent from the shorter prefix that is actually consumed. This paper studies post-hoc verification for promoting such candidates into the consumed shortlist without retraining or replacing the retriever. We introduce a lightweight generative verifier for retrieval models. Given a retriever state and a candidate item, the verifier scores the item through the likelihood of its identifier tokens. It is trained post hoc with next-token cross entropy, requires no sampled negatives or candidate pool during training, and scores only the retriever's top-$K$ candidates at inference. The interface is minimal: the retriever supplies a query state and candidate items, and the item representation can use any fixed tokenization. Across Amazon product recommendation and YaMBDa music recommendation, the same verifier training recipe improves Recall@10 for SASRec, GRU4Rec, NextItNet, and MiniOneRec. Ablations show that the improvements are not explained solely by injecting item-content features into the retriever, supporting verification as a post-hoc output-side adaptation mechanism.
Subjects:
Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.12270 [cs.IR]
(or
arXiv:2609.12270v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.12270
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
11. 【2609.12268】EAR: Entity-Aware Partitioning Approach for Retrieval-Augmented Generation Development
链接：https://arxiv.org/abs/2609.12268
作者：Cenab Batu Bora,Oylum Alatlı,Sebnem Bora,Oguz Dikenelli
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation, improve knowledge-intensive question, knowledge-intensive question answering, easy to overlook, improve knowledge-intensive
备注： 6 pages. Accepted and presented at the 2026 Innovations in Intelligent Systems and Applications Conference (ASYU 2026). To appear in the conference proceedings and IEEE Xplore
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) can improve knowledge-intensive question answering, but the first design choice is easy to overlook: how should the source corpus be partitioned into retrievable units? Fixed-size chunks often return long passages whose relation to the question is only implicit. We introduce EAR, an Entity-Aware Partitioning approach for multiple-choice question answering (MCQA). EAR extracts normalized surface anchors from the question, answer options, and corpus; retrieves local windows around matching corpus anchors; and can attach a larger parent passage through an extractive summary. We evaluate EAR on a cleaned Massive Multitask Language Understanding (MMLU)-style subset of 153 questions selected by an automatic corpus-support heuristic and using decontaminated public textbook text. Across same-protocol top-k = 3 and top-k = 8 sweeps with Mistral, Gemma, and DeepSeek, EAR entity-window reduces retrieved words by 37.5-40.2% relative to chunks. Observed accuracy changes are +5.2, +1.3, and -3.9 points at top-k = 3, and +5.9, -3.3, and -4.6 points at top-k = 8; none of the entity-window differences is statistically significant. The scoped contribution is methodological: EAR provides a compact and inspectable retrieval unit, while its rule-based anchor extractor remains domain-specific and requires separate validation before transfer.
12. 【2609.12107】Extracting Dataset Mentions in Forced Displacement and FCV Documents: A Weakly Supervised Framework with LLM-Based Label Refinement
链接：https://arxiv.org/abs/2609.12107
作者：Rafael Macalaba,Aivin V. Solatorio,Patrick Michael Brock,Olivier Dupriez
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Econometrics (econ.EM)
关键词：referenced remains difficult, humanitarian organizations produce, administrative registries, support surveys, remains difficult
备注： 22 pages, 1 figure
点击查看摘要
Abstract:Development and humanitarian organizations produce and support surveys, administrative registries, and other data resources to inform research, policy, and operations, yet systematically identifying where these datasets are referenced remains difficult. Such references are dispersed across research papers, project documents, humanitarian reports, and other unstructured text, limiting both the ability to trace data use and to identify potential gaps in data availability or dissemination. We present a weakly supervised framework for adapting dataset extraction to forced displacement and Fragile, Conflict, and Violence (FCV) documents without first constructing a large manually labeled training corpus. A lightweight model trained on general research literature generates candidate dataset mentions from unlabeled domain documents, which a frontier large language model (LLM) reviews in context, validating or rejecting candidates and correcting their extraction boundaries. The resulting annotations are supplemented with targeted synthetic and contrastive examples and used to fine-tune the lightweight model for large-scale extraction. We evaluate the resulting model on an independent gold-standard benchmark of 1,706 text passages spanning research, humanitarian, and operational documents. Across the full benchmark, the model achieves 74.1\% precision and 70.5\% recall at the mention level; among passages containing dataset references, precision reaches 89.5\%. At the passage level, the model achieves 88.2\% accuracy and 88.6\% specificity in distinguishing passages with dataset references from those without them. These results demonstrate a practical approach for constructing domain-specific supervision when labeled data are limited, and provide a technical foundation for larger-scale analysis of data use and potential gaps in the displacement data landscape.
13. 【2609.11970】Cortex: Content Analysis Support Software, a Resource for Qualitative Research
链接：https://arxiv.org/abs/2609.11970
作者：Ana Julia da Silva Soares,Rafael Coimbra Pinto
类目：Digital Libraries (cs.DL); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：social sciences, meanings and contexts, qualitative data analysis, human and social, deep understanding
备注： 27 pages, 3 figures
点击查看摘要
Abstract:Qualitative research is widely used in the human and social sciences, characterized by a deep understanding of phenomena through the interpretation of meanings and contexts. Among qualitative data analysis methods, content analysis stands out as a consolidated technique, which allows for the systematic description and interpretation of textual contents. However, as data volume increases, the time required for organization, reading, and categorization becomes a significant challenge, potentially delaying research development. Therefore, this work aimed to develop a web application to support content analysis, based on Bardin's methodology, targeted at academic researchers. The methodology adopted a mixed approach, combining bibliographic research on content analysis with semi-structured interviews with four experienced researchers, aiming to identify real needs and requirements. Based on these inputs, the Cortex software was developed to assist the researcher in the pre-analysis and material exploration stages, generating suggestions for indices, indicators, and categories with full traceability to original documents. The results demonstrate that Cortex is capable of guiding the researcher through the entire methodological workflow, from corpus configuration to results exportation, acting as a methodological collaborator without replacing the researcher's interpretative autonomy.
14. 【2609.11953】InitGen: Candidate Generation for Interaction Initiation in Intelligent Assistants
链接：https://arxiv.org/abs/2609.11953
作者：Ruize Shi,Jinhua Chen,Hong Huang,Ziniu Chen,Ruike Zhang,Jianxun Shi,Yitao Chen,Rui Zhang
类目：Information Retrieval (cs.IR)
关键词：presenting multiple candidate, OPPO Xiaobu Assistant, current session, Interaction initiation refers, refers to presenting
备注：
点击查看摘要
Abstract:Interaction initiation refers to presenting multiple candidate queries when a user opens an intelligent assistant before expressing any intent for the current session. In production, candidate generation incorporates dynamic context and produces all candidates within a strict latency budget. Learning from user feedback is also difficult since the generator usually produces more candidates than are finally displayed. After downstream filtering and ranking, only a subset is exposed to users, so the observed feedback is partial and cannot be reliably assigned to individual queries. We present InitGen, a framework for candidate generation that is deployed in the interaction initiation pipeline of OPPO's Xiaobu Assistant. InitGen generates a set of candidate queries jointly and aligns the generated set with user feedback through weighted preference optimization. The sample weights are derived from user activity and downstream ranking scores. The activity weight reduces the dominance of highly active users during training, while the ranking score is used as a practical estimate of the reliability of the observed feedback. InitGen also uses a rolling window update strategy to incorporate recent interaction data into periodic model updates. In an online A/B test against a strong production baseline, InitGen improves the click-through rate from 0.95% to 1.61%, corresponding to a relative improvement of 69.1%, and increases query exposure by 17.9% under the same traffic allocation. InitGen generates the complete candidate set within 180 ms and has been fully deployed in OPPO's Xiaobu Assistant, which serves over 150 million monthly active users.
15. 【2609.11951】MemRetriever: Learning to Search, Reflect, and Retrieve from Long-Term Memory
链接：https://arxiv.org/abs/2609.11951
作者：Ruiyang Jiang,Chunyu Li,Zhiyu Li
类目：Information Retrieval (cs.IR)
关键词：enables personalized agents, memory enables personalized, Long-term memory enables, personalized agents, enables personalized
备注：
点击查看摘要
Abstract:Long-term memory enables personalized agents, but its value depends on retrieving the right evidence at the right time. Most memory systems use static top-k retrieval: they issue one query, return a fixed number of memories, and pass them directly to a downstream model. This approach can miss evidence distributed across sessions, introduce irrelevant content, and waste context, especially for multi-hop, temporal, and knowledge-update questions. We present MemRetriever, an agentic retrieval model that treats memory access as a multi-step search process. At each step, MemRetriever reasons over the current evidence and selects parallel search for broad exploration, serial search for targeted completion, or reflection and denoising for filtering and evidence assessment. It stops when the retained evidence is sufficient for downstream answering. We construct ReAct-style search-memory trajectories for supervised warm-start training and further optimize the model with Group Relative Policy Optimization. The reward design encourages evidence coverage, noise reduction, answer sufficiency, and efficient termination. Experiments on LOCOMO, LongMemEval, HotpotQA, MuSiQue, and 2WikiMultiHopQA show consistent improvements over static retrieval and supervised-only baselines. MemRetriever-4B-RL also outperforms DeepSeek-v4-Flash on the main LongMemEval retrieval metrics under the same pipeline and achieves the strongest results among the compared methods on MuSiQue. Because its decision logic is independent of the storage backend, MemRetriever can also operate over external knowledge bases and vector databases. These results show that an intermediate decision layer that plans, searches, filters evidence, and determines when to stop can improve both long-term memory retrieval and knowledge-intensive question answering.
16. 【2609.11945】Who Are We Recommending To? Recommender Systems in the Agentic Web
链接：https://arxiv.org/abs/2609.11945
作者：Himan Abdollahpouri,Kyle Kretschman,Sai Ravindranath,Jackie Doremus,Mounia Lalmas
类目：Information Retrieval (cs.IR)
关键词：human directly consumes, directly consumes, emerging Agentic Web, Agentic Web, human directly
备注：
点击查看摘要
Abstract:For two decades, recommender systems have been designed under the assumption that a human directly consumes each recommendation: receiving, interpreting, and acting upon it. The emergence of AI agents powered by large language models challenges this assumption. In the emerging Agentic Web [ 28 ], autonomous agents increasingly act on behalf of users, e.g., browsing, comparing, negotiating, and executing transactions, raising a central question: who is the receiver of a recommendation? In this position paper, we argue that the recommendation paradigm is undergoing a bifurcation. In delegable contexts, such as routine purchases, travel, and constrained transactional tasks, the primary operational consumer of recommendations is shifting from the human to the agent, requiring new optimization objectives, interaction protocols, and evaluation criteria. In experiential contexts, such as entertainment, art, and other subjective or high-stakes choices, humans remain the final judge of relevance, though agents may assist through pre-filtering and curation. We introduce a delegation spectrum that characterizes recommendation contexts along factors such as preference specifiability, outcome verifiability, and decision stakes, and we outline a research agenda spanning agent preference modeling, dual-audience optimization, and the emerging agent attention economy. We further discuss the implications of this shift for the design and evaluation of recommender systems
17. 【2609.11943】PinDCO: Whole-Page Aware Dynamic Creative Optimization at Scale
链接：https://arxiv.org/abs/2609.11943
作者：Yu Hao,Yuchun Li,Peimeng Sui,Meilin Liu,Tianyuan Cui,Hao Li,Zicong Zhou,Akanksha Baid
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Recent advances, dramatically expanding, variants per campaign, advances in generative, substantially accelerated
备注： Accepted by the Recsys26
点击查看摘要
Abstract:Recent advances in generative AI have substantially accelerated the creation of high-quality ad creatives, dramatically expanding the number of candidate variants per campaign. This shift increases the need for scalable dynamic creative optimization (DCO) systems that can match creatives to the most relevant audiences under stringent latency and cost constraints. We present PinDCO, a production DCO system for ad creative retrieval and selection on Pinterest, a billion-scale visual discovery platform. PinDCO is built around a Creative Component Fusion Network (CCFN) that performs dynamic creative scoring by modeling each creative component (e.g., image, title, layout) with a dedicated tower, using component-specific hyperparameters to account for differing modeling complexity. The component representations are fused to predict a creative-level score conditioned on the ad-level prediction, and we improve training data quality via an exploration-exploitation strategy. To account for Pinterest's waterfall grid layout, where a creative's rendered size affects nearby content and session-level engagement, we introduce a Pixel-aware Adjustment Module(PAM) that adjusts scores based on creative size to encourage efficient screen real-estate utilization and better whole-page outcomes. To support the large volume of creative candidates, we further employ a lightweight pre-selection model for early pruning, and optimize serving efficiency through caching and dynamic batching. Extensive offline analyses and online A/B experiments demonstrate the effectiveness of PinDCO, yielding a +3.09% lift in ad Click-Through Rate(CTR) with positive whole-page metrics. With the strong performance, we launched PinDCO in the Pinterest Ads platform.
18. 【2609.11942】Position: Recommender Systems Should Move Beyond Platform-Centric Ranking toward Personal Agent-Mediated Recommendation
链接：https://arxiv.org/abs/2609.11942
作者：Haohan Yuan,Peng He,Dan Zhang,Jianpeng Liang,Junning Zhu
类目：Information Retrieval (cs.IR)
关键词：construct candidate sets, Recommender systems, platforms observe users, construct candidate, candidate sets
备注： Position paper; 13 pages, 2 figures, and 3 tables. Introduces the PAMR paradigm, a mediation-centered evaluation framework, and a proof-of-concept study on recommendation tasks
点击查看摘要
Abstract:Recommender systems are usually framed as ranking systems: platforms observe users, construct candidate sets, and select items on their behalf. This framing hides a deeper allocation of control, in which platforms also determine candidate access, evidence boundaries, explanations, and the path from user need to recommended output. We argue that the next bottleneck in recommendation is not only preference modeling, but control over evidence acquisition and disclosure. We argue for \textbf{Personal Agent-Mediated Recommendation} (PAMR), a paradigm in which a user-facing personal agent represents the user in discovering, filtering, aggregating, and governing recommendation evidence across distributed sources. The central shift is not simply from one ranking model to another, but from platform-side item ranking to user-side evidence mediation. As a position paper, we define PAMR as a new recommendation paradigm, establish its boundary criteria, identify its core mediation decisions, and propose a mediation-centered evaluation framework. A proof-of-concept study on hard Yelp restaurant recommendation tasks further shows that, under a shared LLM ranker, source selection and controlled disclosure provide the strongest observed utility--traceability--exposure--cost operating point.
计算机视觉
1. 【2609.13146】SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image
链接：https://arxiv.org/abs/2609.13146
作者：Yu-Rou Tuan,Hao-Tang Tsui,Nicolas Ugrinovic,Kris Kitani,Xiaoxuan Ma
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：generate visually complete, visually complete individual, asset generation enables, generation enables applications, complete individual parts
备注： Project page: [this https URL](https://lucytuan.github.io/SNAP3D/)
点击查看摘要
Abstract:Part-aware 3D asset generation enables applications such as editing, articulation, simulation, and fabrication, yet existing methods can generate visually complete individual parts without ensuring that they form a valid physical assembly. Consequently, generated neighboring parts may interpenetrate, lack valid connections, or collapse under gravity. We propose a physics-guided framework for improving single-image part-aware 3D generation with physically compatible geometry and stable connections. Our method resolves inter-part penetration, recovers a contact graph between neighboring parts, and introduces parameterized connectors at their contact surfaces. Using feedback from physical simulation, we refine connector placement, orientation, and dimensions to improve assembly stability while preserving the generated geometry. We further introduce a physics-based evaluation protocol that complements conventional geometric metrics by directly testing assembly validity and stability under gravity. Experiments comparing against multiple part-aware 3D generators show substantial improvements in physical realizability and stability while maintaining geometric quality. We additionally validate the resulting parts through 3D printing and real-world assembly.
2. 【2609.13043】Unified CT and MRI Pancreas Segmentation for Label-Efficient Cross-Modality Subregion Transfer
链接：https://arxiv.org/abs/2609.13043
作者：Ziliang Hong,Hongyi Pan,Halil Ertugrul Aktas,Andrea Bejar,Elif Keles,Frank H. Miller,Michael B. Wallace,Rajesh N. Keswani,Gorkem Durak,Ulas Bagci
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Robust medical image, Robust medical, medical image segmentation, intensity distributions, medical image
备注：
点击查看摘要
Abstract:Robust medical image segmentation across imaging modalities is challenging because of large differences in appearance and intensity distributions. Models trained on a single modality often show substantial performance drops when applied to unseen domains. In this work, we develop a unified 3D pancreas segmentation framework that applies domain-adversarial learning to 4,604 heterogeneous CT and MRI scans to learn anatomical representations. A shared nnU-Net encoder-decoder is trained for whole-pancreas segmentation, with a latent domain discriminator encouraging CT-MRI feature alignment. The learned encoder is subsequently transferred to pancreatic head-body-tail segmentation using limited MRI-only subregion annotations. An average Dice score of 87.31% on the in-distribution test set and Dice scores ranging from 84.20% to 88.09% across external OOD datasets were achieved in whole pancreas segmentation. Dice scores of 80.53% on MRI and 83.05% on CT were achieved for downstream subregion segmentation, without using CT subregion annotations. These results demonstrate that a unified anatomical representation can support both cross-modality pancreas segmentation and label-efficient downstream transfer.
3. 【2609.13024】Label-Guided Knowledge Distillation for 3D-CNNs in Action Recognition
链接：https://arxiv.org/abs/2609.13024
作者：Yanjiang Shi,Peng Zhao,Nan Qi,Guiqin Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：model compression technique, key model compression, knowledge distillation aims, lightweight student model, knowledge distillation
备注： 10 pages, 2 figures
点击查看摘要
Abstract:As a key model compression technique, knowledge distillation aims to transfer knowledge from a high-capacity teacher model to a lightweight student model for enhancing the latter's performance. In this work, we reviewed the feature knowledge distillation for 3D-CNNs and observed that most feature distillation methods in video analysis are simple adaptations of those used in image analysis, often neglecting the differences of video features in the temporal dimension. To address this issue, we proposed Label-Guided Knowledge Distillation (LGKD) to guide the distillation of student model features using ground truth labels. Our method entails two components: sample-wise distillation and class-wise distillation, enabling the student model to learn feature representation of the teacher model at two levels. Sample-wise distillation utilizes label information and the teacher's probability distribution to guide the learning of features that significantly impact temporal accuracy while mitigating noise. Meanwhile, class-wise feature distillation employs a prototype network to further capture the relational knowledge among samples within the same category, enhancing the student's ability to learn higher-dimensional semantic information and improving model generalization. To demonstrate the effectiveness and superiority of our method, we conducted comprehensive experiments on two benchmark action recognition datasets, UCF101 and HMDB51, achieving competitive results.
4. 【2609.13013】Net: Tile-Based CNN-SVM Architecture for Autonomous Unmanned Aerial Systems Inspection of Flat Roofs
链接：https://arxiv.org/abs/2609.13013
作者：Samuel Dunthorne,Hashim A. Hashim
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：household energy consumption, long-term environmental sustainability, Flat roofs, carbon emissions, thermal efficiency
备注： Journal of Safety Science and Resilience
点击查看摘要
Abstract:Flat roofs are among the most influential components of the building envelope, governing both structural performance and thermal efficiency, and thereby contributing directly to household energy consumption, carbon emissions, and long-term environmental sustainability. Timely detection of roof defects is essential for reducing heating and cooling losses, preventing moisture-driven degradation such as mold growth, and supporting national climate-change mitigation goals. This paper presents a real-time, Unmanned Aerial System (UAS)-based deep learning framework that autonomously detects defects using live imagery captured during dual-altitude aerial passes. The multi-resolution flight strategy is designed to aid the identification of both small, fine-scale defects and larger structural issues, enabling more comprehensive assessments. To meet the strict computational and power constraints of embedded UAS hardware, the proposed framework integrates a tile-based architecture with a lightweight Convolution Neural Network-Support Vector Machine (CNN-SVM) classifier designed for low-latency onboard inference. The final model-comprising five convolutional layers and four dense layers, the last a linear SVM head, achieved a mean test accuracy of $94.4\%$ ($95\%$ confidence interval $\pm0.4\%$ over three seeds) on a photo-level split ($43,383$ training, $3,869$ validation, and $2,540$ test tiled and augmented images), outperforming GoogLeNet ($89.2\%$) and AlexNet ($79.8\%$). Experimental evaluations using real UAS imagery collected by onsite visits with DJI Matrice 350 RTK drone demonstrate that the system supports rapid, repeatable, and safe roof inspections while reducing human risk, lowering operational costs, and enabling more sustainable building maintenance.
5. 【2609.13012】Pixel Decodability Is Not a Compression Signal: Causally Evaluating Importance Proxies for Visual KV-Cache Eviction
链接：https://arxiv.org/abs/2609.13012
作者：Chenyu Zhou,Qiliang Jiang,Shuning Wu,Xu Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language models retain, Vision-language models, substantial amount, visual key-value cache, Vision-language
备注： 15 pages, 3 figures, 3 tables
点击查看摘要
Abstract:Vision-language models retain a substantial amount of pixel-decodable visual content in their visual key-value cache. We show, in our setting, that this retention is task-inert: across our preregistered tests, how much a unit retains never positively tracks whether the computation that answers the question causally relies on it. We measure retention with a learned pixel-inversion decoder and causal use with single-super-patch KV ablation, the teacher-forced drop in gold-answer log-probability, and relate the two within images under a preregistered, sign-calibrated, held-out design. Retention is decoupled from attention and, in a well-powered null, from causal utilization. Utilization is not inert to every proxy: attention weakly but significantly tracks it, the only signal we find that does and the design's positive control. We characterize pixel-decodable retention as an informational axis of the visual KV cache, orthogonal to the functional one. How much task-inert content a cache holds differs by architecture in our model pair: the encoder-free model retains 2.7 times more than the encoder-based one. The engineering consequence is a controlled negative result. At super-patch granularity, deconfounded pixel-decodable retention ranks KV eviction no better than random; at token granularity it acquires only a weak inverse-importance signal at larger budgets, dominated at every budget by attention magnitude. In our setting, pixel-decodable reconstructability is not a competitive KV-compression signal at any granularity we test.
6. 【2609.13006】Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization
链接：https://arxiv.org/abs/2609.13006
作者：Minh-Loi Nguyen,Xuan-Vu Le,Thanh-Toan Do,Tam V. Nguyen,Minh-Triet Tran,Trung-Nghia Le
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrated remarkable capabilities, photorealistic video content, synthesizing high-fidelity, Video diffusion models, demonstrated remarkable
备注：
点击查看摘要
Abstract:Video diffusion models (VDMs) have demonstrated remarkable capabilities in synthesizing high-fidelity, photorealistic video content. However, they fundamentally lack an intrinsic understanding of physical laws and frequently produce visually appealing but causally illogical sequences characterized by structural hallucinations and physically implausible dynamics. Injecting physical awareness via training-free test-time optimization is a promising alternative, yet existing methods rely on global gradient updates and rigid scheduling heuristics that inadvertently corrupt passive backgrounds and fail to model complex dynamic state changes. To address this, we propose PhysPlan, a novel training-free guidance framework that shifts the paradigm from stochastic visual interpolation to agentic physics simulation. First, a VLM operates as an iterative cognitive simulator, decomposing multimodal inputs into a Chain-of-Visual-Thought to create a multimodal representation of kinematic trajectories and 3D depth geometries. Second, these signals drives an object-centric test-time optimization. Unlike prior training-free methods that rely on global gradients and rigid scheduling heuristics, PhysPlan introduces Object-Centric Gradient Routing to isolate kinematic modifications and completely lock the passive environment. Furthermore, our Kinetic Intensity Profiling dynamically parameterizes framework hyperparameters to accommodate the varying severity of physical deformations. Extensive evaluations on the PhyGenBench and Physics-IQ benchmarks demonstrate that PhysPlan significantly outperforms both foundational and controllable VDM baselines, offering a promising approach for improving the physical understanding of video generation.
7. 【2609.12997】SV-Cine: Diagnosis-Conditioned Segmentation of Single Ventricle Physiology via Generative Data Augmentation
链接：https://arxiv.org/abs/2609.12997
作者：Lila Cunge,Yuehong Liu,Hang Xu,Thomas Coudert,Pierangelo Renella,J Paul Finn,William Hsu,Kim-Lien Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：Single Ventricle Physiology, single functional cardiac, congenital heart disease, heart disease characterized, challenge conventional image
备注：
点击查看摘要
Abstract:Single Ventricle Physiology (SVP) is a rare subtype of congenital heart disease characterized by the presence of a single functional cardiac ventricle with atypical anatomic configurations that challenge conventional image segmentation approaches. The scarcity of clinical data and the morphological diversity across SVP subtypes make the development of robust segmentation methods particularly difficult. To address these limitations, we propose a cardiac MRI segmentation framework focused on ventricular chambers and myocardium segmentation tailored for SVP. First, we introduce a data augmentation pipeline that generates synthetic 3D cardiac meshes using SDF4CHD and corresponding synthetic cardiac MRI through generative modeling. Second, we introduce SV-Cine, a diagnosis-conditioned adaptation of the foundation model CineMA that incorporates patient-level diagnostic information through Feature-wise Linear Modulation layers, enabling diagnosis-aware feature adaptation during segmentation. We evaluated the framework on an internal cohort with varying SVP subtypes. SV-Cine achieved median Dice scores of 0.89 (IQR: 0.80--0.91) for the left ventricle and 0.72 (IQR: 0.54--0.84) for the right ventricle, outperforming the strongest baseline, nnU-Net, by 0.39 Dice points on right ventricle segmentation. It also yields a median ejection fraction error of 5.55 percentage points (IQR: 3.41--7.69) for the dominant ventricle. Compared with the internal cohort, LV and myocardium segmentation performance was lower for the external cohort; whereas RV Dice scores were comparable for both cohorts. Our findings suggest that a pretrained foundation model can be adapted for highly specialized downstream tasks through usage of diagnosis priors while leveraging anatomic knowledge learned from large-scale MRI datasets during pretraining.
8. 【2609.12993】Investigating Temporal Motion Features for Pose-to-Text Indian Sign Language Translation
链接：https://arxiv.org/abs/2609.12993
作者：Manav Dhamecha,Praveen Kumar Chandaliya,Pruthwik Mishra
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Indian Sign Language, Sign Language Translation, Indian Sign, Language Translation, Sign Language
备注： 5 pages, 1 table and 2 figures
点击查看摘要
Abstract:We investigate the effect of pretrained T5 model scale and explicit motion features on pose-to-text Indian Sign Language Translation (SLT) for the WSLP 2026 Shared Task. Pose sequences are projected into the embedding space of T5 through a lightweight pose encoder, with the complete model fine-tuned to generate English text. The shared task data used for this work consists of a test set with 5,334 examples and a validation set with 5,257 examples. We compare T5-small, T5-base, and T5-large, and additionally introduce a motion-augmented variant, T5-small + Motion, that adds explicit frame-to-frame pose differences to the input representation. T5-small achieves the best BLEU and ROUGE scores among the spatial-only models, while T5-large obtains the highest chrF score. Augmenting T5-small with motion features yields the largest single improvement observed in our study, substantially improving BLEU over the spatial-only baseline and making it the strongest model overall on this metric. Our submitted system ranked 5th on the official WSLP 2026 SLT testing leaderboard. The source code and trained models are publicly available on GitHub and HuggingFace.
9. 【2609.12965】Generative Retrieval for Unsupervised Text-Based Person Search
链接：https://arxiv.org/abs/2609.12965
作者：Mang Ye,Yucheng Ji,Yang Bai,Min Cao,Siyuan Chai,Bo Du,Min Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Text-based person search, Text-based person, large image gallery, image gallery based, natural language description
备注： 17 pages, 10 figures. Accepted for publication in IEEE Transactions on Pattern Analysis and Machine Intelligence
点击查看摘要
Abstract:Text-based person search (TBPS) aims to retrieve images of a target person from a large image gallery based on a given natural language description. Most existing methods rely on supervised learning with manually annotated image-text pairs. In this paper, we explore unsupervised TBPS, with only unlabeled images. We propose GTR+, a two-stage generation-then-retrieval framework. In the generation stage, we introduce a tiered description generation framework designed to produce fine-grained and stylistically diverse textual descriptions through a three-tier sequential process. The base tier leverages an automated question-and-answer mechanism to generate basic visual attribute descriptions; the intermediate tier enhances fine-grained detail using an inter-sample contrastive mechanism; the advanced tier further enriches textual diversity via a stylized expansion mechanism. In the retrieval stage, to mitigate the impact of noisy pseudo texts, we develop an adaptive confidence-weighted retrieval learning framework. We model image-text pairs as clean or noisy using a Gaussian Mixture Model, calibrated by real-time image-text similarity and static text generation probability from the prior stage, yielding adaptive sample weights during training. Beyond that, we also contribute LargeFine-Person, a large-scale TBPS dataset with high-quality, fine-grained, and diverse textual annotations, enabling a practical and generalizable TBPS pre-training benchmark under unsupervised setting. Experiments on multiple TBPS benchmarks demonstrate the effectiveness and generalization of both GTR+ and LargeFine-Person. Code is available at: this https URL.
10. 【2609.12953】Fast and Faithful: Principled Conditional Flow Matching for Inverse Problems
链接：https://arxiv.org/abs/2609.12953
作者：Shirin Shoushtari,Edward P. Chandler,Xiao Shi,Ulugbek S. Kamilov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：commonly incorporate measurements, problems commonly incorporate, Flow matching approaches, velocity field, imaging inverse problems
备注：
点击查看摘要
Abstract:Flow matching approaches to imaging inverse problems commonly incorporate measurements in two ways. Conditioning-based approaches supply measurement-derived information as a network input, often through concatenation, while inference-guided approaches combine an unconditional velocity field with a separate data-consistency update. In these common formulations, the forward model is not explicitly enforced within the learned conditional velocity field. We propose a principled parametrization of the measurement-conditional velocity field to solve inverse problems. Under linear interpolation, we express the conditional velocity $v(x_t,t,y)$ in terms of the posterior mean $E[x_1 | x_t,y]$, and characterize that mean as the unique minimizer of a variational objective whose data-consistency term is explicit. We further prove that the velocity field defines a probability flow from the source distribution to the measurement-conditioned posterior. Splitting the variational objective yields a conditional velocity parameterization with operator-dependent data-consistency updates, which we train end-to-end under the flow-matching objective, with no additional guidance at inference. Our method achieves state-of-the-art PSNR with $50\times$ fewer function evaluations than the strongest flow baseline. Varying the sampling steps provides test-time control over the distortion-perception trade-off without retraining.
11. 【2609.12929】DementiaCare-Bench: A Modality-Validated Video Benchmark
链接：https://arxiv.org/abs/2609.12929
作者：Afrouz Sheikholeslami,Yuankai Qi,Xuyun Zhang,Luping Zhou,Amin Beheshti,Quan Z. Sheng,Ming-Hsuan Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Multiagent Systems (cs.MA)
关键词：million people worldwide, Dementia affects, affects an estimated, million people, people worldwide
备注：
点击查看摘要
Abstract:Dementia affects an estimated 57 million people worldwide, and for most families the hardest part of care is not memory loss but the behavioral and psychological symptoms of dementia (BPSD): agitation, wandering, resistance to care, sundowning. Understanding these symptoms requires more than recognizing the behavior itself; it also requires knowing what happened beforehand. The same behavior may call for a different response depending on its trigger. Video-language models (VLMs) could potentially support caregivers, yet no existing benchmark evaluates this capability. To fill this gap, we present DementiaCare-Bench: 56 professionally produced caregiver training videos segmented into 94 clips across nine BPSD categories, with 2023 questions generated by a multi-agent pipeline that grounds every clinical claim in a verbatim transcript span. Each question is then probed under four visual conditions and labelled by the least it requires, so its visual demand is measured rather than assumed. Measurement contradicts intent: we wrote 77.7% of the questions to require ordered frames, and 34.8% do. Across 12 current VLMs the pattern is uniform. The best reach 85% overall, but that average is carried by questions a language model can answer from clinical knowledge alone; accuracy falls by 17 points on average on questions that require the ordered clip, and a leading open model scores at chance on judging whether a caregiver's response was appropriate. A lightweight LoRA fine-tune, DemCare-VLM, moves video dependence from -3.3 to +4.5 points, so what the benchmark exposes can be repaired and not only measured.
12. 【2609.12920】Input Resolution Matters: Real-Time Object Detection Latency
链接：https://arxiv.org/abs/2609.12920
作者：Qingyang Zhang,Fumio Machida,Laura Carnevali
类目：Computer Vision and Pattern Recognition (cs.CV); Performance (cs.PF)
关键词：simplifying independence approximation, selected stage parameters, model total latency, stage parameters expressed, simplifying independence
备注： 8 pages, 2 figures, 2026 34th IEEE International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS)
点击查看摘要
Abstract:We model total latency as the convolution of preprocessing, inference, and postprocessing distributions under a simplifying independence approximation, with selected stage parameters expressed as functions of source-image resolution. Under this assumption, the probability density of the total latency is the convolution of the stage-wise densities, and its cumulative distribution function (CDF) provides the distribution of end-to-end detection time. Each stage is modeled by a parametric distribution (e.g., Exponential, Erlang, Normal, Gamma), with parameters expressed as functions of the source-image resolution. Experiments with YOLOv11n on NVIDIA Jetson Orin NX using COCO2017 images across multiple resolutions assess the proposed models against fixed-parameter baselines using Kolmogorov Smirnov, Anderson Darling, and Cramér von Mises statistics. The results indicate that resolution-aware parameterization can improve distributional approximation in the measured setting, particularly for the more flexible Normal and Gamma models, while the quality of fit remains distribution dependent. Our contribution is a theoretically grounded and lightweight formulation for studying resolution-dependent latency distributions in a measured object detection pipeline.
13. 【2609.12917】PA-CDM: Position-Aware Character Detection Matching for Evaluating Handwritten Mathematical Expression Recognition
链接：https://arxiv.org/abs/2609.12917
作者：Shiliang Luo(East China Normal University)
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Handwritten mathematical expression, identical token-error counts, counts receive identical, mathematical expression recognition, token-error counts receive
备注： 8 pages, 3 figures
点击查看摘要
Abstract:Handwritten mathematical expression recognition (HMER) is conventionally scored by exact-match rates and string-similarity metrics that are blind to where an error occurs: two predictions with identical token-error counts receive identical scores whether they misplace a subscript or swap the operands of a fraction. Render-based character detection matching (CDM) aligns glyphs robustly but remains position-blind---on controlled fraction-operand swaps it scores 0.8595 where position-aware scoring yields 0.6253. Tree-edit metrics exhibit a complementary blind spot: rewrites outside the parser's normalization coverage are penalized as structural errors (0.8552 where render-based metrics score 1.0). We propose PA-CDM, a position-aware metric that couples character detection matching with position-forest encoding and divergence-level weighting; StructPerturb v2.0, a frozen benchmark of 1,340 controlled perturbation pairs across 15 type--intensity cells; and a cross-metric consistency protocol combining a sensitivity matrix, a human study, and LLM-judge calibration. In a six-annotator study, PA-CDM attains the highest correlation with human judgments among seven automatic metrics (Spearman rho=0.9535, n=990). A frontier LLM judge correlates slightly higher (rho=0.9613) but is costly, nondeterministic, and API-dependent; PA-CDM approaches it at zero marginal cost with deterministic, diagnosable behavior.
14. 【2609.12902】Parallel Training Using a CNN-DNN Architecture for Accelerated Development of Diagnostic Models
链接：https://arxiv.org/abs/2609.12902
作者：Janine Weber-Hamacher,Astha Jaiswal,Philipp Fervers,Dorotya Móré,Athanasios Giannakis,Ricarda Fischbach,Andreas Michael Bucher,Rahil Shahzad,Jonathan Kottlors,Thorsten Persigehl,Axel Klawonn
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Artificial intelligence, intelligence has shown, shown promise, promise in assisting, assisting radiologists
备注：
点击查看摘要
Abstract:Artificial intelligence has shown promise in assisting radiologists in imaging-based diagnosis across a wide range of diseases. Efficient training of large deep learning models is essential to cope with extremely large data sets or dynamically growing disease data, like in a pandemic like situation. In this retrospective study, we collected 300 CT scans from COVID-19 and non-COVID-19 pneumonia patients from three different centers in Germany. We investigated a hybrid CNN-DNN network model based on image decomposition and localization that naturally supports parallel and efficient training of deep learning models. In total, 156 models with three different architectures were trained to capture features at different levels resulting in 12 patient-level COVID-19 diagnosis models. Diagnostic performance as well as time saving were measured. The highest accuracy was obtained from DenseNet121 and 3D CNN models with a parallel CNN-DNN approach, resulting in $88.78\%$ training, $76.67\%$ validation and $76.03\%$ test accuracy for the DenseNet121 with $4\times4\times1$ subdomains and $87.72\%$ training, $76.82\%$ validation and $74.86\%$ test accuracy, respectively, for the 3D CNN with $4\times4\times1$ subdomains. The strongest reduction in parallel training time by a factor of $31$ was observed for the 3D CNN model and $4\times4\times2$ subdomains. Our parallel training approach improves efficiency as well as performance enabling rapid model development, among others crucial for pandemic preparedness.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
MSC classes:
68T07, 68W10, 68W15, 68T10
Cite as:
arXiv:2609.12902 [cs.CV]
(or
arXiv:2609.12902v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.12902
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
15. 【2609.12898】UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction
链接：https://arxiv.org/abs/2609.12898
作者：Xinqiang Yu,Zekun qi,Jiawei He,Wenyao Zhang,Xuchuan Chen,Guaocai Yao,Li Yi,Zhaoxiang Zhang,He Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：Fine-grained robotic manipulation, robotic manipulation depends, Fine-grained robotic, robotic manipulation, manipulation depends
备注：
点击查看摘要
Abstract:Fine-grained robotic manipulation depends on understanding parts, not only whole objects. Existing 3D foundation models tend to be either generalized but object-aware, or part-aware but limited to closed-set taxonomies, which weakens zero-shot transfer. We study text-conditioned 3D part segmentation, where a free-form phrase selects a functional part on point cloud. We introduce UniPart, a feed-forward cross-modal 3D Transformer that conditions CLIP text embedding. To scale supervision, we build LangPart-1M with 160K+ Objaverse assets and 8M text to part pairs using multi-view consistent part generation. We further manually label a high-quality subset, LangPart-4K, for fine-tuning and evaluation. UniPart achieves strong zero-shot results on open-vocabulary part benchmarks and transfers to language-conditioned part grasping in real world.
16. 【2609.12892】Beyond Accuracy: Uncertainty-Guided Boundary Refinement for Reliable Biomedical Image Segmentation
链接：https://arxiv.org/abs/2609.12892
作者：Anima Kujur
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Accurate biomedical image, clinically meaningful boundaries, high global overlap, Accurate biomedical, Dice
备注：
点击查看摘要
Abstract:Accurate biomedical image segmentation requires not only high global overlap but also reliable delineation of clinically meaningful boundaries. In blood-smear microscopy, cytoplasm and nucleus contours provide the structural basis for downstream morphology analysis; however, deep segmentation models may remain uncertain or overconfident near ambiguous boundary regions even when achieving strong Dice scores. This work proposes a Reliability-Aware Boundary Refinement Network (RABR-Net), a two-stage framework for trustworthy image segmentation. A strong UNet++ EfficientNet-B4 base segmenter first produces initial class probabilities and logits. Predictive entropy, test-time augmentation variance, margin uncertainty, probability gradients, and soft boundary cues are then combined into a boundary-aware reliability representation. This representation guides a gated residual refiner that selectively corrects uncertain boundary pixels while preserving confident regions of the base prediction. The framework is evaluated using overlap accuracy, class-wise Dice, Boundary Dice, HD95/ASSD, calibration, risk--coverage analysis, robustness under image perturbations, qualitative correction maps, and paired statistical testing. On the held-out test set, the proposed method improves Dice from 0.9602 to 0.9614, Boundary Dice from 0.3448 to 0.3611, and HD95 from 3.0354 to 2.8274 compared with the cached base prediction. Statistical analysis confirms significant improvements in Dice, Boundary Dice, and HD95. Qualitative results show that the learned gate concentrates around uncertain cytoplasm and nucleus boundaries, and correction maps confirm localized boundary refinement. Although calibration does not automatically improve after refinement, the proposed framework provides an interpretable and reliability-focused strategy for boundary-sensitive biomedical image segmentation.
17. 【2609.12885】Learning Sign Language Recognition under Label Noise: A Study of Noise-Robust Losses for Isolated and Continuous Settings
链接：https://arxiv.org/abs/2609.12885
作者：Akihisa Shitara,Yoichi Ochiai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sign language recognition, classification loss treats, CSLR forces pseudo-labels, language recognition, ground truth
备注： 15 pages, 1 figures
点击查看摘要
Abstract:In sign language recognition, the isolated (ISLR) classification loss treats a single label as ground truth, as does the frame-level auxiliary classifier over pseudo-labels we add to continuous (CSLR) methods, which lack one. Stylistic variation blurs ISLR annotation and the lack of temporal boundaries in CSLR forces pseudo-labels; both are noisy. We therefore apply symmetric and generalized cross entropy (SCE, GCE), robust alternatives to cross entropy (CE) from image classification, not to connectionist temporal classification but to the preceding single-label classifier. On ASL Citizen with injected symmetric noise on three backbones (three seeds for ST-GCN), robust losses cost at most 2.5 pt when labels are clean and beat CE by 2.9-10.0 pt in all six conditions at noise rate 0.2, one of which only after q was re-selected on dev. GCE gains more, but its optimal q does not transfer across backbones, whereas one SCE setting works in all nine conditions; both vary 2-11 times more than CE across runs, so a favorable point estimate does not establish stability. For CSLR (PHOENIX-2014) we report no gain; our frame-level targets carry a systematic assignment bias, making that study a diagnosis of a single configuration. At lambda_aux = 25 the pseudo-label CE auxiliary raises word error rate above the no-auxiliary baseline on VAC, CorrNet and SlowFastSign, and GCE/SCE improve on CE by 1.7-3.2 pt (three of six conditions return below that baseline). However, the three losses differ by more than an order of magnitude in effective gradient at a common lambda_aux: matching the initial gradient shrinks the gap to 0.4-0.9 pt, and lowering the CE weight alone already beats that baseline, so neither the degradation nor the improvement can be separated from the effect of the weight. We use only symmetric noise; multi-seed evaluation covers only ST-GCN and VAC isolated.
18. 【2609.12874】VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation
链接：https://arxiv.org/abs/2609.12874
作者：Xinyi Chen,Hanxin Zhu,Xijun Wang,Xingrui Wang,Sen Liang,Xin Li,Zhibo Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：mapping high-dimensional visual, high-dimensional visual signals, cornerstone of modern, mapping high-dimensional, modern video modeling
备注： 9 pages, 5 figures
点击查看摘要
Abstract:Video tokenizers have emerged as a cornerstone of modern video modeling, underpinning progress in compression, reconstruction and generation by mapping high-dimensional visual signals into compact latent spaces. However, despite this progress, current tokenization paradigms largely remain within the 2D visual domain, treating videos as image sequences rather than observations of an underlying dynamic 3D world. Consequently, the learned tokens inherit this observation-centric bias, limiting their capacity to compactly represent real-world 4D scenes. To mitigate this issue, we propose VideoTok4D, a novel 4D-aware video tokenizer for compact world representation. Specifically, our approach comprises three key designs: 1) a spatiotemporal disentanglement strategy that factorizes videos into static and dynamic tokens for holistic world modeling; 2) a track-aware dynamic attention mechanism that aggregates trajectory-aligned cues to promote cross-view motion consistency; and 3) Co4DGen, a diffusion prior learned over the resulting VideoTok4D token space for efficient 4D scene generation. Extensive experiments have demonstrated that our proposed method achieves state-of-the-art performance while requiring up to 4 orders of magnitude less storage than dense 4D representations. Moreover, the compact token space substantially shortens diffusion sequences, enabling efficient generation.
19. 【2609.12871】A Multi-Vehicle Dataset with Camera, LiDAR, and Radar Sensors and Scanned 3D Models for Custom Auto-Annotation using RTK-GNSS
链接：https://arxiv.org/abs/2609.12871
作者：Philipp Berthold,Bianca Forkel,Mirko Maehlisch
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：perception algorithms, crucial element, sensor measurement data, annotated reference information, reference
备注： Paper accompanying the dataset "7V-Scanario"
点击查看摘要
Abstract:Datasets are a crucial element in the development of perception algorithms. They relate sensor measurement data to annotated reference information and allow for the deduction of sensor and object characteristics. In autonomous driving, the reference data commonly consist of semantic image segmentation, point-wise associations, or bounding box annotations. The dataset proposed in this work, however, aims to dig deeper into the evaluation of measurement principles and provides scanned 3D models of all vehicles together with a pose and continuous kinematics reference obtained by RTK-GNSS. Combined, the state of the complete dynamic surrounding of the sensor vehicle is known for any point in time. Subsequent reference formats can be easily computed in user-defined granularity. This dataset involves single-object and multi-object recordings with seven target vehicles. In particular, measurement effects such as occlusion, as well as reflections, can be evaluated, as the normals of the shape of the target vehicles are known. We describe the dataset, discuss the technical background of its development, and briefly present exemplary evaluations.
20. 【2609.12860】3D CT-to-PET Translation via Latent Brownian Bridge Diffusion
链接：https://arxiv.org/abs/2609.12860
作者：Sarita Mourya,Francesco Di Feola,Pierangelo Veltri,Paolo Soda
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：positron emission tomography, Computed tomography, provide complementary anatomical, emission tomography, provide complementary
备注：
点击查看摘要
Abstract:Computed tomography (CT) and positron emission tomography (PET) provide complementary anatomical and functional information for cancer diagnosis and treatment planning. However, the widespread use of PET is limited by high radiation exposure, elevated costs, and restricted availability. To address these limitations, deep learning-based CT-to-PET translation has emerged as a promising approach for synthesizing PET-like information directly from CT images, although accurately modeling the large cross-modal gap remains challenging. In this work, we propose a 3D CT-to-PET translation framework based on latent Brownian Bridge Diffusion (BBDM). The method consists of two stages. First, a Variational Autoencoder (VAE) is trained on paired CT-PET patches, integrating contrastive learning to improve latent alignment between anatomical and metabolic representations. Second, a BBDM is trained in the latent space to translate CT latent representations into their corresponding PET counterparts. The translated PET latents are then decoded and stitched to reconstruct the final 3D PET volume. We evaluate the proposed approach on two publicly available datasets. Quantitative results based on image fidelity and lesion-level PET-specific metrics demonstrate improved performance compared with competing methods. In particular, the proposed approach improves PET signal fidelity, better preserves clinically relevant uptake patterns, and shows improved performance in preserving small-lesion metabolic activation, paving the way for virtual imaging applications.
21. 【2609.12850】MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling
链接：https://arxiv.org/abs/2609.12850
作者：Lei Shi,Sen Peng,Zhiyang Deng,Zhonggui Chen,Xiaohu Guo,Baorong Yang,Xiao Dong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Accurate head modeling, expressive geometric representation, Accurate head, requires a stable, stable yet expressive
备注： 10 pages, 7 figures. Accepted to the Journal Track of Pacific Graphics 2026. Code is available at [this https URL](https://github.com/Bear0325/MGAvatar)
点击查看摘要
Abstract:Accurate head modeling requires a stable yet expressive geometric representation. Existing Gaussian-based head avatars commonly rely on parametric templates (e.g., FLAME) for Gaussian initialization and deformation, but these templates lack personalized priors and struggle to represent structures such as hair and clothing. To address this issue, we propose MGAvatar, a Gaussian-mesh hybrid representation that jointly models geometry and appearance through two Gaussian-mesh binding modes. Specifically, we introduce vertex-bound Gaussians and constrain their learnable parameters, enabling progressive mesh deformation to represent complex head geometry, while a pose-dependent offset module accounts for non-rigid deformations. Once geometry is stabilized, MGAvatar switches to face-bound Gaussians for appearance modeling. To improve appearance consistency across novel poses and viewpoints, we introduce a view-conditioned neural color field that alleviates artifacts caused by independently optimized Gaussian colors. In addition, we design a Gaussian offset network to predict Gaussian offset maps in the observation space, providing greater flexibility for face-bound Gaussians to capture dynamic facial textures. Extensive experiments on multi-view and monocular videos show that MGAvatar outperforms existing methods in rendering quality, producing high-fidelity head avatars with rich texture details.
22. 【2609.12843】Pre-Trained Low-Rank Tensor Decomposition for Multi-Dimensional Image Recovery
链接：https://arxiv.org/abs/2609.12843
作者：Bing-Zhang Fu,Zhi-Long Han,Ting-Zhu Huang,Xi-Le Zhao,Deyu Meng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：latent tensor, tensor, tensor decomposition, pre-trained latent tensor, classical tensor decomposition
备注：
点击查看摘要
Abstract:Recently, tensor decompositions are prevalent for multi-dimensional image representation, which learn the instance-specific structure of each image from scratch. However, tensor decompositions neglect the common structure across different images, leading to limited semantic modeling capability, high computational cost, and a large number of learnable parameters. To address this challenge, we suggest the first pre-trained low-rank tensor decomposition (PLTD) framework, which organically integrates the pre-trained large vision model into the classical tensor decomposition framework. Beyond the shallow and untrained deep tensor decomposition, the suggested PLTD achieves an unprecedented balance among higher recovery fidelity, fewer learnable parameters, and smaller carbon footprint. Specifically, PLTD factorizes the target tensor into a latent tensor and a learnable transform that maps the latent tensor back to the original data domain. The latent tensor consists of two indispensable and complementary terms, i.e., a fixed pre-trained latent tensor and a learnable low-rank latent tensor. The fixed pre-trained latent tensor is distilled from a pre-trained large vision model (i.e., DINOv3) to capture the common structure of the target tensor, while the learnable low-rank latent tensor characterizes the instance-specific structure of the target tensor. To examine the potential of PLTD, we develop the corresponding multi-dimensional image recovery model and theoretically justify the advantages of this framework. Additionally, we discuss the connections between PLTD and classical tensor decomposition frameworks. Extensive experiments on multi-dimensional image recovery demonstrate that PLTD consistently achieves superior performance compared with state-of-the-art methods.
23. 【2609.12835】HemaHier: Chain-Conditioned Ordinal Hierarchies for Lineage-Aware Bone-Marrow Cytology
链接：https://arxiv.org/abs/2609.12835
作者：Afshin Bozorgpour,Peter Schüffler,Edgar Jost,Dorit Merhof
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：ordered maturation trajectories, cell types lie, inherently structured, maturation trajectories, lie on ordered
备注： Accepted at the MICCAI 2026 Workshop on Computational Pathology and Multimodal Data (COMPAYL)
点击查看摘要
Abstract:Bone-marrow cytology is inherently structured: each cell belongs to a hematopoietic lineage, and many cell types lie on ordered maturation trajectories. Standard flat classifiers ignore this structure, treating a mild same-lineage confusion the same as a severe cross-lineage mistake and predicting only discrete labels. We propose HemaHier, an ordinal-hierarchical prediction head for a frozen or lightly adapted cytology foundation model. Its central component is a chain-conditioned maturity score that reads a single maturity value under a per-chain query, supervised only on biologically valid healthy chains, while dysplastic and off-chain cell types remain classes but are excluded from maturity supervision. Fine and lineage predictions are coupled through a shared posterior that guarantees hierarchical consistency, and a staged objective first stabilizes recognition, then adds lineage and maturity supervision. On three bone-marrow datasets under a shared ontology, HemaHier achieves competitive recognition while reducing biologically severe errors and adding a within-lineage maturity ordering that flat classifiers lack. Code is available at this https URL.
24. 【2609.12834】Self-supervised Pre-training Helps Retinal Disease Progression Modelling Most When Data Is Scarce
链接：https://arxiv.org/abs/2609.12834
作者：Ifeoma Veronica Nwabufo,Julius Gervelmeyer,Sarah Müller,Philipp Berens
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires longitudinal imaging, image per participant, time requires longitudinal, disease progresses, longitudinal imaging cohorts
备注：
点击查看摘要
Abstract:Modelling how a disease progresses over time requires longitudinal imaging cohorts, which are scarce and small, whereas cross-sectional data -- one image per participant -- is abundant. Self-supervised pre-training on such data offers a way to bridge this gap, but it is unclear which strategy best supports progression modelling, or how that answer depends on the amount of labelled longitudinal data. We study this for age-related macular degeneration (AMD), pre-training encoders on the large cross-sectional NAKO cohort and predicting time to late AMD on the longitudinal AREDS dataset. We compare in-house self-supervised encoders against a general-purpose (DINOv2) and a domain-specific (RETFound) foundation model, across contrastive, masked-autoencoding, and self-distillation objectives, under frozen and fine-tuned protocols, and across labelled training sets from 100 to 32,250 examples. Which model performs best depends on how the encoder is used. When the encoder is frozen and labels are few -- the regime typical of longitudinal cohorts -- pre-trained representations reach clinically reasonable discrimination from a few hundred labelled samples, while models trained from scratch do not; this advantage fades under fine-tuning. Transfer is governed by the self-supervision objective rather than corpus scale or domain match, so that an encoder pre-trained on a modest cross-sectional cohort matches or exceeds a far larger in-domain foundation model. Together, these results offer a practical recipe for building progression models where longitudinal data is scarce: a frozen self-supervised encoder with a lightweight survival head.
25. 【2609.12830】Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring
链接：https://arxiv.org/abs/2609.12830
作者：Jisheng Dang,Zhenxuan Wang,Bin Li,Ronghao Lin,Bin Hu,Tat-Seng Chua
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Continuous emotion control, improve affective alignment, generation requires, changing the objects, emotion control
备注： 13 pages, 10 figures, and 4 tables. Code is available at [this https URL](https://github.com/ramon-alana/eit-with-anchor-and-grpo)
点击查看摘要
Abstract:Continuous emotion control in text-to-image generation requires a model to improve affective alignment without changing the objects, layout, or scene described by the prompt. Existing supervised emotion-injection methods often optimize feature-space proxies and may therefore exhibit emotion-semantic drift, in which stronger emotional conditioning is accompanied by unintended content changes. We address this problem with a flow-matching image-generation framework that combines continuous valence-arousal (VA) conditioning, Group Relative Policy Optimization (GRPO), and a neutral semantic anchor. The deterministic probability-flow ODE is converted into a marginal-preserving SDE, yielding non-degenerate transition densities for trajectory sampling and policy-ratio estimation. A frozen CLIP-based VA regressor supplies a terminal reward measuring the distance between the predicted and target VA coordinates, while an image generated from the same prompt under zero VA conditioning provides a feature-space reference for semantic preservation. A reduced denoising schedule is used for online RL sampling, whereas the original schedule is retained at inference. Experiments on 3,300 prompt-emotion combinations show substantially lower valence and arousal errors than the VA-conditioned baseline and an improved CLIPScore relative to EmotiCrafter, with a measurable trade-off in reference-free image quality. The results support anchor-regularized Flow-GRPO as a practical approach to balancing emotional alignment and semantic consistency in continuous-affect image synthesis.
26. 【2609.12827】A Dual Cross-Attention Framework for Colposcopic CIN Grading and Swede Score Prediction Using a New Multi-Center Dataset
链接：https://arxiv.org/abs/2609.12827
作者：Dania Khan,Nuzhat Aisha Shaikh,Asfina Hassan Juicy,Raiyun Kabir,S M Shahida,Taufiq Hasan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cervical Intraepithelial Neoplasia, major global health, disease burden falling, burden falling disproportionately, global health challenge
备注： 8 pages
点击查看摘要
Abstract:Cervical cancer is a major global health challenge, with disease burden falling disproportionately on low- and middle-income countries (LMICs) due to a shortage of trained specialists and the subjective nature of colposcopy-based screening. To address this challenge, we propose a novel deep learning framework for the automated grading of Cervical Intraepithelial Neoplasia (CIN) and the prediction of clinical Swede scores. We also introduce the BUET Multi-Center Colposcopy Dataset, a novel, multi-center cohort designed and annotated for Swede score prediction and CIN grading. Our proposed dual-stream cross-attention architecture mimics the visual reasoning of an expert colposcopist by explicitly fusing paired multimodal cervigrams to evaluate comparative tissue responses. Furthermore, we introduce a custom composite loss function to address severe class imbalances and scoring inconsistencies across the five Swede score components. The proposed framework achieved 71.85% accuracy and an 86.23% AUC-ROC for three-class CIN grading, outperforming existing methods. For Swede score component prediction, the architecture achieved AUC-ROC values ranging from 75.7% to 88.4%, with the composite loss function yielding consistent F1-score improvements. Finally, the total predicted Swede Score, which ranges between 0 and 10, shows a Mean Absolute Error (MAE) of 1.489. The results show that the proposed method can pave the way towards developing AI-assisted colposcopy screening tools to support risk-based triage in resource-limited healthcare settings. The dataset and source code are publicly available(url: this https URL)
27. 【2609.12826】CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs
链接：https://arxiv.org/abs/2609.12826
作者：Jonathan Sauder,Thomas Ruckli,Gabrielė Strodomskytė,Ibrahim Souleiman Abdallah,Rahma Hassan Abdi,Djama Goumaneh Awaleh,Mohamed Houssein Farah,Moustapha Nour,Osama Sharhubil Saad,Mustafa Mohammed Khalafallah Altaib,Maysoon Kteifan,Farah Alsoqi,Eyad Zgool,Jafar Al-Omari,Temesgen Gebremeskel Gebreluel,Zekaria Zekeria Abdulkerim,Meron Ghirmay,Teklehaimanot Beraki,Devis Tuia,Guilhem Banc-Prandi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：scaled up dramatically, conservation and restoration, restoration strategies, strategies to counter, counter the global
备注：
点击查看摘要
Abstract:In order to design conservation and restoration strategies to counter the global decline of coral reefs, ecological monitoring of reefs needs to be scaled up dramatically. Computer vision methods are increasingly used to tackle the vast amount of data: as the paradigm of data collection in reefs shifts from highly standardized and constrained survey images to unconstrained imagery on scalable platforms, it is necessary to design machine learning methods that help to get a fine-grained understanding of reefs from general-purpose reef imagery. This paper provides CoralscapesV2, an extension of the Coralscapes dataset for general-purpose visual scene understanding in reefs. CoralscapesV2 increases the dataset size, scope, label completeness and quality for semantic segmentation, and extends the number of classes from 39 to 95 fine-grained visual categories. Furthermore, CoralscapesV2 provides 65k exhaustive fish instance mask annotations, meticulously annotated to completeness by using the video, revealing that annotation of fish based on only static images is insufficient. CoralscapesV2 is the first dataset for panoptic segmentation in coral reefs, capturing a wide range of scenarios in the wild, posing a challenging benchmark for contemporary semantic segmentation and instance segmentation models. CoralscapesV2 is an important step towards general-purpose panoptic segmentation in coral reefs, which has substantial implications for scaling up coral reef monitoring, as it can be employed in a wide range of applications from benthic cover mapping from robot or handheld videos to designing methods for automated quantification and understanding of fish behavior and fish-reef interactions.
28. 【2609.12825】SCDM: Spatial-Contextual Disentanglement Mamba via Differential Inference for Efficient Image Classification
链接：https://arxiv.org/abs/2609.12825
作者：Mustafa Bora Çelik,Hayriye Aktaş Dinçer,Ayse Keles
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：State Space Models, State Space, medical image analysis, modeling long-range dependencies, image analysis
备注： 9 pages, 5 figures
点击查看摘要
Abstract:State Space Models (SSMs), particularly VMamba, have emerged as efficient alternatives for modeling long-range dependencies in medical image analysis. However, distinguishing subtle pathological features from visually similar anatomical backgrounds remains a significant challenge. Existing SSM architectures often learn entangled representations, lacking explicit mechanisms to separate disease-specific signals from normal anatomy. To address this limitation, we propose Spatial-Contextual Differential Mamba (SCDM), an asymmetric dual-branch architecture designed for selective representational disentanglement. SCDM introduces a Positive Branch for extracting discriminative features and a Negative Branch that actively models and suppresses normal anatomical context. This separation is achieved through a similarity-driven repulsion gate and a differential inference rule, which promote competitive feature learning without requiring additional branch labels or increasing model capacity. Evaluated on the RSNA Pneumonia dataset, SCDM achieves competitive classification performance (AUC of 0.858) while requiring significantly fewer parameters (29.4M) and FLOPs (1.44G) compared to standard VMamba and vision transformer baselines. Furthermore, activation analyses demonstrate that our differential mechanism yields highly precise localization, effectively isolating lesions by inhibiting irrelevant anatomical distractors.
29. 【2609.12818】Online Video Agent Harness for Long Video Understanding
链接：https://arxiv.org/abs/2609.12818
作者：Sen Yang,Boqiang Duan,Jing Yang,Weihao Bo,Jie Liu,Boyuan Tong,Ze Feng,Wenkang Zhang,Jingdong Wang,Hua Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：long temporal spans, Long video understanding, packing dense frames, temporal spans, high cost
备注： 35pages, 12 tables, 10 figures
点击查看摘要
Abstract:Long video understanding often behaves like a visual needle-in-a-haystack problem: query-relevant evidence is sparsely distributed across long temporal spans, while packing dense frames into a single VLM context incurs \textit{context rot} and high cost. Existing video agents often rely on query-agnostic offline preprocessing or ad hoc tool sets, which can miss query-specific details and waste computation. In this work, we present VideoXAgent, a purely online video-agent harness for long video understanding that starts from the given video file and user query, plans and decomposes the task, invokes specialized expert tools on demand, and aggregates multimodal evidence to produce a final answer while resolving conflicts among observations. To support this on-demand invocation, we design a suite of heterogeneous expert tools guided by a data-driven taxonomy of atomic capabilities, spanning scripts, VLMs, and domain models (e.g., detection, OCR, ASR, face recognition). The harness further enforces objective evidence prompting and budget-aware control to curb hallucination and non-termination. Across Video-MME-Long, LongVideoBench-Long, LVBench, and MINERVA, VideoXAgent is competitive with frontier LMMs and video agents under a smaller context footprint---about 50k tokens of agent context per sample, even on hour-long videos. In particular, on complex video-reasoning benchmarks such as MINERVA, it matches this level while using only about 15\% of the context of a 1,024-frame dense-packing baseline. Notably, the harness remains effective with a visually weak or even text-only orchestrator, suggesting that strong long-video understanding can emerge from progressive agentic evidence seeking rather than from packing the full video into a single context. Project page: this https URL
30. 【2609.12798】LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection
链接：https://arxiv.org/abs/2609.12798
作者：Zhuangfan Huang,Xiaosong Li,Yang Liu,Tao Ye,Haishu Tan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Camouflaged object detection, intelligent optical perception, important engineering task, targets closely resemble, Camouflaged object
备注：
点击查看摘要
Abstract:Camouflaged object detection (COD) is an important engineering task in intelligent optical perception, but it remains challenging when targets closely resemble their surroundings. Polarization imaging provides complementary physical cues, whereas existing methods typically assume fixed multimodal input configurations and entangle intra-polarization coordination with interaction between red-green-blue (RGB) and polarization representations. We propose LGFN, a lightweight gated RGB-polarization fusion framework supporting separately optimized RGB-only and polarization-assisted configurations. A deterministic Modality Router selects the appropriate configuration according to polarization availability. In the multimodal configuration, an availability-conditioned Modality Gate calibrates the available polarization branches; the Gated Polarization Hub coordinates learned degree of linear polarization (DoLP) and angle of polarization (AoP) representations with explicit polarization cues; and RGB-Polarization Cross Fusion introduces the coordinated representation into the RGB hierarchy through controlled residual interaction. The multimodal configuration requires neither sample-dependent statistics nor handcrafted quality descriptors during inference. On the complete 230-image PCOD_1200 test set, the RGB-only configuration achieves a mean absolute error of 0.0090, a Dice score of 0.8806, and an intersection over union of 0.8144, obtaining the best results on all six metrics among the evaluated RGB-based methods. Under a common local reevaluation protocol, the multimodal configuration outperforms PolarNet and IPNet on all six metrics. Relative to IPNet, it reduces the parameter count, floating-point operations, and latency by 53.1%, 73.6%, and 63.0%, respectively.
31. 【2609.12787】LG-PF: Lightweight Confidence-Guided Polarization Image Fusion
链接：https://arxiv.org/abs/2609.12787
作者：Zhuangfan Huang,Zhenyu Kuang,Gao Wang,Yang Liu,Haishu Tan,Xiaosong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：combines the stable, stable luminance, degree of linear, Polarization, Context-aware Bounded Correction
备注：
点击查看摘要
Abstract:Polarization image fusion combines the stable luminance and structural information of the total- intensity image S0 with the material-sensitive details of the degree of linear polarization (DoLP) image. However, the reliability of DoLP varies spatially, and indiscriminate polarization transfer may amplify unstable responses or disturb the structural appearance anchored by S0. We therefore propose LG-PF, a lightweight confidence-guided framework that formulates polarization fusion as a selective residual transfer process. A Polarization Confidence Prior estimates spatially reliable polarization responses, a Mask-guided Multi-scale Fusion module regulates their transfer across three feature scales, and a Lightweight Context-aware Bounded Correction Head stabilizes local photometric and structural transitions. Confidence guidance is also incorporated into the optimization objectives to preserve reliable polarization details while suppressing unsupported responses. We also construct MSP, a multi-scene polarization fusion dataset containing 1000 pixel-aligned image pairs from 17 indoor and outdoor scene categories. LG-PF achieves the best results across all six evaluated metrics on MSP, while subset-based evaluations on PIF and GAND show promising transferability without fine-tuning. With only 0.2936 M parameters and an inference time of 21.712 ms per image, LG-PF achieves competitive fusion quality with low computational cost. The source code, dataset, and official data splits will be made publicly available upon publication.
32. 【2609.12771】MPT: Missing Prototype Tracking via Barycentric Reconstruction in Vehicular Federated Learning
链接：https://arxiv.org/abs/2609.12771
作者：Hanju Jang(1),Gyeongmin Han(1),Sungmin Lee(1),Kichang Lee(1),Chunghan Lee(2),JeongGil Ko(1) ((1) Yonsei University, (2) Toyota Motor Corporation)
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：federated learning enables, collaboratively improve perception, improve perception models, keeping locally collected, locally collected driving
备注： 9 pages, 7 figures
点击查看摘要
Abstract:Cross-vehicle federated learning enables vehicles to collaboratively improve perception models while keeping locally collected driving data private. However, vehicle participation is transient, and a vehicle may depart before training converges while permanently taking its local data. When this departing vehicle holds most samples of a target class, the class becomes rare in the remaining FL network, and its recognition can silently degrade as the shared backbone continues to evolve. Recovering the class is difficult since the few remaining samples provide a noisy prototype estimate, while FL privacy constraints prevent centralized access to raw data or per-sample features. This paper presents MPT, a cross-vehicle FL framework that maintains rare-class recognition by reconstructing its prototype at every round from privacy-preserving class-level statistics. MPT combines a barycentric decomposition that tracks drift shared with remaining-class prototypes, a covariance-based residual prediction that estimates out-of-span drift, and an adaptive calibration that weighs the remaining rare-class samples according to their reliability. We evaluate MPT on three vehicle classification tasks and four backbones against representative calibration and drift-compensation baselines. MPT outperforms all baselines in rare class F1, reaching 0.516 on the nuImages dataset with only 1\% of rare-class samples remaining, without raw data, per-sample features, or retraining.
33. 【2609.12761】Same Encoder, Different Winner: A Paired-View Framework for Cell Painting Encoder Evaluation
链接：https://arxiv.org/abs/2609.12761
作者：Tim Treis,Nikita Moshkov,Johan Fredin Haslum,Shantanu Singh,Fabian J. Theis
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)
关键词：Cell Painting encoders, Vision encoders, Cell Painting, average precision, typically ranked
备注： 22 pages, 6 figures
点击查看摘要
Abstract:Vision encoders for Cell Painting are typically ranked by a single evaluation, commonly replicate mean average precision (mAP). We introduce CP-BG-Bench, a paired-view evaluation framework that holds the central cell fixed across four matched views (raw crop C, segmented S, and density-augmented variants CD and SD), ablating or augmenting surrounding pixels as a controlled intervention. Instantiating the framework on three datasets (JUMP-CP, RxRx1, RxRx3-core) and three encoders (DINOv3 ViT-B/16, OpenPhenom, SubCell) under four community-standard protocols (replicate mAP, scIB batch integration, CellProfiler feature prediction, cross-batch perturbation recall), we find that the four protocols rank the same encoders systematically differently, with disagreements decomposing along three axes: cell versus background, morphology versus context, and within-study versus across-batch. The largest effect: on RxRx3-core, SubCell with segmented inputs retains 94% of crop replicate mAP but only 32% of crop R@10, so the within-study signal preserved under segmentation is largely non-transferable; density augmentation recovers 84% of the within-study C-to-S gap but only 8% of the cross-batch gap. Segmented views predict CellProfiler features as well as or better than crops on two of three datasets, inverting the replicate-mAP ranking, and the C-to-S gap varies by an order of magnitude across datasets while remaining similar across encoders, indicating that background-driven gain is set by experimental design rather than by the encoder. Single-metric ranking of Cell Painting encoders is therefore sensitive to the protocol used, and protocol disagreements are interpretable as projections onto the three axes the paired-view design exposes. We will release the paired-view datasets, reconstruction pipelines, 36 trained checkpoints, aggregated embeddings, and the full evaluation suite.
34. 【2609.12744】AquaCubeAI-Powered Monitoring Turbidity on-board Φsat-2
链接：https://arxiv.org/abs/2609.12744
作者：Pietro Di Stasio,Francesca Razzano,Elisa Liparulo,Gabriele Meoni,Nicolas Longépé,Deodato Tapete,Paolo Gamba,Gilda Schirinzi,Silvia Liberata Ullo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：conventional satellite workflows, satellite workflows rely, evolving turbidity events, coastal water quality, rapidly evolving turbidity
备注： 16 pages, the paper is under review on IEEE JSTARS
点击查看摘要
Abstract:Timely monitoring of coastal water quality is critical for environmental protection, yet conventional satellite workflows rely on downlink and ground processing, introducing latency that can limit responsiveness to rapidly evolving turbidity events. To address this limitation, we propose AquaCubeAI, a lightweight machine-learning approach for onboard estimation of coastal water turbidity from {\Phi}sat-2 multispectral imagery. By shifting inference from the ground segment to the satellite, AquaCubeAI aims to enable lower-latency, more responsive, and more operationally useful turbidity monitoring under the strict compute and bandwidth constraints of spaceborne platforms. The model is trained on simulated {\Phi}sat-2 acquisitions spatially aligned with Copernicus Marine Service (CMEMS) High-Resolution Ocean Color (HR-OC) turbidity products over selected localized coastal sites spanning four European marine macro-regions. To provide a realistic evaluation of generalization in the presence of spatial correlation, we adopt a spatial block splitting protocol that mitigates data leakage between training and evaluation subsets. The main contributions of this work are: (i) a scalable dataset generation pipeline pairing simulated {\Phi}sat-2 multispectral patches with CMEMS HR-OC turbidity labels across selected localized European coastal sites; (ii) a compact Multi-Layer Perceptron (MLP)-based turbidity regressor trained under a leakage-aware geospatial split and tailored to embedded constraints; and (iii) a reformulation for dense spatial prediction via parameter sharing, enabling turbidity mapping and simple threshold-based anomaly masks for onboard decision logic. Embedded deployment on an Intel Myriad Vision Processing Unit (VPU) further confirms the feasibility of low-power hardware and supports low-latency inference from multispectral inputs.
35. 【2609.12735】Physics-Guided Synthetic High-Frequency Ultrasound Generation for Skin Layer Segmentation
链接：https://arxiv.org/abs/2609.12735
作者：Junkyung ju,Kyungho Yoon,Minwoo Shin
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：automated skin-layer analysis, High-frequency ultrasound, enables noninvasive visualization, densely annotated data, synthetic HFUS
备注： 12 pages, accepted at MICCAI DH4H Workshop 2026
点击查看摘要
Abstract:High-frequency ultrasound (HFUS) enables noninvasive visualization of superficial skin structures, but automated skin-layer analysis is limited by the scarcity of densely annotated data. Existing real HFUS datasets commonly provide annotations for superficial targets such as the epidermis and subepidermal low-echogenic band (SLEB), while dense labels for deeper structures such as dermis, subcutaneous tissue, fascia, and muscle are rarely available. We propose a physics-guided synthetic HFUS generation framework for skin layer segmentation. The framework constructs multilayer acoustic skin phantoms, assigns layer dependent acoustic properties, and uses k-Wave simulation to generate paired synthetic HFUS images, dense layer masks, and simulation metadata. To evaluate whether the generated data provide transferable supervision, we use it for downstream segmentation pretraining and fine-tune the models on real Mendeley HFUS data. Synthetic pretraining followed by real fine-tuning achieved real-domain performance comparable to real-only training and improved mean Dice/IoU in three of four evaluated trainable architectures. These results suggest that physics-guided synthetic HFUS images contain transferable anatomical and textural cues for real-domain skin layer segmentation, although further reduction of the synthetic-real appearance gap is needed to enable greater gains. The code and data are available at: this https URL.
36. 【2609.12731】GRACE: Adaptive Concept Erasure with Geometry-Guided Retention in Diffusion Models
链接：https://arxiv.org/abs/2609.12731
作者：Qinghui Gong,Yihuai Liang,Yuanlun Xie,Deepak Kumar Jain,Vitomir Štruc,Zhengchun Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：necessitating post-hoc concept, large-scale pretraining data, inevitably internalize sensitive, diffusion models inevitably, models inevitably internalize
备注： 14 pages,12 figures
点击查看摘要
Abstract:Text-to-image (T2I) diffusion models inevitably internalize sensitive or non-compliant concepts from large-scale pretraining data, necessitating post-hoc concept erasure. However, existing erasure methods often lack explicit constraints on parameter updates, leading to over-intervention and unintended semantic drift. In addition, many methods rely on manually crafted counterfactual supervision, such as surrogate prompts, which incurs substantial data construction costs that limit scalability to new concepts. To address these limitations, we propose GRACE, a structured concept erasure framework designed to enable localized and selective intervention. Specifically, we introduce a semantically weighted sensitive subspace estimation to precisely lock intervention directions, and employ lightweight subspace-constrained adapters to prevent global semantic disturbance. To eliminate the dependency on manual prompt engineering, we design an automatically decoupled safe-anchor mechanism. To mitigate semantic drift induced by excessive intervention, we introduce an energy-driven dynamic gating mechanism that adaptively controls the timing and strength of intervention at inference. Extensive experiments demonstrate that our method achieves a superior balance between erasure effectiveness and generation fidelity. Compared with the average performance of five state-of-the-art (SOTA) concept erasure methods, our method improves the fine-grained NSFW reduction rate by $17.86\%$, while reducing the macro-averaged target CLIP Score and preservation-oriented Fréchet Inception Distance (FID) by $4.75\%$ and $50.58\%$, respectively, indicating stronger concept suppression with substantially improved preservation of the original model's generative utility.
37. 【2609.12723】Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations
链接：https://arxiv.org/abs/2609.12723
作者：Xavier Anadón,Rémi Pautrat,Rui Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vector CAD drawings, sensor-derived density maps, vector CAD, CAD drawings, Multimodal Floorplan Encoder
备注： Presented at the ECCV 2026 TwinWorld Workshop
点击查看摘要
Abstract:Floorplans arise in many forms, from vector CAD drawings to raster renderings and sensor-derived density maps. This heterogeneity makes it difficult to build learning systems that transfer across modalities and support geometry-centric tasks such as alignment and retrieval. We introduce the Multimodal Floorplan Encoder (MMFE), which maps diverse 2D indoor representations into a shared dense latent grid. MMFE combines a frozen DINOv3 backbone with a trainable Dense Prediction Transformer (DPT) head, and is trained with a per-cell Information Noise-Contrastive Estimation (InfoNCE) objective that aligns spatially corresponding regions across modalities while using all other cells as negatives. To improve robustness to geometric distortions, we incorporate controlled similarity transformations and enforce geometric consistency through feature-grid warping. On Structured3D, a held-out out-of-domain dataset, MMFE improves cross-modal dense matching, enables robust similarity alignment with RANSAC, and yields strong retrieval when paired with learned aggregation.
38. 【2609.12705】ExpertHTR: Unified Handwritten Text Recognition with Multi-Task Learning and Sparse Mixture-of-Experts
链接：https://arxiv.org/abs/2609.12705
作者：Dang Hoai Nam,Nguyen Duy Hieu,Quang Huu Hieu,Vo Nguyen Le Duy
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Handwritten text recognition, page-level training difficult, making joint page-level, Handwritten text, document structure
备注：
点击查看摘要
Abstract:Handwritten text recognition resources are often small and distributed across collections that differ in language, script, document structure, and annotation format, making joint page-level training difficult. We propose ExpertHTR, a unified vision-language framework that addresses this problem through complementary supervision and conditional model capacity. Structural annotations from heterogeneous datasets are first organized through a common Page-Region-Line representation and used to construct four related training tasks for complete transcription, physical-line coverage, text localization, and localized recognition, without requiring additional manual labels. Building on a jointly trained dense model, ExpertHTR introduces a sparse Mixture-of-Experts architecture with an always-active shared branch and conditionally routed full-MLP experts. Sparsegen allows the number of active routed experts to vary with the hidden representation, while routing regularization reduces persistent concentration on a small subset of experts. Experiments on seven heterogeneous handwriting benchmarks show that complementary supervision consistently improves training with page transcription alone, while joint multi-source training provides further gains on most datasets. The proposed sparse expert model further improves the dense baseline on six of the seven sources. The final unified model also substantially outperforms the evaluated general-purpose OCR and vision-language systems on most benchmarks and achieves state-of-the-art performance on the IAM paragraph-level benchmark, while specialized HTR systems remain stronger on several challenging collections.
39. 【2609.12691】Semantically Aligned Gradient-Driven Context-Preserving Image Editing
链接：https://arxiv.org/abs/2609.12691
作者：Chiranjeev Chiranjeev,Muskan Dosi,Mayank Vatsa,Richa Singh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Instruction-guided image editing, training-time blind spot, Instruction-guided image, blind spot, image editing
备注：
点击查看摘要
Abstract:Instruction-guided image editing has a training-time blind spot. Generative editors are never required to semantically verify whether their outputs actually satisfy the instruction. Supervision stops at reconstruction and input textual-level conditioning. This produces incomplete edits, spatial spillover, and poor localization. We present IABEdit, a model-agnostic framework that embeds differentiable semantic verification into training. A frozen vision-language model extracts spatially-aware descriptors from the ground-truth edit. A trainable aligner then reproduces them from the generated output. The residual between the two becomes a gradient that teaches the generator both what to edit and where, with no inference-time VLM cost. IABEdit is compatible with diverse backbones, including U-Net (Stable Diffusion) and MMDiT (FLUX), without altering their inference pipelines. On MagicBrush, it improves structural fidelity by +3.49 DINO-I over the best diffusion baseline and +1.26 over the best overall baseline, while remaining competitive on instruction alignment. It also achieves state-of-the-art instruction adherence performance on RealEdit and EMU Edit benchmarks based on embedding-based metrics. Most consequentially, on the D-LORD surveillance benchmark, it surpasses the proprietary Gemini agent by +5.13 DINO-P under heavy occlusion, where preserving identity is hardest. This shows that gradient-aligned VLM distillation holds up under real-world-like surveillance and occlusion conditions. Human and GPT-4o evaluations confirm perceptually precise, well-localized edits.
40. 【2609.12682】NOVA-GS: Noise-Aware View-Consistent Gaussian Splatting for Low-Light Novel View Synthesis
链接：https://arxiv.org/abs/2609.12682
作者：Shaurya Pavan A,Vemunuri Divya Madhuri,Yash Pradeep Gawande,Kaushik Mitra
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：severe sensor noise, conditions remains challenging, remains challenging due, low-light conditions remains, sensor noise
备注： Accepted to the 3D4S Workshop at CVPR 2026; selected for the Best Paper Award
点击查看摘要
Abstract:Reconstructing 3D scenes under real-world low-light conditions remains challenging due to severe sensor noise, low signal-to-noise ratios, and degraded photometric consistency, which destabilize geometry estimation and novel view synthesis. Existing approaches often rely on well-lit reference data for reliable Structure-from-Motion (SfM) initialization under degraded inputs or apply per-view enhancement methods that introduce cross-view inconsistencies. To address these limitations, we propose \textbf{NOVA-GS}, a unified noise-aware framework for low-light 3D Gaussian Splatting that subsumes enhancement, denoising, and geometry optimization within a single process. Our method leverages VGGT-based feed-forward estimation to obtain robust camera poses and geometry directly from degraded inputs, eliminating the need for SfM. Building on this initialization, NOVA-GS integrates three coupled components: a structure-aware enhancement module for exposure correction, a self-supervised denoising module with blind-spot masking for pseudo-supervision, and a consistency-driven Gaussian Splatting optimization enforcing cross-view geometric coherence. We further introduce a noise-guided spherical harmonic regularization to suppress view-dependent artifacts in noisy regions. Extensive experiments on diverse real-world low-light datasets demonstrate improved geometric fidelity, color consistency, and robustness without requiring paired supervision or well-lit references. this https URL
41. 【2609.12678】Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence
链接：https://arxiv.org/abs/2609.12678
作者：Yifeng Luo,Yupeng Li,Ming Tang,Jianxiong Guo,Liang Lan
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Short-video platforms, primary news source, enabled the widespread, widespread dissemination, dissemination of fake
备注： Accepted to the Findings of EMNLP 2026
点击查看摘要
Abstract:Short-video platforms have become a primary news source for the public, which has also enabled the widespread dissemination of fake news videos. We study the task of fake news video detection and explanation (FNVDE). Existing methods face two critical limitations. First, commonly used frame selection strategies may omit veracity-relevant cues or provide insufficient temporal context for understanding news videos. Second, prior methods neglect either multimodal understanding or evidence retrieval. To address these limitations, we propose NVKE-CEI, a unified system that integrates a news video keyframes extraction method (NVKE) and an FNVDE framework leveraging both content and evidence information (CEI). NVKE selects keyframes based on chronological changes in combined visual and OCR-text similarity. CEI employs two specialized LLM-based fact checkers (content-based and evidence-based) whose outputs are fused by a lightweight judge model. Extensive experiments show that NVKE-CEI outperforms state-of-the-art baselines while generating high-quality content-grounded explanations.
42. 【2609.12668】Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos
链接：https://arxiv.org/abs/2609.12668
作者：Chenxi Yang,Yassine Ouzar,Larbi Boubchir
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent deepfake detection, detection studies increasingly, deepfake detection studies, suggest remote photoplethysmography, studies increasingly suggest
备注：
点击查看摘要
Abstract:Recent deepfake detection studies increasingly suggest remote photoplethysmography (rPPG) signals as an authenticity cue. However, existing benchmarks lack physiological ground truth, and current detectors underexplore the cross-level relationship between facial features and physiological dynamics, often relying on late fusion or rPPG features alone. In this paper, we construct high-fidelity deepfake manipulations on established real rPPG datasets (COHFACE and UBFC-rPPG) to investigate how forgeries disrupt natural physiological signals and facial behavior at the same time. Building on this analysis, we propose a bidirectional co-attention fusion detector that jointly models rPPG and facial behavior tokens. This mechanism explicitly captures the cross-level dependencies between pulse dynamics and facial motion to learn a robust, joint authenticity representation. Extensive experiments using a subject-disjoint 5-fold evaluation demonstrate the superiority of our approach. Achieving a 92.80\% AUC on constructed datasets using face swapping and 96.78\% AUC on motion transfer, our model outperforms both the rPPG-only single modality baseline and the best feature-level fusion methods. Furthermore, transfer-learning result of the fusion detector on Celeb-DF-v2 while keeping both feature extractors fixed achieves 91.20\% accuracy and 86.08\% AUC, which suggests applicability under target-domain adaptation.
43. 【2609.12663】What Did the MLLM Hear? Token-Level Spectro-Temporal Grounding for Audio MLLM Explainability
链接：https://arxiv.org/abs/2609.12663
作者：Lucia Cascone,Valeria Fraenza,Michele Nappi,Fabio Narducci,Benedetto Simone
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Large Language Models, Multimodal Large Language, Audio-based Multimodal Large, Language Models, generate detailed natural-language
备注：
点击查看摘要
Abstract:Audio-based Multimodal Large Language Models (MLLMs) can generate detailed natural-language descriptions of complex acoustic scenes, yet it remains unclear which parts of the input audio support each generated token. This is particularly challenging because acoustic evidence is distributed across time and frequency, and concurrent sound events may overlap temporally while occupying different spectral regions. We introduce STAG, to our knowledge the first post-hoc framework for token-level spectro-temporal grounding of captions generated by audio-based MLLMs. STAG estimates the temporal support for each generated token using target-token-specific vocabulary projections of the encoded audio representations, measures frequency-band relevance through controlled spectral occlusion, and combines the two signals into a spectro-temporal relevance map. We evaluate STAG against ten post-hoc explanation methods across four grounding benchmarks, where it achieves the best event-localization performance on every dataset, and apply it to eight audio-language backbones without parameter updates. Counterfactual deletion further shows that removing the identified evidence selectively reduces confidence in the corresponding event and frequently removes it from the regenerated caption. These results provide behavioral support for the faithfulness and selectivity of the explanations.
44. 【2609.12627】Geometric-to-Semantic Spherical Transfer Learning for Cortical Sulci Labeling
链接：https://arxiv.org/abs/2609.12627
作者：Saeb Tounsi,Joël Chavas,Pietro Gori,Vincent Frouin,Denis Rivière,Jean-François Mangin
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：hemisphere requires high-capacity, cortical surfaces faces, requires high-capacity models, Deep learning, inevitably causes overfitting
备注： Submitted to MICCAI 2026 on February 26, 2026; early accepted on May 7, 2026. This is the original submitted version (preprint) of the paper. The final camera-ready version will appear in the MICCAI 2026 proceedings
点击查看摘要
Abstract:Deep learning on cortical surfaces faces a dilemma: capturing the complex topology of over 60 nomenclature-dependent sulci per hemisphere requires high-capacity models, yet the extreme scarcity of expert annotations ($N=62$ subjects) inevitably causes overfitting. Standard supervised approaches fail to generalize in this data-scarce regime, particularly for variable and small sulci where topological ambiguity is high. To overcome this limitation, we introduce a Geometric-to-Semantic Spherical Transfer Learning framework. First, we leverage massive unlabeled data (UK Biobank, $\approx$30,000 subjects) to pre-train a spherical encoder using a locally-optimized strategy. By relying solely on continuous surface features (curvature and depth), the relevance of this pre-training is confirmed by the model's ability to detect localized and rare topological traits, such as sulcal interruptions. The downstream labeling task, however, introduces extracted sulcal fundi (lines) as an explicit semantic input. To bridge this dimensional domain gap (from purely geometric to semantic) without causing catastrophic forgetting, these anatomical lines are integrated into the pre-trained backbone via a soft-initialized Topological Prior Injector. Our experiments demonstrate that this approach outperforms fully supervised baselines trained from scratch, achieving a mean Dice of 0.77. Crucially, a local analysis reveals that the self-supervised geometric priors yield the largest performance gains on variable and tertiary sulci (up to 14.8%), confirming that learning the cortex shape is highly beneficial for identifying its rarest parts.
Comments:
Submitted to MICCAI 2026 on February 26, 2026; early accepted on May 7, 2026. This is the original submitted version (preprint) of the paper. The final camera-ready version will appear in the MICCAI 2026 proceedings
Subjects:
Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.12627 [cs.LG]
(or
arXiv:2609.12627v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2609.12627
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
45. 【2609.12622】RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradation
链接：https://arxiv.org/abs/2609.12622
作者：Hongbo Gao,Zhengyu Li,Xueru Nie,Dihao Zhu,Lijun Zhao,Yunke Wang,Chang Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：detection leverages complementary, leverages complementary cues, challenging environments, object detection leverages, salient object detection
备注： Accepted at ECCV 2026
点击查看摘要
Abstract:RGB-Thermal (RGB-T) salient object detection leverages complementary cues from visible and thermal modalities to improve robustness in challenging environments. However, in real-world scenarios, the reliability of each modality is inherently unstable: RGB images degrade under low illumination, motion blur, and noise, while thermal imagery often suffers from contrast compression and sensor artifacts. Such degradation introduces unreliable perceptual evidence that can mislead cross-modal fusion and significantly deteriorate detection performance. To address this challenge, we propose RA-SOD, a reliability-aware RGB-T salient object detection framework that explicitly models modality reliability and integrates it into feature learning and cross-modal fusion. First, we introduce a reliability-conditioned representation that adaptively compensates degraded modality features while preserving structural cues. Second, an uncertainty-guided dual-stream refinement strategy progressively corrects cross-modal representations while suppressing unreliable evidence. Finally, we propose a pixel-wise modality competition mechanism that dynamically selects modality cues according to spatial reliability for fine-grained fusion. Extensive experiments on four benchmarks (VT821, VT1000, VT5000, and VT-IMAG) demonstrate that RA-SOD achieves state-of-the-art performance and exhibits strong robustness under severe modality degradation. Code and models are available at this https URL.
46. 【2609.12577】SCORE: SubDistribution-aware Collaborative Knowledge Reinforcing for Cloth-Hybrid Lifelong Person Re-Identification
链接：https://arxiv.org/abs/2609.12577
作者：Kunlun Xu,Liangyu Ma,Jiangmeng Li,Xin Tong,Xiaode Liu,Yufei Guo,Jiahuan Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Lifelong Person Re-Identification, unified person retrieval, person retrieval model, non-stationary data stream, Lifelong Person
备注： Accept by ECCV 2026
点击查看摘要
Abstract:Lifelong Person Re-Identification (LReID) aims to train a unified person retrieval model from a non-stationary data stream. Existing LReID methods mainly focus on scenarios where the clothing of each person is consistent. Recently, the Cloth-Hybrid LReID (CH-LReID) where cloth-consistent and cloth-changing data alternately occur, has emerged as a more practical and challenging scenario. Due to the conflict between clothing-relevant and clothing-irrelevant knowledge, the well-known catastrophic forgetting problem is significantly exacerbated in this task. To address this issue, we propose a SubDistribution-aware COllaborative Knowledge REinforcing (SCORE) framework, where our key idea is explicitly modeling the intra-identity diversity to continually consolidate distinct cloth-consistent and cloth-changing knowledge. Specifically, an Adaptive SubDistribution Modeling mechanism is developed, where a set of distributional subprototypes is assigned to each identity to capture the intra-identity diversity, improving the compatibility between cloth-consistent and cloth-changing knowledge. Then, a Distributional Knowledge Reinforcement scheme is introduced, where the knowledge of old distributional subprototypes is retained in the new ones by a collaborative aligning mechanism. Extensive experiments show that our SCORE achieves the state-of-the-art performance. Our code is available at this https URL
Comments:
Accept by ECCV 2026
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.12577 [cs.CV]
(or
arXiv:2609.12577v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.12577
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
47. 【2609.12574】An Ultra-Widefield Swept-Source OCTA Dataset and a Polar-Gated Mamba Network for Retinal Vessel Segmentation
链接：https://arxiv.org/abs/2609.12574
作者：Yang Liu,Yibing Shen,Keming Zhao,Cenk Jiang,Zhenghang Qian,Zhicheng Du,Chen Xiong,Qidong Shao,Zijun Lin,Yunqi Hu,Jingjing Zhou,Lian Zhang,Peter E. Lobie,Peiwu Qin,Chengming Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：retinal vascular imaging, quantitative vascular analysis, swept-source optical coherence, coherence tomography angiography, enables large-area retinal
备注： Submitted to IEEE Journal of Biomedical and Health Informatics. Under review
点击查看摘要
Abstract:Ultra-widefield (UWF) swept-source optical coherence tomography angiography (SS-OCTA) enables large-area retinal vascular imaging, yet vessel segmentation at this scale lacks dedicated public benchmarks and comprehensive evaluation for quantitative vascular analysis. We introduce WOIVES, to our knowledge the first publicly available UWF SS-OCTA vessel-segmentation dataset, comprising 206 eyes from 152 participants with a 24x20mm^2 field of view. WOIVES spans emmetropia to high myopia and provides soft probability vessel annotations. We further propose PG-Mamba, a visual state space model that enhances conventional directional scans with two complementary polar-coordinate scan orders. An auxiliary Dynamic FOV Gating module performs spatial modulation at the bottleneck. PG-Mamba outperformed seven competitive approaches on broad segmentation metrics under cross-validation. It achieved the lowest median absolute errors for vessel density, fractal dimension, and vessel length density. WOIVES is publicly available on Zenodo (DOI: https://doi.org/10.5281/zenodo.21904672), and the PG-Mamba code is available at this https URL.
48. 【2609.12559】KAD-Net: Kinematics-Aware Decoupled Learning for Robust 3D Hand Pose Estimation from a Single Depth Image
链接：https://arxiv.org/abs/2609.12559
作者：Jun Lu,Zhenming Chen,Lin Chen,Kanlun Tan,Xiaoling Li,Qiao Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：single depth images, depth images struggle, hand pose estimation, pose estimation, Decoupled Learning Network
备注：
点击查看摘要
Abstract:Due to the complexity of hand kinematics and self-occlusion, existing 3D hand pose estimation methods based on single depth images struggle to comprehensively model the topological dependencies among hand joints. Furthermore, traditional hierarchical multitask architectures enforce a shared feature space for both 2D joint localization and depth estimation, which can induce mutual interference. To address these challenges, we propose a Kinematics-Aware Decoupled Learning Network (KAD-Net) for robust 3D hand pose estimation. Specifically, we first design a Finger Topology Constraint (FTC) module to enhance the representation of distal joints. This module utilizes three consecutive finger joints to construct a local kinematic representation to impose topological constraints, which supplements the kinematic features of the distal joints. The FTC module leverages the structural context from visible joints to assist in locating occluded distal joints, thereby improving robustness to occlusion. Additionally, we propose a task-decoupled hierarchical multitask framework. This framework separates 2D joint localization from depth estimation and incorporates a dedicated multitask learning strategy for depth regression, effectively isolating the UV and depth features to mitigate mutual interference and negative transfer. Extensive experiments demonstrate that KAD-Net outperforms existing methods on several benchmark datasets (ICVL, NYU, and MSRA), achieving state-of-the-art accuracy in 3D hand pose estimation. Potential applications of KAD-Net include human-computer interaction, virtual reality and gesture-based control systems.
49. 【2609.12557】DRS-VPT: Directly Relocalizing in a Scan with Vision Point Transformers
链接：https://arxiv.org/abs/2609.12557
作者：Lanke Frank Tarimo Fu,Maurice Fallon
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：feed-forward transformer architecture, architecture for foundational, feed-forward transformer, transformer architecture, present DRS-VPT
备注：
点击查看摘要
Abstract:We present DRS-VPT, a feed-forward transformer architecture for foundational image-to-scan registration. Given query images and a reference 3D point cloud, the model predicts the scan pose and point map alongside the poses and point maps of each camera, all expressed in the first camera's frame. It additionally predicts a coarse-to- fine pyramid of per-point and per-pixel features for direct reprojective alignment of the scan to the first image. This formulation unifies downstream tasks such as camera-LiDAR calibration in autonomous driving and indoor camera-to-map relocalization. A single DRS-VPT model achieves state-of-the-art performance for image-to-LiDAR registration in autonomous driving, competitive indoor relocalization without training map-specific weights, and strong zero-shot transfer to unseen environments. We also show qualitatively that the model learns complex scan-to-image projection properties such as occlusion of back-facing points.
50. 【2609.12552】RelateAnything: Real-Time Open-Vocabulary Relation Prediction From Any Inputs
链接：https://arxiv.org/abs/2609.12552
作者：Maëlic Neau
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：promptable segmentation returns, segmentation returns regions, class list, promptable segmentation, segmentation returns
备注：
点击查看摘要
Abstract:Open-vocabulary detection accepts any class list at inference, and promptable segmentation returns regions without class names: the taxonomy has left the model and become an input. Relation prediction has not. Scene-graph models are still trained and evaluated on the 50 or 56 predicates of one annotation style, their relation head conditioned on object labels and so tied to one detector. Three obstacles explain this, none primarily modelling: no relation corpus is both free-text and verified, a label-conditioned architecture cannot accept a vocabulary it was not trained on, and the standard metric rewards agreement with the training corpus, so a larger vocabulary scores as a regression. We present RelateAnything, a 53M-parameter model taking an image and regions from any source and returning scored relations over a predicate vocabulary supplied at inference as strings. Object labels are never an input, so the region source can change without retraining, and the vocabulary is a bank of text embeddings, not a learned classifier. It runs at 20 ms/frame. Training over 19,103 predicates requires positive-unlabeled supervision and a text encoder that separates antonyms, which contrastive encoders embed at cosine 0.95. To supply the supervision we build RA-4M, 474k images and 4.3M relations over 10,102 free-text predicates, generated against numbered box markers and geometrically verified. To measure it we build OV-SGG-Bench, six axes scored across datasets that the priors standard recall rewards cannot satisfy. On three cross-dataset benchmarks and a fourth zero-shot, RelateAnything has 2.3-3.5x the mean recall of the strongest open-vocabulary method of comparable scale, margins that survive a real detector, and leads a 3B-VLM scene-graph model on both metrics at under 2% of its parameters. In-domain measurement overstates transfer gains ~5x. Model, corpus and benchmark are public.
51. 【2609.12533】Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents
链接：https://arxiv.org/abs/2609.12533
作者：Zhutao Lv,Chenhao Dang,Yi Feng,Yanpei Gong,Xiaolei Wang,Junyan Ye,Conghui He,Weijia Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Real-world Earth observation, Real-world Earth, perform domain computations, Earth observation, translate high-level scientific
备注： 18 pages, 8 figures. The code and datasets of this work will be released soon
点击查看摘要
Abstract:Real-world Earth observation (EO) agents must translate high-level scientific questions into executable workflows to acquire observations, prepare data, perform domain computations, and derive conclusions from runtime evidence. Existing EO agents typically start from supplied observations, while benchmarks typically provide prepared inputs or candidate answers, leaving full-chain open-world EO execution largely untested. We present Earth-Agent-Pro, an execution-adaptive Plan-and-Execute framework using expert-authored skills to constrain planning and runtime tool use. Workflow-centered structured memory records planned steps, accepted evidence, and their dependencies, enabling repair of only the affected workflow suffix when runtime evidence invalidates a step. Separate large language model adapters use sequence-level supervised fine-tuning for planner workflow composition and node-level group relative policy optimization with locally verifiable rewards for executor tool-argument grounding. Earth-Bench-Pro instantiates 248 expert-curated task cores as 744 questions under three matched regimes. Its 248 Open-World Execution questions span RGB imagery, spectral observations, and remote sensing products, pairing high-level requests with runtime data requirements, executable trajectories, and open-ended answers grounded in execution evidence. With a shared GPT-5 backbone, Earth-Agent-Pro achieves 66.13% LLM-as-Judge accuracy, exceeding ReAct by 20.95 points in this metric and 24.44 points in Tools-In-Order. Joint adapter tuning raises Qwen3.5-9B LLM-as-Judge accuracy from 38.31% to 50.00%, an 11.69-point gain over the untuned configuration. Planning-only evaluation and execution with the reference workflow show that the adapters improve workflow composition and argument grounding, respectively. Code and datasets will be released soon.
52. 【2609.12521】Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screening
链接：https://arxiv.org/abs/2609.12521
作者：Yuan Yang,Shulei Li,Haobo Liang
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：Unmanned aerial vehicle, Unmanned aerial, aerial vehicle facade, vehicle facade inspection, combine red
备注： 9 pages, 3 figures. Preprint. Submitted to IEEE Sensors Journal
点击查看摘要
Abstract:Unmanned aerial vehicle facade inspection can combine red, green, and blue (RGB) imagery with thermal measurements to screen surface and subsurface anomalies. However, geometric discrepancies between the sensors and thermal image rendering can obscure spatial correspondence and weak temperature contrasts. This article presents a sensor-level pipeline comprising per-sensor correction, RGB-to-thermal registration, common-support cropping, and signed local contrast encoding of 16-bit radiometric measurements. The encoding preserves the distinction between locally hotter and colder regions and supplies the fourth input channel of a compact single-stream detector. We introduce M3T, a dataset of 674 paired RGB and radiometric thermal samples from five facade-inspection projects covering eight component and anomaly categories. The median residual registration error is 3.384 pixels, and a controlled-displacement analysis characterizes how the local contrast response changes under controlled displacement. Project-grouped four-fold evaluation yields mean average precision of 0.168 over intersection-over-union thresholds from 0.5 to 0.95, using 28.50 billion floating-point operations per image. A separate single-split ablation shows improved delamination detection over RGB-only and alternative thermal inputs, although aggregate accuracy does not improve over RGB alone. Evaluation on RGBT-Tiny shows mixed performance with rendered thermal imagery. These results characterize the category-specific benefits and limitations of aligned radiometric contrast for compact facade screening.
53. 【2609.12517】One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answering
链接：https://arxiv.org/abs/2609.12517
作者：Jian Hu,Zixu Cheng,Da Li,Wei Li,Ziquan Liu,Shaogang Gong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires locating decisive, locating decisive evidence, limited frame budget, Long-Video Question Answering, Question Answering
备注： A step toward recursive self-improvement (RSI) in video understanding by enabling multimodal agents to autonomously discover, evaluate, and route reusable skills for long-video reasoning
点击查看摘要
Abstract:Long-Video Question Answering (LVQA) requires locating decisive evidence in hour-scale videos under a limited frame budget. Most training-free methods apply the same frame-selection strategy to all questions, despite substantial variation in the evidence required by different question types. Our analysis shows that the relative effectiveness of frame-selection strategies varies across semantic categories and benchmarks, motivating adaptive evidence acquisition. In this paper, we introduce AutoSkill, a source-supervised framework for automatically discovering and routing executable frame-selection skills. Starting from a small labelled source pool, LLM agents iteratively propose, implement, evaluate, and refine candidate skills. For a target benchmark, AutoSkill uses only unlabelled question and option text to induce a shared semantic taxonomy, rewrite labelled source examples into the target style, and estimate a category-to-skill mapping. Neither target videos nor target answers are used in this process. At inference time, each question is assigned one skill, which selects the frames used in a single inference of the frozen video MLLM. Across five long-video benchmark splits, AutoSkill improves Qwen2.5-VL-7B and Qwen3.5-4B by 2.4% and 1.2%, respectively, demonstrating the effectiveness of our AutoSkill.
54. 【2609.12509】ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning
链接：https://arxiv.org/abs/2609.12509
作者：Khan Raiyan Ibne Reza,Sanjana Aktar Maria,Sumaiya Tabassum Nimi,Md Adnan Arefeen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limited for low-resource, low-resource languages, require reading, geometry problems, planar geometry problems
备注：
点击查看摘要
Abstract:Evaluation of vision-language models (VLMs) for multimodal mathematical reasoning remains limited for low-resource languages and for geometry problems that require reading a diagram and a question together. We introduce ChitraMiti-12.8k, a synthetic benchmark of 12,874 Bengali planar geometry problems paired with structured 15-attribute descriptions, and NCTB-500, a complementary set of 500 diagrams manually extracted from Bengali school textbooks. Using a three-phase protocol that separates diagram-only, diagram-plus-description, and description-only inputs, we show across five open-weight and closed-source VLMs that description-only performance is statistically indistinguishable from diagram-plus-description performance, establishing structured descriptions as a sufficient textual proxy for controlled evaluation. Despite this, models remain poor at cross-modal verification, frequently misled by a swapped spatial relation even when they answer the unmodified item correctly. We further evaluate supervised adaptation on ChitraMiti-12.8k, finding that fine-tuning improves performance on both ChitraMiti-1k and NCTB-500, although a substantial gap to the strongest zero-shot model remains. Together, ChitraMiti-12.8k, NCTB-500, and our evaluation protocol offer a standardized way to study Bengali multimodal geometry reasoning and, more broadly, whether VLMs actually check their text against what they see. Our dataset and code are publicly available on Hugging Face at this https URL.
55. 【2609.12505】LettuceVisSim: A Simulator That Generates Lettuce Image Time-series for Vision-Based Reinforcement Learning
链接：https://arxiv.org/abs/2609.12505
作者：Ziye Zhu,Bert van 't Ooster,Congcong Sun,Eldert van Henten,Sjoerd Boersma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Systems and Control (eess.SY); Optimization and Control (math.OC)
关键词：controlled environment agriculture, shoot dry weight, shoot dry, dry weight, holds strong potential
备注： 45 pages, 15 figures, Submitted to Biosystems Engineering
点击查看摘要
Abstract:Vision-based reinforcement learning holds strong potential for decision-making in controlled environment agriculture (CEA). However, its development is hindered by the scarcity of labelled crop images. To address this gap, LettuceVisSim, a lettuce growth simulator that generates labelled time series of crop images, was developed and validated. The simulator contains a process-based model (PBM) for shoot dry weight dynamics, a canopy layout algorithm for deriving canopy layout representations from shoot dry weight, and a Unity rendering engine for image generation. Five findings support the simulator. First, the PBM reproduced shoot dry weight under dynamic plant-density management with $\mathrm{R}^{2}=0.84$. Second, a piecewise cubic regression mapped shoot dry weight to potential projected area with $\mathrm{R}^{2}=0.94$. Third, the canopy layout representation was validated using 12 experimental datasets each having different dynamic environmental and spacing conditions. It reproduced the ground coverage ratio dynamics observed in measured images, achieving $\mathrm{R}^{2}=0.84$ when driven by measured shoot dry weight and $\mathrm{R}^{2}=0.40$ (0.76 excluding one outlier) when driven by PBM-simulated values. Fourth, the Unity rendering engine converted canopy layout representations into RGB and segmentation images at less than 10~ms. Fifth, a demonstration showed that a lighting-control policy can be learned and applied by observing only crop images that were generated with LettuceVisSim, providing a proof of concept of vision-based reinforcement learning in CEA using LettuceVisSim.
56. 【2609.12503】When2Talk: When Should a Proactive In-Car Agent Talk?
链接：https://arxiv.org/abs/2609.12503
作者：Kaiser Hamid,Peihang Li,Nade Liang
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)
关键词：Proactive in-cabin agents, passengers understand automated-vehicle, introduce unnecessary interruptions, understand automated-vehicle, Proactive in-cabin
备注：
点击查看摘要
Abstract:Proactive in-cabin agents can help passengers understand automated-vehicle (AV) behavior, but communicating every ride event may introduce unnecessary interruptions. We investigated how communication should adapt to event priority and passenger activity. In a mixed-methods within-subject study, 41 participants rode as passenger in a VR simulated fully-automated vehicle. We compared an event-triggered (ET) policy that communicated immediately at every event with a context-sensitive (CS) policy that selected \textit{Immediate}, \textit{Delayed}, or \textit{Silent} communications. CS increased communication appropriateness and substantially reduced perceived interruption. Perceived trust did not differ between policies, although baselines dispositional trust differentiated communication preferences. Findings highlight event consequence, passenger activity, continuing information value, and confirmation need as key considerations for selective in-cabin communication.
57. 【2609.12497】RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images
链接：https://arxiv.org/abs/2609.12497
作者：Jiabao Wang,Wenjian Liu,Yaoming Cai,Gengyu Zhang,Boyan Zhao,Zijia Zhang,Yao Ding,Xiaobo Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：integrating complementary textural, complementary textural nuances, Infrared-visible image fusion, Infrared-visible image, image fusion facilitates
备注： Accepted to ACM Multimedia 2026 (MM '26). 10 pages, 6 figures. Code: [this https URL](https://github.com/BryceLosky/RoES-Fusion)
点击查看摘要
Abstract:Infrared-visible image fusion facilitates robust multimodal perception by integrating complementary textural nuances from visible sensors with thermal signatures from infrared systems. Due to the task's inherently ill-posed nature, existing methods heavily rely on structural priors but typically enforce rotation equivariance uniformly across all features. Such a holistic approach overlooks a critical distinction where low-frequency shared structures strictly adhere to equivariant constraints while high-frequency modality-specific details require greater flexibility to preserve unique information. To bridge this gap, we propose RoES, a Rotational Equivariant Selective-frequency fusion network. Instead of employing static decomposition, we introduce a trainable rotation-enhanced updater/predictor module to dynamically decouple low- and high-frequency components. The resulting representations are then processed through a dual-branch fusion module tailored for spectral consistency. Specifically, a rotation-equivariant Mamba is employed to capture long-range structural dependencies in the low-frequency domain, while a polar spectral attention-based Dual-Fourier block refines high-frequency details under explicit low-frequency guidance. Extensive experiments demonstrate that RoES consistently achieves state-of-the-art performance in both fusion quality and downstream object detection, establishing a robust solution for multimodal fusion by reconciling frequency-selective features with equivariant constraints. The source code is available at this https URL.
58. 【2609.12491】PhysioAI: Clinical Knowledge-Guided Semantic Supervision for Skeleton-Based Physiotherapy Action Recognition
链接：https://arxiv.org/abs/2609.12491
作者：Jie Cao,Euijoon Ahn,Anwar Hassan,Jinman Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：support automated tracking, remote rehabilitation settings, continuous in-person supervision, support automated, automated tracking
备注： Includes supplementary material and ancillary data files
点击查看摘要
Abstract:Skeleton-based action recognition can support automated tracking of physiotherapy exercises, particularly in remote rehabilitation settings where continuous in-person supervision is impractical. However, most existing methods are developed for large-scale daily-action benchmarks rather than rehabilitation scenarios. Public rehabilitation exercise datasets are typically small, with only subtle kinematic differences between exercise classes. For participants with motor impairments, exercise execution may also deviate from standard movement patterns in amplitude, speed, and coordination, increasing intra-class variability and making reliable recognition more difficult for skeleton-based models. We propose PhysioAI, a clinical knowledge-guided semantic supervision framework that injects structured physiotherapy knowledge into skeleton representation learning. PhysioAI combines graph-based spatiotemporal modelling of human movement with training-time semantic anchors derived from a structured Clinical Knowledge Dictionary (CKD). The CKD descriptions are encoded using a frozen Contrastive Language-Image Pre-training (CLIP) model and projected into an anchor space, where they provide class-specific semantic targets for skeleton representation learning. The resulting CKD-derived anchors are used only during skeleton-model training; inference requires only skeleton inputs. Under subject-disjoint evaluation, PhysioAI achieves $99.03\pm1.34\%$ on KiMoRe Overall, $94.64\pm7.36\%$ on the Hard-67 stress test, and $87.44\pm7.69\%$ on UI-PRMD Overall. These results exceed the strongest comparator for each endpoint by $0.27$, $2.87$, and $1.33$ percentage points (pp), respectively. These findings demonstrate that structured clinical knowledge can serve as an effective source of training-time supervision for physiotherapy action recognition.
59. 【2609.12473】Partition-Invariant Tuning for 3D Scene Understanding
链接：https://arxiv.org/abs/2609.12473
作者：Hongqiang Lin,Tianle Wang,Shuiwang Li,Dongxu Zhang,Yiding Sun,Zihao Guo,Dongfu Yin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：understanding remains challenging, remains challenging due, cloud understanding remains, spatial layouts, point cloud understanding
备注：
点击查看摘要
Abstract:Scene-level point cloud understanding remains challenging due to diverse geometries and spatial layouts. While pre-trained 3D point cloud foundation models (PFMs) offer strong transferability, full fine-tuning (FFT) incurs substantial computational and storage costs. Parameter-efficient fine-tuning (PEFT) provides a promising alternative, but existing PEFT methods largely focus on object-level point clouds and overlook serialization-induced partition variations in large-scale scenes. To address this issue, we propose PointPiT, a partition-invariant tuning framework for scene-level point clouds. Specifically, a Scene-aware Structural Adapter (SSA) integrates local geometric patterns with global scene context to mitigate partition-induced representation shifts. Moreover, Gradient Subspace Optimization (GSO) selects informative and partition-stable update directions, suppressing partition-dependent variations during optimization. Extensive experiments across multiple scene-level benchmarks demonstrate that PointPiT achieves competitive or even superior performance to full fine-tuning with less than 1% of backbone's parameters, while achieving consistent state-of-the-art performance among representative PEFT methods.
60. 【2609.12454】Bridging Vision Foundation Model Priors with CLIP for Spatial-aware Few-shot Anomaly Detection in Medical Images
链接：https://arxiv.org/abs/2609.12454
作者：Juzheng Miao,Yuchen Yuan,Cheng Chen,Pheng-Ann Heng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：medical anomaly detection, CLIP enable effective, Vision Foundation Models, enable effective few-shot, anomaly detection
备注： Accepted by MICCAI 2026
点击查看摘要
Abstract:Vision-Language Models such as CLIP enable effective few-shot medical anomaly detection (AD) via strong image-text semantic alignment. However, their globally contrastive pretraining lacks explicit spatial supervision, limiting precise lesion localization. In contrast, Vision Foundation Models (VFMs) such as DINO learn spatially coherent patch representations via self-distillation and local-to-global consistency, better capturing fine-grained anatomical structures. Leveraging this complementarity, we propose Spatial-FAD, a spatial-aware few-shot medical AD framework that improves lesion localization by combining VFM spatial priors with CLIP semantics. Specifically, we introduce a VFM-enhanced adapter that injects a structural affinity prior derived from DINO into CLIP features. This structure-guided refinement encourages visual embeddings to better adhere to lesion boundaries while maintaining semantic alignment. To address the loss of spatial detail from patchification and the limited input resolution of CLIP, we adopt a sliding-window aggregation strategy. This generates high-resolution, spatially dense embeddings to further enhance localization granularity. Moreover, we introduce a prototype-enhanced support memory scheme to efficiently exploit the few-shot support set. This module stores compact prototypes for normal and abnormal patterns, reducing memory costs while boosting performance by fusing patch-to-prototype and image-text similarities. Extensive experiments on three benchmark datasets, including Liver CT, Retinal OCT, and Brain MRI, demonstrate that Spatial-FAD significantly outperforms state-of-the-art methods, especially in lesion segmentation. Notably, in the 4-shot scenario, our method achieves an average improvement of over 11.4% in Dice score and 1.8% in AUC. Code is available at: this https URL.
61. 【2609.12441】IMPLY: Physically Anchored Consistency for World-Model Rollouts
链接：https://arxiv.org/abs/2609.12441
作者：Aman Mehta,Riya Baviskar
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：world model asked, model, speeds produces, model futures agree, object
备注： 7 pages, 2 figures, 3 tables
点击查看摘要
Abstract:A world model asked what happens if an object is pushed at several speeds produces several futures. If the model has the object in mind, those futures agree about it: each implies the same mass and friction. The consistency checks now used to vet world-action models ask whether a model's futures agree with each other, and none of them knows any physics. We show that this is not enough, and what to do instead. IMPLY reads the physics each rollout implies by inverting a simulator and scores a set of rollouts by how well one object explains all of them, anchored to two calibration pushes the model has observed. In a controlled setting, self-consistency gives a perfect score to a model that ignores the object and always predicts a typical push; anchoring exposes it (AUROC 0.70 versus 1.00). On a real model, V-JEPA 2-AC adapted to the scene, the same thing happens. Given its own calibration pushes the model tracks the object (per-object correlation with the truth 0.91); given another object's, it does not (0.05). Self-consistency cannot tell these apart, preferring the right evidence on 52% of objects, chance level, while anchored disagreement prefers it on 73% and correlates 0.92-0.99 with the rollouts' error. Used to choose among candidate rollout sets, it comes within 0.003 of an oracle that sees the truth. A model that has internalised the wrong object is exactly as self-consistent as one that has internalised the right one; consistency has to be anchored to evidence.
62. 【2609.12431】An End-to-End Automated Pipeline for Controllable Crack Data Synthesis
链接：https://arxiv.org/abs/2609.12431
作者：Conghui Li,Muxin Pu,Chern Hong Lim,Weiyao Lin,Xin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：inspection increasingly relies, weakly controllable defect, deep learning, increasingly relies, relies on deep
备注： this paper is under review in Advanced Engineering Informatics
点击查看摘要
Abstract:Automated crack inspection increasingly relies on deep learning, yet its reliability is limited by scarce and weakly controllable defect data. Existing generative augmentation methods often treat crack synthesis as a generic image-generation task, offering insufficient control over morphology, boundary fidelity, and scene context. This paper proposes an end-to-end automated pipeline for controllable crack data synthesis that formalizes crack geometry and inspection context into reusable computational constraints. First, procedurally sampled Bézier-curve skeletons are translated into realistic crack masks using a GAN, enabling scalable generation of diverse crack morphologies without manual mask design. Second, a dual-ControlNet diffusion framework disentangles appearance guidance from geometric guidance, with an edge-based branch enforcing strict boundary consistency. The framework supports both background-free synthesis and context-aware inpainting. Experiments on CRACK500 and CrackTree200 show consistent gains over existing augmentation baselines, demonstrating a scalable engineering informatics workflow for automated crack-inspection data generation.
63. 【2609.12418】RiPPLE: Cross-Space Performance Prediction from Early Training for Neural Architecture Search
链接：https://arxiv.org/abs/2609.12418
作者：Yifan Yang,Zhaoyan Wang,Zheng Gao,Xiaoyu Li,Jiaojiao Jiang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Neural architecture search, textbf, underline, Neural architecture, NAS
备注：
点击查看摘要
Abstract:Neural architecture search (NAS) evaluates candidate networks, but fully training enough architectures to rank an entire space is expensive. Zero-cost proxies score architectures at initialization, yet their ranking quality varies across search spaces. Learned predictors reduce evaluation cost but typically require fully trained labels or partial-training features for individual candidates. We introduce $\textbf{RiPPLE}$, $\underline{\textbf{R}}$anking v$\underline{\textbf{i}}$a $\underline{\textbf{P}}$refix-$\underline{\textbf{P}}$ropagated $\underline{\textbf{L}}$abel $\underline{\textbf{E}}$xtrapolation, which treats partial training as a source of labels for a small coverage set of anchors. RiPPLE trains these anchors to an early prefix, extrapolates their learning curves to surrogate labels, and propagates the labels over label-free architecture features. The early-training signal remains a label on the anchors rather than a per-candidate feature. Feature, readout, and encoding rules are selected without held-out accuracy and reused across search spaces. We evaluate the method on twelve benchmark cells from four search-space families and on the larger DARTS space. The results examine ranking quality, label efficiency, architecture selection, and the roles of readout, coverage, and propagation. RiPPLE provides a whole-space ranking from a fractional anchor-training budget, with comparisons interpreted under their respective evaluation and cost protocols.
64. 【2609.12417】Spectral Consistency-Guided Multiview Point Cloud Registration for Low-Overlap Scenes
链接：https://arxiv.org/abs/2609.12417
作者：Tianyu Li,Yanghong Lin,Shudong Zhou,Kui Yang,Jingru Zhang,Li Fang,Wei Yao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multiview point cloud, point cloud registration, low-overlap scenes, Multiview point, challenging in low-overlap
备注：
点击查看摘要
Abstract:Multiview point cloud registration is particularly challenging in low-overlap scenes, where reliable correspondences are limited and incorrect pairwise transformations can affect global pose estimation. In addition, registering all scan pairs is computationally expensive because many pairs provide weak geometric information. To address these problems, we propose GMPCR, a non-learning-based spectral consistency-guided framework for efficient and robust multiview point cloud registration. GMPCR builds a refined second-order compatibility structure from initial correspondences and uses its dominant spectral response to evaluate both correspondence reliability and scan-pair confidence. This allows unreliable correspondences to be filtered and informative scan pairs to be selected before relative transformation estimation, leading to a sparse pose graph and reduced pairwise registration cost. For each retained scan pair, maximal-clique-based hypothesis generation is used to estimate reliable relative transformations. The resulting pose graph is further refined by an adaptive history-aware synchronization scheme, in which the effect of residual history is adjusted according to changes in the global rotation residual. A recovery mechanism also allows down-weighted edges to regain confidence when their global consistency improves. Experiments on 3DMatch, 3DLoMatch, ScanNet, and ETH demonstrate the effectiveness of GMPCR. It achieves registration recalls of 97.2% and 89.6% on 3DMatch and 3DLoMatch, respectively, while maintaining competitive performance on ScanNet and ETH. The results show that GMPCR provides a favorable balance among registration accuracy, robustness to low overlap, and computational efficiency. The code is publicly available at this https URL.
65. 【2609.12411】DERA: Detached Edge-Residual Adaptation for Prohibited item Detection
链接：https://arxiv.org/abs/2609.12411
作者：Yonathan Michael,Mohamad Alansari,Mohammed Bennamoun,Dwarikanath Mahapatra,Andreas Henschel,Naoufel Werghi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：X-ray imagery remains, remains challenging due, imagery remains challenging, textbf, X-ray imagery
备注：
点击查看摘要
Abstract:Prohibited-item detection in X-ray imagery remains challenging due to object superposition, weak texture, and material clutter which obscure both semantic appearance and object boundaries. We propose \textbf{DERA}, a \textbf{D}etached \textbf{E}dge-\textbf{R}esidual \textbf{A}daptation framework for prohibited item detection under X-ray imagery. DERA combines hierarchical visual features with a parallel pixel-difference edge pyramid and learns an object-specific boundary prior from training-time contours of the instance masks. The detached prior gates edge-sensitive features, which are injected into the early visual stages through residual heads. This staged design preserves the foundation detector at the start of adaptation, isolates boundary supervision from semantic feature learning, and restricts the final adaptation stage to only \(14.7\)K trainable parameters. Evaluated on PIDray, CLCXray, and STCray, DERA improves the baseline by \textbf{3.1}, \textbf{1.6}, and \textbf{2.4} AP points, respectively.
66. 【2609.12410】A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data
链接：https://arxiv.org/abs/2609.12410
作者：Yusuf Brima,Marcellin Atemkeng,Lakshmana Rao Namamula,Antoine Vacavant
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：Alzheimer disease, growing global health, global health burden, major and growing, health burden
备注：
点击查看摘要
Abstract:Dementia is a major and growing global health burden, with Alzheimer's disease (AD) accounting for most cases. Timely and accurate diagnosis is central to managing this burden and increasingly depends on integrating complementary clinical and imaging information. Multimodal deep learning can combine these modalities for AD diagnosis, but how its explanations behave across modalities, fusion strategies, and cohorts remains unclear. We developed an explainable multimodal framework pairing a 3D CNN encoder for T1-weighted MRI with a feedforward network for harmonized clinical and demographic data, comparing varied model setups on three-way and pairwise diagnostic tasks using 6,479 internal records from the ADNI and 1,703 independent records from the OASIS-3. On ADNI, the tabular-only model achieved the highest three-class AUC-ROC of 0.879 and best discriminated cognitively normal (CN) versus mild cognitive impairment (MCI; 0.903), while cross-attention performed best for MCI versus AD (0.861); CN versus AD was highly discriminative overall. On OASIS-3, the vision-only model performed best (three-class AUC-ROC 0.910); CN versus MCI remained difficult, and no fusion strategy consistently outperformed single modalities across tasks and cohorts. SHAP and Integrated Gradients identified the MMSE as the dominant tabular feature in both cohorts, with global feature rankings agreeing strongly in ADNI ($\rho=0.94$) and OASIS-3 ($\rho=0.96$); CAM-based explanations, however, changed with model configuration and cohort. These findings show that multimodal performance and explanations are task, modality, fusion, and cohort-dependent: a dominant cognitive signal persisted across cohorts, but feature contributions and CAM explanations did not, underscoring the need to evaluate explainability under cohort shift rather than as a stable, intrinsic property.
67. 【2609.12409】OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality
链接：https://arxiv.org/abs/2609.12409
作者：Yang Liu,Qionghong Ma,Joongwon Chae,Lihui Luo,Yibing Shen,Yulin Zhuo,Yingting Zhu,Jiashu Chang,Xiaoyun Zhong,Dongmei Yu,Peter E. Lobie,Peiwu Qin,Chengming Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：High-frequency surgical maneuvers, ophthalmology necessitate high-fidelity, high-fidelity temporal modeling, necessitate high-fidelity temporal, remains computationally prohibitive
备注： Submitted to IEEE Transactions on Image Processing. Under review
点击查看摘要
Abstract:High-frequency surgical maneuvers in ophthalmology necessitate high-fidelity temporal modeling, yet characterizing long-range procedural dependencies remains computationally prohibitive for attention-based architectures. Existing models often require aggressive temporal downsampling, which compromises the detection of fine-grained action boundaries and instrument-tissue interactions. To address these scalability constraints, we present OphBiWSSD, a framework that reformulates surgical temporal action localization leveraging Bidirectional State Space Duality. By employing a weight-tied selective scan mechanism that incorporates both preceding and succeeding surgical contexts, our approach facilitates the global synthesis of non-causal temporal cues with linear complexity. This streamlined architecture is well-suited to capture the bidirectional dependencies present in ophthalmic workflows, effectively bridging the gap between local boundary precision and long-range procedural context without incurring the quadratic memory overhead of traditional Transformers. Extensive experiments on the OphNet benchmark demonstrate that OphBiWSSD achieves state-of-the-art temporal localization performance, with mean Average Precisions of 44.42% on phases and 43.08% on operations, surpassing the baselines by 6.80% and 6.66%, respectively. Empirical validation indicates that our approach ensures precise temporal localization and offers a computationally viable pathway for deploying surgical intelligence systems in clinical environments. The code is publicly available at this https URL.
68. 【2609.12408】GSO-Net: Visual State Machines for Hazardous Freight Transfer Compliance at Petrochemical Logistics Nodes
链接：https://arxiv.org/abs/2609.12408
作者：Yu Xie,Bangshu Xiong,Zhibo Rao,Rui Gan,Chongxuan Liu,Zechu Ouyang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：realistic deployment constraints, existing vision benchmarks, vision benchmarks rarely, benchmarks rarely address, rarely address procedural
备注：
点击查看摘要
Abstract:Hazardous-freight operations at petrochemical logistics nodes are safety-critical for intelligent transportation systems, yet existing vision benchmarks rarely address procedural compliance under realistic deployment constraints. In large infrastructure networks, cameras often operate under sparse round-robin polling, so transfer status must be inferred from incomplete observations and localized evidence. We present GSO-Net, a large-scale benchmark for visual understanding of standard operating procedures (SOPs) in petrochemical unloading scenarios. To our knowledge, GSO-Net is the first public benchmark dataset dedicated to visual SOP understanding in petrochemical hazardous-freight transfer scenarios. It contains over 50,000 independently sampled frames from 64 real expressway petrochemical logistics nodes and adopts an SOP-derived hierarchy linking 9 macroscopic procedural steps with 15 microscopic operational states. Two tasks are defined: joint detection of microscopic states and macroscopic steps as the core benchmark, and frame-level step classification as a diagnostic reference. Experiments with lightweight, transformer-based, open-vocabulary, and holistic models reveal a clear gap between object perception and transfer-stage understanding. Current models remain weak on contact-level state grounding, transient step recognition, and stage consistency, especially under sparse polling, tiny critical targets, and long-tailed operational evidence. GSO-Net provides a practical benchmark for fine-grained state perception and vision-based safety monitoring in hazardous freight transportation. The dataset is publicly available at this https URL
69. 【2609.12397】UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation
链接：https://arxiv.org/abs/2609.12397
作者：Danning Zhang,Yijing Lin,Shuhan Zhuang,Mengqi Huang,Shaojin Wu,Shancheng Fang,Zhendong Mao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：garnered growing attention, Multi-modal image generation, Multi-modal Large Language, recent years, Multi-modal image
备注： Accepted at the Forty-Third International Conference on Machine Learning (ICML 2026)
点击查看摘要
Abstract:Multi-modal image generation, particularly subject-driven customization, has garnered growing attention in recent years. Despite the rapid advancement of generative models, their evaluation remains largely lagging. Existing methods, whether embedding-based or Multi-modal Large Language Model (MLLM)-based, evaluate alignment with each modal condition in isolation, which contradicts the simultaneous condition alignment objective of multi-modal image generation, leading to poor consistency with human judgments. To address this challenge, we propose UFO, the first unified framework for omni-condition alignment simultaneous evaluation. Specifically, UFO introduces a novel Atomized Chain-of-Evaluation paradigm, \emph{i.e.}, it first decomposes omni-condition alignment into a sequential chain of fine-grained, disentangled Atomic Evaluation Units (AEUs), categorizes them into distinct modality-relevance classes, and then employs general or dedicated functional calls for accurate verification of different AEU types. Experimental results demonstrate that UFO achieves the highest correlation with human evaluation preferences, delivering an average improvement of 15.25\%. Furthermore, we present UFO-Bench, a dedicated benchmark designed to holistically evaluate the performance of existing customization models under the diverse mutual interactions of textual and visual conditions.
70. 【2609.12374】Context-Aware Causal Gaze Forecasting for Human-Vehicle Interaction During In-Cabin Tracking Dropouts
链接：https://arxiv.org/abs/2609.12374
作者：Shabnam Shabani,Ghazal Farhani
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：including shoulder checks, Dashboard-mounted gaze trackers, large head rotations, Dashboard-mounted gaze, mirror glances
备注： 8 pages, 5 figures
点击查看摘要
Abstract:Dashboard-mounted gaze trackers often lose sight of the driver's eyes during large head rotations, including shoulder checks, mirror glances, and intersection scanning. These maneuvers occur when information about the driver's visual attention is most useful. Offline gap-filling methods may reconstruct a missing interval using observations from both sides, but an online driver-monitoring system cannot rely on measurements that have not yet occurred. We therefore formulate causal gaze recovery: forecasting unavailable gaze at time t without target-tracker gaze at t or later. We introduce the Causal Context-Gated Forecaster (CCGF), which encodes a 60-frame pre-dropout history of gaze and head pose and combines it with DINOv3 scene features. A learned reliability gate controls the contribution of the history and scene representations as the dropout progresses. We evaluate two scene conditions: Live, in which the scene representation continues to update during tracker loss, and Frozen, in which the final pre-dropout representation is used throughout the missing interval. We evaluate CCGF on 2,047 eligible, naturally occurring GazeSense head\_lost events drawn from 10.5 h of naturalistic driving by ten drivers. Across all recordings, head\_lost accounts for 8.5 percent of GazeSense recording time. Synchronized gaze coordinates from a head-mounted Neon tracker provide supervision and evaluation targets but are never used as model inputs. Under leave-one-driver-out evaluation, CCGF achieves a mean per-driver median error of 175.7 px (10.5 deg) with Live scene updates, a 33 percent reduction relative to history-only causal forecasting. With Frozen scene input, the error increases to 210.8 px (12.9 deg), indicating that scene observations acquired during the dropout provide useful predictive information. We will release the dataset, evaluation protocol, and causal baselines.
71. 【2609.12350】EgoMaize: A First-Person Maize Instance Segmentation Benchmark under Severe Field Occlusion
链接：https://arxiv.org/abs/2609.12350
作者：Jiayi Li,Zihan Zhang,Erhankang Yan,Yitian Chen,Yuze Li,Chengzhang Ding,Jianxin Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：plant-level traits depend, mobile maize phenotyping, overhead views, important for mobile, plant-level traits
备注： Accepted to BMVC 2026
点击查看摘要
Abstract:Close-range first-person field images are important for mobile maize phenotyping because many plant-level traits depend on in-canopy structures that are difficult to ob serve from overhead views. However, post-seedling maize fields create a difficult in stance segmentation setting: stems, leaves, tassels, and neighboring plants are elon gated, repetitive, and strongly occluded. We introduce EgoMaize, a compact benchmark for first-person maize instance segmentation, where the task is to predict ownership consistent plant masks and plant-owned stem/tassel cues from close-range field images with severe same-class overlap. Existing visible-only labels can fragment one physi cal plant into disconnected supervision, while full-amodal labels may require unverifi able completion behind neighboring plants or field objects. EgoMaize therefore uses an evidence-closed annotation workflow for occluded maize regions and assigns unreli able maize regions to ignore rather than background. Baseline results show that pre trained query-based grouping, boundary refinement, and high-resolution crop refine ment help different aspects of the task, but no architecture solves the coupled chal lenges of fine structure recovery, same-class instance ownership, and occlusion reason ing; occlusion-level analysis further shows that performance decreases as plant visi bility becomes more limited. The dataset and code are publicly available at https: //github.com/JaaaaaaaD/EgoMaize.
72. 【2609.12343】VS-Splat: Voxel-Selective feed-forward Gaussian Splatting for end-to-end 3D object reconstruction from sparse-views
链接：https://arxiv.org/abs/2609.12343
作者：Yunsu Jeong,Hyuk Heo,Youngsang Kwak,Jaehwa Kwak,Il Yong Chun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Feed-forward Gaussian splatting, Feed-forward Gaussian, Gaussian splatting, Gaussian splatting models, Gaussian Splatting model
备注： Main paper: 10 pages, 4 figures. Appendix: 4 pages, 5 figures, Transaction of Multimedia
点击查看摘要
Abstract:Feed-forward Gaussian splatting models have demonstrated remarkable effectiveness in reconstructing three-dimensional (3D) objects from a few two-dimensional (2D) images, even if they are unseen. As existing methods typically predict Gaussian primitives uniformly across the 3D space, most primitives are placed in non-object regions. This may hinder the representation of fine object details. This paper proposes a Voxel-Selective Gaussian Splatting model (VS-Splat), a new end-to-endfeed-forward Gaussian splatting framework that predicts many primitives only within selected voxels that are likely to belong to an object, without 3D structural supervision. To achieve this, we propose a new learnable voxel selection approach that identifies object-centric voxels only with 2D rendering this http URL sparse-view rendering experiments with three benchmark datasets show that proposed VS-Splat outperforms several state-of-the-art methods. We further demonstrate its effectiveness as a backbone for an existing densification method and show that anoptional extension improves its robustness to inaccurate camera pose estimates.
73. 【2609.12342】UniMo: Unifying Human and Animal Motion Generation
链接：https://arxiv.org/abs/2609.12342
作者：Zeyu Zhang,Zhiyuan Zhang,Siheng Wang,Yiran Wang,Danning Li,Ian Reid,Richard Hartley
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：key research topic, research topic due, applicability across robotics, content creation, key research
备注： Accepted to SIGGRAPH Asia 2026 Posters
点击查看摘要
Abstract:The conditional generation of 3D motion has emerged as a key research topic due to its wide applicability across robotics, AR/VR, gaming, and content creation. However, extending recent advances in text-driven human motion generation to the animal domain remains challenging due to two core limitations. First, animals exhibit highly diverse skeletal topologies, unlike the standard human structure, making unified modeling across species difficult and leading to inefficient per-species models. Second, existing animal motion datasets suffer from limited scale and annotation quality, constraining model performance. To address these challenges, we propose UniMo, a unified point cloud-based motion generation framework that bypasses topological discrepancies by converting parametric skeletons into unparametric representations, further enhanced by dynamic sampling that allocates more points to active joints. Additionally, we present UniML3D, a large-scale motion-language dataset spanning both human and animal categories, containing 145,907 motion sequences and 433,388 captions-over 102x larger than existing animal datasets. Our method achieves state-of-the-art results on UniML3D and three public benchmarks including HumanML3D, KIT-ML, and AnimalML3D, demonstrating the feasibility and effectiveness of unified human-animal motion generation. Website: this https URL.
74. 【2609.12285】AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation
链接：https://arxiv.org/abs/2609.12285
作者：Long Giang Vu,Chengkai Yao,Yuxin Liu,FNU Aryan,Rajath Chandrashekar Aralikatti
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：unseen indoor environments, fixed object vocabulary, follow natural-language instructions, real-world robotics, unseen indoor
备注：
点击查看摘要
Abstract:Vision-Language Navigation (VLN) in unseen indoor environments is useful in real-world robotics, where an agent must follow natural-language instructions, locate objects, and answer spatial questions without a pre-built map or fixed object vocabulary. Multimodal vision-language models (VLMs) provide strong open-vocabulary grounding and zero-shot reasoning, but struggle to emit reliable metric quantities such as range, bearing, and comparative spatial relations directly from images. Existing approaches address this by folding geometry into hand-engineered pipelines or asking models to output waypoints, requiring changes to the control stack for different robots, tasks, or vocabularies. We introduce AnchorVLN, an open-vocabulary VLN system built on a simple rule: the VLM proposes semantics; geometry decides metrics. It is realised as EMBODIED-NAV-MCP, a Model Context Protocol (MCP) server driven by a VLM agent through a compact set of callable tools. Since no tool accepts distance in metres or bearing in radians, the schema enforces the semantic-geometry boundary without modifying the downstream autonomy stack. We benchmark both tasks of the CMU Vision-Language Navigation Challenge 2026: 30 instruction-following questions over 15 scenes and a frozen 45-question object-reference set. The full system achieves 64.4 percent on instruction following, dropping by 13.3 percentage points without controller modeling (t = 2.77). On object reference, geometric anchoring clears the challenge overlap threshold on 10 of 45 questions, versus 0 of 45 for direct coordinate estimation, reducing median center error from 3.37 m to 2.48 m.
75. 【2609.12261】Revisiting Multi-Object Tracking Baselines: Hyperparameter Optimization with Multi-Fidelity Greedy Coordinate Search
链接：https://arxiv.org/abs/2609.12261
作者：Momir Adžemović
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-object tracking, methods typically rely, chosen by hand, typically rely, conventionally chosen
备注： 23 pages, 7 figures, 12 tables
点击查看摘要
Abstract:Multi-object tracking (MOT) is dominated by the tracking-by-detection paradigm, whose methods typically rely on a small set of hyperparameters that are conventionally chosen by hand. Tuning them requires repeated expert-guided experimentation, while the procedures used to select reported values are often not systematically evaluated or fully documented. Hyperparameter optimization (HPO) automates this process, yet it remains rarely used in MOT, and existing studies applying HPO to MOT predate modern deep-detector-based trackers and HOTA evaluation. We systematically apply HPO across two datasets and four tracking-by-detection methods. We also propose Multi-Fidelity Greedy Coordinate Search (MFGCS), which optimizes one hyperparameter at a time by first evaluating candidate values on a small subset of scenes and re-evaluating only promising candidates on the full dataset. Across all eight tracker-dataset combinations, the Tree-structured Parzen Estimator (TPE) and MFGCS outperform both our hand-tuned configurations and the corresponding published results, with improvements of up to 4.38 and 16.05 HOTA points, respectively. MFGCS also reaches a predefined HOTA target faster than TPE in seven of the eight combinations. Within each tracker-dataset pair, all optimizers share the same search space and evaluation pipeline, isolating the effect of the search strategy. We release the code and tuned configurations to enable future work to compare against systematically optimized rather than default or manually tuned baselines.
76. 【2609.12225】PLSP (Pre-hoc Liminal Space Profiling): OOD Prediction over Detection -- An Anticipatory Approach for Machine Learning Model Reliability
链接：https://arxiv.org/abs/2609.12225
作者：Vipul Bansal,Himanshu Buckchash,Balasubramanian Raman,Deepak Dhungana
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：OOD prediction, OOD, failure during deployment, OOD detection, poses a significant
备注： 10 pages, 3 figures, 5 tables
点击查看摘要
Abstract:Out-of-Distribution (OOD) data poses a significant threat to machine learning models, often leading to model failure during deployment. All existing OOD detection methods are post-hoc, relying on evaluation metrics such as accuracy and AUC-ROC during inference to indirectly assess the model's response to OOD data by measuring deviations. In contrast to existing approaches, the proposed work shifts the paradigm from OOD detection to OOD prediction by proposing a pre-hoc anticipatory framework called PLSP for OOD prediction. We make several key contributions: (a) a dataset-independent metric called the CREDibility Score (CREDS) is proposed for OOD prediction; (b) credibility curves are introduced to study the maximum credibility a model can attain; and (c) credibility heat maps (and volume under surface) are introduced to characterize pre-hoc model behavior across different datasets. This work provides a novel perspective on signal processing under distributional shifts. Experiments across multiple datasets demonstrate that the proposed metric serves as a valuable measure for improving the robustness of machine learning models toward OOD prediction.
77. 【2609.12202】QuPAINT: Physics-Aware Multimodal Reasoning for Quantum Material Characterization
链接：https://arxiv.org/abs/2609.12202
作者：Sankalp Pandey,Xuan-Bac Nguyen,Hoang-Quan Nguyen,Tim Faltermeier,Nicholas Borys,Hugh Churchill,Khoa Luu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：requires localizing exfoliated, Characterizing two-dimensional, microscopy requires localizing, subtle optical contrast, localizing exfoliated flakes
备注：
点击查看摘要
Abstract:Characterizing two-dimensional (2D) quantum materials by optical microscopy requires localizing exfoliated flakes and determining their layer thickness from subtle optical contrast and interference color to select suitable flakes for device fabrication. However, models face synthetic-to-real domain shifts and variation across materials, substrates, laboratories, and imaging conditions. We present QuPAINT, a physics-aware multimodal framework for transferable quantum flake characterization. The Synthetic Materials Framework (Synthia) generates diverse synthetic microscopy images while preserving layer-dependent optical behavior. Using these images, we construct QMat-Instruct, a multimodal instruction dataset with image-specific reasoning traces generated from verified annotations and constrained to observable optical cues. QuPAINT integrates these signals through Physics-Informed Attention (PIA), which injects substrate-relative optical priors into the visual representation to support grounded multimodal reasoning. For evaluation, we introduce QF-Bench, to our knowledge, the largest real-world benchmark for this problem, spanning diverse microscopy and substrate conditions. Using its verified annotations, we study counting, visual grounding, reasoning quality, confidence calibration, and transfer to an unseen material. QuPAINT-8B substantially outperforms prior methods and establishes state-of-the-art performance for both general and monolayer flake detection. Additional experiments show that image-grounded supervision improves strict spatial grounding and confidence calibration while preserving robust general flake detection on the unseen material.
78. 【2609.12181】Physics as the label for measuring and correcting materials reasoning in multimodal models
链接：https://arxiv.org/abs/2609.12181
作者：Hasan Kurban,Rasul Khanbayov,Mustafa Kurban
类目：Computer Vision and Pattern Recognition (cs.CV); Materials Science (cond-mat.mtrl-sci)
关键词：hallucinate invalid properties, Vision-language and language, language models increasingly, models increasingly interpret, increasingly interpret materials
备注：
点击查看摘要
Abstract:Vision-language and language models increasingly interpret materials data, yet benchmarks report that they hallucinate invalid properties and violate physical law. Evaluation matches final answers to scarce human labels, while discovery agents verify final proposals or density functional theory (DFT) execution. Neither measures the physical consistency of a model's reasoning chain. Materials data carries its own physics, making a large class of materials reasoning verifiable without annotation. We introduce MatPCR, a label-free benchmark whose programmatic oracles check diffraction geometry through Bragg's law, scale bars, spectral peaks, and Materials Project-grounded checks of near-hull stability, computed band-gap class, and net magnetization. We define the Physical-Consistency Rate over image and structure inputs; introduce Constraint-Grounded Self-Verification, an agentic loop whose gain survives self-refinement and equal-compute re-prompting controls; release an open verifier useful in distribution but near chance on all six held-out constraint types; and derive an exact identity for how oracle error displaces the reported rate.
79. 【2609.12169】When Ground-Truth Fidelity Matters: An Orchestrated UAS Framework for Wheat Streak Mosaic Virus Detection Using Vision Transformers and Machine Learning
链接：https://arxiv.org/abs/2609.12169
作者：Dewi Endah Kharismawati,Sandeep Dhakal,Courtney E. McCusker,Jennifer R. Wilson,Erik W. Ohlson,Sami Khanal
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Wheat streak mosaic, streak mosaic virus, causing yield losses, Wheat streak, complicating early detection
备注： 29 pages, 9 figures, 2 tables. Submitted to Computers and Electronics in Agriculture
点击查看摘要
Abstract:Wheat streak mosaic virus (WSMV) is a destructive pathogen of sweet corn and other cereal crops, causing yield losses and complicating early detection because symptoms are spatially variable and subtle. In sweet corn seed production, WSMV also has regulatory importance, as phytosanitary regulations from countries such as New Zealand and Chile require seed lots to be certified virus-free. Visual scouting is unreliable because symptoms can resemble abiotic stress, while enzyme-linked immunosorbent assay (ELISA) is accurate but expensive, labor-intensive, and difficult to scale. We present an automated pipeline for plant-level WSMV detection using unmanned aircraft systems (UAS) multispectral imagery. The framework integrates orthomosaic reconstruction, geospatial alignment, plant extraction, and classification using a Vision Transformer with seven-channel inputs (five spectral bands, NDVI, and NDRE). Using treatment-based labels, the model achieved 89% accuracy on over 6,500 test patches across multiple growth stages. However, ELISA-based ground truth revealed substantial label noise: only a small fraction of sampled plants in inoculated plots were infected. Treatment labels therefore did not reliably represent infection status, and the high accuracy was largely driven by label bias rather than disease detection. Performance decreased markedly against row-level symptom severity and plant-level ELISA labels. Under these higher-fidelity but smaller-sample conditions, both deep learning and classical machine learning showed limited generalization and weak separability between ELISA-confirmed mock-inoculated and infected plants. These results show that UAS-based disease detection is constrained by label fidelity and data availability, emphasizing biologically grounded labels and models aligned with real-world conditions.
80. 【2609.12168】USPLIT-VQA: U-Shaped Split Learning for Visual Question Answering with Contribution-Aware Weighted Aggregation
链接：https://arxiv.org/abs/2609.12168
作者：Md Khalid Syfullah,Alvi Ataur Khalil
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Visual Question Answering, Visual Question, Question Answering, jointly interpreting images, natural language queries
备注：
点击查看摘要
Abstract:Visual Question Answering (VQA) systems, jointly interpreting images and natural language queries, hold significant promise across many domains, yet the privacy-sensitive nature of user data creates a fundamental barrier. Centralized training requires access to all data, while federated learning requires each client to host the full model. We propose USPLIT-VQA, a U-shaped split learning framework for privacy-preserving VQA in which each client retains the initial layers and the classification head while the server hosts the computationally heavy intermediate layers, keeping raw inputs and labels on the client device. We further introduce Contribution-Aware Weighted Aggregation (CAWA), a gradientsimilarity-based client scoring mechanism designed to reduce the influence of malicious updates. Experiments on four VQA datasets (VQA-RAD, SLAKE, PathVQA, and VizWiz) with two backbones show accuracy gains over Federated Learning for the Custom model and reduced accuracy for BiomedCLIP under the evaluated fixed split, alongside client memory reductions of up to 5.8X and communication reductions of up to 10.8X. With one malicious client, CAWA reduces the attacker's influence by over 98%, while experiments at higher corruption levels identify its limitations. Reconstruction experiments further show lower inversion quality under the evaluated attacks.
81. 【2609.12155】Single-Query Person-Centric Bimanual Hand-Object Interaction Detection
链接：https://arxiv.org/abs/2609.12155
作者：Jonghyun Kim,Junho Roh,Yubin Yoon,Hyotae Lee,Jongkuk Park,Taehwan Hwang,Jaechul Kim,Jungho Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Understanding person-level bi-manual, Understanding person-level, bi-manual interactions requires, hand, interaction
备注： Accepted to ECCV2026, Project page: [this https URL](https://lgecto-ail-vil.github.io/SingleQuery-BHOI/)
点击查看摘要
Abstract:Understanding person-level bi-manual interactions requires not only detecting hands, but also identifying which two hands belong to the same person and what each hand interacts with. Existing hand--object interaction methods are mostly hand-centric: they treat each hand as an independent instance, which can lead to ambiguous ownership in multi-person scenes. We propose a person-centric formulation in which a single query predicts a structured output for one person, including the human box, body pose, hand boxes and states, and interaction targets. We introduce part-aware deformable attention to allocate attention across human, hand, and pose-specific reference regions, enabling one query to capture the full person structure. We further unify detection and interaction reasoning with a hand-to-query relationship matrix, where each hand selects its interaction target from the detected query set plus a learnable off token, directly recovering the target's box and class without separate object regression. We build a COCO-based dataset with person-centric bi-manual interaction annotations and define structured metrics for evaluating hand states and complete hand--object tuples. Experiments with a transformer-based detector show that our formulation improves person-level bi-manual interaction parsing and provides an effective unified framework for joint detection, pose estimation, and hand reasoning.
Comments:
Accepted to ECCV2026, Project page: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.12155 [cs.CV]
(or
arXiv:2609.12155v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.12155
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
82. 【2609.12151】HSI-Road Relabeled: Surface-Aware Road-Scene Segmentation
链接：https://arxiv.org/abs/2609.12151
作者：Imad Ali Shah,Imran Mehmood,Enda Ward,Martin Glavin,Edward Jones,Brian Deegan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：labeled six-class taxonomy, manually labeled six-class, text, RGB, NIR
备注：
点击查看摘要
Abstract:The HSI-Road dataset provides paired RGB and 25-channel NIR (600--960~nm) images with binary masks but no surface-level labels.~This paper introduces a manually labeled six-class taxonomy: Background, Asphalt, Concrete, Dirt, Water, and Grass, and an RGB-to-NIR registration pipeline with corresponding annotations. Six semantic-segmentation models (SSMs) are evaluated under four input configurations: original-resolution RGB (RGB$_{\text{ori}}$), registered low-resolution RGB (RGB$_{\text{reg}}$), NIR, and channel-stacked RGB$_{\text{reg}}$--NIR (RGBN$_{\text{stk}}$). The comparison quantifies the effect of spatial-resolution reduction on RGB, along with evaluation of NIR and RGBN$_{\text{stk}}$, with results reported using per-class and mean IoU and F1 scores. RGB$_{\text{ori}}$ achieves the highest overall performance but contains 12$\times$ more pixels than the matched-resolution inputs. At the matched 192$\times$384 resolution, RGBN$_{\text{stk}}$ outperforms NIR for all six SSMs and RGB$_{\text{reg}}$ for five of six, with the most consistent gains for the Water class. These results highlight the importance of spatial resolution while showing that NIR provides complementary information to RGB.
83. 【2609.12099】Beyond Argmax: A Mechanistic Study of Semantic Retention in Frozen Foundation-Model Composition for Generalized Few-Shot 3D Segmentation
链接：https://arxiv.org/abs/2609.12099
作者：Silas Kwabla Gah,Ebenezer Owusu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Classical classifier-combination work, hard decision-level voting, classifier-combination work distinguishes, work distinguishes score-level, Classical classifier-combination
备注：
点击查看摘要
Abstract:Classical classifier-combination work distinguishes score-level fusion from hard decision-level voting. We revisit this distinction where independently pretrained, frozen foundation models are composed at inference time for generalized few-shot 3D segmentation. We ask: how much useful semantic information is lost when heterogeneous sources are collapsed to a single class before they can interact? We answer with a same-input semantic-retention intervention. Dense RegionPLC and sparse cross-view SAM3 evidence, model weights, masks, geometry, vocabularies, and fusion rules are frozen; only the number of semantic alternatives retained before interaction is varied via a matched top-k ladder. On 156 held-out ScanNet200 scenes, top-1 reaches 28.47 harmonic-mean (HM) IoU while full distribution fusion reaches 34.87 HM (+6.40, 95% CI [+5.24,+7.64]). The pattern replicates on 50 ScanNet++ scenes: 23.02 vs. 26.50 HM (+3.48, 95% CI [+1.64,+5.93]). The conclusion is robust: full-distribution HM is stable across sparse-source weights 0.3--0.7; alternative operators (max, geometric pooling) also outperform top-1; and a GroundingDINO--SAM2.1 source-replacement diagnostic shows monotonic HM increase from 14.77 to 18.75 with full retention. Calibration diagnostics reveal opposite miscalibration of the two sources, yet correcting calibration does not eliminate the retention advantage. Across datasets and source stacks, most information is recovered by retaining a compact set of plausible alternatives. The contribution is a controlled diagnosis of premature semantic collapse as a repeatable information bottleneck in heterogeneous frozen-model composition.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.12099 [cs.CV]
(or
arXiv:2609.12099v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.12099
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Silas Gah Mr [view email] [v1]
Thu, 10 Sep 2026 18:25:53 UTC (8,032 KB)
84. 【2609.12090】Does Video Memory Use What It Retrieves? A Causal Audit of Memory Specificity
链接：https://arxiv.org/abs/2609.12090
作者：Aditi Tiwari,Akshit Bhalla,Darshan Prasad,Heng Ji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：memory, Video models increasingly, long sequences, preserve information, information over long
备注： 18 pages, 9 figures, 15 tables
点击查看摘要
Abstract:Video models increasingly use memory to preserve information over long sequences, with the assumption that gains come from retrieving and using the correct past content. Standard memory ablations test whether memory helps, but not whether the retrieved content is responsible. We test this directly with read-time memory substitution, which replaces the consumed memory value while leaving the rest of the computation unchanged. This separates memory benefit from memory specificity, the extent to which the gain depends on retrieved content. Across frozen video world models, identity-free controls containing no evaluation-specific content recover essentially the full benefit on Ego-Exo4D and 7-Scenes and about 70% on TUM. In the Ego-Exo4D dose response, recovery falls from 102% to 1% as these values move away from observed training-memory representations, supporting representation repair as the best-supported explanation in this setting. WorldMem shows graded dependence. A wrong memory from the same trajectory recovers 94.1% of the PSNR benefit relative to zero content, while a donor from a disjoint trajectory and biome recovers 43.7%. SAM 2 shows strong content dependence. On DAVIS, replacing the correct spatial memory with a valid wrong memory reduces mean region and boundary score from 0.926 to 0.182. At MOSEv2 reappearance, it falls from 0.459 to 0.000. These results show that memory gains can depend on generic representation support, broader context, or exact episodic content. Read-time substitution provides a direct way to distinguish them.
85. 【2609.12081】MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignment
链接：https://arxiv.org/abs/2609.12081
作者：Guangyu Chen,Qiwei Liang,Shaolong Zhu,Tianxing Chen,Zikuan Xiao,Yifan Xie,Lingfeng Zhang,Ping Luo,Renjing Xu,Wenbo Ding
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Mobile manipulation requires, modalities remain kinematically, requires perceptual evidence, action modalities remain, Mobile manipulation
备注： Website: [this https URL](https://mopa-policy.github.io/)
点击查看摘要
Abstract:Mobile manipulation requires perceptual evidence at different spatial scales for base motion and arm control, while the two action modalities remain kinematically coupled. Existing policies often employ specialized action generation for different subsystems but condition heterogeneous action branches on a shared perceptual representation, leaving subsystem-specific perception-action correspondence implicit. We present MoPA, a framework that aligns perceptual conditioning with mobility and manipulation while preserving coordination at the action level. Dual Perceptual Streams employ two mutually masked query banks to extract separate perceptual representations from a shared vision-language context. Perception2Action Adaptation jointly updates each query bank and its corresponding action stream at every layer of a structured Mixture-of-Transformers decoder, while enabling information exchange between the two action streams. Coupled conditional flow matching learns a joint vector field for coordinated generation of both action chunks. On the ManiSkill-HAB benchmark, MoPA achieves state-of-the-art performance across all three task suites. Across four real-world tasks, MoPA achieves a mean full-task success rate of 76.3%, outperforming the best baseline by 12.5 percentage points. Ablation studies and further analyses validate the effectiveness of the proposed design. Website is available at: this https URL.
86. 【2609.12078】Feature Recovery for Object Understanding After Irreversible Fire Damage
链接：https://arxiv.org/abs/2609.12078
作者：Aditi Tiwari,Sofia Stoica,Savya Khosla,David Forsyth,Heng Ji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：irreversible physical transformations, undergo irreversible physical, change their geometry, visual appearance, environments often undergo
备注： 28 pages, 11 figures, 9 tables
点击查看摘要
Abstract:Objects in post-fire environments often undergo irreversible physical transformations that change their geometry, material state, and visual appearance. Detecting and identifying these remnants is critical for locating hazards, reconstructing pre-incident contents, and inventorying losses. Unlike standard image corruptions, these degradations affect the physical structure of the object itself. To study this setting, we introduce TRACE, a transformation-aware benchmark for post-fire object understanding. TRACE contains 21.4K real-image-grounded synthetic scenes and paired object-level pristine-to-degraded progressions spanning 499 object identities across 189 categories. We define five tasks targeting localization and pre-degradation understanding: degraded-object detection, pristine-state recovery and retrieval, original material recovery, pristine description generation, and functional reasoning. Existing models degrade sharply with severity. From the least to the most severe level, RF-DETR mAP decreases by 71% relative, while InternVL3.5 retrieval R@1 falls from 93.85 to 28.11. To address this, we propose the Feature Recovery Module (FRM), a plug-and-play module that maps degraded encoder features to pristine-aligned representations while keeping the host frozen. Trained only with paired feature supervision, FRM improves scene-level detection, CLIP/SigLIP2 feature recovery, and all four object-level VLM tasks, with larger gains under more severe degradation. Across VLM hosts and severity levels, relative gains average 12.5% for retrieval, 20.1% for material recovery, 13.2% for description generation, and 12.4% for functional reasoning.
87. 【2609.11986】Unlabeled Echoes: Pseudo-Labels and Genus-Aware Smoothing for Bat Call Recognition
链接：https://arxiv.org/abs/2609.11986
作者：Frank Fundel,Alexandra Howard
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：Passive acoustic monitoring, acoustic monitoring produces, Passive acoustic, acoustic monitoring, monitoring produces
备注： Accepted at CV4Ecology @ ECCV 2026
点击查看摘要
Abstract:Passive acoustic monitoring produces far more bat recordings than experts can label. We show that simple model-generated pseudo-labels turn this surplus into effective supervision. We compare pseudo-labeling with other semi-supervised learning methods on an 18-species European corpus using only 10% of its training labels, then transfer the strongest approaches to South African field audio containing nine bat taxa and a nuisance class. Pseudo-labeling outperforms the other semi-supervised learning methods on every European measure, recovering up to 61.5% of the gap to full supervision. It transfers to field audio with gains of 10.69 points in species accuracy and 4.96 points in species macro-F1. We also introduce genus-aware smoothing, which directs uncertain target mass toward congeneric species. Combined with uniform smoothing, it reaches 79.16 species macro-F1, 4.73 points above hard targets. Simple pseudo-labels are therefore highly effective at this ecological data scale, while genus-aware targets inject useful biological structure at no annotation cost. this https URL
Comments:
Accepted at CV4Ecology @ ECCV 2026
Subjects:
Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
Cite as:
arXiv:2609.11986 [cs.SD]
(or
arXiv:2609.11986v1 [cs.SD] for this version)
https://doi.org/10.48550/arXiv.2609.11986
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
88. 【2609.11947】Scenario-Independent Criticality Assessment and Prediction for Vulnerable Road Users in Autonomous Driving
链接：https://arxiv.org/abs/2609.11947
作者：Jörg Gamerdinger,Victor Schwarzenberger,Philipp Schmid,Sven Teufel,Oliver Bringmann
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：Increasing safety, criticality, primary objective, criticality prediction framework, Increasing
备注： Accepted at IEEE VTC Fall 2026
点击查看摘要
Abstract:Increasing safety is the primary objective of automated vehicles. Achieving this goal requires reliable safety metrics that incorporate safety-relevant factors such as object type, velocity, and criticality. A key capability of such metrics is the distinction between critical and non-critical objects, which is addressed through criticality or relevance estimation. Existing criticality metrics are typically designed for specific scenarios and primarily focus on vehicle-to-vehicle interactions. In this paper, we therefore propose a novel criticality metric tailored to vulnerable road users (VRUs), which require special consideration due to their less predictable motion behavior. Furthermore, to avoid the complexity introduced by scenario-specific metrics, we introduce a scenario-independent criticality prediction framework applicable to all traffic participant classes. The effectiveness of both the proposed VRU-centric criticality metric and the criticality prediction framework is evaluated using the DeepAccident dataset, which contains a diverse set of safety-critical traffic scenarios. The proposed VRU-centric criticality metric improves pedestrian criticality classification performance by up to 50 %. In addition, the proposed criticality prediction framework outperforms state-of-the-art metrics by 275 %, achieving an F1-score of 0.96 and enabling scenario-independent criticality assessment across all object classes. These results demonstrate the strong potential of the proposed approaches to enhance criticality assessment for safety evaluation in automated driving systems.
89. 【2609.11939】Adaptive AI: Energy Efficient Multi-exit TinyML on Intelligent Vision Systems at the Edge
链接：https://arxiv.org/abs/2609.11939
作者：Luca Crupi,Lorenzo Lamberti,Alessandro Giusti,Daniele Palossi
类目：Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：Traditional TinyML systems, Traditional TinyML, number of multiply-accumulate, input complexity, relying on fixed-depth
备注：
点击查看摘要
Abstract:Traditional TinyML systems for edge devices achieve high accuracy by relying on fixed-depth models that require a constant number of multiply-accumulate (MAC) operations regardless of the input complexity. This approach wastes critical resources in battery-powered Internet-of-Things (IoT) devices and limits the real-time performance of edge cyber-physical systems. Multi-exit execution schemes mitigate these issues and are widely used on high-end devices such as GPUs, but are rarely exploited on edge IoT devices because they require substantial rethinking given their strict memory and computational constraints. We address these aspects by designing and deploying, on an ultra-low-power GWT GAP9 System-on-Chip (SoC), a novel multi-exit computational scheme, demonstrating it on a MobileNetV2 convolutional neural network (CNN) for the ImageNet-100 classification task. Our approach introduces multiple exits at different CNN depths, each with a confidence-based gating mechanism that dynamically and autonomously decides whether to continue or stop inference. Comparing our multi-exit strategy to the standard MobileNetV2 on a GAP9 SoC, we show a 41% reduction in the average computational cost (from 313 MMAC to 185 MMAC), a 29% lower inference time (from 49 to 35 ms), and an energy saving of 24% (from 2.1 to 1.6 mJ per frame). All these improvements come with a ~1% loss in accuracy compared to the full-depth MobileNetV2, which achieves 80.5%. Finally, comparing our adaptable multi-exit scheme with a third-party state-of-the-art adaptive CNN, also deployed on the GAP9, we achieve more than 2x its computational efficiency, increasing it from 8.1 to 17.2 MAC/cycle.
90. 【2609.13135】Recurrent Dynamic Range Extension
链接：https://arxiv.org/abs/2609.13135
作者：Sebastian Dille,Keru Fu,S. Mahdi H. Miangoleh,Yağız Aksoy
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：dynamic range, present an approach, full dynamic range, input dynamic range, full HDR image
备注： 10 pages, 8 figures. Accepted to ACM SIGGRAPH Asia 2026
点击查看摘要
Abstract:We present an approach to progressively extend the highlights of an image. Instead of reconstructing the full dynamic range of a complex scene directly, we learn a simpler task first: We extend the dynamic range of an input image by a single exposure value. Once this is mastered, we retrieve the full HDR image for the scene by executing our network recurrently, progressively increasing the dynamic range of the input. Our formulation is agnostic to the input dynamic range and targets a bounded output domain. This enables us to use widely available RAW images for the reconstruction task and adapt adversarial losses to construct realistic images. By incorporating Memory Replay for backpropagation, we can train our network recurrently over multiple inference stages and reduce reconstruction errors. As a consequence, our system reconstructs challenging long-tailed HDR scenes robustly and shows powerful recovery of bright light sources and highlights.
