本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新600篇论文，其中：
- 自然语言处理98篇
- 信息检索14篇
- 计算机视觉92篇
自然语言处理
1. 【2609.19145】Objective vs. Search: Decomposing What Makes a Good Tokeniser
链接：https://arxiv.org/abs/2609.19145
作者：Ahmetcan Yavuz,Clara Meister,Tiago Pimentel
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：byte-pair encoding, BPE, modern language models, models, search procedure
备注： Accepted at EMNLP 2026. 20 pages, 4 figures, 10 tables. Code: [this https URL](https://github.com/Ahmetcanyvz/comp-vs-like)
点击查看摘要
Abstract:Two dominant tokenisation algorithms are used by modern language models: byte-pair encoding (BPE) and UnigramLM. These differ along two orthogonal axes: their optimisation objective (compression vs. log-likelihood) and their search procedure (bottom-up merging vs. top-down pruning). Existing comparisons confound these axes, making it unclear whether their observed differences stem from what is being optimised vs. how it is being optimised. We disentangle the two by introducing two new tokenisation algorithms that complete this 2x2 design space: BottomUpLL, a bottom-up likelihood-based tokeniser, and TopDownComp, a top-down compression-based tokeniser. We train language models with tokenisers produced by each algorithm, varying: model size, vocabulary sizes, and domain (English-only vs. multilingual). Evaluating models on bits-per-byte, we find that the search procedure -- not the objective -- is the dominant factor: bottom-up tokenisers consistently achieve lower bits-per-byte in most settings. Evaluating models on the BLiMP task, however, shows no consistent relationship between design choice and performance. Overall, our results disentangle the effect of tokeniser design choices on language modelling performance, offering concrete guidance for their more principled construction.
2. 【2609.19144】A Zeroth-Order Paradigm for LLM Preference Alignment
链接：https://arxiv.org/abs/2609.19144
作者：Peter Chen,Xi Chen,Wotao Yin,Tianyi Lin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：align large language, large language models, memory efficiency, align large, large language
备注： 39 pages
点击查看摘要
Abstract:Direct preference alignment methods are widely used to align large language models (LLMs) with human preferences because of their computational and memory efficiency. However, likelihood displacement motivates alternative ways to extract information from preference pairs with small likelihood margins. In this paper, we propose and analyze Comparison-based Preference Optimization (ComPO), a zeroth-order alignment method based on comparison oracles. ComPO extracts directional information from these pairs without directly optimizing a differentiable preference loss on them. We establish a convergence guarantee for its basic offline scheme under smoothness, gradient sparsity, and compatibility between the oracle and a latent objective. We further introduce online ComPO, which retains the offline comparison mechanism and uses unlabeled policy generations for reverse-KL control relative to a reference policy. Following the coverage perspective of preference fine-tuning, we establish a performance guarantee for a basic constrained scheme under local coverage and in-distribution pairwise reward accuracy. Experiments on Mistral, Llama, Gemma-2, Qwen3, and Gemma-3 models demonstrate improvements over existing direct alignment methods, including length-controlled win rates, with pair-level diagnostics providing evidence consistent with mitigating likelihood displacement.
3. 【2609.19143】PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection
链接：https://arxiv.org/abs/2609.19143
作者：Sara Pieri,Evangelos Kazakos,Shizhe Chen,Josef Sivic,Cordelia Schmid
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Intelligent systems, world require image, require image understanding, systems that act, comprehensive and spatially
备注：
点击查看摘要
Abstract:Intelligent systems that act in the world require image understanding that is both comprehensive and spatially grounded. Current vision-language models (VLMs) can generate fluent and detailed image captions, but reliably associating them with image pixels remains challenging. Existing methods that combine dense captioning with pixel-level grounding often produce either incomplete descriptions or inaccurate segmentation masks. We study this problem through panoptic grounded captioning, a task that requires a VLM to describe both foreground objects and background regions while grounding each referring phrase with pixel-level masks. We make three contributions. First, we introduce PanoCaps, a human-annotated benchmark constructed from panoptic segmentation datasets. It provides dense captions with near-complete pixel coverage and image-text alignments at the entity level, supporting both training and evaluation. We further propose a phrase-mask matching protocol and a generalized Panoptic Quality (gPQ) metric that jointly evaluates textual and mask agreement. Second, we formulate phrase grounding as selection from a phrase-conditioned pool of mask proposals and introduce PANORAMA, a VLM that conditions a pretrained segmenter on contextualized phrase representations to obtain candidate masks and learns to select those corresponding to each phrase. Training this interface jointly with caption generation enables PANORAMA to produce high-quality masks while allowing each phrase to refer to a single region or multiple instances. Third, PANORAMA achieves the best overall grounding on PanoCaps and matches or exceeds specialized models across several pixel-level grounding tasks. Experiments show that our method produces precise entity-level segmentations while maintaining detailed, mask-consistent captions. Code, data and models are available at this https URL.
4. 【2609.19134】ScienceIDE: Turning World's Scientific Codebase into Agent Learnable Environments
链接：https://arxiv.org/abs/2609.19134
作者：Hejia Geng,Zesen Huang,Haoyang Li,Wenbin Li,Koutian Wu,Zihan Zhou,Yuanbo Pang,Weihao Liu,Zigong Xu,Zhiping Li,Zongzheng Zhang,Chuanfei Dong,Jiankai Sun,Tianzhe Zheng,Fengyu Xie,Yue Ma,Yueheng Shi,Tong Xie,Zonglin Di,Xianrong Liu,Qucheng Gao,Yimin Liu,Jiaming Pan,Sheng Huang,Xiao-Han Ma,Lanqing Yuan,Zhenlin Zhu,Ziang Liu,Ziyang Xu,Junkai Wang,Kangkai Liang,Jiayi Xian,Zehong Zhao,Liuwei Xu,Jingxu Xie,Peijin Zhang,Qiang Gao,Chengyi Xing,Zhe Zhao,Xi Wang,Yaopeng Xing,Xing Meng,Zhenfei Yin,Yingcheng Wu,Ling Yang
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：repositories encode decades, Scientific, encode decades, decades of human, code repositories encode
备注： Code: [this https URL](https://github.com/aitofound/ScienceIDE)
点击查看摘要
Abstract:Scientific code repositories encode decades of human knowledge in executable models, methods, and tools. Yet fragmented toolchains, implicit domain conventions, and specialized correctness criteria make this knowledge difficult to convert into reliable learning experience-a challenge we call the scientific experience bottleneck. We introduce ScienceIDE, infrastructure for turning the world's scientific code into programmable environments for scientific agents. Guided by expert-defined scientific cases and acceptance criteria, agents transform repositories into executable environments that support task generation, execution, and scientific verification. These environments provide a shared foundation for supervised fine-tuning, reinforcement learning, and evaluation. Using verified interaction trajectories, we train PhAI-IDE-72B, PhAI-IDE-9B, and PhAI-IDE-4B. The model family shows gains in held-out scientific-code repair and across selected general-purpose benchmarks in code, reasoning, and knowledge, providing evidence of positive transfer from scientific experience to broader capabilities. ScienceIDE lays the foundation for an integrated workspace for agent learning and scientific practice, making humanity's scientific software a shared substrate for developing scientific intelligence. Code: this https URL
5. 【2609.19113】Playing log(N)-Questions over Wikipedia Abstracts: Communication Efficiency Between Paired Frontier Models
链接：https://arxiv.org/abs/2609.19113
作者：Peter Potash
类目：Computation and Language (cs.CL)
关键词：frontier language models, evaluate six frontier, frontier language, log, Wikipedia lead paragraphs
备注： 29 pages
点击查看摘要
Abstract:We evaluate six frontier language models on the two-agent $\log(N)$-Questions game. A questioner sees $N$ Wikipedia lead paragraphs and must identify a secretly chosen target using exactly $\log_2 N$ yes/no questions. An answerer sees only the target and the question, and replies with one word. Both roles run on the same provider, so the game measures how well a model communicates with itself across an information asymmetry. We run 408 games over document sets of 4 to 1024 paragraphs at a total API cost of \$363. One model finishes well behind the others: Claude Opus 5 wins 28 of 68 games, against 45 to 56 for GLM-5.3, GPT-5.6 Sol, Grok 4.6, Gemini 3.8 Flash and Kimi K3. The leading five are only marginally separable. Pooling those five, win rate declines with set size at $r=-0.973$ and is fit by a single per-round reliability parameter. The form is $\text{win}=p^{\log_2 N}$ with $p=0.928$. Losses divide into answer errors and discrimination failures in roughly equal measure, and models almost never name a document their own evidence excludes. Every unanimous answer error from the weakest model was inspected: 32 of 34 are ``No'' answers, on properties stated in the document's first sentence, under an instruction that explicitly warns against defaulting to ``No''. Information per question, estimated from answer balance, correlates with win rate at $r=+0.88$. The only two models to extract a full bit per question are the only two that partition on document titles, a strategy absent below $N{=}32$ and used in a quarter of questions above it. Reasoning-token expenditure varies $4.5\times$ across models with little relation to success, and the trace grows as the candidate set shrinks without a matching gain in reliability.
6. 【2609.19101】Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluations
链接：https://arxiv.org/abs/2609.19101
作者：Leon Bergen,Usha Bhalla,Andrew Lee,Barak Widawsky,Linas Nasvytis,Connor Watts,Siddharth Boppana,Sidharth Baskaran,Dron Hazra,Michael Byun,Atticus Geiger,Owen Lewis,Matthew Kowal,Vasudev Shyam,Thomas Fel,Thomas McGrath,Ekdeep Singh Lubana,Jack Merullo
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：reward hacking, hacking, reward, hacks, reward hacking behaviors
备注：
点击查看摘要
Abstract:As models scale, reward hacking becomes more frequent, more sophisticated, and more consequential. Does it leave a telltale signature in model representations? This work analyzes how reward hacking is represented internally in frontier open source LLMs, and how those representations can be used to understand and discover the range of hacking behaviors a model displays. In particular, we find that simple difference of means vectors coherently represent reward hacking in Kimi K3, GLM 5.2, and Qwen 3.8 Max across a variety of behaviors in common evaluations. Despite their simplicity, these vectors are both generalizable and interpretable, and we can use them to reliably detect reward hacking. We first evaluate reward hacking in commonly reported benchmarks like DeepSWE and SWE-bench, finding that models reward hack excessively in these environments; GLM 5.2 hacks in 57.2% of rollouts on DeepSWE and in 73% of rollouts on SWE-bench. Catching these requires monitors; LLM monitors are effective, but expensive detectors. We show that DoM vectors are similarly effective but virtually free, catching 3.1% more hacks in Kimi K3 and 7.9% fewer hacks in GLM 5.2 on DeepSWE at a monitor matched false positive rate. DoM vectors run on the chain-of-thought also predict reward hacks in the model's subsequent actions, meaning we can run them online and catch potential hacks before they occur. Finally, we analyze probe-hits that LLM monitors do not catch and discover other undesirable behaviors, as well as show transfer to finding hacks in non-SWE evaluations. Together, these results provide evidence that simple, white-box methods can be used to scalably study and monitor reward hacking behaviors in frontier open source models
7. 【2609.19093】Reporting Practice Matters: The Impact of Reference Choice on Chest X-ray Report Evaluation
链接：https://arxiv.org/abs/2609.19093
作者：Daniel P. Jeong,Charles Q. Li,Hossein Hosseiny,Nitya M. Bhalla,Fatma Uyar Morency,Pradeep Ravikumar,Zachary C. Lipton,Michael Oberst
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Radiologists follow heterogeneous, follow heterogeneous reporting, heterogeneous reporting practices, reporting practices, Radiologists follow
备注： Preprint
点击查看摘要
Abstract:Radiologists follow heterogeneous reporting practices. Two radiologists examining the same image and identifying the same clinical findings might nevertheless compose superficially distinct reports, varying in terminology, shorthand, formatting, and level of detail. These variations in reporting norms represent an under-appreciated obstacle in efforts to evaluate AI-based radiology report generation (RRG) models, where machine-generated reports are typically assessed based on their concordance with human-generated references. In this paper, we quantify the sensitivity of established evaluation metrics to variations in reporting practices, revealing impacts large enough to alter the rankings of models. We introduce a radiologist-informed taxonomy of variations in radiology reporting practice and a method (ReRef) that rewrites reference reports along the axes of our taxonomy while preserving clinical interpretation. For instance, when comparing the performance of nine RRG models on MIMIC-CXR using RadCliQ-v1, condensing the discussion of normal findings in the reference reports causes Libra to drop from first to second place while CheXOne rises from third to first. Our results suggest that many current metrics fail to decouple clinical interpretation from conformity to reporting practices and that choosing the ``right'' references that accurately reflect the desired reporting practices can be important in practice. To support future research, we release MIMIC-CXR-Ext-ReRef, a radiologist-validated dataset of 120 (original, alternative) reference report pairs derived from MIMIC-CXR.
8. 【2609.19088】MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education
链接：https://arxiv.org/abs/2609.19088
作者：Luyao Zhu,Xun Wei Yee,Wei Li,Mun Thye Mak,Wee Siong Ng
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：remain insufficiently evaluated, achieved remarkable progress, settings remain insufficiently, educational settings remain, Large vision-language models
备注：
点击查看摘要
Abstract:Large vision-language models have achieved remarkable progress in multi-modal understanding, yet their capabilities in educational settings remain insufficiently evaluated. In AI-assisted language learning, models must interpret artistic imagery, understand its semantic, affective, and cultural content, and reason about visual context to support meaningful interaction. However, existing benchmarks primarily focus on real-world images or domain-specific educational reasoning, providing limited coverage of artistic educational content. To address this gap, we introduce MUSE, a benchmark for evaluating large vision-language models on artistic image understanding in situated educational applications. MUSE decouples image annotation from question generation, enabling diverse tasks with controllable difficulty while reducing annotation effort. It comprises twelve tasks spanning visual perception, semantic and affective interpretation, culture understanding, and compositional reasoning, together with diverse artistic images deliberately curated to center Singaporean and Southeast Asian multicultural contexts alongside Western art traditions, covering multiple themes and difficulty levels. Evaluation of open-source and proprietary models reveals substantial disparities across capability dimensions, particularly in affective interpretation and compositional reasoning. Our analysis further identifies common failure modes and key challenges for developing trustworthy multi-modal models for education. We hope MUSE will serve as a standardized benchmark for advancing multi-modal understanding in situated educational applications.
9. 【2609.19072】Safety-Flag: A Unified Benchmark for the Reliability and Calibration of LLM Content Moderators
链接：https://arxiv.org/abs/2609.19072
作者：Yibo Hu
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：Large language models, Large language, individual benchmarks, Large, report aggregate accuracy
备注：
点击查看摘要
Abstract:Large language models are increasingly used for content moderation, but most evaluations still report aggregate accuracy on individual benchmarks. We introduce Safety-Flag, which places seven widely used safety benchmarks (BeaverTails, XSTest, Ethics, WildGuard, Aegis, ToxiChat, and ToxiGen) into a single balanced flag / do-not-flag protocol. We release item-level decisions and confidence scores for six general-purpose LLMs and four dedicated guards, together with three reference models, evaluated on the same items. Safety-Flag measures three dimensions of moderator reliability: error direction, probability calibration, and confidence-based error ranking for human review. They often disagree. Aggregate accuracy does not reveal error direction: one model flags $85\%$ of benign content, whereas another misses $54\%$ of harmful content. All six general-purpose models are overconfident; fitting one temperature per model reduces calibration error by $2.8$--$6.0\times$ without changing predicted labels or confidence ordering. Confidence-based abstention lowers selective risk for every model, although the gains depend on how well confidence ranks errors. Dedicated guards produce fewer false alarms and are better calibrated, but several have higher miss rates outside their documented coverage. We release the benchmark, fixed item lists, evaluation code, per-item model outputs, and leaderboard at: this https URL.
10. 【2609.19071】Benchmarking Large Language Models for Biomedical Relation Extraction
链接：https://arxiv.org/abs/2609.19071
作者：Claudiu Creanga,Teodor Marchitan,Liviu P. Dinu
类目：Computation and Language (cs.CL)
关键词：Extracting SNP-phenotype associations, Extracting SNP-phenotype, vital but challenging, biomedical literature, literature is vital
备注：
点击查看摘要
Abstract:Extracting SNP-phenotype associations from biomedical literature is vital but challenging. We benchmarked diverse NLP models, including MLMs, hybrid architectures, and state-of-the-art LLMs (Gemini 2.0, OpenAI O-series, Qwen, Mistral), on the SNPPhenA corpus across three tasks: sentence-level, abstract-level, and association strength classification. OpenAI O1 achieved state-of-the-art (SOTA) results using few-shot learning for non-finetuned sentence-level classification (F1 0.89) and established a new SOTA for abstract-level classification (F1 0.82). Association strength classification proved difficult, though fine-tuned Gemini 2.0 Pro performed best (F1 0.60) in the first LLM evaluation of this task. Proprietary LLMs, especially in few-shot (O1) or fine-tuned (Gemini 2.0 Pro) settings, significantly outperformed other models. These findings confirm the power of modern LLMs for genomic knowledge extraction.
11. 【2609.19070】Reading Between the Lines: Can LLMs Discover the Question Behind the Text?
链接：https://arxiv.org/abs/2609.19070
作者：Claudiu Creanga,Liviu P. Dinu
类目：Computation and Language (cs.CL)
关键词：paper introduces, inferring the single, focused on inferring, motivated the creation, question archaeology
备注：
点击查看摘要
Abstract:This paper introduces ``question archaeology'', a specific evaluation task focused on inferring the single, authentic "genesis question" that motivated the creation of a complete text. Distinct from question generation, which targets any plausible question, or discourse frameworks that model utterance-level acts, our task assesses a model's grasp of authorial intent. We present a new dataset of commissioned texts paired with their original research questions and plausible distractors. Our evaluation of both proprietary models, like Gemini Flash and Pro, as well as open source models like Mistral and Qwen, reveals significant progress in this task, with the newer versions outperforming the earlier ones, while BERT-based models performed poorly. Notably, our findings indicate that current LLMs surpass human performance on this task, suggesting advanced understanding of authorial intent. This capability has important implications for AI's role in tasks requiring nuanced interpretation of human communication. Our work thus provides a new framework and a challenging benchmark for future models.
12. 【2609.19059】MIRAGE: How Conversation State Shapes Historical Evidence Use in Multimodal Personal Agents
链接：https://arxiv.org/abs/2609.19059
作者：Yu Liu,Wenxiao Zhang,Cheng Hu,Cong Cao,Fangfang Yuan,Xinyu Wang,Jin B. Hong,Yanbing Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Multimodal large language, large language model, long-running tasks, large language, assistants for long-running
备注： Accepted by ACM MM 2026
点击查看摘要
Abstract:Multimodal large language model (MLLM) agents are increasingly used as personal assistants for long-running tasks. Their utility depends on continuity: agents must retrieve and use earlier evidence across dialogue, files, and workspace state. However, agents can generate plausible answers even when access to that history has degraded, causing outcome-only evaluation to overestimate true evidence use. We present MIRAGE (Multimodal Interaction Retrieval, Attribution, and Grounding Evaluation), a controlled study of historical evidence use under conversation-state variation in multimodal personal agents. MIRAGE holds evidence objects, questions, and scoring fixed while varying only conversation state, and evaluates whether an agent can determine answerability, recover the correct source, and answer from it. Across seven frontier and open-weight multimodal backbones, we find that: 1) pre-compaction depth and post-compaction continuation form distinct, non-monotonic failure regimes rather than a single degradation curve; 2) open-weight models rely heavily on context continuity and are reluctant to spontaneously switch to tool-mediated retrieval when provenance fails; and 3) retrieval pressure improves source attribution in deep pre-compaction states for tool-compliant models, but consistently regresses after compaction, where stored evidence has already degraded. These findings show that historical evidence use should be evaluated under state variation, rather than inferred from outcome-only correctness.
13. 【2609.19044】Entropy in Conversational AI: Structured Unpredictability as Inferrable Interiority
链接：https://arxiv.org/abs/2609.19044
作者：Sebastian Cochinescu
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：producing history-dependent behavior, increase response diversity, history-dependent behavior, diversity without producing, producing history-dependent
备注： 18 pages, 5 figures, 6 tables. Ancillary files contain the complete artifact: code, frozen protocol, per-sequence and per-item outcome files, and deterministic analysis scripts. Code archive: [this https URL](https://doi.org/10.5281/zenodo.21462383) Final-grid pre-registration: [this https URL](https://osf.io/dyt3w/)
点击查看摘要
Abstract:Sampling can increase response diversity without producing history-dependent behavior. We formalize a different design target, structured unpredictability, as conditional dependence between an output and a persistent hidden state beyond what an observer can infer from the transcript. A selection layer updates a low-dimensional style-and-attention state from a capacity-limited stream, generates several responses with a fixed base model, and selects for novelty and state affinity. Evaluation uses scripted sequences of independent prompt turns: the base model receives the current turn and rendered state, but not the preceding dialogue; cross-turn dependence resides in the wrapper state and response selector. A synthetic implementation validates the pipeline and matches four prospectively hash-frozen divergence features at point level. In the final real-model grid (mlx-community/Qwen2.5-1.5B-Instruct-4bit; 56 sequences per arm), the mechanism increased lexical novelty over the low-variance and consistency-only controls by 0.073 and 0.023, respectively. Its stylometric-consistency contrast with novelty-matched sampling was equivalent to zero under the registered smallest-effect rule, so the joint novelty-consistency criterion failed. The original two-part accumulation criterion also failed; a revised final-grid contrast, frozen after the powered grid, found higher consistency than the memory-reset ablation (0.028, 95% CI [0.018,0.039]), but does not establish path dependence. Twin separation was not established (0.003, 95% CI [-0.011,0.019]); the mean curve's saturating curvature matched the frozen prediction, which without separation does not support path dependence. Probe-level capability equivalence held within +/-0.10 on a near-ceiling battery, while output quality was not evaluated. All outcomes are machine-scored; no claims about perceived mind or consciousness are tested.
14. 【2609.19022】alkMatrix: Generating Character Dialogue that is Both Consistent and Diverse
链接：https://arxiv.org/abs/2609.19022
作者：Ayuto Tsutsumi,Yuu Jinnai
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Candidate-based decoding typically, Candidate-based decoding, decoding typically selects, non-decomposable requirements, satisfies global
备注：
点击查看摘要
Abstract:Candidate-based decoding typically selects a completion for each prompt independently, but many applications require a collection of outputs that satisfies global, non-decomposable requirements. We formulate this setting as structured multi-prompt, multi-completion selection: given a candidate pool for every prompt, select one completion per prompt to optimize a collection-level objective. We instantiate the problem in character dialogue, where each character should remain consistent across situations, each line should fit its situation, and characters and situations should remain distinguishable. Our method, TalkMatrix, generates multiple candidates for every character--situation pair and jointly selects a complete matrix using four embedding-based consistency and diversity objectives. Because a weighted sum can improve some dimensions by sacrificing another, TalkMatrix maximizes the worst-performing objective through a two-level minimax formulation. We approximately optimize the resulting discrete objective with multi-start coordinate ascent, and compare it with local, partial-matrix, and generic combinatorial search baselines. We run experiments on $50$ synthetic role-playing scenarios and $25$ curated board game scenarios where multiple characters interact in predefined situations. An LLM-as-a-judge rates matrix-level selection higher than random and independent cell-level selection baselines. These results show the value of structured selection for globally controlled dialogue generation, while our empirical validation remains specific to role-playing scenarios.
15. 【2609.19006】WordPolo: Evaluating Language Models Through Iterative Semantic Feedback
链接：https://arxiv.org/abs/2609.19006
作者：Tyler McDonald,Ali Emami
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Large Language, Large Reasoning Models, Large Reasoning, Large
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) and Large Reasoning Models (LRMs) are typically evaluated on challenging benchmarks through dataset accuracy alone, providing no insight into the quality or faithfulness of their reasoning processes. We present WordPolo, a word-finding task where participants must discover an unknown target word using semantic similarity feedback. Players start with zero knowledge, make guesses, and receive distance scores (1 = correct, higher = further away). Success requires interpreting scores to navigate semantic space and systematically narrow the search. This design makes iterative reasoning and adaptive search strategies both directly observable and necessary for success. We evaluate recent LLMs (GPT-4.1, Llama 4, Claude 3.5 Haiku, Qwen 3), LRMs (o4-mini, Deepseek-R1), humans, and a novel heuristic on 1,500 puzzles. Beyond solve rates (which range from 4% to 62%), we introduce progression-based metrics that reveal models often make meaningful progress, insights that accuracy alone would miss. Our analysis shows how reasoning models can be hindered by overthinking and underthinking, while successful models exhibit human-like strategies. WordPolo demonstrates the need for benchmarks that test both reasoning process and outcomes, providing holistic measurements of model capabilities. Our code and dataset can be found at this https URL.
16. 【2609.19004】CompileRover: Revolutionizing Virtual Machine Compiler Optimization with a Tri-Role LLM-Driven Framework
链接：https://arxiv.org/abs/2609.19004
作者：Mingqiao Mo,Yunlong Tan,Hao Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：virtual machine compilers, virtual machine, frameworks significantly enhancing, generated assembly code, machine compilers
备注： 20 pages
点击查看摘要
Abstract:Code optimization plays a crucial role in the development of virtual machine compilers, with optimization frameworks significantly enhancing the performance of generated assembly code. However, existing virtual machine compiler outputs frequently exhibit redundant computations, inefficient loop structures, and suboptimal function implementations, which collectively impair execution efficiency. To address these shortcomings, we propose CompileRover, an advanced optimization framework specifically designed for virtual machine compilers. CompileRover employs a sophisticated three-role collaboration mechanism, comprising a referee, an advisor, and an operator, effectively overcoming performance bottlenecks by leveraging comprehensive optimization algorithms and novel methodologies, including control flow analysis, code structure transformations, and dynamic execution pattern recognition. Extensive evaluations demonstrate that CompileRover consistently surpasses state-of-the-art virtual machine compilers, achieving significant improvements in execution performance across various benchmarks. Furthermore, performance analyses validate that the introduced optimizations notably reduce execution overhead, improve dataflow consistency, and robustly enhance compiler performance, showcasing CompileRover as an effective and reliable approach to optimizing virtual machine compilers.
17. 【2609.19002】Code Consistency Preference Optimization Verification for Language Model Alignment
链接：https://arxiv.org/abs/2609.19002
作者：Yunlong Tan,Mingqiao Mo,Hao Zhang
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：Execution-based verification enhances, enhances large language, large language models', language models' mathematical, verification enhances large
备注： 24 pages
点击查看摘要
Abstract:Execution-based verification enhances large language models' mathematical reasoning through computational soundness and dependency-aware filtering. However, prior preference optimization methods relying on Bradley-Terry reward models fail to capture the logical dependencies and execution consistency needed for scientific tasks. We propose a method that generates computationally sound solutions with dependency graphs for execution-consistent preference optimization. We first build a scientific reasoning dataset using UltraFeedback prompts, model generations, verification, and consistency results. Then we extract reasoning step expressions, prerequisites, and derivability relationships to construct dependency graphs and compute execution consistency scores. These scores are appended to each step, creating paired training data. Fine-tuning Llama-3-8B and DeepSeekMath-7B yields significant gains: +17.0% on MATH and +15.1% on GSM8K. Extending our Scientific Feasibility Control framework achieves 50.1% accuracy on PhyX multimodal physics reasoning, surpassing DeepSeek-R1 (49.8%) and OpenAI o3-mini (48.2%), with 91.7% scientific validity coverage at alpha=0.10 and 73% fewer scientific law violations, resulting in the CCPO model family.
18. 【2609.18998】One Axis, No Brake: Self-Knowledge Limits the Filtering of Harmful Peer Conformity in LLMs
链接：https://arxiv.org/abs/2609.18998
作者：Yibo Hu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Multi-agent LLM systems, Multi-agent LLM, LLM systems, systems are expected, model
备注：
点击查看摘要
Abstract:Multi-agent LLM systems are expected to be more reliable because agents can catch each other's mistakes. But peer pressure cuts both ways: the same correction that fixes a wrong answer can overturn a right one. The tempting safeguard is a brake that keeps the beneficial revisions and blocks the harmful ones. We show this brake is hard to build, for a simple reason: a revision is harmful exactly when the original answer was right, so deciding whether to block it is the same as knowing whether the model was already correct. This turns the open-ended hunt for a brake into one measurable quantity, the model's self-knowledge: any brake built from a deploy-time signal is a correctness probe in disguise, and self-knowledge is far from perfect (AUROC $\approx 0.64$--$0.89$ across six model families). We call this ceiling the wall. Even white-box steering of the model's own correctness direction does not breach it: it changes how often the model revises, but harmful and beneficial revisions move together. At population scale the wall becomes the cliff: when most agents start wrong, debate amplifies the shared mistake into a confident, wrong consensus. In our multiple-choice societies, more agents, more model diversity, and a stronger member do not fix it. What helps is adding information before the revision, not filtering after it. Local agreement is not global correctness.
19. 【2609.18996】Compiled Agency: Frontier General-Purpose Coding Agents Build Winning Game Players from Bare Interaction - from Flappy Bird to StarCraft II and Civilization
链接：https://arxiv.org/abs/2609.18996
作者：Joey Xiao,Haonan Huang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM agents, supplying perception, skill libraries, executable-policy scaffolds, repeatedly struggled
备注：
点击查看摘要
Abstract:LLM agents have repeatedly struggled to convert knowledge of a game into competent play, even when researchers build the agent around the model - supplying perception, memory, skill libraries, planners, or executable-policy scaffolds. Rapid progress in coding agents raises two sharper questions: can frontier models now win games at all, and can they win them unaided, building the entire player themselves? We introduce Gauntlet, a develop-freeze-evaluate framework that ports games from small arcades to full commercial-scale titles, behind one deliberately bare contract: a general-purpose coding agent receives a game description, a raw observation/action interface, and an empty policy file - no strategy, no algorithm, no architecture. In a single autonomous session the agent experiments with the live game and engineers a standalone controller; we freeze the result and score it on held-out instances with zero model calls during play. On an unpublished procedural roguelike, held-out success spans 0-86 percent and exposes a sharp generational threshold: every observed session of a newest-generation system outperforms the best session of its predecessor. At full-game scale, a compiled raw-API controller defeats every fair StarCraft II built-in AI and two cheating variants, and single-session programs win complete games of Civilization (Freeciv) by total conquest on held-out seeds. Though at modest rates against novice AI, this is a first: no prior language-agent system had won full games of this genre standalone, without per-turn model calls and a hand-crafted tactical layer. Frontier coding agents begin to track long-horizon strategy. The frozen programs are inspectable. We call this capability compiled agency: development experience compiled into a persistent executable agent whose architecture is built by the model.
20. 【2609.18994】A Benchmark Suite and Ground-Truth Methodology for Formal Verification of IEC 61131-3 Ladder Diagram Programs
链接：https://arxiv.org/abs/2609.18994
作者：Pierre Dantas,Lucas Cordeiro,Waldir Junior
类目：Computation and Language (cs.CL); Hardware Architecture (cs.AR); Software Engineering (cs.SE)
关键词：Programmable Logic Controller, IEC 61131-3 encodings, Structured Text, Ladder Diagram, Logic Controller
备注： 11 pages
点击查看摘要
Abstract:We present the first benchmark suite for formal verification of Programmable Logic Controller (PLC) programs that combines controlled ground truth with coverage of both textual (Structured Text, ST) and graphical (Ladder Diagram, LD) IEC 61131-3 encodings. Despite growing support for tools, the field lacks standard evaluation benchmarks: existing corpora omit formal properties or graphical dialects, and private program sets preclude reproducible measurement of progress. Our suite comprises 50 programs in 83 variants across ten industrial domains, provided in PLCopen Extensible Markup Language (XML) and ST, each paired with a formal property, machine-checkable expected verdict, and violation witness in the Software Verification Competition (SV-COMP) format. The central methodological contribution is a tripartite ground-truth discipline - verdicts are established by construction, fault injection, or audited cross-tool consensus - motivated by a concrete failure mode where the obvious safety property misclassifies all attacks from two public logic-bomb corpora as safe due to invisible non-termination. Reference verdicts are obtained with the Efficient SMT-Based Context-Bounded Model Checker (ESBMC) v8.4 from source: all 25 graphical benchmarks execute, and 43 of 45 accepted variants match recorded verdicts. On the finite-state fragment (21 benchmarks), nuXmv - a model checker with unrelated decision procedures - agrees on all 24 interlock variants and resolves two benchmarks ESBMC-PLC leaves unknown, confirming tool-neutral ground truth and discriminative power. Porting exposes format and semantics fragmentation: front-ends accept different serializations, and timer semantics vary across tools - phenomena the suite is designed to reveal. The corpus, schema, validator, and recheck harness are released as open artifacts.
21. 【2609.18961】MechSparse: Mechanism-Guided Sparse PEFT Selection Is Task-Shaped
链接：https://arxiv.org/abs/2609.18961
作者：Son Ha Xuan,Phat T. Tran-Truong,Xuan-Bach Le
类目：Computation and Language (cs.CL)
关键词：Mechanistic interpretability identifies, carry specific behaviors, interpretability identifies sparse, identifies sparse subsets, Mechanistic interpretability
备注：
点击查看摘要
Abstract:Mechanistic interpretability identifies sparse subsets of heads and MLP blocks that carry specific behaviors. We ask whether such causal signals can guide where to place a small PEFT budget more effectively than the cheap heuristics practitioners already use. \method{} scores attention heads and MLP blocks by normalized activation-patching recovery on clean/corrupted probes and trains LoRA/QLoRA only on the selected sites; \methodc{} adds bounded credit for small within-layer joint subsets. We compare against random, magnitude, activation-norm, and gradient/Fisher on Ministral-8B/NF4 in three cells: Swahili span-JSON information extraction (IE) at $b{=}0.25\%$ and $1.0\%$, and English$\to$Swahili machine translation (MT) at $b{=}1.0\%$. The causal selectors never win the primary metric. On the headline IE cell (3 seeds, paired-bootstrap CIs over $600$ predictions), \methodc{} beats random by $+0.079$ span+type F1 and gradient/Fisher by $+0.174$, but trails activation-norm by $0.028$, with the smallest cross-seed std ($\pm 0.003$). On MT all four selectors lie within $0.30$ BLEU and every paired CI includes zero. A schema-versus-span decomposition explains the IE gap: activation-norm captures the rigid JSON routine, while causal scores track content-sensitive sites. We distill a preliminary diagnostic -- prefer activation-norm when output structure dominates, treat causal selectors as a hypothesis for content-dominated tasks -- and release masks, scores, predictions, and evaluation files for direct replay.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.18961 [cs.CL]
(or
arXiv:2609.18961v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.18961
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
22. 【2609.18960】When Audit Quality Fails to Predict Downstream Utility: A Counterfactual Study of Synthetic-Data Selectors for Low-Resource African NLP
链接：https://arxiv.org/abs/2609.18960
作者：Son Ha Xuan,Phat T. Tran-Truong,Xuan-Bach Le
类目：Computation and Language (cs.CL)
关键词：LLM judge rates, Quality-aware synthetic-data selection, LLM judge, downstream model learn, synthetic-data selection rests
备注：
点击查看摘要
Abstract:Quality-aware synthetic-data selection rests on a proxy: examples that an LLM judge rates as good should also help a downstream model learn. In a controlled replay in low-resource African-language classification, we show that this proxy breaks. Across four languages (Amharic, Hausa, Swahili, Yoruba), two classification tasks (MasakhaNEWS, AfriSenti), and five matched-budget selectors, audit rankings and downstream rankings diverge. Within each cell, the Spearman between judged label correctness and Macro-F1 across selectors has mean $\rho{=}0.04$ (median $0.00$), showing that the mismatch is not an aggregation artifact. \method{}-V2, our counterfactual audit framework, produces the cleanest selected pool on three audit channels at once: highest judged label correctness ($0.904$ vs.\ $0.767$ for naive, a $17.9\%$ relative gain), lowest shortcut score, and a hard-reject rate of $0.162$ vs.\ $0.486$ for naive. AlpaGasus nevertheless leads downstream Macro-F1 ($0.202$ vs.\ $0.163$ for \method{}-V2), and the inversion persists on the five non-degenerate cells. The lesson is methodological: in this controlled setting, audit quality is a property of the selected pool, not a guarantee of downstream utility. Synthetic-data evaluation should therefore report audit and downstream metrics on the same retained sets. We release the audit tables, per-selector retained pools, and a claim ledger that links every reported number to its source row.
23. 【2609.18959】LangSelect: Cost-Aware Target-Language Routing for LLM Code Generation
链接：https://arxiv.org/abs/2609.18959
作者：Son Ha Xuan,Phat T. Tran-Truong,Xuan-Bach Le,Nghia Duong-Trung
类目：Computation and Language (cs.CL)
关键词：LLM code-generation systems, LLM code-generation, target programming language, code-generation systems, decoding and treat
备注：
点击查看摘要
Abstract:LLM code-generation systems usually choose a target programming language before decoding and treat that choice as fixed. We show that, for language-flexible programming tasks -- tasks where several target languages are acceptable and checkable by the same tests -- this choice is a measurable cost lever: verified implementations of the same task can differ substantially in generated-token length. We introduce LangSelect, a verification-aware router that selects the target language before generation and falls back when the first attempt fails. To separate offline routing opportunity from end-to-end behavior, we evaluate verified-solution replay, which chooses among already accepted corpus solutions, and live GPT-5 generation, which charges every generation attempt, including failures and fallbacks. On MultiLang-Bench, a 3,000-task, 8-language verified corpus, replay shows substantial language-routing headroom. In live evaluation on 450 held-out tasks, a train-split Domain heuristic baseline reduces harness-proxy tokens, which include wrapper and entrypoint overhead, by 50.3\% at 92.9\% pass after fallback, while a learned CodeBERT+metadata selector reaches the highest pass after fallback, 93.8\%, with a 3.7\% token increase. These results show that output-language routing can define a practical cost-correctness frontier for unit-test-verifiable code generation.
24. 【2609.18935】Long-Lived Characters, Local Inference: Incremental Memory Maintenance for Game NPCs
链接：https://arxiv.org/abs/2609.18935
作者：Zimu Xu
类目：Computation and Language (cs.CL)
关键词：reread its entire, entire life, deployed language-model characters, long reusable prefix, locally deployed language-model
备注： 18 pages, 6 figures. Supporting numerical snapshots included as ancillary files
点击查看摘要
Abstract:A game character should not have to reread its entire life before every conversation. For locally deployed language-model characters, however, revising a few memories can invalidate a long reusable prefix. The resulting preparation cost competes with both foreground dialogue and the maintenance of other characters. This matters especially when dialogue feeds game-defined actions and value judgments: a fluent but incorrect account of who owns an item, or whether a transfer has already happened, can corrupt the input to otherwise deterministic rules. We study incremental memory maintenance for long-lived game NPCs in a quantized Qwen hybrid recurrent-attention model. Our runtime removes superseded attention KV entries, computes replacement records at the true sequence tail, and preserves the continuing recurrent state and unchanged KV. Existing local experiments combine multi-update dialogue replays, fixed-input placement ablations, and attention diagnostics. Independent block composition weakens query-conditioned memory selection without a uniform chunk-initial attention collapse. True-tail updates preserve important current-state and historical bindings across eight scripted maintenance rounds; a placement case recovers the full-refill quantity in three reconstructions, while slot-preserving alternatives repeat a double-subtraction error. Attention-distribution proximity alone does not explain these semantic differences. The results motivate treating a character's inference state as a maintained, history-dependent resource, rather than only a disposable encoding of its latest memory text.
25. 【2609.18909】Beyond Outcomes: Dual-View Relational Learning for Efficient Agent Benchmarking
链接：https://arxiv.org/abs/2609.18909
作者：Xinshuai Guo,Junjie Wu,Dolly Deng,Yinghui Li,Hai-Tao Zheng,Suncong Zheng,Maxm Pan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：conventional LLM benchmarks, conventional LLM, LLM benchmarks, substantially more costly, costly to evaluate
备注：
点击查看摘要
Abstract:Agent benchmarks are substantially more costly to evaluate than conventional LLM benchmarks. Benchmark compression is therefore a natural solution, yet existing methods primarily model redundancy in task--model final-score distributions, which is important in agentic evaluation. To address this limitation, we analyze large-scale trajectories and identify six complementary process signals that are systematically associated with final agent performance. To disentangle agent performance redundancy from a complete perspective, we propose DualViewEval, an agent benchmark compression method that jointly exploits outcome and process relations to learn an exact-size miniset and predict the full-benchmark scores. Across five agent benchmarks and five representative baselines, DualViewEval achieves the best results in all datasets. With only 20 tasks, it achieves $24\times$--$40\times$ compression on APEX-Agents and BFCL, reducing mean absolute error (MAE) by $14.5\%$--$28.2\%$ over the strongest competitors while improving Kendall's $\tau$ by up to $7.2\%$ relative to EssenceBench on SWE-bench Verified. The selected minisets further reveal capability differences among different agents, providing compact and diagnostic feedback for efficient agentic model development.
26. 【2609.18908】How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards
链接：https://arxiv.org/abs/2609.18908
作者：Yanyi Pu,Damian A. Gonzalez-Salzberg,Zheng Yuan,Nikolaos Aletras
类目：Computation and Language (cs.CL)
关键词：Existing legal benchmarks, cover diverse tasks, remain comparatively underexplored, continuous monetary remedies, monetary remedies remain
备注： EMNLP 2026 main conference paper. 28 pages, 5 figures
点击查看摘要
Abstract:Existing legal benchmarks cover diverse tasks, while continuous monetary remedies remain comparatively underexplored. We introduce ECtHR-NPD, to the best of our knowledge, the first benchmark for predicting non-pecuniary damage (NPD) awards at the European Court of Human Rights (ECtHR) from case information when no statutory formula or explicit calculation rule determines the amount. ECtHR-NPD contains 14,575 cases with case-level awards in nominal euros, chronological splits, and a protocol separating target construction from model input. We evaluate a battery of methods, including constant predictors, gradient-boosted trees, retrieval methods, fine-tuned encoder language models (LMs), prompted decoder LMs, and knowledge-augmented agents. Our results show that more sophisticated LM and agentic approaches do not consistently outperform the strongest feature-based baseline. All model families struggle to identify zero awards and to calibrate high-award predictions, with further degradation on the Challenging test view, making ECtHR-NPD a challenging testbed for current state-of-the-art open-weight and proprietary LMs.
27. 【2609.18905】Structured Claim-Level Discourse Representations for Dense Health Narratives
链接：https://arxiv.org/abs/2609.18905
作者：Farnoushsadat Nilizadeh,Elham Pourabbas Vafa,Shirin Nilizadeh,Eduard Dragut
类目：Computation and Language (cs.CL)
关键词：short conversational spans, densely entangled claims, social media videos, evidential frames, conversational spans
备注：
点击查看摘要
Abstract:Health discourse in social media videos often contains densely entangled claims spanning multiple thematic aspects, stances, evidential frames, and rhetorical functions within short conversational spans. Existing approaches largely rely on coarse topic-level, sentiment-based, or stance-oriented representations that do not adequately capture this structure. Our analysis identifies an average of 13.22 atomic claims per minute, motivating richer claim-level discourse representations. We introduce a structured framework for claim-level discourse analysis in dense health narratives. Our framework models discourse through tuples linking atomic claims with thematic aspects, stance, and multidimensional pragmatic discourse attributes. To support this setting, we construct a benchmark spanning four health domains with 1,191 manually annotated claims from 60 videos. Using this framework, we evaluate automated structured discourse analysis under different discourse context settings. Results show that current LLMs achieve strong performance on thematic categorization and stance prediction, but struggle with high-dimensional pragmatic profiling. We also find that different discourse tasks benefit from different forms of contextual reasoning, suggesting that future systems may require task decomposition and specialized inference strategies.
28. 【2609.18861】PersonaPath: Towards Knowledge-Centric Personalized Learning Path Planning
链接：https://arxiv.org/abs/2609.18861
作者：Yu Liu,Zeming Liu,Tianle Zhang,Zihao Cheng,Yuhang Guo,Kehai Chen,Min Zhang,Yunhong Wang,Haifeng Wang
类目：Computation and Language (cs.CL)
关键词：Adaptive learning systems, item-level interaction logs, systems commonly formulate, learning systems commonly, commonly formulate learning
备注： Accepted to AACL-IJCNLP 2026 Main Conference
点击查看摘要
Abstract:Adaptive learning systems commonly formulate learning path planning as Exercise-Centric (EC) recommendation, where the next step is inferred from item-level interaction logs. Evaluating goal-oriented guidance additionally requires explicit learner goals and curriculum-scale prerequisites: learners with similar exercise records may need different paths toward their targets. We therefore study Knowledge-Centric (KC) personalized learning path planning, where a planner must reason over learner profiles, mastery states, and prerequisite knowledge structures to decide which textbook, unit, and concept should be studied next. To support this setting, we introduce PersonaPath, a benchmark that pairs 2,000 fine-grained learner personas with a hierarchical knowledge graph of 347 textbooks, 1,751 units, and 4,092 concepts across 77 subjects. We evaluate representative LLMs on PersonaPath. Results show that even the strongest LLM reaches only a 29.5% final pass rate in Basic Education, and that the main bottleneck lies in adaptivity, where no model exceeds 44.7% in tailoring paths to individual learners.
29. 【2609.18860】Decodable but Misrouted: Sparse Features Uncover a Readout Gap in Vision-Language Models for Harmful Meme Detection
链接：https://arxiv.org/abs/2609.18860
作者：Girish A. Koushik,Diptesh Kanojia,Helen Treharne
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large vision-language model, vision-language model misclassifies, reflect missing internal, missing internal evidence, route represented evidence
备注： 40 pages, 9 figures
点击查看摘要
Abstract:When a large vision-language model misclassifies a harmful meme, the failure may reflect missing internal evidence or an inability to route represented evidence to its output. We distinguish these cases in Gemma-3 and Qwen3.5 using sparse autoencoders, role-conditioned probes, causal interventions, and recovery experiments across six harmful content benchmarks, with additional Spanish and Hindi-English code-mixed evaluations. Sparse readouts outperform native prediction on all six primary binary tasks: Qwen averages $0.740$ versus $0.432$ native macro-F1, while residual reconstruction reaches $0.486$, whereas Gemma improves from $0.532$ to $0.714$. These differences reflect supervised accessibility rather than a pre-existing, native decision rule, and the most influential token role depends on the task. Under the evaluated score scales, Qwen silent-feature ablation is $24-63$ times more probe-sensitive, whereas routed-feature patching on literal yes/no tasks is $16-140$ times more output-sensitive. Calibration-only routing recovers $93.3$% of the mean gap, and probe-distilled LoRA improves native predictions, although shared multi-task adaptation causes negative transfer. A case study of Gemma-3-12B on Facebook Hateful Memes finds a distributed rank-32 image-prompt interaction, reaching $0.756$ versus $0.685$ native macro-F1. Robustness controls show that the signal extends beyond English, is not explained solely by accompanying OCR, and depends on paired visual evidence. Thus, routing, rather than representation alone, is a recurring bottleneck in harmful meme classification.
30. 【2609.18852】EviGen: Predictive Evidence Scaffolding for Verifiable Clinical Rationale Generation
链接：https://arxiv.org/abs/2609.18852
作者：Fengnan Li,Heman Burre,Liwen Sun,Roshni Varma,Matthew M. Engelhard
类目：Computation and Language (cs.CL)
关键词：Longitudinal electronic health, electronic health records, Longitudinal electronic, capture years, history across notes
备注： Accepted to Findings of EMNLP 2026. 29 pages, 4 figures, 23 tables
点击查看摘要
Abstract:Longitudinal electronic health records (EHRs) capture years of patient history across notes, codes, labs, and procedures, and contain evidence needed to reason about likely clinical outcomes. However, comprehensive clinician review of these records is impractical, and LLM-based processing is costly and often unreliable, missing some relevant observations while hallucinating others. We therefore propose EviGen, a three-layer framework for verifiable clinical rationale generation that addresses these challenges. The first layer is a patient-conditioned retriever that uses learnable queries to find evidence predictive of, not just textually relevant to, a clinical outcome and ranks it by prediction attribution scores. The second layer is an LLM generator that consumes this ranked evidence as a scaffold to produce a clinical rationale grounded in the retrieved spans. The third layer is a process-supervised verifier that checks the generated rationale at the reasoning-step level, flagging unreliable claims. Across three medical prediction datasets, EviGen improves prediction performance and rationale faithfulness over full-context LLM and RAG baselines, and is preferred by clinical reviewers in a usability evaluation.
31. 【2609.18844】ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts
链接：https://arxiv.org/abs/2609.18844
作者：Liyang Fan,Chi Wei,Yitai Li,Xinping Bi,Guhong Chen,Chenghao Sun,Haoxiang Yang,Qingwen Li,Kai Yan,Hong Li,Bo Li
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：turn visual inputs, context management, expected to turn, turn visual, visual inputs
备注： 31 pages, 7 figures, including appendices
点击查看摘要
Abstract:Multimodal coding agents are expected to turn visual inputs into usable artifacts, and they act through a harness, the layer of tools, context management, and execution environment around the model. Existing evaluations often isolate short tool calls, API traces, or screenshot resemblance, and a low score under these proxies cannot say whether the model saw poorly, planned poorly, or was failed by its harness. We study scientific overview figure reconstruction, an agent task in which a source image must become an editable PowerPoint slide that preserves text, topology, layout, and native document structure. We introduce ReFigBench, a benchmark and evaluation framework built on 1,000 real overview figures retrieved from arXiv papers with full provenance. Coding agents from four model families reconstruct every figure under two workflows, direct code generation and a specialized PPTX workflow, and the strongest model runs inside two commercial harnesses, yielding ten configurations. Evaluation combines deterministic artifact checks, repeated automated scoring by judges from two model families, and blinded human comparisons. Perception remains a bottleneck that iterative rendering only partly repays. Whether workflow effort converts into quality depends on the model together with its harness, since the same model gains from the specialized workflow inside one harness and loses inside the other, and the harness shifts scores even under an identical direct prompt. The specialized workflow erases native connectors in every configuration, human judges still prefer its renderings in most matchups, and even the strongest agent falls short of the rubric ceiling. These results expose the tension between fidelity and editability as the central challenge for practical multimodal document agents.
32. 【2609.18823】Using OCR Heads to Verbalize Image Semantics
链接：https://arxiv.org/abs/2609.18823
作者：Sheridan Feucht,Benno Krojer,Sarah Wang,Henry Abrahamsen,Byron C. Wallace,David Bau
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：map from pixels, OCR, VLMs map, interpretable semantic features, semantic features
备注： 21 pages, 22 figures
点击查看摘要
Abstract:How do VLMs map from pixels to semantics? To understand this general question, we focus on a narrow one: studying how VLMs perform optical character recognition (OCR). Across four models, we identify attention heads causally necessary for OCR, and discover that these are in fact general-purpose heads that output interpretable semantic features across all image tokens. For example, pointing these heads at an image token containing the word "bike" causes Qwen3-VL-8B to output "bike," but pointing them at a bird wing causes the model to output the token "feathers." We collapse these heads' attention weights into a single verbalization lens transformation that reveals interpretable semantic features in hidden states across all layers. When combined with projection to vocabulary space, we can obtain interpretable labels starting from layer 0, showing that image representations are in fact aligned with language in early layers. We find that we can also use the inverse of this transformation to edit non-word concepts, e.g., replacing a tractor with a revolver in a naturalistic image, providing causal evidence that this subspace is useful for more than just OCR. Our results are an example of how the study of specific mechanisms can shed light on broader interpretability problems.
33. 【2609.18804】Beyond frequency measures: Can contextual embeddings capture meaning change in scientific texts?
链接：https://arxiv.org/abs/2609.18804
作者：Jianying Liu(STL, BETA, CEIPI),Kim Gerdes(LISN, Qatent, STL),Jean-Marc Deltorn(CEIPI)
类目：Computation and Language (cs.CL)
关键词：Identifying technological trends, Identifying technological, core scientometric task, substantial meaning shifts, capture substantial meaning
备注：
点击查看摘要
Abstract:Identifying technological trends is a core scientometric task, yet traditional frequency-based approaches struggle to capture substantial meaning shifts of domain-specific terms. We hypothesise that contextual embeddings can complement frequency dynamics to effectively track diachronic semantic change. We compare frequency and embedding-based approaches across Astrophysics and NLP corpora spanning from 2010 to 2024. Candidate terms are extracted using KeyBERT (utilizing SciBERT as its underlying language model) and filtered for significant frequency increases using Fisher's exact test. These terms are then evaluated for genuine semantic shift by domain experts to establish ground-truth labels. To quantify semantic drift, each term's contextual embedding ''clouds'' from the two discrete periods are compared using multiple metrics: cosine distance, average pairwise distance, Hotelling-type T 2 , and maximum mean discrepancy. Results indicate that frequency-based methods align slightly better with human judgments of ''trend-related terms'' than semantic metrics (Precision@50 of 0.62 vs 0.60 in Astrophysics). The two signals show a correlation of around 0.6. Several terms identified exclusively by embedding metrics (e.g., ''primordial black holes'') represent critical conceptual developments invisible to pure frequency analysis. These findings indicate that semantic metrics may capture complementary information, highlighting the value of integrating contextual embeddings into scientometric trend analysis.
34. 【2609.18772】Zero-Shot Cross-Lingual Recognition of Sign Language Handshapes
链接：https://arxiv.org/abs/2609.18772
作者：Marcel Granero-Moya,Carolina del Corral Farrarós,Gloria Haro,Coloma Ballester,Ricardo Marques
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：American Sign Language, processing advances rapidly, American Sign, Sign language processing, world sign languages
备注： Accepted at the Workshop on Sign Language Processing (WSLP), EMNLP 2026
点击查看摘要
Abstract:Sign language processing advances rapidly for high-resource languages such as American Sign Language (ASL), yet most of the world's sign languages lack the phonological annotations new methods require. We present the first zero-shot cross-lingual framework for handshape recognition, transferring from ASL to Catalan Sign Language (LSC). Our approach leverages the decomposition of handshapes into five phonological features -- selected fingers, flexion, spread, thumb position, and thumb contact -- shared across both languages, to decode LSC handshapes from predicted features via a composite phonological distance metric. We evaluate three architectures (MLP, SL-GCN, SHuBERT) trained on two ASL corpora (PopSign, Sem-Lex) against a 37-handshape, single-signer LSC benchmark. Zero-shot transfer proves viable once recording-format disparities are harmonized, reaching 80.0% phonological feature accuracy and 54.5% expected handshape accuracy. Phonological decomposition thus offers a bridge for extending sign language technologies to low-resource languages without any target-language video training labels.
35. 【2609.18766】FRAUDSkill: Structured Frozen-Weight Skill Optimization for Audio Anti-Fraud Detection
链接：https://arxiv.org/abs/2609.18766
作者：Chengxian Hu,Zhiming Ma,Mingjun Pan,Yifan Wang,Shun Zhang,Qifan Wang,Zhilei Zhao,Yijin Zhou,Yuxi Zhao,Huiyuan Liu,Peidong Wang,Peng Chen
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：directly processing speech, Large audio-language models, Large audio-language, fraud-related evidence, shown promise
备注： 10 pages, 4 figures, including supplementary material
点击查看摘要
Abstract:Large audio-language models have shown promise for anti-fraud detection by directly processing speech and reasoning over fraud-related evidence. Their deployment, however, requires predictions to follow a predefined label space and a structured decision protocol consisting of service-scenario identification, fraud detection, and conditional fraud-type classification. Existing fine-tuning and prompt-based approaches typically encode task knowledge, constraints, and decision rules into model parameters or manually maintained prompts, making them difficult to adapt as fraud patterns and labeling policies evolve. To this end, we propose FRAUDSkill, a structured frozen-weight adaptation framework that leaves the underlying audio-language model unchanged while optimizing an external layer of skill programs, route-specific policies, and decision rules. We further combine structured output control with validation-guided multi-path inference to ensure protocol-compliant predictions. On the TeleAntiFraud benchmark, FRAUDSkill achieves 73.50% Macro-F1, outperforming the shared frozen-model baseline by 31.96% while reducing invalid outputs to 1.94%. Extensive experiments demonstrate that external skill optimization provides an effective and adaptable solution for structured audio anti-fraud detection without modifying the underlying model. The source code is available at this https URL.
36. 【2609.18748】AntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection
链接：https://arxiv.org/abs/2609.18748
作者：Huiyuan Liu,Zhiming Ma,Yanxing Liu,Shun Zhang,Qifan Wang,Di Liu,Yifan Wang,Yuyang Deng,Haoyang Meng,Yijin Zhou,Yuxi Zhao,Chengxian Hu,Peidong Wang,Peng Chen
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：routine service conversations, resemble routine service, Telecom fraud scripts, scripts evolve rapidly, Telecom fraud
备注： 12 pages, 4 figures, including supplementary material
点击查看摘要
Abstract:Telecom fraud scripts evolve rapidly and are often designed to resemble routine service conversations, creating two key requirements for audio-based telecom-fraud evaluation. First, benchmarks must incorporate newly observed scam patterns without overwriting previously established test sets. Second, they must distinguish fraud from lawful, near-domain calls rather than relying on topic-separated negative examples. We present TeleAntiFraud 2.0, constructed with our Mixed-Tree Anti-Fraud Generation Pipeline and evaluated under a monthly frozen evaluation protocol. The pipeline transforms online fraud-case abstracts into profile-grounded scenarios, expands them through mixed-tree generation, realizes fraud and non-fraud dialogue paths under shared contexts, renders validated dialogues as role-matched speech, and freezes the resulting audio, labels, prompts, manifests, and provenance records for each monthly evaluation set. Each frozen set contains 900 Chinese calls, comprising 600 fraud and 300 near-domain non-fraud cases. Controlled text experiments show that three classifiers achieve perfect macro-averaged F1 (Macro-F1) when evaluated against unrelated or ordinary negatives, but drop to 0.65-0.68 with near-domain sibling negatives. Full-set audio and automatic-speech-recognition plus large-language-model (ASR+LLM) evaluations further reveal class-prior shortcuts, prediction collapse, and snapshot sensitivity. Together, these findings establish near-domain construction and collapse-aware reporting as core requirements for evaluating audio-based telecom-fraud models under realistic confusable conditions. The accompanying research artifact includes the construction code, evaluation scripts, manifests, and documentation. Our dataset and code are available at this https URL.
37. 【2609.18739】A Scalable Framework for Automated NER Annotation Correction in Low-Resource Languages
链接：https://arxiv.org/abs/2609.18739
作者：Toqeer Ehsan,Thamar Solorio
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Named Entity Recognition, Entity Recognition, Named Entity, NLP task, Poor quality
备注： Accepted to Findings of EACL 2026
点击查看摘要
Abstract:Poor quality or noisy annotations in Named Entity Recognition (NER), as in any other NLP task, make it challenging to achieve state-of-the-art performance. In this paper, we present a multi-step framework to enhance the annotation quality of NER datasets by employing automated techniques. We propose a frequency-based iterative approach that leverages self-training and a dual-threshold mechanism to enhance inference confidence. Experimental evaluations on different NER datasets demonstrate significant improvements in NER performance with respect to the original datasets. This work further explores the potential of generative Large Language Models (LLMs) to perform NER for low-resource languages.
38. 【2609.18729】"If I Had to Buy Just ONE: Galaxy S26 Ultra": Auditing AI-Generated Product Recommendations
链接：https://arxiv.org/abs/2609.18729
作者：Lucas G. Uberti-Bona Marin,Thales Bertaglia,Giovanni Astante,Bram Rijsbosch,Gijs van Dijck,Anikó Hannák,Gerasimos Spanakis,Konrad Kollnig
类目：Computers and Society (cs.CY); Computation and Language (cs.CL)
关键词：Gemini, real commercial-advice queries, Google Gemini, Google, Google Search
备注：
点击查看摘要
Abstract:Consumers increasingly use AI chatbots for advice on what to buy. With companies like OpenAI and Google monetising their AI through advertising, this raises difficult questions about the bias and impartiality of such advice. In response, we conduct an AI audit of popular chatbots using real commercial-advice queries. First, we curate a dataset of 2,528 real commercial-advice queries (ConsumerQ). Then, we evaluate 1,536 responses to product queries from popular AI chatbots: ChatGPT (chatbot and API), Google Gemini (chatbot and API), and Google Search (AI Overviews). We find that ChatGPT expresses a first-person product preference in 79% of product-recommending responses, compared with 7% for Gemini and 2% for AI Overviews, while the products recommended often change across repeated requests. Displayed sources vary strongly: for the same query, the ChatGPT and Gemini interfaces share only 5.4% of domains on average, with no domain in common in 76.7% of comparisons. APIs provide a different view from their corresponding interfaces, with mean domain overlaps of 12.0% for ChatGPT and 14.8% for Gemini, and also differ in the types and layers of source information they expose. Our findings show that neither isolated responses nor API observations can be assumed to represent the commercial advice consumers encounter. Independent audits of AI-mediated commercial advice should therefore account for repeated responses, consumer-facing conditions, and the source layer being observed.
39. 【2609.18720】LocQE: Principled Domain Adaptation for Localisation Quality Estimation by Leveraging Post-Edits
链接：https://arxiv.org/abs/2609.18720
作者：Kathy Hämmerl,Gabriel Bretschner,Joern Wuebker
类目：Computation and Language (cs.CL)
关键词：Learned quality estimation, Learned quality, machine translation evaluation, quality estimation, COMETKiwi are widespread
备注：
点击查看摘要
Abstract:Learned quality estimation (QE) models such as COMETKiwi are widespread and work well for general machine translation evaluation. However, they are known to struggle on unseen domains, limiting their performance in a real-world localisation context. We show that they are insensitive to some important factors in localisation, such as whether numbers are translated accurately, or even whether the correct number of spaces and punctuation are preserved in a translation. Further, a key capability for optimisation of machine translation is the ability of QE models to accurately rank different translations of a single segment, which suffers significantly from the domain transfer. In the absence of large-scale direct assessment data, we propose principled fine-tuning approaches to reduce the domain gap with even small amounts of post-editing data. Using a multi-task fine-tuning approach and a simple tokeniser intervention, we create a QE model which proves markedly better at distinguishing preferred post-edits from rejected initial translations in a localisation context. We show that preferences and artificial continuous scores stabilise each other, and argue that to calibrate metrics both in terms of their absolute scores and comparisons between translation of the same source, both types of signal are needed.
40. 【2609.18533】A Probe Shift Is Not a Fairness Fix: The Limits of Representation Steering in Speech Models
链接：https://arxiv.org/abs/2609.18533
作者：Nicolas Bourrel,Abderrahmane Issam,Gerasimos Spanakis
类目：Computation and Language (cs.CL)
关键词：Automatic speech recognition, systems exhibit unequal, exhibit unequal error, Automatic speech, unequal error rates
备注： Accepted at IMPACT-SPEECH 2026
点击查看摘要
Abstract:Automatic speech recognition (ASR) systems exhibit unequal error rates across speaker groups, motivating interventions on their internal representations. We ask whether speaker-linked attributes that are linearly readable from pretrained ASR encoders yield useful directions for reducing group word-error-rate (WER) gaps. Across Whisper-medium, HuBERT-large, and Wav2Vec2-large on Common Voice and the Speech Accent Archive, we probe every encoder layer for metadata-derived sex/gender, age, and native/accent labels; construct centroid and probe-derived directions; inject them at selected layers; and compare downstream probe trajectories with matched WER changes. Sex labels are highly decodable (best macro-F1 0.924--0.941), native/accent labels are also above chance (0.544--0.696), and age is weaker (0.354--0.397). Of 22 post-selected reruns, nine have 95% paired-bootstrap intervals entirely below zero, yet every absolute source-group WER reduction is below 0.7 percentage points. Conversely, a local target-class probe rate can rise from 8.09% to 99.87% while WER worsens. Linear readability is therefore neither evidence of causal use nor a reliable mitigation method. Our results motivate evaluating speech-bias interventions jointly at representation, propagation, and task levels.
41. 【2609.18529】Machine Translation between English and Syriac (East Syriac Dialect) using Statistical Machine Learning
链接：https://arxiv.org/abs/2609.18529
作者：Hadiana Sliwa,Hossein Hassani
类目：Computation and Language (cs.CL)
关键词：Natural Language Processing, Syriac, language, UNESCO, Assyrians speak
备注： 17 pages, 4 figures, 8 tables
点击查看摘要
Abstract:UNESCO considers the Assyrian (Syriac) language an endangered language. Although Assyrians speak the language worldwide, the speaking population is uncertain (ranging from 500,000 to 1,500,000). Syriac is also one of the least studied languages in Natural Language Processing (NLP). Despite advances in Machine Translation (MT) over the past decade, the lack of publicly available corpora and the orthographic complexity of the Syriac script, specifically the Madnkhaya script, have left this language entirely ignored in the computational linguistics literature. This study develops the first phrase-based Statistical MT (SMT) model for English-to-Assyrian MT using the Moses framework. We created a dataset of 38,847 sentence pairs from the complete English and Syriac Bible, merging a pre-existing New Testament dataset with an Old Testament built from scratch through PDF extraction, using custom segmentation scripts and manual alignment review by three bilingual annotators. The Syriac side of the corpus undergoes diacritic removal and Byte-Pair Encoding tokenization to reduce orthographic sparsity before training. We trained and evaluated six models using different configurations and splitting-scheme ratios, language model order, distortion limits, and the inclusion of an Operation Sequence Model. The best-performing configuration achieves a word-level BLEU score of 23.54. Human evaluation by 11 native Assyrian speakers resulted in mean adequacy and fluency scores of 3.42 and 3.34 out of 5, respectively. These results are consistent with comparable low-resource SMT models trained on Biblical corpora for morphologically rich Semitic languages. The corpora, scripts, and trained model are publicly available, providing the research community with the first systematically curated English-Syriac dataset and a reproducible baseline for future MT and broader NLP work on this endangered language.
42. 【2609.18516】Align, Integrate, and Fire: Efficient Token-Level Alignment for Zero-Shot SpeechLLMs
链接：https://arxiv.org/abs/2609.18516
作者：Abderrahmane Issam,Yusuf Can Semerci,Jan Scholtes,Gerasimos Spanakis
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Language Models excel, natural language processing, spoken input remains, Large Language
备注： Accepted at WMT2026
点击查看摘要
Abstract:While Large Language Models excel in natural language processing, efficiently extending their capabilities to spoken input remains a significant challenge. Existing methods for building SpeechLLMs often rely on computationally expensive full-model fine-tuning, or employ parameter-efficient projectors that suffer from inefficient token sequence lengths and costly full-model supervision. In this paper, we introduce Aligned Continuous Integrate-and-Fire, a highly efficient framework for zero-shot speech processing. Our method dynamically compresses continuous acoustic frames into the exact discrete token length of the target text utilizing explicit Dynamic Time Warping alignments. This allows our initial training stage to establish a robust acoustic-to-semantic bridge using lightweight distance metrics, entirely bypassing the computationally expensive LLM forward pass. For subsequent fine-tuning, we propose a memory-efficient knowledge distillation objective that targets a single LLM layer, performing competitively with full-model cross-entropy training at a fraction of the computational cost. Through extensive evaluations on Automatic Speech Recognition and Speech Translation, we demonstrate that our method achieves superior performance compared to prior parameter-efficient baselines.
43. 【2609.18494】Size Matters: Foundation Model for Czech HTML documents
链接：https://arxiv.org/abs/2609.18494
作者：Martin Dvořák,Vít Tlustoš,Artyom Voronin,Martin Habrovec,Kateřina Podlesná,Barbora Rišová,Josef Vonášek
类目：Computation and Language (cs.CL)
关键词：high-traffic industrial environments, industrial environments requires, Creating universal, environments requires models, high-quality representations
备注：
点击查看摘要
Abstract:Creating universal, high-quality representations of web documents in high-traffic industrial environments requires models that are both performant and economic. Existing approaches, however, often depend on large models, overlook the structural information inherent in HTML, or are constrained by short context windows, limiting their ability to process real-world web pages. We present HTML-LM, a compact foundation model with 154 million parameters that addresses these limitations through HTML-aware training and a ModernBERT-based architecture. It was trained on 100 million web documents using multiple objectives, including masked language modeling, bag-of-words prediction, and contrastive distillation from large language models. Consequently, HTML-LM sets a new state-of-the-art for classification and regression applications in the Czech Internet domain, surpassing both larger encoders and small-sized LLMs. The model is deployed in production, processing thousands of web documents per second, and released to the community under the CC BY-NC 4.0. this https URL.
44. 【2609.18487】ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models
链接：https://arxiv.org/abs/2609.18487
作者：Shijie Lian,Bin Yu,Zhaolong Shen,Xiaopeng Lin,Yichao Du,Zhirui Zhang,Laurence T. Yang,Kai Chen
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：executable commands recovered, Action tokenizers play, tokenizers play, play a central, central role
备注： Project Page: [this https URL](https://deepcybo-physai.github.io/ActionPiece/)
点击查看摘要
Abstract:Action tokenizers play a central role in autoregressive vision-language-action (VLA) models, determining both the targets for policy training and the executable commands recovered from predicted tokens. Their fidelity is commonly evaluated using pointwise reconstruction metrics such as mean squared error (MSE), yet small individual errors do not fully characterize how faithfully action adjustments across demonstrations are preserved. After compression, similar actions may still cluster around a representative motion, while the adjustments needed for different contexts are diminished, distorted, or even reversed. We introduce physical rank consistency (PRC) to measure how well tokenization preserves local physical distance rankings after reconstruction. Evaluating decoded actions provides a common reference across token vocabularies and decoder architectures, complementing pointwise accuracy with a measure of relational fidelity. We further present ActionPiece, which preserves physical action relationships through joint supervision of representation learning and quantization. Physical rank preservation supervises near-far ordering in encoder and quantized feature distances, while quantization regularization applies the same ordering to codeword assignment distributions. Both objectives augment reconstruction, producing discrete action tokens for standard autoregressive policy learning and execution through a frozen decoder. Under the same Qwen3-VL-4B policy training setup, ActionPiece achieves 94.8% on LIBERO and 68.8% on unseen LIBERO-Plus, with additional evaluations reaching 71.9% on SimplerEnv and 51.5% across VLA-Arena L0-L2. Component ablations show that the two objectives jointly improve PRC and policy success, demonstrating the value of physical relationship supervision for action tokenization.
45. 【2609.18470】Divide and Conquer: Mixture-of-Bottleneck Experts in Informative Ordinal Space for Video-based Multimodal Sentiment Analysis
链接：https://arxiv.org/abs/2609.18470
作者：Ronghao Lin,Qiaolin He,Zefeng Lu,Yichu Liu,Li Huang,Sijie Mai,Haifeng Hu,Yap-peng Tan
类目：Multimedia (cs.MM); Computation and Language (cs.CL)
关键词：human speaking videos, Video-based Multimodal sentiment, Video-based Multimodal, Multimodal sentiment analysis, image sequence
备注：
点击查看摘要
Abstract:Video-based Multimodal sentiment analysis (MSA) must handle information from text, audio, and image sequence in human speaking videos, yet current methods often fail to integrate modalities with task awareness. Most models treat video sentiment prediction as a single task, overlooking its ordinal nature, and their fusion strategies struggle to capture diverse unique and synergic cues across modalities. To address these limitations, we adopt a divide-and-conquer perspective by reformulating MSA as an ordinal regression problem and decoupling it into polarity recognition and intensity prediction. Driven by information theory, we introduce a Mixture-of-Bottleneck (MoB) framework that assigns different latents to polarity- and intensity-specific experts for different modalities. With the learning of information bottleneck, each expert learns compact and task-relevant representations while filtering out redundancy and noise. A multimodal bottleneck routing fusion module then fuses these expert latents with hard mining strategy, guiding the prediction in the ordinal sentiment space. Extensive experiments on 4 MSA datasets and 4 language models show that MoB effectively leverages informative latents from diverse modalities and captures general sentiment structure. Beyond stronger performance, MoB comprehensively captures fine-grained intra- and inter-modal dynamics, enabling more trustworthy localization of nuanced video sentiment signals.
46. 【2609.18461】Disentangling Long-Term Memory via Latent Neuro-Symbolic Reasoning
链接：https://arxiv.org/abs/2609.18461
作者：Cai Ke,Xinghao Chen,Xiaoyu Shen,Keyu Chen,Siyu An,Junnan Dong,Ruifeng Xu,Ruizhi Qiao,Xing Sun
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：implicit behavioral evidence, behavioral evidence, agents are required, required to reason, long-term history interactions
备注：
点击查看摘要
Abstract:Personalized agents are required to reason over long-term history interactions to infer both explicit preferences and implicit behavioral evidence. While early flat retrieval methods score memory fragments independently and neglect the distributed information, current structured memory frameworks rely on query-agnostic static graphs that fail to capture the context-dependent relations. Crucially, raw textual memories are inherently entangled and noisy, making fine-grained personalization and cross-session reasoning computationally prohibitive. To this end, we present LGM, a novel neuro-symbolic framework that shifts long-term memory disentanglement into a continuous latent space. Specifically, (i) instead of persisting fixed graphs, we design a tailored latent graph construction with a sparse autoencoder. Subject to each query, it maps historical interactions into latent memory nodes and disentangles the memory traces into sparse concept activations, dynamically synthesizing query-aware relational edge weights. (ii) A graph encoder then treats the query embedding as a conditioning preference to direct non-linear message passing across the task-specific latent subgraph. This yields a highly expressive memory representation for effective activations. Extensive experiments on long-term personalization benchmarks demonstrate that LGM significantly outperforms state-of-the-art baselines in capturing both explicit and implicit preferences while enabling personalized responses.
47. 【2609.18445】M-SQE: Multilingual Skill Quality Estimation for Enhancing Language Equality in Agentic Skill Use
链接：https://arxiv.org/abs/2609.18445
作者：Yilun Liu,Shimin Tao,Minggui He,Chenxin Liu,Li Zhang,Chen Liu,Miao Zhang,Jiaxin Guo,Min Zhang,Liqun Deng,Xiaojun Meng,Daimeng Wei
类目：Computation and Language (cs.CL)
关键词：extend LLM agents, reusable procedural documents, LLM agents, extend LLM, deploying agents
备注： 17 pages, 6 figures
点击查看摘要
Abstract:Agent skills, reusable procedural documents that extend LLM agents beyond their parametric memory, have become an important interface for deploying agents on real-world tasks. Community-maintained skill libraries built around this interface are growing rapidly. However, this ecosystem remains deeply English-centric: our audit finds that low-resource languages such as Swahili and Hindi have no in-language skill content, so retrieval often returns a skill written in a different language than the query, degrading accuracy and recall. A practical solution is to synthesize in-language skills for retrieval but the quality can be unreliable, so relevance in this setting alone often surfaces a related but unusable candidate. To address this, we propose M-SQE, a post-retrieval Multilingual Skill Quality Estimation framework that scores candidates via a Theory view for intrinsic quality and an Action view for task-grounded utility, unified into a domain-conditioned final score. We evaluate M-SQE across three skill-use domains: general, tool-use, and cultural tasks. Empirically, we build three-layer candidate skill pools mirroring today's ecosystem, where M-SQE's task success exceeds existing baseline's average by at least +3.5 points across three different retrievers. Particularly, M-SQE lifts the lowest-resource languages most (+12.9pp on Hindi and +5.6pp on Swahili) and achieves strong performance across all six culture regions, thereby moving agentic skill use toward linguistic and cultural equality.
48. 【2609.18440】Planning or Improvisation? Stress-Testing the Poetry Planning Site on Open Models and Open Cross-Layer Transcoders
链接：https://arxiv.org/abs/2609.18440
作者：Éric Jacopin
类目：Computation and Language (cs.CL)
关键词：Haiku plans rhymes, Lindsey, newline, Haiku plans, line
备注： 17 pages, 3 figures, 8 tables. Code, data and analysis scripts: [this https URL](https://github.com/PCfVW/poetry-planning-site) . An earlier version was submitted to the BlackboxNLP 2026 special track on reproducibility and reliability in interpretability analyses; this version adds a rerun composition-horizon experiment (36 runs, 8,640 sampled lines) and a transcoder-free activation-patching test
点击查看摘要
Abstract:Lindsey et al. (2025) report that Claude 3.5 Haiku plans rhymes: features for candidate rhyme words are active on the newline before a line is written, and a suppress-and-inject intervention redirects the line only when applied there (their Figure 13). We test how far this generalizes on seven cells crossing four open models (0.6B to 2.6B parameters) with six open cross-layer transcoders (CLTs), on one consumer GPU, decomposing the claim into position specificity (C1), newline site identity (C2), and a newline-resident plan (C3). This is a stress test rather than a faithful reproduction: attribution graphs are unavailable for these CLTs, so features are found bottom-up from decoder vectors. C1 generalizes, in every cell and in all 247 of 444 prompt-by-inject pairs with a detectable effect, but the effective position is the final prompt token, adjacent to emission, and only two cells reach behaviorally meaningful probabilities. C2 and C3 are not recovered by any probe: a census of every active feature finds no rhyme-anticipating enrichment at the newline, and steering the newline while the model composes the whole line, over 36 runs and 8,640 sampled lines, shows why. That intervention is strong but one token long, making the injected word the first word of the composed line in 703 of 720 samples and leaving the rhyme six words later untouched. A final test drops the transcoder entirely: patching the newline's whole residual, at every layer, from a minimal-pair poem whose third line ends on a different rhyme moves the rhyme in 11 of 1,260 composed lines against 4 at baseline, with a design resolving 1.4%. We read this as a boundary condition rather than a refutation: at this scale and with these transcoders, the causal site is emission-adjacent. We reproduce Figure 13's shape, not its mechanism. Code and data are public (code: this http URL).
49. 【2609.18417】Dependency-Aware Trajectory Refinement for Efficient Multi-Turn Agent Fine-Tuning
链接：https://arxiv.org/abs/2609.18417
作者：Zhuo Chen,Zhen Zhang,Xinyu Wang,Kewei Tu
类目：Computation and Language (cs.CL)
关键词：failed tool calls, Multi-turn agent trajectories, Multi-turn agent, parallel sub-queries, verification-only steps
备注： AACL 2026 Findings
点击查看摘要
Abstract:Multi-turn agent trajectories often contain redundant rounds (failed tool calls, parallel sub-queries, verification-only steps) that inflate both training and inference cost. We propose viewing each trajectory as a \emph{round-level dependency DAG} that exposes which rounds are globally load-bearing for the final answer, and fine-tune agents on trajectories refined through this DAG. Given an LLM-annotated DAG, these edits are deterministic and interpretable, with optional rephrasing. Models trained on these refined trajectories consistently outperform those trained on the original trajectories at lower inference cost. Specifically, across four multi-modal QA benchmarks, our refinements improve downstream accuracy by up to $1.7$\,pp over vanilla SFT (and $5.7$\,pp over an LLM-deletion baseline) while reducing per-sample inference messages by up to approximately $40\%$ and inference tokens by up to approximately $48\%$, translating to substantial savings in compute and serving cost. Code is available.
50. 【2609.18385】Emotion Experience, Expression, and Perception: Emotion Analysis on Multimodal Social Media Posts
链接：https://arxiv.org/abs/2609.18385
作者：Christopher Bagdon,Carina Silberer,Roman Klinger
类目：Computation and Language (cs.CL)
关键词：frequently combine text, authors frequently combine, social media, social media posts, social media post
备注： Accepted for publication at EMNLP 2026 main conference
点击查看摘要
Abstract:Emotions are an essential aspect of human communication, particularly on social media, where authors frequently combine text and images to convey their emotions. Yet prior work on emotion analysis of social media posts has overlooked two important aspects in regard to measuring how well readers can reconstruct the authors' intent: (1)~the image modality, with most work focusing solely on text, and (2)~the real-world events that trigger the expressed emotions, and their relationship to the post content. We therefore study the relation between (a) the author's experience of the event that caused them to write a social media post and (b) the content of the post, with a focus on readers' capability to reconstruct that emotion expression. To do that, we introduce the Multimodal Multi-Emotion-Model dataset Mult2EMo, created by collecting annotations from both authors and readers on the posts and their triggering events. We find that reconstruction is possible but challenging for both human readers and computational models. We show that understanding the triggering event is crucial for accurate reconstruction, and that reconstruction is particularly challenging when posts rely heavily on the image to express emotion.
51. 【2609.18357】Market Signal Injection: Adversarial Context Manipulation of LLM Pricing Agents
链接：https://arxiv.org/abs/2609.18357
作者：Dohun Lee,Hyunwoo Park
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language model, Large language, remain unchanged, Large, manipulates numerical formatting
备注： 30 pages, Accepted to FinNLP 2026 Workshop @ EMNLP 2026
点击查看摘要
Abstract:Large language model (LLM) pricing agents may respond to how market data is presented, even when its numerical values remain unchanged. We introduce market signal injection (MSI), an attack that manipulates numerical formatting, competitor ordering, or qualitative market commentary without issuing explicit instructions. We evaluate nine open-weight models in simulated Bertrand duopoly and triopoly markets and three proprietary models in duopoly markets. Sentiment-based attacks produce the largest behavioral shifts, which propagate to other firms and alter profits and consumer surplus. Susceptibility varies across model families, and larger models are not consistently more robust. Matched neutral-text controls and a rule-based agent support a framing-based account of these shifts under the fixed demand parameters of our simulation. Episode-held-out probes distinguish baseline from attacked activations in all eleven re-evaluated model--condition pairs: linear AUC is 1.00 and MLP AUC ranges from 0.93 to 0.99. This separability does not by itself identify harmful pricing decisions. Input canonicalization removes the tested sentiment attacks, while decision boundary anchoring, which combines prompt constraints with output projection, provides partial mitigation under the tested adaptive attacks. These results identify data presentation as an attack surface for LLM pricing agents and motivate defenses that account for interactions among agents.
52. 【2609.18346】Faithful yet Collusive: Why Chain-of-Thought Monitoring Cannot Detect Collusion in LLM Pricing Agents under Oligopolistic Competition
链接：https://arxiv.org/abs/2609.18346
作者：Dohun Lee,Hyunwoo Park
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, sustain supracompetitive prices, deployed as autonomous, tacit coordination
备注： 20 pages, Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Large language models (LLM) deployed as autonomous pricing agents may sustain supracompetitive prices through tacit coordination. We develop a causal graph divergence framework that separately measures structural faithfulness and intent faithfulness of LLM pricing agents in Bertrand competition. Across nine LLMs under duopoly and triopoly conditions, collusive behavior and chain-of-thought (CoT) faithfulness dissociate along both dimensions: the most collusive model accurately reports cooperative intent yet reasons structurally unfaithfully, while the most structurally faithful model sustains supra-Nash pricing under both market structures. These findings establish that CoT monitoring alone cannot serve as a standalone safeguard against algorithmic collusion.
53. 【2609.18341】Understanding AI Provider Recommendations in Local Service Markets
链接：https://arxiv.org/abs/2609.18341
作者：Hazem Ibrahim,Yasir Zaki
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：proprietary model, search, model, open-weight model, recommendations
备注： 12 pages, 6 figures
点击查看摘要
Abstract:When someone asks an AI assistant which doctor to see or which firm to trust with their savings, the answer is a referral. We audit AI provider recommendations in four registry-backed service domains across the 100 largest U.S. metropolitan areas, matching every recommendation against the official registry for its domain (Medicare clinician and facility records, and SEC adviser disclosures), under three conditions: an open-weight model, a proprietary model without web search, and the same proprietary model with search. Without search, both models largely fabricate recommendations in the domains the web covers thinly. Only 4% of the open-weight model's recommended doctors and 11% of the proprietary model's match a clinician in the queried city, and the open-weight matches are name coincidences: its matched clinicians are no likelier to be primary-care doctors than names drawn at random from the registry. With search, 64-71% of recommendations in the same domains match a real provider. Search also changes who is recommended. Without it, recommended advisory firms carry SEC misconduct disclosures at 3.6 times the registry base rate, even after adjusting for firm size; with search, significantly below it. Restaurants, where quality and visibility are separately measurable, show a 3-5x review-count premium but a rating premium of at most a tenth of a star. Finally, search largely removes the metro-size penalty: without it, real recommendations concentrate in the largest metros; with it, match rates are similar across metro-size terciles. Whether an AI referral is trustworthy depends strongly on its retrieval configuration rather than on the underlying model alone, yet an answer produced without retrieval often carries no sign that its recommendations were never verified.
54. 【2609.18320】Attention Dispersion as a Diagnostic Signal for Hallucination in Large Language Models
链接：https://arxiv.org/abs/2609.18320
作者：Shardul P. More,Tanuja S. Pawar
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large Language Models, Large Language, frequently exhibit hallucinations, frequently exhibit, presenting a major
备注： 6 pages, 2 figures, 1 table
点击查看摘要
Abstract:Large Language Models (LLMs) frequently exhibit hallucinations, presenting a major barrier to reliability in complex reasoning tasks. While traditional detection methods rely on output-based confidence metrics, these logits are often miscalibrated by modern alignment techniques. In this paper, we investigate the temporal volatility of internal attention mechanisms as an alternative diagnostic signal for hallucination that does not depend on output calibration. By introducing an unsupervised metric for attention dispersion, we show that epistemic uncertainty leaves a measurable trace within intermediate layers, where spikes in attention entropy are associated with reasoning breakdowns. We evaluate our approach on mathematical reasoning benchmarks (GSM8K and MATH-500) using the Qwen2.5 model family (1.5B and 3B parameters), finding statistically significant AUC improvements of up to +0.076 over output-based baselines across all tested conditions. These findings suggest that attention dispersion is a promising complement to traditional hallucination detection methods, requiring further investigation across broader model families and task domains.
55. 【2609.18317】Knowledge-Graph Based Augmentation versus Retrieval Augmented Generation for Cultural-Related Question Answering
链接：https://arxiv.org/abs/2609.18317
作者：Pablo Poulenard,Yannis Karmim,Valentin Barrière
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Latin America, culturally specific facts, Large language, language models
备注：
点击查看摘要
Abstract:Large language models (LLMs) suffer from a long-tail deficit: culturally specific facts, particularly those concerning underrepresented regions such as Latin America, appear too rarely in pretraining corpora to be reliably memorized. Retrieval-Augmented Generation (RAG) addresses this by grounding generation in external text, but structured alternatives such as Knowledge Graphs (KGs) offer tighter control over what enters the context, along with potential gains in explainability and updatability. We benchmark Graph-RAG against standard RAG on LatamQA, a culturally grounded multiple-choice dataset spanning eight thematic categories. The graphs are built end-to-end from Wikipedia articles with KGGen, a recent open-domain extractor, without manual curation in our main setting. G-Retriever is competitive with RAG and reduces the error of the base LLM by 72\% with a standard KG and 78\% with a benchmark-aware variant, the gap to RAG narrowing further as the graph is oriented toward task-relevant content. The trained projection transfers zero-shot to Portuguese without target-language fine-tuning, indicating multilingual reach.
56. 【2609.18310】SEA-LION-v4.8: A Technical Report
链接：https://arxiv.org/abs/2609.18310
作者：Ahmed Mohammad Dabeer,Ahn Jeongmi,Anocha Sutaveephamochanon,Antonyrex Sajeban,Aulia Adila,Chan Hok Teng,Adwin,Cheng Zi Yi,Nicholas Zhuang Ziyi,Choa Hsueh Mei Esther,David Ong Tat-Wee(David Wang Dawei),Evelyn Tan Chor Phin,Heng Cheng Peng,Jonathan,Lee Chwan Ren(Li Chunren),Leong Wai Yi,Leong Wei Qi,Leslie Teo Eng Sipp,Liew Rachel,Limkonchotiwat Peerat,Montalan Jann Railey Estrada,Muhammad Ridzuan Bin Mokhtar,Nagarajan Karthik,Ng Boon Cheong,Raymond(Huang Wenzong, Raymond),Ngui Jian Gang,Nguyen Thanh Ngan,Tasawong Panuthep,Pereira Mark Gregory,Phang Shi Wei Benjamin,Poon Yip Hung,Joseph,Rengarajan Hamsawardhini,Siow Wei Kang Bryan,Tai Ngee Chia,Tan Choon Meng,Tan Le Min,Sheryl,Tan Siao Wei(Chen Xiaowei),Tan Yi Xian,Tee Jun Yun,Teng Kok Wai,Tjhi William Chandra,Tuchinda Pume,Wu Donghang,Yong Xianbin,Yosephine,Zhang Zhou
类目：Computation and Language (cs.CL)
关键词：NVIDIA Nemotron, Southeast Asian Languages, built upon NVIDIA, Southeast Asian, Asian Languages
备注： A technical report
点击查看摘要
Abstract:We introduce Nemotron-SEA-LION-v4.8, a family of Southeast Asian Languages in One Network (SEA-LION) built upon NVIDIA Nemotron 3. The family includes 30B-A3B and 120B-A12B models, with both continued-pretrained base checkpoints and post-trained variants. We adapt the models using Southeast Asian, reasoning, code, and multilingual parallel datasets, followed by post-training with supervised fine-tuning and online on-policy distillation. On SEA-HELM, the 30B-A3B model improves the overall SEA score from 46.06 to 51.57, while the 120B-A12B model improves from 49.30 to 63.44. The strongest gains are observed in instruction following, natural language reasoning, and natural language understanding across seven Southeast Asian languages.
57. 【2609.18304】Rollback the World, Keep the Reflection: Rollback-Induced Reflection for Long-Horizon LLM Agents
链接：https://arxiv.org/abs/2609.18304
作者：Yi Yu,Liuyi Yao,Yaliang Li,Enshu Wang,Libing Wu
类目：Computation and Language (cs.CL); Robotics (cs.RO)
关键词：Large language model, agents increasingly tackle, single erroneous action, multi-step environment interaction, Large language
备注：
点击查看摘要
Abstract:Large language model (LLM) agents increasingly tackle long-horizon tasks through multi-step environment interaction, yet a single erroneous action can alter subsequent states and observations, causing errors to compound over time. Existing methods either correct the context without repairing altered environment states or restore earlier states while discarding useful experience, making it difficult to both eliminate failure conditions and avoid repeating past mistakes. We argue that reliable recovery should instead be treated as a rollback-boundary control problem that jointly determines when to intervene, where to resume, and what information should survive recovery. Based on this view, we propose Rollback-Induced Reflection (RIR), a unified recovery framework that restores execution to a selected prior state while carrying forward reusable knowledge distilled from the abandoned trajectory to guide subsequent decisions. We further characterize recovery through a unified operator over rollback depth and retained memory, providing a general view of state restoration and knowledge retention. Experiments on three long-horizon benchmarks demonstrate that RIR consistently improves task performance across multiple LLM backbones, with structured reflection memory preserving useful experience and selective rollback enabling efficient recovery.
58. 【2609.18291】Relationally Guided Use Case Modeling with LLMs
链接：https://arxiv.org/abs/2609.18291
作者：Guangyu Wang,Bangqi Li,Ji Wu,Zhijun Shao
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：software engineering activities, downstream software engineering, including requirements analysis, support downstream software, test case generation
备注： 19 pages, 8 figures, 6 tables
点击查看摘要
Abstract:Use case flows are important elements of use case modeling because they support downstream software engineering activities, including requirements analysis, architectural and detailed design, and test case generation. However, constructing them manually is costly and expertise-intensive, while existing automated approaches still struggle to preserve semantic consistency, control-flow logic, data-flow logic, and the intended system boundary, especially when identifying branch points and generating alternative flows. To address this problem, we propose FlowGen for complete use case flow construction. FlowGen uses LLM-based Semantic Information Processing (SIP) to extract semantic elements, constructs a Semantic Relational Graph (SRG) encoded by an enhanced R-GAT for basic flow generation (BFGen), and further supports branch point prediction through BPP and branch-conditioned alternative flow generation through AFGen. Evaluations on 13 public and 7 industrial datasets show that FlowGen consistently outperforms competitive baselines in all three core components. In particular, BFGen improves over the best baseline by 14% in Precision, 7-25% in Recall, 11-30% in F1, and 10-19% in AUC; BPP improves Precision by 30-110%, Recall by 33-91%, and F1 by 32-117%; AFGen improves Precision by 8-23%, F1 by 5-18%, and AUC by 0.6-2.5%. Moreover, we validate the effectiveness of the LLM-based SIP module and the attention preservation factor in BFGen, analyze the impact of requirement completeness on BFGen, and examine how different scopes of branch-related context affect AFGen.
59. 【2609.18284】Made in Hungary: Comments on the performance of generative language models
链接：https://arxiv.org/abs/2609.18284
作者：Mátyás Osváth,Enikő Héja,Noémi Ligeti-Nagy
类目：Computation and Language (cs.CL)
关键词：develop generative language, recent years, initiatives have emerged, emerged to develop, develop generative
备注： 14 pages, 1 figure
点击查看摘要
Abstract:In recent years, three initiatives have emerged to develop generative language models in Hungary. The motivation behind them is the same. For Hungarian, no model with the given capability existed, or existing English-centric models offered limited proficiency. A detailed examination of the corresponding studies, however, reveals several methodological limitations. First, the reliability of the evaluation protocols is questionable. Contrary to the findings of Csibi et al. [2026], evaluation under the recommended inference settings shows that Qwen3-4B achieves higher scores than Racka-4B, its Hungarian-adapted version. Data contamination is evident in the work of Yang et al. [2025d] and Szentmihályi et al. [2025], potentially biasing the reported results. Second, the training pipelines fall short of current best practices in corpus curation and data mixture, which risks wasting substantial compute on low-quality data. The lack of controlled ablations prevents reliable assessment of these choices. Third, none of the three papers assessed forgetting or capability loss. Testing the adapted models on a subset of the original benchmarks indicates performance decline in all three cases, especially Racka-4B. These observations emphasize the importance of rigorous experimental design in language model development, given the significant computational and financial costs involved.
60. 【2609.18282】oo Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement
链接：https://arxiv.org/abs/2609.18282
作者：Xinglang Zhang,Yuanmeng Xiang,Yunyao Zhang,Zeliang Chen,Junqing Yu,Zikai Song
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, higher engagement match, evaluate online content, real user engagement
备注：
点击查看摘要
Abstract:Large language models are increasingly used to generate and evaluate online content, yet it remains unclear whether the qualities they associate with higher engagement match what real users respond to. We study this question using 1.17 million answers to 25,978 questions from Zhihu, Quora, and Reddit, comparing real platform answers and AI-generated answers across four within-question engagement levels. We introduce Ontological Preference Measurement, which represents answers along three dimensions: logic, affect, and expression. We find a systematic gap between AI preference and real user engagement: as target engagement increases, LLMs add more explicit logical structure, while real user engagement is more strongly associated with affective and expressive salience. We call this tendency logic overbinding. Based on this diagnosis, we propose Ontology-Masked Reasoning Autoencoding (OMRA), a controlled intervention that masks and reconstructs over-explained spans while preserving stance, factual content, and coherence. Across four LLM families, OMRA reduces the measured gap by an average of 54.4%. In human evaluation, OMRA wins 62.4% of pairwise preference judgments against matched real platform answers, even though the real answers are more often judged to be human-written.
61. 【2609.18274】I code or AI code: A comparative evaluation of AI-rated scores in classroom observations
链接：https://arxiv.org/abs/2609.18274
作者：Y. Fong,J. Xiang,T.Y.D. Chan,K. Lee,E.Y.H. Lau
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：guiding pedagogical improvement, pedagogical improvement, widely recognized, establishing benchmarks, benchmarks of education
备注：
点击查看摘要
Abstract:Classroom observations are widely recognized as a key tool for establishing benchmarks of education quality and guiding pedagogical improvement, yet they remain resource-intensive and dependent on trained observers. This study evaluated the feasibility of using a LLM (GPT-5 model) to score teacher-child interactions in early childhood classrooms, benchmarked against human raters. The study analyzed 87 video-recorded observations from 38 classrooms across 30 kindergartens in Hong Kong. Using observation transcripts, the AI model was configured to apply the full Classroom Assessment Scoring System (CLASS) framework. AI-rated scores were then compared with human ratings by examining correlations and differences in mean scores of the CLASS domains and dimensions. The results showed greater convergence between AI and raters for the Emotional Support domain and, in particular, the Quality of Feedback dimension, which captures how teachers use feedback to extend children's learning. Greater divergence emerged for interactions that were more procedural or context-dependent, particularly within the Classroom Organization and Instructional Support domains. These findings suggest that transcript-based AI scoring may capture some of the relative variation in teacher-child interactions but cannot yet reproduce calibrated human judgements consistently across the full CLASS framework. AI-assisted observation may therefore be more appropriate as a preliminary screening tool rather than as a replacement for trained observers, providing teachers with evidence for reflection rather than high-stakes evaluation. Future research should examine whether domain-specific training and incorporation of contextual and visual information can improve alignment between AI and human rated scores.
62. 【2609.18259】${M}^2$Tok: Multi-head Multi-codebook Discrete Action Tokenization for Vision-Language-Action Models
链接：https://arxiv.org/abs/2609.18259
作者：Chunpu Xu,Zhixuan Liang,Yuhao Zhang,Chi-Min Chan,Jessie Wang,Yang Xiao,Mengkang Hu,Xiaokang Yang,Yao Mu
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：successfully adapted autoregressive, adapted autoregressive language, process multimodal signals, Recent advancements, autoregressive language models
备注： ECCV 2026
点击查看摘要
Abstract:Recent advancements have successfully adapted autoregressive language models to process multimodal signals, such as images and actions. Since raw action signals are continuous, effective tokenization is essential to map high-dimensional inputs into compact discrete tokens for autoregressive processing. However, existing discrete action tokenizers often suffer from high reconstruction loss, failing to preserve the fine-grained dynamics required for precise control. This ``discretization bottleneck'' significantly limits the performance ceiling of downstream Vision-Language-Action (VLA) models. To address this, we propose $\mathcal{M}^2$Tok, a Multi-head Multi-codebook Action Tokenizer designed to minimize reconstruction error and enhance policy performance. Our approach introduces two key structural innovations: (1) we decompose the latent action features into multiple heads, enabling the model to implicitly align specific heads with distinct action dimensions; (2) we assign independent codebooks to each head for quantization. By leveraging the combinatorial nature of multiple codebooks, we significantly expand the representational expressivity of the tokenizer, leading to substantially lower reconstruction loss compared to previous methods. We evaluate the $\mathcal{M}^2$Tok-based VLA on the RoboTwin, Simpler-Env, and 3 zero-shot real-world tasks. Experimental results demonstrate our method not only achieves superior reconstruction fidelity but also significantly boosts the success rate of VLA models. Comprehensive ablation studies further confirm the effectiveness of the multi-head and multi-codebook mechanisms. Code is available at \href{this https URL}{this https URL}.
63. 【2609.18204】Beyond Accuracy: How Procedural Traces Shift the Decision Criterion of LLM Overseers
链接：https://arxiv.org/abs/2609.18204
作者：Zihan Chen,Di Zhu,Lei Zheng,Weiling Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：large language model, Organizations increasingly, language model, claimed steps, large language
备注： 11 pages, 4 figures, 3 tables. Accepted at the 60th Hawaii International Conference on System Sciences (HICSS)
点击查看摘要
Abstract:Organizations increasingly use oversight loops where one large language model (LLM) audits another's outputs alongside procedural traces of claimed steps. A common concern about such LLM-as-a-judge pipelines is that detailed traces make overseers gullible. Using signal detection theory, we audit five LLM overseers on 19 compliance tasks (4,551 analyzed judgments), varying only trace detail and evidence labeling. With disconfirming evidence always visible, error detection remains near ceiling. Instead, elaborate traces shift the decision criterion toward rejection, increasing false alarms in susceptible overseers. Without option labels, human-validated reason coding shows about 60% of false alarms cite an inability to tie evidence to its option. Labels eliminate this stated reason, yet residual rejection of correct work persists in those overseers and rises with trace detail. Procedural traces thus act as governance artifacts that shape oversight decisions. AI auditors should be evaluated by their decision criterion and false-alarm behavior, alongside accuracy.
64. 【2609.18203】Behavior2Value: Benchmarking and Empowering LLMs for Consumer Value Measurement from E-commerce Behaviors
链接：https://arxiv.org/abs/2609.18203
作者：Peixuan Hou,Bin Chen,Li He,Jian Xu,Bo Zheng,Xiuli Ma,Guojie Song
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：shape human behaviors, shape human, deep motivational orientations, deep motivational, Human
备注：
点击查看摘要
Abstract:Human values are deep motivational orientations that shape human behaviors. In e-commerce, they reveal the stable drivers behind users' purchase decisions. Compared with short-term interests, consumer values better explain how users evaluate products before purchase. However, consumer values are often implicit in complex and fragmented behavioral trajectories, leaving value measurement from e-commerce behaviors largely underexplored. To this end, we propose the Behavior-to-Value (B2V) task, which aims to identify consumer values from e-commerce behavioral trajectories. Centered on this task, we first construct the E-commerce Consumption Value Taxonomy (ECVT) and introduce B2V-Bench, the first B2V dataset and benchmark, based on anonymized Taobao behavioral logs. B2V-Bench consists of real-world purchase decision episodes, covering 25 types of purchase behaviors, along with corresponding consumer value orientations manifested in each episode. To improve consumer value measurement accuracy, we further present B2V-Verifier, a behavior-to-value measurement model based on Value Verification Tuning, which learns to assess whether behaviors provide sufficient evidence for each value inference. Experiments show that B2V-Verifier outperforms strong LLM baselines, improving multi-label classification by 34\%. The dataset and code will be publicly released upon acceptance.
65. 【2609.18194】-SANDHI: Tone Sandhi-aware Adaptive Network with Decoupled Hybrid Injection for Low-resource Taiwanese Hokkien Speech Recognition
链接：https://arxiv.org/abs/2609.18194
作者：Hung-Yang Sung,Chien-Chun Wang,Tien-Hong Lo,Yu-Sheng Tsao,Yung-Chang Hsu,Berlin Chen
类目：Computation and Language (cs.CL)
关键词：Taiwanese Hokkien automatic, process implicit phonological, Taiwanese Hokkien, automatic speech recognition, Hokkien automatic speech
备注： Accepted to IEEE SLT 2026
点击查看摘要
Abstract:In Taiwanese Hokkien automatic speech recognition (ASR), prior studies often treat tone sandhi as a major challenge under the assumption that models fail to process implicit phonological variations. However, our experiments on Taiwanese Hokkien reveal that speech foundation models actually handle tone sandhi variations effectively, and the real performance bottleneck stems from a localized confusion between these variations and retained citation tones. To address this, we propose T-SANDHI to explicitly decouple surface acoustics from underlying lexical intent on top of a frozen Whisper backbone. Using a lexicon-guided multi-task learning structure driven by text-derived pseudo labels, our lightweight hybrid injection module integrates independent citation and sandhi phonetic streams via dynamic gating. Extensive evaluation on the TAT-MOE corpus and two blind test sets demonstrates that this explicit disentanglement effectively resolves tonal mapping confusion, outperforming baselines with strict parameter efficiency.
66. 【2609.18156】ochewBench: A Human-Reviewed Benchmark for Teochew Hanzi Translation
链接：https://arxiv.org/abs/2609.18156
作者：Jianan Wu
类目：Computation and Language (cs.CL)
关键词：exhibits distinctive lexical, substantial speaker community, models remain limited, Teochew Hanzi expressions, Teochew Hanzi
备注： 11 pages
点击查看摘要
Abstract:Teochew has a substantial speaker community and exhibits distinctive lexical, syntactic, and pragmatic features, yet textual resources for evaluating large language models remain limited. We present TeochewBench, a human-reviewed benchmark comprising 300 Teochew Hanzi expressions for evaluating translation from Teochew Hanzi into Mandarin Chinese and English. The dataset covers five categories: basic vocabulary; everyday sentences; Teochew-specific expressions; tone, politeness, and context; and idiomatic, ambiguous, and culturally specific expressions. A primary Teochew-speaking reviewer examined all entries individually and revised them as needed, while two additional Teochew speakers verified selected items. Our main evaluation covers 11 official general-purpose post-trained models on the reviewed dataset in both translation directions, yielding 6,600 predictions. Two official base checkpoints provide 1,200 predictions for supplementary diagnostics, bringing the total to 13 models and 7,800 predictions. We additionally include a Hanzi-copy control, which returns the source input unchanged, to assess how shared Hanzi affect automatic scores for translation into Mandarin Chinese. Qwen3.5-27B achieved the highest overall chrF-style score among the evaluated checkpoints, at 60.63, followed by Qwen2.5-72B-Instruct at 56.61, Gemma-3-27B-IT at 56.36, and GLM-4-32B-0414 at 55.82. Across the 11 main-evaluation models, the mean chrF-style score decreased from 69.25 for low-specificity items to 27.52 for high-specificity items. High-specificity expressions received lower scores and exhibited smaller cross-model differences, suggesting that they constitute a shared low-scoring region across the model families evaluated here. The Hanzi-copy control further indicates that surface overlap in low-specificity items can substantially affect automatic scores for translation into Mandarin Chinese.
Comments:
11 pages
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.18156 [cs.CL]
(or
arXiv:2609.18156v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.18156
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
67. 【2609.18154】PageRecall: Measuring Page Selection in Literature-Grounded Question Answering
链接：https://arxiv.org/abs/2609.18154
作者：Aaditya Chauhan
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：answer lives, page, retrieve the relevant, requested format, table or figure
备注： Accepted at the 1st Workshop on Grounding Language Models (GroundLM 2026), co-located with EMNLP 2026. 9 pages. System description for the LitTraceQA shared task (team Everest)
点击查看摘要
Abstract:We describe our system for LitTraceQA (GroundLM @ EMNLP 2026): given a research question, retrieve the relevant papers from a pool of 27,487, cite the page and the table or figure where the answer lives, and answer in a requested format. Our main finding is that evidence grounding is limited by retrieval, not by reading. The page selector put the annotator's page, which we call the gold page, in front of the model that locates evidence only about half the time (52.6% gold-page recall), while that model, given the page, cited the right one in 45 of the 48 locators it emitted (94%). When the page was missing it rarely said so: of 45 such cases it returned nothing 14 times, a wrong page 24 times, and a correct page 7 times, so the pipeline failed quietly almost twice as often as it failed visibly. Since the failure was that the right page was never shown, the fix is to stop choosing: each retrieved paper fits in the model's context, so we show it whole. Page ranking survives only as a fallback inside papers too long to fit, which no test-split paper was, and gold-page recall reaches 100% on the papers we can parse. Separately, questions that identify their target by position rather than content, such as "the first author of the 24th reference", are served by parsing rather than retrieval: we resolve the bibliography into an addressable list, which also supplies identifiers the evidence metric scores. The final system scores 0.762 paper $F_1$, 0.441 evidence $F_1$ and 0.920 multiple-choice accuracy on the held-out test split. Because the pipeline depends on a closed model without seed control, we release a harness that verifies the paper's central claims against committed artifacts.
68. 【2609.18135】DualSQL: Text-to-SQL with Multi-Agent Reinforcement Learning
链接：https://arxiv.org/abs/2609.18135
作者：Shijie Chen,Yu Gan,Yeounoh Chung,Jiani Zhang,Quannan Li,Sravan Babu Bodapati,Cody J. Greer,Yu Su,Fatma Ozcan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB)
关键词：schema linking, fundamental tasks, SQL generation, SQL, SQL correctness
备注：
点击查看摘要
Abstract:State-of-the-art Text-to-SQL systems are typically multi-agent pipelines centered around two fundamental tasks: schema linking and SQL generation. However, existing work trains separate models for each task, failing to leverage the synergy between these interrelated tasks. In this work, we propose DualSQL, a new Text-to-SQL system consisting of two agents powered by a single model backbone. The agents share the same model weights and agentic scaffold, enabling joint optimization through a robust multi-agent reinforcement learning (RL) framework. We design three database access tools to facilitate effective multi-step reasoning grounded to interactions with the databases. To improve training and avoid model collapse, we introduce a set of rollout guardrail mechanisms that stabilizes multi-agent RL training, supporting DualSQL to keep improving during training. We also introduce a new SQL correctness metric, robust execution match (REX), to more accurately judge SQL correctness and assign reward signals. Being trained on only 3755 examples, DualSQL-4B achieves an impressive 68.0% execution accuracy on the BIRD development set, matching previous 7B models. DualSQL-8B further improves to 71.1%, outperforming previous state-of-the-art single-model solutions with 32B parameters. These results demonstrate the strength of joint multi-agent reinforcement learning for building high performance Text-to-SQL pipelines.
69. 【2609.18131】Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing
链接：https://arxiv.org/abs/2609.18131
作者：Eunju Shin,Jongbin Ryu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：activation entropy, based on activation, performance, MoE, quantization method based
备注： Accepted by the Conference on Empirical Methods in Natural Language Processing (EMNLP) 2026
点击查看摘要
Abstract:In this paper, we present a Mixture-of-Experts (MoE) quantization method based on activation entropy. Although quantization reduces memory and computational costs, it can substantially degrade performance. In particular, performance decline is pronounced in quantized MoE models, where individual experts have a small number of parameters that are sensitive to low-bit representation. Considering that MoE operates as an ensemble model with collaborative contributions from routed experts, a significant performance decline of a particular expert due to quantization can harm model performance. Therefore, we propose Colla-Q, a bit-allocation framework to maintain balanced performance across experts through an activation-entropy-based bit-width allocation algorithm. This approach encourages each expert to operate collaboratively in the quantized model, thereby 1) improving the overall MoE performance and 2) reducing the dependence on the calibration dataset. Since uniformly adjusting each expert's performance facilitates robustness and stability of the MoE model, the proposed MoE quantization method can generalize more consistently across different calibration datasets. Our code is available at: this https URL
70. 【2609.18111】A Comprehensive Review of Generative Physical Artificial Intelligence
链接：https://arxiv.org/abs/2609.18111
作者：Satyam Gaba,Krutiksinh Rana,Siva Sai,Vinay Chamola,Dusit Niyato
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Physical Artificial Intelligence, Generative Physical Artificial, Artificial Intelligence, Generative Physical, Physical Artificial
备注： 25 pages, 8 figures
点击查看摘要
Abstract:The integration of large-scale foundation models with physical embodiments has led to significant advancements in robotics known as Generative Physical Artificial Intelligence (GPAI). These agentic AI systems autonomously perceive, reason, and act in complex real-world situations. This survey comprehensively analyzes GPAI systems, focusing on their architectural foundations, current applications, and key limitations. We introduce a taxonomy of five distinct approaches: Robot Foundation Models (RFMs) for cross-platform skill transfer; Vision-Language Action (VLA) models for end-to-end multi-modal perception and control; Large Behavior Models (LBMs) for human-like movement generation; Diffusion Policy Models (DPMs) for diffusion model-based temporally coherent action generation; and World Foundation Models (WFMs) for physics-compliant simulation and data generation. We examine how these approaches complement each other: WFMs generate training data for VLAs and DPMs, RFMs enable cross-platform deployment of learned policies, while LBMs provide motion priors for natural behavior. Through examples across autonomous vehicles, industrial automation, healthcare robotics, and humanoid systems, we identify significant performance improvements and summarize promising research directions in data-efficient learning, sim-to-real transfer, edge-compatible architectures, and safety frameworks. These insights advance embodied AI for IoT-connected environments where intelligent agents interact with networked sensors, actuators, and edge devices.
71. 【2609.18106】Linguistic Triggers of Gender and Racial Bias in Open-Weight LLMs Applied to Recruitment
链接：https://arxiv.org/abs/2609.18106
作者：Kosuke Kitahara,Nobuhiro Yamaguchi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：remain poorly understood, entering hiring pipelines, discriminatory failure modes, EEOC adverse-impact analysis, Act high-risk classification
备注： Accepted at the 9th AAAI/ACM Conference on AI, Ethics, and Society (AIES 2026). Extended version with Appendices A-B (prompt templates and full stimulus set)
点击查看摘要
Abstract:Open-weight large language models are rapidly entering hiring pipelines, yet their discriminatory failure modes -- and the regulatory exposure these create under the EU AI Act high-risk classification (Annex III) and U.S. EEOC adverse-impact analysis -- remain poorly understood. We present the first systematic, multi-model audit of open-weight LLMs that treats job-posting language as the primary experimental variable, evaluating six models (Llama 3.2, Mistral, Gemma 3, Qwen 3, Phi 3, DeepSeek-R1) across four controlled experiments that jointly probe recruiter-simulation and job-seeker-simulation tasks. We find that (1) agentic posting language depresses recruiter recommendation scores for female candidates (r_rb = 0.309, p_Bonf = 7x10^-5; model-fixed-effects r_rb = 0.448), while communal language partially reverses the penalty; and (2) coded-exclusion language suppresses non-White recruiter scores at large effect sizes (r_rb = 0.646-0.758) and, on the job-seeker side, selectively deters non-White personas from expressing interest -- operationalizing a chilling-effect mechanism at scale. A label-ablation experiment isolates the explicit demographic persona label as the primary causal driver, and Word Embedding Association Tests corroborate these findings at the representational level (d = 1.01-1.45 under Caliskan et al.'s multi-word gender attribute lists). We translate these results into a concrete pre-deployment audit protocol -- posting-vocabulary scoring, persona-conditioned LLM probing, and adverse-impact flagging against the four-fifths threshold -- that operationalizes the documentation and risk-management obligations Annex III imposes on high-risk AI in recruitment.
72. 【2609.18094】Agora: Git as Shared Memory for Collective AutoResearch
链接：https://arxiv.org/abs/2609.18094
作者：Yifan Zhang,Yunheng Zou,Shaokun Zhang,Jian Hu,Hao Zhang,Binfeng Xu,Jan Kautz,Yi Dong
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Autonomous research loops, training setup unattended, Autonomous research, setup unattended, AutoResearch show
备注：
点击查看摘要
Abstract:Autonomous research loops such as AutoResearch show that one coding agent can improve a training setup unattended. Run several of them and each session starts from scratch, so more agents tend to mean more duplicated search rather than more discovery. Agora is a shared memory for such agents: research is recorded as an append-only directed acyclic graph (DAG) stored in Git, so that every claim is a commit anyone can check out and rerun. Each result, insight, hypothesis, verification, and report is an immutable commit whose parent edges say what it builds on; a derived index exposes the frontier, the neglected branches, and the verification status of each claim, and a diversity-aware selection rule keeps the community from collapsing onto one leader. We describe the system and report its first sustained use: a run of nearly 12 days in which 13 language-model workers, with no assigned tasks and no central planner, worked on a weight-transfer problem. Given 141 pretrained donor models and a frozen 119.6M-parameter attention-SSM hybrid whose dimensions match no donor, the workers had to initialize the target without training data or gradient updates. They published 1,703 contributions and drove the evaluator from 3.39 to 1.899 bits per byte, closing 62% of the gap to a trained GPT-2 124M. The winning recipe compresses donor next-token statistics into the target's embedding and output head, then adds a short-range context signal through sparse edits to attention, feed-forward, and state-space blocks. Its 145-commit ancestry spans 15 accounts, and 165 independent reproductions were posted, none of which failed. We describe the single mid-run human intervention that pulled the community out of a monoculture, what the trace does and does not establish, and the controlled comparison that would settle whether shared research state improves discovery per unit of compute.
73. 【2609.18068】From a River in Gilead to the Inference Distributions of Large Language Models: Covert Dialect Bias and Linguistic Profiling at Scale
链接：https://arxiv.org/abs/2609.18068
作者：Chowdhury Mohammad Abdullah,Rita Orji
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, African American Vernacular, Standard American English, Nigerian Standard English
备注： 12 pages, 5 figures. Accepted to the 9th AAAI/ACM Conference on AI, Ethics, and Society (AIES 2026)
点击查看摘要
Abstract:Large language models (LLMs) are increasingly deployed in high-stakes domains such as housing screening. While alignment techniques mitigate explicit racial bias in generated text, they often leave covert attitudinal associations in internal probability distributions untouched. Adapting the matched-guise sociolinguistic paradigm, we examine covert dialect bias in housing-related social judgments across four varieties: Standard American English (SAE), African American Vernacular English (AAVE), Nigerian Standard English (NSE), and Nigerian Pidgin (NP). AAVE reflects the racialized dialect studied in prior covert-bias evaluations, whereas NSE and NP represent Black African, postcolonial varieties absent from this literature. Using 260 meaning-matched sentence quadruples and log-probability scoring over housing-relevant adjectives, we probe ten open-weight LLMs across three contexts varying in social proximity: tenant screening, neighbor acceptance, and roommate selection. Across all ten models, AAVE and NP are consistently associated with more negative adjectives than SAE, with NP penalized most severely. Crucially, each dialect is penalized via distinct stereotype clusters rather than a generic non-standard category. NSE, which carries institutional prestige, displays a context-dependent shift: favored over SAE in formal tenant screening but increasingly penalized as social proximity grows. Our findings reveal that LLMs inherit covert dialect bias along both racial identity and prestige dimensions, echoing documented human housing discrimination and demonstrating its reach across postcolonial English varieties.
74. 【2609.18047】Exact semantic readout from compressed vector representations
链接：https://arxiv.org/abs/2609.18047
作者：Daniel Quigley
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Logic in Computer Science (cs.LO)
关键词：compressed vector representations, characterize when compressed, fixed map, finite lexicon truth, vector representations admit
备注： 24 pages; 31 references; 13 figures; 2 tables
点击查看摘要
Abstract:We characterize when compressed vector representations admit exact linear or affine readouts of a finite lexicon's truth conditions: one fixed map per predicate, sending each entity vector to the corresponding truth vector. A necessary and sufficient row-space condition determines existence; the augmented truth matrix has rank r, giving minimum dimension r in the linear case, and r-1 in the affine. Exact readouts return values in a shared truth basis on which Boolean connectives act unchanged; separability alone requires an intervening threshold. For binary relations, exact bilinear readout of identity or strict total order requires linearly independent entity vectors. Experiments with GloVe and word2vec distinguish exact affine recovery, linear separability, and held-out prediction: most predicates are strictly separable, but none admits an exact affine readout from the pretrained embeddings. Supervised transductive training attains exact affine recovery to numerical precision at every tested dimension meeting the bound. At the embeddings' original dimension, geometries constrained to exact linear recovery retain 98-99 percent of the pretrained variance on the feature norms, and 80-83 percent on the WordNet lexicon.
75. 【2609.18011】Gaze as Evidence for Common Grounding: A Cross-Corpus Analysis of MapTask and MUNDEX
链接：https://arxiv.org/abs/2609.18011
作者：Nan Li,Albert Gatt,Massimo Poesio
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：asymmetric information, understanding through interaction, coordinate their understanding, gaze, MUNDEX
备注： 16 pages, 17 tables, 2 figures; accepted to the MINT workshop at EMNLP 2026 (oral presentation)
点击查看摘要
Abstract:In collaborative tasks with asymmetric information, participants coordinate their understanding through interaction. We ask whether gaze provides evidence about grounding across two such tasks. Working from discrete behavioral annotations, we map HCRC MapTask (Anderson et al., 1991) and MUNDEX (Türk et al., 2023) into a shared partner/task/away vocabulary and compute gaze features around task-relevant dialogue units. In both corpora, aligned reference interpretations (MapTask) and UND (understood) judgments (MUNDEX) are associated with more task-directed gaze and with less partner-directed gaze, lower gaze entropy, and fewer gaze transitions. The associations are clearest for the participant leading the task: in giver-produced references, and in explainer judgments, which also co-vary with the explainee's gaze. In same-speaker MapTask reference chains, the speaker's gaze entropy is lower at the mention where a previously non-aligned referent becomes aligned. The best gaze feature groups improve modestly over controls under grouped cross-validation: temporal features in MapTask and raw proportions in MUNDEX. Because effects are small and several weaken when recurring participants rather than dialogues are the unit of inference, we treat gaze as one contributing cue to grounding, to be interpreted alongside task and dialogue context.
76. 【2609.18005】A Calibrated Instrument for Measuring How Inference Optimizations Affect Output Quality
链接：https://arxiv.org/abs/2609.18005
作者：Jerry Kaplan
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：active research area, Large language model, Large language, research area, spanning quantization
备注： 23 Pages. 6 tables in main text,5 tables in appendices. Code, prompts, and result files at [this https URL](https://github.com/jerrykaplan/Calibrated-Instrument)
点击查看摘要
Abstract:Large language model optimization is an active research area, spanning quantization of model weights, early-exit methods for skipping layers, and speculative decoding. Each track uses its own quality measures, typically an idiosyncratic benchmark score. Few approach the measurement precision required by other scientific disciplines. We propose a rigorous methodology for measuring output quality, suitable for cross-system and cross-technique comparison. We score outputs with an LLM as a judge, but calibrate the judge formally: we compare its scores on two ordinary runs of a model given the same prompts, verifying that it shows no systematic preference between statistically equivalent outputs and measuring its per-sample noise. Each design also includes a 'null' condition, provably identical in distribution to the unmodified model, whose measured difference must be zero. With this one instrument we measure several acceleration techniques on the same prompts, so their quality costs can be compared. Perceived quality proves highly dependent on the domain of discourse. A 4-bit model was indistinguishable from its 16-bit original down to our design's +/-0.3-point resolution, in English prose and Chinese alike. At 3-bit precision the same prompts lost 0.5 points in English prose, 0.9 in Chinese, and 1.1 on multi-step math; early exit that cost 0.7 points on prose cost 2.5 on math, cutting correctly solved problems from 19 of 27 to 6. The pattern held for models from Alibaba and from Meta, but not its magnitude: the same quantizer cost Meta's model 1.8 points where it cost Alibaba's 0.7. A model's certainty about a token predicts how likely it is to differ from the full model's choice, but not how much that difference affects judged quality, so acceptance rules relying on certainty cannot distinguish errors that matter from errors that don't.
Comments:
23 Pages. 6 tables in main text,5 tables in appendices. Code, prompts, and result files at this https URL
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
ACMclasses:
I.2.7; I.2.6
Cite as:
arXiv:2609.18005 [cs.CL]
(or
arXiv:2609.18005v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.18005
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Jerry Kaplan [view email] [v1]
Wed, 16 Sep 2026 01:49:12 UTC (788 KB)
77. 【2609.17632】EvolveTrade: Experience-Driven Policy Refinement for Self-Evolving LLM Trading Agents
链接：https://arxiv.org/abs/2609.17632
作者：Sehee Kim,Yumin Choi,Minki Kang,Sung Ju Hwang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language model, static hand-written tool-use, combine market data, Large language, hand-written tool-use policies
备注：
点击查看摘要
Abstract:Large language model (LLM) trading agents can combine market data, news, and executable analysis, but their behavior is often controlled by static hand-written tool-use policies that are fixed before deployment. This limits their ability to adapt how they gather evidence, invoke tools, verify signals, and manage risk under changing market regimes. We introduce EvolveTrade, a self-evolving framework that treats the system prompt of a tool-using trading agent as a text-parameterized policy. After each update interval, a Policy Agent revises this policy using accumulated decision traces and realized portfolio feedback, while keeping the backbone LLM fixed. The updated policy is then used for the next batch of trading decisions, enabling the agent to refine its information-acquisition and portfolio-construction procedure over time. Experiments across multiple market regimes and two LLM backbones show that EvolveTrade often improves Sharpe Ratio and Cumulative Return over fixed-policy LLM baselines, achieving the improved SR and CR in most evaluated settings. Behavioral analyses further show that self-evolved policies increase code-mediated analysis and activate regime-relevant computations; case-level policy-to-return attributions trace how policy-induced allocation changes contribute to realized return differences. These results suggest that adapting the reusable procedure governing tool use is a key direction for building more robust LLM trading agents.
78. 【2609.17602】Making Political Text Scaling Comparable: Infrastructure and Hyperparameter Sensitivity for 17 Algorithms
链接：https://arxiv.org/abs/2609.17602
作者：Patrick Parschan
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Computational text-based ideal, ideal point estimation, text-based ideal point, Computational text-based, involves numerous researcher
备注： Accepted for the 6th edition of the workshop on Computational Linguistics for the Political and Social Sciences (CPSS)
点击查看摘要
Abstract:Computational text-based ideal point estimation (CT-IPE) methods are usually compared as named algorithms, yet applying them involves numerous researcher choices that configure how political text is turned into position estimates. This paper argues that CT-IPE methods are better understood as configurable measurement pipelines than as fixed estimators. Building on a large-scale comparative experiment spanning 17 CT-IPE algorithms, 5,537 experimental runs, and approximately 4.25 million left-right position estimates, I describe the shared infrastructure that makes these heterogeneous methods jointly executable and quantify how sensitive their estimates are to alternative hyperparameter choices. Variance-partitioning and SHAP-based sensitivity analyses show that, for most algorithms, hyperparameter profiles explain little residual variance through a shared shift: 13 of the 17 algorithms exhibit ICC values below .10. Where this profile-level sensitivity is present, it is concentrated in a small number of consequential researcher choices, most notably the selection of the underlying language or embedding model, the seed keyword lists that anchor the construct, and the number of topics.
79. 【2609.17554】English Word Sense Disambiguation in 2026: When the Labels Become the Bottleneck
链接：https://arxiv.org/abs/2609.17554
作者：Vassili Philippov,Amro Salman,Dmitrii Andreev,Penny Hands,Emil Kaiumov,Pavel Katunin,Anton Nikolaev
类目：Computation and Language (cs.CL)
关键词：English all-words word, gold standard decide, decide benchmark rankings, standard decide benchmark, LLM WSD evaluation
备注： 48 pages, 10 figures. Code, data, and live leaderboard: [this https URL](https://glitetech.github.io/sensebench/)
点击查看摘要
Abstract:In English all-words word sense disambiguation (WSD), the labels, not the models, have become the bottleneck: frontier LLMs are accurate enough that the errors surviving in the gold standard decide benchmark rankings -- in the test sets we score on and, as we show causally, in the corpus we train on. We release lexEN, a WSD evaluation benchmark built as a conservative, human-adjudicated correction layer over Maru2022's ALL_NEW benchmark (211 labels changed, 56 removed), and SenseBench, an auditable LLM WSD evaluation harness and living leaderboard (57 models, 192 runs). The task is inventory-constrained multiple choice (the model picks from the supplied WordNet senses), so the reported accuracies are a ceiling on what models achieve without that help. On lexEN-v1 the frontier LLMs converge near 95% (best, 95.6%), the top three families are statistically indistinguishable, and accuracy trades off against reasoning effort and cost across a ~2,500x price span. Relabeling SemCor with frontier models and retraining BEM, ESCHER, and ConSeC unchanged lifts them by several F1 points on test sets the relabeling never touched; we release the relabeled corpora and Glite LENS, a 298M bi-encoder trained on the repaired labels -- to our knowledge the strongest reported (83.6 Raganato ALL, 87.4 Maru ALL_NEW) -- serving at ~$0.13 per million items. On hard items, fine-grained WordNet senses are partly ill-posed even for experts (three-reviewer Fleiss kappa=0.537); coarsening raises annotator agreement and model accuracy together across four inventories, placing a top model inside the expert agreement band at coarse granularity (statistically equivalent under three of four) but significantly below it at fine. The binding constraint is now cost.
80. 【2609.17553】he Limits of BPE Tokenization in Polish: Segmentation-Flexional Forms, Grammatical Anchoring, and First-Person Stability in Inflectional Language Models
链接：https://arxiv.org/abs/2609.17553
作者：Elzbieta Dawidek(University of Lower Silesia DSW Ideis)
类目：Computation and Language (cs.CL)
关键词：analyzes BPE tokenization, article analyzes BPE, limits of statistical, analyzes BPE, grammatical
备注： The preprint was first posted on SocArXiv on 24 May 2026; version 3 is available at [this https URL](https://doi.org/10.31235/osf.io/7exa6_v3) English translation of a manuscript originally written in Polish
点击查看摘要
Abstract:This article analyzes BPE tokenization in Polish as a test case for the limits of statistical segmentation in an inflectional language. It asks whether frequency-based tokenization preserves linguistically relevant units, including orthographic form, phonemic and syllabic segmentation, derivational structure, inflectional endings, grammatical form, and the speaking subject. The material includes diagnostic words, a children's text, selected forms from the Preamble to the Constitution of the Republic of Poland, word-family tests, and examples with Polish diacritics and nasal vowels. BPE tokenizers may produce segments that coincide with syllabic or morphologically interpretable divisions, but remain dependent on the frequency of written forms. They do not systematically map orthographic representation onto phonemic structure or context-dependent phonetic realization. The results show that BPE stabilizes frequent surface fragments of grammatical exponents rather than grammatical categories themselves. A form such as ustanawiamy is not merely a sequence ending in -y, but a verbal form anchored in conjugation, person, number, tense, mood, and aspect. The article develops the concept of grammatical form anchoring. In Polish, forms such as poszlam, zrobilam, or bylam can establish the position of the speaking subject without an explicit pronoun. In interaction with AI, this exposes a further problem: a language model does not possess a stable grammatical "I", but reconstructs it contextually and may mirror the user's forms or shift grammatical gender. Roclawski's segmentation-flexional forms are proposed as a diagnostic framework for evaluating tokenization boundaries. More stable modeling of Polish may require sublexical stabilization, anchoring grammatical form in the inflectional system, representing sentence patterns and verbal valency, and maintaining the grammatical "I" in dialogue.
81. 【2609.17552】Does Moral Reasoning Training Help or Hurt? Red-Teaming RL-Trained Ethical Agents with Persona Attacks
链接：https://arxiv.org/abs/2609.17552
作者：Arth Singh
类目：Computation and Language (cs.CL)
关键词：make language-model agents, pressure is unknown, make language-model, adversarial persona pressure, Moral-reward
备注： 19 pages, 3 figures. Accepted at the Trustworthy AI for Good Workshop (AI4GOOD) at ICML 2026
点击查看摘要
Abstract:Moral-reward RL can make language-model agents more cooperative, but whether that alignment survives adversarial persona pressure is unknown. Such attacks are realistic: retrieved context, tool outputs, or multi-turn framing can all inject role instructions that compete with the agent's moral objective. We red-team morally trained Gemma-2-27B/9B and Llama-3.1-8B agents with five persona attacks, then probe causality with noise-reward controls, adversarial PPO, representation analysis, steering, and head ablations. At 27B, moral RL cuts mean adversarial degradation by 5.2x but costs ~11pp ETHICS accuracy; across 205 scenarios and 5 seeds, reasoning-level moral reward yields 5.8x robustness while a matched random reward yields none. The training also reshapes representation geometry (mean CKA 0.82/0.83 vs. 0.98 for noise), moves peak attack processing 8 layers earlier, and exposes a rank-1 L21 direction that recovers 83% of full PPO's average robustness. One failure mode survives all of this. Against Fiction role-play, L21 steering recovers only 29% of the gap, and head ablation finds 38 compliance heads competing with 25 alignment heads. Moral RL thus builds robustness that is partly linear and partly circuit-distributed, transferable through activation steering, yet still beaten by named-character role-play.
82. 【2609.17550】No Usable Linear "Capitulation Direction" in Two Small LLMs: A Validation Protocol for Activation-Steering Claims, and a Cross-Family Behavioral Study of Sycophancy Under Pushback
链接：https://arxiv.org/abs/2609.17550
作者：Saad Aamir,Muhammad Awais Bin Adil
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Language models frequently, users push back, Language models, push back, models frequently abandon
备注： 12 pages, 3 figures. Code, transcripts, and analysis: [this https URL](https://github.com/saad-aamir/sycophancy-direction)
点击查看摘要
Abstract:Language models frequently abandon correct answers when users push back. We study this in two small instruction-tuned models from different families, Qwen2.5-1.5B and Llama-3.2-1B, over TriviaQA: the model answers, is challenged with one of four scripted pushback styles, and answers again. Conditioned on an initially correct answer, the models flip to a wrong answer in 41.8% and 43.1% of episodes. Which pressure works is a property of the model, not the pressure: the same within-question paired comparison (bare doubt vs. emotional appeal), specified in advance, is Bonferroni-significant in opposite directions across families (Qwen: bare doubt emotional, OR 2.5, p=.040; Llama: emotional bare doubt, OR 4.0, p=.001). Failure mode is also model-dependent: Llama abandons answers without recommitting at six times Qwen's rate (8.2% vs. 1.4%). Identical pushback repairs initially wrong answers only ~13% of the time; pushback is net epistemically destructive. We then ask whether capitulation is linearly decodable from the pre-response residual stream, a prerequisite for steering-vector interventions at that locus. A naive difference-in-means probe appears to succeed (in-sample AUROC 0.81/0.71), but a validation protocol combining question-level cross-validation, shuffled-label nulls, and a known-direction positive control shows the signal is overfitting: the best cross-validated AUROC is 0.582 in Qwen and 0.548 in Llama, both near or below their permutation thresholds and far under a pre-registered usability bar of 0.70, while the identical pipeline recovers a pushback-presence control direction at AUROC 1.000 in both. We further quantify a measurement hazard: substring grading underestimates capitulation by 18-24 percentage points. Code, prompts, transcripts, and analysis are released.
83. 【2609.17549】Do Social Patterns Hold in Synthetic Data? Analyzing Cyberbullying Dynamics in LLM-Generated and Authentic Dialogues
链接：https://arxiv.org/abs/2609.17549
作者：Arefeh Kazemi,Hamza Qadeer,Sinan Asci,Joachim Wagner,Brian Davis
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：complex social phenomenon, social phenomenon characterized, repeated aggression, phenomenon characterized, characterized by repeated
备注：
点击查看摘要
Abstract:Cyberbullying (CB) is a complex social phenomenon characterized by repeated aggression, power imbalance, and multi-party interaction. Although large language models (LLMs) are increasingly used to generate synthetic CB conversations for data augmentation and benchmarking, it remains unclear whether such data faithfully reproduces the social dynamics of authentic interactions beyond supporting downstream task performance. We present a comprehensive framework for evaluating the social realism of LLM-generated CB conversations. We compare authentic and synthetic dialogues generated by GPT, Grok, and LLaMA across interactional structure (turn-taking, power dynamics, and repair behavior), linguistic and stylistic realism (pronoun usage and humor), affective and behavioral markers (CB types, profanity, and toxicity), and temporal escalation dynamics. We further complement automatic analyses with a human evaluation of cyberbullying presence, scenario relevance, role plausibility, and social realism. Our results show that LLM-generated data consistently preserves high-level interactional structure, including role participation patterns, directional power asymmetry, and broad distributions of behavioral markers. However, all models systematically distort finer-grained social phenomena, including behavioral magnitude, role-specific allocation, categorical distributions, and temporal dynamics. These distortions are strongly model-dependent: GPT suppresses harmful content, Grok amplifies aggressive behaviors, and LLaMA provides the most balanced approximation while smoothing role distinctions. Our findings show that synthetic CB data is useful for modeling global interactional structure but remains an imperfect substitute for authentic conversations when behavioral realism and social dynamics are essential.
84. 【2609.17548】Myovox: Reading Speech from the Muscles of the Face
链接：https://arxiv.org/abs/2609.17548
作者：Varshith Madishetty
类目：Computation and Language (cs.CL)
关键词：open-vocabulary English text, decodes open-vocabulary English, English text, phone error rate, open-vocabulary English
备注：
点击查看摘要
Abstract:Myovox, from myo (muscle) and vox (voice), decodes open-vocabulary English text from 31-channel surface electromyography (sEMG) recorded from the muscles of the face during vocalized speech. It takes the single-subject emg2speech General Corpus from a published 51.17% word error rate to 18.53%, in three separable moves, each measured in isolation. First, I recover the open-vocabulary decode settings missing from the public release and reach a faithful 40.63% WER / 39.02% PER baseline whose phone error rate matches the published one to within 0.8 points, so the acoustic model is reproduced faithfully. Second, I replace the causal encoder with a bidirectional Conformer trained by a four-term cross-modal distillation against the parallel audio's WavLM-Large layer-9 features, reaching 26.14% WER / 22.34% PER from the electromyography alone. Third, I ensemble two acoustic models, union their multi-scale n-best lists, and rerank with a QLoRA-fine-tuned 7B language model, reaching 18.53% WER, the best result reported on this corpus, though not the best reported for sEMG-to-text on other corpora (Section 2). I then report the negative result that bounds the whole approach: reranking is exhausted at 18.5% because the binding constraint is the electromyographic acoustic phone error rate (~20.9%), not the language model. The correct words are simply absent from the acoustic posteriors, so no reranker can reach the 9.30% n-best oracle. All test numbers are on the 400-sentence held-out test set under the authors' official 8,500 / 760 / 400 sequential split; every hyperparameter is tuned once on validation and applied once to test.
85. 【2609.17547】How AI Assistants Respond to Repeated Abuse
链接：https://arxiv.org/abs/2609.17547
作者：William Guey,Wei Zhang,Pierrick Bougault,Yi Wang,Agoston Bodo,Vitor D de Moura,José O Gomes
类目：Computation and Language (cs.CL)
关键词：repeated verbal abuse, difficult interactions, benign task, expected to remain, repeated verbal
备注： 9 pages, 3 figures, 1 table
点击查看摘要
Abstract:AI assistants are expected to remain useful during difficult interactions, but little is known about how repeated verbal abuse changes their engagement with an otherwise benign task. We contribute a bilingual, multi-turn framework that separates hard disengagement, an unconditional statement of noncontinuation with no stated route to resume, from soft withdrawal, continued availability, observable task-related work, and boundary setting. Each of eight time-specific API configurations contributed 48 escalation conversations and eight smaller constant-frustration comparisons, giving 448 five-turn conversations, 2,240 responses, and 6,720 metadata-blinded model judgments. Primary results use the sustained-abuse endpoint of the 48 escalation conversations per configuration. Hard disengagement ranged from 0/48 in four configurations to 24/48 (50.0%) for Gemini 3.1 Pro, with strong configuration-associated heterogeneity (matched-label Monte Carlo p = 0.00001). GPT-5.6 Sol produced hard-disengagement labels in 15/48 (31.2%) endpoints, whereas Claude Fable 5 produced none and yielded 42/48 (87.5%) soft-withdrawal labels. Aggregate hard-disengagement rates were similar in English and Chinese (30/192 versus 32/192), although configuration-specific directions varied. Availability also differed from task-related work: Claude Opus 4.8 and Claude Fable 5 remained explicitly available in 48/48 endpoints while providing observable task-related work in only 8/48 and 7/48. Human coding was used to evaluate measurement quality. The results show why a single refusal label cannot capture whether an assistant leaves, pauses, preserves a route back, sets a boundary, or still performs substantive work.
86. 【2609.17546】Legal LLM Hallucination Should Be Evaluated as Failure of Legal Warrant
链接：https://arxiv.org/abs/2609.17546
作者：Maksym Taranukhin,Vered Shwartz
类目：Computation and Language (cs.CL)
关键词：legal LLMs' hallucinations, position paper, LLMs' hallucinations, factual inaccuracy, legal
备注： Accepted at AI4Law@ICML2026
点击查看摘要
Abstract:In this position paper, we argue that legal LLMs' hallucinations should be evaluated as a failure of legal warrant rather than as factual inaccuracy or citation failure. We define claim-authority warrant as the context-sensitive relation between a consequential legal claim and authority that exists, applies to the relevant jurisdiction, is current for the date of analysis, has the legal status represented by the system, and supports the proposition asserted. Warranted legal generation is the broader system behavior that answers, narrows, asks, warns, corrects a false premise, or abstains according to that relation. The falsifiable prediction is that warrant metrics reveal material failures that answer accuracy, citation existence, generic attribution, LegalHalBench-style statute relevance, and CitaLaw-style sentence-citation alignment can miss. We sharpen this claim with a side-by-side comparison item and a small, reproducible pilot over public-rule tests. We then specify benchmark records, claim boundaries, support labels, mixed response-policy scoring, risk weights, annotation reliability reporting, and jurisdiction-specific authority ontologies. The result is a concrete research agenda for evaluating legal AI systems by whether their consequential claims are licensed by law.
87. 【2609.17544】Large Language Models Versus Physicians in Traditional Chinese Medicine: A Real-World Clinical Case Evaluation
链接：https://arxiv.org/abs/2609.17544
作者：Jiacheng Xie,Xiaoting Tang,Yang Yu,Jinpu Li,Shouli Li,Congcong Jing,Yantao Yang,Zhiyong Zhao,Ziyang Zhang,Qilin Song,Guanghui An,Dong Xu
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：traditional Chinese medicine, real-world traditional Chinese, case library comprising, Large language models, de-identified outpatient cases
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly being explored for clinical applications, yet their assessment for real-world traditional Chinese medicine (TCM) practice remains limited We constructed a clinical case library comprising 349 de-identified outpatient cases from 62 hospitals and evaluated 16 LLMs and a comparator cohort of 60 practicing TCM physicians using 60 representative cases selected from this library. Model outputs and physician reports were anonymized and scored by five senior TCM experts across nine diagnostic and therapeutic dimensions. Cutting-edge general-purpose LLMs achieved higher expert scores than the physician comparators, particularly for medical advice, treatment principles and selected diagnostic tasks. However, prescription-level analyses revealed discrepancies in herb selection, dosage, and treatment strategy, and qualitative safety review identified hallucinations and undesirable template-driven outputs. These findings highlight the potential of LLMs for TCM decision support while underscoring the need for physician oversight, safety constraints and prospective clinical evaluation.
88. 【2609.17542】Register Bias in Complexity-Based Large Language Model Routing
链接：https://arxiv.org/abs/2609.17542
作者：Simran Koul
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：services increasingly route, African American English, Large language model, send easy queries, Large language
备注： 4 pages, 2 figures. Code: [this https URL](https://github.com/SimranKoul2026/register-bias-llm-routing)
点击查看摘要
Abstract:Large language model services increasingly route each query to one of several models of differing capability, using a cheap estimate of query complexity to send easy queries to small models and hard queries to large ones. I show that this routing step is not register neutral: text written in a non-standard English register, African American English or the English of second-language writers, is systematically assigned a lower-capacity tier than a meaning-equivalent standard-English version of the same query. The effect is driven by a specific, common routing signal, input length, because non-standard registers omit function words and thus look shorter and therefore simpler; other complexity signals do not carry it. I demonstrate the disparity on 37,704 authentic learner sentence pairs and on a controlled parallel corpus. I then measure the quality consequence on a device, edge, and cloud model ladder and find that the harm is driven by pervasive model bias, every tier, including a frontier cloud model, answers non-standard-register queries significantly less accurately, while the marginal quality cost of the routing decision itself is not significant on this benchmark. Complexity-based routing thus compounds the exposure of the users that the models already serve worst.
89. 【2609.17539】MudawanSn: A Gold-Standard Wolof-Arabic Parallel Corpus for Machine Translation
链接：https://arxiv.org/abs/2609.17539
作者：Mouhamed Mbaye,Thierno Diop
类目：Computation and Language (cs.CL)
关键词：Modern Standard Arabic, sentence-aligned pairs manually, pairs manually translated, Modern Standard, Standard Arabic
备注： 8 pages, 1 figure
点击查看摘要
Abstract:We present MudawanSn, a gold-standard resource of 1,271 sentence-aligned pairs manually translated from Wolof into Modern Standard Arabic (MSA). The source texts are drawn from the MasakhaNER corpus and cover politics, society, religion, and sports in Senegalese news discourse. Although multilingual resources such as FLORES-200 and NTREX include both Wolof and Arabic, no publicly available parallel corpus is specifically designed for the Wolof-Modern Standard Arabic language pair. We describe the corpus construction protocol, sentence alignment procedure, and quality-control workflow. We benchmark four machine translation systems spanning three architectural families: NLLB-200 (600M), mT5-base, and two AfriNLLB variants, showing that fine-tuning on MudawanSn yields substantial improvements in both translation directions. The best-performing model, AfriNLLB-12, achieves 7.76 BLEU and 30.72 chrF++ for Wolof-to-Arabic, and 8.75 BLEU and 33.08 chrF++ for Arabic-to-Wolof. The corpus is released under the CC BY-NC license and is publicly available on Hugging Face and GitHub.
90. 【2609.17538】From Pixels to Pairs: A Comprehensive Benchmark of LLM-Based Key-Value Extraction in Noisy Document Settings
链接：https://arxiv.org/abs/2609.17538
作者：Zahra Anvari,Vassilis Athitsos
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：remains poorly understood, structured information extraction, Large language models, noise remains poorly, realistic OCR noise
备注： 25 pages, 20 tables, 5 figures
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for structured information extraction from documents, yet their behavior under realistic OCR noise remains poorly understood. We present a systematic benchmark of open-source instruction-tuned LLMs for key-value pair (KVP) extraction under both clean-text and noisy OCR conditions. We evaluate representative decoder-only models (Gemma, Mistral, Qwen2.5, LLaMA 3, and DeepSeek) on the FUNSD, CORD, and SROIE benchmarks using both Gold-text annotations and OCR outputs from PaddleOCR, EasyOCR, and Tesseract. A unified evaluation protocol isolates the effects of input quality, model design, and prompting under consistent conditions. The results show that modern LLMs act as strong semantic extractors when high-quality text is available, in some cases approaching supervised layout-aware systems. Under OCR noise, however, performance degrades substantially and performance gaps between models narrow as input corruption increases. Across all datasets, extraction performance is governed by two factors: semantic reasoning over text and preservation of textual fidelity under OCR noise. While larger models improve results on clean text, these gains diminish under noisy inputs, where OCR quality becomes the dominant factor. We also identify recurring failure modes, including key-value misalignment, hallucination, and numeric corruption. Our findings highlight the gap between clean-text evaluation and real-world deployment, emphasizing the need to jointly improve OCR quality, structural reasoning, and LLM-based semantic modeling.
Comments:
25 pages, 20 tables, 5 figures
Subjects:
Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.17538 [cs.CL]
(or
arXiv:2609.17538v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.17538
Focus to learn more
arXiv-issued DOI via DataCite
Submission history From: Zahra Anvari [view email] [v1]
Tue, 14 Jul 2026 02:20:43 UTC (10,830 KB)
91. 【2609.17537】Relation Before Entity: Deferred Commitment in Language Model Factual Recall
链接：https://arxiv.org/abs/2609.17537
作者：Divyansh Agarwal
类目：Computation and Language (cs.CL)
关键词：France to Paris, causally active, France, Paris, information
备注： 8 pages, 4 figures. Accepted at the Mechanistic Interpretability Workshop at the 43rd International Conference on Machine Learning (ICML 2026). Code available at [this https URL](https://github.com/divyanshddn146/deferred-entity-commitment)
点击查看摘要
Abstract:We ask whether relation-type information (e.g., capital-of) and entity-specific information (e.g., France to Paris) become causally active at the final-token position at the same depth during recall. Using four complementary causal diagnostics across four decoder-only models and eight prompt families, we find a robust temporal asymmetry: relation information becomes generation-controlling before entity information does. Relation onset precedes entity onset by 10-16 tested layers (31-44% of network depth) at threshold 0.4, with the ordering holding across all 16 model-threshold combinations for thresholds 0.2-0.5. Critically, entity information is not absent early: entity-token patching succeeds at 90-100% in early layers. Instead, entity commitment to generation is deferred: entity information is available at the entity-token position but becomes generation-controlling at the final token only after being routed there.
92. 【2609.17536】hink Before You Comfort: Reflective Cognitive Alignment for Protocol-Grounded Elderly Stimulation Agents
链接：https://arxiv.org/abs/2609.17536
作者：Jiyue Jiang,Ziyi Li,He Hu,Sheng Wang,Yuhan Chen,Yanyu Chen,Jingqi Zhou,Pengan Chen,Fei Ma,Irwin King,Yu Li,Chuan Wu
类目：Computation and Language (cs.CL)
关键词：Cognitive Stimulation Therapy, offers non-pharmacological support, scalability remains constrained, severe data scarcity, Stimulation Therapy
备注：
点击查看摘要
Abstract:Cognitive Stimulation Therapy (CST) offers non-pharmacological support for elders with cognitive impairment, yet scalability remains constrained by reliance on trained facilitators and severe data scarcity, particularly for privacy-sensitive, low-resource languages such as Cantonese. While Large Language Models (LLMs) show promise for automated companionship, they often struggle to balance empathetic engagement with adherence to cognitive stimulation guidelines. We propose a framework addressing these challenges along two complementary axes. First, STaR-CS (Style-Transfer and Role-Conditioned Cognitive Stimulation) synthesizes multi-party dialogues through facilitator style modeling and structured skeleton extraction, mitigating data barriers. Building upon this corpus, the Reflective Cognitive Alignment (RCA) framework models stimulation interactions as a sequential decision process, integrating Protocol-Constrained Chain-of-Cognition (PC-CoC) for structured reasoning and Inference-Time Value Alignment (IVA) for principled response selection based on safety and engagement goals. Evaluations across six backbone LLMs and two independent judges show that RCA consistently improves protocol adherence, safety, and group facilitation over standard prompting baselines. Our code is available at this https URL.
93. 【2609.17535】DANTINOX: A Unified Framework for Multi-Paradigm Language Modeling
链接：https://arxiv.org/abs/2609.17535
作者：Marco Simoni,Aleksandar Fontana,Giulio Rossolini,Andrea Saracino
类目：Computation and Language (cs.CL)
关键词：discrete masked diffusion, Language generation research, research increasingly spans, autoregressive decoding, generation research increasingly
备注：
点击查看摘要
Abstract:Language generation research increasingly spans three paradigms: autoregressive decoding, discrete masked diffusion, and continuous flow-matching. Comparing them is difficult because each lives in a separate codebase, so measured differences often reflect implementation details rather than the paradigms themselves. We present DantinoX, an open-source JAX/Flax library in which a single modular Transformer backbone serves all three paradigms. Switching the generation paradigm, attention mechanism, or hardware topology requires only a configuration change, while the backbone architecture, tokenizer, initialization strategy, and training infrastructure remain consistent. This enables controlled cross-paradigm comparisons within one API for training, streaming inference, and benchmarking.
94. 【2609.17534】Faking Good and Faking Bad in LLMs: Response Distortion Across Dark Triad Personality Traits
链接：https://arxiv.org/abs/2609.17534
作者：Victoria Popa,Guglielmo Cola,Caterina Senette,Maurizio Tesconi
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, Social desirability, human personality assessment, Language Models
备注： 21 pages, 7 figures, Journal
点击查看摘要
Abstract:Social desirability and impression management are pervasive sources of response distortion in human personality assessment, yet their effects on Large Language Models (LLMs) remain underexplored. This study investigates whether contemporary LLMs systematically modulate the expression of Dark Triad traits (Machiavellianism, narcissism, and psychopathy) under fake-good and fake-bad conditions. Seven state-of-the-art models were evaluated across two ecologically relevant contexts: employment selection and forensic evaluation, in which socially desirable or undesirable incentives were conveyed through contextual framing. Trait expression was measured using standard psychometric scoring procedures and compared with self-assessment baselines at both aggregate and item levels. Results revealed systematic and condition-consistent response modulation. Most models reduced Dark Triad scores under fake-good conditions and increased them under fake-bad conditions, although the magnitude and consistency of these effects varied across traits and models. Machiavellianism and narcissism showed the strongest and most coherent shifts, whereas psychopathy displayed greater heterogeneity. Context also influenced responses, with employment scenarios generally producing larger effects than forensic scenarios. An additional experiment showed that explicit fake-bad instructions generated substantially stronger distortions than contextual framing alone. The results suggest that personality-related outputs should be interpreted in light of the motivational and situational context in which they are elicited. More broadly, they highlight the value of psychometric paradigms for evaluating susceptibility to response distortion, impression management, and context-dependent behavioral shifts, with important implications for LLM benchmarking, alignment evaluation, and robustness assessment.
95. 【2609.17532】Enhancing Extubation Failure Prediction with LLM-Derived Features from Respiratory Therapy Clinical Notes
链接：https://arxiv.org/abs/2609.17532
作者：Izzy Chaiken,Aditya Khowal,Neha A. Sathe,Mark M. Wurfel,Lucy Lu Wang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Physics and Society (physics.soc-ph)
关键词：Invasive mechanical ventilation, preventing extubation failure, Invasive mechanical, safe discontinuation, extubation failure
备注： Published in CHIL 2026. 11 pages, 4 figures, 4 tables, 25 pages including citations and supplemental material
点击查看摘要
Abstract:Invasive mechanical ventilation is a lifesaving therapy, but timely, safe discontinuation is essential to preventing extubation failure (EF) and related risks to health. We present a novel approach to EF prediction that leverages features classified in free-text respiratory therapy notes using a large language model and logistic regression pipeline. Applied to a patient cohort from University of Washington Medicine, our method identifies clinically meaningful EF-related features that improve EF prediction performance when included alongside structured patient data. We further highlight how differences in target populations in prior EF prediction studies, such as heterogenous inclusion criteria and EF definition, can lead to systematic differences in model performance and hinder generalizability between studies.
96. 【2609.09206】MLLMs Hallucinate when Information Distribution Drifts in Synergy Heads
链接：https://arxiv.org/abs/2609.09206
作者：Meng'en Qin,Junye Chen,Jucheng Liu,Youlu Xing,Song Wang,Ruize Han
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, reliable practical applications
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) often struggle with hallucinations, thus hindering their reliable practical applications. Existing attention-based mitigation methods mainly rely on indirect signals (e.g., attention weights) that fail to accurately reflect the actual information shift underlying hallucination generation. In this paper, we propose HEAL, Head-lEvel information disentAnglement and caLibration for identifying and mitigating hallucinations. HEAL first employs causal noise intervention on multi-head outputs to filter out causally redundant heads. Subsequently, it disentangles information distribution within the remaining heads via the counterfactual Difference-in-Differences, categorizing heads into four types. Through analysis, we observe: hallucinations happen when information distribution drifts away from a healthy equilibrium in synergy heads, not strongly correlated with the quantity or strength of modality-specific heads. Motivated by this insight, HEAL injects dynamic information calibration factors into the value vectors of synergy heads, and actively regulates visual-language dependencies, steering the output distribution towards factual evidence. Extensive experiments demonstrate that HEAL effectively reduces hallucinations across multiple MLLMs, offering a simple and interpretable pathway to enhance model trustworthiness.
97. 【2408.07702】he Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Models
链接：https://arxiv.org/abs/2408.07702
作者：Karime Maamari,Fadhil Abubaker,Daniel Jaroslawicz,Amine Mhedhbi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：crucial step, Schema linking, Schema, linking, Abstract
备注：
点击查看摘要
Abstract:Schema linking is a crucial step in Text-to-SQL pipelines. Its goal is to retrieve the relevant tables and columns of a target database for a user's query while disregarding irrelevant ones. However, imperfect schema linking can often exclude required columns needed for accurate query generation. In this work, we revisit schema linking when using the latest generation of large language models (LLMs). We find empirically that newer models are adept at utilizing relevant schema elements during generation even in the presence of large numbers of irrelevant ones. As such, our Text-to-SQL pipeline entirely forgoes schema linking in cases where the schema fits within the model's context window in order to minimize issues due to filtering required schema elements. Furthermore, instead of filtering contextual information, we highlight techniques such as augmentation, selection, and correction, and adopt them to improve the accuracy of our Text-to-SQL pipeline. Our approach ranks first on the BIRD benchmark achieving an accuracy of 71.83%.
98. 【2609.18565】Variational Quantum Transformer Architecture for Synthetic Language Generation
链接：https://arxiv.org/abs/2609.18565
作者：Julian Hager,Michael Kölle,Gerhard Stenzel,Tobias Rohe,Jonas Stein,Claudia Linnhoff-Popien
类目：Quantum Physics (quant-ph); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：synthetic QNLP sequence, NISQ-compatible quantum transformer, QNLP sequence modelling, compact NISQ-compatible quantum, synthetic QNLP
备注： Accepted for publication in the QNLPAI 2026 proceedings (Springer Lecture Notes in Computer Science, LNCS). 10 pages, including references and appendix, 2 figures
点击查看摘要
Abstract:We propose a compact NISQ-compatible quantum transformer architecture for synthetic QNLP sequence modelling. The model preserves the autoregressive next-token interface of a classical transformer, but replaces attention and feed-forward sublayers with variational quantum encoder blocks, connector circuits, decoder blocks and a direct two-qubit measurement readout. Token contexts are angle-encoded into small quantum registers, processed by parallel variational heads and encoder integration circuits and conditioned through decoder ancillae to produce a distribution over a four-token vocabulary. We evaluate several architecture variants on deterministic and lexicographic grammar-generation tasks against a compact classical transformer baseline. The quantum models are trainable end-to-end and learn nontrivial grammar structure, including perfect deterministic generation in individual runs and high lexicographic validity in the strongest variant. The classical baseline remains more accurate and stable and the quantum models are sensitive to initialization. The contribution is therefore not a claim of quantum advantage, but a concrete architecture and evaluation of transformer-inspired QNLP sequence modelling under near-term quantum constraints.
信息检索
1. 【2609.18459】SEEK: Secure and Efficient Encrypted Keyword Search For Privacy-Preserving Messaging Protocols
链接：https://arxiv.org/abs/2609.18459
作者：Soumyadyuti Ghosh,Michail Maniatakos
类目：Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：preserving end-user privacy, protects sensitive user, sensitive user data, detecting dangerous messages, communication protects sensitive
备注：
点击查看摘要
Abstract:Encrypted communication protects sensitive user data but can facilitate harmful or unlawful exchanges, creating a trade-off between detecting dangerous messages and preserving end-user privacy. To address this, we propose SEEK, a practical and efficient encrypted keyword-search protocol for privacy-preserving messaging that combines homomorphic encryption with secure two-party computation (2PC). SEEK first partitions messages into ciphertext fragments with the minimum sufficient overlap, then homomorphically correlates them using encrypted keyword trapdoors. For long messages, this design can reduce sender-side encryption and upload overhead by up to two orders of magnitude over state-of-the-art baselines. It supports ASCII case-insensitive matching with one fixed-size encrypted trapdoor and one homomorphic multiplication per fragment, yielding up to 5.47x faster correlation computation than the strongest fragmentation-based baselines. SEEK then invokes 2PC-based selected decoding, blinded zero testing, and secure aggregation, revealing only the keyword presence-or-absence bit while hiding the keyword, its length, message contents, match counts, and locations. SEEK achieves 100% accuracy under case variations that result in exact-matching failures, without requiring additional trapdoors or online communication. We further realize SEEK as an end-to-end web and cross-platform mobile application. Prototype evaluation on a weekly messaging history yields an online computation time of 1.92 s per search, demonstrating the practical feasibility and efficiency of SEEK.
2. 【2609.18437】Exploring LLMs and RAG for Plausible and Explainable Material Prediction of Vehicle Components
链接：https://arxiv.org/abs/2609.18437
作者：Frederik Wagner,Annerose Eichel,Sabine Schulte im Walde
类目：Information Retrieval (cs.IR)
关键词：requiring extensive fine-tuning, explain plausible materials, extensive fine-tuning, accurately predict, predict and explain
备注：
点击查看摘要
Abstract:In this work, we explore whether LLMs can accurately predict and explain plausible materials for vehicle components such as brake discs or fuel injectors without requiring extensive fine-tuning. We test and evaluate three approaches: a standard generative LLM baseline, a single-pass Retrieval-Augmented Generation (RAG) approach, and an iterative Chain-of-Verification (CoVe) variant. For retrieval, we rely on publicly available data using a domain-filtered Wikipedia corpus. Since no gold standard exists for this task, we develop a custom web-based annotation tool supporting crucial functions for structured domain expert evaluation. LLM-based generation substantially outperforms prior work, which is not further surpassed by the tested RAG approaches. Our results surface remaining challenges for RAG-based systems: hyperparameter optimization, the availability of high-quality, legally accessible domain corpora, and expert evaluation study design.
3. 【2609.18341】Understanding AI Provider Recommendations in Local Service Markets
链接：https://arxiv.org/abs/2609.18341
作者：Hazem Ibrahim,Yasir Zaki
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：proprietary model, search, model, open-weight model, recommendations
备注： 12 pages, 6 figures
点击查看摘要
Abstract:When someone asks an AI assistant which doctor to see or which firm to trust with their savings, the answer is a referral. We audit AI provider recommendations in four registry-backed service domains across the 100 largest U.S. metropolitan areas, matching every recommendation against the official registry for its domain (Medicare clinician and facility records, and SEC adviser disclosures), under three conditions: an open-weight model, a proprietary model without web search, and the same proprietary model with search. Without search, both models largely fabricate recommendations in the domains the web covers thinly. Only 4% of the open-weight model's recommended doctors and 11% of the proprietary model's match a clinician in the queried city, and the open-weight matches are name coincidences: its matched clinicians are no likelier to be primary-care doctors than names drawn at random from the registry. With search, 64-71% of recommendations in the same domains match a real provider. Search also changes who is recommended. Without it, recommended advisory firms carry SEC misconduct disclosures at 3.6 times the registry base rate, even after adjusting for firm size; with search, significantly below it. Restaurants, where quality and visibility are separately measurable, show a 3-5x review-count premium but a rating premium of at most a tenth of a star. Finally, search largely removes the metro-size penalty: without it, real recommendations concentrate in the largest metros; with it, match rates are similar across metro-size terciles. Whether an AI referral is trustworthy depends strongly on its retrieval configuration rather than on the underlying model alone, yet an answer produced without retrieval often carries no sign that its recommendations were never verified.
4. 【2609.18296】One-Step Retrieval Framework for Real-Time Sponsored Search Ads Using Hierarchical Text Representations
链接：https://arxiv.org/abs/2609.18296
作者：Tongtong Liu,Renyu Zhang,Jiayu Ding,Hongchao Guo,Xintao Yang,He Wei,Zhaoyu Li,Haiyang Wu
类目：Information Retrieval (cs.IR)
关键词：multi-stage cascading architectures, Traditional retrieval systems, retrieval systems typically, cascading architectures, optimized independently
备注：
点击查看摘要
Abstract:Traditional retrieval systems typically use multi-stage cascading architectures (MCA), where each module is optimized independently, leading to inconsistent objectives and the premature elimination of high-potential candidates. Recent LLM-based generation methods offer end-to-end solutions but use discrete semantic identifiers (SIDs) to retrieve ads, which are not learned by the base LLM and require memorization of numerous SID-to-ad mappings during SFT, suffering from limited generalization to unseen ads, high maintenance and update costs. The one-to-one mapping between SIDs and advertisements leads to inefficient decoding. Moreover, these methods rely on a small reward model (e.g. pctr) for relevance and ranking, limiting the LLM's ability to fully assess ads' commercial value. To address these challenges, we propose A uNified Generation-discriminative-ranking reaL-time rEtrieval (ANGLE) framework. ANGLE uses LLM-generated hierarchical textual representations, which consist of commercial intent that provide high-level overviews and ad abstract that deliver fine-grained details. Additionally, ANGLE integrates retrieval, relevance, and ranking directly within a single LLM, enabling precise and efficient ranking of ads by leveraging the full capabilities of the LLM. We applied ANGLE to the real-world search scenarios, achieving a 1.81% increase in consumption and a 2.16% increase in gross merchandise volume (GMV). We also conducted offline evaluations of ANGLE and seven baselines, with ANGLE outperforming all across key metrics such as HR and ACR.
5. 【2609.18248】Quanta: A Self-Contained Python Library for Hybrid Retrieval over Quantised Embeddings, Lexical Indexes, and Knowledge Graphs
链接：https://arxiv.org/abs/2609.18248
作者：Ioannis E. Livieris
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：independently operated systems, approximate nearest-neighbour index, advanced retrieval-augmented generation, retrieval-augmented generation pipeline, relational document store
备注：
点击查看摘要
Abstract:An advanced retrieval-augmented generation pipeline is typically assembled from three or four independently operated systems: an approximate nearest-neighbour index, a full-text search engine, a graph database, and a relational document store. Each contributes its own deployment surface, configuration model, and failure modes, and the integration logic that binds them is written anew in every project. In this work, we present \textsc{Quanta}, an open-source Python library, which unifies dense vector search over 4-bit quantised embeddings, BM25 full-text retrieval, and knowledge-graph traversal behind a single retrieval API. Quanta makes two design commitments, which distinguish it from existing hybrid retrieval stacks. First, signals are combined by \emph{weighted reciprocal rank fusion} rather than by normalising heterogeneous scores onto a shared range, which we argue is ill-posed because such normalisations are query-dependent. Second, the graph is a \emph{candidate expander and not a relevance scorer}: traversal widens the candidate pool, and the newly admitted documents are re-scored by the dense indexes under an identifier allowlist, so structural adjacency determines what is considered while content evidence determines how it ranks.
6. 【2609.18188】Single-Token Expected-Value Scoring for Cold-Start Candidate Ranking
链接：https://arxiv.org/abs/2609.18188
作者：Qihang Wang,Jinwei Tan,Mengyuan Shi,Mayank Sharma,Shuai Zhao,Fuxian Li,Ryan Yan,Alexander P. Kreuzer,Mohit Jain,Dheeraj Toshniwal,Manoj Seethamsetty(Indeed Inc.)
类目：Information Retrieval (cs.IR)
关键词：streamlines candidate review, AI-assisted sourcing streamlines, sourcing streamlines candidate, Large Language Models, candidate review
备注： 10 pages, 7 figures. Accepted at RecSys in HR '26: The 6th Workshop on Recommender Systems for Human Resources, in conjunction with the 20th ACM Conference on Recommender Systems (RecSys 2026), September 28 - October 2, 2026, Minneapolis, MN, USA. To appear in CEUR Workshop Proceedings
点击查看摘要
Abstract:AI-assisted sourcing streamlines candidate review, reducing the administrative burden of manual screening for recruiters. However, deploying language models as production rankers remains challenging. Zero-shot Large Language Models (LLMs) may produce unstable, non-deterministic scores and rank less accurately, while conventional deep neural rankers require millions of logged interactions that a low-traffic, niche sourcing platform does not produce. What is available instead is a few hundred thousand ordinal relevance labels -- small by ranker-training standards, but sufficient when a pretrained language model already encodes the general world knowledge the task depends on. We present single-token expected-value scoring, a ranking primitive that casts candidate-job relevance as an ordinal classification over the grade tokens {1, ..., 5} and reads the relevance score as the expectation of the first-token probability distribution. Because the score comes from a single decoding step rather than open-ended generation, it is a deterministic function of the model's logits, requires no output parsing, and serves at low latency. To learn the non-linear interdependencies of heterogeneous hiring criteria from this supervision alone, we fine-tune a Small Language Model (SLM) with a hybrid ordinal regression loss combining a Mean Squared Error term, which preserves ordinal distance, with a categorical Cross-Entropy term, which sharpens class boundaries. We evaluate along two dimensions -- Jobseeker Relevance and Employer Relevance -- using NDCG@10 and low relevance rate. Offline, our fine-tuned model outperforms a heuristic baseline and zero-shot LLMs. An end-to-end simulation shows the same direction at larger magnitude (+54.2% Jobseeker NDCG@10, -46.7% low relevance rate), and a live online experiment reduces employer low-relevance by 27.3% and raises employer keep rate by 7.07%.
Comments:
10 pages, 7 figures. Accepted at RecSys in HR '26: The 6th Workshop on Recommender Systems for Human Resources, in conjunction with the 20th ACM Conference on Recommender Systems (RecSys 2026), September 28 - October 2, 2026, Minneapolis, MN, USA. To appear in CEUR Workshop Proceedings
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2609.18188 [cs.IR]
(or
arXiv:2609.18188v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2609.18188
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
7. 【2609.18163】me-Aligned Evolving Concept Graphs for Scientific Relation Forecasting
链接：https://arxiv.org/abs/2609.18163
作者：Fred Sun,Jingze Wang,Minkun Xu,Shangqi Guo
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Forecasting scientific relations, identifying promising connections, Forecasting scientific, guide discovery, discovery by identifying
备注：
点击查看摘要
Abstract:Forecasting scientific relations can guide discovery by identifying promising connections before they emerge. Existing approaches often model concept semantics and graph structure separately or summarize semantics over coarse historical snapshots, leaving semantic representations potentially misaligned with rapidly evolving graph evidence. We propose a time-aligned evolving concept graph framework that jointly models semantic and structural evolution. Its core idea is to treat dated papers as shared update events, reconstructing semantic and structural states from the same publication history through each prediction time. Pair-level fusion combines these states to forecast first co-occurrence, relation formation, and conditional relation type. Holding architecture and training fixed, refreshing context alongside graph updates improves mean relation AUPRC by 16.6% over frozen context. On a graph built from 187,848 papers with 270,687 concepts and 7.45 million co-occurrence links, the complete framework improves mean relation AUROC from 0.9290 for the strongest evaluated baseline to 0.9722, with mean population-weighted AUPRC 0.005778.
8. 【2609.18154】PageRecall: Measuring Page Selection in Literature-Grounded Question Answering
链接：https://arxiv.org/abs/2609.18154
作者：Aaditya Chauhan
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：answer lives, page, retrieve the relevant, requested format, table or figure
备注： Accepted at the 1st Workshop on Grounding Language Models (GroundLM 2026), co-located with EMNLP 2026. 9 pages. System description for the LitTraceQA shared task (team Everest)
点击查看摘要
Abstract:We describe our system for LitTraceQA (GroundLM @ EMNLP 2026): given a research question, retrieve the relevant papers from a pool of 27,487, cite the page and the table or figure where the answer lives, and answer in a requested format. Our main finding is that evidence grounding is limited by retrieval, not by reading. The page selector put the annotator's page, which we call the gold page, in front of the model that locates evidence only about half the time (52.6% gold-page recall), while that model, given the page, cited the right one in 45 of the 48 locators it emitted (94%). When the page was missing it rarely said so: of 45 such cases it returned nothing 14 times, a wrong page 24 times, and a correct page 7 times, so the pipeline failed quietly almost twice as often as it failed visibly. Since the failure was that the right page was never shown, the fix is to stop choosing: each retrieved paper fits in the model's context, so we show it whole. Page ranking survives only as a fallback inside papers too long to fit, which no test-split paper was, and gold-page recall reaches 100% on the papers we can parse. Separately, questions that identify their target by position rather than content, such as "the first author of the 24th reference", are served by parsing rather than retrieval: we resolve the bibliography into an addressable list, which also supplies identifiers the evidence metric scores. The final system scores 0.762 paper $F_1$, 0.441 evidence $F_1$ and 0.920 multiple-choice accuracy on the held-out test split. Because the pipeline depends on a closed model without seed control, we release a harness that verifies the paper's central claims against committed artifacts.
9. 【2609.18148】LIGE-GR: A Smooth Leap from Ranking to Generative Recommendation in the LLM Era
链接：https://arxiv.org/abs/2609.18148
作者：Venkat Srinivas,Chenzhang He,Sam Woodmansee,Shawn Lian,Wenjie Hu,Renjie Jiang,Ziheng Huang,Xinyuan Zhang,Zhihao Zheng,Zhuoran Yu,Rui Li,Lei Yuan,Ziwei Li,Jimmy Jia,Mert Terzihan,Ekrem Kocaguneli,Yiming Liao,Zhichen Zhao,Yue Yin,Yue Weng,Wanlin Ma,Xufeng Cai,Weimiao Wu,Yezhou Huang,Du Zhang,Yukun Ding,Aaron Johnston,Yueming Wang,Zhaojie Gong,Yuting Zhang,Serena Li,Adithya Ganesh,Boying Liu,Haichuan Yang,Xialu Li,Matt Ma,Qunshu Zhang,John Joshua Miller,Praveen Rathinavelu,Cheng Huang,Aadhar Sachdeva,Josh Karns,Andres Aaron Gutierrez,Neil Agarwal,Gustas Pladis,Vladimir Batygin,Gopal Ray,Aditya Priyadarshi,Shantanu Patil,Zhe Wang,Penny Pan,Yiping Han,Arun Singh,Guangdeng Liao,Bi Xue,Xinyao Hu,Yang Song,Yisong Song,Meihong Wang,Haotian Wu,Deepak Agarwal,Ji Liu
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：provided important inspiration, remarkable success, success of large, provided important, important inspiration
备注：
点击查看摘要
Abstract:The remarkable success of large language models (LLMs) has provided important inspiration for the next generation of recommender systems. Structurally, recommendation and language generation share a similarity: both aim to produce an ordered sequence that optimizes the user's experience. However, how to precisely absorb the essence of the LLM paradigm into mature industrial recommender systems remains an open problem. There are two challenges. First, it is unclear how to incorporate sequence-level generation and optimization from the LLM paradigm into recommendation. Second, real-world recommender systems are mature systems that have been iteratively customized for years around specific products, business constraints, serving infrastructure, and organizational ownership. Replacing such systems wholesale is often technically risky and organizationally disruptive. In this paper, we propose LIGE-GR, a listwise generation and evaluation recommendation framework that upgrades from a traditional ranking system based on itemwise recommendation toward a generative recommendation paradigm. Instead of rebuilding the entire recommendation stack from scratch, LIGE-GR generalizes the existing pointwise recommendation system into a listwise generation system. This allows mature recommender systems to benefit from listwise optimization while preserving compatibility with existing models, value functions, and serving infrastructure. We validate LIGE-GR in short-video recommendation on Instagram Reels and Facebook Video. On these recommendation surfaces, LIGE-GR improves time spent by 1.14 percent on Instagram Reels and 0.72 percent on Facebook Video, while requiring only modest additional inference resources.
Subjects:
Machine Learning (cs.LG); Information Retrieval (cs.IR)
Cite as:
arXiv:2609.18148 [cs.LG]
(or
arXiv:2609.18148v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2609.18148
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Shawn Lian [view email] [v1]
Wed, 16 Sep 2026 05:28:52 UTC (6,965 KB)
10. 【2609.18042】DUPAR: Dual-Path Conversational Retrieval via Speech Retriever with Cross-Turn Evidence Caching
链接：https://arxiv.org/abs/2609.18042
作者：Yuanjun Li,Yiwen Liu,Dapeng Li,Zhiwei Xu,Bin Zhang,Shengtao Zhang,Rong Shen
类目：Information Retrieval (cs.IR)
关键词：Voice assistants grounded, Voice assistants, transcribe speech queries, external knowledge typically, automatic speech recognition
备注： 5 pages, 4 figures
点击查看摘要
Abstract:Voice assistants grounded in external knowledge typically use automatic speech recognition (ASR) to transcribe speech queries before retrieving evidence from textual knowledge bases. This cascade adds latency and propagates recognition errors, whereas direct speech retrieval is vulnerable to cross-modal misalignment. To address these limitations, we propose DUPAR, a conversational retrieval framework with complementary slow and fast paths. The fast path uses a task-adapted audio encoder aligned with frozen BGE-M3 text embeddings to search a cross-turn evidence cache. When cache confidence is insufficient, the slow path fuses full-index retrieval using audio and ASR-transcript embeddings, and the selected evidence refreshes the next-turn evidence cache through one-hop graph expansion. On a domain-specific knowledge base, our trained audio encoder approaches text-retrieval accuracy on clean speech with a 3.75$\times$ query-side speedup over ASR + Text Encoder. It raises average Recall@10 from 0.771 to 0.875 on the noise benchmark and improves overall Recall@1 by 4.2 percentage points across synthesized speaking styles. Compared with full-index audio retrieval, cross-turn evidence caching significantly reduces retrieval errors when the previous turn retrieves correct evidence and the follow-up targets a one-hop neighboring chunk.
11. 【2609.17639】Scaling Articulated Rationales for MLLM-based Recommendation
链接：https://arxiv.org/abs/2609.17639
作者：Haoke Xiao,Yueyang Liu,Yuhui Zhang,Xiang Chen,Yufei Liu,Jia Xu,Yalong Guan,Xiaolan Zhu,Xiaoyu Zhang,Shijun Wang,Shuang Yang,Zijie Meng,Zejian Zhang,Ruochen Yang,Xiangyu Wu,Tingting Gao,Han Li,Lantao Hu,Cheng Luo,Kun Gai
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Modern recommendation systems, largely infer user, systems largely infer, infer user preferences, Modern recommendation
备注：
点击查看摘要
Abstract:Modern recommendation systems largely infer user preferences from implicit behaviors such as clicks, watch time, and negative feedback, but these signals reveal what users do rather than why they like or dislike content. This work studies articulated user rationales (AURs), i.e., users' natural-language explanations of their preferences, as a new class of polarity-aware and reason-level textual signals for recommendation. Despite their potential value, AURs are difficult to use in industrial systems because they are naturally sparse, often low-quality, and only cover a small fraction of items. We present SARA (Scaling Articulated Rationales), an industrial framework that turns sparse AURs into scalable recommendation signals. SARA first builds a data engine that elicits and curates AURs from 240M Kuaishou Live users, producing SARA-HQ, a quality-controlled and author-centric rationale dataset. It then aligns a general-purpose MLLM into SARA-7B through large-scale SFT and Quality-Refining DPO, extending rationale generation from 86,564 AUR-covered authors to the full 10M-author space. Finally, SARA-Ranker integrates the generated positive and negative rationales into production ranking via rationale-aware interaction modeling and rejection-memory modeling. Extensive offline evaluation, human calibration, and online A/B tests show that SARA-7B generates more specific, polarity-consistent, and grounded rationales than strong MLLM baselines, while SARA-Ranker improves engagement and reduces negative feedback in production. Deployed with daily refresh for over 30 days, SARA establishes articulated rationales as a practical, first-class textual signal for industrial recommendation systems.
12. 【2609.17564】Beyond Static RAG: An Adaptive, Tri-Metric Routing Framework for Efficient Long-Context Inference on Commodity GPUs
链接：https://arxiv.org/abs/2609.17564
作者：Saipraveen Vabbilisetty,Ajay Kumar Boddepalli,Deep Narayan Mishra,Shashank Kapadia,Haoan Wang,Anupriya Sharma
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：Deploying retrieval-augmented generation, outweigh generation-time savings, neural prompt compression, Deploying retrieval-augmented, practical failure mode
备注： This Paper is accepted and presented at ICML Scale Workshop 2026. [this https URL](https://scale-icml-2026.github.io/accepted_papers.html) (Paper ID :72)
点击查看摘要
Abstract:Deploying retrieval-augmented generation (RAG) on commodity GPUs such as the NVIDIA T4 (16 GB VRAM) exposes a practical failure mode we call the Compression Paradox: neural prompt compression can add key-value (KV) cache contention and preprocessing latency that outweigh generation-time savings, while skipping compression can cause out-of-memory (OOM) failures on long contexts. We identify two distinct failure mechanisms when a vLLM-served LLM and a PyTorch-based compressor are co-deployed under tight memory budgets, and introduce the Tri-Metric Router, a deterministic, training-free policy that selects among Raw, Neural (LLMLingua-2), and Lexical (BM25) pipelines. The router uses three CPU-side signals: spatial complexity ($L$), syntactic density ($\rho_{key}$), and type-token ratio (TTR). Unlike prior semantic-only adaptation, our dispatch signal is hardware-physical, based on VRAM headroom and a latency crossover point. Thresholds are calibrated from profiling on LongBench qasper, yielding an operating crossover near 4,332 words on T4; our contribution is this calibration methodology rather than a hardware-specific constant. On out-of-distribution holdouts, the method achieves 0% OOM failures, 88.5 $\pm$ 4.4% oracle alignment, and 49.3% Combined F1, improving over always-on lexical compression by 5.2 points without additional VRAM or training cost.
13. 【2510.04816】On Predicting Post-Click Conversion Rate via Counterfactual Inference
链接：https://arxiv.org/abs/2510.04816
作者：Junhyung Ahn,Sanghack Lee
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Accurately predicting conversion, Accurately predicting, predicting conversion rate, online advertising systems, recommendation domains
备注： This work has been accepted for publication at the IEEE International Conference on Data Mining (ICDM) 2025
点击查看摘要
Abstract:Accurately predicting conversion rate (CVR) is essential in various recommendation domains such as online advertising systems and e-commerce. These systems utilize user interaction logs, which consist of exposures, clicks, and conversions. CVR prediction models are typically trained solely based on clicked samples, as conversions can only be determined following clicks. However, the sparsity of clicked instances necessitates the collection of a substantial amount of logs for effective model training. Recent works address this issue by devising frameworks that leverage non-clicked samples. While these frameworks aim to reduce biases caused by the discrepancy between clicked and non-clicked samples, they often rely on heuristics. Against this background, we propose a method to counterfactually generate conversion labels for non-clicked samples by using causality as a guiding principle, attempting to answer the question, "Would the user have converted if he or she had clicked the recommended item?" Our approach is named the Entire Space Counterfactual Inference Multi-task Model (ESCIM). We initially train a structural causal model (SCM) of user sequential behaviors and conduct a hypothetical intervention (i.e., click) on non-clicked items to infer counterfactual CVRs. We then introduce several approaches to transform predicted counterfactual CVRs into binary counterfactual conversion labels for the non-clicked samples. Finally, the generated samples are incorporated into the training process. Extensive experiments on public datasets illustrate the superiority of the proposed algorithm. Online A/B testing further empirically validates the effectiveness of our proposed algorithm in real-world scenarios. In addition, we demonstrate the improved performance of the proposed method on latent conversion data, showcasing its robustness and superior generalization capabilities.
14. 【2408.07702】he Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Models
链接：https://arxiv.org/abs/2408.07702
作者：Karime Maamari,Fadhil Abubaker,Daniel Jaroslawicz,Amine Mhedhbi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：crucial step, Schema linking, Schema, linking, Abstract
备注：
点击查看摘要
Abstract:Schema linking is a crucial step in Text-to-SQL pipelines. Its goal is to retrieve the relevant tables and columns of a target database for a user's query while disregarding irrelevant ones. However, imperfect schema linking can often exclude required columns needed for accurate query generation. In this work, we revisit schema linking when using the latest generation of large language models (LLMs). We find empirically that newer models are adept at utilizing relevant schema elements during generation even in the presence of large numbers of irrelevant ones. As such, our Text-to-SQL pipeline entirely forgoes schema linking in cases where the schema fits within the model's context window in order to minimize issues due to filtering required schema elements. Furthermore, instead of filtering contextual information, we highlight techniques such as augmentation, selection, and correction, and adopt them to improve the accuracy of our Text-to-SQL pipeline. Our approach ranks first on the BIRD benchmark achieving an accuracy of 71.83%.
计算机视觉
1. 【2609.19143】PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection
链接：https://arxiv.org/abs/2609.19143
作者：Sara Pieri,Evangelos Kazakos,Shizhe Chen,Josef Sivic,Cordelia Schmid
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Intelligent systems, world require image, require image understanding, systems that act, comprehensive and spatially
备注：
点击查看摘要
Abstract:Intelligent systems that act in the world require image understanding that is both comprehensive and spatially grounded. Current vision-language models (VLMs) can generate fluent and detailed image captions, but reliably associating them with image pixels remains challenging. Existing methods that combine dense captioning with pixel-level grounding often produce either incomplete descriptions or inaccurate segmentation masks. We study this problem through panoptic grounded captioning, a task that requires a VLM to describe both foreground objects and background regions while grounding each referring phrase with pixel-level masks. We make three contributions. First, we introduce PanoCaps, a human-annotated benchmark constructed from panoptic segmentation datasets. It provides dense captions with near-complete pixel coverage and image-text alignments at the entity level, supporting both training and evaluation. We further propose a phrase-mask matching protocol and a generalized Panoptic Quality (gPQ) metric that jointly evaluates textual and mask agreement. Second, we formulate phrase grounding as selection from a phrase-conditioned pool of mask proposals and introduce PANORAMA, a VLM that conditions a pretrained segmenter on contextualized phrase representations to obtain candidate masks and learns to select those corresponding to each phrase. Training this interface jointly with caption generation enables PANORAMA to produce high-quality masks while allowing each phrase to refer to a single region or multiple instances. Third, PANORAMA achieves the best overall grounding on PanoCaps and matches or exceeds specialized models across several pixel-level grounding tasks. Experiments show that our method produces precise entity-level segmentations while maintaining detailed, mask-consistent captions. Code, data and models are available at this https URL.
2. 【2609.19142】PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics
链接：https://arxiv.org/abs/2609.19142
作者：Bardienus P. Duisterhof,Kaifeng Zhang,Adam Hung,Bowen Wen,Stan Birchfield,Yunzhu Li,Deva Ramanan,Jeffrey Ichnowski
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：World models endow, models endow perceptual, endow perceptual systems, World models, evolve under interaction
备注： [this https URL](https://pointzero-wm.github.io/)
点击查看摘要
Abstract:World models endow perceptual systems with the ability to predict how scenes evolve under interaction. They are most beneficial when trained on diverse volumes of data, to instill a rich prior into downstream applications. Existing methods typically require robot action labels to learn action-conditioned 3D dynamics, which excludes web video data from the training pool. We study 3D point track completion as a pre-training objective for learning transferable 3D dynamics without robot data. Given a single RGB-D observation and sparse partial 3D trajectories (tracks), we predict future 3D tracks of all observed points. We show this objective produces a rich 3D dynamics prior, without requiring robot action labels. We contribute a diverse dataset of 2.9 million synthetic frames spanning deformable, articulated, and rigid objects, and use it to train PointZero. We show that a flexible and expressive transformer, PointZero, outperforms prior methods on the same data. We demonstrate the utility of our pre-training objective by post-training PointZero for two downstream applications: (1) action-conditioned 3D dynamics prediction and (2) imitation learning. When fine-tuned to condition on end-effector pose, PointZero outperforms the baselines on the recent PGND 3D dynamics benchmark. When fine-tuned to predict robot actions and 3D tracks, PointZero outperforms or matches the baselines on 6/7 simulated and real-world robot manipulation tasks. We furthermore evaluate training PointZero from scratch to isolate the benefits of our proposed architecture from those of our proposed pre-training objective and dataset. We release the dataset, checkpoints, and full training recipe.
3. 【2609.19138】In-Context Robot Learning with VLM Agents
链接：https://arxiv.org/abs/2609.19138
作者：Dongzhou Cheng,Taoran Yi,Ye Fang,Xingwu Zhang,Fan Feng,Yixuan Li,Gengxiong Zhuang,Rongze Wang,Shuai Yang,Wei Song,Weizhi Xue,Minyan Wu,Jie Gui,Jiaqi Wang,Tong Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Enabling robots, adapt to unfamiliar, unfamiliar environments, environments as readily, moonshot goal
备注： Project Page: [this https URL](https://cheng-haha.github.io/GPT-Policy) GitHub Code: [this https URL](https://github.com/cheng-haha/GPT-Policy)
点击查看摘要
Abstract:Enabling robots to adapt to unfamiliar environments as readily as humans remains a moonshot goal of embodied AI. No finite collection of demonstrations can cover every task and situation a robot will encounter, making the ability to learn from context at deployment essential for generalization. Such in-context learning (ICL), however, remains largely beyond the reach of existing robotic policies. The broad agentic capabilities of commercial vision-language models (VLMs), such as GPT-6 Astra, raise a compelling question: can these models learn from demonstrations, examples, and interaction feedback, then translate that information into executable and verifiable robot behavior from a new initial state without gradient updates or persistent changes to task-specific parameters? We introduce GPT-Policy, a general-agent framework for in-context robot learning. GPT-Policy integrates a context compiler that preserves task-relevant visual transitions, a VLM that proposes robot-tool actions, and a constrained controller that verifies and executes each action and reports its outcome. We evaluate its reliability and limitations through task success and efficiency metrics, matched comparisons across models, and controlled context ablations. In real-robot trials, human video demonstrations improve task completion even without robot action labels, while aligned action references yield further gains on contact-sensitive tasks. These findings position GPT-Policy as a step toward robot adaptation through in-context learning, providing an empirical foundation for translating the general-purpose capabilities of VLMs into physical behavior and clarifying the challenges that must be overcome for reliable deployment.
4. 【2609.19122】Adaptive Convolutional Sparse Coding via Information Bottleneck for Robust Visual Signal Representation
链接：https://arxiv.org/abs/2609.19122
作者：Meng'en Qin,Yinchen Liu,Mingxuan Cui,Youlu Xing
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：robust downstream prediction, Visual signals require, robust visual signal, Convolutional sparse coding, signals require compact
备注：
点击查看摘要
Abstract:Visual signals require compact yet sufficient representations for robust downstream prediction. Convolutional sparse coding (CSC) provides an explicit mechanism for suppressing redundant components while preserving signal content, but its sparsity coefficient is typically fixed and manually selected. We propose an adaptive convolutional sparse coding framework for robust visual signal representation. Specifically, we unfold the CSC optimization with the Fast Iterative Shrinkage-Thresholding Algorithm (FISTA) and treat the sparsity coefficient as a differentiable variable jointly learned with the network parameters. From the information bottleneck perspective, this coefficient controls the trade-off between information retention and compression: the sparsity term promotes compact representations, while the reconstruction term together with task loss preserves task-relevant signal content. We further introduce a label-free post-training strategy that adjusts the compression strength for corrupted inputs with the main network parameters fixed. Experiments on CIFAR and ImageNet demonstrate competitive clean-data recognition and greatly improved robustness under different input perturbations.
5. 【2609.19119】rack, Articulate, Act: Generating Articulation from Casual Human Videos
链接：https://arxiv.org/abs/2609.19119
作者：Jiaming Zhang,Homanga Bharadhwaj
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：rich causal evidence, rich causal, causal evidence, produces task-relevant, motion induces object
备注： Preprint. Under Review
点击查看摘要
Abstract:Human videos contain rich causal evidence for robot manipulation: they reveal how hand motion induces object motion and produces task-relevant changes in object state. In this work, we study articulated objects such as doors, drawers, cabinets, laptops, ovens, and hinged containers that are ubiquitous in daily life and present unique challenges for embodied interaction. These objects cannot be represented by a single pose; their motion depends on the underlying parts and joints. We introduce a real-to-sim framework that reconstructs a simulation-ready articulated object and hand-object interaction from a casual monocular RGB video, without RGB-D or multi-view input, prior scans, manually specified joints, or robot demonstrations. Our key insight is that dense 3D point tracks provide an embodiment-agnostic articulation cue: points on the fixed link remain approximately stationary, while points on the moving link follow coherent revolute or prismatic motion. Our method segments the links, estimates the joint and its state trajectory, reconstructs an articulated asset, and aligns the recovered 3D hand motion with the object. Central to our approach is a modular recipe that repurposes powerful pretrained models for single-image 3D reconstruction, mesh segmentation, and 3D scene flow, connecting their predictions through explicit geometric reasoning to infer articulation. We use the reconstructed articulated object and the human hand trajectory to replay interactions through contact in MuJoCo. The framework shows how pretrained vision models and explicit motion reasoning can turn casual human videos into articulated object models suitable for downstream embodied interactions. this https URL
6. 【2609.19088】MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education
链接：https://arxiv.org/abs/2609.19088
作者：Luyao Zhu,Xun Wei Yee,Wei Li,Mun Thye Mak,Wee Siong Ng
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：remain insufficiently evaluated, achieved remarkable progress, settings remain insufficiently, educational settings remain, Large vision-language models
备注：
点击查看摘要
Abstract:Large vision-language models have achieved remarkable progress in multi-modal understanding, yet their capabilities in educational settings remain insufficiently evaluated. In AI-assisted language learning, models must interpret artistic imagery, understand its semantic, affective, and cultural content, and reason about visual context to support meaningful interaction. However, existing benchmarks primarily focus on real-world images or domain-specific educational reasoning, providing limited coverage of artistic educational content. To address this gap, we introduce MUSE, a benchmark for evaluating large vision-language models on artistic image understanding in situated educational applications. MUSE decouples image annotation from question generation, enabling diverse tasks with controllable difficulty while reducing annotation effort. It comprises twelve tasks spanning visual perception, semantic and affective interpretation, culture understanding, and compositional reasoning, together with diverse artistic images deliberately curated to center Singaporean and Southeast Asian multicultural contexts alongside Western art traditions, covering multiple themes and difficulty levels. Evaluation of open-source and proprietary models reveals substantial disparities across capability dimensions, particularly in affective interpretation and compositional reasoning. Our analysis further identifies common failure modes and key challenges for developing trustworthy multi-modal models for education. We hope MUSE will serve as a standardized benchmark for advancing multi-modal understanding in situated educational applications.
7. 【2609.19010】abular Deep Learning vs Classical Machine Learning for Urban Land Cover Classification
链接：https://arxiv.org/abs/2609.19010
作者：Muntasir Tabasum,Tanpia Tasnim,Md. Ekramul Islam,Al Zadid Sultan Bin Habib
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Machine Learning Repository, environmental monitoring, UCI Machine Learning, Urban Land Cover, classification plays
备注： Published in NeurIPS 2025 The 5th Muslims In ML (MusIML) Workshop
点击查看摘要
Abstract:Urban Land Cover (ULC) classification plays a crucial role in urban planning, environmental monitoring, and sustainable development. We study this task using the ULC dataset from the UCI Machine Learning Repository, which includes tabular features derived from high-resolution aerial imagery across nine classes (e.g., roads, trees, grass, water). The dataset presents typical remote sensing challenges, including high dimensionality, heterogeneous features, and class imbalance. In a unified, reproducible pipeline, we benchmark classical machine learning models (e.g., Logistic Regression, SVM, Random Forest, XGBoost, CatBoost) against Tabular Deep Learning (TDL) models (TabNet, FT-Transformer, TabTransformer, TabSeq, and 1D CNNs). To address class imbalance, we employ weighted cross-entropy loss for TDL models and evaluate performance using accuracy, macro-precision, macro-recall, macro-F1, AUC-ROC, and confusion matrices. Our results show that while tree ensembles remain strong general baselines, TDL models can match or exceed their performance when non-linear interactions are significant and imbalance handling is effective, providing complementary advantages for urban land cover mapping. See code: this https URL
8. 【2609.18980】Instrument Classification of Solo Sheet Music Images
链接：https://arxiv.org/abs/2609.18980
作者：Kevin Ji,Daniel Yang,TJ Tsai
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD)
关键词：sheet music, sheet music images, paper studies instrument, solo sheet music, sheet music image
备注： Published at ICASSP 2021
点击查看摘要
Abstract:This paper studies instrument classification of solo sheet music. Whereas previous work has focused on instrument recognition in audio data, we instead approach the instrument classification problem using raw sheet music images. Our approach first converts the sheet music image into a sequence of musical "words" based on the bootleg score representation, and then treats the problem as a text classification task. We show that it is possible to significantly improve classifier performance by training a language model on unlabeled data, initializing a classifier with the pretrained language model weights, and then finetuning the classifier on labeled data. In this work, we train AWD-LSTM, GPT-2, and RoBERTa models on solo sheet music images from IMSLP for eight different instruments. We find that GPT-2 and RoBERTa slightly outperform AWD-LSTM, and that pretraining increases classification accuracy for RoBERTa from 34.5% to 42.9%. Furthermore, we propose two data augmentation methods that increase classification accuracy for RoBERTa by an additional 15%.
9. 【2609.18971】LaSeD: Label-Semantic Self-Distillation for Visual-Only Surgical Phase Recognition
链接：https://arxiv.org/abs/2609.18971
作者：Ye Tao,Claudia Scherl,Sara Monji-Azad
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：supporting context-aware assistance, phase recognition maps, Surgical phase recognition, clinically meaningful workflow, supporting context-aware
备注：
点击查看摘要
Abstract:Surgical phase recognition maps each video frame to a clinically meaningful workflow phase, supporting context-aware assistance, documentation, and postoperative analysis. Most methods treat phase annotations only as class IDs, whereas recent surgical vision-language models often require additional video--text data, captions, or instruction tuning. We propose \emph{LaSeD}, a label-semantic self-distillation framework that uses phase names as privileged training-time context while retaining visual-only deployment without a ground-truth phase-name hint. LaSeD initializes a frozen teacher and a student from the same pretrained VLM checkpoint. The teacher receives the frame, a fixed task prompt, and the ground-truth phase-name hint; the student receives the same frame and prompt without the hint, and only its visual encoder is optimized. Training combines hard phase-token supervision with feature-level distillation from cached teacher representations. At inference, the teacher and hint are removed, and the student predicts one of the seven Cholec80 phases through constrained digit-token logits without an additional classifier head. On the Cholec80 evaluation split, LaSeD achieves 86.20\% accuracy, 77.75\% macro recall, 78.13\% macro precision, and 64.15\% macro Jaccard. Under the identical protocol, it improves a visual-only Qwen3-VL-4B baseline by 9.45, 9.42, 11.93, and 12.22 percentage points, respectively. Visual-only means that the image is the only sample-specific inference input, while all frames share the same fixed task prompt. These results suggest that phase names provide a useful low-cost signal for adapting VLMs to surgical workflow analysis. (The code will be published soon.)
10. 【2609.18955】KDTwin: Task-Aware Knowledge Distillation for Lightweight Multi-Task Driving Scene Segmentation
链接：https://arxiv.org/abs/2609.18955
作者：Huy Che,Minh-Khoi Do,Dinh-Duy Phan,Duc-Khai Lam
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Efficient perception models, Efficient perception, carefully balanced, essential for real-time, accuracy and computational
备注：
点击查看摘要
Abstract:Efficient perception models are essential for real-time autonomous driving, where accuracy and computational cost must be carefully balanced. However, applying knowledge distillation to multi-task driving scene segmentation is challenging because drivable-area and lane segmentation exhibit different spatial characteristics and class imbalance. We propose KDTwin, a task-aware distillation framework for lightweight multi-task segmentation networks. The proposed method performs distillation at both the shared encoder and task-specific decoders. Encoder-level pairwise distillation transfers spatial relational knowledge to enhance the student's shared representation. For the decoders, we use a weighted loss for drivable-area segmentation and a boundary-aware loss for lane segmentation, enabling task-adaptive knowledge transfer without increasing inference complexity. Experiments on BDD100K show consistent improvements across the evaluated CNN-based and Transformer-based student models without increasing inference-time parameters or FLOPs. The results show that designing distillation objectives according to task-specific characteristics can effectively enhance multi-task segmentation performance for autonomous driving. The source code is available at this https URL.
11. 【2609.18952】Automated Dental Caries Segmentation in Panoramic Radiographs Using Dual-Stage Deep Learning
链接：https://arxiv.org/abs/2609.18952
作者：Jihun Kim,Kyeonghun Kim,Jong-yeol Lee,Yeongseok Seo,Dohyun Chun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remains challenging due, caries remains challenging, Early detection, posterior teeth, remains challenging
备注： 10 pages, 6 figures, 3 tables. Accepted at the Workshop on Machine Learning in Medical Imaging, MLMI 2025, held in conjunction with MICCAI 2025
点击查看摘要
Abstract:Early detection of dental caries remains challenging due to limitations in traditional diagnostic methods, particularly for proximal lesions in posterior teeth. Deep learning models show promise for automated caries detection but face scalability constraints due to requirements for large volumes of expertly annotated training data. This study presents a dual-stage deep learning framework combining Faster R-CNN for tooth localization with U-Net for pixel-wise caries segmentation in panoramic radiographs. We developed a systematic transformation pipeline to convert large-scale polygon-annotated datasets into high-resolution binary segmentation masks, enabling pixel-wise supervised learning. The framework was trained using both expert-verified datasets and algorithmically processed labels from 3,000 panoramic images. Our approach achieved robust performance with an IoU of 0.9013, Dice coefficient of 0.9482, Recall of 0.9433, and Precision of 0.9774, demonstrating superior accuracy compared to existing methods while significantly reducing false-positive rates. The dual-stage framework effectively addresses data annotation bottlenecks in dental AI applications and demonstrates potential for scalable, automated caries detection systems that can improve diagnostic consistency and support clinical decision-making.
12. 【2609.18943】Dose-Aware Cold Diffusion with Physics Consistency for Generalizable Low-Dose CT Reconstruction
链接：https://arxiv.org/abs/2609.18943
作者：Md Imam Ahasan,Guangchao Yang,A F M Abdun Noor,S M Hasan Mahmud,Md Mahfuzur Rahman
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：computed tomography significantly, tomography significantly degrades, significantly degrades image, degrades image quality, Reducing radiation dose
备注： 8 pages, 7 figures, 3 tables. Accepted at International Joint Conference on Neural Networks (IJCNN 2026)
点击查看摘要
Abstract:Reducing radiation dose in computed tomography significantly degrades image quality and poses challenges for accurate and clinically reliable reconstruction. While recent approaches have shown promise for low-dose CT, they often struggle to generalize across continuous and previously unseen dose levels, leading to artifacts and loss of anatomical detail. To address these limitations, we propose Dose-Aware Cold Diffusion (DACD), a physics-consistent reconstruction framework that explicitly models radiation dose as a continuous latent factor within a cold diffusion process. The proposed DACD framework integrates image-based dose-aware perception, multi-scale structural prior extraction, and dose-calibrated step allocation to adaptively guide the denoising trajectory. In addition, an iterative forward-backprojection correction is incorporated into the reverse refinement process to enforce projection-domain data consistency. Extensive experiments on three public benchmarks, including Mayo-2020, Mayo-2016, and LoDoPaB-CT, demonstrate that DACD consistently outperforms state-of-the-art diffusion-based and physics-guided methods in both quantitative accuracy and visual fidelity, particularly under ultra-low-dose conditions. The results show that DACD achieves robust generalization across a continuous range of dose levels, including those unseen during training.
13. 【2609.18920】PhysVGGT: Feed-Forward Dense Physical Property Estimation from A Single Image
链接：https://arxiv.org/abs/2609.18920
作者：Sneha Paul,Guile Wu,Bingbing Liu,Dongfeng Bai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：images remains challenging, RGB images remains, govern how robots, robots should grasp, manipulate and interact
备注： Technical report
点击查看摘要
Abstract:Physical properties, such as friction, hardness, stiffness, and density, govern how robots should grasp, manipulate and interact with objects, yet estimating these properties from RGB images remains challenging. Existing methods typically employ per-object reconstruction augmented with physical properties or directly query vision-language models at test time, which results in substantial computational overhead that limits their applicability. In this work, we present PhysVGGT, a feed-forward model that predicts dense maps of friction coefficient, Shore hardness, Young's modulus, and density, together with object-level mass, from a single RGB image in one forward pass. The key idea of PhysVGGT is to formulate physical property estimation as a dense per-pixel prediction problem and employ a visual geometry transformer to extract geometry-aware tokens from the input image followed by a dense prediction branch for estimating local physical properties and a global prediction branch for estimating object-level mass. In addition, we introduce a scalable pseudo-label generation pipeline that enables large-scale weakly supervised training for dense physical property prediction, substantially reducing the need for expensive direct physical measurements. Extensive experiments show that PhysVGGT achieves state-of-the-art performance on the ABO-500 dataset and generalizes effectively to the out-of-distribution NeRF2Physics dataset. Moreover, PhysVGGT eliminates the need for per-object reconstruction and test-time optimization, achieving an inference latency of only 0.13s per image, making it $27\times$ faster than the previous state of the art.
14. 【2609.18898】NormLift: From Lifted Features To Semantic Reliability In 3D Gaussian Splatting
链接：https://arxiv.org/abs/2609.18898
作者：Yihan Zang,Da Li,Dominik Engel,Shinkyu Park,Ivan Viola
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains insufficiently understood, theoretical role remains, role remains insufficiently, Training-free weighted aggregation, open-vocabulary scene understanding
备注： 20 pages, 6 figures
点击查看摘要
Abstract:Training-free weighted aggregation is widely used to lift 2D semantic features onto 3D Gaussians for open-vocabulary scene understanding, yet its theoretical role remains insufficiently understood. Existing analyses typically justify this operation from the rendering side, treating Gaussian features as linearly composable Euclidean variables for reconstructing 2D feature maps. However, this view does not match downstream 3D usage, where each Gaussian is often queried independently in a cosine-based embedding space. We revisit feature lifting from the 3D side and formulate per-Gaussian assignment as a cosine alignment problem on the CLIP unit sphere. Under this objective, the L2-normalized semantic back-projected feature emerges as the closed-form solution, providing a complementary interpretation of the standard lifting rule from the perspective of per-Gaussian semantic assignment. The same formulation further yields a norm decomposition into intra-view and inter-view consistency, suggesting that feature magnitude itself can serve as a semantic reliability signal. Calibrated by effective multi-view support, this reliability score guides a mode-voting refinement that preserves CLIP feature validity by avoiding linear averaging. Experiments on open-vocabulary 3D semantic segmentation show that NormLift is an efficient, training-free framework that achieves strong performance across evaluation protocols.
15. 【2609.18860】Decodable but Misrouted: Sparse Features Uncover a Readout Gap in Vision-Language Models for Harmful Meme Detection
链接：https://arxiv.org/abs/2609.18860
作者：Girish A. Koushik,Diptesh Kanojia,Helen Treharne
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large vision-language model, vision-language model misclassifies, reflect missing internal, missing internal evidence, route represented evidence
备注： 40 pages, 9 figures
点击查看摘要
Abstract:When a large vision-language model misclassifies a harmful meme, the failure may reflect missing internal evidence or an inability to route represented evidence to its output. We distinguish these cases in Gemma-3 and Qwen3.5 using sparse autoencoders, role-conditioned probes, causal interventions, and recovery experiments across six harmful content benchmarks, with additional Spanish and Hindi-English code-mixed evaluations. Sparse readouts outperform native prediction on all six primary binary tasks: Qwen averages $0.740$ versus $0.432$ native macro-F1, while residual reconstruction reaches $0.486$, whereas Gemma improves from $0.532$ to $0.714$. These differences reflect supervised accessibility rather than a pre-existing, native decision rule, and the most influential token role depends on the task. Under the evaluated score scales, Qwen silent-feature ablation is $24-63$ times more probe-sensitive, whereas routed-feature patching on literal yes/no tasks is $16-140$ times more output-sensitive. Calibration-only routing recovers $93.3$% of the mean gap, and probe-distilled LoRA improves native predictions, although shared multi-task adaptation causes negative transfer. A case study of Gemma-3-12B on Facebook Hateful Memes finds a distributed rank-32 image-prompt interaction, reaching $0.756$ versus $0.685$ native macro-F1. Robustness controls show that the signal extends beyond English, is not explained solely by accompanying OCR, and depends on paired visual evidence. Thus, routing, rather than representation alone, is a recurring bottleneck in harmful meme classification.
16. 【2609.18844】ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts
链接：https://arxiv.org/abs/2609.18844
作者：Liyang Fan,Chi Wei,Yitai Li,Xinping Bi,Guhong Chen,Chenghao Sun,Haoxiang Yang,Qingwen Li,Kai Yan,Hong Li,Bo Li
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：turn visual inputs, context management, expected to turn, turn visual, visual inputs
备注： 31 pages, 7 figures, including appendices
点击查看摘要
Abstract:Multimodal coding agents are expected to turn visual inputs into usable artifacts, and they act through a harness, the layer of tools, context management, and execution environment around the model. Existing evaluations often isolate short tool calls, API traces, or screenshot resemblance, and a low score under these proxies cannot say whether the model saw poorly, planned poorly, or was failed by its harness. We study scientific overview figure reconstruction, an agent task in which a source image must become an editable PowerPoint slide that preserves text, topology, layout, and native document structure. We introduce ReFigBench, a benchmark and evaluation framework built on 1,000 real overview figures retrieved from arXiv papers with full provenance. Coding agents from four model families reconstruct every figure under two workflows, direct code generation and a specialized PPTX workflow, and the strongest model runs inside two commercial harnesses, yielding ten configurations. Evaluation combines deterministic artifact checks, repeated automated scoring by judges from two model families, and blinded human comparisons. Perception remains a bottleneck that iterative rendering only partly repays. Whether workflow effort converts into quality depends on the model together with its harness, since the same model gains from the specialized workflow inside one harness and loses inside the other, and the harness shifts scores even under an identical direct prompt. The specialized workflow erases native connectors in every configuration, human judges still prefer its renderings in most matchups, and even the strongest agent falls short of the rubric ceiling. These results expose the tension between fidelity and editability as the central challenge for practical multimodal document agents.
17. 【2609.18836】Copy What Is Seen, Generate What Is Not: Training-Free Anomaly-Aware Video Restoration
链接：https://arxiv.org/abs/2609.18836
作者：Zhida Qu,Shengchao Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：training-free video editing, video editing answers, training-free anomaly detectors, Anomaly-aware Video Restoration, anomaly detectors stop
备注： 10 pages, 9 figures, 7 tables
点击查看摘要
Abstract:A surveillance system that detects an anomaly often has to repair the footage as well, yet the two tasks are studied in isolation: training-free anomaly detectors stop at a score or a label, while training-free video editing answers to a user prompt rather than to a detector. This paper proposes AVR (Anomaly-aware Video Restoration), which closes that gap with frozen pretrained models alone and generates content only where the clip offers no evidence to copy. Motion evidence first gates open-vocabulary proposals into spatio-temporal masks. A background prior computed from the clip then fills every pixel the anomaly ever uncovers, leaving diffusion to synthesize only what no frame showed, and a frozen verifier decides per clip whether to trust a classical, a prior-anchored, or a background-conditioned restorer. Extensive experiments on three surveillance datasets, under both full-reference anomaly injection and real anomalies, show that AVR leads full-frame fidelity under oracle masks, matches three trained video inpainters inside the edited region, and outperforms a detect-then-generate pipeline on the masks it produces itself, while suppressing both the residual anomaly and the flicker of free diffusion.
18. 【2609.18823】Using OCR Heads to Verbalize Image Semantics
链接：https://arxiv.org/abs/2609.18823
作者：Sheridan Feucht,Benno Krojer,Sarah Wang,Henry Abrahamsen,Byron C. Wallace,David Bau
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：map from pixels, OCR, VLMs map, interpretable semantic features, semantic features
备注： 21 pages, 22 figures
点击查看摘要
Abstract:How do VLMs map from pixels to semantics? To understand this general question, we focus on a narrow one: studying how VLMs perform optical character recognition (OCR). Across four models, we identify attention heads causally necessary for OCR, and discover that these are in fact general-purpose heads that output interpretable semantic features across all image tokens. For example, pointing these heads at an image token containing the word "bike" causes Qwen3-VL-8B to output "bike," but pointing them at a bird wing causes the model to output the token "feathers." We collapse these heads' attention weights into a single verbalization lens transformation that reveals interpretable semantic features in hidden states across all layers. When combined with projection to vocabulary space, we can obtain interpretable labels starting from layer 0, showing that image representations are in fact aligned with language in early layers. We find that we can also use the inverse of this transformation to edit non-word concepts, e.g., replacing a tractor with a revolver in a naturalistic image, providing causal evidence that this subspace is useful for more than just OCR. Our results are an example of how the study of specific mechanisms can shed light on broader interpretability problems.
19. 【2609.18773】DISTA-Net++: Rethinking Infrared Small Target Unmixing Beyond Sub-Pixel Separation
链接：https://arxiv.org/abs/2609.18773
作者：Mengze Xu,Zhu Liu,Weidong Sheng,Boyang Li,Yimian Dai,Ming-Ming Cheng,Jian Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Long-range infrared imaging, single indistinguishable blob, imaging frequently confronts, frequently confronts dense, diffraction-limited signatures merge
备注：
点击查看摘要
Abstract:Long-range infrared imaging frequently confronts dense target clusters whose diffraction-limited signatures merge into a single indistinguishable blob, concealing the number, sub-pixel positions, and radiant intensities of the underlying sources. While deep learning has advanced general object detection, resolving such Closely-Spaced Infrared Small Targets (CSIST) remains largely unexplored, owing to a systemic infrastructure void and a fundamental paradigm mismatch. The dominant formulation, which reduces unmixing to a blind, discrete sub-pixel separation, is inherently insufficient: without semantic guidance, the ill-posed inverse problem admits ambiguous solutions plagued by false and missed detections, while grid-based discretization locks predictions onto fixed lattice centers, chaining precision to prohibitively expensive grid refinement. We argue that CSIST unmixing should instead be informed and continuous. To ground this paradigm shift, we establish the first comprehensive open-source ecosystem for the field, comprising the large-scale CSIST-100K benchmark, a tailored metric suite, and the GrokCSO toolkit. Upon this foundation, we propose DISTA-Net++, which anchors a dynamic deep unfolding backbone with two synergistic mechanisms: a Count-Guided Prior that injects the global target count as an explicit semantic constraint to regularize the solution space, and a Continuous Coordinate Rectification that regresses off-grid offsets to decouple localization accuracy from grid resolution. Extensive experiments validate our paradigm: even under the most economical 3x division, DISTA-Net++ surpasses 7x-division state-of-the-art methods by 16.15% in CSO-mAP and 62.96% in count accuracy at merely one-sixth of their computation, demonstrating that unmixing precision need not be purchased with finer discretization. The complete ecosystem is available at this https URL.
20. 【2609.18772】Zero-Shot Cross-Lingual Recognition of Sign Language Handshapes
链接：https://arxiv.org/abs/2609.18772
作者：Marcel Granero-Moya,Carolina del Corral Farrarós,Gloria Haro,Coloma Ballester,Ricardo Marques
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：American Sign Language, processing advances rapidly, American Sign, Sign language processing, world sign languages
备注： Accepted at the Workshop on Sign Language Processing (WSLP), EMNLP 2026
点击查看摘要
Abstract:Sign language processing advances rapidly for high-resource languages such as American Sign Language (ASL), yet most of the world's sign languages lack the phonological annotations new methods require. We present the first zero-shot cross-lingual framework for handshape recognition, transferring from ASL to Catalan Sign Language (LSC). Our approach leverages the decomposition of handshapes into five phonological features -- selected fingers, flexion, spread, thumb position, and thumb contact -- shared across both languages, to decode LSC handshapes from predicted features via a composite phonological distance metric. We evaluate three architectures (MLP, SL-GCN, SHuBERT) trained on two ASL corpora (PopSign, Sem-Lex) against a 37-handshape, single-signer LSC benchmark. Zero-shot transfer proves viable once recording-format disparities are harmonized, reaching 80.0% phonological feature accuracy and 54.5% expected handshape accuracy. Phonological decomposition thus offers a bridge for extending sign language technologies to low-resource languages without any target-language video training labels.
21. 【2609.18753】oward Markerless Video-based Tremor Analysis: Objective Quantification of Pathological Tremor in Mouse Preclinical Models
链接：https://arxiv.org/abs/2609.18753
作者：Yota Koshimoto,Akihiro Tsukahara,Yasuhiro Moriwaki,Mariko Isogawa
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：including Parkinson disease, movement disorder characterized, including Parkinson, Parkinson disease, characterized by involuntary
备注：
点击查看摘要
Abstract:Tremor is a movement disorder characterized by involuntary, rhythmic oscillations of body parts and is a hallmark of several neurological conditions, including Parkinson's disease and essential tremor. Elucidating its underlying mechanisms relies heavily on mouse models, which offer genetic manipulability and translational relevance to human neural circuitry. Accordingly, these models are indispensable for studying tremor pathophysiology. So far, electromyography and accelerometers have been used as methods to quantitatively observe tremors in mice. However, these methods have several drawbacks, such as high costs and complex setups. In particular, the invasive surgical implantation of devices causes significant stress to the animals. Although RGB-based methods offer non-invasive and cost-effective alternatives, they often lack the sensitivity required to detect subtle tremors. Therefore, this paper addresses these challenges by achieving mouse tremor severity estimation using conventional RGB cameras only. To address the challenging task of isolating tremor-related vibrations while the mouse itself is also in motion, our pipeline incorporates segmentation-based pre-processing to extract the mouse region and a Tremor Score Estimation Module that captures subtle tremors with high sensitivity. In the experiments, we assessed tremors in unrestrained mice using a non-invasive method with two standard cameras. The results demonstrated a strong correlation with accelerometer measurements and confirmed that the method accurately captured the intensity-dependent characteristics of tremors. The project page is available at this https URL.
22. 【2609.18737】Geometry beneath the Waves: Dense Priors for Sparse-View Underwater 3D Gaussian Splatting
链接：https://arxiv.org/abs/2609.18737
作者：Harvey Caldeira,Haoran Wang,Guoxi Huang,Shaoyu Cai,Rachel Fu,Nantheera Anantrasirichai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：supports applications ranging, marine ecosystem monitoring, reconstruction supports applications, immersive visualisation, supports applications
备注： Accepted to SIGGRAPH Asia Poster
点击查看摘要
Abstract:Underwater 3D reconstruction supports applications ranging from marine ecosystem monitoring and subsea inspection to underwater archaeology, education, and immersive visualisation. 3D Gaussian Splatting has made real-time photorealistic novel-view rendering practical, while underwater variants incorporate physically based image-formation models to separate medium effects from scene radiance. Their reconstruction quality, however, remains fundamentally limited by the geometry used for initialisation.
23. 【2609.18716】Mask IPL: Noise-Free Intrinsic Position Learning via Computation Graph Clipping for Event-Based Spike-Driven Tracking
链接：https://arxiv.org/abs/2609.18716
作者：Yimeng Shan,Malu Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Spiking Neural Networks, Spiking Neural, Neural Networks, extract spatiotemporal features, naturally extract spatiotemporal
备注：
点击查看摘要
Abstract:Spiking Neural Networks (SNNs) match the event-driven nature of event cameras and naturally extract spatiotemporal features. These properties have motivated a series of recent studies on event-based tracking with SNNs. Intrinsic Position Learning (IPL) acquires strong position information without introducing additional parameters, making it a mainstream approach for position encoding in event-based spike-driven tracking. However, the mechanism behind its effectiveness lacks systematic theoretical analysis. Moreover, our analysis reveals that IPL introduces noise in both forward and backward propagation. The former increases inference error, while the latter prevents parameters from converging to better solutions. This paper presents a systematic analysis of IPL and demonstrates that its effectiveness stems from the synergy between IPL and multi-stage convolution. The zero blocks in the joint tensor act as zero padding for convolution, and the resulting boundary effect propagates layer by layer through multi-stage convolution. Every parameter update is therefore driven by a gradient that perceives the relative displacement between template and search frames. Positional encoding added after the convolutional stage cannot provide this information. We further propose a simple Computation Graph Clipping method that applies a validity mask determined by the layout to the operations of every layer, making invalid regions equivalent to zero padding in both forward and backward propagation. This eliminates the noise without introducing additional parameters and makes the actual gradient coincide with the ideal gradient. We name the improved method Mask IPL. Without increasing parameters or computational cost, Mask IPL improves the AUC of the Tiny-scale tracker on FE108, FELT, and VisEvent, and consistently improves the Base-scale tracker as well.
24. 【2609.18582】On-the-Fly Homographies Calibration for Multi-Camera Tracking
链接：https://arxiv.org/abs/2609.18582
作者：David Voihanski,Mor Sinai,Ben Zion Bobrovsky
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Precise multi-camera tracking, Precise multi-camera, tracking traditionally relies, relies on rigorous, large-scale deployments
备注：
点击查看摘要
Abstract:Precise multi-camera tracking traditionally relies on rigorous 3D site calibration, yet this requirement is often operationally impossible in large-scale deployments. Privacy regulations frequently prohibit recording video for offline calibration; limited bandwidth precludes synchronizing high-resolution streams from hundreds of cameras; and covering immense physical sites with calibration targets is logistically infeasible. We present a multi-camera homography calibration system designed to overcome these barriers through "on-the-fly" geometric refinement. Starting from coarse manual homographies, we introduce a centroid-based projection optimization (PO) that continuously aligns the ground-plane geometry using live detection streams. Because PO operates asynchronously on already-transmitted, lightweight metadata, it adds zero computational latency to the real-time tracker. This allows the system to adapt automatically to camera movements or environmental changes without human intervention. This optimized geometry feeds a multi-camera bird's-eye-view (BEV) tracker that fuses detections and unifies trajectories across zones. Crucially, by operating strictly on live anonymous metadata, our solution ensures a privacy-safe, zero-overhead, and resilient tracking pipeline that maintains global consistency in dynamic environments where static, recorded-video calibration is impossible.
25. 【2609.18578】Learning Where to Focus: Self-Supervised Multi-Scale ViTs for Histopathology
链接：https://arxiv.org/abs/2609.18578
作者：Anabel Stammer,Valay Bundele,Mehran Hosseinzadeh,Hendrik P.A. Lensch
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Pathologists diagnose diseases, multiple biological scales, locating suspicious tissue, spanning multiple biological, Pathologists diagnose
备注： 13 pages, 5 figures, plus supplementary material. Accepted at DAGM GCPR 2026
点击查看摘要
Abstract:Pathologists diagnose diseases by first locating suspicious tissue and then examining it at higher magnification, whereas self-supervised vision transformers (ViTs) allocate the same spatial resolution to every image region despite diagnostic evidence being sparse and spanning multiple biological scales. Recent pathology foundation models have substantially improved representation quality by scaling training data and model capacity, but largely retain uniform tokenization. We instead investigate whether pathology representations can be improved by learning where to allocate spatial resolution during self-supervised learning. To this end, we propose CRAFT (Coarse-to-fine Region-Adaptive Feature Tokenization), a DINO-based framework that learns image-dependent mixed-scale representations by using self-supervised attention to selectively refine informative regions while preserving coarse context, together with a symmetric cross-scale regularization objective that encourages complementary coarse and fine representations. Across CAMELYON16, TCGA-Lung subtype classification, and TCGA-LUAD survival prediction, CRAFT consistently outperforms comparable-scale self-supervised methods while requiring lower inference computation. Despite using only a compact 22M parameter backbone trained on comparatively small pathology datasets, CRAFT remains competitive with, and often surpasses, substantially larger pathology foundation models.
26. 【2609.18562】Sim-to-Real Traffic Scene Understanding by Decoupling Semantics from Caption Generation with V-JEPA
链接：https://arxiv.org/abs/2609.18562
作者：Nguyen Hoai Thuong Bui,Thanh Nguyen Vo,Trinh Tra Giang Nguyen,Ha Duc Bui
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：real domain shift, challenging synthetic-to real, synthetic-to real domain, visual question answering, City Challenge Track
备注： Winner of Track 2 at the AI City Challenge 2026, with the paper published at the ECCV conference 2026 (ECCV-W)
点击查看摘要
Abstract:Track 2 of the AI City Challenge 2026 requires both visual question answering (VQA) and traffic event description generation under a challenging synthetic-to real domain shift. Existing vision-language approaches often entangle semantic understanding with language generation, making them susceptible to hallucination and inconsistent reasoning across event phases. In this work, we propose a decoupled semantic understanding framework that first resolves predefined traffic questions into structured semantic facts and subsequently uses these facts to guide caption generation. A frozen V-JEPA encoder extracts predictive scene representations, while a lightweight Llama-based predictor produces answers for VQA queries. To improve reliability, we introduce a training-free structured refinement mechanism that exploits statistical priors, inter-question relationships, and temporal event consistency to correct prediction errors. The refined semantic facts are then provided to Qwen3-VL-8B to generate pedestrian and vehicle descriptions for each traffic event. Experimental results on the official 2026 AI City Challenge Track 2 benchmark show that the proposed method achieves 87.09% VQA accuracy and an overall S2 score of 60.0853, ranking first among all participating teams. These results demonstrate that predictive world representations combined with structured semantic refinement enable more accurate and reliable traffic understanding, leading to higher-quality lan guage generation.
27. 【2609.18554】CARA: Collision-Aware Resolution Adaptation for Multiresolution Hash Encoding Based Image Fitting
链接：https://arxiv.org/abs/2609.18554
作者：Linfeng Ye,Zhixiang Chi,Shayan Mohajer Hamidi,En-hui Yang,Konstantinos N. Plataniotis
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Multiresolution hash encodings, recently enabled fast, high-fidelity implicit neural, implicit neural representations, storing multi-scale features
备注： 32 pages, 12 figures, ECCV 2026
点击查看摘要
Abstract:Multiresolution hash encodings have recently enabled fast and high-fidelity implicit neural representations by storing multi-scale features in fixed-size hash tables along a geometric resolution schedule. However, the standard design is data-agnostic: different resolution levels receive identical hash-table capacity despite large differences in image frequency content. As a result, some levels experience severe hash collisions while others underutilize parameters, leading to inefficient capacity allocation. To address this issue, we propose Collision-Aware Resolution Adaptation (CARA), a method that assigns per-level resolutions by balancing the effective information load across hash levels. This adaptive allocation reduces capacity bottlenecks and improves parameter efficiency. In addition, we introduce an invertible pixel-shuffle transform that reduces hash load factors by redistributing spatial information, thereby mitigating collision-induced information loss without enlarging the hash tables. To support evaluation on extremely high-resolution data, we also curate, to the best of our knowledge, the first uncompressed whole-slide image dataset for academic research. Experiments on Kodak images, gigapixel natural images, and raw whole-slide images demonstrate that CARA consistently improves the fidelity-parameter trade-off. Our method matches state-of-the-art performance while using only $27.76%$ of the parameters, and achieves up to $6.11$ dB PSNR improvement at comparable parameter counts. Code is provided in the supplementary.
28. 【2609.18548】HAP: A Hand-Driven Active Perception Framework for Egocentric Head Motion Prediction
链接：https://arxiv.org/abs/2609.18548
作者：Yunji Feng,Junyi Ma,Guanzhong Sun,Chenyang Xu,Hesheng Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：motion comparatively underexplored, hand motion, motion, Egocentric motion forecasting, observed hand motion
备注：
点击查看摘要
Abstract:Egocentric motion forecasting has primarily focused on hands and manipulated objects, leaving future human head motion comparatively underexplored. During manipulation, the head both redirects perception toward the target to acquire task-relevant evidence and coordinates with body and hand motion. We therefore formulate future six Degree of Freedom (6-DoF) head-motion prediction conditioned on observed hand motion and inferred target context, and propose HAP, a Hand-Driven Active Perception framework. HAP infers confidence for each target object from observed hand motion and object geometry. Then constructs a dynamic Predictive Target-Centric Amodal Occlusion Graph (P-TAOG) representing current and potential occlusion among candidate objects. Directed graph and causal temporal reasoning encode the evolving target conditioned perceptual state, which is fused with hand and head motion history. A horizon-wise gate then blends the learned trajectory with a constant velocity prior. We further introduce Bottle, an egocentric RGB-D dataset of object manipulation toward specified targets, with coordinated head and hand motion under changing target visibility. Experiments on the public dataset and Bottle show that HAP achieves lower head motion prediction errors than representative baselines, supporting the value of hand driven intention and dynamic occlusion reasoning for anticipating human head motion. Code will be released at this https URL.
29. 【2609.18546】STUNet-Fusion: Spatiotemporal Needle-Tip Localization in Ultrasound Video via Multi-Channel Motion Fusion
链接：https://arxiv.org/abs/2609.18546
作者：Chia-Chi Hsu,Chia-Hsuan Hsu,Che-Chou Shen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：produce similar responses, ultrasound remains challenging, partially invisible, similar responses, remains challenging
备注：
点击查看摘要
Abstract:Needle-tip localization in ultrasound remains challenging because the needle may appear weak, discontinuous, or partially invisible, while imaging artifacts and anatomical structures can produce similar responses. To address this problem, we propose STUNet-Fusion, a spatiotemporal framework for needle-tip localization in ultrasound videos. The proposed method formulates the input as a tri-channel spatio-temporal fusion tensor, comprising grayscale appearance, grid-based motion feature, and raw frame difference. A shared ResNet-34 encoder extracts spatial features, ConvLSTM integrates temporal dependencies, and a U-Net decoder reconstructs a dense probability heatmap. The final coordinates are extracted via a soft-argmax operation to achieve sub-pixel localization accuracy. Experimental results demonstrate that this spatiotemporal fusion strategy significantly improves localization robustness compared to conventional baselines.
30. 【2609.18542】Accuracy- and Real-Time-Aware 4D Radar Preprocessing for Autonomous Driving Perception Systems
链接：https://arxiv.org/abs/2609.18542
作者：Woo-Jin Jung,Dong-Hee Paek,Jeong-Su Park,Seung-Hyun Kong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：adverse weather conditions, promising next-generation sensor, stable sensing capability, autonomous driving perception, driving perception systems
备注： 7 pages, 7 figures, Transactions of the Korean Society of Automotive Engineers
点击查看摘要
Abstract:4D radar has emerged as a promising next-generation sensor for improving the robustness of autonomous driving perception systems because of its stable sensing capability under adverse weather conditions. However, deploying 4D radar in embedded environments with limited hardware resources requires radar-representation preprocessing that jointly considers perception accuracy, real-time performance, and computational complexity. This paper proposes a preprocessing framework for 4D-radar-based 3D object detection. First, Percentile-based 3D Shape Preservation (P3DP) extracts point clouds from radar tensors while preserving object-shape information and suppressing noise and false alarms. Second, Multi-frame-based Noise Point Discrimination using Kernel Density Estimation (MF-KDE) improves the density and reliability of sparse radar point clouds. Finally, Embedded \ NetScore (ENS) evaluates suitability for embedded deployment by jointly considering accuracy, real-time performance, adverse-weather robustness, and model complexity.
31. 【2609.18540】SVMemAgent: A Streaming Video Memory Agent for Query-Agnostic Online Frame Selection
链接：https://arxiv.org/abs/2609.18540
作者：Dohwan Ko,Ji Soo Lee,Pierce Chuang,Debojeet Chatterjee,Ashish Shenoy,Yichao Lu,Seungwhan Moon,Xin Luna Dong,Vikas Bhardwaj,Hyunwoo J. Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Streaming Video Memory, selection studies focus, video, studies focus, Streaming Video
备注：
点击查看摘要
Abstract:Most keyframe selection studies focus on offline settings, assuming access to the full video and query in advance. In contrast, real-world streaming scenarios require online frame selection under unknown video duration, without access to either the query or future frames during selection. To address this, we introduce Streaming Video Memory (SVMem), a compact and representative memory of previously observed content, updated continuously as the video stream unfolds. Building on this setting, we propose the Streaming Video Memory Agent (SVMemAgent), which dynamically maintains a memory by deciding at each timestep whether to replace an existing memory frame with the incoming frame or discard it. SVMemAgent is trained using Group Relative Policy Optimization (GRPO) with task-driven rewards derived from diverse question-answer pairs, implicitly exposing the policy to a distribution of queries during training so that SVMem retains generally informative frames at inference, when queries are unavailable. Experiments on both online and offline video benchmarks show that SVMemAgent consistently outperforms online frame selection baselines and achieves competitive performance with offline methods that assume access to the full video and query. Through task-driven rewards, SVMemAgent learns an emergent keyframe selection policy that prefers frames containing textual information, which may benefit downstream VideoQA tasks.
32. 【2609.18511】Learning from Distributed Eyes: Leveraging Collaborative Perception for Automated Model Adaptation
链接：https://arxiv.org/abs/2609.18511
作者：Yanan Ma,Yihang Tao,Zhengru Fang,Zihan Fang,Yiqin Deng,Xianhao Chen,Yuguang Fang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：autonomous driving, domain shifts, struggle to generalize, environments due, due to domain
备注： 9 pages, 3 figures
点击查看摘要
Abstract:In autonomous driving, perception models often struggle to generalize to new environments due to domain shifts. While unsupervised model adaptation offers a feasible solution without labor-intensive manual labeling, existing methods that rely solely on the ego-vehicle's data often lead to inferior pseudo-labeling performance. To address this critical issue, we propose LDE, Learning from Distributed ``Eyes", a novel framework that transforms collaborative perception (CP) into a source of high-quality supervision for model adaptation. This pseudo-labeling approach is hyperparameter-insensitive and relatively reliable, assuming CP often outperforms single-agent's perception. However, naively implementing this approach encounters (1) the communication bottleneck of sharing rich features under time and bandwidth constraints, (2) the view discrepancy between the CP view and the learner's Field of View (FoV), and (3) the unreliability even in CP-generated labels. To address these issues, we design an adaptation-oriented feature sharing mechanism that selectively transmits the most critical information for adaptation, an FoV filtering method that meticulously eliminates mismatched labels, and a curriculum learning strategy to progressively exploit pseudo labels. Extensive experiments on 3D object detection tasks demonstrate that LDE consistently outperforms both the pre-trained models and state-of-the-art unsupervised adaptation methods.
33. 【2609.18510】DiT-Garment: Garment Dynamics with Diffusion Transformers
链接：https://arxiv.org/abs/2609.18510
作者：Antoine Dumoulin,Laurence Boissieux,Joao Regateiro,Pierre Hellier,Stefanie Wuhrer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：present DiT-Garment, model dynamic, model, body, DiT-Garment
备注：
点击查看摘要
Abstract:We present DiT-Garment to model dynamic 3D clothing over human body models in arbitrary motion. Unlike existing methods, DiT-Garment can animate garments with unseen designs and physical materials, while allowing for direct inference of deformations for any target pose. To achieve this, we leverage a 2D diffusion transformer architecture to learn 3D deformations in a 2D UV-space. As the result is non-deterministic, our generative model learns the distribution of possible outcomes. The template garment is represented as a 3D triangle mesh spatially aligned with a 3D human body model in a standardized pose. To work with different garment designs without the need of a common template or complex graph convolution operations, the diffusion transformer is conditioned on a 3D position map of the template, represented in UV-space, which allows to implicitly learn a deformation of the 3D space around the body in standard pose. Further conditioning on body motion and physical parameters allows to physically ground the model. We quantitatively and qualitatively evaluate DiT-Garment on both synthetic and real data. While only trained on synthetic simulations of automatically generated cloth designs, our method generalizes to captured and artist-made garment designs. Code and data are available for research purposes at this https URL.
34. 【2609.18493】Semantic-ITC: A Frame-wise Indoor Mobile Laser Scanning Dataset and Benchmark for Semantic Segmentation
链接：https://arxiv.org/abs/2609.18493
作者：Haiyang Wu,Muhammad Affan,George Vosselman,Ville Lehtola
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：mobile laser scanning, remain largely absent, indoor MLS semantic, MLS semantic segmentation, indoor MLS
备注：
点击查看摘要
Abstract:Semantic labels for indoor mobile laser scanning (MLS) frames remain largely absent from current point cloud semantic segmentation benchmarks, which mainly focus on reconstructed indoor scenes or outdoor LiDAR perception. This paper introduces Semantic-ITC, to the best of our knowledge the first public dataset and benchmark for frame-wise indoor MLS semantic segmentation. The dataset contains 52 indoor sequences, 79,108 MLS frames, and 1.23 billion labeled points collected in classrooms, corridors, meeting rooms, offices, and study areas. Labels are attached directly to measured LiDAR points in each frame using 16 semantic classes covering structural elements, furniture, room equipment, vegetation, and other indoor objects. Semantic-ITC preserves the sparse, non-uniform, and frame-wise sampling pattern of indoor MLS, making it distinct from scene-level reconstructed point clouds and mesh-based indoor datasets. The annotations are produced by a hybrid workflow that combines predictions from a visual foundation model applied to synchronized RGB images, structural information from BIM, and manual refinement, with the final labels assigned to the original LiDAR frames. A single-frame benchmark is provided, and the best baseline reaches 79.27\% mIoU. Remaining errors are concentrated around object boundaries and ambiguous indoor classes, indicating the challenges of indoor MLS segmentation under sparse frame geometry and long-tailed class distributions. The dataset provides a public benchmark for evaluating semantic segmentation directly on measured indoor MLS frames and supports future studies on frame-wise indoor MLS semantic segmentation.
35. 【2609.18490】Learning A Unified Template for Gait Recognition
链接：https://arxiv.org/abs/2609.18490
作者：Panjian Huang,Saihui Hou,Junzhou Huang,Yongzhen Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Human wisdom reveals, Human wisdom, Diffusion Models, wisdom reveals, reveals that creation
备注： Accepted at ICCV 2025
点击查看摘要
Abstract:"What I cannot create, I do not understand."Human wisdom reveals that creation is one of the highest forms of learning. For example, Diffusion Models have demonstrated remarkable semantic structure and memory in image generation, understanding, and restoration, which intuitively benefits representation learning. However, current gait networks rarely embrace this perspective, relying primarily on learning by contrasting gait samples under varying complex conditions, leading to semantic inconsistency and uniformity issues. To address these issues, we propose Origins with generative capabilities whose underlying philosophy is that different entities are generated from a unified template, inherently regularizing gait representations within a consistent and diverse semantic space to capture accurate gait differences. Admittedly, learning this unified template is exceedingly challenging, as it requires the comprehensiveness of the template to encompass gait representations with various conditions. Inspired by Diffusion Models, Origins diffuses the unified template into timestep templates for gait generative learning, and meanwhile transfers the unified template for gait representation learning. Especially, gait generative and representation learning serve as a unified framework for end-to-end joint training. Extensive experiments on CASIA-B, CCPG,SUSTech1K, Gait3D, GREW and CCGR-MINI demonstrate that Origins performs unified generative and representation learning, achieving superior performance.
36. 【2609.18488】Beyond Random Couplings: Contrastive Noise Alignment in Generative Flows
链接：https://arxiv.org/abs/2609.18488
作者：Lennart Wittke,Vinicius Azevedo
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Diffusion and flow-matching, independently sampled Gaussian, sampled Gaussian noise, flow-matching models, models are typically
备注： 21 pages, 10 figures, 9 tables
点击查看摘要
Abstract:Diffusion and flow-matching models are typically trained by corrupting data through independently sampled Gaussian noise. While simple and scalable, this forward process induces arbitrary data-noise couplings, forcing the network to learn high-curvature transports between unrelated endpoints. Existing optimal-transport methods reduce this burden by reassigning fixed noise samples to data, but the source noise distribution itself remains passive. To address this, we introduce Contrastive Noise Alignment (CNA), a training-time method that creates dynamic, contrastive couplings by optimizing the noise representations directly. By modeling the noise batch as an interacting particle system, CNA employs a cross-modal InfoNCE objective to align noise particles with their paired data targets. To prevent spatial collapse, this alignment is regularized using an angular entropy term and a radial norm penalty. We show theoretically that this equilibrium asymptotically preserves Gaussian structures, maintaining tractability during inference. Empirically, CNA improves the alignment between noise and data, reduces flow curvature, and provides better generation quality with fewer required sampling steps. For few-step, pixel-space generation (2-4 NFEs), CNA reduces FID by over 50\% compared to standard rectified flow, and by at least 24\% against Optimal Transport baselines.
37. 【2609.18487】ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models
链接：https://arxiv.org/abs/2609.18487
作者：Shijie Lian,Bin Yu,Zhaolong Shen,Xiaopeng Lin,Yichao Du,Zhirui Zhang,Laurence T. Yang,Kai Chen
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：executable commands recovered, Action tokenizers play, tokenizers play, play a central, central role
备注： Project Page: [this https URL](https://deepcybo-physai.github.io/ActionPiece/)
点击查看摘要
Abstract:Action tokenizers play a central role in autoregressive vision-language-action (VLA) models, determining both the targets for policy training and the executable commands recovered from predicted tokens. Their fidelity is commonly evaluated using pointwise reconstruction metrics such as mean squared error (MSE), yet small individual errors do not fully characterize how faithfully action adjustments across demonstrations are preserved. After compression, similar actions may still cluster around a representative motion, while the adjustments needed for different contexts are diminished, distorted, or even reversed. We introduce physical rank consistency (PRC) to measure how well tokenization preserves local physical distance rankings after reconstruction. Evaluating decoded actions provides a common reference across token vocabularies and decoder architectures, complementing pointwise accuracy with a measure of relational fidelity. We further present ActionPiece, which preserves physical action relationships through joint supervision of representation learning and quantization. Physical rank preservation supervises near-far ordering in encoder and quantized feature distances, while quantization regularization applies the same ordering to codeword assignment distributions. Both objectives augment reconstruction, producing discrete action tokens for standard autoregressive policy learning and execution through a frozen decoder. Under the same Qwen3-VL-4B policy training setup, ActionPiece achieves 94.8% on LIBERO and 68.8% on unseen LIBERO-Plus, with additional evaluations reaching 71.9% on SimplerEnv and 51.5% across VLA-Arena L0-L2. Component ablations show that the two objectives jointly improve PRC and policy success, demonstrating the value of physical relationship supervision for action tokenization.
38. 【2609.18473】CADSplat: Sparse-View 3D Gaussian Splatting Aided by CAD Models for Robust, Photorealistic Digital-Twin Reconstruction
链接：https://arxiv.org/abs/2609.18473
作者：Kristof Overdulve,Lode Jorissen,Nick Michiels
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：geometrically accurate digital, accurate digital twins, wide-baseline posed images, explicit CAD shape, CAD shape prior
备注：
点击查看摘要
Abstract:We present CADSplat, a framework that reconstructs photorealistic, geometrically accurate digital twins from sparse ($15$ views), wide-baseline posed images of an object by regularizing 3D Gaussian Splatting (3DGS) with an explicit CAD shape prior. Using such a prior requires finding a CAD model whose shape resembles the object depicted in the images and determining the pose of each camera relative to the object. We obtain both by matching segmented object silhouettes against silhouettes rendered from a CAD library and keeping the camera-to-object poses of the best-matching model. We then anchor 3D Gaussian primitives to the surface of the retrieved model and jointly optimize the 3DGS parameters, the camera-to-object registration, and a non-rigid deformation field to account for shape differences between the physical object and the CAD model. Across two real-world datasets, CADSplat outperforms unconstrained, few-shot, and mesh-texturing baselines and degrades gracefully to as few as 3 views. Our experiments show that most of the gain in rendering quality comes from how the splats are constrained---a fixed set of splats tied to a surface and moved by a single smooth deformation field---rather than from the CAD shape itself. The CAD model adds shape knowledge where views are scarcest, in the sparsest captures and on strongly self-occluded objects, and it places every camera in the object's own frame. This enables applications beyond novel-view synthesis, such as markerless augmented reality registration, per-image object pose estimation, physical simulations, and the transfer of part labels from the design to the reconstruction.
39. 【2609.18465】GeoCond: A Conditioning-Aware Reliability Adapter for Feed-Forward 3D Reconstruction
链接：https://arxiv.org/abs/2609.18465
作者：David Ahmedt-Aristizabal,Mohammad Ali Armin,Russell Tsuchida,Lars Petersson
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：extreme relative rotation, VGGT predict cameras, low overlap, low parallax, predict cameras
备注：
点击查看摘要
Abstract:Feed-forward 3D foundation models such as VGGT predict cameras, depth, and point maps in a single pass, but can fail silently under low overlap, low parallax, and extreme relative rotation. Stratified analyses over these factors show that these failures are governed by geometric conditioning and are poorly captured by native aleatoric confidence. We introduce GeoCond, a lightweight reliability adapter for frozen feed-forward 3D backbones. GeoCond reads the backbone's predicted geometry and outputs pose-level uncertainty and a refinement gate. During training, it can be supervised by frame-permutation orbit variance, ground-truth pose error when labels are available, or cycle residuals from unlabelled independent pose graphs. At inference, the default head requires only one backbone pass and a small MLP. On VGGT, GeoCond improves out-of-distribution (OOD) AUSE (area under the sparsification-error curve; lower is better) from $0.32$ to $0.20$ over native confidence, transfers zero-shot to outdoor extreme-view scenes, and avoids the collapse caused by applying bundle adjustment uniformly. Across multiple backbones, cycle-distilled variants provide a ground-truth-free adaptation route, including cases where permutation variance vanishes on equivariant models. The same reliability signal supports gated refinement, pose-graph weighting, calibration, curation, and capture decisions. Reliable feed-forward 3D reconstruction requires not only predicting geometry, but also knowing when that geometry should be trusted.
40. 【2609.18462】CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models
链接：https://arxiv.org/abs/2609.18462
作者：Tianbin Liu,Jian Zhu,Taiyi Su,Jianjun Zhang,Chong Ma,Zitai Huang,Yi Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：FastWAM-style world action, action models enable, models enable efficient, generalize poorly, world action models
备注： 13 pages, 2 figures
点击查看摘要
Abstract:FastWAM-style world action models enable efficient action-only inference, but generalize poorly under visual distribution shifts. Their reconstruction-oriented representations emphasize appearance-specific details, limiting generalization to unseen scenes and objects. Without observation history, the model also lacks temporal evidence for robustly identifying task-relevant state changes and motion in unfamiliar visual conditions. To address these limitations, we present the Causal Semantic World Action Model (CSWAM), which augments FastWAM with a causal semantic expert built on V-JEPA 2.1. V-JEPA provides temporally grounded representations of semantic state changes and motion with less dependence on appearance-specific details. The expert learns their future evolution from a sparse history of current and past observations and shares the history-derived context with both the video and action streams through causal attention. At inference, CSWAM conditions action denoising on the current video state and observed semantic history, retaining efficient action-only inference. We conduct simulation and real-robot experiments to evaluate generalization under distribution shifts. With embodied pretraining, CSWAM raises Randomized success on RoboTwin 2.0 Clean-to-Randomized transfer from 10.16% to 45.18%, a gain of 35.02 percentage points over FastWAM. Across two real-robot tasks and three OOD difficulty levels, CSWAM improves average success over FastWAM by 42.5 percentage points, from 27.5% to 70.0%.
41. 【2609.18444】DR.WILSS: Diffusion-Based Replay for Weakly Supervised Continual Semantic Segmentation
链接：https://arxiv.org/abs/2609.18444
作者：Leon Arthur Marx,Francesco Barbato,Matteo Caligiuri,Pietro Zanuttigh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Weakly supervised class-incremental, class-incremental semantic segmentation, supervised class-incremental semantic, Weakly supervised, aims to train
备注： Accepted at MMSP 2026, 6 pages, 4 figures
点击查看摘要
Abstract:Weakly supervised class-incremental semantic segmentation (WILSS) aims to train a segmentation model over multiple steps, each introducing new concepts to be learned with only image-level supervision. We introduce this http URL, an innovative approach to address catastrophic forgetting in continual learning using diffusion-based generative replay. Our framework leverages language clues to guide the diffusion process, employing self-inpainting and regularization techniques to efficiently produce replay data, aiding the learning process. By generating high-quality replay data, the information from previously learned classes can be preserved during continual updates, a critical challenge in incremental learning scenarios. To further align the statistics of replay data with those of training samples, we apply LoRAs to the generative model. Experimental results demonstrate state-of-the-art performance across multiple benchmarks and generative architectures, while avoiding storage of training data and the use of additional resource-demanding tools during training. The proposed technique enables an optimal tradeoff between training complexity and inference-time accuracy, making this http URL a promising solution for real-world applications.
42. 【2609.18432】Occluded Gait Recognition with Mixture of Experts: An Action Detection Perspective
链接：https://arxiv.org/abs/2609.18432
作者：Panjian Huang,Yunjie Peng,Saihui Hou,Chunshui Cao,Xu Liu,Zhiqiang He,Yongzhen Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：real-world scenarios pose, scenarios pose challenges, Detection Based Mixture, gait, action
备注： Accepted at ECCV 2024
点击查看摘要
Abstract:Extensive occlusions in real-world scenarios pose challenges to gait recognition due to missing and noisy information, as well as body misalignment in position and scale. We argue that rich dynamic contextual information within a gait sequence inherently possesses occlusion-solving traits: 1) Adjacent frames with gait continuity allow holistic body regions to infer occluded body regions; 2) Gait cycles allow information integration between holistic actions and occluded actions. Therefore, we introduce an action detection perspective where a gait sequence is regarded as a composition of actions. To detect accurate actions under complex occlusion scenarios, we propose an Action Detection Based Mixture of Experts (GaitMoE), consisting of Mixture of Temporal Experts (MTE) and Mixture of Action Experts (MAE). MTE adaptively constructs action anchors by temporal experts and MAE adaptively constructs action proposals from action anchors by action experts. Especially, action detection as a proxy task with gait recognition is an end-to-end joint training only with ID labels. In addition, due to the lack of a unified occluded benchmark, we construct a pioneering Occluded Gait database (OccGait), containing rich occlusion scenarios and annotations of occlusion types. Extensive experiments on OccGait, OccCASIA-B,Gait3D and GREW demonstrate the superior performance of this http URL is available at this https URL.
43. 【2609.18430】StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions
链接：https://arxiv.org/abs/2609.18430
作者：Awomo-WM Team:Enhui Ma,Kaiwen Guo,Tingrui Zhang,Wei Song,Yingshui Tan,Jianhua Xu,Tong Zhang,Kaicheng Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video world models, world models, video world, physical dynamics, objects move
备注： Project page: [this https URL](https://westlakedi-awomo.github.io/StrucPhysVideo-Page/)
点击查看摘要
Abstract:Modeling physical dynamics, including how objects move, interact, and change state, is central to video world models for embodied AI. We present StrucPhysVideo, a family of video world models that bridges physics-focused data curation with language- and action-conditioned prediction of scene evolution. Our data pipeline combines motion-aware video segmentation, quality and content filtering, and physical relevance verification with structured annotations of objects, materials, and temporally localized interactions. By disentangling camera motion from object behavior and explicitly describing contact, deformation, and state transitions, the pipeline provides supervision grounded in observable physical events. Building on these data, we introduce StrucPhysVideo-TI2V, a sparse Mixture-of-Experts (MoE) text-image-to-video model trained with a curriculum that progressively emphasizes physical dynamics while retaining general-domain video data. StrucPhysVideo-TI2V achieves state-of-the-art performance on Physics-IQ Verified, scoring 45.5% and outperforming Cosmos3-Super-Image2Video by 2.8 percentage points. Caption ablations across backbones further demonstrate the effectiveness of physics-focused supervision. We further extend StrucPhysVideo-TI2V to StrucPhysVideo-IA2V, an interactive image-action-to-video world model that predicts visual outcomes from robot end-effector commands. Action conditioning, causal autoregressive generation, and few-step distillation enable incremental robot rollouts with only four denoising steps. Together, StrucPhysVideo advances physical dynamics modeling from image- and language-conditioned video prediction toward action-driven interaction.
44. 【2609.18413】Vocabulary-Guided Gait Recognition
链接：https://arxiv.org/abs/2609.18413
作者：Panjian Huang,Saihui Hou,Chunshui Cao,Xu Liu,Yongzhen Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：gait, gait features, vocabulary, gait networks, human
备注： Accepted at NeurIPS 2025
点击查看摘要
Abstract:What is a gait? Appearance-based gait networks consider a gait as the human shape and motion information from images. Model-based gait networks treat a gait as the human inherent structure from points. However, the considerations remain vague for humans to comprehend truly. In this work, we introduce a novel paradigm Vocabulary-Guided Gait Recognition, dubbed Gait-World, which attempts to explore gait concepts through human vocabularies with Vision-Language Models (VLMs). Although VLMs have achieved the remarkable progress in various vision tasks, the cognitive capability regarding gait modalities remains limited. The success element in Gait-World is the proper vocabulary prompt where this paradigm carefully selects gait cycle actions as Vocabulary Base, bridging the gait and vocabulary feature spaces and further promoting human understanding for the gait. How to extract gait features? Although previous gait networks have made significant progress, learning solely from gait modalities on limited gait databases makes it difficult to learn universal gait features for practicality. Therefore, we propose the first Gait-World model, dubbed {\alpha}-Gait, which guides the gait network learning with vocabulary knowledge from VLMs. However, due to the heterogeneity of the modalities, directly integrating vocabulary and gait features is highly challenging as they reside in different embedding spaces. To address the issues, {\alpha}-Gait designs Vocabulary Relation Mapper and Gait Fine grained Detector to map and establish vocabulary relations in the gait space for detecting corresponding gait features. Extensive experiments on CASIA-B, CCPG, SUSTech1K, Gait3D and GREW reveal the potential value and research directions of vocabulary information from VLMs in the gait field.
45. 【2609.18406】Prosthesis-Aware 3D Human Pose Estimation: A Dataset and Benchmark for RSP Users
链接：https://arxiv.org/abs/2609.18406
作者：Yilin Wen,Kechuan Dong,Fumiya Suginaka,Ken Endo,Yusuke Sugano
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sports performance evaluation, performance evaluation, video is important, important for applications, rehabilitation assessment
备注： ECCV 2026. Project page: [this https URL](https://ut-vision.github.io/RSP3D/)
点击查看摘要
Abstract:Recovering 3D human body motion from video is important for applications such as rehabilitation assessment and sports performance evaluation. For prosthesis users, this requires capturing both natural body joints and the geometry of the prosthetic device, a challenge that existing methods are not designed to address. Model-based estimators rely on body models trained on non-amputee individuals and cannot represent prosthesis geometry, while model-free methods lack body kinematic priors and are unreliable under occlusion. This challenge is particularly prominent for users of running-specific prostheses (RSPs), where the RSP has a complex curved geometry and moves dynamically during exercise. To fill this gap, we collect RSP3D, the first 3D dataset of RSP users, covering essential daily-life and exercise actions from participants with varied amputation conditions, using a multi-camera marker-based motion capture setup. We formally define the task of prosthesis-aware 3D pose estimation, evaluate representative methods in a zero-shot setting, and confirm their individual limitations. We further propose a hybrid baseline combining model-based body joint estimation with model-free RSP shape recovery, establishing a starting point for future research.
46. 【2609.18399】A Non-Linear Neuron Based Detection of Isolated Pixels in Binary and Grayscale Images using Contrast Sensitive Receptive Fields
链接：https://arxiv.org/abs/2609.18399
作者：Nassir Mohammad
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Identifying isolated points, quality control management, Identifying isolated, image processing applications, medical imaging
备注：
点击查看摘要
Abstract:Identifying isolated points is important in image processing applications such as medical imaging, astronomy and quality control management. Other domains, such as cybersecurity, also present challenges that can be framed as image processing problems. One example of particular interest is the identification of anomalous single nodes in spatially organised networks where groups of nodes in different regions share similar feature values. This task can involve both binary and more complex grayscale images. However, existing methods face limitations: template matching is infeasible for grayscale images, while 2nd order derivative based methods are highly sensitive to noise and require user-specified thresholds. To overcome these issues, a novel method is proposed for detecting meaningful single-pixel deviations in images. This approach modifies and extends a neuron model, originally designed for anomaly detection, to operate on spatially diameter limited receptive fields that incorporate excitatory and inhibitory regions. The result is a method that is free from user-specified thresholds and parameters, and can be applied to both binary and grayscale images, providing an effective, robust and efficient solution.
47. 【2609.18393】MSR: Multiple Subject Reference for Video Generation
链接：https://arxiv.org/abs/2609.18393
作者：Guannan Li,Jiaji Chen,Jingyuan Liao,Yu Geng,Baolan Qiu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires preserving appearance, images requires preserving, multiple images requires, Multiple Subject Reference, intended role
备注： 11 pages, 4 figures. Model weights and inference workflows are publicly available
点击查看摘要
Abstract:Conditioning a video generator on multiple images requires preserving appearance while associating each reference with its intended role. We present MSR (Multiple Subject Reference), a slot-aware conditioning scheme for LTX-based video generation. Each reference image is independently encoded as a static clip and represented by a separate latent-token group. A compact Fourier-feature multilayer perceptron adds a numeric slot embedding, while slot-dependent temporal offsets modify the group's rotary coordinates. The reference groups are prepended to noisy target tokens and serve as clean context during target-only flow-matching training. We implement this scheme through low-rank adaptation and release the resulting weights and inference workflows. Qualitative examples demonstrate compositions containing distinct characters and referenced environments in realistic and stylized scenes. Development observations suggest reduced reference confusion relative to an earlier continuous-reference baseline, while similar clothing, complex garments, and viewpoint changes remain challenging. We describe the conditioning mechanism, the retained training configuration, and the observed strengths and limitations of the released system. A supplementary audio-reference experiment adds voice conditioning while keeping the visual parameters frozen.
48. 【2609.18379】JigSync: Gauge-Resolved Synchronization for Jigsaw Reassembly under Unknown Piece Orientation
链接：https://arxiv.org/abs/2609.18379
作者：Soham Pahari,Antik Aich Roy,Ujjwal Bhattacharya
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Square jigsaw reassembly, Square jigsaw, jigsaw reassembly requires, pairwise relationships, spatial arrangement
备注：
点击查看摘要
Abstract:Square jigsaw reassembly requires recovering the spatial arrangement of shuffled fragments from their visual content and pairwise relationships. While recent studies have made substantial progress, existing benchmarks typically assume that all fragments are provided upright, reducing reassembly to a permutation problem. We study the generalized problem in which each fragment may also have gone through an unknown rotation. For this setting we establish a gauge-unobservability theorem: the minimum of the weighted least-squares objective is exactly invariant under a uniform global rotation of arbitrary magnitude, so no residual-based criterion can recover the global orientation. The theorem further identifies how the issue of global orientation can be resolved: an orientation anchor estimated from the content of a single fragment, lying outside its scope, suffices. To address the above, we propose JigSync, which attains 63.8% and 31.8% absolute accuracy (AA) on GAP-3 and GAP-5, respectively, the highest reported on both, while additionally recovering a rotation per piece that neither benchmark requires. We release JigSync, a degradation protocol that sweeps shape, erosion, photometry, grid size, and rotation independently.
49. 【2609.18363】Online Multi-Camera 3D Tracking via ID Prediction over Recurrent Sparse Queries
链接：https://arxiv.org/abs/2609.18363
作者：Pragyan Shrestha,Haruto Nakayama,Atom Scott
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Online multi camera, query-based trackers carry, maintain scene global, multi camera, tracking must maintain
备注：
点击查看摘要
Abstract:Online multi camera 3D tracking must maintain scene global identities across synchronized views, yet query-based trackers carry these identities only implicitly in the instance bank, where they fragment upon query interruption. We present an online architecture that recovers association accuracy by predicting IDs explicitly over recurrent sparse queries. An outside-in Sparse4D detector fuses calibrated views into world frame 3D detections while propagating a sparse query bank, and a causal MOTIP ID decoder associates detections against a finite trajectory memory. We adapt MOTIP's relative-ID prediction and recycled slot runtime to globally fused 3D observations, and introduce metric spatial gating and proximity based newborn recovery. On the official 2026 AI City Challenge Track 1 test set, our method raises HOTA from 29.63 with native instance bank identities to 38.01, primarily through an AssA increase from 20.83 to 31.10, and ranks third on the public leaderboard. Full-sequence validation over all 9,000 frames of each scene shows that decoupled ID training improves HOTA over native identities, whereas continuing detector training alongside the detached ID objective produces scene-dependent gains and losses.
50. 【2609.18345】Visual Input and Its Framing Affect Attribute-based Descriptions Produced by Large Vision-Language Models
链接：https://arxiv.org/abs/2609.18345
作者：Xiaomeng Wang,Martha Larson,Zhengyu Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large vision-language models, single text prompt, Large vision-language, text prompt, vision-language models
备注：
点击查看摘要
Abstract:Large vision-language models (LVLMs) are commonly used with only a single text prompt as the input, or plus an image. In this paper, we demonstrate that when the image exists, even if the text prompt is not about the specific instance (but only the concept it belongs to) in that image, the response would still be affected. For example, when the text prompt only asks for the attribute descriptions of a dog breed, an image depicting a specific dog from that breed would shift the response. Further, how the specific instance is framed in that image would determine towards which the response shifts. Detailed analyses also reveal that in the response, physical terms increase from 18% for text-only to 45% (40%) for subject-focused (subject-in-situation) framings. Overall, the unexpected effects of visual cues on LVLMs highlight the need to understand the presence of an image and its framing when evaluating the robustness of LVLMs.
51. 【2609.18336】Pose2Muscle: Structured Spatio-Temporal Decoding for Discrete Muscle Activity Estimation from Human Pose
链接：https://arxiv.org/abs/2609.18336
作者：Yuepeng Chen,Jiehong Shi,Kaili Zheng,Boyi Zhang,Chenyi Guo,Ji Wu,Xiangling Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Muscle activity, prevention and rehabilitation, discrete muscle activity, critical for injury, injury prevention
备注：
点击查看摘要
Abstract:Muscle activity is fundamental to human movement, and understanding its patterns is critical for injury prevention and rehabilitation. Conventional muscle activity monitoring relies on specialized sensors such as surface electromyography, which limits its practicality for long-term real-world use. Existing studies suggest that muscle-related information can be inferred from human pose. However, the substantial gap between externally observable pose and internal muscle activation, limits the accuracy and generalization of current approaches. In this study, we propose Pose2Muscle, a pose-driven framework for discrete muscle activity estimation without requiring sEMG signals at inference time. Instead of directly regressing continuous sEMG signals, Pose2Muscle reformulates muscle estimation as a structured prediction problem over discrete muscle activity states, yielding a more stable and interpretable target space. The framework combines multi-scale spatio-temporal attention to capture motion patterns at complementary spatial and temporal scales with a directed acyclic graph-based decoder that maintains multiple candidate muscle-state hypotheses and performs structured trajectory inference over time. To support this task, we construct PoseEMG-43, a synchronized pose-sEMG dataset containing 2,992 movement instances from 43 daily-life actions performed by 14 participants. Experiments show that Pose2Muscle consistently outperforms representative retrieval- and pose-based baselines. It achieves an Adjacent-level Accuracy of 86.36% and a Pearson correlation coefficient of 0.8821 under the Random Split, and 63.97% and 0.6795, respectively, under the Subject-Level Split. These results demonstrate the feasibility of inferring structured muscle-state patterns from human pose and suggest the potential of Pose2Muscle for muscle-aware movement analysis when direct physiological sensing is impractical
52. 【2609.18329】PDA++: Field-Aligned Planning and Scene-Adaptive Insertion in Remote Sensing
链接：https://arxiv.org/abs/2609.18329
作者：Xianchi Dong,Yingyan Hou,Chao Ren,Wanxuan Lu,Zihan Wei,Hongfeng Yu,Yixiao Wang,Chubo Deng,Xian Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing recognition, making realistic synthetic, Remote sensing, costly annotations, long-tailed scenarios
备注： Extended journal version of our ICML 2026 paper "Plan, Decouple, Assimilate: Physics-Aware Object Insertion in Remote Sensing Imagery"
点击查看摘要
Abstract:Remote sensing recognition is often constrained by scarce observations of rare targets and costly annotations, making realistic synthetic augmentation particularly valuable for few-shot and long-tailed scenarios. Object insertion provides an efficient way to increase target diversity while preserving authentic background scenes, but realistic insertion in overhead imagery requires the generated target to adapt coherently to its surrounding environment. To this end, we propose PDA++, a unified environment-aware object insertion framework organized as Plan, Decouple, and Assimilate. Planning determines scene-compatible poses through an affordance field that combines geometric clearance with structure- and scale-aware cues. Decoupling introduces a pose-conditioned background that provides precise spatial guidance together with target-scene context, allowing the reference object to preserve its identity while adapting to the target observation. This construction also naturally provides pixel-level masks for segmentation augmentation. Assimilation further improves local coherence by aligning multi-scale texture distributions through optimal transport. On the optical benchmark, PDA++ achieves a whole-image FID of 6.28 and improves average few-shot recognition mAP50 by 17.69 points, corresponding to a 28.8% relative gain over the real-data baseline. On SAR imagery, it improves ship detection by 4.10 mAP50 points and remains effective under cross-dataset transfer and amorphous-target insertion. Code is available at this https URL.
53. 【2609.18323】Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model
链接：https://arxiv.org/abs/2609.18323
作者：Haoyu Zhao,Zihao Zhao,Tianyu Deng,Ziqin Xu,Zihao Zhang,Xudong Wang,Jinxiang Guo,Chen Gao,Ziyi Ye,Yeying Jin,Jiaxi Gu,Zuxuan Wu,Shuicheng Yan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent Omni-Modal Generative, Omni-Modal Generative Models, Recent Omni-Modal, Generative Models, Omni-Modal Generative
备注： 17 pages, 14 figures
点击查看摘要
Abstract:Recent Omni-Modal Generative Models (Omni-Models) have advanced content generation toward unified modeling of text, images, video, and audio. MiniMax-H3 exemplifies this transition by combining multimodal context understanding with joint audio-visual generation in a shared latent framework. Its unified architecture raises a fundamental question: Can multimodal alignment improve the model's world reasoning, and what new evaluation paradigms do omni-modal inputs enable? To investigate this question, this work introduces a comprehensive evaluation framework organized around four complementary dimensions of physical world reasoning. Unlike existing evaluation frameworks for video generation and world models, which are often constrained by limited input modalities and evaluation settings where prompts closely match the target video content, our evaluation is specifically designed to exploit the multimodal inputs of Omni-Model. We construct a diverse set of novel tasks that require models to integrate complementary information across modalities. Specifically, we consider four scenarios, including implicit prompts paired with multiple frames, audio-image, prefix-videos, and audio-video inputs. Every single modality provides only partial evidence about the underlying event, requiring the model to jointly reason over the complementary semantic cues to infer latent event states and future dynamics. Across 517 evaluation instances, MiniMax-H3 achieves an overall success rate of 41.97%. Video-based Decision Reasoning yields the highest success rate at 56.00%, while Audio-based Disambiguation Reasoning is the weakest, reaching only 27.40%. These results indicate that effective multimodal integration remains key to fully exploiting the benefits of diverse input modalities. The project is available at this https URL.
54. 【2609.18302】Visual Autoregressive Priors for RAW-to-sRGB Image Signal Processing
链接：https://arxiv.org/abs/2609.18302
作者：Tailai Chen,Xiaotong Luo,Yuan Gao,Xin Jin,Wenjun Zeng
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)
关键词：missing camera metadata, imperfect spatial alignment, image signal processing, perceptually faithful colors, recover perceptually faithful
备注： Accepted at ECCV 2026 Workshop on Low-Level Vision Frontiers (LoViF). 13 pages, 4 figures
点击查看摘要
Abstract:RAW-to-sRGB image signal processing (ISP) must recover perceptually faithful colors and fine details from sensor measurements, often under imperfect spatial alignment and missing camera metadata. This paper presents, to the best of our knowledge, the first application of visual autoregressive (VAR) next-scale prediction over a discrete image codebook to the RAW-to-sRGB ISP task. We adapt a frozen 1.10\,B-parameter VAR backbone for RAW-conditioned ISP with only 32.93\,M trainable parameters (2.99\%), and propose a frequency-decomposed color loss that separately supervises low-frequency tone via wavelet LL cosine similarity and chromatic edges via detail-band $\ell_1$. On the Zurich RAW-to-sRGB benchmark, the method improves PSNR-Y from 21.31 to 21.89\,dB and reduces LPIPS from 0.276 to 0.218 on the full 1,204-image test set. Diagnostic experiments show that the VAR prior preserves structure well, but continuous color transfer remains the dominant bottleneck: oracle affine correction recovers 3.8\,dB, while learned color heads yield marginal gains.
55. 【2609.18279】Decoder-Agnostic Token Merging for Vision Transformers: A Systematic Study of G2TM
链接：https://arxiv.org/abs/2609.18279
作者：Victor Bercy,Martyna Poreba,Michal Szczepanski,Samia Bouchafa
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computer vision tasks, vision tasks, computer vision, Vision Transformers, range of computer
备注： Extended version of [this https URL](https://cea.hal.science/cea-05578363) , to be published in Communications in Computer and Information Science (CCIS), Springer. Codes are available at [this https URL](https://github.com/vbercy/g2tm)
点击查看摘要
Abstract:Vision Transformers (ViTs) have achieved state-of-the-art performance across a range of computer vision tasks, mainly thanks to the self-attention mechanism. However, its complexity, increasing quadratically with the number of tokens, remains the major obstacle to ViT efficiency and deployment at scale. Token merging reduces this cost by aggregating redundant tokens. Yet existing methods are typically evaluated within a single architecture, leaving open whether their effectiveness stems from the merging mechanism itself or from the specific decoder they are paired with. We extend Graph-Guided Token Merging (G2TM), a single module inserted early in a ViT-based network, beyond its original Segmenter setting. We evaluate G2TM across three semantic segmentation frameworks (Segmenter, SETR, EoMT) and three decoder families (Linear, Transformer-, convolution-based), as well as standard ViT image classification. Our results show that G2TM's behavior and accuracy-efficiency trade-off are consistent across every tested architecture for a given backbone size, indicating that its effectiveness is a property of the encoder rather than the decoder. G2TM also generalizes well to image classification, achieving an even smaller degradation in accuracy compared to semantic segmentation. We further find that G2TM's optimal hyperparameters, resulting in a consistent drop in GFLOPs of 22-47% and an increase in throughput by up to 74% for segmentation models on ADE20K dataset, depend primarily on the backbone's pre-training recipe and on the target dataset, rather than on the decoder choice.
56. 【2609.18260】MS-RFD: Multi-Signal Release Frame Detection in Hammer Throw from Reconstructed 3D Trajectories
链接：https://arxiv.org/abs/2609.18260
作者：Ahmed Endris Hasen,Nikolaos Passalis,Tomi Vanttinen,Jenni Raitoharju
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sports performance analysis, reshaping sports performance, Recent advances, enabling automated detection, performance analysis
备注： 6 pages, 4 figures
点击查看摘要
Abstract:Recent advances in artificial intelligence and computer vision are reshaping sports performance analysis by enabling automated detection, tracking, and performance analysis. In hammer throw, performance is strongly determined by the kinematic conditions at release, particularly release speed, release angle, and release height. However, identifying the release instant from video typically requires manual frame-by-frame inspection, which is subjective and cumbersome in real-world training scenarios. In this paper, we present a fully automatic multi-signal release frame detection (MS-RFD) method for hammer throw using reconstructed 3D hammer trajectories. The proposed method integrates four complementary kinematic signals: speed dynamics, angular velocity transition, radial distance relative to the rotation center, and post-release trajectory linearity. These signals are fused to score and verify candidate release frames. MS-RFD is evaluated through the throwing-distance estimation error obtained from the release parameters estimated at the detected frame. An ablation study analyzes the contribution of each signal and compares alternative candidate selection strategies. The results show that speed dynamics and radial expansion provide the strongest signals for release frame detection, while angular velocity and post-release linearity provide smaller refinements.
57. 【2609.18259】${M}^2$Tok: Multi-head Multi-codebook Discrete Action Tokenization for Vision-Language-Action Models
链接：https://arxiv.org/abs/2609.18259
作者：Chunpu Xu,Zhixuan Liang,Yuhao Zhang,Chi-Min Chan,Jessie Wang,Yang Xiao,Mengkang Hu,Xiaokang Yang,Yao Mu
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：successfully adapted autoregressive, adapted autoregressive language, process multimodal signals, Recent advancements, autoregressive language models
备注： ECCV 2026
点击查看摘要
Abstract:Recent advancements have successfully adapted autoregressive language models to process multimodal signals, such as images and actions. Since raw action signals are continuous, effective tokenization is essential to map high-dimensional inputs into compact discrete tokens for autoregressive processing. However, existing discrete action tokenizers often suffer from high reconstruction loss, failing to preserve the fine-grained dynamics required for precise control. This ``discretization bottleneck'' significantly limits the performance ceiling of downstream Vision-Language-Action (VLA) models. To address this, we propose $\mathcal{M}^2$Tok, a Multi-head Multi-codebook Action Tokenizer designed to minimize reconstruction error and enhance policy performance. Our approach introduces two key structural innovations: (1) we decompose the latent action features into multiple heads, enabling the model to implicitly align specific heads with distinct action dimensions; (2) we assign independent codebooks to each head for quantization. By leveraging the combinatorial nature of multiple codebooks, we significantly expand the representational expressivity of the tokenizer, leading to substantially lower reconstruction loss compared to previous methods. We evaluate the $\mathcal{M}^2$Tok-based VLA on the RoboTwin, Simpler-Env, and 3 zero-shot real-world tasks. Experimental results demonstrate our method not only achieves superior reconstruction fidelity but also significantly boosts the success rate of VLA models. Comprehensive ablation studies further confirm the effectiveness of the multi-head and multi-codebook mechanisms. Code is available at \href{this https URL}{this https URL}.
58. 【2609.18256】Evolving Error States: Failure-Aware Progressive Repair for Ultrasound Lesion Segmentation
链接：https://arxiv.org/abs/2609.18256
作者：Ziliang Wang,XuJiang Tang,Lu Yuting,Weixin Xu,Yongqiang Zhao,Ying Fu,Kehua Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reliability under sparse, heterogeneous failures remains, medical image segmentation, sparse and heterogeneous, remains a fundamental
备注：
点击查看摘要
Abstract:Reliability under sparse and heterogeneous failures remains a fundamental challenge for medical image segmentation. High average accuracy can conceal a small set of structurally distinct and clinically consequential errors. Existing post-hoc correction methods alleviate this problem, but typically estimate false-positive and false-negative corrections from the same fixed prediction. This ignores the dynamic evolution of error states and limits the correction of complex cases. Inspired by iterative error feedback in structured prediction, we propose Failure-Aware Progressive Repair (FAPR). FAPR represents the current segmentation mask as a dynamic failure state and models each repair operation as a state-transition operator. Each accepted correction forms a new prediction state for subsequent error diagnosis and repair, enabling later operations to adapt to preceding changes. Conditional routing selectively activates necessary state transitions, while failure replay exposes the model to rare error states. By keeping the base segmentor frozen, FAPR preserves its established segmentation capability while improving difficult cases. Across three public ultrasound lesion segmentation benchmarks, FAPR improves mean DSC by 1.52%. On the very-hard subsets of BUSI and TN3K, the average gain reaches 13.77%.
59. 【2609.18239】Unified Response Geometry for Structured Pruning
链接：https://arxiv.org/abs/2609.18239
作者：Kaixiang Shu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：ranking individual channels, individual channels, downstream mixing, commonly formulated, formulated as ranking
备注：
点击查看摘要
Abstract:Structured pruning is commonly formulated as ranking individual channels, although channel responses can be complementary or cancel through downstream mixing. Motivated by these response interactions, we formulate pruning as the selection of a subset with large joint response capacity, followed by a separate functional realization step. Our unified response geometry maps each candidate set to \(M(D,R)=D^{1/2}RD^{1/2}\) and uses its determinant together with Schur-greedy residuals to select non-redundant coordinates. The same construction yields two information-conditioned instances: an unlabeled instance based on activation covariance, and a task-conditioned instance that combines activation and gradient variance for response scale with gradient correlation for complementarity. To convert the selected subset into an executable network, we fold predictable removed responses into successor weights through ridge compensation and recalibrate batch-normalization statistics, without fine-tuning the network. On ImageNet ResNet-50, the unlabeled instance reaches \(65.4\%\) and \(53.9\%\) Top-1 accuracy at 30\% and 40\% deletion, versus \(59.8\%\) and \(43.1\%\) for strength-only selection; the task-conditioned instance reaches \(67.7\%\) and \(56.3\%\) under the same protocol. A six-family screen shows architecture-dependent behavior, with positive relative contrasts in several convolutional and expansion-layer settings and clear boundary cases in windowed attention. These results support response geometry as a conditional principle for structured pruning, with its benefit determined jointly by the observed response and the architecture in which that response is realized.
60. 【2609.18227】WISE: A Lightweight, Weakly-Supervised Model for Onboard Fire Smoke Detection and Localization
链接：https://arxiv.org/abs/2609.18227
作者：Sha Lu,Yu Sun,Liang Zhao,Jixue Liu,Lin Liu,Jiuyong Li,A. K. Qin,Alejandro Mousist,Stefan Peters
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：rapid response, critical for early, early warning, warning and rapid, Weakly-supervised Inference-efficient Smoke
备注： Accepted manuscript. 35 pages, 4 figures
点击查看摘要
Abstract:Wildfire smoke detection from satellite imagery is critical for early warning and rapid response. For onboard satellite deployment, detection systems must operate under strict memory and latency constraints while providing spatially informative outputs for downstream decision-making. Existing tile-level classification methods are computationally efficient but lack spatial localization, whereas pixel-level segmentation approaches provide detailed masks yet are typically too computationally demanding for real-time onboard execution. To address this gap, we propose WISE (Weakly-supervised Inference-efficient Smoke Extraction), a deployment-oriented framework for onboard fire smoke detection and localization. WISE leverages only tile-level annotations through a teacher-student distillation strategy, where an offline teacher provides soft spatial supervision to a lightweight WISE-Student optimized for efficient onboard inference. The student jointly predicts tile-level smoke presence and smoke probability maps within a single forward pass, enabling spatially informative detection under strict computational constraints. WISE was evaluated through in-orbit execution aboard the ISS-mounted IMAGIN-e payload. Three model variants achieve average inference times of 0.10 s, 0.14 s, and 0.26 s per tile, indicating near-real-time per-tile inference within onboard resource limits. Ground-based experiments on Landsat 5 and Landsat 8 imagery further indicate effective detection and spatially informative localization. The best-performing variant achieves a mean tile-level F1 score of 0.964 and a mean pixel-level F1 score of 0.750 across 10 runs, while containing only 0.12M parameters and requiring approximately 3 GFLOPs. Together, these results indicate that WISE is a practical candidate for low-latency wildfire smoke monitoring from space under onboard resource constraints.
61. 【2609.18212】A Lightweight CNN Integrated Compact Convolutional Transformer for Multi-Scale Feature Learning and reducing computational complexity for breast cancer mammography image detection and classification
链接：https://arxiv.org/abs/2609.18212
作者：Md Taimur Ahad(Department of Management North South University, Dhaka, Bangladesh),Ainuddin Ahmed(Department of Management North South University, Dhaka, Bangladesh)
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Convolutional Neural Networks, Neural Networks, demonstrated strong capability, Convolutional Neural, Compact Convolutional Transformer
备注：
点击查看摘要
Abstract:Over the years, Convolutional Neural Networks (CNNs) have demonstrated strong capability in cancer detection and classification using medical images. However, CNN-based models often struggle to capture long-range contextual dependencies. In such scenarios, integrating Compact Convolutional Transformer (CCT) architectures after the CCT layer allows CNN-extracted features to reshape into compact patch tokens using a CCT tokenizer, followed by the addition of positional embeddings to preserve spatial structure. Using 5-fold cross-validation, the model was tested on 3 sets of breast cancer mammography. With only 250,435 parameters, the model achieved 99%-100% accuracy across 3 datasets, indicating robust generalization. Explainable AI (XAI) was integrated into the model to explain the breast cancer classification process to enhance clinical trust. The results indicate that the proposed framework is suitable for computer-aided diagnosis systems, particularly in resource-constrained clinical environments. The novelty of the proposed CNN-integrated CCT overcomes the limitation of CNN's gradient degradation in the last layers by integrating convolutional tokenization with transformer-based learning. Lighter than ViT, which is effective in capturing long-range dependencies, the model has also proven efficient in breast cancer classification by capturing long-range dependencies among breast tissue regions.
62. 【2609.18210】Understanding Dynamic Scenes at Gigapixel Scale: Wide-Area Spatio-Temporal Perception from UAVs
链接：https://arxiv.org/abs/2609.18210
作者：Yuhang Zhu,Meiyi Zhu,Yunkai Dang,Zhangnan Li,Yuxuan Wang,Wenbin Li,Hongbing Pan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：shifting aerial perception, recognizing individual targets, understanding entire dynamic, entire dynamic scenes, Spatio-temporal Scene Understanding
备注： 9 pages, 5 figures, 3 tables
点击查看摘要
Abstract:UAV-borne imaging has advanced from megapixel to gigapixel sensors, shifting aerial perception from recognizing individual targets to understanding entire dynamic scenes. We characterize this demand as Wide-area Spatio-temporal Scene Understanding (WSTU), which requires wide-area coverage, per-target resolution, and temporal continuity at once, a combination existing datasets lack. To fill this gap, we introduce an ultra-High-resolution (12768x9564) Airborne Remote-sensing Dataset (HARD) annotated at three levels for object detection, multi-object tracking, and scene-level visual question answering. Ultra-high-resolution imagery raises per-frame processing time to seconds. At that scale latency can no longer be ignored in evaluation. Thus, we propose a latency-aware metric for multi-object tracking called streaming-HOTA (s-HOTA). Extensive baseline experiments show how ultra-high-resolution processing reshapes each task. For detection, the end-to-end pipeline affects accuracy and speed as much as the detector itself does. For tracking, high latency charges the association axis far more unevenly than the detection axis, and association is where pipelines diverge. As a result, the pipeline that performs best offline can lose its lead under s-HOTA. For VQA, vision-language models remain weak at cross-frame identity binding and cannot transfer their single-frame gains to it. Together these findings show that the baselines we evaluate fall short of WSTU. HARD provides the data and the systematic baselines to advance it.
63. 【2609.18206】CapMap-MS-TTA: 3rd Place Solution for the MUMU Track of the 8th LSVOS Challenge at ECCV 2026
链接：https://arxiv.org/abs/2609.18206
作者：Chengfeng Qiu,Kaifeng Wei
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large-scale Video Object, Video Object Segmentation, peak GPU memory, Large-scale Video, solve image tagging
备注：
点击查看摘要
Abstract:The MUMU track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge requires a single unified multimodal model to jointly solve image tagging (Task A), open-vocabulary object detection (Task B), and English captioning (Task C) under strict resource constraints (=0.5B parameters and =8 GB peak GPU memory). We present CapMap-MS-TTA, a training-free submission built on Microsoft Florence-2-base (~231M parameters), combining caption keyword mapping with multi-scale flip test-time augmentation. Task C uses the native DETAILED_CAPTION pathway with length/token sanitization. Task A maps the same detailed caption into the official quality/scene/event vocabularies via an expanded keyword lexicon with whole-word matching and a lightweight expand-hints stage. Task B runs Florence-2 open detection (OD) with multi-scale and horizontal-flip test-time augmentation (TTA), followed by label-aware non-maximum suppression (NMS). Without fine-tuning, the system improves our reproduced Florence-2 baseline from 15.16 to a best public score of 16.4815, and ranks 3rd on the final MUMU leaderboard.
64. 【2609.18164】Energy-Regularized Imitation Learning for Force- and Work-Aware Robotic Manipulation
链接：https://arxiv.org/abs/2609.18164
作者：Toshiki Otani,Hiromu Taketsugu,Norimichi Ukita
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：grounded learning problem, paper studies energy-aware, studies energy-aware manipulation, physically grounded learning, learning problem
备注： ECCV 2026 Workshop on Force-Grounded, Cross-View Articulated Manipulation
点击查看摘要
Abstract:This paper studies energy-aware manipulation as a physically grounded learning problem. We define a joint-space mechanical-work proxy from joint torque and angular displacement, and train a differentiable energy predictor that estimates this work from robot states and actions. The predictor converts a non-differentiable simulator-side physical quantity into a differentiable regularizer for fine-tuning a pretrained manipulation policy. We instantiate the framework with RVT-2 on RLBench and evaluate 12 manipulation tasks involving object contact, articulated motion, placement, pushing, and sweeping. The proposed fine-tuning reduces the average mechanical work from 208.8J to 204.4J (i.e., 2.1% reduction), while the mean task success rate also increases slightly from 86.2% to 86.9%. These results show that work-aware policy optimization can suppress physically inefficient motion without requiring an explicit differentiable dynamics model.
65. 【2609.18139】Multi-View Mixture-of-Experts with Vision-Language Reranking for Cross-View Object Geo-Localization
链接：https://arxiv.org/abs/2609.18139
作者：Xuyu Fan,Qi Ming,Zhu Han,Liuqian Wang,Siyuan Cao,Xiaohan Zhang,Xudong Zhao,Mingjing Zhao,Yuhan Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cross-view object geo-localization, object geo-localization, locates a target, street-view queries, imagery using drone
备注：
点击查看摘要
Abstract:Cross-view object geo-localization (CVOGL) locates a target in satellite imagery using drone or street-view queries. Existing methods train separate detectors for each viewpoint, leading to parameter redundancy and impeding cross-view knowledge sharing. Moreover, top-ranked satellite candidates are often visually similar, so visual appearance and categorical labels alone are insufficient to resolve such ambiguity. To address these, we propose MVLGeo, an efficient framework designed to unify multiple viewpoints and reduce model redundancy. First, we introduce environmental contextual text from the query view as cues to distinguish visually similar candidates via Vision-Language Reranking (VL-Rerank). Second, we design a multi-view Mixture-of-Experts architecture (MV-MoE) with a shared encoder and view-specific experts to reduce redundancy and promote knowledge sharing, while cross-view contrastive learning aligns their representations for consistency. Third, we introduce an adaptive elliptical prior (ESAM-Prior) as auxiliary positional encoding for anisotropic geometric perception. Extensive experiments on the CVOGL benchmarks confirm that MVLGeo, as a unified model for multiple query viewpoints, achieves state-of-the-art performance, demonstrating robustness to input degradation and generalization across viewpoints. Code and models will be available on GitHub to facilitate future work.
66. 【2609.18133】Stealthy in Semantics, Antagonistic in Space: Attacking Visible-Infrared Object Detectors via Object-Level Misalignment
链接：https://arxiv.org/abs/2609.18133
作者：Yueqi Zhu,Qi Ming,Guo Cheng,Yongkang Zhang,Feiran Liu,Juan Fang,Jiahuan Zhou,Jiangmeng Li,Yuhan Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visible-infrared object detectors, weather conditions, robust perception, perception under challenging, challenging illumination
备注：
点击查看摘要
Abstract:Visible-infrared object detectors are used for robust perception under challenging illumination and weather conditions. Current physical attacks apply conspicuous patches to spatially aligned target regions, which are noticeable to human observers. Meanwhile, most of these methods only perturb the appearance within the aligned region, without explicitly targeting the correspondence between modalities or the fusion process. In this paper, we propose CamoShift, an adversarial framework for visible-infrared object detection. By combining visual camouflage with object-level infrared shifting, CamoShift breaks cross-modal spatial alignment and disrupts fusion. Specifically, the Semantic Camouflage Module (SCM) generates a stealthy camouflaged patch that can be attached to the host object and maintains its effectiveness in the infrared branch through an RGB-IR adapter. The Object-level Spatial Decoupling Module (OSDM) shifts the infrared target evidence in a scale-aware manner, so as to break object-level correspondence and disrupt cross-modal fusion. Then, the Harmonic Adversarial loss (HarAdv loss) further balances attack strength and visual stealth during optimization. To the best of our knowledge, we are the first to target both visual stealthiness and attack success in visible-infrared object detection. Extensive experimental results show that CamoShift achieves a superior balance between attack effectiveness and visual stealth. Code and models will be available on GitHub.
67. 【2609.18129】MCLC-NET: Multimodal Continual Learning for Leaf Counting
链接：https://arxiv.org/abs/2609.18129
作者：Ruchi Bhatt,Pratibha Kumari,Shreya Bansal,Vedant Agnihotri,Dwarikanath Mahapatra,Mukesh Saini
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：monitoring plant growth, estimating crop yield, plant phenotyping, monitoring plant, plant growth
备注：
点击查看摘要
Abstract:Leaf counting is an important task in plant phenotyping for monitoring plant growth and estimating crop yield. Most existing methods rely on RGB images, but their performance is often affected by occlusion, lighting variations, and other real-world challenges. Additional modalities, such as depth and thermal images, can provide useful complementary information. However, multimodal leaf counting remains underexplored. Also, many existing methods assume that all training data are available simultaneously, which is impractical in real agricultural settings, where data is collected over time from multiple sources. To address these challenges, we propose MCLC-NET, a multimodal continual learning framework for leaf counting. It learns tasks sequentially using a memory-based strategy with a memory buffer to retain important samples from previous tasks. We also introduce MMLC, a real-world multimodal leaf-counting dataset designed for a domain incremental scenario (DIS) in CL. It contains RGB, depth, and thermal images collected across different crop types under varying environmental conditions, arranged in three orderings: crop-wise, time-wise, and mixed. Experimental results, averaged over three random seeds, demonstrate that MCLC-NET consistently outperforms existing methods across all three task orderings, achieving the lowest AMSE of 0.675$\pm$0.027, 0.542$\pm$0.069, and 0.745$\pm$0.057, respectively.
68. 【2609.18125】PRISM: Predictive Representation of Interaction Style and Motion for Social Robot Navigation
链接：https://arxiv.org/abs/2609.18125
作者：Bo-Han Chen,Hiromu Taketsugu,Norimichi Ukita
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：interacting and adjust, adjust their behavior, Predictive Representation, Style and Motion, Abstract
备注： ECCV 2026 Workshop on Agent in World
点击查看摘要
Abstract:Humans often observe others before interacting and adjust their behavior accordingly. Robot navigation in crowds, however, often represents pedestrians mainly by observed geometric states, leaving individual differences in interaction tendencies implicit. We propose PRISM (Predictive Representation of Interaction Style and Motion), a framework that infers interaction traits from passive observations of human-human interactions. PRISM encodes human trajectories into a continuous ordinal latent space with a transformer encoder trained by Rank-N-Contrast loss, and pairs each inferred trait with a temporal-stability score supplied to the navigation policy. In randomized crowd simulations, PRISM reduces collision rates over the geometry-only baseline and yields small improvements in navigation-time and path-length metrics. These results suggest the utility of passive latent-trait inference for social navigation in dynamic crowds.
69. 【2609.18124】Aligned Consensus Teaching for Label-Efficient Oriented Object Detection in Weakly-Aligned Visible-Infrared Imagery
链接：https://arxiv.org/abs/2609.18124
作者：Qi Ming,Xiaxin Yuan,Jiahuan Zhou,Jiangmeng Li,Xudong Zhao,Zhanchao Huang,Juan Fang,Shaoguang Huang,Aleksandra Pizurica
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visible-infrared object detection, Visible-infrared object, oriented bounding boxes, detects objects, infrared images
备注：
点击查看摘要
Abstract:Visible-infrared object detection (VIOD) detects objects with oriented bounding boxes from paired visible and infrared images. Existing methods depend on costly dual-modality annotations. Semi-supervised learning can reduce this burden, but extending it from single-modal detection to VIOD is challenging. In the practical image-pair-level setting considered here, only a few pairs are labeled in both modalities, while the rest are completely unlabeled. This limited supervision creates three challenges: (i) too few labeled boxes for robust cross-modal alignment; (ii) pseudo-label errors caused by branch-wise misses accumulate during self-training; and (iii) tail-class annotations become critically scarce as the labeling budget decreases. We propose Aligned Consensus Teacher (ACT) for label-efficient VIOD in this setting. Its Cycle-Consistent Region Alignment (CRA) combines cycle consistency and sparse anchors with reliability-weighted regional matching. Cross-Modal Consensus Mean-Teacher (CMC-MT) forms consensus pseudo labels under pair-preserving views to recover branch-wise misses and supervise unlabeled pairs. Text-Guided Cross-Modal Instance Augmentation (TG-CMIA) uses a vision-language scene prior to compose tail-class instance pairs while preserving RGB--IR offsets. To the best of our knowledge, ACT is the first framework to study semi-supervised VIOD under this image-pair-level setting. Experiments on DroneVehicle and VEDAI show consistent gains across annotation ratios. With 10\% labeled pairs on DroneVehicle, ACT reaches 94.3\% of the mAP obtained by the same detector under full supervision. Code and models will be available on GitHub to facilitate future work.
70. 【2609.18111】A Comprehensive Review of Generative Physical Artificial Intelligence
链接：https://arxiv.org/abs/2609.18111
作者：Satyam Gaba,Krutiksinh Rana,Siva Sai,Vinay Chamola,Dusit Niyato
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Physical Artificial Intelligence, Generative Physical Artificial, Artificial Intelligence, Generative Physical, Physical Artificial
备注： 25 pages, 8 figures
点击查看摘要
Abstract:The integration of large-scale foundation models with physical embodiments has led to significant advancements in robotics known as Generative Physical Artificial Intelligence (GPAI). These agentic AI systems autonomously perceive, reason, and act in complex real-world situations. This survey comprehensively analyzes GPAI systems, focusing on their architectural foundations, current applications, and key limitations. We introduce a taxonomy of five distinct approaches: Robot Foundation Models (RFMs) for cross-platform skill transfer; Vision-Language Action (VLA) models for end-to-end multi-modal perception and control; Large Behavior Models (LBMs) for human-like movement generation; Diffusion Policy Models (DPMs) for diffusion model-based temporally coherent action generation; and World Foundation Models (WFMs) for physics-compliant simulation and data generation. We examine how these approaches complement each other: WFMs generate training data for VLAs and DPMs, RFMs enable cross-platform deployment of learned policies, while LBMs provide motion priors for natural behavior. Through examples across autonomous vehicles, industrial automation, healthcare robotics, and humanoid systems, we identify significant performance improvements and summarize promising research directions in data-efficient learning, sim-to-real transfer, edge-compatible architectures, and safety frameworks. These insights advance embodied AI for IoT-connected environments where intelligent agents interact with networked sensors, actuators, and edge devices.
71. 【2609.18100】Beyond Pixel Similarity: Task-Aware Evaluation of GAN-Based Synthetic Sonar Data for Robotic Perception
链接：https://arxiv.org/abs/2609.18100
作者：Hannan Ejaz Keen,Muhammad Moazam Fraz,Karsten Berns
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：perception remains challenging, annotating training data, downstream perception remains, synthetic sonar data, remains challenging
备注： Accepted at Sim2Real and Classical Control: From Rigorous Theory to Data-Driven Robotics - IROS Workshop 2026
点击查看摘要
Abstract:Synthetic data can reduce the cost of collecting and annotating training data for robotic perception, but generating sensor observations that preserve the characteristics relevant to downstream perception remains challenging, particularly for sonar imagery. In this work, we investigate whether conventional image-fidelity metrics adequately reflect the downstream perception performance of GAN-generated synthetic sonar data. We employ a Pix2Pix conditional generative adversarial network with four discriminator configurations characterized by different receptive fields: PixelGAN, PatchGAN-16, PatchGAN-70, and ImageGAN. The models are trained using sonar imagery from two datasets and evaluated using conventional image-fidelity metrics, including Structural Similarity Index (SSIM), Peak Signal-to-Noise Ratio (PSNR), and Mean Squared Error (MSE). To complement these pixel-level measures with task-oriented evaluation, YOLOX-S, YOLOX-L, and Faster R-CNN detectors are trained exclusively on real sonar imagery and subsequently evaluated on the GAN-generated images using identical test samples and annotations across all discriminator configurations. The results reveal a discrepancy between image-fidelity and downstream object-detection performance: the configuration achieving the best SSIM, PSNR, and MSE does not consistently yield the best detection performance. In particular, PatchGAN configurations achieve strong downstream detection results despite not achieving the highest pixel-level similarity scores. These findings suggest, for the datasets and models considered, pixel-level image-fidelity metrics alone may not consistently capture the task-relevant realism of synthetic sonar observations and motivate the use of task-aware evaluation for synthetic sensor data intended for robotic perception.
72. 【2609.18088】Mask 2D-3D: Adaptive Dual-Masked Autoencoder Network for Image-to-Point Cloud Registration
链接：https://arxiv.org/abs/2609.18088
作者：Zhixin Cheng,Jiacheng Deng,Xiaotian Yin,Baoqun Yin,Richang Hong,Tianzhu Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：erroneous correspondences caused, Detection-free methods, prone to erroneous, caused by domain, presence of non-overlapping
备注：
点击查看摘要
Abstract:Detection-free methods for image-to-point cloud registration are prone to erroneous correspondences caused by domain and modality discrepancies, limited sensitivity of feature extractors, and the presence of non-overlapping regions. The Masked Autoencoder (MAE) has shown strong performance in visual representation for images and point clouds. It may be helpful to apply this approach to image-to-point cloud registration, a task that requires unified feature extraction and accurate cross-modal correspondences. Standard MAE's random masking may overlook key regions due to limited camera views, reducing registration effectiveness. To address this, we propose the Intermodal Dual-MAE Framework (ID-MAE) with a Similarity-based RL Masking Strategy (SRLM), which adaptively masks informative positions by leveraging cross-modal similarity and reinforcement learning, thus narrowing the modality gap. Our method enhances cross-modal representation learning by enforcing representation consistency during feature extraction, thereby enabling more reliable 2D-3D correspondence estimation. Experiments on RGB-D Scenes v2 and 7-Scenes benchmarks show that our method achieves state-of-the-art performance in image-to-point cloud registration.
73. 【2609.18084】Not All Layers Need Tuning: Diagnosing and Directing Adaptation in Vision-Language-Action Models
链接：https://arxiv.org/abs/2609.18084
作者：Shahram Najam Syed,Arthur Jakobsson,Prayuj Sachdev,Jeffrey Ichnowski
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：methods apply uniform-capacity, apply uniform-capacity adapters, requires equal adjustment, environment is expensive, methods apply
备注： 9 pages, 7 figures, 7 tables
点击查看摘要
Abstract:Fine-tuning a Vision-Language-Action (VLA) model for a new deployment environment is expensive, yet most methods apply uniform-capacity adapters to every network region as if every region requires equal adjustment. This paper tests that assumption on five architecturally diverse VLAs (OpenVLA-OFT, $\pi_0$, SmolVLA, DTP, Octo; 93M-7B parameters). Measuring per-region adaptation cost as normalized parameter displacement under region-isolated fine-tuning reveals an adaptation spectrum in which appearance shifts concentrate cost in the vision encoder, instruction shifts in the language backbone, and novel-object shifts in the vision encoder together with the action head, across all five architectures. To exploit this structure, we introduce a pipeline that observes, diagnoses, allocates, and adapts. From ten unlabeled target observations and without fine-tuning, the diagnostic estimates per-region cost by combining reference-free gradient and Monte Carlo Dropout signals with a Centered Kernel Alignment score against a cached source reference; the allocator converts the estimates into variable-rank LoRA adapters under a parameter budget and freezes well-calibrated regions; and standard LoRA fine-tuning trains the resulting adapters. The diagnostic ranks regions within each deployment at a median Spearman of 0.91, and the allocation matches or exceeds uniform LoRA at every budget we tested on LIBERO and CALVIN. On a physical xArm-7, the pipeline matches full fine-tuning under an instruction-wording shift with 0.04% of its trainable parameters, and on five held-out scenes evaluated without retraining it leads every baseline, with 11-23 successes of 30 rollouts against 8-18 for the strongest parameter-efficient baseline at equal or larger budgets and 2-11 for full fine-tuning. These results suggest that adaptation cost in VLAs is structured enough to measure before fine-tuning begins.
74. 【2609.18077】vidax: A Unified JAX Framework for Video Generative Models on Accelerator Meshes
链接：https://arxiv.org/abs/2609.18077
作者：Congyue Deng
类目：Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
关键词：CUDA reference implementations, generative models ship, CUDA reference, ship almost exclusively, Open-source video generative
备注：
点击查看摘要
Abstract:Open-source video generative models ship almost exclusively as PyTorch/CUDA reference implementations. This leaves Cloud TPU pods without a production-ready inference path, despite offering large, cost-effective accelerator memory pools ideal for long-sequence spatiotemporal attention. We present vidax, an open-source JAX/Flax inference engine and zero-copy PyTorch-to-JAX weight translator for modern video generation architectures. vidax covers a diverse set of spatiotemporal models --- including Diffusion Transformers, omnimodal Mixture-of-Transformers, 3D VAEs, text encoders, and native samplers --- with zero PyTorch dependency in the execution path. The framework unifies 1D tensor parallelism with DeepSpeed-Ulysses sequence parallelism on a single JAX sharding mesh, integrates TPU flash-attention kernels, and implements per-layer weight offloading to support reference resolutions that exceed single-device memory. We benchmark compile times, latency, and peak memory utilization on TPU v4-8 hardware, and document real-world numerical bugs surfaced during checkpoint translation. vidax is released open-source as a baseline for JAX and TPU video generation research.
75. 【2609.18069】GeoCueFormer: Geometry-Guided Wavelet Representation and Prediction-Cued Dual-Stage Decoder for Underwater Semantic Segmentation
链接：https://arxiv.org/abs/2609.18069
作者：Xian Wu,Xinjin Li,Yiliu Xu,Yining Liu,Yong Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：marine ecosystem monitoring, severe visual degradation, remains challenging due, ecosystem monitoring, visual degradation
备注： 14 pages, 5 figures, conference paper
点击查看摘要
Abstract:Underwater semantic segmentation is essential for marine ecosystem monitoring, yet remains challenging due to severe visual degradation. Light absorption and scattering often lead to color shifts, low contrast, and blurred boundaries, making shallow detail features unreliable. Existing underwater segmentation methods improve RGB feature aggregation or boundary prediction, but still lack an explicit mechanism to distinguish structure-related details from degradation-induced responses. To address this limitation, we propose GeoCueFormer, a lightweight framework that combines geometry-constrained frequency enhancement with prediction-cued refinement. GeoCueFormer performs stage-specific wavelet enhancement on hierarchical encoder features to complement shallow boundary details while preserving deep structural semantics. A depth-derived spatial gate constrains shallow frequency enhancement toward geometry-consistent regions, and a prediction-cued dual-stage decoder further refines ambiguous high-resolution features. GeoCueFormer obtains 82.23% and 73.04% mIoU on SUIM and DUT, respectively. Under comparable model complexity and standard benchmark settings on SUIM and DUT, it achieves SOTA performance while maintaining a favorable accuracy-complexity trade-off. These results show that distinguishing structural details from degradation-induced interference is more effective for underwater segmentation.
76. 【2609.18058】Finder: Agentic Closed-Loop Object Finding for Embodied Grounding
链接：https://arxiv.org/abs/2609.18058
作者：Shixiong Xu,Zhiyuan Chen,Song Ding,Rui Luo,Xiaowei Liang,Dongxu Miao,Zhiying Du
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：partially observed, core capability, Finding, embodied agents, Finding the object
备注：
点击查看摘要
Abstract:Finding the object referred to by language in a partially observed 3D scene is a core capability for embodied agents. Existing approaches either couple object search with online exploration, which can be costly when relevant observations have already been captured, or query pre-built open-vocabulary maps and scene graphs in a static, one-shot fashion. We present Finder, an agentic closed-loop object-finding primitive for embodied grounding. Instead of treating grounding as passive retrieval from a fixed scene representation, Finder maintains a typed loop state that links query-conditioned planning, scoped evidence gathering, candidate verification, and accept/continue/abort control. When evidence is incomplete or ambiguous, the loop can redirect subsequent perception and comparison rather than simply returning the top retrieved object. On open-vocabulary embodied Object Retrieval in Habitat/HM3D and real-world RGB-D scenes, Finder improves the averaged 1m success rate by 15.75 points over strong baselines. The same primitive also transfers to sequential object grounding and embodied object-centric question answering, improving spatial and temporal localization without changing the inner grounding protocol. Project page: this https URL.
77. 【2609.18056】Position Anchor Tuning: Towards Efficient Adaptation of Pre-Trained Point Cloud Transformers
链接：https://arxiv.org/abs/2609.18056
作者：Zheng Liu,Xin Gao,Jinchao Zhu,Gao Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diverse downstream tasks, pivotal research direction, Parameter-efficient fine-tuning, adapting pre-trained point, pre-trained point cloud
备注： 10 figures, 7 tables
点击查看摘要
Abstract:Parameter-efficient fine-tuning (PEFT) has recently emerged as a pivotal research direction for adapting pre-trained point cloud transformers to diverse downstream tasks. Although existing methods achieve excellent fine-tuning performance with high parameter efficiency, they ignore inference efficiency. To tackle this problem, a novel PEFT method termed position anchor tuning (PAT) is proposed in this paper. As multi-head attention (MHA) and feed-forward network (FFN) are computation-heavy blocks in pre-trained transformers, PAT decreases their computational cost through token aggregation-expansion pairs. Each pair comprises a token aggregation module (TAM) and a token expansion module (TEM). For MHA and FFN blocks, TAMs extract representative tokens from their input tokens based on position anchors in 3D space. These extracted tokens, rather than the original input tokens, are processed by the blocks, thereby reducing the number of tokens involved in computation. Then, TEMs propagate the learned representations back to the original input tokens. Since TAMs are solely responsible for capturing task-specific representations, base-sharing low-rank adaptation (BSLoRA) is further introduced to enable them to learn such representations effectively with only a small number of trainable parameters. Extensive experiments on widely used benchmarks demonstrate that PAT performs comparably to state-of-the-art methods while incurring significantly lower computational overhead and fewer trainable parameters.
78. 【2609.18038】CoAtNet-DeepMoE: A Convolution-Attention Hybrid with DeepSeek Mixture-of-Experts for Parameter-Efficient Tomato Disease Classification
链接：https://arxiv.org/abs/2609.18038
作者：Md Nadim Mahamood,Md Arif Shahriar,Md Shafi Ud Doula,Kamrul Hasan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：growing rapidly, improving in parallel, world population, population is growing, technology is improving
备注： 16 pages, 8 tables, 6 figures
点击查看摘要
Abstract:The world population is growing rapidly, and technology is improving in parallel. Meeting the huge demand for food for these 7 billion people not only depends on increasing food production but also on reducing food loss. Crop losses due to disease affect both the food supply and the financial and economic stability of a country. Tomatoes are among the top food-producing crops globally, and a significant portion of this production is lost due to disease. People have used Machine Learning techniques for feature extraction and early diagnosis of tomato diseases, and nowadays, Deep Learning-based models are widely used for disease recognition. However, most existing models are highly parameter-intensive, which increases the time required for training and inference. As a result, while lightweight models are more suitable for user-friendly applications, they often show a reduction in performance. To balance performance and model size, we propose CoAtNet-DeepMoE, a Convolution-Attention hybrid architecture for rich feature extraction, further enhanced with a DeepSeek Mixture of Experts to substantially reduce the number of parameters without sacrificing accuracy. We evaluate our model on both balanced and imbalanced datasets from Kaggle and PlantVillage, demonstrating robustness and achieving 99.80% accuracy, 99.80% precision, 99.80% recall, and 99.80% F1-score on Kaggle, and 99.83% accuracy, 99.85% precision, 99.76% recall, and 99.80% F1-score on PlantVillage, representing state-of-the-art performance with only 2.47M parameters. The source code will be available at this https URL.
79. 【2609.18037】SetPlanner: A Lightweight Plug-in Point-Set Planner for Frozen SAM
链接：https://arxiv.org/abs/2609.18037
作者：Dawei Yan,Yuezhe Yang,Menglan Ruan,Chunfeng Yang,Yudong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Models provide reusable, Segment Anything Models, provide reusable priors, require user prompts, automatic instrument segmentation
备注： 5 pages, 2 figures, 3 tables. Submitted to IEEE ICASSP 2027
点击查看摘要
Abstract:Segment Anything Models provide reusable priors, yet they require user prompts and cannot support fully automatic instrument segmentation. Automatic prompting is difficult for thin, articulated, reflective, and partly occluded tools, where several configurations can be valid. We formulate automatic prompting as lightweight point-set planning and isolate the point source under a frozen pathway. To this end, we present SetPlanner, a 1.52M-parameter plug-in point-set planner for frozen SAM. The plug-in preserves SAM's point-prompt interface and enables reuse across backbones. SetPlanner plans complete unordered K-point sets from geometry-aware targets with a permutation-aware conditional flow. SAM decodes eight candidates; their consensus readout yields a ground-truth-free prediction. Across three endoscopic datasets, SetPlanner wins all six transfer routes over a LoRA-adapted system. Under our frozen-pathway protocol, SetPlanner reaches 0.934 Dice on Kvasir-Instrument and recovers 96% of a 44.4-point localization gap, while candidate disagreement ranks low-Dice cases at AUROC 0.969.
80. 【2609.18034】IRIS: Implicit Rendering Matters for Pose-Free Novel View Synthesis
链接：https://arxiv.org/abs/2609.18034
作者：Wenyu Li,Sidun Liu,Peng Qiao,Yong Dou,Tongrui Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：images remains challenging, unposed multi-view images, multi-view images remains, jointly learn scene, remains challenging
备注： Accepted by ACM Multimedia 2026
点击查看摘要
Abstract:Novel view synthesis from unposed multi-view images remains challenging, as the model must jointly learn scene representations and camera parameters without pose supervision. Existing approaches largely fall into two extremes: implicit latent-space rendering is flexible and easy to optimize, but often yields weakly grounded camera estimation; explicit 3D representations provide stronger geometric grounding, but introduce heavier parameterization and more fragile optimization. In this paper, we present IRIS, a fully self-supervised framework that provides a practical middle ground between these two paradigms. Instead of decoding free latent tokens or reconstructing fully explicit 3D primitives, IRIS represents the scene as a latent neural field and renders novel views by querying this field under self-predicted cameras. Specifically, projected features from reference views are aggregated at sampled 3D points to form point-wise latent features, which are then composed along target rays for rendering. This design preserves the flexibility and optimization stability of implicit modeling, while introducing stronger geometric structure than unconstrained latent rendering. Extensive experiments show that IRIS achieves strong novel view synthesis quality with competitive pose accuracy under fully self-supervised learning. Our project page: this https URL
81. 【2609.18007】Newer Is Not Fairer: Gender Stereotyping in Text-to-Image AI Across Model Generations
链接：https://arxiv.org/abs/2609.18007
作者：Shesh Narayan Gupta,Nik Bear Brown
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：remains poorly understood, Stable Diffusion model, creative settings, remains poorly, Stable Diffusion
备注：
点击查看摘要
Abstract:Text-to-image generative models are widely used in professional and creative settings, yet how they represent gender across occupations -- and whether newer models are fairer -- remains poorly understood across multiple generations. We evaluate gender representation across 20 occupations, 5 prompt templates, and 4 Stable Diffusion model generations (SD 1.5, SD 2.1, SDXL, SD 3 Medium), generating 8,000 images with n = 100 per occupation-model cell (5 prompts x 20 images), and classifying all with DeepFace. Across the 8,000 open-source images, 76.4% show male subjects (95% CI [75.1%, 78.7%], p 2.2 x 10^-16, Benjamini-Hochberg adjusted). More strikingly, 57.6% of images for historically female-coded occupations show male subjects (raw p = 3.43 x 10^-22, BH-adjusted p = 1.71 x 10^-21). All nine significant tests reported in this paper survive BH correction across 10 tests. When compared against U.S. Bureau of Labor Statistics workforce data, models underrepresent women by 20-46pp on average, with particularly large deviations for near gender-balanced occupations: scientist (48% female in BLS, 82-99% male in model outputs) and cleaner (46% female in BLS, 80-92% male in outputs). Model generations do not improve steadily: bias worsens from SD 1.5 to SDXL before partially recovering in SD 3 Medium. A preliminary comparison with GPT-image-1 on five occupations suggests lower bias than open-source models, though the practical effect is small (Cramer's V = 0.080) and the comparison is exploratory. No model achieves gender parity.
82. 【2609.17628】LEAP: Learning Emergent Active Perception for Quadruped Navigation
链接：https://arxiv.org/abs/2609.17628
作者：Ü. Bora Gökbakan(WILLOW),Stéphane Caron(ISIR),Philippe Souères(LAAS-GEPETTO)
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：autonomous agents, agents to select, passively process, reduce uncertainty, Active perception
备注：
点击查看摘要
Abstract:Active perception allows autonomous agents to select their viewpoints rather than passively process the viewpoints given to them, enabling them to target where to reduce uncertainty about their environment. Learned systems typically encourage this behavior with hand-designed proxy objectives, such as coverage or curiosity bonuses, that may conflict with the task. In this work, we propose a method to learn emergent active perception (LEAP) without augmentation of the task objective. We formulate the problem of goal-oriented navigation over hazardous terrains with goals that must be discovered visually. We then propose an architecture for navigation policies with active perception, and train them on a terrain curriculum where task pressure alone leads to the emergence of gaze control. Key to this emergence, LEAP works on a gaze-invariant representation that integrates depth images into egocentric belief maps. We validate its performance in held-out evaluation scenarios, where it achieves a 92.7% success rate, compared to 74.2% for scripted or 34.5% for passive perception, and comes within 4.6 points of a privileged oracle. We validate that LEAP navigation policies, unchanged, can be directly applied to steering quadrupedal locomotion policies in physics simulation.
83. 【2609.17613】DualCount: Structurally Consistent Density and Point Modeling for Zero-Shot Object Counting
链接：https://arxiv.org/abs/2609.17613
作者：Xuan Cuong Ngo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：category-specific training, Zero-shot object counting, aims to estimate, estimate the number, text query
备注： ECCV 2026
点击查看摘要
Abstract:Zero-shot object counting aims to estimate the number of objects specified by a text query without category-specific training. Recent approaches primarily rely on density regression or detection-style instance prediction. While effective, density-based models often suffer from spatial ambiguity and background leakage due to weakly regulated mass allocation, leading to fragmented or part-biased representations that increase counting error in complex scenes. In this work, we propose an instance-aware dual-decoder framework that structurally couples density and point representations for zero-shot object counting. Instead of treating density estimation as independent pixel-wise regression, we interpret it as a structured mass allocation problem over a latent set of object instances. Predicted instance centers induce a soft instance-wise decomposition of the density map, upon which we enforce two geometric constraints: (1) per-instance mass conservation, ensuring each object contributes approximately one unit of density mass, and (2) center-of-mass alignment, encouraging each density component to concentrate around its corresponding predicted center. These constraints introduce instance-level geometric consistency and lead to more accurate mass allocation, thereby reducing counting error. Extensive experiments on FSC-147, PUCPR+, and CARPK show that our approach consistently reduces counting error and establishes new state-of-the-art performance in zero-shot object counting.
84. 【2609.17575】mperon: Full-Time SAM Quality at a Third Less Wall-Clock
链接：https://arxiv.org/abs/2609.17575
作者：Stamatis Mastromichalakis
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Sharpness-aware minimization, Muon epoch costs, Muon refiner, SAM, SAM-wrapped Muon refiner
备注： 12 pages, 5 Figures, 4 Tables
点击查看摘要
Abstract:Sharpness-aware minimization (SAM) doubles the cost of every training step, yet its benefit concentrates where training ends. We study where an expensive training mode should be spent and propose Temperon: a plain-SGD explorer for the first 43% of the epoch budget, then one scheduled hand-off that gives the entire final cosine anneal to a SAM-wrapped Muon refiner. On CIFAR-10/100, SVHN and Tiny ImageNet (five seeds, times reported as epochs-to-target times an idle-GPU-calibrated epoch cost), Temperon matches the best full-time-SAM recipe on accuracy everywhere while reaching the hardest common target 35%, 34% and 32% sooner on three of the four, and sits a tier above the published SAM+SGD recipe at level cost. Ablations make the attribution exact: the Muon refiner is worth +0.85pp with everything else fixed; the explorer's shape and its restarts are worth nothing, and we withdraw them as contributions. Re-running the closest rival, late-phase SAM, at matched budget shows the frontier: it is fastest to every mid-level target, but the tier the Muon refiner buys (0.83 on CIFAR-100, 0.97 on CIFAR-10) is reached by no SGD-refined method in any seed, and on Tiny ImageNet, where Muon buys no tier, the rival simply wins -- the measured boundary of the method. The allocation law transfers to GPT-2 pretraining (full-SAM quality at -29% wall-clock) and GLUE fine-tuning (never worse than full-time SAM at a third of its SAM cost). Two constants organize the economics: skipping SAM early buys a fixed credit, and a Muon epoch costs 1.50x a SAM+SGD epoch on all four datasets. Finally, the hand-off cannot be timed from the trajectory: under cosine schedules the accuracy curve is plateau-then-surge, so the information lives in the schedule, making the scheduled switch principled rather than convenient. Code and a pip-installable implementation are released.
85. 【2609.17566】Adaptive Interpolatory Curve Subdivision with Learned Local Angles
链接：https://arxiv.org/abs/2609.17566
作者：Hassan Ugail,Newton Howard
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generating smooth geometric, smooth geometric objects, pivotal in computer, computer graphics, graphics for generating
备注：
点击查看摘要
Abstract:Curve subdivision is pivotal in computer graphics for generating smooth geometric objects from control polygons. Interpolatory subdivision is especially attractive because the refined curve is guaranteed to pass through the designer's control points. Classical four-point and six-point schemes preserve this property, but their behaviour is governed by a single global tension parameter, limiting their ability to adapt across flat regions, sharp turns and varying local geometries. We introduce an adaptive local-angle formulation that keeps the interpolatory structure intact while learning how each new vertex should be inserted. A compact edge-wise predictor assigns one insertion angle per edge, while the original vertices are copied exactly at every refinement level. Interpolation is therefore a structural property of the operator and does not depend on the trained weights. The same predictor is used with geometry-specific geodesic primitives on the Euclidean plane, the two-sphere and the Poincaré disk. Under a matched-density evaluation protocol, the method reduces nearest-neighbour error by factors of five to seventeen over the best validation-tuned fixed-tension baseline, and by about 1.8 over centripetal Catmull-Rom in the Euclidean case. It also substantially reduces bending energy and tangent roughness, while remaining competitive with separately trained per-geometry models.
86. 【2609.17565】A Heisenberg Lift Descriptor for Order Sensitive Online Handwriting Recognition
链接：https://arxiv.org/abs/2609.17565
作者：Hassan Ugail,Newton Howard
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recognition systems typically, systems typically represent, typically represent pen, represent pen trajectories, fixed-length Euclidean shape
备注：
点击查看摘要
Abstract:Online handwriting recognition systems typically represent pen trajectories through fixed-length Euclidean shape descriptors that capture the spatial outline of each stroke, but are insensitive to the order in which that outline is produced. Two strokes that trace the same region of the plane in opposite directions are indistinguishable to any such order-blind representation, yet their traversal directions may carry decisive class information in characters where loop orientation and stroke sequencing matter. This paper introduces a Heisenberg-lift framework that addresses this gap through a compact, interpretable, order-sensitive augmentation for online pen-trajectory features. The simplest instance is the terminal signed area, a single parameter-free scalar appended to an existing Euclidean descriptor at negligible computational cost. Evaluated on two standard online handwriting benchmarks, this one-scalar addition, consistently raises classifier accuracy over the Euclidean baseline. On the hardest character pair in our study, the letters o and y, the signed area alone achieves perfect separation while the Euclidean baseline falls short. The advantage grows further under additive coordinate noise, a practically relevant degradation in pen-trajectory data. A richer fifteen-dimensional extension, derived from a noncommutative Heisenberg-group subdivision scheme, provides additional gains in noisy and loop-structured conditions. Dimension-matched statistical controls confirm that all improvements reflect geometric information rather than feature-count inflation. The resulting descriptor is lightweight, closed-form, and directly interpretable, making it a practical augmentation for online handwriting and related document-trajectory classification pipelines in which the direction of stroke execution carries discriminative information.
87. 【2609.17560】Pay Only for Disagreement: Certified No-Regression Verdicts for Model Updates with Matching Label-Complexity Bounds
链接：https://arxiv.org/abs/2609.17560
作者：Vishnu Bindu Balachandran
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：silent vendor swap, vendor swap, silent vendor, production model, Abstract
备注： 32 pages, 6 figures, 6 tables
点击查看摘要
Abstract:Every production model is updated, by retraining, fine-tuning, quantization, or a silent vendor swap, and each update risks being worse than what it replaced. We formalize update promotion as certified paired risk-difference auditing. Our starting point is a support identity: the risk difference between two models lives on the inputs where they disagree, observable without labels. We build DISCERN, a sequential two-tier protocol. A zero-label tier certifies benign updates whose disagreement rate is below tolerance from unlabeled traffic alone. An audited tier labels only sampled disagreements through an anytime-valid confidence sequence, valid at every stopping time and under any label-routing rule, even an adversarial judge. We prove finite-sample validity and matching label-complexity bounds of order rho^2/eps^2 at the rate level, so exploiting free disagreement provably saves a factor 1/rho over any pairing-blind auditor, and the guarantee composes across an unbounded sequence of promotions from one error budget. Across 14,000+ replayed audit streams over 785 update pairs, including LoRA fine-tunes of language models up to 1.4B parameters, miscoverage is 0.0002 (nominal 5%), power 0.986 with zero false alarms, and 56% of benign updates certify with zero labels. Each audit emits a machine-checkable evidence record for post-market monitoring.
88. 【2609.17545】Selective Prediction and Uncertainty-Aware Referral for Pap Smear Classification
链接：https://arxiv.org/abs/2609.17545
作者：Nisreen Albzour,Sarah S. Lam
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning models, screening system deployed, Deep learning, system deployed alongside, classify every slide
备注：
点击查看摘要
Abstract:Deep learning models for cervical cytology are almost always evaluated as if every prediction must be acted upon, yet a screening system deployed alongside a cytopathologist need not classify every slide: it can defer the cases it is least certain about. Evaluating such a system requires asking not only how often it is correct, but whether its confidence ranks its errors to the bottom. This paper studies selective prediction and uncertainty-aware referral on the Herlev Pap smear dataset under a binary Normal-versus-Abnormal formulation. Two lightweight transformer backbones (Swin-Tiny, TinyViT-5M) are fine-tuned on Herlev from ImageNet-pretrained weights with weighted random sampling, calibrated by post-hoc temperature scaling fit on a held-out calibration subset, and compared against a soft-voting ensemble of both models. Discrimination is reported alongside expected calibration error (ECE) and, as the primary endpoint, the area under the risk-coverage curve (AURC). No statistically significant difference was detected between the two configurations in accuracy or macro-F1, yet the ensemble halves AURC (0.0022 vs. 0.0045, a 51.8% reduction, lower in all five folds) and extends the coverage at which zero errors are made from 18.3% to 72.8% of the pooled test predictions. The same ensemble is nonetheless worse calibrated in absolute terms (ECE 0.0339 vs. 0.0247) and produces more false negatives (14 vs. 10). These results separate two properties that are frequently conflated: the ability to rank predictions by trustworthiness, and the accuracy of the confidence values themselves. Ensembling improves the former while degrading the latter, and the former directly governs the observed risk-coverage tradeoff, whereas the latter governs the interpretation of the reported confidence values.
89. 【2609.17538】From Pixels to Pairs: A Comprehensive Benchmark of LLM-Based Key-Value Extraction in Noisy Document Settings
链接：https://arxiv.org/abs/2609.17538
作者：Zahra Anvari,Vassilis Athitsos
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：remains poorly understood, structured information extraction, Large language models, noise remains poorly, realistic OCR noise
备注： 25 pages, 20 tables, 5 figures
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for structured information extraction from documents, yet their behavior under realistic OCR noise remains poorly understood. We present a systematic benchmark of open-source instruction-tuned LLMs for key-value pair (KVP) extraction under both clean-text and noisy OCR conditions. We evaluate representative decoder-only models (Gemma, Mistral, Qwen2.5, LLaMA 3, and DeepSeek) on the FUNSD, CORD, and SROIE benchmarks using both Gold-text annotations and OCR outputs from PaddleOCR, EasyOCR, and Tesseract. A unified evaluation protocol isolates the effects of input quality, model design, and prompting under consistent conditions. The results show that modern LLMs act as strong semantic extractors when high-quality text is available, in some cases approaching supervised layout-aware systems. Under OCR noise, however, performance degrades substantially and performance gaps between models narrow as input corruption increases. Across all datasets, extraction performance is governed by two factors: semantic reasoning over text and preservation of textual fidelity under OCR noise. While larger models improve results on clean text, these gains diminish under noisy inputs, where OCR quality becomes the dominant factor. We also identify recurring failure modes, including key-value misalignment, hallucination, and numeric corruption. Our findings highlight the gap between clean-text evaluation and real-world deployment, emphasizing the need to jointly improve OCR quality, structural reasoning, and LLM-based semantic modeling.
Comments:
25 pages, 20 tables, 5 figures
Subjects:
Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.17538 [cs.CL]
(or
arXiv:2609.17538v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.17538
Focus to learn more
arXiv-issued DOI via DataCite
Submission history From: Zahra Anvari [view email] [v1]
Tue, 14 Jul 2026 02:20:43 UTC (10,830 KB)
90. 【2609.09206】MLLMs Hallucinate when Information Distribution Drifts in Synergy Heads
链接：https://arxiv.org/abs/2609.09206
作者：Meng'en Qin,Junye Chen,Jucheng Liu,Youlu Xing,Song Wang,Ruize Han
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, reliable practical applications
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) often struggle with hallucinations, thus hindering their reliable practical applications. Existing attention-based mitigation methods mainly rely on indirect signals (e.g., attention weights) that fail to accurately reflect the actual information shift underlying hallucination generation. In this paper, we propose HEAL, Head-lEvel information disentAnglement and caLibration for identifying and mitigating hallucinations. HEAL first employs causal noise intervention on multi-head outputs to filter out causally redundant heads. Subsequently, it disentangles information distribution within the remaining heads via the counterfactual Difference-in-Differences, categorizing heads into four types. Through analysis, we observe: hallucinations happen when information distribution drifts away from a healthy equilibrium in synergy heads, not strongly correlated with the quantity or strength of modality-specific heads. Motivated by this insight, HEAL injects dynamic information calibration factors into the value vectors of synergy heads, and actively regulates visual-language dependencies, steering the output distribution towards factual evidence. Extensive experiments demonstrate that HEAL effectively reduces hallucinations across multiple MLLMs, offering a simple and interpretable pathway to enhance model trustworthiness.
91. 【2609.19042】FedASAP: Activation Statistics-driven Structured Adaptive Pruning for Efficient Personalized Federated Learning for Lesion Segmentation on brain MRI
链接：https://arxiv.org/abs/2609.19042
作者：Karan R. Bagri,Tarun K. Garg,Vaanathi Sundaresan
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：developing robust deep, medical imaging, developing robust, robust deep learning, data
备注：
点击查看摘要
Abstract:In medical imaging, developing robust deep learning models requires data from various domains. However, regulatory policies protecting patient privacy restrict data sharing. Federated learning (FL) addresses this by enabling collaborative model training without centralizing data. Yet, data heterogeneity across client centers requires personalized models to enhance performance. Clients with limited resources may struggle to efficiently train or deploy large deep neural networks. Adaptive model pruning tackles both challenges by reducing model size while enabling personalized FL adaptation. Although research has investigated adaptive pruning methods in FL, their effectiveness on dense prediction tasks like segmentation remains unexplored. To address this gap, we propose Activation Statistics-driven structured Adaptive Pruning (FedASAP), which uses activation-based features to guide filter removal for each client. By learning a lightweight classifier on per-filter activation statistics, FedASAP refines importance-score rankings and produces compact, personalized segmentation models in heterogeneous federated settings. Our results show the approach's effectiveness by achieving better Dice scores of 0.796 and 0.743, than state-of-the-art, while reducing parameter count by 45% and 73% on two multi-centric brain pathology segmentation datasets: Federated Tumour Segmentation (FeTS) and White Matter Hyperintensities (WMH), respectively.
92. 【2609.18983】Flexible-Region Based Adaptive In-Loop Filter for Video Coding
链接：https://arxiv.org/abs/2609.18983
作者：Xuewei Meng,Chuanmin Jia,Jing Cui,Shanshe Wang,Siwei Ma
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Adaptive loop filter, Video Coding Standard, Audio Video Coding, Adaptive loop, video coding
备注： This paper was submitted to PCS2019
点击查看摘要
Abstract:Adaptive loop filter (ALF) for video coding, which is designed to minimize the mean square error between original and reconstructed samples by using Wiener-based filter, has attracted increasing attention for its significant capability in improving coding efficiency. In the second and third Audio Video Coding Standard, i.e., AVS2 and AVS3, ALF is adopted as one of the in-loop filters. In current design, each frame is divided into 16 regions at most and corresponding filter coefficients are then derived and utilized to reconstruct each region. In this paper, a flexible-region based ALF (FRALF) scheme is proposed to improve the adaptability of existing ALF in AVS3, which introduces multiple region partition templates, such as $2\times4$, $4\times4$, $4\times8$ and $8\times8$. We subsequently propose the filter coefficients merging algorithm to further improve coding efficiency by estimating the distortion level of different partition regions. The proposed FRALF can fully consider the local texture characteristics as well as non-local similarities synthetically. The experimental results show that FRALF outperforms the existing region-based ALF in AVS3 with relatively low complexity increasing.
