Arxiv每日速递(2026-10-23)

本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新773篇论文，其中：

• 自然语言处理117篇
• 信息检索27篇
• 计算机视觉114篇

自然语言处理

1. 【2610.31667】Direct Pass@$k$ Optimization for Thought Pruning: Balancing Quality and Diversity in Test-Time Reasoning

链接：https://arxiv.org/abs/2610.31667

作者：Mahdi Salmani,Adel Javanmard,Devansh Gupta,Meisam Razaviyayn

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：key inference strategy, Test-time scaling, scaling has emerged, key inference, inference strategy

备注：

点击查看摘要

Abstract:Test-time scaling has emerged as a key inference strategy for reasoning models, where a model generates a large number of candidate solutions in the hope of finding at least one correct solution. Running all candidate solutions to completion can be computationally demanding, so recent work prunes the candidate pool after generating only a short prefix, committing further computation only to the surviving candidates. Existing pruning strategies divide broadly into two categories: Quality-based methods assign a score to each partial solution and discard those predicted to ultimately lead to an incorrect final solution, while diversity-based methods select partial solutions that follow different reasoning trajectories and are therefore likely to cover different final solutions. The tension between these two objectives is an instance of exploration versus exploitation, yet little to no prior work on pruning exposes this trade-off directly, let alone optimizes it. In this paper, we introduce a pruning procedure that addresses this trade-off directly by optimizing pass@$k$ over the selected solution pool. In particular, it chooses the pool to maximize the probability that at least one of its partial solutions, when continued to completion, yields a correct answer. Because this objective simultaneously rewards high-quality partial solutions and penalizes redundancy among them, quality and diversity are naturally balanced by the criterion itself rather than through separate ad-hoc design choices. On eight open-weight reasoning models, our method outperforms existing quality-based and diversity-based pruning strategies. The gains are particularly pronounced when the pruning procedure keeps a moderate number of partial solutions for continued generation, highlighting the value of directly balancing quality and diversity during pruning.

2. 【2610.31657】Cost-Aware Abstention for LLM-Based IT Ticket Classification

链接：https://arxiv.org/abs/2610.31657

作者：Sachin Gupta

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Wrong automatic routing, automatic routing, held-out test data, Wrong automatic, human triage

备注： Accepted at the 38th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2026). 9 pages, 5 figures, 9 tables

点击查看摘要

Abstract:Wrong automatic routing of an IT support ticket can cost more than human triage. We evaluate cost-aware abstention as an offline, cost-conditional readiness assessment: select a routing policy on calibration data under explicit costs, then evaluate that frozen policy once on held-out test data. On a public 47,837-ticket, eight-class corpus, we compare four trained non-LLM classifiers with four large language models under zero- and few-shot prompting. Under the illustrative cost model (c_ok, c_triage, c_wrong) = (0, 1, 5), TF-IDF with logistic regression and a threshold of 0.60 selected on calibration reduces test cost from 0.763 to 0.472, a 38.1% relative reduction (paired ratio-bootstrap 95% CI [35.7%, 40.4%]), while lowering wrong routes from 15.3% to 3.5%. Frozen calibration-selected policies also beat both always-route and always-defer on held-out test data in 14 of 16 settings in a post-hoc cost-parameter analysis. The strongest prompted configuration reaches 0.477 accuracy on a stratified 1,000-ticket test subset, versus 0.879 for fine-tuned DistilBERT on the same tickets. Isotonic lowers expected calibration error without reliably improving discrimination: GPT-4o-mini few-shot has one confidence value before and after recalibration and correctness AUROC 0.500. We therefore report correctness AUROC and tie-aware risk-coverage area alongside ECE. At the analytically derived break-even probability 0.80, seven prompted configurations defer all tickets; Haiku few-shot routes only 19/1,000. An LLM-only agreement control and margin/entropy rejection baselines further separate calibration from discrimination. The findings are scoped to this dataset, prompt design, model endpoints, and illustrative costs; the work is an evaluation framework, not a new abstention algorithm or universal deployment certification.

3. 【2610.31646】Low-Bit N-Gram Embeddings for Language Models

链接：https://arxiv.org/abs/2610.31646

作者：Stephen Chung,Wenyu Du

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：recent open-weight language, open-weight language models, tables, recent open-weight, open-weight language

备注： 24 pages, 10 figures, 10 tables

点击查看摘要

Abstract:Many recent open-weight language models use n-gram embedding tables to improve performance. These tables store learned representations of short token sequences, such as pairs or triples of consecutive tokens, which the model retrieves during processing. However, they can require substantial memory: DeepSeek-V4.1-Flash, for example, allocates 196 billion parameters to its Engram n-gram memory. We therefore investigate whether this memory cost can be reduced while preserving the performance improvement that the tables provide. We propose storing n-gram embeddings at low precision and systematically investigate different quantization methods and bit allocations across tables. Across nanochat-, Llama-, and GPT-2-family models trained from scratch, four-bit tables save approximately 75% of table memory while preserving more than 99% of the validation-loss improvement from adding the tables. Using fewer bits leads to a larger drop in performance, although we find that a short fine-tuning phase recovers a significant part of this loss. In addition, reinvesting the saved memory in larger tables can improve performance beyond that of the original full-precision tables while still using less memory. These table memory savings also extend to large existing models: on DeepSeek-V4.1-Flash and Qwen3.8-Flash-Next, low-bit tables save 47-55% of table memory, with perplexity increases of less than 1.2% and largely preserved downstream task performance. These findings establish low-bit precision as a practical way to reduce the memory requirements of n-gram embeddings and use the saved capacity to improve model performance.

4. 【2610.31636】Can an Agent Debug a Web Corpus? Agentic Auditing of Slovak FineWeb2

链接：https://arxiv.org/abs/2610.31636

作者：Marek Šuppa,Ivan Vykopal,Jaroslav Kopčan

类目：Computation and Language (cs.CL)

关键词：individual languages unanticipated, languages unanticipated, thousand languages, individual languages, Multilingual pipelines

备注： Accepted to WaC Workshop at EMNLP 2026

点击查看摘要

Abstract:Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leaving the failure modes of individual languages unanticipated. We use an LLM once, as a corpus debugger rather than a classifier: a tool-using agent explores the corpus through a read-only, budgeted API and compiles each finding into an executable test, which a native speaker then validates. On the 26.5M-document Slovak portion of FineWeb2, three runs costing \$2.21-\$2.84 each found seven findings over four phenomena. The largest is a machine-generated content farm of 1,408,437 documents (5.32%) that passed the pipeline's filters, 86.6% of it passing even stricter thresholds. Blinded labels support 6 of the 7 findings (defect rates .53-1.00 against .08 in a random control) and do not support one. The compiled suite scans the full corpus in 0.7 s of wall-clock time without a GPU, against \$12k-\$90k per LLM classification pass. The best static sampling baseline validates more selectors than any agent run, at under half the cost. The agent contributes exact prevalence, a precision estimate checked against sampled documents, an account of why the pipeline missed each slice, and a reusable test. We release the framework, Slovak test suite, validation data and agent trajectories.

5. 【2610.31620】Bilingual Language Models Capture Cross-Linguistic Influence in Second-Language Reading

链接：https://arxiv.org/abs/2610.31620

作者：Abderrahmane Issam,Irene E. Winther,Stefan L. Frank

类目：Computation and Language (cs.CL)

关键词：surprisal is widely, bilingual models, monolingual language model, widely established, bilingual models trained

备注： Under review

点击查看摘要

Abstract:While monolingual language model (LM) surprisal is widely established as a predictor of reading times, it cannot capture the non-native (L2) reading dynamics that are shaped by the reader's first language (L1). In this work, we investigate whether the cross-lingual transfer within bilingual models aligns with human L1-driven biases during L2 reading. We evaluate bilingual models on eye-tracking data of readers from 12 diverse L1 backgrounds reading English texts. To isolate L1-specific transfer, we compare bilingual models trained on an L1 that matches the readers' L1 background to both a monolingual English baseline and bilingual models trained on other L1s. We demonstrate that matching the readers' L1 improves the prediction of L2 reading times. This predictive advantage is concentrated in late-stage eye-tracking measures, modulated by L1-L2 script overlap, and peaks among intermediate-proficiency readers. These findings provide evidence that bilingual LMs capture aspects of cross-linguistic influence, and that such influence is present in L2 reading behavior.

6. 【2610.31606】How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions

链接：https://arxiv.org/abs/2610.31606

作者：Miguel Mochizuki Silva,Samuel Ismael,Mateus C. Dias,Thaís Gaudêncio,Yuri Malheiros,Barufaldi

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：lesion management literature, breast lesion management, clinical retrieval-augmented generation, evidence-aware retrieval evaluation, retrieval evaluation protocol

备注： 18 pages, 3 figures, 6 tables

点击查看摘要

Abstract:Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrieval-augmented generation (RAG) system over breast lesion management literature, addressing the dependence of retrieval scores on annotation coverage. Methods: An 18-document corpus and an 18-query development benchmark, with one Yes/No or WH-question per document, were used. Retrieval combined dense embeddings, BM25, and cross-encoder reranking. Chunk sizes of 128 to 1024 tokens, overlaps of 0 to 20%, and four retriever configurations were evaluated. Relevance was defined by evidence spans mapped to all containing chunks, treating overlapping chunks with equivalent evidence as relevant. Retrieval was evaluated using R-Precision, Recall@K, MRR, and nDCG@K. Separately, generation was assessed on a 512-token index at K=1 to 5 using DeepEval claim-level metrics, with deepseek-v4-pro as the LLM judge, and BLEU/ROUGE metrics. Results: The selected hybrid retriever, using 384-token chunks and 20% overlap, retrieved accepted evidence in the top three results for 17 of 18 queries. Recall@3, R-Precision, MRR@3, and nDCG@3 each reached 0.94. Ground-truth curation increased evidence spans from 25 to 37 and accepted chunk targets from 36 to 51 without changing retrieval rankings. Conclusion: Cross-encoder reranking achieved the highest retrieval scores. Expanded relevance annotations increased recognized evidence without changing rankings, highlighting annotation sensitivity. The small development set and retrieval-informed curation require independent validation, including radiologist assessment of evidence sufficiency.

7. 【2610.31586】Would an LLM Match into a Residency? Uncertainty, Reasoning and Image Use of Open Language Models on the Spanish MIR Examination

链接：https://arxiv.org/abs/2610.31586

作者：Miguel Fernandez-de-Retana,Unai Zulaika,Ruben Sanchez-Corcuera,Aritz Bilbao-Jayo,Aitor Almeida

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)

关键词：sound clinical reasoning, common evidence offered, Spanish MIR residency, clinical reasoning, sound clinical

备注： 13 pages, 8 figures

点击查看摘要

Abstract:Accuracy on medical examinations is common evidence offered for the clinical use of language models, yet a health system that intends to run an open model on its own hardware needs to know considerably more: whether the model recognizes when it is likely to be wrong, whether medical fine-tuning improves this ability, whether its correct answers rest on sound clinical reasoning, or whether it actually uses the images it is given. We examine these questions for four open models of 8 to 27 billion parameters on the Spanish MIR residency examination, scoring 1,552 questions from eight editions under the exam's own rules. Answering every question, the three larger models would rank among roughly the first 600 to 3,000 candidates, with 41 to 43 specialties still open to them. Abstention, however, never pays, because even their least confident answers are right more often than the 25% break-even. Medical fine-tuning reduced overconfidence at the cost of accuracy, without improving how well confidence separates right from wrong answers. Moreover, 13-38% of correct answers rejected a distractor for a clinically unsound reason that confidence did not reflect, and removing or swapping the provided contextual images left accuracy unchanged.

8. 【2610.31558】Diffusion Language Models for Perplexity-Aware Black-Box Attacks

链接：https://arxiv.org/abs/2610.31558

作者：Ali Al-Lawati,Elsayed Eshra,Dongwon Lee,Suhang Wang

类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

关键词：low-dimensional Gaussian latent, Gaussian latent space, trigger malicious behaviors, low-dimensional Gaussian, Gaussian latent

备注：

点击查看摘要

Abstract:\emph{Continuous-space} attacks find prompts that trigger malicious behaviors, such as overthinking, in black-box LLMs by sampling or optimizing over a low-dimensional Gaussian latent space and decoding it to text through a \emph{random mapping} and nearest-token lookup. Because the random mapping is not learned from language, its prompts can be highly unnatural, and as such easily detectable through input guardrails, and the risk estimates they yield are not grounded in natural prompts. In this paper, we demonstrate that the same continuous latent-space framework can be coupled directly to a learned generative distribution over language, a continuous diffusion language model (dLLM), which removes the artificial random mapping while preserving the standard-Gaussian latent formulation and the downstream sampling or optimization procedure. We evaluate this approach under two settings: sampling-based estimation using \emph{RareTrap} and optimization-based search using \emph{ThinkTrap}. We find that character-level perplexity drops from $10^3$--$10^7$ to 3--5 in RareTrap and from 20--28 to 4.3--5.4 in ThinkTrap. We also find that model risk estimates can differ by an order of magnitude across the two mappings.

9. 【2610.31529】An Empirical Study of Recent Large Language Models for Knowledge Graph to Text Generation on Standard Benchmarks

链接：https://arxiv.org/abs/2610.31529

作者：Priyanka,Renaud Delbru,Souhail Bakkali,Mickaël Coustaty,Antoine Doucet

类目：Computation and Language (cs.CL)

关键词：fluent natural language, natural language, verbalizes a set, fluent natural, Knowledge

备注： 18 pages, 6 figures, 17 tables, Preprint, Under review

点击查看摘要

Abstract:Knowledge graph-to-text (KG-to-text) generation verbalizes a set of knowledge graph triples into fluent natural language. While fine-tuned encoder-decoder models have long been the standard approach, recent LLMs are becoming increasingly competitive. We benchmark recent LLMs against fine-tuned encoder-decoder models, using reference-based metrics and graph-grounded reference-free LLM-based evaluation validated against human annotations. We observed that recent LLMs substantially narrow, and in several settings close, the gap with fine-tuned models on reference-based metrics, while performing better on graph-grounded metrics. LLM-based evaluation scores show limited correlation with reference-based metrics, suggesting that the two approaches capture different aspects of generation quality. Graph-grounded evaluation reveals that prompted models produce fewer contradictions and triple omissions than fine-tuned models, and these errors increase more rapidly with graph size for fine-tuned models, highlighting differences between the two approaches that reference-based metrics may not fully capture.

10. 【2610.31520】he Geometry of Metaphor: Probing and Steering Metaphor Representations in Large Language Models

链接：https://arxiv.org/abs/2610.31520

作者：Shihui Li,Mette Andersen,Martha Lewis

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：human cognition, crucial aspect, aspect of human, Metaphor, Abstract

备注： BlackboxNLP 2026: The 9th Workshop on Analyzing and Interpreting Neural Networks for NLP

点击查看摘要

Abstract:Metaphor is a crucial aspect of human cognition. As such, we would like to understand how it is represented in large language models (LLMs) and how it might be controlled. We use mechanistic interpretability techniques to identify causal subspaces in a range of LLMs covering different architectures and sizes. We show that we are able to steer output on classification tasks across different parts of speech. We are also able to steer output on generation tasks, indicating that these techniques can be used to control the metaphoricity of LLM output.

11. 【2610.31512】owards User Simulators That Stay On Task And Still Sound Natural

链接：https://arxiv.org/abs/2610.31512

作者：Mustafa Omer Gul,Philippe Laban,Tanya Goyal,Jennifer Neville

类目：Computation and Language (cs.CL)

关键词：LLM-based system performance, system performance degrades, Users increasingly rely, prolonged interaction, follow complex user

备注： 30 pages, 16 figures, 6 tables. In submission

点击查看摘要

Abstract:Users increasingly rely on AI systems for extended, multi-turn tasks, yet evidence indicates that LLM-based system performance degrades over prolonged interaction. To evaluate and improve AI assistants in such settings, we need user simulators that faithfully follow complex user intents while exhibiting realistic conversational behavior. Existing approaches manifest a trade-off: prompted assistants can follow complex user intents but lack behavioral fidelity, while specialized user simulators better approximate conversational behavior but struggle to remain faithful to complex intents. In this paper, we propose a reinforcement learning (RL) recipe that jointly rewards task intent adherence and behavioral naturalness. A crucial contribution of the method is operationalizing naturalness with a lightweight discriminator trained in an alternating, adversarial loop with the user simulator. We release the resulting model, UserLM-2.0, which produces valid simulated conversations (i.e., meeting both task-faithfulness and naturalness criteria) 46.2% of the time, over three times the rate of the strongest prior user simulator (14.1%).

12. 【2610.31470】Measuring the Verifier's Floor: How Much Apparent Rare-Word Text-to-Speech Error Is ASR Error?

链接：https://arxiv.org/abs/2610.31470

作者：Kirill Borodin,Vasilii Kudryavtsev,Nikita Vasiliev,Grach Mkrtchian

类目：ound (cs.SD); Computation and Language (cs.CL)

关键词：automatic speech recognition, evaluated by transcribing, transcribing its output, rate also counts, ASR

备注： Submitted to IEEE ICASSP 2027

点击查看摘要

Abstract:Text-to-speech (TTS) is usually evaluated by transcribing its output with an automatic speech recognition (ASR) system, so the word error rate also counts recognizer errors. We measure these errors on human recordings of the test sentences. On LibriSpeech and FLEURS, the evaluation recognizer misses 33-67% of very rare words even in human speech, and all three recognizers miss 22-42%. Checking every word with two more recognizer families lowers the apparent TTS error on words that at least one recognizer hears two- to three-fold (very rare LibriSpeech words: from 10-13% to 3-5%), yet very rare words remain the hardest. Ignoring words the recognizer misses in human speech is biased: the other recognizers find TTS errors far more often on these words (4-6% vs. 0.2-0.3%) and overturn about half of the errors this mask keeps. As half of the remaining adjudicated errors may be spelling variants, a listening test is needed.

13. 【2610.31467】From Structured Records to Patient Narratives: Preserving Clinical Alignment in LLM-Generated Health Summaries

链接：https://arxiv.org/abs/2610.31467

作者：Bayram Ayadi,Florian Geissler,Johanna Schmidhuber

类目：Computation and Language (cs.CL)

关键词：longitudinal physiological records, increasingly generate longitudinal, generate longitudinal physiological, Large Language Models, systems increasingly generate

备注： 18 pages, 3 figures

点击查看摘要

Abstract:As wearable and digital health systems increasingly generate longitudinal physiological records, communicating these observations in patient-accessible language remains a significant challenge. Large Language Models (LLMs) offer a promising mechanism for translating structured clinical information into readable narratives, but this process may introduce semantic drift, where clinically precise meaning is distorted during simplification. We investigate evidence-grounded health summarization for menstrual health monitoring using a constrained generation framework that combines structured evidence conditioning with Retrieval-Augmented Generation (RAG) using a prompt-based constrained generation framework. We evaluate semantic alignment using Natural Language Inference (NLI), atomic factuality metrics, and readability measures. Across three LLMs and 4,500 generated summaries, explicit grounding constraints consistently improve clinical alignment, particularly by improving uncertainty preservation and, once faithfulness is evaluated against retrieved evidence, generally preserving or improving faithfulness, while effects on omission remain model-dependent. We also find that improved clinical alignment comes at the cost of increased reading difficulty and medical terminology. These findings highlight the need to jointly evaluate faithfulness, uncertainty preservation, and readability when developing patient-facing medical LLM systems.

14. 【2610.31459】How Different, or Different How? Stance Granularity in Viewpoint Selection for Dialog Systems that Engage Users with Alternative Views

链接：https://arxiv.org/abs/2610.31459

作者：Morita Tarvirdians,Reeve Lorena,Catharine Oertel

类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

关键词：Perspectivized Stance Vectors, viewpoints, user, user engage, concepts

备注：

点击查看摘要

Abstract:Systems that aim to help a user engage with viewpoints other than their own have to decide how different those viewpoints should be. Viewpoints are mainly represented on a scalar scale, too coarse to distinguish viewpoints that disagree with the user about different things. We introduce a selection policy in which a bandit sets how far viewpoints may sit from the user, and the policy selects the most novel viewpoint within that bound. We vary only its stance encoder, comparing a scalar score with Perspectivized Stance Vectors, which break a position into separate stances on concepts. We integrate it inside a dialog system and run a between-subjects study (N=63). Concept-level stance produces more varied exposure sequences and broader coverage of the topic's positions, but does not change how deeply users justify viewpoints or how accurately they reconstruct them. Finally, we analyze user--viewpoint relations at the concept level, showing that users reconstruct a viewpoint least accurately on concepts that one side took no position on, rather than on concepts where the two disagreed. Our findings open up opportunities for dialog systems that support engagement with alternative viewpoints by acting on which concepts a user and a viewpoint disagree on, rather than on distance alone.

15. 【2610.31439】Multi-Token Prediction and Alternative Tokenization Improve Learning Latent Multi-Hop Graph Search at Scale

链接：https://arxiv.org/abs/2610.31439

作者：Arvid Frydenlund,FuTe Wong,Katherine Lambert,Frank Rudzicz

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：language model generate, start node, end node, generate the shortest, shortest path

备注： Don't be intimidated by the page length :)

点击查看摘要

Abstract:Given an unseen graph, a start node, $s$, and an end node, $t$, can a language model generate the shortest path from $s$ to $t$? Prior work has found that models fail to learn this task as the graphs scale. We show that this failure has two causes: the supervision signal and the tokenization. First, we theoretically establish and empirically demonstrate the effectiveness of multi-token prediction (MTP), and show that the benefits of MTP are topologically agnostic. Second, we introduce alternative tokenizations and show that the two causes are orthogonal. Using these methods, we break through the scaling wall observed by prior work, consistently and stably learning to solve the task at scales far beyond previous limits.

16. 【2610.31422】How Well Do Decision Models Transfer to Vietnamese? An Empirical Study of Text Classification

链接：https://arxiv.org/abs/2610.31422

作者：Phat Huu Ha,Nguyen Xuan Phuc,Nong Nhut Quy,Trinh Tran Tran,Nguyen Minh Triet,Dang Van Thin

类目：Computation and Language (cs.CL)

关键词：Vietnamese remains underexplored, Recent advances, specialized decision models, specialized decision, remains underexplored

备注：

点击查看摘要

Abstract:Recent advances in specialized decision models have expanded the possibilities for zero-shot classification, yet their effectiveness on Vietnamese remains underexplored. This study evaluates four specialized decision models across 13 classification settings spanning six task groups, examining zero-shot performance, sensitivity to label-description language, and robustness to Vietnamese linguistic variations. The evaluation considers English, Vietnamese, and bilingual label descriptions, alongside common linguistic perturbations involving teencode, typographical errors, and diacritic removal. Under English label descriptions, JEV achieves the strongest overall performance, ranking first in 11 classification settings. The effects of label-description language vary across models and datasets, with bilingual descriptions providing no consistent improvement. Robustness experiments reveal that diacritic removal causes the most substantial performance degradation, reducing mean macro-$F_1$ by 9.51--15.47 points across model configurations, considerably more than teencode or typographical errors. These findings highlight the importance of label-description choices and Vietnamese orthographic variation when evaluating specialized decision models for zero-shot text classification.

17. 【2610.31421】How Depth Growth and Looping Shape In-Context Learning in Language Models

链接：https://arxiv.org/abs/2610.31421

作者：Ferdinand Kapl,Kaitlin Maile,Stefan Bauer,Johannes von Oswald

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：models reuse computations, depth-grown language models, looped models rely, reasoning capabilities, attracted interest

备注：

点击查看摘要

Abstract:Looped and depth-grown language models reuse computations across depth and have attracted interest for their reasoning capabilities. Building on prior suggestive evidence of improved in-context-learning (ICL), we investigate how such reuse favors ICL, including how it shapes the acquisition, retention, and mechanisms of this ability. Our analysis spans pretrained language models up to 3B parameters and controlled tasks. The experiments provide evidence for a shared inductive bias toward learning from context: grown and looped models rely more on information in context and, compared with a full-depth dense reference, acquire ICL earlier in controlled tasks and retain it more strongly when learning fixed associations in the weights is also possible. Tracing attention heads through training reveals that depth growth propagates early induction heads across layers. Ablations show that grown and looped models rely more strongly on induction-ranked heads for both few-shot performance and later-token prediction. Together, these findings provide evidence for a shared inductive bias toward learning from context and suggest that (soft) parameter reuse shapes how this ability develops and which attention mechanisms support it.

18. 【2610.31415】SyRA-CS: Synthetic-to-Real Adaptation for Code-Switched ASR with Meta-Learning

链接：https://arxiv.org/abs/2610.31415

作者：Fadel Thior,Ahmer Tabassum,Haania Siddiqui,Hanan Aldarmaki,Thamar Solorio

类目：Computation and Language (cs.CL)

关键词：automatic speech recognition, remains difficult, fully match, automatic speech, speech recognition

备注：

点击查看摘要

Abstract:Code-switched (CS) automatic speech recognition (ASR) remains difficult because real CS speech is scarce and synthetic speech does not fully match it. We investigate whether synthetic CS speech is more useful for learning an adaptation-friendly initialization than for ordinary continual fine-tuning. We propose SyRA-CS, a pair-specific synthetic-to-real adaptation framework based on Reptile meta-learning. For each language pair and pretrained model, we meta-train on the corresponding synthetic CS-FLEURS subset and then adapt using one hour of labeled real target speech. We evaluate four architectural settings: Encoder-CTC, FastConformer-RNN-T, Attention Encoder-Decoder (AED) and Speech-LLM. Experiments cover on Arabic-, French-, German-, and Hindi-English, against synthetic-only transfer, real-only fine-tuning, and continual fine-tuning. SyRA-CS improves over continual fine-tuning on WER in all 16 model-pair comparisons and on CER in 15 of 16, with relative macro WER reductions of 17.7% for XLS-R and 5.3-5.8% for the other three models. The gains hold across the tested models but vary in size across architectures, language pairs and metrics.

19. 【2610.31412】SQuAT: Spherical Lattice Vector Quantization-Aware Training

链接：https://arxiv.org/abs/2610.31412

作者：Sebastian Loeschcke,Ivan Koryakovskiy,Tycho F. A. van der Ouderaa,Riccardo Del Chiaro,Mart van Baalen,Paul N. Whatmough,Markus Nagel

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：remains poorly understood, offer strong rate-distortion, large language models, strong rate-distortion trade-offs, Vector quantization

备注： 25 pages, 7 figures

点击查看摘要

Abstract:Vector quantization (VQ), in particular lattice-based methods, offer strong rate-distortion trade-offs for low-bit large language models (LLMs), yet their behavior under quantization-aware training (VQ-QAT) remains poorly understood. We scale lattice VQ-QAT to billion-parameter LLMs and multi-billion-token training regimes, and introduce SQuAT, a shape-gain VQ-QAT approach trained with a separate straight-through estimator (STE) for the shape and gain. SQuAT decomposes weights into direction and magnitude: normalized directions are quantized using an $E_8$-derived spherical codebook, while gains are quantized independently with low-bit scalar quantizers. We show that, unlike a standard STE applied to the full quantizer, which ignores the shape-gain structure, these separate STEs induce tangent-space updates for directions, yielding an implicit form of spherical (Riemannian) optimization. To enable scalability, we develop a distributed exact nearest-neighbor assignment scheme, in which workers quantize disjoint weight blocks and communicate only discrete indices, reducing VQ-QAT training time by 12.8$\times$ and allowing us to scale it to 10B tokens. Across instruction-tuned LLaMA-3.2-1B/3B, Qwen3-4B, and base Qwen3-1.7B, SQuAT consistently outperforms standard VQ-QAT STE under identical quantizers and initialization, and achieves SOTA VQ-QAT accuracy.

20. 【2610.31407】Same Entity, Different Script: Diagnosing Cross-Script Entity Matching Failures in Language Models

链接：https://arxiv.org/abs/2610.31407

作者：Athira Gopal,Patil Prathamesh Pravin,Ankush Kadu,Arpit Jain,Ashwanth Krishnan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Multilingual language models, Multilingual language, same-person accuracy falls, same-person accuracy, Devanagari

备注：

点击查看摘要

Abstract:Multilingual language models can give different identity judgments when the same people's names are written in different scripts. We study this effect using 601 audited identity pairs with attested Devanagari and Latin forms, holding the question and relation fixed. Qwen2.5-7B's same-person accuracy falls from 35.1% in Latin to 8.5% in Devanagari under Marathi prompts, while different-person accuracy remains above 98%. Evaluation across five models reveals distinct response biases, and reduced tokenization fragmentation does not reliably close the gap. Replicating the design on 374 audited Malayalam pairs built from the same entities reproduces the effect in a second script and language family: same-person accuracy falls to 5.3%, about half the matched Devanagari rate, while the margin still ranks matching above non-matching names at 0.925 AUROC. Latin-trained probes recover label information from Devanagari states, exceeding a string-feature baseline under similarity-matched negatives. Scalar calibration recovers 87% of the raw model-probe balanced-accuracy gap, identifying decision criterion placement as a major contributor. Activation patching localises causal sensitivity to the second entity in Qwen's middle layers; one shared sensitivity direction transfers about half the full-state margin correction. A fact-independent intervention at this site raises held-out Marathi same-person accuracy from 6.5% to 33.5%, with 98.5% different-person accuracy. Together, these results distinguish script-dependent discrimination from criterion placement and identify a causal site for improving identity judgments.

21. 【2610.31401】HERD: Harness-Evolving Recursive Distillation for Continual Learning

链接：https://arxiv.org/abs/2610.31401

作者：Xun Sun,Thanh Thi Nguyen,Thuy-Trang Vu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Continual learning requires, requires a model, knowledge without compromising, compromising its existing, Continual learning

备注： 22 pages, 9 figures

点击查看摘要

Abstract:Continual learning requires a model to keep acquiring new skills and knowledge without compromising its existing capabilities. Parametric methods suffer from catastrophic forgetting and loss of plasticity. Non-parametric methods, such as prompts, skills, and harnesses, leverage in-context learning but are limited by context length and lossy plain-text compression. To effectively combine their complementary strengths, we propose HERD (Harness-Evolving Recursive Distillation), a hybrid continual learning framework that learns efficiently in the harness and internalizes experience into cumulative capabilities via distillation. On the harness side, HERD continually refines its skills to capture reusable patterns, while retaining high-residual examples that the skills fail to capture in a bounded memory. On the parameter side, HERD performs drift-constrained distillation with dual anchors, substantially reducing forgetting over long recursive runs. On the 25-stage task stream of TRACE+17, under fixed memory and compute budgets, HERD matches the strongest parametric baseline in new-task acquisition while exhibiting the least forgetting and the strongest retention of general capabilities.

22. 【2610.31397】Parameter-Efficient Adaptation of Large Language Models to a Low-Resource Agglutinative Language: A Corpus, Datasets, and a Reproducible Benchmark for the Bashkir Language

链接：https://arxiv.org/abs/2610.31397

作者：Mullosharaf K. Arabov,Svetlana S. Khaybullina

类目：Computation and Language (cs.CL)

关键词：Bashkir Web Corpus, agglutinative language written, remains poorly represented, low-resource agglutinative language, Bashkir Web

备注： Preprint. 29 pages, 1 figure, 17 tables

点击查看摘要

Abstract:Bashkir is a low-resource agglutinative language written in Cyrillic and remains poorly represented in modern LLMs. We present an open resource suite and a systematic benchmark of adaptation methods: the Bashkir Web Corpus (71,567 documents, 46.9M tokens, 16 sources) and three labelled datasets for binary, multiclass and multilabel text classification; the benchmark covers the first two. Experiments use eight architectures (82M-8B: DistilGPT2, GPT-2 base/medium, Phi-3-mini, Mistral-7B, YandexGPT-5-Lite-8B, mBERT, XLM-R) and three adaptation groups (full fine-tuning, QLoRA, in-context learning), plus continual pretraining (CPT). (1) QLoRA on 3.8-8B models outperforms encoder-only fine-tuning on binary classification: YandexGPT-5-Lite-8B with CPT reaches macro-F1 0.748 vs 0.653 (XLM-R) and 0.650 (mBERT); pairwise differences are significant after Holm correction (p0.001). (2) YandexGPT-5-Lite-8B significantly outperforms Mistral-7B and Phi-3-mini on multiclass classification, BPB and native-speaker ratings (mean 3.28 vs 2.52 and 2.22; n=100; alpha=0.69-0.77; p0.05); on binary classification its QLoRA advantage is not significant (p=0.084). (3) CPT effects depend on model and task: perplexity improves for Phi-3-mini (+0.58) and YandexGPT-5-Lite-8B (+0.33) but worsens for Mistral-7B (-1.15, p0.001); on binary classification CPT helps Mistral-7B most (+4.0 macro-F1). (4) Tokeniser fertility on Bashkir varies 2.67x (2.92-7.80) and tracks adaptation quality, while perplexity across tokenisers is not comparable. Cyrillic tokenisers with Russian pretraining are preferable; LLM judges reproduce native ratings for grammar and coherence (rho=0.33-0.46) but not language correctness (rho=0.16, p=0.11); native evaluation remains necessary. All artefacts are open-licensed.

23. 【2610.31385】A Task-Centric Survey of Long-Document Visual Question Answering: Taxonomy, Evolution, and Future Directions

链接：https://arxiv.org/abs/2610.31385

作者：Yufei Tong,Guanjie Cheng,Tianle Wu,Leilei Zhang,Hang Zheng,Peihan Wu,Jianwei Yin,Shuiguang Deng

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：growing research interest, attracting growing research, visually rich documents, essential for acquiring, acquiring knowledge

备注： 26 pages, 9 figures, 6 tables

点击查看摘要

Abstract:Visual document understanding is essential for acquiring knowledge from visually rich documents and is attracting growing research interest. Existing surveys emphasize architectures or technical approaches, with limited attention to how task bottlenecks shape technical choices and research priorities. We present a task-centric survey that decomposes long-document visual question answering (VQA) into four components: document parsing, evidence organization and retrieval, generator organization and learning, and evaluation. For each, we develop a fine-grained taxonomy and trace motivations, technical responses, and cross-component connections. We focus on explicit retrieval while covering direct reading. Our temporal analysis traces expanding priorities from multimodal content understanding to sufficient, high-fidelity evidence acquisition and sustained evidence management. We outline future directions in evidence sufficiency, verifiable and correctable understanding, and budget-aware coordination, with an outlook on continual document understanding.

24. 【2610.31366】AfterDeleteBench: Auditing Post-Deletion Information Persistence in LLM Agents

链接：https://arxiv.org/abs/2610.31366

作者：Ehsan Saleh,Roozbeh Nahavandi,Sama Salarian,Raef Bassily,Andrew Perrault

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：maintain external persistent, derive additional state, external persistent memory, LLM agents maintain, agents maintain external

备注： 25 pages, 7 figures, 12 tables

点击查看摘要

Abstract:Many LLM agents maintain external persistent memory and derive additional state from past interactions, such as summaries. Deleting an original memory record therefore need not remove information carried by its descendants. We introduce AfterDeleteBench, a controlled behavioral audit for this failure mode in fixed-weight LLM agents. For each synthetic secret, we compare an exposed-then-deleted agent with an otherwise matched agent that was never exposed to the secret, allowing post-deletion recovery to be attributed to the original exposure. In our primary setting, a single query recovers the deleted secret from Qwen2.5-7B-Instruct in roughly two thirds of cases, while matched never-exposed controls have zero recovery. Crucially, recovery does not require a surviving verbatim copy: when the complete secret string is absent and only separately stored components remain under a public composition rule, exact reconstruction succeeds in 62-99% of cases across Qwen, Mistral, and Phi-3. We also show that the response interface is part of the measurement system: target-bearing replies can be scored as failures when the requested format and parser are misaligned. Finally, we separate reconstruction from write-back and fresh-session recall. Provenance-aware closure eliminates observed recovery in the tested positive-baseline settings, whereas an exact-literal write filter blocks reinsertion but cannot erase information already present. Together, these results show that source deletion should be evaluated behaviorally at the level of the agent and its memory system, not only as a storage operation.

25. 【2610.31356】CrisiLangs: A Multilingual Resource for Crisis Warning Generation

链接：https://arxiv.org/abs/2610.31356

作者：Giacomo Gonella,Stefano Menini,Marco Guerini

类目：Computation and Language (cs.CL)

关键词：entails issuing warning, emergency entails issuing, warning messages promptly, issuing warning messages, warning messages

备注：

点击查看摘要

Abstract:Communicating with the public during an emergency entails issuing warning messages promptly. In Europe, it often requires producing them in more than one language. Recent work has shown that language models can be trained to generate warning messages as a crisis unfolds, but the available data covers only English. To fill this gap, we present CrisiLangs, a multilingual extension of CrisiText (an English dataset of crisis events paired with warning messages written according to expert communication guidelines) to Italian, Bulgarian, German, and Greek. Expert native speakers translated the warning messages of 1,000 events drawn from 411 scenarios, for a total of 5,000 event-message pairs across five languages. We test the resource to fine-tune a multilingual model on all five languages jointly, with and without the emergency guidelines in the prompt, and compare it with a zero-shot baseline. The fine-tuned models outperform the baseline on ROUGE-L, BLEU and BERTScore in every language and configuration. In a human preference study, low decoding temperatures receive the most preferences in all five languages and in both configurations, while the effect of the guidelines varies by language.

26. 【2610.31317】SurveyGraph: Generating Academic Surveys via Methods-Entity Knowledge Graphs

链接：https://arxiv.org/abs/2610.31317

作者：Yifan Yuan,Yancheng Zhu,Zuoyu Zhang,Xiaogang Peng

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：capture research structure, systems retrieve papers, generation systems retrieve, limiting their ability, research structure

备注： Accepted at EMNLP 2026 Findings. 34 pages including appendices

点击查看摘要

Abstract:Most automated survey generation systems retrieve papers as flat documents, limiting their ability to capture research structure. We present SurveyGraph, a framework built around a Methods-Entity Knowledge Graph (MEKG) encoding method-level follow-on, competition, and shared-resource relations. The graph supports core-paper discovery, retrieval, hybrid outlining, and evidence-gated narrative synthesis. We evaluate retrieval, semantic edges, citation grounding, collection coverage, and generation-stage components. In a controlled seven-method equal-budget benchmark, MEKG-anchored fusion balances recall and structural density, with an independent co-citation check. In a separate archived graph-native diagnostic, graph-aware retrieval nearly doubles recall over flat lexical baselines across eight runs (p = 0.004). A semantic evidence gate achieves AUC = 0.75. Audits of 160 generated sentences find 80.6% anchored-or-partial citation support. Human adjudication of 108 stratified semantic edges finds 68.5% supported-or-partial relations (binary-support Cohen's kappa = 0.64), with improves strongest (80.6%) and extends weakest (52.8%). A SurveyBench-facing collection probe reaches mean reference coverage of 0.521 across four topics with an eight-paper budget. Same-backend Qwen diagnostics on a 30-paper/74-relation graph show reduced organization signals when hybrid outlining is removed. Concurrent-system comparisons provide bounded context rather than matched-backend end-to-end evidence. The results position MEKG as an auditable structural layer for typed diagnostics, relation-specific filtering, and controlled survey generation. Code and artifacts: this https URL.

27. 【2610.31314】When LLMs Forget What They Believe: Characterizing State Integrity Collapse in Long-Horizon Dialogues

链接：https://arxiv.org/abs/2610.31314

作者：Yancheng Zhu,Yifan Yuan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Large language models, Large language, State Integrity Collapse, Integrity Collapse, Large

备注： Accepted at EMNLP 2026 Main Conference. 17 pages including appendices

点击查看摘要

Abstract:Large language models can repeat an instruction while failing to keep obeying it. We study this recall-compliance dissociation in long-horizon dialogue and define State Integrity Collapse: a model preserves a stated constraint in memory but stops applying it to later turns. We introduce StateTrack-Bench, a controlled suite of conversations covering numerical, format, role/persona, factual-memory, and logical-rule constraints. Across seven provider-pinned model snapshots and five dialogue-depth probes, strict joint retention ranges from 62.4% to 100.0%, with degradation concentrated in symbolic constraints and in one especially brittle model. A forked recall audit shows that 88.6% of observed failures are behavioral-drift failures rather than ordinary forgetting; excluding the brittle outlier preserves this diagnosis (84.4% of failures). Extended evaluations at depths up to 50 turns confirm that the dissociation persists beyond the core benchmark, while Structured State Anchoring recovers up to 24.4 points on immutable constraints. The results show that reliability cannot be inferred from single-turn instruction following alone; evaluation must track whether remembered constraints remain operational as dialogue state grows. Code and artifacts are available at: this https URL.

28. 【2610.31305】Cola2: Co-Adaptive Hierarchical Language Modeling with Continuous Semantic Compression and Balanced Discrete Generation

链接：https://arxiv.org/abs/2610.31305

作者：Hongcan Guo,Yian Zhao,Feng Wang,Shen Nie,Guoqiang Wei,Yan Zeng,Hengshuang Zhao

类目：Computation and Language (cs.CL)

关键词：discrete text realization, latent space compresses, separates continuous semantic, continuous semantic modeling, generation separates continuous

备注： 47 pages, 14 figures, 5 tables

点击查看摘要

Abstract:Hierarchical language generation separates continuous semantic modeling from discrete text realization, but its effectiveness depends on what the latent space compresses and how the discrete generator uses it. We propose Cola2, a framework that jointly studies continuous semantic compression, the balance between reconstruction and generation, and continuous-discrete co-adaptation. Cola2 dynamically segments text into semantic spans, controls the compression rate through auxiliary-loss-free negative feedback, and combines reconstruction and generation supervision to learn compact, predictive latent representations. A block-causal masked diffusion decoder is trained with clean, noisy, and dropped latent conditions, while classifier-free guidance adjusts the balance between semantic reconstruction and autonomous generation. Token-prediction gradients update the encoder through the latents, whereas Flow Matching prior learning is decoupled from representation learning by stop-gradient. During inference, generated text is re-encoded under a fixed span layout to keep the latent history consistent with the actual text context. Experiments on five downstream tasks with about 210 billion training tokens validate the core designs and show competitive, unsaturated scaling. With 346.03 billion source tokens, an unconverged checkpoint reaches a 60.10 average across eight tasks and surpasses Llama-3-8B on HellaSwag and StoryCloze despite its reported pretraining budget being over 43 times larger. These results demonstrate the potential of continuous-latent hierarchical language generation.

29. 【2610.31303】he Value of Memory in Language Agents

链接：https://arxiv.org/abs/2610.31303

作者：Zehao Lin,Erenkai Zhu,Helan Hu,Xixuan Hao,Chunyu Li,Kai Chen

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：enables language agents, Memory enables language, enables language, past experience, language agents

备注： 19 pages, 3 figures, 5 tables

点击查看摘要

Abstract:Memory enables language agents to carry useful distinctions from past experience into future decisions. Its value depends on which distinctions survive, whether a bounded agent can use them, and what can be recovered or revised as demands evolve. We develop a decision-theoretic framework that follows this value from raw history through persistent state, operational use, and costly recovery and revision. Original and retained value are expressed in units of avoided task loss; risk-cost frontiers describe attainable recovery and preservation across uses. Unknown demand yields value profiles, while interactive feedback changes the distribution of future work. A cost-aware simulation condition and five minimal counterexamples expose the roles of information timing, retrieval access, component interaction, feedback and demand uncertainty. In particular, a pointer with zero mutual information about the answer can still reduce the cost of exact recovery. Diagnostics on LoCoMo, a two-project update task and longitudinal cases exhibit failures of preservation, use and measurement. At fixed retrieved evidence, a saved ledger changes subsequent answers; at fixed agent outputs, an evaluator revision changes scores. The framework connects these distinctions to operational risk bounds and testable principles for allocating memory, preserving recovery options and revising evidence dependencies.

30. 【2610.31277】CoWriter: Guiding Methodological and Synergetic Human-LLM Co-Authoring

链接：https://arxiv.org/abs/2610.31277

作者：Shmuel Amar,Benjamin Lieber,Ori Shapira,Debanjana Kar,Sebastian Maximilian Dennerlein,Yufang Hou,Ido Dagan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

关键词：causing review fatigue, transformed text generation, interfaces often reduce, passive supervision, causing review

备注：

点击查看摘要

Abstract:While LLMs have transformed text generation, standard chat-and-canvas interfaces often reduce human authoring to quite passive supervision, causing review fatigue, over-reliance on AI, and the sidelining of the human role in long-form, source-grounded writing. Prior systems typically address isolated writing phases, leaving comprehensive end-to-end human-LLM collaboration largely unexplored. In this paper, we introduce CoWriter, a proactive agentic scheme that adapts expert human (co-)authoring methodologies from cognitive science to flexibly steer the entire writing workflow while actively encouraging the user to engage. In an exploratory user study, compared to a standard LLM baseline, authors using CoWriter better expressed their perspectives and maintained a higher sense of document ownership, supported quantitatively by $2.2\times$ more successful agent engagements. Furthermore, external reader judges rated the resulting texts higher in "human touch" qualities like storytelling and integrating unique personal experiences. Overall, our results demonstrate that proactively engaging users through established human practices is beneficial for effective LLM-supported co-authoring, providing useful methodologies, techniques and insights for future research on collaborative agents.

31. 【2610.31272】Memory-Aware Reward Modeling: Learning Human Preferences for LLM Memory Use

链接：https://arxiv.org/abs/2610.31272

作者：Yijiang River Dong,Zexue He,Cheng Yu,Tiancheng Hu,Michael J Ryan,Jan Batzner,Zheng Hui,Shaolong Wu,Orestis Papakyriakopoulos,Alex Pentland,Nigel Collier,Jiaxin Pei

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Memory enables language, enables language model, language model assistants, generate personalized responses, necessarily produce responses

备注：

点击查看摘要

Abstract:Memory enables language model assistants to maintain continuity across sessions and generate personalized responses, but knowing more about a user does not necessarily produce responses they prefer. Existing evaluations assess memory capabilities without directly establishing whether memory use benefits the user. To study this gap, we collect approximately 1,000 pairwise judgments from 87 participants using their own ChatGPT queries and personal memories. We find that memory-conditioned responses are not consistently preferred over responses generated without memory and in some cases, users strongly prefer the latter. Automatic evaluators also show limited agreement with users and favor memory-conditioned responses substantially more often than users do. Motivated by these gaps, we introduce a memory-aware reward model that learns from user judgments, achieving 72.8\% preference prediction accuracy and outperforming the existing baselines. Our findings motivate evaluation and optimization objectives that align memory use with the preferences of the people whose information is being used.

32. 【2610.31259】A Systematic Comparison of Search Space Complexity and Efficiency for Time-Synchronous End-to-End ASR Models

链接：https://arxiv.org/abs/2610.31259

作者：Simon Berger,Larissa Kleppel,Ralf Schlüter

类目：Computation and Language (cs.CL)

关键词：Automatic Speech Recognition, Hidden Markov Models, Speech Recognition, Automatic Speech, Hidden Markov

备注： Accepted at IEEE SLT 2026. 7 pages, 4 figures

点击查看摘要

Abstract:Search is a central component of Automatic Speech Recognition (ASR) systems and has been deeply investigated for classical ASR modeling based on Hidden Markov Models (HMMs). However, in work on current sequence-to-sequence ASR architectures it is often simplified to a small fixed-size beam search without external Language Model (LM). In this work, we present a comparative analysis of search space complexity and efficiency for Connectionist Temporal Classification (CTC) and neural transducer models under different pruning strategies and LM configurations. We show that these end-to-end (E2E) models work with a small search space most of the time but exhibit large temporary peaks in hypothesis count during periods of uncertainty. Score-based pruning dynamically adapts the search to model uncertainty, leading to a significantly lower Real-Time Factor (RTF). Our results highlight the limitations of search with low fixed-size beam pruning and provide practical guidelines for efficient search in E2E ASR.

33. 【2610.31256】IndoNutriQA: An Indonesian Clinical Nutrition Question Answering Benchmark

链接：https://arxiv.org/abs/2610.31256

作者：Tirana Noor Fatyanosa,Ummu Ditya Erliana,Mahendra Data,Muhammad Nurwegiono,Eleazar Tadeo Eman,Alham Fikri Aji

类目：Computation and Language (cs.CL)

关键词：underpins Clinical Intelligent, public domain-specific data, Clinical Question Answering, Decision Support Systems, Clinical Intelligent Decision

备注： 26 pages (9 pages main text, plus limitations, ethics, references and appendix), 5 figures, 18 tables. Under review at EACL. Data and code: [this https URL](https://github.com/NLP-UB/IndoNutriQA)

点击查看摘要

Abstract:Clinical Question Answering (QA) underpins Clinical Intelligent Decision Support Systems, but progress is severely limited for low-resource languages such as Indonesian by the absence of public domain-specific data. We introduce IndoNutriQA, an expert-curated Indonesian clinical QA benchmark of 911 question-answer pairs built from real clinical-nutrition reports. Rather than a large-scale training corpus, it is positioned as a high-quality evaluation resource: every pair is grounded in a clinically relevant context, enriched with structured metadata (anthropometric assessment, medical diagnosis, document provenance, chunk segmentation). Eight standardised question types following the Nutrition Care Process (NCP), including the Problem, Etiology, Sign and Symptom (PES) diagnosis statement, are answered for every report, which was written by a graduate-level dietetic intern, by one of three nutritionists. Answers are free-form clinical prose rather than extractive spans, and an expert validation study finds 6-10% of reference answers contestable. The dataset supports generative, extractive and retrieval-augmented QA as well as zero- and few-shot LLM evaluation. We report fine-tuned baselines (IndoBERT variants, mT5, RAG) with 5-fold cross-validation, learning curves and bootstrap 95% confidence intervals, and benchmark eight contemporary LLMs zero- and five-shot. We further calibrate our LLM-as-judge rubric against three expert raters (one RD, two nutritionists), finding it human-comparable on factuality and completeness but unreliable on clinical safety, and a human error analysis shows it misses unsupported content that the raters identify. IndoNutriQA is released to foster research in Indonesian clinical NLP and nutritional decision support.

34. 【2610.31202】Predicting Music Valence and Arousal via Textual and Multimodal In-Context Learning in Large Language Models

链接：https://arxiv.org/abs/2610.31202

作者：Chi-En Dai,Chih-Pin Tan,Yi-Hsuan Yang

类目：ound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：emotional valence remains, valence remains difficult, context-dependent nature, reliably predicted, predicted from musical

备注： Submitted to ICASSP 2027

点击查看摘要

Abstract:While arousal can be reliably predicted from musical audio, emotional valence remains difficult to model due to its subjective and context-dependent nature. In this work, we investigate the potential of in-context learning (ICL) with large language models to advance continuous valence and arousal prediction. Rather than predicting emotion scores directly, our framework leverages contextual demonstrations from an auxiliary dataset to refine the initial predictions produced by a small, task-specific base model. We systematically evaluate a text-based ICL variant using lyrics and generated audio captions, alongside a multimodal variant that incorporates raw audio signals. Using the entire MER60 dataset strictly as a held-out test set, our experiments demonstrate substantial performance gains, particularly for valence. Text-based ICL improves the valence $R^2$ from 0.110 to 0.427 with 80 demonstration shots, while the multimodal variant achieves 0.346 with only 10 shots. These findings suggest that training-free ICL offers an effective inference-time strategy for current language models to predict continuous music emotion.

35. 【2610.31199】Investigating Multi-Cultural Value Selection Biases in LLMs

链接：https://arxiv.org/abs/2610.31199

作者：Siddhesh Pawar,Arnav Arora,Dustin Wright,Dirk Hovy,Isabelle Augenstein

类目：Computation and Language (cs.CL)

关键词：cultural evaluations commonly, evaluations commonly reduce, commonly reduce identity, Large language models, Large language

备注： 27 pages, 13 figures, 18 tables

点击查看摘要

Abstract:Large language models (LLMs) serve users whose cultural identities are multi-layered, yet cultural evaluations commonly reduce identity to one label. In this work, we study LLMs under simultaneous identity cues, with a country persona in the system prompt and a second identity signaled in the user turn, either by naming a country (explicit cue) or through the query language (implicit cue). We test World Values Survey (WVS) multiple-choice probing and open-ended sociopolitical generation. In multiple-choice probing, language cues shift answers about three times more than explicit cues but away from the associated country's distribution, and explicit cues do not consistently move answers toward the named country. Across 1.6 million open-ended responses, naming a country closes 30-44% of the gap to the model's own responses for that country, and explicit cues produce more differentiated value changes than language cues. Our results suggest that country and language cues should be evaluated as distinct signals rather than interchangeable proxies for culture.

36. 【2610.31193】When More Metadata Misleads: Probing Field-Level Grounding in LLM-Generated Museum Descriptions

链接：https://arxiv.org/abs/2610.31193

作者：Clemencia Siro,Laura Hollink

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Machine Learning (cs.LG)

关键词：field, generation, additional input fields, field type, metadata

备注： Accepted to EMNLP 2026 Findings

点击查看摘要

Abstract:Metadata-conditioned generation is often framed as a data-to-text task in which additional input fields should improve grounding. Museum description generation challenges this assumption because catalogue records are heterogeneous, partially visual, and unevenly documented across geographic regions. We study how metadata composition shapes the generation of artefact descriptions through a two-phase framework. Phase 1 analyses natural metadata variation in a large museum collection, where field count, field type, image availability, and Place co-vary. Phase 2 introduces controlled field probes that hold object identity fixed while varying metadata quantity, field type, and image access. Our results show that metadata quantity alone does not explain generation behaviour. Field type determines whether models ground, omit, or infer information, while images can both support visual grounding and increase unsupported interpretation. More broadly, our findings show that metadata-conditioned data-to-text evaluation should assess field- and claim-level support, rather than relying only on aggregate input coverage or reference similarity.

37. 【2610.31172】Prompting Strategy Effects Depend on the Judge: A Multilingual Study of LLM-as-a-Judge Robustness

链接：https://arxiv.org/abs/2610.31172

作者：Asal Mehrabi,Mohammad Aliannejadi,Clemencia Siro

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Role Conditioning, recommended based solely, Conditioning are recommended, solely on English, English benchmarks

备注： 23 pages,

点击查看摘要

Abstract:LLM-as-a-Judge evaluation is increasingly applied to multilingual tasks, yet prompting strategies such as Chain-of-Thought and Role Conditioning are recommended based solely on English benchmarks. Whether their effectiveness transfers across judge models and languages remains unknown: prompt-sensitivity studies are largely English-centric, while existing multilingual judge studies fix the prompt template. In this work, we address this gap by measuring this interaction through a benchmark of 9 prompting strategies, 4 open-weight judges, 27 languages, and 4 tasks across 13 datasets, yielding over 1M pointwise scores on gold-reference outputs, validated against human judgments. We find that prompting strategies are not transferable: the choice of the judge model dominates the choice of prompting strategy, strategy effects reverse direction across judges, and stability degrades in low-resource languages, where these effects are concealed by aggregate reporting. These findings show that prompting effects in multilingual evaluation are conditioned on the judge, task, and language. Consequently, prompting strategies should be validated for the intended evaluation setting, and cross-study comparisons should account for both judge and prompt configuration.

38. 【2610.31158】Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research Reports

链接：https://arxiv.org/abs/2610.31158

作者：Jiahao Meng,Qize Yang,Yuxuan Wang,Yunfei Chu,Wensi Dai,Jin Xu,Yunhai Tong

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Deep Research Report, evaluate research centered, Research Report Generation, Deep research, Video-Centered Deep Research

备注：

点击查看摘要

Abstract:Deep research agents synthesize open-web evidence into long reports, but current benchmarks do not evaluate research centered on a source video. We introduce Video-Centered Deep Research Report Generation. Given a video and user request, an agent identifies research questions, retrieves external multimodal evidence, and produces an interactive report linked to relevant video moments. This task has direct practical value because it helps users locate relevant moments, verify claims, reproduce demonstrated procedures, and make informed decisions from video content. We present a skill-based workflow and OmniDR-Bench for this task. For evaluation, we propose Omni Atomic Rubric Trees (Omni-ARTs). Each tree contains three dimensions, 23 shared directions, and task-specific atomic binary criteria. The directions test audiovisual grounding, multimodal evidence use, and interactive presentation. Audited Rubric Construction (ARC) builds these trees through independent evidence collection, automated checks, behavioral calibration, and iterative human review. OmniDR-Bench contains 50 Chinese and English tasks across 19 realworld subcategories. It includes 6,414 criteria. Across 18 agent configurations, the best system scores 63.3 out of 100. Current agents still need broader content coverage, stronger causal and logical analysis across modalities, and more accurate citation support. We further analyze models, harnesses, skill configurations, video categories, and research trajectories. The code and data are released at this https URL.

39. 【2610.31148】Prompt Sensitivity in Tool-Augmented Model Comparisons

链接：https://arxiv.org/abs/2610.31148

作者：Mateusz Modrzejewski,Tomasz Radzikowski

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：models scores higher, Language models, scores higher, compared on question-answering, question-answering benchmarks

备注： 9 pages plus 8 pages of supplementary material; 2 figures and 4 tables in the main text, 2 figures and 5 tables in the supplement

点击查看摘要

Abstract:Language models are compared on question-answering benchmarks that pose each question in one wording, and a reworded question can change which of two models scores higher. We ask whether giving the models tools makes such comparisons more stable. An accuracy gain cannot answer this, because tools change several steps between the question and the scored answer at once. We propose a matched protocol that separates those steps: the answer readout, reasoning, the decision to call, the tool's answer, and the report supplied without a call. We apply it to six open models in five domains under five wordings. We find that tools raise accuracy where a program answers the question and widen the wording sensitivity of many pairwise comparisons. The widening follows how often a model calls, and call frequency follows the wording for some models and not others. It also depends on the interface and the instructions: a native tool-calling interface and a second tool description leave no detected widening in molecules, and sensitivity persists where tools return intermediate results. These findings show that deterministic reports do not guarantee stable comparisons. We recommend reporting call frequency and comparison stability under several wordings beside accuracy.

40. 【2610.31135】Mixing Matters: Evidence Position Bias Across Sequence Mixers in Long-Context Question Answering

链接：https://arxiv.org/abs/2610.31135

作者：Aman Behera,Namit Solanki,Mehul Anand

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Long-context models, Long-context, answer-bearing evidence, hybrid Mamba architectures, Transformer

备注： Accepted at the 2nd Workshop on Principles of Generative Modeling (PriGM), NeurIPS 2026. 9 pages. Code: [this https URL](https://github.com/beingamanforever/Mixing-Matters)

点击查看摘要

Abstract:Long-context models often use answer-bearing evidence less effectively when it appears away from a prompt boundary. We compare this position bias across Transformer, state-space, and hybrid Mamba architectures by moving one gold document through a fixed set of nine distractors. The evaluated Transformers show a beginning advantage that the evaluated state-space models lack, while both families favor evidence near the end. A matched pure-versus-hybrid Mamba comparison points in the same direction but remains statistically uncertain. The family difference appears among models that can answer the task. Transformer primacy reappears on synthetic retrieval, where state-space ceiling prevents a family comparison. A corpus swap within one state-space architecture changes overall accuracy without a detectable change in curve shape. Prompt changes can create or nearly remove a beginning advantage. Position remains decodable across architectures even when response curves differ, and attention concentration near initial tokens covaries with beginning sensitivity in the tested Transformer family. These exploratory results show that effective context use depends on the evaluated architecture family, capability, task, and prompt, without isolating the sequence mixer as the sole cause.

41. 【2610.31125】Delta N-gram: Forward-Only Continual Writing into a Language Model's Native N-gram Memory

链接：https://arxiv.org/abs/2610.31125

作者：Hao Wu

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：native hashed N-gram, hashed N-gram table, writes needed backpropagation, present Delta N-gram, model native hashed

备注： 33 pages, 3 figures, 9 tables, 2 algorithms. Follow-up to [arXiv:2610.14921](https://arxiv.org/abs/2610.14921) . Code: [this https URL](https://github.com/af-74413592/delta-ngram)

点击查看摘要

Abstract:Our previous analysis found that a model's native hashed N-gram table is where continual updates disturb the base least, but its writes needed backpropagation and changed the pretrained table. We present Delta N-gram, a forward-only write path into that table. The pretrained table T^0 is never modified. Evidence is written into a sparse patch \Delta on the rows it addresses: a 4.1M-parameter writer emits a target and a gate per (position, hash head) event, and a block-averaged delta rule keeps each row a convex combination of its old value and the gated targets. The writer is trained offline on raw text with the pretraining objective; at use time writing takes forward passes only, and clearing \Delta restores the original model. A 0.6B prototype trained to answer questions keeps 16/16 facts after a second write; online gradient writes keep 2--4/16. We study two writers: a plain writer that encodes evidence with the T^0-only model, and a delta writer that reads its current memory while encoding. On Qwen3.8-Flash-Next, the plain writer's memory is document-specific: on 64 held-out news events it lowers continuation NLL by 0.068 nats/token against empty memory and by 0.024 against another document's memory, and 0.063 and 0.013 after 16 intervening articles. The delta writer's memory is more document-specific and keeps more of it under distraction (70% vs 54%). Over 35,000 writes on our previous seven-task chain both writers stay stable and the delta writer drifts less (layer-2 math drift 176% vs 188%); later accuracy changes by -0.26/-0.52pp (-7.29pp for gradient updates) and small-k_i drift is 17.9/17.5% (39.2%). Acquisition is negative, and general-input drift reaches 32.8% (20.75%): format rows read by every example grow to 4--12 times their pretrained norm. Zeroing eight such rows removes over 98% of layer-2 drift on math inputs, together with their NLL gain.

42. 【2610.31117】hrough a PRISM, Clearly: Step-Sequence Reasoning for Mistake Recognition in Procedural Videos

链接：https://arxiv.org/abs/2610.31117

作者：Olga Loginova,Oleksandr Bezrukov,Frank Keller

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：valid multi-step activities, requires identifying deviations, recognition requires identifying, Procedural mistake recognition, mistake recognition requires

备注：

点击查看摘要

Abstract:Procedural mistake recognition requires identifying deviations from valid multi-step activities. We study post-completion recognition from videos with benchmark-provided step boundaries. We introduce PRISM (Procedural mistake Recognition via Interpretable Semantic Modeling), which grounds video segments in language and maps their descriptions to procedural states using a lightweight hidden Markov model trained on correct executions. Reference alignment and semantic checks identify errors in step content and order. To support evaluation across heterogeneous benchmarks, we map dataset-specific annotations to four edit-based error types: insertion, deletion, substitution, and transposition. Across three benchmarks, we compare gold and VLM-generated descriptions in raw, semantic-role, and action-object forms. Decoder controls show consistent gains from the trained local decoder over nearest-candidate matching, with additional, dataset-dependent benefits from sequence decoding. Semantic role labeling improves Any-F1 in all six matched grounded comparisons, although the gains vary across datasets and do not translate into uniform improvements under separate configuration selection. These results establish language grounding as an effective interface for explicit procedural mistake reasoning and characterize the contributions of representation and decoding.

43. 【2610.31116】A Grammar of French Civil Cassation: A Ground-Level Dataset and Tool

链接：https://arxiv.org/abs/2610.31116

作者：Avrile Floro,Tamara Dhorasoo,Nils Holzenberger,Thomas Le Goff,Tiphaine Viard,Maria Boritchev

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

关键词：paper presents, French Court, ground-reasons pairs, Court, civil chambers

备注： Accepted at JURIX 2026 (39th International Conference on Legal Knowledge and Information Systems)

点击查看摘要

Abstract:This paper presents a dataset of 121,536 ground-reasons pairs across 86,464 rulings of the five civil chambers of the French Court of Cassation (2016-2025). An appeal on points of law cannot itself be appealed and often decides a case for good. Understanding how the Court rules is thus crucial and can help lawyers who draft those appeals. Inside a ruling, every ground of appeal (a distinct legal complaint against the appealed decision) has its own answer from the Court. This answer is called the reasons and it belongs to one of a few doctrinal families. Using a deterministic pipeline, we pair each ground with its reasons and attach the pair to its family, according to the established French taxonomy. We obtain a descriptive grammar of civil cassation that shows which grounds succeed, which legal texts they refer to, and how both evolve over the decade. We release the dataset, the code and an interactive consultation tool.

44. 【2610.31107】Learning What to Ask for Tomorrow: Active Preference Acquisition for Long-Term Personalized Web Agents

链接：https://arxiv.org/abs/2610.31107

作者：Yiqi Wang,Zizhi Zeng,Jiaqi Zhang,Yiqun Duan,Mingkai Zheng,Taotao Cai

类目：Computation and Language (cs.CL)

关键词：Web agents increasingly, long-term usefulness depends, agents increasingly serve, repeated online tasks, Web agents

备注：

点击查看摘要

Abstract:Web agents increasingly serve the same user across repeated online tasks such as booking travel, shopping, and scheduling, so their long-term usefulness depends on how well they know the user's preferences. Passive memory and personalization methods cannot obtain preferences the user never reveals, and clarification methods that value a question by its benefit to the current task overlook the benefit of reusing the answer in later tasks. We study Active Preference Acquisition (APA): which missing preferences are worth the cost of asking? We define the Prospective Personalization Value (PPV) of a missing preference as its expected cumulative utility gain over future tasks minus the effort and disclosure-risk cost of asking, and select questions under a per-interaction budget. We characterize when cumulative reuse justifies acquisition despite insufficient single-task benefit, and evaluate this regime with an initial-profile diagnostic. APA computes the counterfactual gain of each candidate preference on public task prototypes with the agent's own task solver and aggregates it by the expected reuse of each task family. We evaluate it on ActiveWebPref, a controlled longitudinal benchmark with hidden but queryable user profiles and exact task utilities. At a horizon of 20 tasks, 34.4% of budget-feasible valuable missing preferences are amortization-dependent; APA acquires 80.3% of them, whereas current-task value of information acquires 5.1%. Under per-user asking-cost caps matched to APA's realized expenditure, APA achieves higher net utility than four heuristic selection baselines. In our cost setting, asking about every unknown preference yields lower net utility than not asking, while APA recovers 84.2% of its utility gain with 27.6% of its questions. The value of acquiring a user preference should account for its reuse across future tasks, not only its benefit to the task at hand.

45. 【2610.31098】RIFT: KV Cache Compression for Draft Models with Complementary Compressibility Training

链接：https://arxiv.org/abs/2610.31098

作者：Dor Tsur,Maor Ashkenazi,Maximilian Golub,Peter Hicks,Yaniv Galron,Talor Abramovich,Yoav Miron,Tiyasa Mitra,Bita Darvish Rouhani,Ran Zilberstein

类目：Computation and Language (cs.CL)

关键词：Speculative decoding, popular decode acceleration, cache, cache compression, Speculative

备注：

点击查看摘要

Abstract:Speculative decoding is a popular decode acceleration method. As such, it is particularly relevant to long-output generation, which requires an increasingly large KV cache. KV cache compression offers a way to constrain costs in long-context drafting. However, compression methods that focus on prefill information can lose relevance as the output length grows. We term this phenomenon decode staleness and show that it degrades draft model accuracy under selection-based KV cache compression. We introduce RIFT, a family of selection-based KV cache compression strategies that balance prefill information and recent generated tokens. We show that refreshing the KV cache selection during token generation significantly improves the drafter's quality at the cost of additional decode latency. To alleviate the refresh costs, we propose an adaptive KV refresh strategy that reduces the number of score calculations while retaining the drafter's quality. We further demonstrate how a compressibility-driven drafter training phase, based on sparse attention masks, can improve the drafter's quality under a compressed KV cache. Combined with compressibility training, RIFT enables Qwen3.5-4B, drafting for Qwen3.5-122B, to retain over 98% of its full-cache acceptance length on 32K-token inputs, 4K-token outputs, and an 8K-token KV cache budget.

46. 【2610.31090】What Pairwise Evaluation Misses: Reward Scores across Prompts

链接：https://arxiv.org/abs/2610.31090

作者：Mateusz Modrzejewski,Tomasz Radzikowski

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：filtering and ranking, preference optimization, prompt, responses, Reward models

备注： 31 pages, 5 figures, 33 tables

点击查看摘要

Abstract:Reward models score responses for preference optimization, filtering and ranking, and pooling scores across prompts needs them to be comparable. Yet pairwise evaluation compares two responses to the same prompt, so any score component shared by a prompt's responses cancels and goes untested. We study this component by comparing between-prompt variation in model scores with the same variation in human ratings of the same responses. We propose a human-referenced audit, built from a between-prompt variance share, a sibling-rating regression and prompt substitutions, and apply it to eighteen released scorers and six matched training conditions. We find that scores cluster by prompt more than the ratings do: on HelpSteer2, six reward models have between-prompt shares of 0.34 to 0.64 against a human share near zero. Replacing the original prompt with a fixed instruction keeps substantial clustering but weakens agreement with prompt-level human ratings, so clustering alone does not show agreement with humans. Part of that variation is useful: subtracting prompt means lowers the helpfulness of globally selected responses, and scores stay sensitive to a wrong prompt even when training shuffles prompt means. We propose that reward evaluation check between-prompt variation, sensitivity to a wrong prompt and usefulness for selection separately.

47. 【2610.31062】SCOPE: Compiling Natural-Language Policies into Neurosymbolic Predicate Programs

链接：https://arxiv.org/abs/2610.31062

作者：Arnon Mazza,Elad Levi

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：single-turn content moderation, application-specific policies evaluated, LLM agents, tool-call trajectories, agents has shifted

备注：

点击查看摘要

Abstract:Policy enforcement for LLM agents has shifted from single-turn content moderation to compound, application-specific policies evaluated over multi-turn transcripts and tool-call trajectories. Fine-tuned guardrail models are efficient but degrade on compound policies, and while LLM-as-a-judge approaches achieve higher accuracy, they incur high inference cost and tend to produce unstable predictions. Neurosymbolic methods offer a natural alternative, decomposing the policy into narrow neural decisions composed under explicit logic. However, existing symbolic layers lack the required expressiveness and are optimized against fixed data rather than the policy itself. To address this, we introduce SCOPE, which compiles a policy into an executable program of neural predicates executed by small models, deterministic extractors, and code that composes their outputs. The program is optimized jointly with its training data, using adversarial generation of counterexamples that target where the program deviates from the policy. We evaluate SCOPE on a benchmark of real-world policy tasks against prompt optimization, task decomposition, and workflow generation methods, achieving the highest average accuracy across tasks and models. Programs optimized with the weakest executor transfer to other models without further optimization. This allows them to be deployed in production on inexpensive models, where they reach accuracy comparable to frontier reasoning models. Unlike these monolithic models, SCOPE produces substantially more stable predictions, and each verdict is interpretable through the predicate outputs that produced it. Additionally, we validate the key components of our method through an ablation study. SCOPE thus enables reliable, interpretable, and efficient policy enforcement at production scale.

48. 【2610.31047】Harm Is Behavioural, Moderation Is Lexical: How Language and Culture Decide Whom Automated Safety Systems Protect and Whom They Silence

链接：https://arxiv.org/abs/2610.31047

作者：Gabriel Lars Sabadin,Dr Nicola Harding,Sarah Kingston

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：paper quotes slurs, published test suites, Content warning, African American English, quotes slurs

备注： 18 pages, 2 figures. Code, simulations and per-case outputs: [this https URL](https://osf.io/v7aef/files/osfstorage?view_only=9449667241894b1ca7d336fc4b8259d8)

点击查看摘要

Abstract:Content warning: this paper quotes slurs and hateful statements from published test suites; the racial slur among them is masked. Automated systems decide at scale which messages are harmful, and they decide unevenly. Classifiers label African American English as offensive up to twice as often as other English, the accounts of prominent drag queens can score as more toxic than those of white nationalists, and safety behaviour that holds in English collapses in low-resource languages. We argue that over-flagging and under-protection share one cause: deciding harm from vocabulary and surface form rather than from what a message does. We organise the evidence into seven failure modes and argue, as testable hypotheses, that harmful behaviours (a request for secrecy, a demand for payment, an attempt to isolate someone) travel across languages better than the words that express them. We propose an evaluation protocol that makes the gap between the best- and worst-served language communities a headline result, and show that the naive gap is inflated under equal service and that its usual bootstrap interval is unreliable. Applied to five open systems in eleven languages, from a keyword lexicon to two current multilingual guard models, the protocol finds that none reaches native-speaker accuracy at separating harmful function from harmless form (51 of 55 system-language pairs fall short); that greater capability raises discrimination in nine languages while leaving Arabic and romanised Hindi near chance, so the gap between the best- and worst-served languages grows with capability; that one system both over-flags and under-protects the same language most; and that a language a system reads worst can look the most fairly treated when only false positives are reported.

Comments:
18 pages, 2 figures. Code, simulations and per-case outputs: this https URL

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

ACMclasses:
I.2.7; K.4.1

Cite as:
arXiv:2610.31047 [cs.CL]

(or
arXiv:2610.31047v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2610.31047

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

49. 【2610.31019】Chunk Recomputation under Real Document Revisions: Measuring Update Cost and Retrieval Quality of Fixed, Recursive, and Content-Defined Chunking

链接：https://arxiv.org/abs/2610.31019

作者：Yuning Bian,Lele Xu,Yifan Yuan,Xinyu Yin,Chengyan Zhan

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：knowledge base continue, strategies for retrieval-augmented, retrieval-augmented generation, documents underlying, underlying a knowledge

备注： 6 pages, 3 figures, 3 tables. Accepted at AIBDCC 2026

点击查看摘要

Abstract:Chunking strategies for retrieval-augmented generation are almost always evaluated on a static snapshot, yet the documents underlying a knowledge base continue to change. Because chunks are embedded independently, a boundary that moves after an edit forces unchanged text to be re-embedded. We measure this update cost on 120 pairs of adjacent Chinese and English Wikipedia revisions for three stateless chunkers (non-overlapping fixed-size, recursive paragraph-first, and content-defined chunking) under a strict byte-identical reuse rule and a frozen dense encoder. On the 116-article common-success pool, with frozen, length-calibrated parameters, fixed-size chunking recomputes 57-68% of its full new-version embedding-input workload, recursive chunking 38-56%, and content-defined chunking 43-54% (it failed on 4 of 62 Chinese articles), while at these parameters mean evidence recall under a fixed 2048-token retrieval budget differs by less than two percentage points within either language. A cost-only parameter grid shows that the ranking of the two content-aware chunkers changes with chunk-length settings, whereas non-overlapping fixed-size chunking has the highest recomputation cost in every length-matched condition. Controlled edits and a verbatim-presence diagnostic support boundary drift as one contributor to recomputation of text already present in the previous version. Update cost is therefore a substantial, parameter-sensitive dimension that static retrieval evaluations do not expose and that should be reported alongside retrieval quality.

50. 【2610.31017】Mostly Reading: What Open-Book Scores Measure in Document-Level LoRA Adapters

链接：https://arxiv.org/abs/2610.31017

作者：Martino M. L. Pulici,Cuong Xuan Chu,Evgeny Kharlamov,Volker Tresp

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Single-document LoRA adapters, Single-document LoRA, merged and retrieved, proposed as units, units of knowledge

备注： 27 pages, 3 figures, 15 tables, under review at ACL ARR

点击查看摘要

Abstract:Single-document LoRA adapters have been proposed as units of knowledge to be merged and retrieved; yet open-book scoring, with the document in the prompt, can credit a document's own adapter (its specialist) for reading that document as readily as for holding it. Training one adapter for each of 150 Wikipedia articles on Llama-3.1-8B-Instruct, we find that open-book scores mostly measure a reading behaviour every adapter shares: a random adapter trained on another document recovers 82 % of the specialist's open-book advantage over the base model but only 2 % of its advantage on a cloze probe that asks for the same document's facts without providing the source text, a share we cannot distinguish from zero. Content does reach the weights, since the specialists beat the base model in cloze recall by 0.094, and the geometry of their updates follows the documents they read; yet, in a test of 30 queries, adapters chosen by weight-space proximity or text embedding are not distinguishable from random ones on either probe, although that test cannot exclude an advantage of about four fifths of what a query's own adapter gains over a random one. At 16 documents or more, correctly scaled merges recover 87 % to 89 % of the specialists' open-book advantage but only 12 % to 16 % of their cloze advantage, with intervals that run from below zero to at most 32 %, against 94 % for joint this http URL also report four silent errors, each of which produced a clean, wrong result.

51. 【2610.30997】Padding to k: A Minimum Count in the Schema Makes Open-Weight Models Pad Their Extraction Lists

链接：https://arxiv.org/abs/2610.30997

作者：Abhishek Barali,Aayush Paudel

类目：Computation and Language (cs.CL)

关键词：Extraction pipelines, pipelines ask language, language models, models, Extraction

备注： 26 pages, 4 figures. Preregistered at [this https URL](https://osf.io/e4r9f) . Code and data: [this https URL](https://github.com/AbhishekBarali/padding-to-k)

点击查看摘要

Abstract:Extraction pipelines ask language models for JSON that follows a schema, and the schema can set a minimum number of list entries. We ask what models do when the document holds fewer items than that minimum. Under a preregistered plan, we test eight open-weight models on 558 real documents from nine annotated datasets, with six more models on hosted services as a reference. Three findings stand out. First, models treat the count as a target: a minimum shown in the schema, but not enforced, raises the share of lists longer than the true count from 34.5% to 55.4%. Second, the padding is hard to catch, because most added entries are real text taken from the document; about half of them pass a check that each entry occurs in the source. Third, common fixes help only partly: a line saying fewer items are fine removes the effect on average but misses more true items, a count in prose ("up to k") also raises over-counting, an "N/A" option under an enforced minimum still leaves half the lists padded, and re-asking with the validation error makes padding far more common. We release the code, answer lists and run records at this https URL

52. 【2610.30989】ColaBench: Evaluating Memory-Guided Knowledge Acquisition in Personal Agents

链接：https://arxiv.org/abs/2610.30989

作者：Wenjie Zhang,Zhichao Shi,Xuhui Jiang,Xiaojun Wu,Cehao Yang,Chengjin Xu,Xiaoning Song

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：user current request, apply external knowledge, external knowledge suited, draw on long-term, apply external

备注： 12 pages, 4 figures

点击查看摘要

Abstract:Personal agents need to draw on long-term interaction history to retrieve and apply external knowledge suited to a user's current request. Even an answer grounded in relevant documents can be unsuitable when it overlooks the user's circumstances. This creates two connected challenges: using historical conditions to identify the knowledge needed for a new request, and applying that knowledge to the user's situation. Existing benchmarks advance memory recall, personalized retrieval, and memory-guided action, while the joint evaluation of these two challenges remains underexplored. We introduce ColaBench, a synthetic benchmark in health and daily living, with 349 tasks across 10 Profiles and a knowledge base of 13,033 documents. Its Evidence Graph connects personal conditions to their disclosures across public interaction sessions, records prior document exposure, and links answer requirements to personal and newly acquired document evidence. We also introduce MemKB, which uses state summaries to inform queries and rule application, and memory-document links to retrieve knowledge associated with the user's history. MemKB achieves 86.25% Accuracy with an average of 4.07 interaction rounds per task. Task-level analysis finds larger gains on tasks integrating information across multiple historical Facts; error analysis further identifies unsupported personal assumptions and rule misapplication as obstacles to using retrieved evidence. ColaBench provides traceable tasks and an evaluation framework for studying how memory guides knowledge acquisition and rule application.

53. 【2610.30987】Interpretive Variation and Discourse Structure in Detecting Enthymemes in Controversial Political Discourse

链接：https://arxiv.org/abs/2610.30987

作者：Martial Pastor,Nelleke Oostdijk

类目：Computation and Language (cs.CL)

关键词：common persuasion device, conclusion unstated, social media, leave a premise, premise or conclusion

备注：

点击查看摘要

Abstract:Enthymemes are arguments that leave a premise or conclusion unstated, and they are a common persuasion device on social media. Because readers must fill in the missing part themselves, they often disagree on whether a text contains one. This paper asks how to detect and evaluate enthymemes when such disagreement is part of the task. On tweets about vaccination and immigration, each labeled by five annotators, F1 stalls around 0.67 for every fine-tuned model we train, regardless of data size, added features or label type. We therefore ask how these models should be evaluated instead, and propose metrics that compare predictions with the full distribution of annotator votes, together with a model that predicts this distribution directly and captures disagreement better at no cost in F1. We then ask what role discourse structure plays. Models learn to rely on explicit argumentative structure: they reliably recognize tweets without an enthymeme but rarely commit on tweets that contain one. Both the models and a discourse parser miss arguments whose links are left implicit and must be inferred by the reader. Finally, we discuss what these blind spots mean for content moderation systems trained on majority labels.

54. 【2610.30983】A Reality Check of Inference-Time Context Augmentation Methods

链接：https://arxiv.org/abs/2610.30983

作者：Haeun Yu,Geert Heyman,Pepa Atanasova,Isabelle Augenstein

类目：Computation and Language (cs.CL)

关键词：Large language models, Large language, resulting in hallucinations, parametric knowledge, fail to utilise

备注： 19 pages, 8 figures

点击查看摘要

Abstract:Large language models (LLMs) often fail to utilise the context given in the input, resulting in hallucinations or a fallback to parametric knowledge. Context augmentation methods aim to improve model performance by modifying the input, from inserting filler tokens that add computational time to adding relevant content such as elaboration of a context during inference. However, these methods have been evaluated in isolation and only by their performance gains, leaving it unclear how they compare and whether they reliably improve performance. In this paper, we present an evaluation framework spanning five methods that differ in how informative the inserted content is and apply them at the sentence level across seven models spanning multiple sizes on three datasets. We find that accuracy gains are not always genuine improvements but undirected perturbations: the methods correct some predictions while breaking others, particularly when the inserted text allows only for more computational time. Our analysis reveals that methods that bring no additional content primarily change model predictions near the decision boundary. Our findings highlight the need to evaluate the reliability of the accuracy gains before adopting them in practice.

55. 【2610.30970】Joint or Per-Option? Compact Encoders for Closed-Set Decisions from 17 Million to 1 Billion Parameters

链接：https://arxiv.org/abs/2610.30970

作者：Tardelli Ronan Coelho Stekel

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：language-model pipelines end, selecting a tool, language-model pipelines, pipelines end, per-option scoring

备注： 18 pages, 8 figures, 8 tables. Code: [this https URL](https://github.com/tardellirs/crivo-decision-encoders) ; models: [this https URL](https://huggingface.co/tardellirs)

点击查看摘要

Abstract:Many language-model pipelines end in a closed-set decision, such as selecting a tool. Prompting a large language model for it is slow and order-sensitive. We ask how small an encoder for such decisions can be and whether it should read the options jointly or separately. In a three-seed study at 32 million parameters, per-option scoring beats joint scoring on a held-out sample of a 37-benchmark decision suite by 5.8 points of chance-corrected skill at matched optimizer steps and by 2.8 at approximately matched training compute; two external benchmarks agree, though not significantly on their unseen tasks. Crossing reader with initialisation shows that the advantage requires a reranker initialisation, whose query-candidate pair input matches per-option reading; from the raw encoder the two readers are indistinguishable. Per-option scoring needs 5 to 13 times more encoder passes: at most twice the median latency, but more than four times the mean. Of six released joint encoders (17 million to 1 billion parameters), the 68- and 150-million-parameter models exceed a 435-million-parameter DeBERTa-v3 zero-shot classifier by 4.9 and 5.9 accuracy points on 209 overlap-audited System1-Arena tasks and are at least on par with it on the 145 tasks unseen in training. The smallest answers a median request in 14 milliseconds on 16 processor threads, against 728 for the classifier. Reordering options changes 12 to 23% of the joint models' answers (per-option scoring: none). Up to 68 million parameters, they lead their size range on a public leaderboard's private, mainly in-distribution tests.

56. 【2610.30960】Once a Tree, Always a Tree? Cross-lingual Transfer of Hierarchical Generalization in Language Models

链接：https://arxiv.org/abs/2610.30960

作者：Shin Yamaguchi,Masaya Taniguchi,Tatsuki Kuribayashi,Taro Watanabe,Yoshinobu Kano

类目：Computation and Language (cs.CL)

关键词：process remains unclear, underlying process remains, remains unclear, underlying process, process remains

备注： EMNLP 2026 main

点击查看摘要

Abstract:Language models (LMs) often exhibit successful cross-lingual transfer through continued (pre)training, still their underlying process remains unclear. One possibility is that LMs can leverage the evidence toward language-universal principles, namely, hierarchical structure, from a source language (L1) to a new language (L2), while many other non-linguistic explanations, e.g., improved initialization of position embeddings, can be potentially possible. In this study, to quantify the cross-linguistic transferability of linguistic evidence in cross-lingual LM training, we introduce a new experimental design, namely, a cross-lingual poverty-of-stimulus (CPOS) setting that ablates how LMs' hierarchical generalization in L2 can be led by structural evidence provided in L1. We contrast counterfactual L1 and L2 learning scenarios where the L2 corpus is ambiguous between linear and hierarchical grammar rules, while the amount of positive evidence for the hierarchical rule is controlled on the L1 side. Our experimental results show that LMs can partially, yet not perfectly, transfer L1 structural evidence to L2, yielding only a small but detectable hierarchical bias, while the strength of transfer depends on language pairs. We further ablate the conditions for successful transfer, motivated by recent reports on the substantial impact of vocabulary overlap. We indeed find that vocabulary overlap is crucial even for the cross-lingual transfer of hierarchical syntactic generalization. This suggests that this also explains the language-pair-dependent tendencies in the main experiments and suggests that the transfer of linguistic evidence in continued new-language learning is only conditionally achievable.

57. 【2610.30949】IQuest-Q1: Advancing Foundation Capabilities for Agentic CLI Systems

链接：https://arxiv.org/abs/2610.30949

作者：A. Jian Yang,An Huang,Bo Dan,Chen Mu,Chengran Yang,Chuan Shi,Feng Chang,Hongxin Li,Hongyuan Tao,Jinxing Zhang,Jujie He,Kun Wang,Lin Jing,Ming Yang,Qicheng Hu,Renyuan Li,Shark Liu,Shawn Guo,Shi Qing,Shi Zhong,Tianyu Zheng,Wei Liu,Wei Zhang,Wenrui Cai,Wenxiao Chen,Xuxing Chen,Yan Xing,Yi Xing,Yifan Luo,Yiran Xing,Yizhi Li,Yongsheng Kang,Yucheng Ding,Yue Song,Yun Qing,Yunqi Liu,Zelong Huang,Zhengmao Ye,Zhentao Fan,Zhiteng Li,Ziling Huang,Bihong Tang,Bingli Wang,Ce Jun,Changhao Chen,Chen Hu,Chen Xiao,Chi Liu,Chunjiang Ge,Danyang Li,Deyang Kong,Dian Qi,Ding Tan,Evan Yang,Fanglin Xu,Fei Bai,Gang Liu,Guochang Li,Hao Tang,Haoran Feng,Haowen Wang,Huahao Hu,Huanjin Yao,Huatong Song,Jia Deng,Jiajun Wu,Jialiang Cheng,Jiayi Liang,Jiayi Wu,Jie Deng,Jiejun Tan,Jing Yang,Jingda Xu,Junhang Cheng,Junxiao Liu,Kai Lv,Kaixiang Pan,Kecheng Lu,Kun Zeng,Kun Zheng,Kunbo Ding,Liang Qiu,Lingyi Sun,Luan Zhang,Mengxiao Lv,Ning Dong,Pei Wang,Peng Zhang,Qingsong Cai,Qixiang Yin,Qiyao Wang,Renbiao Liu,Renfei Dang,Ruihang Li,Ruirui Huang,Shanhui Yin,Shen Jian,Shengjie Fang,Shikai Li,Shinan Zhang

类目：Computation and Language (cs.CL)

关键词：agentic foundation model, combining Stable SplitNorm, agentic foundation, agentic coding capabilities, strengthen agentic coding

备注： IQuest Report

点击查看摘要

Abstract:We present IQuest-Q1, a sparse Mixture-of-Experts (MoE) agentic foundation model with 320B total parameters (15B activated). IQuest-Q1 is developed through a three-stage process: (1) stable and efficient pre-training, combining Stable SplitNorm, Muon, and muP with a two-stage curriculum whose second stage increases the coding-data mixture, preserving a wide stability margin between safe and optimal learning rates; (2) fine-grained mid-training, expanding the data mixture across domains and formats and progressively extending the context; and (3) multi-scaffold with multi-version post-training, combining SFT, domain-specialized RL, and MOPD across various scaffolds to integrate complementary training signals and strengthen agentic coding capabilities. Furthermore, model merging combines different experts and checkpoints from different stages while mitigating conflicts among their parameter updates. The resulting IQuest-Q1 demonstrates capabilities in both coding and general tasks. We release IQuest-Q1 as an open-source model to support community research and development.

58. 【2610.30947】RetiJev: Fast and Source-Grounded Ophthalmic Decision Models

链接：https://arxiv.org/abs/2610.30947

作者：Bo Liu,Lianyu Wang,Meng Wang,Ching-Yu Cheng,Huazhu Fu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：support requires fast, incur substantial latency, Ophthalmic clinical decision, autoregressive large language, decision support requires

备注：

点击查看摘要

Abstract:Ophthalmic clinical decision support requires fast, accurate, and privacy-preserving inference, yet autoregressive large language models (LLMs) incur substantial latency and computational overhead for decisions among predefined actions. We therefore investigate a decision-oriented alternative to generative reasoning. Specifically, we first introduce RetiJev-Data, a source-grounded ophthalmology corpus comprising 78,158 clinical-decision and diagnosis questions derived from articles in PubMed Central and a MeSH vocabulary covering 531 eye diseases, and 50,074 guideline-grading questions spanning 11 grading systems, along with a 24,662-question evaluation benchmark. Based on this, we develop RetiJev, a family of 0.8B-9B decision models that directly score candidate answers without autoregressive decoding. Across all model sizes, RetiJev outperforms both a 27B LLM and the commercial Jev 1.13 decision model on guideline grading by 10.4-23.0 points. RetiJev-9B further achieves the highest accuracy on clinical decisions, improving over both baselines by 5.4-6.5 points while matching them on diagnosis. It answers a case in 158 ms on one GPU, 3.5x faster than LLM generation and 470x faster than reasoning. Models are released at this https URL.

59. 【2610.30946】racing Hallucinations in LLM Reasoning for UML Class Diagram Generation: An Empirical Taxonomy and Mitigation Study

链接：https://arxiv.org/abs/2610.30946

作者：Mojdeh Rahmanian,Foutse Khomh,Ashkan Sami,Yanchao Yu

类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)

关键词：Large Language Models, Large Language, natural language requirements, generate UML class, Prompt Faithfulness

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) can generate UML class diagrams from natural language requirements, but hallucinations may compromise the correctness and completeness of the resulting diagrams. Existing evaluations mostly assess the final diagram, without examining the intermediate traces of reasoning-capable LLMs, which can reveal where these hallucinations arise. We develop an empirical taxonomy of eleven hallucination sub-types organised into three dimensions: Prompt Faithfulness (deviations between requirements and reasoning), Code Faithfulness (discrepancies between reasoning and generated PlantUML code), and Reasoning Quality (problems within the reasoning). The taxonomy was derived from 60 manually annotated DeepSeek-R1 traces, applied to 120 further DeepSeek-R1 traces through a dual-LLM annotation pipeline, and examined on 20 DeepSeek-V4-Pro traces. Code Faithfulness was the most frequent dimension for DeepSeek-R1 in both datasets, whereas Prompt Faithfulness dominated for DeepSeek-V4-Pro, suggesting model-dependent failure patterns. In the manually annotated traces, reasoning-trace length showed no significant monotonic association with hallucination frequency, whereas requirement complexity was negatively associated with it, particularly for Prompt Faithfulness errors. In a mitigation experiment on 13 Golden UML ModelSet cases with three Qwen3-based models, adding Prompt Faithfulness and Reasoning Quality constraints to the generation prompt raised the pooled mean F1 score by 4.0 percentage points, whereas a post-hoc Code Faithfulness review provided no consistent further benefit. Relationship modelling remained the lowest-scoring element throughout. These results suggest that localising hallucinations within the generation process can inform targeted, prompt-based mitigation. Whether these findings generalise beyond the DeepSeek and Qwen3 model families remains to be tested.

60. 【2610.30934】Verbalizing Activation Differences with Natural Language Autoencoders

链接：https://arxiv.org/abs/2610.30934

作者：Andrea Blasi Núñez,Gianluca Barmina,Federico Torrielli,Thiusius Rajeeth Savarimuthu,Peter Schneider-Kamp,Lukas Galke Poech

类目：Computation and Language (cs.CL)

关键词：Activation verbalizers translate, large language models, NLAs, human-readable text, verbalizers translate

备注： Under Review

点击查看摘要

Abstract:Activation verbalizers translate the internal representations of large language models into human-readable text. The recently proposed natural language autoencoders (NLAs) learn this by reconstructing activations through a natural language bottleneck. However, it remains unclear how well these methods generalize beyond the setting they were trained for. Here, we study this question for NLAs along four closely related questions: (i) Do NLA verbalizations exhibit compositional structure with respect to their input? (ii) Do NLAs generalize to finetuned versions of the model they were trained for? (iii) Can NLAs recover finetuning objectives in model diffing? (iv) Can NLAs be specialized for model diffing? Across four models from three families, our experiments provide evidence supporting a largely positive answer to all four questions. Specifically, verbalizations of composed analogy activations mostly name the target while rarely mentioning the subtracted word, and an NLA can be reused on lightweight finetunes of its original model without retraining, with reconstruction quality degrading noticeably only for the largest model. Verbalizing activation differences between Taboo model organisms and their original models recovers the concealed secret word for most organisms, and reinforcement learning on activation differences further improves this recovery on held-out organisms. We also find that NLAs can recover the finetuning objective without the finetuned model generating any token, since the most informative token positions precede the user prompt. NLAs do not yet match state-of-the-art model diffing methods on the emergent misalignment detection task, but outperform a blackbox baseline. Our findings suggest that NLAs can meaningfully verbalize differences in activation space, rendering NLAs a promising direction for future work.

61. 【2610.30933】ReflectPO: Reflection-Guided Policy Optimization for Long-Horizon LLM Agents

链接：https://arxiv.org/abs/2610.30933

作者：Rumei Li,Xunliang Cai

类目：Computation and Language (cs.CL)

关键词：large language models, external tools, large language, language models, tackle complex

备注：

点击查看摘要

Abstract:With external tools, large language models (LLMs) can tackle complex tasks through sustained environmental interaction. LLM-based agents are therefore increasingly used to tackle complex long-horizon tasks in real-world environments. However, these tasks involve sequential, interdependent decisions and changes in environmental states. Early execution errors affect subsequent interaction histories and environmental states, and their effects accumulate along the decision chain. To address this challenge, we propose Reflection-Guided Policy Optimization (ReflectPO), a reinforcement learning framework for autonomous error recovery in long-horizon tasks. ReflectPO comprises two core components. The first is Reflection-Guided Sampling. We use branch differences and repeated visits in interaction trajectories to construct hints for error recovery. The second is Tree-Structured Credit Assignment. We organize sampled trajectories into trees and assign action-level credit using parent--child reward differences and recovery gains. Experiments over two long-horizon tool-use benchmarks show that ReflectPO outperforms multiple existing baselines in most domains. It also achieves the best overall performance on average. Further analyses show that ReflectPO effectively improves agents' ability to recognize their own deviations, recover from erroneous states, and continue making progress toward task completion.

62. 【2610.30912】Hierarchical Fine-Grained Cross-Modal Alignment via Dynamic Granularity Discovery and Optimal Transport

链接：https://arxiv.org/abs/2610.30912

作者：Pengfeng Song,Shaozhong Zhang,Pengfei Shao

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：model visual evidence, distinguish semantically similar, image-text retrieval requires, including objects, Fine-grained image-text retrieval

备注： 8 figures, 6 tables. Code available at [this https URL](https://github.com/sungkites/HFCMA)

点击查看摘要

Abstract:Fine-grained image-text retrieval requires a model not only to assess global semantic consistency between an image and a text, but also to model visual evidence for local textual semantics, including objects, attributes, quantities, actions, and relations, so as to distinguish semantically similar candidates. Existing methods commonly use fixed image patches, detected regions, or text tokens as the basic matching units and then aggregate local interactions through max pooling, cross attention, or similarity accumulation. Such strategies remain limited in semantic unit construction and global matching consistency. This paper proposes a hierarchical fine-grained cross-modal alignment framework, termed HFCMA. The framework progressively transforms low-level patch and token representations into adaptive visual regions and textual phrases, and then performs structured region-phrase matching within a global retrieval scoring process. Specifically, HFCMA first adopts dynamic granularity discovery (DGD) to aggregate raw patches and tokens into semantically compact visual regions and textual phrases. It then formulates region-phrase matching as an entropy-regularized optimal transport problem, thereby estimating a structured alignment matrix under global marginal constraints. To reduce background noise and local semantic drift, HFCMA further introduces background debiasing, textual importance weighting, and prototype consistency regularization. Experiments on Flickr30K and MS-COCO show that HFCMA effectively combines dynamic semantic unit construction with OT-based structured matching under a dual-encoder retrieval framework. The resulting fine-grained score provides structured local alignment information for candidate ranking and improves the discrimination of subtle semantic differences.

63. 【2610.30900】Silicon Samples Match the Answers but Not the Respondents

链接：https://arxiv.org/abs/2610.30900

作者：Yusuke Kumagae,Masahiro Kaneko

类目：Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：Silicon sampling generates, large language model, resulting synthetic populations, Silicon sampling, sampling generates survey

备注：

点击查看摘要

Abstract:Silicon sampling generates survey respondents by having a large language model (LLM) answer a survey as a person with given demographic attributes, and the resulting synthetic populations are increasingly used in place of human ones. Existing evaluations focus on individual-answer accuracy, per-question answer distributions, and correlations across questions. None of these compares the respondents themselves, so a generator whose respondents have combinations of answers found in no human respondent can still score well if it reproduces every answer distribution. We propose the respondent coverage gap (RCG), which represents each respondent as a point defined by their complete answer profile and measures how far each human respondent is from the nearest generated one, relative to the distance between human samples. On two US social surveys, all six LLMs we evaluate leave human respondents uncovered, and under our main settings, they fall behind a baseline that samples each answer independently from the human marginals. Across the prompting and inference settings we test, every LLM has a higher RCG than a Gaussian copula fitted to the human data.

64. 【2610.30885】From Perpetrators' Digital Footprints to Behavioral Communities: An Ontology-Driven Framework for Bengali Cyberbullying Analysis--- FULL VERSION

链接：https://arxiv.org/abs/2610.30885

作者：Md. Nesarul Hoque,Md Hanif Seddiqui,Miskatul Anwara,Rudra Pratap Deb Nath

类目：Computation and Language (cs.CL)

关键词：isolated abusive messages, Cyberbullying involves behavioral, abusive messages, isolated abusive, Cyberbullying involves

备注： 32 pages, 8 tables, 13 figures

点击查看摘要

Abstract:Cyberbullying involves behavioral and contextual patterns beyond isolated abusive messages. However, existing approaches remain fragmented across content detection, semantic representation, and network analysis, with limited interpretable perpetrator representations, multi-scale structural modeling, and explanations of behavior-driven similarity and influence propagation. These limitations hinder the identification of persistent perpetrators, characterization of behavioral communities, and assessment of potentially influential users. This paper proposes Ontology-Driven Cyberbullying Behavior and Network Analysis (ODCBNA), a perpetrator-centric framework integrating requirements-driven ontology design, knowledge graph construction, behavioral modeling, community analysis, and influence modeling. Using the Bengali Contextual and Diverse Cyberbullying (BenCoDiC) corpus as a use case, ODCBNA identifies $1{,}063$ users with at least three bullying comments or replies as perpetrators and represents each through a $64$-dimensional behavioral and contextual feature vector. Cosine similarity and $k$-nearest-neighbor modeling produce a weighted network with $27{,}554$ edges. Louvain analysis identifies six communities with a modularity of approximately $0.495$ and $27$ sub-communities. Feature-contribution analysis identifies the Video, Impact, and User Profile groups as the strongest contributors to behavioral similarity and community separation, while contextual dimensions support interpretation. Community-constrained influence analysis shows that IM Greedy achieves small positive gains in all six communities, although different seed-selection methods produce comparable diffusion spreads despite limited seed overlap. These findings provide an interpretable basis for understanding perpetrator behavior, community organization, and potential influence patterns in Bengali online environments.

65. 【2610.30882】Inherited, Not Invented: Tracing the Provenance of Wait in Reasoning Models

链接：https://arxiv.org/abs/2610.30882

作者：Zhizhuo Kou,Sizai Hou,Long Chen,Jian Yang,Junyu Luo,Jingshu Peng,Wenkai Zhang,Sirui Han,Yike Guo

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Reinforcement learning, reconsidering a step, credited with teaching, teaching reasoning models, Reinforcement

备注： Under review

点击查看摘要

Abstract:Reinforcement learning (RL) is credited with teaching reasoning models to write {wait} before reconsidering a step, yet large RL accuracy gains do not require the word. This view can confuse what RL discovers with what a model inherits from its training data. We trace the word through open models' training histories, reading it with label-free indices of frequency, position, form and usage and an injected-error test, all computed from sampled outputs. We find that zero-RL almost never coins the marker: on bases that lack the word, RL raises MATH-500 accuracy substantially while {wait} stays near absent. It arrives with training data: mid-training in OLMo-3, and fine-tuning on reasoning traces installs it in most models whose base lacks it. Where the base already uses it, both released RL-Zero recipes (OLMo-3, MiMo) multiply it, whereas KL-free GRPO from the same base does not; OLMo-3's recipe wears down its form and makes it a more sensitive but more liberal alarm; RL after supervised fine-tuning barely changes it, and our GRPO recipe erases a marker seeded by fine-tuning. Finally, we show that marker frequency alone does not indicate RL-induced reasoning and caution against LLM-as-a-judge revision metrics, as automated judges can reverse human-labelled trends.

66. 【2610.30880】One Teacher, Many Views: Reducing Reference Sensitivity in On-Policy Self-Distillation

链接：https://arxiv.org/abs/2610.30880

作者：Khouloud Saadi,Di Wang

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：On-policy self-distillation, dense token-level supervision, privileged copy conditioned, trajectories with dense, dense token-level

备注：

点击查看摘要

Abstract:On-policy self-distillation (OPSD) improves reasoning by training a model on its own trajectories with dense token-level supervision from a privileged copy conditioned on a reference solution. Existing methods typically use a single teacher distribution conditioned on the complete reference. We identify a limitation of this formulation: a reference is only one realization of the reasoning process. Although it provides evidence about the answer, it also encodes an ordering, phrasing, and solution path. Full-reference conditioning can therefore produce correct targets that depend excessively on information unavailable to the student at inference. We show that replacing one valid reference with another, while holding the problem and student state fixed, can substantially alter the teacher distribution, a phenomenon we call reference-induced target instability. To address this instability, we introduce Monte Carlo Privileged Distillation (MCPD), which models privileged context as a distribution over partial reference views and distills the marginal teacher distribution. MCPD evaluates the teacher under multiple views and averages the resulting next-token distributions. We show that this probability-space average is the exact target induced by minimizing the expected teacher-to-student KL divergence over privileged views. Across mathematical and scientific reasoning benchmarks, we show that MCPD produces more reference-consistent supervision and consistently improves over full-reference OPSD.

67. 【2610.30860】Synthetic-to-Real Code-Switched ASR: A Spontaneous Nepali-English Podcast Benchmark

链接：https://arxiv.org/abs/2610.30860

作者：Firoj Paudel

类目：Computation and Language (cs.CL); Sound (cs.SD)

关键词：Devanagari and Latin, language switch points, presents severe challenges, Nepali-English code-switched conversational, Latin orthography

备注： 9 pages, 4 figures, 7 tables. Code: [this https URL](https://github.com/Firoj-Wise/nepali-english-codeswitch-asr) , Dataset: [this https URL](https://huggingface.co/datasets/SamaFiroz/nepali-english-codeswitch-podcasts)

点击查看摘要

Abstract:Nepali-English code-switched conversational speech presents severe challenges for automatic speech recognition (ASR), chiefly through script confusion (inappropriate mixing of Devanagari and Latin orthography) and elevated error rates at language switch points. Supervised fine-tuning (SFT) can adapt multilingual foundation models, but human code-switched audio is expensive to collect and annotate. We curate a new benchmark of 13,044 spontaneous podcast utterances (15.45 h total; 10,214 test, 2,830 dev), audited and verified to eliminate machine translation leakages and acoustic loops. We investigate a two-stage synthetic-to-real adaptation framework: Stage 1 applies SFT on 0.95 h of speech synthesized via a multi-speaker, dual-engine TTS pipeline; Stage 2 explores Group Relative Policy Optimization (GRPO) with transcription and script rewards. We find that synthetic SFT provides the primary cross-domain transfer to spontaneous human speech, reducing Mixed Error Rate (MER) from 23.40% to 21.52% (-1.88 pp) and switch-point error rate (SPER) from 35.89% to 28.77% (-7.12 pp). Subsequent GRPO yields small, statistically significant adjustments on 173 test utterances (1.69%), driving English script confusion (SCR_en) from 6.45% to 6.36% (p = 0.001) and SPER to 28.70% (p = 0.022 clustered). Crucially, ablation reveals that in this SFT-converged encoder-decoder setting, an auxiliary script reward term yields performance identical to MER-only optimization because rollout candidate groups exhibit near-zero script variance on synthetic data. On monolingual benchmarks, SFT improves Nepali MER by 2.71 pp (stabilizing at 18.42% after GRPO, a 2.38 pp gain over baseline) while preserving English lexical WER (3.38% vs. 3.33%). Verified transcripts, timestamps, episode metadata, and reconstruction scripts are publicly released.

68. 【2610.30841】RIAD: Benchmarking Omni-Modal Ambiguity in Multimodal Large Language Models

链接：https://arxiv.org/abs/2610.30841

作者：Zhaolu Kang,Yidi Wang,Yile Li,Siqi Zeng,Yingjie He,Richeng Xuan,Zhichao hu

类目：Computation and Language (cs.CL)

关键词：natural communication, channels is considered, central feature, feature of natural, underspecified until evidence

备注： NeurIPS 2026 Evaluations and Datasets Track

点击查看摘要

Abstract:Ambiguity is a central feature of natural communication: a sentence, image, or sound may remain underspecified until evidence from the other channels is considered. Yet current multimodal benchmarks mostly test perception, recognition, or reasoning over already determinate inputs, leaving unclear whether omni-modal large language models can resolve ambiguity distributed across text, vision, and audio. We introduce TRIAD, a benchmark for omni-modal ambiguity resolution. Each item is a text--image--audio triplet paired with a question and a set of answer options, and is constructed so that the full triplet determines a unique answer while removing any one modality makes the set of consistent options non-unique. TRIAD contains $327$ hand-written queries in $86$ scene groups and covers $18$ ambiguity categories across the three modalities. Evaluating $14$ omni-modal systems reveals that strong item-level performance does not translate into robust scene-level disambiguation: the best model still trails humans by over $20$ points in group accuracy. Removing answer options widens the gap further, driving model group accuracy to the single digits while humans remain robust. Leave-one-out and transcript/description counterfactuals further show that current systems often underuse audio cues when text and image are present. TRIAD reframes omni-modal evaluation around disambiguation rather than recognition, and provides a taxonomy, benchmark, and diagnostic protocol for measuring this capability.

69. 【2610.30828】utorCaseBench: A Case-Grounded Benchmark for Evaluating LLM Tutors in Supporting Students with Challenging Behaviors

链接：https://arxiv.org/abs/2610.30828

作者：Yeon Su Park,Chanyoung Park,Tae Soo Kim,Seungju Kim,Hyunwoo Kim,Daho Jung,Jinsung Yoon,Juho Kim

类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

关键词：challenging behaviors common, existing benchmarks overlook, behavioral difficulties, overlook the challenging, challenging behaviors

备注： Under Review

点击查看摘要

Abstract:LLMs are increasingly used as AI tutors, yet existing benchmarks overlook the challenging behaviors common among students with learning and behavioral difficulties. We introduce TutorCaseBench, a benchmark that grounds AI-tutor evaluation in qualitative case studies from pedagogy, educational psychology, and special education. Our pipeline converts documented student categories into case-specific scenarios, tutor-student dialogues, and rubrics grounded in source evidence. The benchmark contains 923 dialogues across five challenge types, evaluated through open-ended response generation (1,560 items) and multiple-choice selection (2,537 items). Across 11 state-of-the-art LLMs, even the strongest model satisfies a rubric criterion in only 55.8% of open-ended cases, while models are better at selecting appropriate strategies than generating situated responses. These results reveal a gap between intervention recognition and context-specific adaptation, especially for open-weight models. All data are publicly available at this https URL.

70. 【2610.30785】Invisibilization as a Source of Probability Bias in Language Models

链接：https://arxiv.org/abs/2610.30785

作者：Christian Arnold,Ernesto Calvo,Guadalupe Gonzalez,Sebastián Vallejo Vera,Tiago Ventura

类目：Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：Language models, inform their responses, aligned to avoid, avoid using protected, gender to inform

备注： 17 pages, 4 figures, 2 tables

点击查看摘要

Abstract:Language models are aligned to avoid using protected attributes such as race, ethnicity, and gender to inform their responses. Therefore, they increasingly refuse or hedge when such attributes appear in a prompt. However, if a system must decide how much to learn from what people tell it, it is costly to refuse valuable information because of its source. In this article, we measure the cost of declining information in a two-urn game with an exact Bayesian answer. We present leading LLM models from two developers (OpenAI and Anthropic) with a prompt that requires them to decide how far to trust an unverifiable report from a participant whose description we randomize across ten configurations (6,600 sessions). We show that leading models often decline to assess the reporter, treating information as worthless at rates set by the description rather than by the evidence. At its widest, models decline a Black-described reporter 46% of the time and a white-described reporter 9%; yet, when they do assess the information, the Black-described reporter receives slightly more trust. The bias is invisible to audits that compare average trust or look only at assessed cases. It grows with reasoning effort, follows words rather than categories (models invoke race for "Black" but not for its Spanish translation negro, and never for "Indigenous"), and worsens under warning instructions a practitioner would try first. We also present a scoring option that reduces the refusal rate bias. When a model's trust is scored against revealed truth over repeated rounds, it credits identical records equally. In four of five configurations from Anthropic and OpenAI, the racial gap in trust falls below 0.02 by the last rounds.

71. 【2610.30783】MixJudge: Learning a Language-Queryable Critic for Vocal Mixing

链接：https://arxiv.org/abs/2610.30783

作者：Kuan-Hsun Ho,Yuan-Chiao Cheng,Yen-Tung Yeh,Yi-Hsuan Yang

类目：ound (cs.SD); Computation and Language (cs.CL)

关键词：resulting mix, assessing the resulting, Mixing, Mixing requires, applying processing

备注： Submitted to ICASSP 2027

点击查看摘要

Abstract:Mixing requires not only applying processing but also assessing the resulting mix. Audio-language models can provide conversa- tional mixing advice, but existing evaluations do not separately test whether they can judge specific mixing issues. Since professional supervision for such judgments is scarce, we construct a curriculum of 11 vocal-mix issues at multiple severity levels and use it to train MixJudge, a language-queryable audio critic. MixJudge shows its ability to retrieve mixing issues, distinguish opposite issues, and order the severity of an issue. Moreover, its judgments transfer to menu selection: given a set of processing candidates, MixJudge often favors versions acoustically closer to a held-out professional version, demonstrating how explicit mixing judgment can support comparison and downstream mixing decisions.

72. 【2610.30778】Where meanings converge and diverge: Revisiting linguistic relativity across 81 languages

链接：https://arxiv.org/abs/2610.30778

作者：Weiran Wang,Wenjuan Qin,Haitao Liu

类目：Computation and Language (cs.CL)

关键词：people who speak, languages organize concepts, Whorf hypothesis, organize concepts, languages organize

备注：

点击查看摘要

Abstract:Do people who speak different languages organize concepts in similar ways? This question lies at the heart of the Sapir--Whorf hypothesis and debates about linguistic relativity. Shared basic meanings, however, need not imply shared relations among them. We compared relations among 196 basic concepts across 81 languages, using word embeddings from two multilingual models to quantify conceptual structure expressed in language. Cross-language correspondence was greater for sociocultural meanings than for meanings concerning nature and motion, a contrast recurring across models and classifications. Within the sociocultural domain, relational differences increased with geographic separation; less closely related languages differed more across all domains. These findings suggest that universality and relativity are interwoven across conceptual domains. They inform an account in which shared cognitive resources interact with linguistic and local experience, and predict greater cross-language correspondence in human semantic judgments for sociocultural than for nature and motion meanings.

73. 【2610.30763】Abstract Priorities, Concrete Rewards: How Stated Preferences Relate to What People Reward in AI Responses

链接：https://arxiv.org/abs/2610.30763

作者：Zihan Chen,Lei Nico Zheng,Di Zhu

类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：assistants built, built on large, trained on human, increasingly personalized, personalized to users'

备注： 27 pages, 5 figures, 30 tables. Code and data are available from the authors upon request

点击查看摘要

Abstract:AI assistants built on large language models (LLMs) are trained on human feedback and increasingly personalized to users' stated preferences. Yet how closely these preferences reflect what people reward in responses remains unclear. We compare stated and revealed preferences in the public PRISM dataset, in which 1,396 participants reported how much seven response attributes mattered to them and then rated 29,347 responses from 21 LLMs. Among responses to the same prompt, features the survey never asked about, such as response length, formatting and refusal language, were at least as strongly associated with ratings as text proxies of the surveyed attributes. Whether stated priorities matched ratings depended on how attributes were measured: participants who prioritized an attribute favoured responses from models that others perceived as strong on it, but not responses that scored higher on text proxies for it. Written feedback was more telling: participants who asked for shorter answers, even in earlier conversations, gave length less weight in their ratings, and those asking for longer answers gave it more. Their relative priorities over the surveyed attributes, however, did not predict this weight. Reasons given for choices reflected perceived attributes more than measured features. Participants also differed stably in how much they weighted several concrete features, especially length, but with a median of 6 conversations per participant, these weights were estimated poorly. The largest gain from personal information in predicting held-out choices was 0.13 percentage points, compared with 1.11 for a stronger pooled model. Stated priorities thus track perceived attributes of AI responses but say little about the concrete features that ratings reward, a distinction that matters for preference elicitation and AI personalization.

74. 【2610.30751】How Firm Are AI Models' Ethical Boundaries? A Pay-Stub Editing Test of 15 Models

链接：https://arxiv.org/abs/2610.30751

作者：Simiao Ren,Xingyu Shen,Tommy Duong,Tsang Ng,Ankit Raj

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：sensitive request, small change, wording move, Muse Spark issue, request to acting

备注： 11 pages: 4 pages of main content, 1 page of references, and 6 appendix pages; 7 figures and 4 tables; ancillary data and code included

点击查看摘要

Abstract:Can a small change in wording move an AI model from refusing a sensitive request to acting on it? We test 15 models on the same request to increase the income shown on a pay stub. Across 445 observable trials, models issue editing calls in 14.1% of cases when a loan purpose is stated, 33.1% when the purpose is omitted, and 66.2% when the change is described as fixing a printing error. Astra refuses all ten loan-purpose requests but issues calls in all ten purpose-omitted trials. Fable, Opus, and Muse Spark issue none across all three wordings; Sonnet issues some under the latter two. Response excerpts illustrate different ways of refusing, redirecting, or justifying an edit. The file is a marked test document and all tools are simulated. These results probe how boundaries behave in one setting; they do not prove an overall ethics ranking or that a harmful real-world edit succeeded.

75. 【2610.30742】UniGuard: Multi-View Guardrail Learning for Cross-Interface Safety Generalization

链接：https://arxiv.org/abs/2610.30742

作者：Viet-Thanh Pham,Thuy-Trang Vu,Junae Kim,Rollin Omari,Dinh Phung,Gholamreza Haffari,Lizhen Qu

类目：Computation and Language (cs.CL)

关键词：agent trajectory, multi-agent trace, agentic systems, policy-conditioned input, layers for LLMs

备注： 31 pages

点击查看摘要

Abstract:Guardrail models are increasingly used as safety layers for LLMs and agentic systems, but most are trained on fixed prompt or response interfaces and become unreliable when the same safety case appears as a conversation, agent trajectory, multi-agent trace, or policy-conditioned input. We propose UniGuard, a training framework that learns interface-invariant safety representations from multiple semantically aligned views of the same safety case. We also construct the UniGuard-FT dataset by transforming 1,000 public safety cases into prompt, response, multi-turn conversation, agent-trace, and multi-agent-trace views, and train UniGuard-0.6B with classification, supervised contrastive learning, and asymmetric confidence calibration losses. Across unseen-interface benchmarks ATBench, PolicyGuardBench, and DynaBench, UniGuard-0.6B improves over its pretrained guardrail by 45.12 F1 points on average and reduces expected calibration error by 35.41 points, while remaining competitive with much larger guardrails such as Claude-Sonnet-4.5 and GPT-5.2 - despite being a 0.6B model and trained only with synthetic data.

76. 【2610.30715】Meaning Contracts: Local Semantic Geometry in Large Language Models

链接：https://arxiv.org/abs/2610.30715

作者：Andrés Daniel Godoy Ortiz

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：large language models, paper studies, local geometry, semantic, geometry

备注： 24 pages, 8 figures. Code and data: [this https URL](https://github.com/adgodoyo/Meaning_Contracts)

点击查看摘要

Abstract:This paper studies the local geometry of semantic meaning in large language models. Current representation analyses ask whether meanings are close in embedding space, or whether linear probes separate semantic classes, but they do not characterize the within-concept local geometry: what is invariant across realizations of a single semantic factor, what varies, and what changes when meaning is refined. This paper characterizes that geometry through two controlled probes evaluated on four architecturally diverse decoder-only LLMs (Gemma 4, Llama 3.2, Qwen 2.5, Pythia). A cross-lingual probe uses language as a perturbation to separate exact meaning matches, same-factor realizations, nearby concepts, and out-of-domain contrasts. A refinement probe separates specificity-bearing semantic narrowing from high-probability attributive elaboration and adversarial controls; both probes are validated by blind human judgments. Four findings recur across all models: under mean pooling, once dominant variance directions are removed, sentence pairs order by semantic relatedness (same factor, then same domain, then different domain) without overlap over a band of layers; semantic factors organize around an invariant core surrounded by structured realization-specific variation; refinement produces directed displacement into tighter neighborhoods, including against controls built on the same base noun; and sentence-level and token-local readouts expose complementary geometry (volume contraction at the sentence level, sharper anisotropic endpoints at token-local readout). We interpret these results as evidence that LLM semantics are organized as local anisotropic neighborhoods in which meaning contracts under refinement.

77. 【2610.30705】ULME: Predictive Coupling for Mutually Reinforcing Embedding and Language Modeling

链接：https://arxiv.org/abs/2610.30705

作者：Yang Liu,Zhiqiang Yuan,Shu-Dong Huang,Jiancheng Lv,Liwei Yang,Qiwei Yan,Kailin Lv,Jinchao Zhang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：modern large language, separate specialized models, large language models, deployed side, Text embedding

备注： AAAI 2027 Submmitted

点击查看摘要

Abstract:Text embedding and text generation are two of the most useful capabilities of modern large language models, yet they are typically provided by separate specialized models (an embedder and a generator) trained with incompatible objectives and deployed side by side in retrieval-augmented generation and agent systems. Recent unified embedding-generation models such as GritLM share parameters between the two capabilities, but they either switch attention regimes between modes or optimize embedding and language modeling as parallel objectives that never supervise each other. We argue that these designs are only partially unified: the two capabilities coexist on the same weights, but do not shape each other. We propose ULME, a post-training framework that unifies embedding and language modeling on a causal decoder-only LLM through predictive coupling. ULME inserts a chain of learnable slots between the query and the answer, reads a semantic embedding and a reasoning embedding from two designated slots, and trains three objectives on a shared causal backbone: a contrastive loss anchoring the semantic slot to document representations, a language-modeling loss supervising answer generation, and a stop-gradient predictive loss that aligns the reasoning slot with a pooled summary of the answer, so that generation actively shapes what the embedding encodes. Across two model families (Qwen2.5, Qwen3) and eight scales spanning 0.5B-8B parameters, a single ULME checkpoint improves MTEB by 3.3-4.1 points over the strongest open-source baseline, tightens BRIGHT and AdvBench-IR simultaneously, and remains on par with a generation-only fine-tune on standard accuracy benchmarks (MMLU, GSM8K, MMLU-Pro, HumanEval), demonstrating that genuine unification yields mutually reinforcing rather than merely coexisting capabilities.

78. 【2610.30696】Disentangling Robustness and Sycophancy in Multilingual LLMs

链接：https://arxiv.org/abs/2610.30696

作者：Rhitabrat Pokharel,Ameeta Agrawal

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：user false premise, multilingual LLM agrees, LLM agrees, false premise, user false

备注：

点击查看摘要

Abstract:When a multilingual LLM agrees with a user's false premise, is it being sycophantic, or does it simply not know better in that language? Current research does not distinguish these cases: they record only whether the model agreed, not why. We introduce the SC-matrix, that crosses a model's competence (whether it answers correctly under no pressure) with its sycophancy (whether it maintains that answer under pressure). Our results show that (1) identical aggregate sycophancy rates can mask different failure compositions, (2) high competence in a language does not always protect against sycophancy, and (3) reasoning-oriented mitigations outperform directive-based strategies. We find that multilingual sycophancy is not a single phenomenon but a composite of different failures that require distinct diagnosis.

79. 【2610.30690】From Clinical Judgment to Checkable Rules: Clinician-Led Guardrails for Mental-Health Chatbots

链接：https://arxiv.org/abs/2610.30690

作者：Chenhan Lyu,Kit Wislocki,Sarah Elizabeth Stoeckl,Maitreyi Sinha,Amir Rahmani

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

关键词：Large language models, Large language, deployed in mental-health, inspect or explain, mental-health contexts

备注：

点击查看摘要

Abstract:Large language models (LLMs) deployed in mental-health contexts can be evaluated for safety failures, but the resulting judgments are often difficult to inspect or explain. Common approaches to improving safety rely on prompt engineering, LLM-as-a-Judge, and Constitutional AI. In this work, we describe a clinician-led alternative in which two clinicians define, finalize, and adjudicate the four safety checks of a rule base, which is formally verified for internal consistency and applied as a guardrail over LLM outputs. Here and in the title, clinician-led refers to this rule base, not to the fact extractor or the uncertainty default, which are ours. Every verdict of the resulting verification layer is recomputable from a named rule and sixteen facts. Against an LLM judge matched in model, revision, quantization, rule text, and decoding but without the layer's computed 988/911 fact, the largest disagreement class, the satisfied-rule class, is structured: the Llama-3.3-70B judge, on its primary prompt, demands a crisis resource from 55 of the 65 replies (84.6%) that already contain one, while the same model, asked as a fact extractor, reports a recognized resource present on 54 of the 55. The verification layer never raises that demand, by construction. We report with equal prominence where this judge is stronger: fewer false crisis alarms on the one reference-scored check. We also report the measured cost (a specification revision raised block-class outcomes on held-out boundary prompts of an over-refusal benchmark from 6.0% to 16.0%, chiefly by changing fact extraction), the clinicians' decision to keep our uncertainty default, and the analysis of the result. The contribution is not a safer verdict. It is a guardrail whose disagreements with the judge localize to named rules and facts and whose measured costs trace to named facts and the uncertainty default.

80. 【2610.30682】Direct cueing of word identity through word duration: evidence from Mandarin homophones

链接：https://arxiv.org/abs/2610.30682

作者：Xiaomeng Zhu,Megan Niu,Jason Shaw,Kevin Tang

类目：Computation and Language (cs.CL)

关键词：word duration, spoken word recognition, word, word recognition, Mandarin Chinese

备注：

点击查看摘要

Abstract:While there is increasing evidence that words are stored in the mental lexicon with some phonetic detail, there are open questions about exactly which phonetic details are stored and whether they are functionally relevant for spoken word recognition. Word-level phonetic cues, such as word duration, provide an appropriate test case. Across languages, including Mandarin Chinese, high frequency words are shorter than low frequency words. Using a homophone ordering task, we investigate whether differences in word duration impact word recognition. Mandarin Chinese was examined since it has abundant disyllabic homophones. Our results indicate that participants were able to use word duration to recognize the order of homophone pairs, selected to vary in lexical frequency. Both with high noise levels and when no other cues were available, participants mapped the shorter duration auditory stimulus to the higher frequency word. The results provide evidence that word duration can directly cue the identity of words, suggesting that it may be a phonetic detail incorporated into the lexical representation. We discuss this direct cueing account alongside alternative accounts of how word duration may modulate word recognition.

81. 【2610.30678】Scaling Laws for Safety Probes

链接：https://arxiv.org/abs/2610.30678

作者：Yuchen Wu(University of Washington),Jerry Wei(Anthropic)

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

关键词：probe, model, monitoring language models, error, standard tool

备注： 62 pages, 23 figures, 33 tables

点击查看摘要

Abstract:Safety probes trained on a model's activations are a standard tool for monitoring language models in real time. Each time a new model is released or a new harm area needs to be monitored, the probe must be retrained, which requires new labels and a choice of probe architecture. Yet neither the model nor the labels tell us in advance how well the resulting probe will perform. Finding out requires training and comparing many probe configurations. In this paper, we ask whether probe performance can instead be predicted in advance from model size and the number of labels. Existing safety datasets are insufficient for this, as they are either limited in scale or already saturated. We therefore construct six new safety datasets of sufficient size and difficulty. On these datasets, we train two probe architectures on 20 base models from five model families, with 32 to $10^{6}$ labels for each model. We measure performance using probe error, defined as 1 - AUROC, where lower values are better. We find that probe error follows two simple scaling laws. First, the lowest probe error a model can reach falls as a power law in its size. Second, probe error decreases towards its floor as the number of examples increases; the slope increases as the target model size increases. Both laws hold across tasks, model families and probe architectures, and only their fitted constants differ. When fitted on the smallest models of a family, the laws predict the error of the next larger model to within 0.02 in 72% of cases. They also identify whether more labels or a larger model is the cheaper way to reach a target error in 73% of cases. Finally, they choose the probe architecture with an extra error of only 0.006 on average when they pick the worse one. These laws allow safety researchers to determine how to create the best probe for any given model and label budget.

82. 【2610.30677】WikiOriginQA: Automated Construction of a QA Dataset with Knowledge Origins for Analyzing Cultural Bias

链接：https://arxiv.org/abs/2610.30677

作者：Kento Haneda,Yosuke Kishinami,Ryo Fujii,Keisuke Sakaguchi,Makoto Morishita

类目：Computation and Language (cs.CL)

关键词：human annotators familiar, Existing datasets, annotators familiar, human annotators, considerable human effort

备注： Accepted to AACL-IJCNLP 2026 (9 pages, 2 figures, 10 tables)

点击查看摘要

Abstract:Existing datasets on cultural knowledge have been typically created by human annotators familiar with each culture. However, the process requires considerable human effort, presenting a significant challenge to scalability. To address this challenge, we introduce WikiOriginQA, a QA dataset automatically constructed by objectively representing the origins of knowledge through the creation dates of different Wikipedia language editions. Experimental results with the created dataset confirm that LLM performance tends to be biased toward Anglophone cultures. Furthermore, the results suggest the importance of knowledge propagation into the Anglosphere. These findings demonstrate the validity of our automated approach, enabling cultural bias evaluations with superior scalability across diverse languages without extensive manual annotation.

83. 【2610.30676】Spectral Smoothing and Spiking Perturbations Reconfigure Capability Profiles and Selective Task Performance in Large Language Models

链接：https://arxiv.org/abs/2610.30676

作者：Qince Luan,Jianhui Xu,Yang Xu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Singular-value spectra encode, transformer feed-forward projections, behavior remains underexplored, spectra encode important, encode important structure

备注：

点击查看摘要

Abstract:Singular-value spectra encode important structure in transformer feed-forward projections, yet their causal role in downstream behavior remains underexplored. We study post-hoc spectral smoothing and spiking interventions on the up_proj and down_proj matrices. Positive perturbation stretches deviations from the geometric mean, making large singular values larger and small ones smaller (spiking), and vice versa. The intervention preserves singular vectors and the geometric mean of the singular values. Across five open Llama and Qwen instruction models, we evaluate the perturbed systems on capability-labeled subtasks, standard and chain-of-thought reasoning benchmarks, judge-scored truthfulness, hallucination, and safety tasks, and TRAIT personality probes. To interpret score shifts, we fit responses in a three-dimensional capability basis consisting of factual knowledge, language understanding, and deductive reasoning. The induced changes suggest structured rather than purely random sensitivity: large positive perturbations more reliably suppress language and deductive responses, moderate negative perturbations can sometimes improve factual or task-local performance on the evaluated grids, and sensitivity varies strongly by model family, benchmark module, and underlying layerwise spectral inequality. These results position spectral perturbation as a lightweight intervention for probing how capabilities are organized and traded off in large language models.

84. 【2610.30664】Compiling Autoregressive LLM Control into Policy-Exact Parallel Inference for Hierarchical RAG

链接：https://arxiv.org/abs/2610.30664

作者：Zehao Lin,Qianfeng Shen,Xixuan Hao,Shaobo Cui,Chunyu Li,Kai Chen,Bo Tang,Zhenjun Wang,Jin Yan,Zhiyu Li,Feiyu Xiong

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：Large language models, structured decision pipelines, language models increasingly, models increasingly act, Large language

备注： 5 pages, 2 figures, 1 table

点击查看摘要

Abstract:Large language models increasingly act as controllers in structured decision pipelines, yet their decisions are still executed by autoregressive text decoding. Hierarchical RAG is one such setting: at each frontier of a document tree, an LLM commits to $b$ of $k$ sections under an input-dependent action grammar, executed as either failure-prone free-form JSON or reliable but strictly serial grammar-constrained generation. We show that this serialization is unnecessary for bounded-horizon control: the reachable future forms a shallow action-prefix tree, which we compile --- one root prefill plus one tree-causal probe evaluate every prefix-conditioned action distribution with serial decoding's tokens, positions, and causal ancestry. A prefix-state lemma makes compiled control policy-exact in exact arithmetic: the same policy with a two-forward critical path and zero output tokens. One further probe pass certifies the exact order-marginalized MAP set. Across four document-disjoint splits and two scales on the primary MetaX device, compiled control matches the serial policy on $84$--$89\%$ of questions --- every instrumented divergence a floating-point near-tie --- and cuts control latency by $35$--$47\%$ versus token-wise serial decoding and $6$--$7\%$ versus an idealized chunked engine; an H800 repetition preserves the ordering.

85. 【2610.30663】Group Relative Policy Optimisation Improves Multilingual Speech Recognition in Low-Resource Languages

链接：https://arxiv.org/abs/2610.30663

作者：Tim Wenjie Hu,Evelyn Nafula Ouma,Benjamin Akera,John A. Quinn

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Autoregressive encoder-decoder speech, Relative Policy Optimisation, Group Relative Policy, Autoregressive encoder-decoder, exposure bias

备注： 5 pages, 3 figures, submitted to ICASSP 2027

点击查看摘要

Abstract:Autoregressive encoder-decoder speech recognition models trained with teacher forcing can suffer from exposure bias, limiting their ability to recover from their own prediction errors at inference time. Recent work has shown that reinforcement learning with Group Relative Policy Optimisation (GRPO) improves speech recognition in major languages with LLM-based models. We extend this line of work to smaller, non-LLM encoder-decoder ASR models, using Whisper-large-v3 as a case study across 51 African languages. The benefits of this approach are most pronounced when training data is scarce or when input audio is noisy or degraded. Our resulting model, SunflowerASR, achieves the best published macro-averaged WER on the AfriVox-v2 (0.227) and SimbaBench (0.372) benchmarks, and is publicly available.

86. 【2610.30635】What the Specification Did Not Say: Specification-Oracle Gaps in Test-Graded Coding-Agent Benchmarks

链接：https://arxiv.org/abs/2610.30635

作者：Fei Ding

类目：Computation and Language (cs.CL)

关键词：Coding-agent benchmarks, Coding-agent, upstream project, natural language, tests

备注： 13 pages

点击查看摘要

Abstract:Coding-agent benchmarks often describe a task in natural language but grade it with tests taken from the upstream project. Passing those tests can require information the description never states: a constant's name, a module path, an exact message. We call this a specification-oracle gap: where it exists, a benchmark also measures whether an agent reproduces upstream implementation details. We formalise the gap, including the inconsistencies that chains of dependent tasks add, and build a static audit for five languages that classifies every name-, path- and literal-level dependency of every scored test (held-out precision 89.2%, recall 92.9%). On SWE-Milestone (98 graded milestones, 35 published runs), 25 milestones contain a test that depends on an unstated, non-inferable name or path. Build units with such a dependency fail in 80.6% of runs, against 48.4% for comparable units without one, and withholding a single hidden name from the reference stops its unit's tests from compiling in 126 of 128 cases. The leaderboard's ranking is robust to removing the affected tests, but they shift scores within repositories and favour agents that reproduce upstream names. Across four further benchmarks, prevalence appears to follow construction: a third or more of the tasks are affected where specifications are release notes or LLM summaries, almost none where tasks are screened or written for their tests; how much a gap costs depends on how the harness grades. We release the audit, corrected filter lists and specification addenda.

87. 【2610.30612】he Fusion Tax: A Diagnostic Analysis of When Hybrid Retrieval Hurts

链接：https://arxiv.org/abs/2610.30612

作者：Aaditya Chauhan,Arun Agarwal

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：software documentation surveyed, sparse lexical retriever, surveyed in September, Hybrid retrieval, reciprocal rank fusion

备注：

点击查看摘要

Abstract:Hybrid retrieval, which fuses a sparse lexical retriever with a dense neural one, is widely recommended in the software documentation surveyed in September 2026, usually with reciprocal rank fusion (RRF), on the strength of aggregate gains. We ask what fusion costs on individual queries, treating "do not fuse" as a first-class outcome, in the setting in which hybrid retrieval is deployed: a standard Anserini BM25, five dense encoders spanning 22M-596M parameters and three model generations, a learned-sparse (SPLADE) alternative, and a cross-encoder second stage, on seven BEIR datasets and three fusion functions. Even the best method, dense-weighted score interpolation, ranks relevant documents below the better of its two components on 13-48% of queries and below the deployable dense-only retriever on 8-21% (14-48% and 11-25% at a weight selected under leave-one-corpus-out validation), while beating dense-only in aggregate on every corpus with the primary encoder; the downside is significant under loss-averse risk-sensitive evaluation on six of the seven corpora. We call this loss the fusion tax. It is mostly a ranking effect that preserves recall in aggregate, it is most likely on the queries that only one retriever covers, and it persists across the encoder ladder and the SPLADE substitution. RRF carries the higher tax wherever the dense retriever is clearly stronger and only beats dense-only where the two components are balanced. Fusion failure is weakly predictable within a corpus but transfers unreliably across corpora, because the features that predict it change sign with the sparse-dense balance. A cross-encoder recovers part of the tax only where it is itself reliable. We distill these findings into guidance that keys the fusion decision to the measured sparse-dense balance of the target corpus.

88. 【2610.30593】-SAX: A Two-Track Time Series Symbolization for Natural Language Shape Querying

链接：https://arxiv.org/abs/2610.30593

作者：Zhao Tan,Xianglong Bao,Zhipeng Xi,Ming Jin

类目：Databases (cs.DB); Computation and Language (cs.CL)

关键词：series databases aims, Natural language querying, databases aims, users find, histories of data

备注： 14 pages, 8 figures, 2 tables. Accepted at the Australasian Database Conference (ADC 2026). This is the submitted manuscript prior to peer review

点击查看摘要

Abstract:Natural language querying for time series databases aims to let users find what they need in long histories of data by asking in plain language. Shape queries ask how a series moves. They are the main challenge of this task. Recent work makes them feasible by using symbolization as a bridge between the query and the long history. However, existing symbolizations were designed for compression, similarity indexing, or classification. What a symbolization should provide for natural language querying has not been systematically studied. We therefore examine the definitions of six classical symbolizations against this task and identify three limitations. (1) Direction is missing from the string, (2) direction is measured at too small a scale, and (3) the letters are arbitrary. Three design principles follow. We follow these principles and make a minimal redesign of SAX called TT-SAX (two-track SAX). The level letters stay. Each segment gains a trend letter. It is measured across neighboring segments rather than inside one, and graded to match the adjectives that queries use. We conduct extensive experiments on the public NLQTSBench benchmark, comparing TT-SAX with the six classical symbolizations across six LLMs. TT-SAX outperforms all six on shape queries, and ablations trace its gains back to the three limitations one by one. This paper is the first systematic study of time series symbolization with natural language querying as the design goal. It provides a foundation for future research on this task. Our code is available at this https URL.

89. 【2610.30557】Governed Self-Evolution for Autonomous Investing: A Multi-Agent LLM System with an Invariant Core

链接：https://arxiv.org/abs/2610.30557

作者：Yebo Feng,Jingyang Dai,Liangrui Pan,Nelson Lau,Jiahua Xu,Yang Liu

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Portfolio Management (q-fin.PM)

关键词：combine heterogeneous evidence, untrusted Web content, live Web data, heterogeneous evidence, combine heterogeneous

备注：

点击查看摘要

Abstract:LLM agents that act on live Web data must combine heterogeneous evidence, remember what they have done and improve from outcomes without weakening their own safeguards. We study this problem in autonomous investing, where every action is irreversible and based on untrusted Web content. We present Steward, a multi-agent LLM system that draws the boundary of self-evolution in its type system. First, nine role-specialised agents decide jointly: four analysts read news feeds, SEC filings, macroeconomic series and market data and emit typed reports, from which a Portfolio Manager sets target positions that a protected Risk Manager audits. Second, a seven-layer shared memory, assembled by code from the system's own record, gives each decision its position context, the market narrative, calibration and the agent's past decisions. Third, the system improves itself by review: code grades every trade and forecast nightly and writes the grades into memory, and each quarter a reflector proposes prompt learnings that a deterministic gate applies reversibly and replay of recorded inputs verifies. All three operate around an invariant core of order arithmetic, risk rules and discipline-agent prompts that no self-edit can reach. In a five-month live deployment (102 trading days, 1,632 LLM calls), the system contained a 24.6% sector drawdown to a 0.3% loss; in replay of its recorded inputs, a single model given the same raw data traded more and lost 1.35 points against the market over five days where the joint design showed no significant loss, and no injected instruction was followed; and a 2015-2026 backtest shows the core alone lowering the maximum drawdown under all 50 random entry policies. The reflector traced the dominant failure to its root cause, and the gate applied a learning that the agent adopted on trigger evenings and on no control evening. Code: this https URL

90. 【2610.30533】IFC-MCQ: Automatically Generating Multiple-Choice Benchmarks for Evaluating LLM Agents on IFC Data Retrieval

链接：https://arxiv.org/abs/2610.30533

作者：Rabindra Lamsal,Sisi Zlatanova,Xuesong Shen

类目：Computation and Language (cs.CL)

关键词：Industry Foundation Classes, Industry Foundation, Foundation Classes, building information exchange, large language models

备注：

点击查看摘要

Abstract:Industry Foundation Classes (IFC), the standard for building information exchange in architecture, engineering, and construction (AEC), is increasingly queried through large language models (LLMs) using natural language. Evaluating these systems at scale is difficult because free-text answers require costly human or LLM-based review. We propose IFC-MCQ, a method that automatically generates multiple-choice benchmarks from IFC files for exact option-set grading. The taxonomy covers 15 categories and 36 subtypes across four groups, with answer keys derived from the file and distractors constructed from file-derived values or predefined rules. We applied IFC-MCQ to IFC models of varying sizes and modelling characteristics to assess generation coverage and evaluated two agentic configurations on selected models using tool- and code-based retrieval. The evaluation exposed category-specific failure modes and showed that performance can vary with the source IFC model and retrieval interface. IFC-MCQ enables scalable benchmarking of LLM-based IFC retrieval in AEC workflows.

91. 【2610.30518】Protegrity-PII Technical Report

链接：https://arxiv.org/abs/2610.30518

作者：Hardeep Bassi,Hui Ma,Luís Seabra,Koowum Joshi,Daniel Pereira,Averell Gatton

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：PII decision model, PII decision, structured and unstructured, present Protegrity-PII, unstructured text

备注：

点击查看摘要

Abstract:We present Protegrity-PII, a new PII decision model for structured and unstructured text. Protegrity-PII achieves a typed recall of 0.915 with a precision of 0.907 on a new benchmark we propose, PII-SCOPE. Our model processes text in 0.49 seconds per million characters at \$0.0005 per million characters on a single RTX 6000 using batched inference. Due in part to the expansive nature of the entity type taxonomy used in training, Protegrity-PII achieves superior out-of-distribution generalization when benchmarked against a selection of state of the art models and datasets.

92. 【2610.30516】Beyond End-to-End Recovery: Towards a Better Understanding of LLM Steganography via Rolewise Decomposition

链接：https://arxiv.org/abs/2610.30516

作者：Om Tailor,Yucheng Pan,Solaleh Mohammadi,Xinyan Liu,Kaiqing Zhang

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词：large language model, language model, private message, large language, private

备注： 33 pages, 5 figures

点击查看摘要

Abstract:In large language model (LLM) steganography, an encoder hides a private message in an otherwise ordinary response, as text transmitted to a decoder, who attempts to recover it. The success of this private-message transmission is commonly measured through end-to-end (E2E) recovery, which checks whether the decoder correctly reconstructs the private message. However, E2E recovery cannot distinguish encoding failures from decoding failures or reveal how the private message is represented in the encoder's transmitted text. To address these limitations, we introduce a rolewise decomposition framework that separately examines how private messages are represented in encoder transmitted texts, what decoders recover, and what deterministic verification can establish. Across 7,200 encoder responses, we identify 168 verifiable encodings missed by decoders and 706 responses containing private messages reconstructed through word-length or token-initial patterns not explicitly specified in the encoder's instructions. These findings demonstrate that E2E recovery alone may obscure important distinctions between encoding and decoding, motivating their separate evaluation to better understand and mitigate the safety issues caused by LLM steganography.

93. 【2610.30512】Behind Aggregate Scores: What Systematically Varying Arena-Hard's LLM Judge Reveals

链接：https://arxiv.org/abs/2610.30512

作者：Louise Yorke

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

关键词：LLM judges, aggregate score, aggregate, LLM, aggregate scores

备注： Accepted at the JUDGe workshop (Can We Trust the Judge?), NeurIPS 2026 (non-archival). 18 pages, 3 figures. Code and data: [this https URL](https://github.com/Yorkel/llm-judge-release)

点击查看摘要

Abstract:LLM judges are used to determine which of two answers is better. Trusting these verdicts requires knowing how repeatable they are and how much they depend on the judge's instructions. We show that similar aggregate scores can conceal substantial changes in individual verdicts, both when the same setup is repeated and when the instructions change. Using 500 Arena-Hard v2.0 prompts with two models' answers held fixed, we run GPT-4.1 as the judge under all eight combinations of criteria, output format and task framing, and repeat every setup unchanged at temperature zero on a pinned model version. Rerunning the default setup moves the aggregate score by about one point but changes the win/tie/loss outcome on 21.2% of prompts. Instruction changes introduce further sensitivity: in one setup, which asks for the verdict without reasoning and also drops several other instructions, outcomes change on 28.2 percentage points more prompts than the two setups' unchanged reruns do on average, and the aggregate score falls by 4.09 points. In another, where the criteria prioritise accuracy, outcomes change on 6.7 percentage points more prompts by the same comparison, while the aggregate score barely moves. A stable aggregate score therefore does not establish that individual verdicts are repeatable. This distinction matters when those verdicts are used as preference labels or to assess individual responses. Evaluations that rely on individual verdicts should repeat each setup they use and report both aggregate scores and prompt-level agreement.

94. 【2610.30504】Rethinking the Evaluation of LLM Fact-Checkers

链接：https://arxiv.org/abs/2610.30504

作者：Ayana Niwa,Miyu Yamada,Kouta Nakayama,Masahiro Kaneko,Hisami Suzuki,Satoshi Sekine

类目：Computation and Language (cs.CL)

关键词：Large language models, Large language, Large, answer factual questions, answer factual

备注：

点击查看摘要

Abstract:Large language models (LLMs) are widely used to answer factual questions, but their answers can contain errors and must be fact-checked claim by claim. Yet the resulting score depends on three design decisions: which questions the claims answer, under what conditions each claim is judged, and which sources count as evidence. No existing benchmark specifies all three. We introduce JSFactCheckBench, a Japanese benchmark that specifies all three, with 1,913 claims from LLM answers to questions about misleading information that circulated on Japanese social media, each annotated for factuality at a reference time and for importance to the question, using evidence from preselected Web sources. Across six LLMs, all verify claims directly answering the question less accurately than supplementary claims, a gap that aggregate scores obscure. Scores also drop when models must locate the relevant content in longer or multiple sources and, for all four open models, when the surrounding question and response are added. These weaknesses are visible only because the benchmark records the conditions behind each label. A benchmark that leaves them implicit cannot reveal them.

95. 【2610.30485】Why Bother Me Again? Benchmarking Personal Agent Memory for Interaction Preferences

链接：https://arxiv.org/abs/2610.30485

作者：Jialin Li,Zhenhao Chen,Hanjun Luo,Hanan Salam

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：increasingly complex everyday, turn capable assistance, complex everyday tasks, unnecessary confirmations, repeated questions

备注： 97 pages. Project page: [this https URL](https://mempabench.com)

点击查看摘要

Abstract:Personal intelligence systems are taking on increasingly complex everyday tasks, yet repeated questions, unnecessary confirmations, and unwanted outreach can turn capable assistance into interaction burden. Reducing this burden requires agents to remember how users want to be assisted. However, existing memory benchmarks focus on factual recall and personalized answers and rarely test how agents learn and act on interaction preferences. We introduce MemPABench, an interactive environment for on-policy evaluation of memory in personal agents. MemPABench poses long-horizon tasks requiring agents to decide when to clarify, confirm, or act autonomously. Four grounded simulated users hold 14 preferences across work and personal contexts. Their feedback spans 99 sessions over four months, with five event-driven changes per user testing memory updates. We evaluate preference selection, delivered behavior, and sensitivity to context and preference change. Evaluating four memory systems across four LLM backbones, we find that current memory brings limited gains in preference selection. Retrieval-based systems (i.e. Mem0, MemOS, simple RAG) do not outperform No Memory, while File-based memory improves accuracy but applies preferences beyond relevant contexts. Our analysis shows that current memory struggles to retrieve interaction preferences and adapt to preference changes. Even with the correct preference available, overriding the agent's default interaction habits remains challenging. The environment and dataset are available at this https URL.

96. 【2610.30474】Rethinking SAE Evaluation: An Atomic Interpretable Unit Framework Reveals Hidden Polysemanticity and Redundancy

链接：https://arxiv.org/abs/2610.30474

作者：Riteng Zhang,Xiaoqian Wang

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Sparse autoencoders, characterizes individual features, learned feature set, originally motivated, motivated by discovering

备注： Accepted to NeurIPS 2026 (Evaluations and Datasets Track). 92 pages. Code: [this https URL](https://github.com/ritengzhang77-max/SAE-AIU)

点击查看摘要

Abstract:Sparse autoencoders (SAEs) were originally motivated by discovering monosemantic features, a property that characterizes individual features but does not specify what the learned feature set should look like as a whole. As SAEs have increasingly been adopted for attribution, circuit discovery, and intervention, researchers have begun evaluating metrics that describe global properties of the feature set, such as sparsity, dead feature rates, reconstruction fidelity, and disentanglement, a diverse set that extends far beyond monosemanticity. However, this implicit shift beyond monosemanticity has not been formalized as a clear, well-defined objective that comes before these evaluation metrics. Without such an objective, existing metrics remain ad hoc, with their necessity unjustified. In this work, we formalize this ultimate objective by introducing a new paradigm for SAE evaluation: requiring that SAE features, and more generally dictionary-based decompositions of model representations, form an atomic interpretable unit basis, a coordinate system for semantically meaningful explanation. Under this paradigm, we organize existing and new measurements such as DAME (Dominance-Aware Monosemanticity Evaluation) as proxy metrics and introduce a comprehensive benchmarking framework. Evaluating hundreds of SAEs across multiple architectures and model families, we uncover failure modes in which some SAEs appear monosemantic under existing evaluation metrics while remaining functionally polysemantic: the most dominant features, those contributing most to model computation, are systematically less interpretable and more redundant. These failure modes warrant attention from SAE researchers as targets for improved training and architectures, and motivate dominance-aware evaluation as a standard check for practitioners before SAE features are deployed for attribution, circuit tracing, or intervention.

97. 【2610.30435】Self-Assessment Reinforcement Learning for Search-State Awareness in Retrieval-Augmented Large Language Models

链接：https://arxiv.org/abs/2610.30435

作者：Taewhoo Lee,Minju Song,Jungwoo Park,Chanwoong Yoon,Junha Jung,Hyeon Hwang,Sanghoon Lee,Minbyul Jeong,Jaewoo Kang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：enabled large language, Recent advances, synthesizing external information, large language models, tackle complex tasks

备注：

点击查看摘要

Abstract:Recent advances in search agents have enabled large language models to tackle complex tasks by retrieving and synthesizing external information. However, existing search agents often lack search-state awareness, i.e., the ability to recognize what information has been obtained and what remains missing, leading to hallucinated reasoning and prematurely terminated search. To address this limitation, we propose Self-Assessment Reinforcement Learning (SARL), a reinforcement learning framework in which models learn to recognize their own search state during training and improve their search behavior accordingly, without requiring additional assessment at test time. SARL achieves this through a dual reward design that captures the corrective effect of each assessment while penalizing excessive reliance on it, jointly encouraging effective and efficient search trajectories. Under this setup, SARL achieves a 24.3% relative improvement over the strongest baseline, with average gains of 35.9% on multi-hop reasoning and 27.9% on deep research benchmarks against the strongest per-benchmark baselines. SARL further surpasses methods built on auxiliary supervision or multi-agent coordination, despite operating as a standalone RL framework with no inference-time scaffolding. Beyond final performance, SARL maintains training stability under extended search horizons, a regime where existing methods consistently degrade, enabling sustained gains as task complexity grows.

98. 【2610.30418】Agent Mosaic: Recognizing Confidentiality Leaks in Agentic LLM Systems

链接：https://arxiv.org/abs/2610.30418

作者：Daniel Ruiz,Luca Luceri,Emilio Ferrara

类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Modern LLM agents, Modern LLM, LLM agents, retrieve information, information from accessible

备注： 16 pages, 9 figures, submitted to ACL Rolling Review, October 2026 cycle

点击查看摘要

Abstract:Modern LLM agents can retrieve information from accessible documents, and then disclose a sensitive conclusion assembled from them. This mosaic effect creates a critical risk for agents operating over confidential data. We quantify its realization with 30 synthetic cybersecurity, medical, and military examples, yielding 10,800 final answers from three LLM agents in controlled simulation and 1,440 answers from live agents in two open-source harnesses. Even under benign queries designed to be answerable from one document, GPT-5.6-Sol, the best performing model tested, discloses forbidden composites in 7.08% of answers (95% CI: 3.75-10.67%) in simulation, with worse disclosure rates in live harnesses. Adding visible classification headers and explicit aggregation rules reduces pooled disclosure rates substantially, yet unsafe disclosures persist in 32.37% of simulated answers (95% CI: 28.33-36.19%) across all intents despite these safeguards. Furthermore, increased refusals do not guarantee confidentiality, since significant refusals reveal the prohibited conclusion regardless. These results point to a troubling conclusion: sensitive data leaks via mosaic-style events are an observed confidentiality failure mode in the evaluated settings at non-negligible rates. They motivate stronger controls on what agents may infer and disclose in sensitive data environments with mixed-clearance users.

99. 【2610.30413】X-pressing Intimacy: Mental Health Disclosure After Twitter Acquisition

链接：https://arxiv.org/abs/2610.30413

作者：Olivia Pal,Yunhao Yuan,Meghana Mandava,Talayeh Aledavood,Eshwar Chandrasekharan,Koustuv Saha

类目：ocial and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

关键词：Elon Musk October, disclose mental health, governance remains unclear, mental health experiences, media platforms provide

备注：

点击查看摘要

Abstract:Social media platforms provide spaces for individuals to disclose mental health experiences and seek support, yet how these disclosures evolve during major shifts in platform governance remains unclear. We examine mental health self-disclosure surrounding Elon Musk's October 2022 acquisition of Twitter, analyzing approximately 824K tweets across anxiety, depression, bipolar disorder (BD), borderline personality disorder (BPD), and suicidal ideation (SI) or related experiences, alongside 266K comparison tweets. Using Linguistic Inquiry and Word Count (LIWC) and an LLM-based intimacy classifier, we characterize changes in psycholinguistic expression and disclosure intimacy. Following the acquisition, we observe declines in affective and social language, alongside increases in first-person singular pronouns and future-focused expressions. Intimacy patterns vary by condition: anxiety, depression, and BPD show increases in low-intimacy and decreases in moderate-intimacy disclosures, whereas suicide-related posts show more high-intimacy disclosures. However, compared with broader Twitter discourse, only the relative decline in moderate- versus low-intimacy disclosure for BPD remains statistically significant. Our findings underscore the importance of considering both language and intimacy when studying platform transitions, informing the design of online environments that support sensitive self-disclosure.

100. 【2610.30412】SIM-UT: A User Simulation based Evaluation Framework for Medical Triage Chatbots

链接：https://arxiv.org/abs/2610.30412

作者：Deepali Mittal,Dheeraj Mundhra,Yulia Sidorova,Tersia de Kock,Oli Munns,Sofie S Meyer

类目：Computation and Language (cs.CL)

关键词：English-only benchmarks, evaluation methods focus, middle-income countries, focus on single-turn, chatbots' knowledge

备注： 23 pages, 4 figures, 3 tables

点击查看摘要

Abstract:LLM-based chat agents are increasingly used for complex, multi-turn, multilingual medical triage in low- and middle-income countries (LMICs), yet evaluation methods focus on single-turn, English-only benchmarks that primarily test the chatbots' knowledge. In practice, users are often confused, overwhelmed, or emotionally vulnerable, giving unclear, misspelled single-word answers or long messages in regional dialects, and the context of a conversation can shift rapidly. We propose SIM-UT (Simulation of User Behaviour for Triage), a multi-turn, simulation-based evaluation method that identifies ecologically valid, contextually relevant failure modes of LLM-based triage chat agents. Using SIM-UT, we evaluated three real-world WhatsApp-based health chatbots: a respiratory screening programme in India, a hearing health support programme in South Africa, and a diabetes and lifestyle coaching agent in Kenya. We compared a medically fine-tuned open model (MedGemma) against general-purpose frontier models (ChatGPT and Claude) across 5,000+ multilingual simulated conversation turns grounded in the personas, constraints, and communication patterns of the real user populations, over 2-4 iterative rounds. A key failure mode emerged in both model families: de-escalation risk. The agents initially identified medical emergencies correctly, but when the user minimised the symptoms without introducing new clinical information, they de-escalated, exhibiting clinically dangerous sycophancy, for example agreeing that vaginal bleeding in pregnancy was "not a problem" or that decreased fetal movements at 32 weeks "can be normal". We recommend user simulation-based behavioural evaluation, grounded in real user context and covering adversarial and edge cases, as standard practice for triage chatbots in production, so that safeguards can be added before deployment or in subsequent iterations.

101. 【2610.30385】xt-Only LLM Correctors Break Correct Transcripts: A Repair-Damage Analysis of Audio Grounding in ASR Error Correction

链接：https://arxiv.org/abs/2610.30385

作者：Vasiliy Kudryavtsev,Kirill Borodin,Nikita Vasiliev,Mikhail Gorodnichev,Grach Mkrtchian

类目：ound (cs.SD); Computation and Language (cs.CL)

关键词：LLM correctors, ASR output, aggregate WER, judged by aggregate, correctors of ASR

备注： Submitted to IEEE ICASSP 2027

点击查看摘要

Abstract:LLM correctors of ASR output are judged by aggregate WER, which hides what they fix and what they break. We decompose every WER change exactly into repaired tokens, damaged tokens and insertions, and use this to ask what the source audio adds to a corrector. We compare correction with and without the audio, for the model's own draft and for the output of an independent recogniser, on three corpora. With Gemini 2.5 Flash, text-only correction of its own draft breaks 13-32% of already-correct transcripts; with the audio, 1-3%. Damage falls in both settings. Repair falls against the own draft and rises against the recogniser. On medical dictation, kept insertions cancel the gain in net WER. The open-weight Voxtral, which rarely edits, does not show this pattern. Prompts differ between the two arms, so the contrasts bound the effect of the audio and do not isolate it.

102. 【2610.30379】MemPlan: Memory-Conditioned PDDL Planning for Partially Observable Text Environments

链接：https://arxiv.org/abs/2610.30379

作者：Tengwei Song,Robert Hoehndorf

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：agents are flexible, costly and prone, prone to hallucinated, hallucinated or invalid, LLM agents

备注： NeurIPS 2026

点击查看摘要

Abstract:LLM agents are flexible in language interaction, but using them as long-horizon planners is costly and prone to hallucinated or invalid actions. This paper targets a different role for LLMs: constrained bridges between language and symbolic planning. We propose MemPlan, a memory-conditioned PDDL planning framework for partially observable interactive text environments. MemPlan keeps the PDDL domain fixed and reconstructs the PDDL problem at each step from parsed observations, candidate hypotheses, and interaction memory. Positive graph memory assigns relevance-based action costs to candidate hypotheses for missing objects, locations, or conditions, guiding the planner toward more plausible checks. Negative memory records execution-refuted assumptions and compiles them into exclusion constraints, preventing repeated attempts at candidates already contradicted by feedback. A unified schema-conditioned language--symbol interface, trained offline with supervised fine-tuning, connects text environments to the planning loop through observation-to-fact parsing and symbolic-action-to-command grounding. Experiments on TextWorld, ALFWorld, and Robotouille show that MemPlan improves task completion and step efficiency over language-only and PDDL-aware baselines, while substantially reducing online token cost compared with LLM-planning baselines such as ReAct. The same fine-tuned interface is also reused across TextWorld task types without task-specific fine-tuning. Our code and data are available at: this https URL.

103. 【2610.30374】Climbing the Ladder: Automating Data Pipelines and Reproducing Baselines in Low-Resource Settings

链接：https://arxiv.org/abs/2610.30374

作者：Donato Meoli,Eryk Wdowiak

类目：Computation and Language (cs.CL)

关键词：include Sicilian learned, massively multilingual translation, multilingual translation systems, non-standardised web text, original system

备注： 17 pages, 6 tables

点击查看摘要

Abstract:The massively multilingual translation systems that now include Sicilian learned it from noisy, non-standardised web text. To obtain better translation quality, we redevelop the small neural machine translation (NMT) system that Wdowiak customized for Sicilian. We rebuild on maintained software the extraction of the parallel text from the PDFs of the bilingual journal Arba Sicula, whose sentences are aligned by a language-agnostic sentence encoder with thresholds tuned against an existing hand alignment and then filtered for the typical errors of automatic alignment. Furthermore, the tokenization and the desinence-biased subword segmentation of the original system are ported to a Perl-free implementation, and all the results are measured on a frozen test set drawn from the journal. We compare small Transformers trained from scratch with the pretrained NLLB model adapted by low-rank fine-tuning, in both directions and with Italian as a closely related bridge language, and we adapt to the pretrained model the reverse-training recipe of the original system, i.e., a stage on forward-scored back-translations of the web Sicilian followed by a stage on the curated literary text. The pretrained model is by far the better of the two, and the staged training improves the translation into Sicilian more than the translation from it. On the test set of the original system, and in the tokenized space in which it was scored, the staged model with a larger adapter and more back-translations is above the reverse-training recipe in the directions that involve English and below it between Sicilian and Italian. Yet, a multilingual adapter degrades the directions on which it was not trained, which limits its use as a general multilingual model.

104. 【2610.30363】Probing and Steering for Safety-Relevant Behaviours in Large Language Models

链接：https://arxiv.org/abs/2610.30363

作者：Nimun Bajwa,Massimo Poesio

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：model residual stream, language model residual, Activation probes, detect safety-relevant behaviours, residual stream

备注： 20 pages, 26 figures, 11 tables. Code, data and interactive interface: [this https URL](https://github.com/NimunB/probing-safety-behaviours)

点击查看摘要

Abstract:Activation probes are computed directions in a language model's residual stream, used both to detect safety-relevant behaviours and, by adding their direction back into the stream, to steer them. We explore how the main design choices behind such probes interact, within one pipeline, on one model (Llama-3.1-8B-Instruct), and across three behaviours: deception, high-stakes awareness and sycophancy. The pipeline crosses two estimators (difference-of-means and logistic regression) with three token-pooling schemes (last, mean and learned attention), selects appropriate layers to detect or steer a behaviour, and evaluates every direction twice: as a detector of the behaviour, and as a steering vector to push outputs towards the behaviour. Prior work read together suggests a read/write dissociation, in which logistic regression reads (detects) best but difference-of-means directions write (steer) best. We find that it holds for deception and high-stakes but not for sycophancy, where the pattern reverses. The reversal appears to follow partially from the data rather than from the estimators. The best pooling technique and the layer choice depend on the behaviour and data, and the layer that steers best can sit well before the layer that detects best. The right steering metric to use between changing a model's perception and eliciting behaviour depends on the task - and the two can disagree outright. The exported probes and directions power an interactive interface through which a user can score and steer text directly.

105. 【2610.30355】CiteAnchor: Source-Aware Grounding for Hallucinated Citation Detection and Resolution

链接：https://arxiv.org/abs/2610.30355

作者：Chenyi Tong,Ping Nie,Yu Zhang

类目：Computation and Language (cs.CL); Digital Libraries (cs.DL)

关键词：Hallucinated citations make, scientific claims, make it harder, harder to trace, verify the evidence

备注： 18 pages, 4 figures, 9 tables

点击查看摘要

Abstract:Hallucinated citations make it harder to trace sources and verify the evidence behind scientific claims. Detecting them is difficult because bibliographic records can be incomplete or differ across source types and publication versions. A plausible match alone neither validates the citation nor establishes its underlying source. We introduce CiteResolve, a benchmark of 423 real-world hallucinated citations annotated for source recoverability. We further propose CiteAnchor, a source-aware grounding framework that adapts retrieval and field-level verification to each source type and separately determines citation validity and whether a unique source can be recovered. On an existing detection benchmark, CiteAnchor achieves 0.841 F1 with GPT-5.6 Luna and 0.784 with an open-weight backbone, outperforming the baseline with the same backbones by 7.9 and 36.8 points. On CiteResolve, it achieves 74.7% and 70.7% end-to-end task success, outperforming the corresponding web search baselines by 16.3 and 65.3 percentage points. Our code and data are available at this https URL.

106. 【2610.30349】Consistency Is Not Validity: Self-Rewarded Moral Argumentation Makes Language Models Decisive but Pliable

链接：https://arxiv.org/abs/2610.30349

作者：Marius De Kuthy Meurers,Aaron Parisi,Bernd Bohnet

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：LLMs are increasingly, increasingly consulted, rewarding good arguments, argument quality, policy

备注： 20 pages, 10 figures, 9 tables

点击查看摘要

Abstract:LLMs are increasingly consulted for moral judgment. We aim to improve performance on such tasks by rewarding good arguments, on the premise that arguing well increases the likelihood of judging well. We train a reinforcement learning policy initialized from a state-of-the-art language model in a self-judged tournament with masked thinking: the generated arguments are judged pairwise on argument quality by the policy itself. As an empirical basis, we extract authentic dilemmas from classic novels, using a logic solver to verify that each constitutes a conflict. We show that our judge rates argument quality like human annotators, and the policy then adopts the language register that it rewards. Testing on the external benchmarks MoralChoice, ELEPHANT, and MORABLES, we find that the policy becomes more decisive and invariant to the order in which options are presented, but sycophancy and reframing remain a challenge to validity. Two ablation studies with synthetic dilemmas and unmasked thinking match the reordering gains, but show a weaker register shift and higher sycophancy. We conclude that consistency is not validity: consistency under reordering can be optimized without improving the moral judgment it is meant to signal.

107. 【2610.30344】AQL-Lite: Enabling Efficient Knowledge Acquisition for Arabic LLMs via Data-Centric Continual Pretraining

链接：https://arxiv.org/abs/2610.30344

作者：Houssam Eddine Boukhalfa,Mourad Bouache,Mourad Dahmane

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Arabic large language, Arabic Quality Language, Modern Standard Arabic, Training Arabic large, large language models

备注： 15 pages, 7 figures, 10 tables

点击查看摘要

Abstract:Training Arabic large language models faces challenges from noisy web data, dialectal variation, and the high cost of continual pretraining (CPT). We introduce AQL-Lite (AQL: Arabic Quality Language), a time- and resource-efficient framework for adapting a multilingual LLM to Modern Standard Arabic (MSA). AQL-Lite couples a quality-first curation pipeline (structural cleaning, heuristic and model-based filtering, MSA selection, and deduplication) with a partial-parameter CPT recipe that trains RS-LoRA adapters across the network together with the last eight transformer blocks and the embedding matrix, under layer-wise learning rates. At a matched 1B-token budget, CPT on AQL-curated data raises a four-benchmark Arabic mean by 3.51 points over CPT on raw web text, which yields no gain over the base model. In a controlled 5B-token comparison, AQL-Lite recovers 94% of the gain of full-parameter CPT (mean 73.19 vs. 73.58) in 52% of the wall-clock time and outperforms adapter-only baselines on every benchmark, and a component ablation shows that adapters, unfrozen blocks, and embedding training each contribute. Scaled to 40B MSA tokens and instruction-tuned on one million examples, the resulting 12B model scores 75.3 on the seven-benchmark Open Arabic LLM Leaderboard v2 (OALL v2) suite. These results suggest that partial-parameter CPT on a carefully curated corpus is a practical route to efficient MSA adaptation.

108. 【2610.30296】Measuring Research Progress and Linguistic Inclusion in Low-Resource Languages

链接：https://arxiv.org/abs/2610.30296

作者：Atnafu Lambebo Tonja,Tadesse Destaw Belay,Jesujoba Oluwadara Alabi,Israel Abebe Azime,Benjamin Rosman,Ehsan Shareghi,Thamar Solorio,Pontus Stenetorp,Monojit Choudhury

类目：Computation and Language (cs.CL)

关键词：Large Language Models, landscape remains unmapped, multilingual NLP, equitable landscape remains, Large Language

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) have accelerated research on low-resource and multilingual NLP, but their effectiveness in creating an equitable landscape remains unmapped. We analyze 1,158 peer-reviewed open-access papers published between 2020 and 2025, examining research attention to low-resource languages (LRLs) and representation across language and speaker populations. To assess linguistic inclusion beyond publication counts, we introduce the Linguistic Inclusion Framework (LIF), a multidimensional framework that measures linguistic inclusion in four dimensions: research growth, representation expansion, representation continuity, and distributional equity. While annual publications grew from 52 to 415, a 5.4X increase in their ACL Anthology publication share, this growth largely concentrated on represented languages rather than expanding coverage of underrepresented languages. Further analysis shows that languages spoken in Asia account for 64.1% of speakers across LRLs we analyze but receive only 46.7% of the language representation share (0.7X their proportional share), while European languages receive 5.3X their proportional share. At the country level, linguistically diverse regions such as sub-Saharan Africa and Southeast Asia show the lowest language coverage ratios. Applying the framework at the continental level, we find that no region scores well on all four dimensions, showing that research growth alone is not a reliable metric of progress toward equitable and inclusive language technology\footnote{We will release all collected and annotated data for research purposes}.

109. 【2610.30193】Protection Is Not One Event: A Survey of RAG Protection Research by Measured Endpoint

链接：https://arxiv.org/abs/2610.30193

作者：Peiyang Liu,Xi Wang,Di Liang,Youru Li,Zhi Cai,Wei Ye

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：Retrieval-augmented generation, including content leakage, risks including content, systems face security, copyright risks including

备注： ACL Rolling Review (August 2026 cycle) recommends that the paper be accepted at an *ACL conference

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) systems face security, privacy, and copyright risks including content leakage, source reconstruction, unauthorized access, data poisoning, and prompt injection. Yet RAG protection studies use incompatible evaluation metrics, datasets, and threat models. We present a systematic survey and human-coded evidence map of 118 full-text-confirmed RAG defense papers, organized by measured endpoint rather than claimed goal or defense mechanism. Our seven-family taxonomy covers content disclosure, formal privacy proxies, access control and suppression, corpus-use detection, and pipeline integrity and attribution. Thirty-two annotators double-coded the papers kappa=0.867. The survey identifies three gaps. First, retrieval reranking and context rewriting each span five or six endpoint families, so mechanisms do not identify protection outcomes. Second, only 17.8% of studies use content disclosure or reconstruction as their primary endpoint; under the frozen copyright/ownership relation label, 73.3% of records have corpus-use detection as their primary endpoint, and none have an emitted-expression primary endpoint. Third, most evaluations use general-purpose question-answering datasets and non-adaptive attacks rather than sensitive data and adaptive, multi-turn extraction. Our controlled RAG testbed shows that preventing verbatim copying does not prevent private-fact recovery: a normalized 8-gram guard reduces 20-token copying to 0.0%, but a three-query adaptive attacker recovers 48.3% of hidden facts on Qwen3-8B. We release the taxonomy, dataset, coding protocols, and testbed to enable comparable, claim-aligned RAG security evaluation.

110. 【2610.30168】Finitely Verifiable Segmentation: Decidability for Every Tokenizer with a Finite-State Verifier

链接：https://arxiv.org/abs/2610.30168

作者：Nicklas Nidhögg

类目：Formal Languages and Automata Theory (cs.FL); Computation and Language (cs.CL); Programming Languages (cs.PL)

关键词：segmentation policy assigns, policy assigns, byte string, segmentation policy, segmentation

备注： 36 pages, 1 figure, 2 tables. Artifact: [this https URL](https://doi.org/10.5281/zenodo.22994411) . The modules, the gate and the records of the library and tokenizer instances are in the artifact, with a verifier that runs every module and holds each reported count to the output line it rests on. Companion to [arXiv:2608.03473](https://arxiv.org/abs/2608.03473) , [arXiv:2608.09761](https://arxiv.org/abs/2608.09761) , [arXiv:2609.10600](https://arxiv.org/abs/2609.10600) and [arXiv:2610.08854](https://arxiv.org/abs/2610.08854)

点击查看摘要

Abstract:A segmentation policy assigns to each byte string at most one segmentation into tokens. Call it finitely verifiable when a finite automaton over marked strings, bytes paired with boundary bits, accepts exactly the policy's own segmentations. The automaton judges a proposed segmentation and need not compute one. The paper shows what that hypothesis buys. Four questions that practice settles by folklore become decidable, whether a window certifies a token boundary, whether the boundary gap is bounded, whether a mask keeps generation completable, and whether two policies are equivalent. The last three specialize limitedness, coaccessibility and the equivalence of single-valued transducers. The first refines the synchronizing cut of code theory, and two more ask whether a certified cut, or the cuts of an inventory, let each piece scan alone. The class sits strictly between the online-scannable policies and those with regular domains, and its inner frontier is Choffrut's and decidable in polynomial time. Markings are length-preserving, so the class is exactly the rational segmentation policies, a normal form rather than a restriction, and what the decisions need is a supplied verifier. The class is closed under the operations pipelines use: composition over a labeled stage, restriction, splitting, and byte-fallback union of literal policies. Each composite inherits the six decisions, and certificates transfer between stages under four laws. Under rational, unifilar, almost surely stopping finite-state sources, each mass of the weighted section is an exact rational, and so is each rate where expected length is positive. Maximal-munch lexing, canonical byte-pair encoding and two-mode WordPiece instantiate the interface, and the munch library implements all six decisions. Every theorem carries an executable check, and every reported statistic is a program's own output.

111. 【2610.30162】FusionEval: Benchmarking Model Fusion for Large Language Models

链接：https://arxiv.org/abs/2610.30162

作者：Shuo Cai,Yanggan Gu,Yuhang Liu,Su Lu,Yuanyi Wang,Yang Yu,Zhen Li,Zhitian Hou,Guanghao Zhu,Ming Li,Hongxia Yang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Model fusion aims, tool, expert capabilities, fusion aims, individual expert capabilities

备注： 20 pages, 4 figures

点击查看摘要

Abstract:Model fusion aims to integrate the capabilities of multi-expert models into a single model. Existing evaluations offer limited coverage of reasoning with long chains of thought and tool use, while strong average performance can mask substantial losses in individual expert capabilities. We introduce FusionEval, a benchmark that provides controlled expert pools, integrates fusion methods with and without additional training, and offers a unified evaluation suite. The pools contain domain experts independently trained from Qwen3 and Llama base models across math, code, science, instruction following, and tool use. The suite evaluates capability retention and computational cost on eight public benchmarks under comparable data access rules, reporting normalized average and worst performance, runtime, and peak GPU memory usage. Extensive experiments show that training-free methods preserve reasoning performance but substantially degrade tool use at both model scales. In contrast, MOPD preserves tool use and achieves a more balanced capability profile, but requires additional data preparation, inference, and training. Jointly retaining reasoning, instruction following, and tool use at low computational cost remains a challenge. We hope FusionEval supports future research on efficient model fusion that jointly preserves expert capabilities. Our code is available at this https URL.

112. 【2610.30161】auIndianBankBench: Procedure-Aware, Action-Oriented Evaluation of Tool-Using Conversational Agents

链接：https://arxiv.org/abs/2610.30161

作者：Krishanu Adhikary,Prashant Devadiga

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：FAQ pages, Indian banks serve, scripted chatbots, pages and scripted, banks serve customers

备注： 15 pages, 6 figures, 14 tables. Code: [this https URL](https://github.com/npci/TauIndianBankBench;) data: [this https URL](https://huggingface.co/datasets/NPCI/tau-indian-banking)

点击查看摘要

Abstract:Many Indian banks serve customers through FAQ pages and scripted chatbots. Assistants based on language models could respond faster and carry out requests such as blocking a card, but only if they give correct information and follow the bank's rules. These rules prescribe a procedure, a set of required steps, such as obtaining a closure quote before closing a deposit. Adapting models to this domain requires measuring how well they follow the procedure, before and after training. Benchmarks usually judge only the records left at the end of a conversation. Many required steps, however, leave the records unchanged, so an assistant that skips them can still be judged successful. We present TauIndianBankBench, an action-oriented benchmark of 1,000 Indian retail-banking tasks where an assistant helps a simulated customer. Besides the final records, it checks that the assistant took every required step and made no unrequested change. For every model, 6.5-12.0% of sessions are judged successful when only the final records are checked, although the assistant skipped a required step or made an unrequested change. Scoring both procedure and outcome shows more accurately how well language models perform in Indian retail banking.

113. 【2610.30158】Lighthouse: On Building a Trustworthy Digital Assistant for Exploring History with Civil Rights Archives

链接：https://arxiv.org/abs/2610.30158

作者：John A. Aydin,Angelica Williams,Steven Dindl,Nathan Saunders,Kate Boyd,Vandana Srivastava,Biplav Srivastava

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：studying history effectively, Artificial intelligence, including text, decision-support aid, tools for studying

备注：

点击查看摘要

Abstract:Artificial intelligence (AI), as a decision-support aid, provides new tools for studying history effectively using multimodal data, including text, images, and audio. We present, to our knowledge, the first digital assistant named Lighthouse--commonly called a chatbot--for exploring the Civil Rights period of the United States using data from South Carolina. From an AI perspective, the system's novelty lies in its guiding design principles of (a) focusing on trustworthiness of content and (b) by modeling and reducing potential harm to users from generated answers. It implements these with a neuro-symbolic approach that combines neural learning through a large language model (LLM) with rule-based symbolic solving, balancing risk of answers with generality of coverage. We evaluate Lighthouse with both factual objective questions that admit a single acceptable answer as well as subjective questions. For the latter, a dataset of subjective question-answer pairs (QAs) is created by discovering a "gold standard" by aggregating answers from independent experts. Lighthouse has access to over 18k primary sources from a range of collections and can be easily extended.

114. 【2610.30154】baseVultra: Compact Nonlinear Recurrence with Reallocated Capacity

链接：https://arxiv.org/abs/2610.30154

作者：Linke Zhang

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Nonlinear recurrent networks, streaming sequence modeling, gated cell design, Nonlinear recurrent, streaming sequence

备注： Preprint. 14 pages, 3 figures. Revised based on peer review feedback from WAIC Academic 2026 (1 weak accept, 2 borderline)

点击查看摘要

Abstract:Nonlinear recurrent networks remain useful for streaming sequence modeling, yet gated cell design is still dominated by LSTM and GRU. We study whether recurrent computation can be reallocated away from gate transforms and toward candidate generation. We propose baseVultra, a compact recurrent cell that concentrates the dense recurrent budget on a single H x H candidate-generation matrix, while replacing recurrent gate matrices with O(H) diagonal interactions. The candidate update combines this dense branch with two low-rank auxiliary branches, an EMA cache, and learnable output blending; the gates additionally receive lightweight second-order access to h_{t-2} through diagonal terms. On TinyShakespeare character-level language modeling, baseVultra achieves a validation loss of 1.594 in the compact one-layer 200K setting, compared with 1.604 for a parameter-matched LSTM and 1.616 for a parameter-matched GRU, while its dense recurrent matrix-vector computation is about 54% of GRU under matched hidden size for this configuration. On text8, a roughly 45x larger benchmark, baseVultra is competitive with full-gate cells (1.854 bpc vs. 1.849 for GRU and 1.837 for LSTM). On formal-language probes, the largest gains appear under constrained hidden-state capacity (0.991 vs. 0.761 GRU and 0.691 LSTM OOD2 accuracy on Counter at H=16) and vanish as hidden size grows. These results characterize where and when candidate-focused recurrent capacity allocation helps: the benefit is concentrated in compact regimes, while full-gate cells remain competitive at scale.

115. 【2610.29217】When Multiple Choices Are Correct: Asymmetric Probability Allocation in Jev and Other Decision Models

链接：https://arxiv.org/abs/2610.29217

作者：Rushab Munot

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Decision models return, models return normalized, return normalized probability, normalized probability distributions, Decision models

备注： 11 pages, 2 figures. Code: [this https URL](https://github.com/Rushab1/gr-jev)

点击查看摘要

Abstract:Decision models return normalized probability distributions over candidate choices, which downstream applications can use to select among choices. Although their providers emphasize the reliability of these probabilities, calibration on tasks with a single correct choice does not establish their reliability when multiple choices are correct. We evaluate three decision models (Jev, Liquid d1, and GPT-6 Luna Decisions) on three diverse datasets (MetaTool, HotpotQA, and ECtHR) to study probability allocation and thresholding. Even when models rank every correct choice above every distractor, in 28% to 50% of those lists, at least one correct choice receives a probability below the uniform probability of 1/n, where n is the number of choices. We also present each model with five identical copies of a correct choice and observe probability disparities, with mean gaps ranging from 17 to 79 percentage points. We further show how these allocation disparities affect the recovery of multiple correct choices under probability thresholding. Decision-model probabilities can rank correct choices, but a probability threshold does not identify the set of correct choices.

116. 【2601.02915】ChemBART: Pre-training a Reaction Language Model for Comprehensive Synthesis Planning

链接：https://arxiv.org/abs/2601.02915

作者：Kenan Li,Yijian Zhang,Jin Wang,Haipeng Gan,Zeying Sun,Xiaoguang Lei,Hao Dong

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Recent advances, demonstrated transformative potential, large language models, advances in large, demonstrated transformative

备注： Under peer review. 31 pages, 6 figures, 2 tables

点击查看摘要

Abstract:Recent advances in large language models (LLMs) have demonstrated transformative potential across diverse fields. However, in computer-aided synthesis planning (CASP), current LLM methodologies are often restricted to single-molecule representations, limiting their application to isolated, single-task scenarios such as precursor prediction. Addressing this gap, we present ChemBART, a BART-based language model that adopts a reaction-centric pre-training strategy. By leveraging a mask-filling pre-training task on holistic reaction expressions (Reactant Reagent Product), ChemBART effectively solves a variety of chemical problems, including precursor/reagent generation, temperature-yield regression, and molecular property classification. Building on these capabilities, we demonstrate the integration of ChemBART with Monte Carlo tree search (MCTS) for multi-step synthesis route design, where the model serves to optimize the policy and value functions within a reinforcement learning framework. Beyond single-molecule pre-trained LLMs that are constrained to specific applications, ChemBART unifies diverse chemical tasks to facilitate synthesis planning with comprehensive implementation information. Most significantly, the proposed multi-step synthesis routes and reaction conditions were validated in the wet lab, confirming the discovery of shorter synthetic pathways with a 20% yield improvement over established literature benchmarks. Our work highlights the potential of reaction-focused pre-training and showcases the broad utility of ChemBART in closing the loop between in silico prediction and wet-lab synthesis.

117. 【2509.16444】Domain-Specific Constitutional AI: Enhancing Safety in LLM-Powered Mental Health Chatbots

链接：https://arxiv.org/abs/2509.16444

作者：Chenhan Lyu,Yutong Song,Pengfei Zhang,Amir M. Rahmani

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：rising global rates, driven by rising, psychological care, underserved communities, Mental health applications

备注： Accepted to 2025 IEEE 21st International Conference on Body Sensor Networks (BSN)

点击查看摘要

Abstract:Mental health applications have emerged as a critical area in computational health, driven by rising global rates of mental illness, the integration of AI in psychological care, and the need for scalable solutions in underserved communities. These include therapy chatbots, crisis detection, and wellness platforms handling sensitive data, requiring specialized AI safety beyond general safeguards due to emotional vulnerability, risks like misdiagnosis or symptom exacerbation, and precise management of vulnerable states to avoid severe outcomes such as self-harm or loss of trust. Despite AI safety advances, general safeguards inadequately address mental health-specific challenges, including crisis intervention accuracy to avert escalations, therapeutic guideline adherence to prevent misinformation, scale limitations in resource-constrained settings, and adaptation to nuanced dialogues where generics may introduce biases or miss distress signals. We introduce an approach to apply Constitutional AI training with domain-specific mental health principles for safe, domain-adapted CAI systems in computational mental health applications.

信息检索

1. 【2610.31385】A Task-Centric Survey of Long-Document Visual Question Answering: Taxonomy, Evolution, and Future Directions

链接：https://arxiv.org/abs/2610.31385

作者：Yufei Tong,Guanjie Cheng,Tianle Wu,Leilei Zhang,Hang Zheng,Peihan Wu,Jianwei Yin,Shuiguang Deng

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：growing research interest, attracting growing research, visually rich documents, essential for acquiring, acquiring knowledge

备注： 26 pages, 9 figures, 6 tables

点击查看摘要

Abstract:Visual document understanding is essential for acquiring knowledge from visually rich documents and is attracting growing research interest. Existing surveys emphasize architectures or technical approaches, with limited attention to how task bottlenecks shape technical choices and research priorities. We present a task-centric survey that decomposes long-document visual question answering (VQA) into four components: document parsing, evidence organization and retrieval, generator organization and learning, and evaluation. For each, we develop a fine-grained taxonomy and trace motivations, technical responses, and cross-component connections. We focus on explicit retrieval while covering direct reading. Our temporal analysis traces expanding priorities from multimodal content understanding to sufficient, high-fidelity evidence acquisition and sustained evidence management. We outline future directions in evidence sufficiency, verifiable and correctable understanding, and budget-aware coordination, with an outlook on continual document understanding.

2. 【2610.31317】SurveyGraph: Generating Academic Surveys via Methods-Entity Knowledge Graphs

链接：https://arxiv.org/abs/2610.31317

作者：Yifan Yuan,Yancheng Zhu,Zuoyu Zhang,Xiaogang Peng

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：capture research structure, systems retrieve papers, generation systems retrieve, limiting their ability, research structure

备注： Accepted at EMNLP 2026 Findings. 34 pages including appendices

点击查看摘要

Abstract:Most automated survey generation systems retrieve papers as flat documents, limiting their ability to capture research structure. We present SurveyGraph, a framework built around a Methods-Entity Knowledge Graph (MEKG) encoding method-level follow-on, competition, and shared-resource relations. The graph supports core-paper discovery, retrieval, hybrid outlining, and evidence-gated narrative synthesis. We evaluate retrieval, semantic edges, citation grounding, collection coverage, and generation-stage components. In a controlled seven-method equal-budget benchmark, MEKG-anchored fusion balances recall and structural density, with an independent co-citation check. In a separate archived graph-native diagnostic, graph-aware retrieval nearly doubles recall over flat lexical baselines across eight runs (p = 0.004). A semantic evidence gate achieves AUC = 0.75. Audits of 160 generated sentences find 80.6% anchored-or-partial citation support. Human adjudication of 108 stratified semantic edges finds 68.5% supported-or-partial relations (binary-support Cohen's kappa = 0.64), with improves strongest (80.6%) and extends weakest (52.8%). A SurveyBench-facing collection probe reaches mean reference coverage of 0.521 across four topics with an eight-paper budget. Same-backend Qwen diagnostics on a 30-paper/74-relation graph show reduced organization signals when hybrid outlining is removed. Concurrent-system comparisons provide bounded context rather than matched-backend end-to-end evidence. The results position MEKG as an auditable structural layer for typed diagnostics, relation-specific filtering, and controlled survey generation. Code and artifacts: this https URL.

3. 【2610.31311】he Delayed Countdown Method for Validating Review-Oriented AI Workflows in eDiscovery

链接：https://arxiv.org/abs/2610.31311

作者：David D. Lewis,Tara Emory,Lenora Gray,Mark Noel,Jeremy Pickens,Eugene Yang

类目：Information Retrieval (cs.IR)

关键词：AI-assisted document review, Review-oriented workflows, electronic discovery, AI-assisted document, existing review-oriented workflows

备注：

点击查看摘要

Abstract:Review-oriented workflows have become the dominant approach to AI-assisted document review in electronic discovery (eDiscovery). How to validate the effectiveness of review-oriented workflows has, however, remained a confusing and controversial topic in technology-assisted review (TAR) in the law. We examine the sources of this controversy, and propose a simple and practical evaluation approach for review-oriented workflows. Our Delayed Countdown method is easily incorporated into existing review-oriented workflows and software, is compatible with arbitrary stopping rules, and produces valid frequentist confidence intervals on effectiveness. We explain the conceptual foundations of the method, provide example computations, discuss the handling of logically impossible recall values, and suggest future work on decreasing review costs.

4. 【2610.31019】Chunk Recomputation under Real Document Revisions: Measuring Update Cost and Retrieval Quality of Fixed, Recursive, and Content-Defined Chunking

链接：https://arxiv.org/abs/2610.31019

作者：Yuning Bian,Lele Xu,Yifan Yuan,Xinyu Yin,Chengyan Zhan

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：knowledge base continue, strategies for retrieval-augmented, retrieval-augmented generation, documents underlying, underlying a knowledge

备注： 6 pages, 3 figures, 3 tables. Accepted at AIBDCC 2026

点击查看摘要

Abstract:Chunking strategies for retrieval-augmented generation are almost always evaluated on a static snapshot, yet the documents underlying a knowledge base continue to change. Because chunks are embedded independently, a boundary that moves after an edit forces unchanged text to be re-embedded. We measure this update cost on 120 pairs of adjacent Chinese and English Wikipedia revisions for three stateless chunkers (non-overlapping fixed-size, recursive paragraph-first, and content-defined chunking) under a strict byte-identical reuse rule and a frozen dense encoder. On the 116-article common-success pool, with frozen, length-calibrated parameters, fixed-size chunking recomputes 57-68% of its full new-version embedding-input workload, recursive chunking 38-56%, and content-defined chunking 43-54% (it failed on 4 of 62 Chinese articles), while at these parameters mean evidence recall under a fixed 2048-token retrieval budget differs by less than two percentage points within either language. A cost-only parameter grid shows that the ranking of the two content-aware chunkers changes with chunk-length settings, whereas non-overlapping fixed-size chunking has the highest recomputation cost in every length-matched condition. Controlled edits and a verbatim-presence diagnostic support boundary drift as one contributor to recomputation of text already present in the previous version. Update cost is therefore a substantial, parameter-sensitive dimension that static retrieval evaluations do not expose and that should be reported alongside retrieval quality.

5. 【2610.31011】Formal-Informal Mathematical Alignment through and beyond Human Annotations

链接：https://arxiv.org/abs/2610.31011

作者：Noah Gießing,Ankit Satpute,Hamid Rahkooy,André Greiner-Petter,Moritz Schubotz

类目：Information Retrieval (cs.IR)

关键词：provide machine-verifiable representations, including definitions, provide machine-verifiable, machine-verifiable representations, Formalized mathematics libraries

备注： Accepted at: Proceedings of the 35th ACM International Conference on Information and Knowledge Management (CIKM '26), November 7-11, 2026, Rome, Italy

点击查看摘要

Abstract:Formalized mathematics libraries such as Lean's \texttt{mathlib} provide machine-verifiable representations of mathematical knowledge, including definitions, theorems, and their relationships. If effectively connected to informal mathematical resources, formal mathematics could help uncover previously implicit links between mathematical concepts and improve access to existing formalizations. However, connections between informal and formal mathematics libraries are currently sparse and unsystematic. In this paper, we make first strides towards better formal integration. We construct a dataset linking informal statements from the Stacks Project to their formalizations in \texttt{mathlib} by exploiting expert annotations. We evaluate retrieval, LLM-based reranking, and LLM-assisted verification to discover new unannotated informal-to-formal links. To facilitate exploration and reuse of formalized knowledge, we integrated the newly discovered alignments into the MaRDI knowledge graph, enabling mathematicians to find formal counterparts to informal mathematical content. We discuss the difficulties and challenges in using LLMs for linking formal and informal mathematical content. All code and data necessary for reproducing this paper can be found at: this https URL

6. 【2610.30941】PAIR: Preference-Aligned Intent Retrieval for Premium People Recommendation at LinkedIn

链接：https://arxiv.org/abs/2610.30941

作者：Zhongkai Shangguan,Yanbin Kang,Yihan Cao,Ruijie Jiang,Qiannan Yin,Chang Yue,Zijian Zhou,Girish Kathalagiri,Changshuai Wei,Zhengming Xing

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：General-purpose embeddings trained, General-purpose embeddings, relevance is inherently, General-purpose, profile similarity

备注：

点击查看摘要

Abstract:General-purpose embeddings trained on profile similarity often misrank candidates in professional networks, where relevance is inherently complementary rather than symmetric. For example, job seekers usually engage with recruiters rather than peers with similar credentials. Current user recommendation systems are often built on profile similarity or social signals such as shared connections, which are effective in friend-oriented social networks where users tend to connect with similar people or within existing social circles. However, this does not hold in professional platforms like LinkedIn, where interactions are often goal-driven and cross-role interactions, requiring matching based on complementary intents rather than similarity or social proximity. In this paper, we propose Preference-Aligned Intent Retrieval, a retrieval framework that is designed to model user intent preference instead of profile similarity. Our approach is inspired by the preference-learning perspective of Direct Preference Optimization, but instantiates preference learning as an exposure-conditioned multi-negative contrastive objective over embeddings. This formulation simplifies training and scales efficiently to large candidate sets without requiring an explicit reference model. Furthermore, we incorporate user interaction history by aggregating click histories with positional encoding to capture temporal order, which enables constant-cost updates of user representations over a fixed history window, allowing new interactions to be incorporated without re-encoding history. As a result, personalization can be updated efficiently using lightweight CPU operations without repeated LLM inference during serving. We evaluate PAIR on LinkedIn's Premium retrieval task. A 0.6B parameter model achieves a MAR@100 of 0.45.

7. 【2610.30932】UserArena: Benchmarking Interactive User Simulation for Long-Horizon Shopping Agents

链接：https://arxiv.org/abs/2610.30932

作者：Jujia Zhao,Jiakai Tang,Jing Yu,Wen Chen,Jian Wu,Han Zhu,Fei Sun,Suzan Verberne,Zhaochun Ren

类目：Information Retrieval (cs.IR)

关键词：Agentic recommendation pursues, pursues shopper goals, recommendation pursues shopper, Agentic recommendation, pursues shopper

备注：

点击查看摘要

Abstract:Agentic recommendation pursues shopper goals through sequences of context-dependent decisions. Developing and evaluating such policies requires faithful recommendation world models that capture both the interactive shopping environment and users' behavioral responses over long interactions. Existing resources rarely provide long-horizon, fine-grained real-user trajectories or support trajectory-level evaluation and offline validation against production A/B results. We introduce UserArena, a real-world e-commerce interactive benchmark containing 64,729 session trajectories from 11,010 users, spanning 566,102 items and 13 action types. UserArena pairs these trajectories with an interactive environment and supports offline validation against outcomes from a controlled production A/B test, enabling five-level evaluation from output validity and local decisions to sequential behavior, personalization, and outcomes. To improve simulator fidelity over these long-horizon interactions, we further propose On-Policy Trajectory Distillation (OPTD), which uses trajectory-level intent to provide dense teacher targets on student-generated rollouts. Experiments show that OPTD achieves the strongest overall fidelity among the evaluated simulators under UserArena's evaluation protocol and most closely reproduces the production policy effect in offline simulation.

8. 【2610.30843】Lean Finder V2: Semantic Search for Mathlib That Disambiguates User Queries

链接：https://arxiv.org/abs/2610.30843

作者：Jialin Lu,Xiaoyu Liu,Hengrui Luo,Rodrigo Stehling,Linxi Liu,Weiran Sun,Yuepeng Wang,Wuyang Chen

类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)

关键词：Lean Finder, introduce Lean Finder, Finder, Mathlib, Lean

备注：

点击查看摘要

Abstract:We introduce Lean Finder V2, a semantic search framework for Mathlib that disambiguates user queries through complementary model-level adversarial training and input-level query rewriting. Human mathematicians and coding agents rarely search Mathlib by providing detailed context. In practice, they query short properties, notation, aliases, or hypotheses, leaving much of the intended mathematics implicit. In contrast, existing Mathlib search engines unrealistically assume context-rich queries. The scarcity of real-world short queries paired with ground-truth Mathlib statements makes this ambiguity even more intractable. We argue that this is essentially a data problem. Through adversarial training, we scale up the generation of labeled short and ambiguous queries, and learn to disambiguate user queries at both model-level fine-tuning and input-level query rewriting. On the human-curated MathlibQR benchmark, our Lean Finder V2 sets a new state of the art, with at least 11% relative improvement over the previous best Mathlib semantic search engines. On top of our state-of-the-art retriever, optimized query rewriting further improves MathlibQR retrieval. On unlabeled queries from human and coding-agent interactions, Lean Finder V2 is ranked as the strongest system. Integrated with Claude Code, Lean Finder V2 improves proof success on downstream theorem-proving task. Lean Finder V2 is available at: this https URL

9. 【2610.30825】Bezier-Guided Adaptive Flow for Cross-domain Sequential Recommendation

链接：https://arxiv.org/abs/2610.30825

作者：Ziang Lu,Yu Zhang,Xinzhe Jiang,Lei Sang,Yiwen Zhang

类目：Information Retrieval (cs.IR)

关键词：Cross-domain sequential recommendation, alleviate data sparsity, Cross-domain sequential, sequential recommendation aims, knowledge across domains

备注：

点击查看摘要

Abstract:Cross-domain sequential recommendation aims to alleviate data sparsity and cold-start problems by transferring useful preference knowledge across domains. However, users exhibit varying degrees of preference consistency across domains, while existing methods often rely on global alignment objectives or coarse-grained transfer strategies. Such approaches may introduce irrelevant information and provide limited flexibility in adapting semantic representations to individual user preferences. To address these challenges, we propose BGAFlow, a personalized framework that combines state-adaptive semantic evolution with user-specific transfer control. BGAFlow first establishes a shared semantic space through unified dual-domain pretraining with user profiles inferred by a large language model (LLM). Based on latent interest overlap, it then estimates a personalized horizon to determine the appropriate transfer extent for each user. To enable semantic adaptation, BGAFlow constructs a conditional Bezier curve as a geometric reference and learns a residual flow that progressively refines the trajectory based on intermediate preference states. The learned flow incorporates dynamic preference feedback to adjust transfer directions, while recommendation supervision and trajectory regularization encourage effective and smooth adaptation. Extensive experiments on real-world datasets demonstrate that BGAFlow consistently outperforms state-of-the-art baselines, validating the benefits of personalized transfer control and state-adaptive semantic evolution.

10. 【2610.30710】Automated Enrichment Analysis with GraphRAG: Efficient Multi-Database ORA Extraction and Biological Interpretation

链接：https://arxiv.org/abs/2610.30710

作者：Guangcan Li,Shuyuan Zheng,Jiayao Liu,Shigeto Seno,Makoto Onizuka

类目：Information Retrieval (cs.IR); Databases (cs.DB)

关键词：interpret gene-expression studies, related enrichment signals, flat term lists, obscure gene-level links, Over-Representation Retrieval-Augmented Generation

备注： Accepted to the 2026 IEEE International Conference on Bioinformatics and Biomedicine (IEEE BIBM 2026)

点击查看摘要

Abstract:Over-representation analysis (ORA) is widely used to interpret gene-expression studies, but its outputs are often fragmented across gene-set databases and presented as flat term lists that obscure gene-level links among related enrichment signals. We propose Graph-Based Over-Representation Retrieval-Augmented Generation (GBOR-RAG), an integrated and traceable framework for ORA interpretation. GBOR-RAG represents heterogeneous gene-set databases as a unified term--gene knowledge graph, where shared genes connect related terms across sources. After graph-based ORA scoring, the framework retrieves a compact connected evidence subgraph that preserves both cross-database relationships and gene-level support. The subgraph conditions an LLM to generate biological interpretations, and we introduce a claim-level faithfulness metric to assess whether generated claims are supported by explicit evidence. Experiments show that graph-based ORA preserves conventional ORA results with high consistency (mean Pearson $r=0.997$) while reducing query time by a median of $37\times$ (up to $48\times$). The retrieved subgraphs average 36.8 nodes and achieve the highest overall integration score (4.12), and GBOR-RAG attains the highest claim-level faithfulness (0.90) among the compared systems. Adding a PubMed literature layer further improves the overall interpretation quality from 4.17 to 4.75.

11. 【2610.30697】Lychee: Certified Screening of Inverted Lists for High-Recall Vector Search

链接：https://arxiv.org/abs/2610.30697

作者：Dongfang Zhao

类目：Information Retrieval (cs.IR)

关键词：probed lists, Nearest-neighbor search, embedding vectors matches, vectors matches faces, missed threat

备注： 14 pages, 12 figures

点击查看摘要

Abstract:Nearest-neighbor search over embedding vectors matches faces against watchlists, transactions against known fraud patterns, and medical images against confirmed cases, where a missed neighbor is a missed threat, fraud, or diagnosis. Because an approximate index cannot report which queries lost a true neighbor, these applications require recall of 0.999 to 0.9999, at a cost far below that of exact search over billions of vectors. Inverted-file indexes reach high recall by probing more lists, but they read and score every probed vector at full precision, so that throughput falls in inverse proportion to the number of probed lists. Graph indexes saturate below these targets, whereas quantized lists must rerank their candidates with the full vectors. Our insight is to decide for almost every probed vector that it cannot enter the top k of the probed lists without reading the vector, through the certified lower bound of exact search by certified exclusion. This paper turns this insight into Lychee, a GPU inverted-file search that screens the probed lists on tensor cores under a threshold from anchors of the same lists and computes exact distances only for the few survivors. We prove that Lychee returns exactly the k nearest vectors of the probed lists, the answer of an inverted-file search at full precision, while it reads a few hundred full vectors per query regardless of the number of probed lists. On eleven datasets from one million to one billion vectors and against ten GPU and CPU baselines, Lychee is 9.7 to 117 times faster than IVF-Flat at equal recall with 200 probed lists on datasets of up to 100 million vectors. It also reaches recall levels that CAGRA and HNSW do not reach and outruns exact search by certified exclusion by 5 to 18 times above ten million vectors. On four GPUs, Lychee searches one billion vectors at recall 0.9999, 44.5 times faster than IVF-Flat on BIGANN-1B.

12. 【2610.30675】OneLatent: Latent Reasoning for Efficient Foundation Recommendation Models

链接：https://arxiv.org/abs/2610.30675

作者：Hao Jiang,Peiru Du,Pengfei Yao,Mengting Li,Siyuan Lou,Kuo Cai,Sheng Yu,Qiang Luo,Jian Liang,Ruiming Tang,Fei Pan,Peng Jiang,Wenwu Ou

类目：Information Retrieval (cs.IR)

关键词：Large language models, Large language, foundation recommendation models, language models, backbone of foundation

备注：

点击查看摘要

Abstract:Large language models (LLMs) have demonstrated strong reasoning capabilities, motivating their use as the backbone of foundation recommendation models (FRMs). Existing methods enhance recommendations through explicit Chain-of-Thought (CoT) reasoning under a Think-then-Answer paradigm. However, explicit CoT incurs substantial inference overhead by generating lengthy reasoning traces and relies on manually designed templates that struggle to capture diverse, dynamic user interests. We propose OneLatent, an efficient latent reasoning framework that compresses explicit reasoning traces into several learnable latent tokens, enabling Latent-Reason-then-Answer inference without generating verbose traces. OneLatent first introduces Multi-View Adaptive CoT (MV-ACoT), which creates diverse, high-quality teacher-generated supervision by exploring user interests from multiple perspectives and automatically adapting reasoning complexity to each instance. Building on pretrained FRMs, it then uses a three-stage latent-token alignment paradigm to progressively internalize CoT traces into learnable latent tokens. Finally, a multistage curriculum-based post-training strategy activates latent-token reasoning for downstream recommendation tasks. Experiments on an industrial-scale Kuaishou dataset and the public Kuaishou LLM-Rec benchmark show that OneLatent consistently outperforms explicit CoT-based methods and traditional baselines. Compared with the Think and No-Think variants of FRMs, OneLatent improves SID@64 by 17.44% and 9.33%, respectively, while achieving over 17x higher online inference throughput. We further develop a production serving system for scalable, real-time FRM inference. An online A/B test in Kuaishou's local-services advertising scenario shows that deploying OneLatent with this system yields an estimated 9.6% revenue lift over strong online baselines, including OneRec and OneReason.

13. 【2610.30664】Compiling Autoregressive LLM Control into Policy-Exact Parallel Inference for Hierarchical RAG

链接：https://arxiv.org/abs/2610.30664

作者：Zehao Lin,Qianfeng Shen,Xixuan Hao,Shaobo Cui,Chunyu Li,Kai Chen,Bo Tang,Zhenjun Wang,Jin Yan,Zhiyu Li,Feiyu Xiong

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：Large language models, structured decision pipelines, language models increasingly, models increasingly act, Large language

备注： 5 pages, 2 figures, 1 table

点击查看摘要

Abstract:Large language models increasingly act as controllers in structured decision pipelines, yet their decisions are still executed by autoregressive text decoding. Hierarchical RAG is one such setting: at each frontier of a document tree, an LLM commits to $b$ of $k$ sections under an input-dependent action grammar, executed as either failure-prone free-form JSON or reliable but strictly serial grammar-constrained generation. We show that this serialization is unnecessary for bounded-horizon control: the reachable future forms a shallow action-prefix tree, which we compile --- one root prefill plus one tree-causal probe evaluate every prefix-conditioned action distribution with serial decoding's tokens, positions, and causal ancestry. A prefix-state lemma makes compiled control policy-exact in exact arithmetic: the same policy with a two-forward critical path and zero output tokens. One further probe pass certifies the exact order-marginalized MAP set. Across four document-disjoint splits and two scales on the primary MetaX device, compiled control matches the serial policy on $84$--$89\%$ of questions --- every instrumented divergence a floating-point near-tie --- and cuts control latency by $35$--$47\%$ versus token-wise serial decoding and $6$--$7\%$ versus an idealized chunked engine; an H800 repetition preserves the ordering.

14. 【2610.30612】he Fusion Tax: A Diagnostic Analysis of When Hybrid Retrieval Hurts

链接：https://arxiv.org/abs/2610.30612

作者：Aaditya Chauhan,Arun Agarwal

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：software documentation surveyed, sparse lexical retriever, surveyed in September, Hybrid retrieval, reciprocal rank fusion

备注：

点击查看摘要

Abstract:Hybrid retrieval, which fuses a sparse lexical retriever with a dense neural one, is widely recommended in the software documentation surveyed in September 2026, usually with reciprocal rank fusion (RRF), on the strength of aggregate gains. We ask what fusion costs on individual queries, treating "do not fuse" as a first-class outcome, in the setting in which hybrid retrieval is deployed: a standard Anserini BM25, five dense encoders spanning 22M-596M parameters and three model generations, a learned-sparse (SPLADE) alternative, and a cross-encoder second stage, on seven BEIR datasets and three fusion functions. Even the best method, dense-weighted score interpolation, ranks relevant documents below the better of its two components on 13-48% of queries and below the deployable dense-only retriever on 8-21% (14-48% and 11-25% at a weight selected under leave-one-corpus-out validation), while beating dense-only in aggregate on every corpus with the primary encoder; the downside is significant under loss-averse risk-sensitive evaluation on six of the seven corpora. We call this loss the fusion tax. It is mostly a ranking effect that preserves recall in aggregate, it is most likely on the queries that only one retriever covers, and it persists across the encoder ladder and the SPLADE substitution. RRF carries the higher tax wherever the dense retriever is clearly stronger and only beats dense-only where the two components are balanced. Fusion failure is weakly predictable within a corpus but transfers unreliably across corpora, because the features that predict it change sign with the sparse-dense balance. A cross-encoder recovers part of the tax only where it is itself reliable. We distill these findings into guidance that keys the fusion decision to the measured sparse-dense balance of the target corpus.

15. 【2610.30611】Better Reasoning, Not Just Bigger Models: A Structure-Grounded Framework for Efficient and Reliable Inference

链接：https://arxiv.org/abs/2610.30611

作者：Amirhossein Aghaei,Liangyan Li,Shiyi Yang,Shaohua Wang,Yan Wang

类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：improved linguistic fluency, substantially improved linguistic, Scaling large language, reliable autonomous agents, autonomous agents require

备注：

点击查看摘要

Abstract:Scaling large language models has substantially improved linguistic fluency, yet reliable autonomous agents require more than fluent generation. In multi-turn inference, current agentic systems often produce semantically plausible but structurally ungrounded reasoning, especially under incomplete observations. We propose Structure-Grounded Uncertainty Reduction (SGUR), a training-free framework that complements token-level generation with active uncertainty reduction over structured hypothesis spaces. SGUR represents incomplete observations as a query graph and aligns them with candidate hypothesis graphs through a prior-weighted partial graph matching mechanism, where database-derived empirical priors assign greater importance to decision-relevant relations rather than treating all graph edges uniformly. The resulting inference state is iteratively refined by an active information-gain strategy that selects the next most informative node to query, systematically pruning the candidate space. We instantiate SGUR on a challenging PrimeKG-derived sequential medical diagnosis benchmark, demonstrating that structural grounding can partially substitute for model scale: starting from only two observed symptoms, SGUR achieves 92.5% Hit@3, outperforming the strongest Graph-RAG baseline by 9.4 percentage points while using approximately 5x fewer tokens. Notably, SGUR enables smaller backbone models to match or exceed the performance of models up to 10x larger, suggesting that structural grounding provides a more robust and efficient paradigm for scaling agent performance than relying exclusively on increasing model size.

16. 【2610.30544】Journal Basket: Supporting Cross-Disciplinary Literature Searching and Methodological Transparency

链接：https://arxiv.org/abs/2610.30544

作者：Michael Cahalane

类目：Digital Libraries (cs.DL); Information Retrieval (cs.IR)

关键词：relevant scholarly publications, identify relevant scholarly, Business students beginning, journal, Business Deans Council

备注： 18 pages, 2 Figures, 1 Table

点击查看摘要

Abstract:Business students beginning a research project must learn how to identify relevant scholarly publications, distinguish disciplinary sources, construct database searches, and report the decisions behind their literature reviews. These tasks can be difficult because journal classification systems and bibliographic databases organize scholarly information differently. This paper introduces Journal Basket, a browser-based tool developed to help business students conduct journal-bounded literature searches and currently available in beta. Journal Basket enables users to construct journal collections from the Australian Business Deans Council (ABDC) Journal Quality List, choose from 42 business discipline presets, entire ABDC fields or the Financial Times FT50 list, apply journal rating thresholds, and generate search expressions for Scopus, Web of Science and Business Source. Users can also inspect and modify journal collections, download journal inventories, and generate methodological descriptions and deterministic identifiers for journal selections. Companion learning resources use explanations, examples and interactive activities to teach review methods, database choice, referencing and the use of contemporary AI tools. Drawing on the journal-basket concept used by this http URL, I describe the educational motivation, design rationale, technical architecture, and practical workflow of Journal Basket. I distinguish reproducing a journal collection from reproducing an entire database search and discuss the limitations of journal rankings as search boundaries. The paper addresses scholarly information retrieval through a workflow for defining journal boundaries, generating database-specific queries and documenting search decisions.

17. 【2610.30425】Getting a GRIP on Graph-Based Search for Learned Sparse Retrieval

链接：https://arxiv.org/abs/2610.30425

作者：Vihan Lakshman,Franco Maria Nardini,Cosimo Rulli,Rossano Venturini

类目：Information Retrieval (cs.IR); Databases (cs.DB)

关键词：recently gained traction, LSR, Learned sparse, recently gained, gained traction

备注： 8 pages

点击查看摘要

Abstract:Learned sparse retrieval (LSR) has recently gained traction in the information retrieval community for the ability to combine the generalization capabilities of neural representations with the interpretability of keyword-based search. A number of recent works have demonstrated that inverted indexes, when appropriately modified for learned sparse embeddings, achieve state-of-the-art recall-latency tradeoffs for LSR, often outperforming graph-based indexes by substantial margins in latency at a fixed recall target. As a result, the community has generally concluded that graph-based approximate nearest neighbor (ANN) search is inferior to inverted indexes for LSR. This paper challenges this conventional wisdom. Our key insight is that, while applying standard graph-based ANN indexes out-of-the-box to sparse vectors leads to uncompetitive performance, we can overcome these shortcomings by infusing the strengths of inverted indexes into graph-based search. In particular, we introduce three techniques to accelerate graph-based LSR: (i) term-based entry point seeding, (ii) approximate routing via sparse sketching, and (iii) sparse partition-based graph construction. We combine these techniques into a new graph-based ANN system for LSR we call GRIP. On the MS MARCO v2 benchmark (138M passages) with SPLADE embeddings, GRIP achieves a $2.5\times$ latency improvement over Seismic, a state-of-the-art inverted index tailored for LSR, at 95\% recall@10. Ultimately, our results call into question the default choice of inverted indexes for deploying learned sparse retrieval.

18. 【2610.30423】When Agentic Retrieval Fails Silently: Framework and Production Evidence from a Creative AI Assistant

链接：https://arxiv.org/abs/2610.30423

作者：Yan (Fergie)Liang,Anuj Agarwal,Aditya Reddy Cheruku

类目：Information Retrieval (cs.IR)

关键词：behavioral NDCG assume, behavioral NDCG, NDCG assume, CTR, MRR

备注： 5 pages, 1 figure. Submitted to CHIIR 2027 Industry Track

点击查看摘要

Abstract:CTR, MRR, and behavioral NDCG assume the user sees ranked results and acts on them. In an agentic assistant, a generation layer consumes retrieval output first, and that assumption breaks in three ways. The agent reads the results before the user does (who). The user's action can come several turns or sessions after retrieval (when). Outcomes blend retrieved content with the model's own knowledge (what caused it). We call this the attribution gap. We propose Layered Agentic Retrieval Assessment (LARA), which measures retrieval quality, engagement and outcome, and product success as three independent layers joined by a four-field lineage schema that requires no new modeling. We examine the motivation on Adobe Express, where one retrieval infrastructure serves a gallery search surface and an agentic assistant at roughly one-eighth its session volume for the same user population. Chat users reformulate more than gallery users (44.4% vs. 33.1%) because chat reformulation refines generated output. LARA restores attribution for the retrieval.

19. 【2610.30365】Data-Void Exploits in Web-Searching LLMs

链接：https://arxiv.org/abs/2610.30365

作者：Michele Guerra,Wuyeh Jobe,Sanjana Nambiar,Christina Pöpper,Azza Abouzied

类目：Cryptography and Security (cs.CR); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)

关键词：seek online information, Large Language Models, Web-searching Large Language, read synthesized answers, users seek online

备注： Extended version of the paper to appear in the Network and Distributed System Security (NDSS) Symposium 2027. 23 pages

点击查看摘要

Abstract:Web-searching Large Language Models (LLMs) have changed how users seek online information: instead of sifting through ranked lists of links, users read synthesized answers. This shift creates a new LLM vulnerability: a data-void exploit. Disinformers publish their narratives in search spaces where relevant and reliable content is scarce, i.e. data voids, then rely on the LLM's web-search to retrieve and then use, cite, or list those pages in its responses to data-void seeking prompts. Unlike classical search, where users see ranking cues and competing results, LLMs can obscure when an answer relies on sparse, unverified, or adversarial sources. We study this threat by varying the user's prompt tone - skeptical, excited, or neutral - and LLM choice - ChatGPT, Gemini, or Sonar Pro - as well as three attacker controls. The attacker can use one of five known strategies to construct and fill a data void with their narrative, host their content at varying levels of visibility from well-established, indexed domains to less established ones, and include generative-optimization engine features thought to boost citing by web-searching LLMs. We find that data-void exploits can succeed with only a single attacker controlled page. Across all conditions, attacker-content appears in LLM responses 31% of the time. User controls offer limited protection: while skeptical prompts slightly reduce success and slightly increase flagging or warnings in LLM responses, we find no evidence of large effects of prompt tone or model choice on success rates, although smaller effects cannot be ruled out. Overall, our results establish data voids as a practical inference-time attack surface for manipulating web-searching LLMs through strategically placed web content and highlight the urgent need for defenses against such exploits.

20. 【2610.30359】FAIRGate: Agentic Runtime Policy Selection and Verified Repair for Fairer Recommendation Delivery

链接：https://arxiv.org/abs/2610.30359

作者：Navkar Jain,Enock Ayiku,Kenneth Fletcher

类目：Information Retrieval (cs.IR)

关键词：Fairness-aware recommender systems, Fairness-aware recommender, fixed re-ranking rule, rule after scoring, recommender systems

备注： Accepted at the 1st IEEE International Conference on Responsible Artificial Intelligence (IRAI 2026), Melbourne, Australia. 6 pages, 2 figures, 5 tables

点击查看摘要

Abstract:Fairness-aware recommender systems often encode one fairness objective during training or apply a fixed re-ranking rule after scoring. In deployment, however, the appropriate fairness action can vary across requests because the candidate pool, item metadata, exposure debt, user preference history, and utility budget all change at runtime. We propose FAIRGate, a model-agnostic delivery controller that places an agentic policy-selection layer between a base ranker and the final top-K list. The agent does not define fairness objectives from scratch. It chooses from a predefined policy library covering long-tail exposure, item-group exposure balance, concentration control, calibration protection, and abstention. A deterministic executor then applies the selected policy through constrained repair, and a validator accepts the result only when relevance, feasibility, metadata, calibration, and audit constraints are satisfied. The final language-model component receives only the verified audit trace and produces evidence-linked narration after the ranking decision is fixed. This design gives the agent runtime responsibility while keeping fairness enforcement measurable, bounded, and replayable.

21. 【2610.30193】Protection Is Not One Event: A Survey of RAG Protection Research by Measured Endpoint

链接：https://arxiv.org/abs/2610.30193

作者：Peiyang Liu,Xi Wang,Di Liang,Youru Li,Zhi Cai,Wei Ye

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：Retrieval-augmented generation, including content leakage, risks including content, systems face security, copyright risks including

备注： ACL Rolling Review (August 2026 cycle) recommends that the paper be accepted at an *ACL conference

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) systems face security, privacy, and copyright risks including content leakage, source reconstruction, unauthorized access, data poisoning, and prompt injection. Yet RAG protection studies use incompatible evaluation metrics, datasets, and threat models. We present a systematic survey and human-coded evidence map of 118 full-text-confirmed RAG defense papers, organized by measured endpoint rather than claimed goal or defense mechanism. Our seven-family taxonomy covers content disclosure, formal privacy proxies, access control and suppression, corpus-use detection, and pipeline integrity and attribution. Thirty-two annotators double-coded the papers kappa=0.867. The survey identifies three gaps. First, retrieval reranking and context rewriting each span five or six endpoint families, so mechanisms do not identify protection outcomes. Second, only 17.8% of studies use content disclosure or reconstruction as their primary endpoint; under the frozen copyright/ownership relation label, 73.3% of records have corpus-use detection as their primary endpoint, and none have an emitted-expression primary endpoint. Third, most evaluations use general-purpose question-answering datasets and non-adaptive attacks rather than sensitive data and adaptive, multi-turn extraction. Our controlled RAG testbed shows that preventing verbatim copying does not prevent private-fact recovery: a normalized 8-gram guard reduces 20-token copying to 0.0%, but a three-query adaptive attacker recovers 48.3% of hidden facts on Qwen3-8B. We release the taxonomy, dataset, coding protocols, and testbed to enable comparable, claim-aligned RAG security evaluation.

22. 【2610.30181】Deep Search in Real-World Web Environments

链接：https://arxiv.org/abs/2610.30181

作者：Xiaomin Yu,Hongliang Chen,Zhe Huang,Shilin Yan,Shao-Rong Su,Xuqiao Ma,Feiyang Wang,Jiayu Chen,Jiwei Fang,Yu Yan,Yini Huang,Chen Chen,Ruoxi Cheng,Yuzhi He,Yuhui Zhang,Xiaoxing Hu,Chen Liu,Jianbo Lin,Yijiang Li,Xiaobin Hu,Menglong Li,Zhuoran Lu,Weishi Wang,Zhongqi Yue,Chengwei Qin

类目：Information Retrieval (cs.IR); Multimedia (cs.MM); Software Engineering (cs.SE)

关键词：remains insufficiently evaluated, real-world open Web, open Web environments, open Web, Web environments remains

备注：

点击查看摘要

Abstract:Despite substantial progress in Deep Search agents, their ability to conduct end-to-end research in real-world open Web environments remains insufficiently evaluated. Unlike static retrieval settings, information on the real-world Web is distributed across diverse sources, modalities, and heterogeneous formats, often involving complex interaction mechanisms that require agents to autonomously search for, access, and integrate relevant evidence during execution. To address this gap, we introduce the OpenDS task, designed to evaluate agents' ability to perform multi-step deep search in the live, open Web. This task requires agents to autonomously explore the real Web, discover and connect relevant evidence from multiple independent sources through Web search, browser interaction, and evidence processing, and ultimately determine a unique factual answer. Building on this task formulation, we construct OpenDS-World, a benchmark comprising 200 challenging tasks spanning diverse information modalities, heterogeneous file formats, and interactive access requirements, with independent human verification to ensure evidence validity and answer uniqueness. We evaluate 12 frontier models under a unified tool environment and execution protocol. The best-performing model achieves 39.0% accuracy, while human evaluation across 1,000 independent attempts yields 21.1% accuracy. Further analyses of tool usage, search cost, termination behavior, and failure recovery reveal substantial differences in research strategies across models, as well as persistent challenges in tool coordination and long-horizon search management. OpenDS-World provides a unified evaluation platform for systematically assessing and advancing agents' autonomous deep search capabilities in real-world open Web environments.

23. 【2610.30180】QProtFuse: Query-Guided Layer Fusion for Retrieval-Augmented Protein Function Prediction

链接：https://arxiv.org/abs/2610.30180

作者：Mianzhi Pan,Peishuo Liu,Yawen Ouyang,Botian Wang,Yiming Rong,Hao Zhou,Jianbing Zhang

类目：Information Retrieval (cs.IR); Quantitative Methods (q-bio.QM)

关键词：amino acid sequences, Predicting protein functions, understanding biological processes, Predicting protein, amino acid

备注：

点击查看摘要

Abstract:Predicting protein functions from amino acid sequences is essential to understanding biological processes. Large language models (LLMs) offer flexible function descriptions to natural-language queries, yet their limited protein understanding motivates retrieval-augmented generation (RAG). Existing protein RAG methods primarily expand external retrieval signals while overlooking the rich knowledge encoded within a single protein language model (PLM). We show that retrieval performance varies across PLM layers and biological tasks, making conventional final-layer selection suboptimal. To this end, we propose QProtFuse, which uses queries to adaptively fuse multi-layer protein features and jointly learns protein and annotation retrieval through intra-modal and cross-modal contrastive objectives. On Prot-Inst-OOD, QProtFuse achieves the best protein and annotation retrieval scores, reaching 16.4\% Recall@1 with annotation reranking. These gains improve downstream RAG-based function descriptions, yielding the highest LLM-as-a-judge scores for both Qwen3-8B (6.22/10) and DeepSeek-V4-Pro (6.68/10). Ablations and weight analyses demonstrate the value of query-guided fusion and complementary training objectives for exploiting a PLM's internal knowledge.

24. 【2610.30178】Association between Player Perception and AI Disclosure on Steam: An Exploratory Study

链接：https://arxiv.org/abs/2610.30178

作者：Fabian Wiesinger,Johanna Pirker,Denis Helic

类目：Information Retrieval (cs.IR); Human-Computer Interaction (cs.HC)

关键词：central role, player reactions play, development is growing, growing rapidly, subject of intense

备注：

点击查看摘要

Abstract:The use of generative AI in game development is growing rapidly and is the subject of intense debate in which player reactions play a central role. This paper contributes to this discussion by analyzing Steam reviews to examine whether games with AI disclosure are associated with different review patterns. Using a dataset across multiple disclosure groups, we apply linguistic analysis including keyword-based, word frequency, and characteristic word analysis to investigate the AI-related discussion on Steam. Our results show that AI-disclosed games are associated with higher levels of AI-related criticism in negative reviews. Our findings provide a first exploratory step towards understanding how players perceive AI disclosure.

25. 【2610.30177】FlexVDR: Learning to Allocate Matryoshka Representation Budgets for Visual Document Retrieval

链接：https://arxiv.org/abs/2610.30177

作者：Haowen Xiang,Yibo Yan,Xin Zou,Shuliang Liu,Yi Cao,Mingdong Ou,Xuming Hu

类目：Information Retrieval (cs.IR)

关键词：Visual document retrieval, capture fine-grained evidence, Visual document, rich multi-vector representations, document retrieval relies

备注： 21 pages, 5 figures

点击查看摘要

Abstract:Visual document retrieval relies on rich multi-vector representations to capture fine-grained evidence in document pages, but encoding and matching these representations can be computationally expensive. Existing compression and elastic representation methods expose smaller configurations, yet making multiple budgets available does not determine which configuration a query should use. The allocation decision must estimate the retrieval value of alternative representations before incurring their full computation, while accommodating different resource preferences. We introduce FlexVDR, a framework for query-adaptive budget allocation within a single retriever. We construct a joint family of routes over encoder depth, embedding width, and token count. Retrieval supervision and distillation train the compact routes, while a native bypass preserves the full-budget reference. A Budget Allocator predicts route-specific retrieval utility from early query features and combines these predictions with a configurable resource preference to select a route. Experiments across five backbones on ViDoRe V1, V2, and V3 public show that FlexVDR retains much of the native retrieval quality while selecting compact routes for individual queries. A configurable resource preference allows the same retriever to adjust its computation without retraining or switching models.

26. 【2610.30175】FormBench: A Benchmark for Fine-Grained Retrieval in Formulation Patents

链接：https://arxiv.org/abs/2610.30175

作者：Vineeth Venugopal,Elsa Olivetti,Jonathan Welch

类目：Information Retrieval (cs.IR)

关键词：retrieve precise chemical, precise chemical information, technical documents, platform for testing, testing the ability

备注： 28 pages, 9 figures. Dataset: [this https URL](https://huggingface.co/datasets/vinven7/FormBench) ; code: [this https URL](https://github.com/olivettigroup/formbench)

点击查看摘要

Abstract:We introduce FormBench, a platform for testing the ability of models to retrieve precise chemical information from technical documents. FormBench contains 55,352 queries and two retrieval corpus variants each with ~1M passages: FormBench-Random (C0), with randomly sampled distractors, and FormBench-Structured (C1), with structurally proximate distractors. Each query is paired with an anchor passage, a hard negative, and a soft negative - derived from a materials ontology through entity overlap scoring, providing a deeper graded signal on a model's discriminatory power. We evaluate 10 model configurations spanning commercial API encoders (OpenAI, Voyage), open-source encoders (Nomic, GTE-large, Qwen3-Embed), and their task-adaptive fine-tuned (TAPT) variants. We find: (1) commercial APIs score very poorly across all configurations (OpenAI-3-large: 0.009 on C1, 0.213 on C0); (2) TAPT on FormBench triplets lifts Qwen3-Embed to 0.4085 on C1, 0.4835 on C0; (3) BM25 remains competitive (0.375 on C1, 0.467 on C0), exceeded only by TAPT-Qwen3; (4) corpus size has a significant impact on retrieval behavior, as demonstrated through a corpus-size ablation; (5) the API failure traces to within-domain geometric collapse; (6) APIs outperform even the TAPT variants on classification and clustering tasks. FormBench is released in BEIR-compatible format at this http URL under CC-BY-4.0.

27. 【2610.30167】IRAH: Hierarchical Agentic Tree Search for Retrieval Pipeline Optimization

链接：https://arxiv.org/abs/2610.30167

作者：Maria Ana Cardei,Aniket Singh,Amir Moghadam,Srividhya Baikadi,Rashmi Shetty

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Optimizing Information Retrieval, requires jointly selecting, Information Retrieval Agentic, Optimizing Information, jointly selecting structural

备注： Under review

点击查看摘要

Abstract:Optimizing Information Retrieval (IR) pipelines for Retrieval-Augmented Generation (RAG) requires jointly selecting structural components and numerical hyperparameters under limited evaluation budgets. We introduce the Information Retrieval Agentic Harness (IRAH), which combines Language Agent Tree Search for IR (LATS-IR) with offline meta-learned initialization. LATS-IR performs UCT-guided hierarchical search, first exploring macro-structural pipeline choices and then refining numerical parameters, with natural-language reflections to guide subsequent mutations and provide inspectable search traces. We evaluate IRAH on three in-distribution benchmarks and one out of-distribution benchmark to assess generalization under distribution shift. Under the same meta-learned initialization, LATS-IR outperforms TPE on two of three in-distribution benchmarks, with gains of up to 6.4%, and remains competitive on the out-of-distribution benchmark. Across all four benchmarks, warm-started IRAH achieves the highest average held-out nDCG@10 (0.4816) and improves over its cold-start counterpart. These results establish IRAH as a competitive approach to retrieval pipeline optimization under constrained evaluation budgets.

计算机视觉

1. 【2610.31671】A Unified Framework for Image-to-3D Part Generation via Variable Granularity

链接：https://arxiv.org/abs/2610.31671

作者：Qiwen Gu,Xin Zhou,Xiwu Chen,Zhongyang Zhu,Zhuo Zhang,Junqiao Zhao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：digital asset creation, existing methods lack, accommodate diverse user, diverse user workflows, user workflows requiring

备注： Accepted at NeurIPS 2026. Code: [this https URL](https://github.com/Gucci233/FlexPart)

点击查看摘要

Abstract:Controllable 3D part generation is pivotal for digital asset creation, yet existing methods lack the flexibility to accommodate diverse user workflows requiring varying levels of control. In this paper, we introduce FlexPart, a unified image-to-3D part generation framework that supports variable-granularity geometric conditions within a single model. By seamlessly integrating heterogeneous inputs, ranging from sparse points to dense bounding boxes and masks, via gated adaptive modulation, FlexPart unlocks a powerful cross-modal synergy. We also propose an asymmetric geometric guidance mechanism that leverages strong spatial priors to align representations across granularities, improving geometric consistency and facilitating inter-task synergy. Under mask conditioning on PartVerseXL, FlexPart reduces Part CD by 16.6% relative to TripoSG + SAM3D and by 10.5% relative to OmniPart, while maintaining competitive whole-mesh quality. The code can be found at this https URL

2. 【2610.31670】Sensorimotor Alignment: A Platonic Proxy for Embodied Policy Success

链接：https://arxiv.org/abs/2610.31670

作者：Yunfei Xie,Howard H. Qian,Shiyi Lan,Kaiyu Hang,Chen Wei

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)

关键词：Robotic foundation models, Robotic foundation, Platonic Representation Hypothesis, motivates cheap offline, cheap offline proxies

备注： 28 pages. Project page and code available at [this https URL](https://yunfeixie233.github.io/s2/)

点击查看摘要

Abstract:Robotic foundation models are typically evaluated through costly closed-loop rollouts, which motivates cheap offline proxies for model capability. The Platonic Representation Hypothesis (PRH) suggests that as representations improve, different modalities such as vision and language converge toward a shared statistical model of reality. We ask whether motion trajectories form another such modality: as embodied models become more capable, should their sensory representations converge toward the structure of physical motion? To examine this, we propose Sensorimotor Alignment ($S^2$), a training-free offline metric that measures how well a model's sensory representation aligns with the geometry of physical motion. We find that $S^2$ correlates positively with downstream robot task success across embodied model families, making it a low-cost offline proxy for prioritizing models before closed-loop evaluation. $S^2$ can also identify promising vision-language model (VLM) backbones even before costly fine-tuning into vision-language-action models (VLAs). Beyond this correlation, $S^2$ offers representation-level explanations for phenomena observed in VLAs and world action models (WAMs). With $S^2$, we extend PRH to embodied models and make sensorimotor alignment empirically measurable, offering insight into why an embodied model succeeds beyond its closed-loop success rate.

3. 【2610.31668】Reading, Writing, Sharing, and Interacting with the World through Video

链接：https://arxiv.org/abs/2610.31668

作者：Shengqiong Wu,Meng Luo,Bobo Li,Ziwei Liu,Shuicheng Yan,Ming-Hsuan Yang,Philip Torr,Hao Fei

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：generating visual sequences, Video foundation models, advanced rapidly, generating visual, seek to capture

备注： 102 pages, 17 figures, 19 tables. Project page: [this https URL](https://vid-gen.github.io/video-world-model-survey)

点击查看摘要

Abstract:Video foundation models have advanced rapidly in understanding and generating visual sequences, while video world models seek to capture the underlying dynamics of the world they depict. Despite their different objectives, both concern the relationship between video observations and an evolving world. This survey adopts world modeling as a unifying lens for examining these developments. Viewing an observed video as a partial, lossy, and temporally ordered projection of a latent temporal world, we organize the literature around four complementary operations: reading infers world properties from observed video; writing synthesizes video from specified or learned world conditions; sharing integrates understanding and generation through common modeling mechanisms; and interacting predicts and updates world states under actions and evolving observations. This perspective distinguishes temporal coherence in observed or generated sequences from consistency in the underlying world state. Across tasks, representations, models, datasets, and benchmarks, we trace a shift in emphasis from clip-level recognition and perceptual fidelity toward persistent state, controllable evolution, physical and causal validity, and evaluation grounded in interaction and downstream decisions, and we distill the open challenges that follow.

4. 【2610.31659】SpectralCanary: Embarrassingly Simple Low-Frequency Traces for T2I Dataset-Use Auditing

链接：https://arxiv.org/abs/2610.31659

作者：Sy-Tuyen Ho,Anirudh Satheesh,Soham Chawathe,Huy Nghiem,Yongkyun Lee,Andrew Adams Schoen,Furong Huang

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：reproducing training images, characteristics without reproducing, reproducing training, Proactive dataset-use auditing, dataset-use auditing plants

备注： NeurIPS 2026 Workshop on Attributing Model Behavior at Scale

点击查看摘要

Abstract:Auditing whether a text-to-image (T2I) model was fine-tuned on a particular image collection is difficult: a model can absorb collection-level visual characteristics without reproducing training images. Proactive dataset-use auditing plants a shared signal in a dataset before release, then later checks whether that signal appears in a suspect model's generated outputs. Existing approaches often trade off verifiability, fidelity, robustness, and deployability. We introduce $\textbf{SpectralCanary}$, which uses a smooth low-pass mask to blend a fixed canary image into every collection image while leaving captions unchanged and requiring neither auxiliary generation nor per-image optimization. A lightweight verifier detects the transferred signal in suspect-model outputs. Across eight tests on the Pokemon dataset and three realistic data transformations, spanning two architectures families, SpectralCanary achieves the highest average per-generation TPR@$1\%$ FPR ($91.1\%$) and fixed threshold model-level accuracy using 30 generations ($94.8\%$) among the evaluated methods. Across five datasets spanning artistic, medical, satellite, and fashion domains with SD3.5, SpectralCanary averages $92.4\%$ per-generation TPR@$1\%$ FPR while preserving the released images (SSIM $0.989$, LPIPS $0.022$) with a near-zero mean change FID (mean $\Delta$FID $0.05$) across datasets. Matched-energy ablations on Pokemon and ROCOv2 support our design choice, low-frequency placement transfers more reliably compared to mid/high-frequency placement. Under the evaluated adaptive attacks, the most effective removal requires aggressive modification and incurs more than $25$ $\Delta$FID points. These results identify low-frequency visual signals as effective carriers for collection-level T2I audit traces.

5. 【2610.31651】BrickWright: Agentic Creation of Physically Feasible Brick Builds

链接：https://arxiv.org/abs/2610.31651

作者：Ava Pun,Kevin Dai,Sally Chen,Maxwell Jones,Ruixuan Liu,Kangle Deng,Changliu Liu,Maneesh Agrawala,Deva Ramanan,Jun-Yan Zhu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Frontier coding agents, Frontier coding, increasingly adept, Frontier, agents

备注：

点击查看摘要

Abstract:Frontier coding agents are becoming increasingly adept at 3D modeling. Yet, they still face challenges when building objects meant to be assembled in the physical world, often creating invalid assemblies with floating, colliding, or disconnected parts. We argue that providing agents with tools for assembling builds and verifying their physical feasibility is sufficient for them to produce physically valid assemblies that still adhere to input prompts. Focusing on the domain of LEGO brick builds, we present BrickWright, a framework for generating physically feasible brick builds from text or image prompts using pre-trained agents, where a build is physically feasible if it uses only real parts, has no colliding or floating parts, and forms a connected structure if possible. BrickWright guides agents to create builds by writing code with BrickLayer, a Python toolkit with two main components: an ergonomic brick assembly API that halves inference cost compared to working in raw LDraw, and a validator that provides feedback on physical feasibility. Whereas baseline agents achieve physical validity rates ranging from only 9% (GPT-6 Luna) to 69% (GPT-6 Astra), BrickWright-guided agents achieve 100% validity on a sample of 512 prompts, while improving prompt adherence for lightweight agents and maintaining it for stronger agents. Additionally, they outperform specialized models on the text-to-brick task. Code is available on our project page: this https URL

6. 【2610.31649】Gate3DGen: A Pre-processing Model that Selectively Purifies Real-World Images for 3D Generation

链接：https://arxiv.org/abs/2610.31649

作者：Xiaolin Li,Zihao Huang,Fanpeng Meng,Chen Yang,Guanjun Wu,Kai Zhang,Jiemin Fang,Qi Tian

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：achieved high fidelity, uneven illumination, achieved high, degrades sharply, sharply on real-world

备注： Project page: [this https URL](https://supra-3d.github.io/gate3dgen)

点击查看摘要

Abstract:Single-image 3D generation has achieved high fidelity on curated benchmarks, yet degrades sharply on real-world images with uneven illumination, blur, and occlusions. Purifying such inputs requires deciding when to intervene and preserving the visual cues needed for 3D generation, while leaving clean inputs unchanged. We introduce Gate3DGen, a selective pre-processing model that gates image inputs to existing 3D generators without retraining them. A degradation-aware router bypasses inputs classified as clean and extracts features to guide purification of the remaining inputs. Conditioned on these features, a 3D-oriented one-step purifier purifies degraded inputs with spatial losses that encourage preservation of object identity, contours, and textural cues. To provide paired supervision, we construct a synthetic data engine that renders clean views of 3D assets and synthesises composite degradations. On the synthetic benchmark, the purifier improves image fidelity and downstream 3D geometry in only 2.3s on average, reducing TRELLIS.2 mesh distance by 61.5% relative to degraded inputs. VLM evaluation and human preferences on real photographs further support identity preservation and degradation correction. More demos and code are available at this https URL.

7. 【2610.31645】OmniRay: Camera-Agnostic Monocular 3D Reconstruction with Composite Ray Fields

链接：https://arxiv.org/abs/2610.31645

作者：Namitha Guruprasad,Abhay Yadav,Cheng Peng,Rama Chellappa,Anand Bhattad

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：wide-angle imagery produced, produce distorted geometry, Monocular models recover, panoramic lenses, assume a pinhole

备注： Project page: [this https URL](https://nam1410.github.io/omniray/)

点击查看摘要

Abstract:Monocular models recover 3D geometry from a single image in one pass, but most assume a pinhole camera and produce distorted geometry on the wide-angle imagery produced by fisheye and panoramic lenses. Camera-aware models remove this assumption by predicting a per-pixel ray field. However, they represent different camera geometries using a single fixed basis to capture both the overall camera projection and its finer variations. We argue that camera geometry can be viewed as having a hierarchy of complexity for representing rays. We present OmniRay, a feed-forward model whose Ray Module is composed of three components: a monotone radial base that captures radially symmetric structure, a spherical-harmonic residual for smooth deviations from it, and a free-form residual for remaining local variation. These components are composed as successive rotations on the sphere, allowing the representation to accommodate diverse camera geometries. Given a single image, OmniRay predicts a ray direction and an up-to-scale radial distance for every pixel, from which a 3D point cloud is recovered without needing camera information at inference time. Extensive experiments across different camera configurations demonstrate that OmniRay establishes a new state-of-the-art in camera-agnostic monocular 3D reconstruction.

8. 【2610.31644】GigaBench: Benchmarking Learnable Representations for Gigapixel Image Compression and Super-Resolution

链接：https://arxiv.org/abs/2610.31644

作者：Matteo Fusconi,Alex Costanzino,Pierluigi Zama Ramirez,Luigi Di Stefano

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Learnable Representations, fit parametric families, kinds of signals, fit parametric, parametric families

备注： Project page at [this https URL](https://matteofusconi.github.io/GigaBench) Accepted at WACV2027

点击查看摘要

Abstract:Learnable Representations (LRs) can fit parametric families of functions to diverse kinds of signals. These emergent neural-native data formats are gathering interest in the scientific community due to their compactness, resolution-agnosticism and amenability to direct neural processing. On the other hand, gigapixel images are becoming increasingly widespread across a variety of scientific, cultural, and industrial domains. In this paper, we present GigaBench, the first benchmark and experimental evaluation focused on deploying LRs with gigapixel imagery. GigaBench includes images collected, acquired, and synthetically rendered across diverse domains, and addresses image compression and super-resolution. We adapt a representative set of LRs, spanning Implicit, Hybrid, and Explicit methods, so as to operate reliably at the gigapixel scale on consumer hardware. Through systematic evaluation across reconstruction quality, model size, compression and inference times, we identify consistent trends across methods and suggest actionable guidance for future investigation.

9. 【2610.31641】UniVOE: A Removal-Driven Framework for Interaction-Aware Universal Video Object Editing

链接：https://arxiv.org/abs/2610.31641

作者：Shuzhou Yang,Lanqing Guo,Lingen Li,Weiqi Li,Zhao Zhong,Liefeng Bo,Jian Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：reciprocal editing operations, Video object removal, object removal, reciprocal editing, editing operations

备注：

点击查看摘要

Abstract:Video object removal and injection are reciprocal editing operations between object-present and object-absent video states, yet they differ substantially in training difficulty. Removal can be effectively bootstrapped from video inpainting and further adapted to erase object-related interaction effects. Injection, however, requires large-scale paired supervision to model object appearance, dynamics, and scene-dependent effects, while perfectly aligned real-world pairs are difficult to collect and synthetic data lacks sufficient realism and diversity. To address this challenge, we present UniVOE, a removal-driven framework for training both video object removal and injection models. We first train an effect-aware remover by transferring video inpainting priors and finetuning on object-present/object-absent pairs. The trained remover converts real object-present videos into object-absent counterparts, creating large-scale paired supervision for injection. An injection model is trained on these pairs in the reverse direction to recover objects together with their dynamics and interaction effects. Moreover, since pixel-level reconstruction alone cannot adequately capture perceptual realism, we introduce a reward-based post-training method that aligns injection results with human preferences using a proprietary reward model. Experiments against strong open-source and commercial systems demonstrate that UniVOE achieves state-of-the-art performance on both object removal and injection, particularly in challenging interaction-effect cases.

10. 【2610.31640】WorldForge V2: Eliciting Camera-Trajectory Alignment in Video Diffusion Models

链接：https://arxiv.org/abs/2610.31640

作者：Chenxi Song,Yanming Yang,Tong Zhao,Ruibo Li,Joey Tianyi Zhou,Chi Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：learned rich, making them promising, Video diffusion models, video re-rendering, camera control

备注：

点击查看摘要

Abstract:Video diffusion models have learned rich 3D/4D priors, making them promising for scene generation and video re-rendering. However, their use in spatial tasks is limited by imprecise camera control, spatial and temporal inconsistencies, and entangled camera motion with scene dynamics. Existing approaches, such as task-specific fine-tuning and post-process warping, often introduce visual artifacts, generalize poorly, or incur high computational costs. We propose WorldForge V2 to achieve accurate camera control while preserving the generative capabilities of pretrained video models. We first develop a training-free guidance framework using warped references to iteratively refine generation along a target camera path. Optical-flow analysis identifies motion-related latent channels for selective guidance, helping separate motion control from appearance. A dual-path strategy further compares guided and unguided predictions to correct artifacts from imperfect references. Together, these components guide viewpoint changes while preserving scene appearance and object motion. To reduce refinement costs, v-cache approximates the correction using the preceding denoising prediction, avoiding an additional model evaluation. We further extend motion localization from latent channels to network blocks and introduce Trajectory LoRA, which concentrates adaptation on blocks most responsive to trajectory guidance. A two-stage training strategy teaches these adapters to denoise the states encountered during guided generation, using limited supervision effectively. This enables reliable camera control with very little training data, with a single training scene already supporting generalization to unseen scenes. Quantitative and qualitative evaluations across multiple datasets show that our method achieves state-of-the-art generation quality and trajectory accuracy in camera-controlled video generation.

11. 【2610.31635】HiP3R: Hierarchical Pose Graphs for Long-Horizon 3D Reconstruction

链接：https://arxiv.org/abs/2610.31635

作者：Zunnan Xu,Shangchen Zhou,Yihang Luo,Chen Change Loy

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Feed-forward models accurately, Feed-forward models, models accurately estimate, geometry from short, models accurately

备注： Technical Report

点击查看摘要

Abstract:Feed-forward models accurately estimate camera motion and 3D geometry from short video windows. However, computational and memory costs prevent direct inference on sequences containing thousands of frames. Long videos must therefore be processed as overlapping chunks. This division produces independent local reconstructions with inconsistent coordinate frames and duplicate estimates of shared cameras. Achieving global consistency requires propagating constraints from adjacent overlaps and distant revisits across the sequence. This requirement naturally motivates pose graph optimization. However, the choice of graph level creates a trade-off. Chunk-level graphs efficiently resolve scale drift and close large loops. Yet, their rigid transformations cannot correct internal errors or conflicting frame predictions. Conversely, frame-level optimization offers local flexibility, but scaling it globally is computationally expensive and can break metric scale. HiP3R resolves this trade-off using a hierarchical pose graph. HiP3R first optimizes a robust chunk-level $\mathrm{Sim}(3)$ graph to establish the global layout and scale. It then holds this layout fixed and estimates one shared $\mathrm{SE}(3)$ camera per frame, turning overlapping window predictions into a single trajectory. Experiments across multiple benchmarks demonstrate the effectiveness of HiP3R in improving camera trajectories and 3D reconstruction. Our method applies to both chunk-based and streaming backends without additional training or fine-tuning. The codes are available at this https URL.

12. 【2610.31623】F2G-Pose: Geometry-Aware Foundation Feature Lifting for Direct RGB-D Category-Level Object Pose Estimation

链接：https://arxiv.org/abs/2610.31623

作者：Jinyu Zhang,Haitao Lin,Jiashu Hou,Xiangyang Xue,Yanwei Fu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：instance-specific CAD models, object pose estimation, paper studies category-level, RGB-D object pose, category-level RGB-D object

备注： Accepted at NeurIPS 2026. 22 pages, including the complete technical appendix

点击查看摘要

Abstract:This paper studies category-level RGB-D object pose estimation, which recovers an object's 3D rotation and translation without instance-specific CAD models or reference views. This task is highly ambiguous due to intra-class variations, symmetries, and partial observations. Current solutions struggle to balance reliability and efficiency: methods based on intermediate structures are prone to error propagation, while diffusion models suffer from high inference latency and complex post-hoc candidate extraction. To address this, we present F2G-Pose, a real-time direct, single-pass framework that predicts category-level pose, metric size, and camera-frame completed shape from a single RGB-D observation in one feed-forward pass. F2G-Pose lifts dense visual foundation features to partial point clouds, encodes local geometry with DGCNN tokenization, and integrates object-level structure with a Mixture-of-Experts Transformer. Joint size prediction and camera-frame shape completion encourage metric consistency through dense geometric supervision. With its task-specific network trained only on pose-annotated synthetic SOPE data and its frozen RADIO backbone externally pretrained, F2G-Pose achieves state-of-the-art accuracy on SOPE and ROPE while running at 28 FPS for pose-only inference, and further demonstrates strong camera-frame geometry on HouseCat6D and real-object transfer on HANDAL. Analyses of latency, robustness, shape completion, and GenPose++ candidate behavior further demonstrate the efficiency and reliability of F2G-Pose, with real-world manipulation experiments demonstrating deployment potential under segmented RGB-D inputs. The project page, code, and pretrained models are made available at this https URL.

13. 【2610.31592】Beyond Best-of-$k$: Prior-Consistent DAPS for Ambiguous Nonlinear Inverse Problems

链接：https://arxiv.org/abs/2610.31592

作者：Merve Kocabas,Benjamin A. Burns,Andreas Geiger,Kent Gauen,Sara Fridovich-Keil

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Diffusion models, solving inverse problems, inverse problems, nonlinear inverse problems, solving inverse

备注：

点击查看摘要

Abstract:Diffusion models have become strong priors for solving inverse problems. However, nonlinear inverse problems such as phase retrieval remain challenging when multiple measurement-consistent solutions are distinguishable only by the prior; we call such measurements ambiguous. Existing diffusion-based samplers rely on local approximations during reconstruction. For an ambiguous measurement, these approximations can allow measurement guidance to favor a measurement-consistent mode that is close to a prior-supported mode but is itself not supported by the prior. Evaluation often masks this type of failure by reporting the best-of-$k$ runs, where the best is selected by comparison to the ground truth. We introduce Prior-Consistent DAPS (PC-DAPS), a variant of Decoupled Annealing Posterior Sampling (DAPS) designed to address this failure case by maintaining multiple candidate solutions within a single sampling run. As annealing noise decreases, PC-DAPS prunes and replaces weaker candidates according to their prior consistency, without any ground-truth access. PC-DAPS reduces the incidence of prior-inconsistent samples and improves sample quality on nonlinear inverse problems while preserving sample quality and diversity on linear inverse problems.

14. 【2610.31566】CellTrack-Bench: Microscopic Cell Tracking Benchmark for Vision-Language Models

链接：https://arxiv.org/abs/2610.31566

作者：Ilan Theodoro,Jordão Bragantini,Loïc A. Royer

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large language models, Large language, shown outstanding performance, shown outstanding, text-first tasks

备注：

点击查看摘要

Abstract:Large language models have shown outstanding performance on text-first tasks such as coding, math, and writing. Recent efforts are shifting models' training to include scientific problems that often live in highly specialized domains beyond text, such as protein structure and biological images. However, in these scenarios, their general-purpose accuracy compared with specialized algorithms remains in question. One such domain is cell tracking, which requires spatiotemporal awareness of cell dynamics. To evaluate this, we created a new benchmark, CellTrack-Bench, which assesses Vision-Language Models' (VLMs) cell-tracking-related performance against specialized trackers. The full benchmark draws from 15 standard cell-tracking datasets across four imaging modalities and comprises 1,537 problems corresponding to 9,041 cell-linking decisions. We selected a hard subset requiring greater reasoning effort by identifying failures shared across distinct algorithmic trackers. With this proposed dataset, we: (i) evaluated different environment harnesses for VLMs; (ii) benchmarked 9 frontier closed-source models and 13 open-weight models; and (iii) provided a detailed analysis of their failure modes. Code, the stored model outputs, and a pipeline that regenerates the benchmark from the source datasets are available at this https URL.

15. 【2610.31565】Squaring-the-Sphere: Distortion-Free and Seamless Panorama Generation via CubeAtlas

链接：https://arxiv.org/abs/2610.31565

作者：Xuhui Zuo,Chenjie Cao,Tengfei Wang,Junta Wu,Yisu Zhang,Chunchao Guo

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：global spherical continuity, requires both local, global spherical, local perspective fidelity, Generating

备注：

点击查看摘要

Abstract:Generating 360-degree panoramas requires both local perspective fidelity and global spherical continuity. Existing representations face a trade-off: equirectangular projection (ERP) enables seamless panorama modeling but suffers from severe distortion and a domain gap to pre-trained image generators, whereas cubemaps preserve perspective geometry but often produce inconsistent faces and visible seams. We present Squaring-the-Sphere, a panoramic image generation framework built on a novel representation CubeAtlas, which unfolds all cubemap faces into a single compact canvas. By arranging orientation-aligned, rotated polar regions alongside the equatorial faces, this representation preserves the perspective geometry of cubemaps while organizing the cross-face relationships required for seamless panorama assembly. It further enables a pretrained diffusion transformer to model the complete panorama jointly in a single pass, without altering the backbone architecture or positional encoding. While CubeAtlas has a token count comparable to ERP, its structured layout makes many dense attention interactions unnecessary. We therefore introduce a layout-aware sparse attention mask that preserves the interactions required for panorama continuity while removing geometrically irrelevant token pairs. As a result, CubeAtlas achieves better quality than ERP modeling with lower attention computation. Furthermore, we introduce a training-free super-resolution technique and a fusion scheme that enhance fine details in distortion-free perspective space before achieving the final ERP panorama. Experiments on various benchmarks demonstrate that our method improves geometric fidelity, cross-view consistency, and high-resolution visual quality over previous methods.

16. 【2610.31538】LACToS: Local Anomaly Detection via Conditional Typicality of Superpixels

链接：https://arxiv.org/abs/2610.31538

作者：Jihoon Hong,Alireza Kheirandish,Rohan Sanda,Sara Fridovich-Keil

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：identifying spatially confined, spatially confined anomalous, task of identifying, identifying spatially, spatially confined

备注：

点击查看摘要

Abstract:Local anomaly detection is the task of identifying spatially confined anomalous or out-of-distribution (OOD) regions within an otherwise in-distribution (ID) image. Most existing methods are designed for a specific context, with a strong focus on industrial defect detection, where they achieve excellent performance on well-established benchmarks. However, we observe that these methods can exhibit significant performance drops in other contexts, especially when the inlier distribution is multimodal. To account for this inlier complexity, we propose LACToS, a principled local OOD detection method based on statistical typicality and made tractable through two innovations: (i) grouping pixels into superpixels and (ii) using a computationally efficient proxy to estimate typicality. We evaluate LACToS across three diverse applications spanning medical imaging, human faces, and X-ray security screening. LACToS performs more robustly than prior methods across these benchmarks. The code is released here: this https URL.

17. 【2610.31523】Diffusion-Based Synthesis of Complete 3D Biparametric Prostate MRI

链接：https://arxiv.org/abs/2610.31523

作者：Claudia Giardina,Montse Pardàs,Verónica Vilaplana

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：representative prostate MRI, Synthetic biparametric MRI, deep learning applications, prostate MRI datasets, biparametric MRI

备注： Presented at the 6th Deep Generative Models Workshop (DGM4MICCAI), MICCAI 2026

点击查看摘要

Abstract:Synthetic biparametric MRI (bpMRI) may help alleviate the limited availability of large and representative prostate MRI datasets for deep learning applications. In this work, we present a conditional 3D diffusion framework for anatomy-conditioned synthesis of complete prostate bpMRI from anatomical masks. The framework supports sequential synthesis, in which T2w and diffusion modalities are generated by separately trained models, and joint synthesis, in which all bpMRI modalities are generated simultaneously within a single model. Five configurations were trained using PI-CAI, FastMRI Prostate, and PROSTATEx datasets to investigate different conditioning schemes, target modalities, and synthesis strategies. Evaluation using distribution-based metrics, paired-image similarity, and qualitative assessment demonstrated the feasibility of both synthesis pathways. Joint synthesis achieved competitive distributional fidelity while generating complete bpMRI, whereas direct synthesis of ADC and computed high-b-value DWI outperformed their derivation from synthetic diffusion-weighted images.

18. 【2610.31505】Evaluation of Uncertainty-Aware Multi-Software Ensembles for Hippocampal Segmentation

链接：https://arxiv.org/abs/2610.31505

作者：Gabriel Oliveira-Stahl,Anna Schroder,James Moggridge,Hamza A. Salhab,Caroline Micallef,Josephine Barnes,M. Jorge Cardoso,Carole H. Sudre,Matthew Grech-Sollars

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：monitoring neurological conditions, tool for diagnosing, diagnosing and monitoring, monitoring neurological, neurological conditions

备注： Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) [this https URL](https://melba-journal.org/2026:030)

点击查看摘要

Abstract:Accurate hippocampal segmentation can be a useful tool for diagnosing and monitoring neurological conditions such as Alzheimer's disease and epilepsy. While numerous automated segmentation methods exist, their clinical adoption remains limited. Reliable uncertainty assessment can enhance trust and facilitate clinical translation. This study evaluates ensembles of five heterogeneous hippocampal segmentation methods - InnerEye, ASHS, FastSurfer, HippoSeg, and FreeSurfer - across two dementia datasets and one epilepsy dataset. The sub-ensemble containing InnerEye, FastSurfer, and HippoSeg emerged as both accurate and efficient, highlighting the feasibility of balancing computational cost and performance. Additionally, ensemble-derived uncertainty quantification with sample variance, mutual information, and predictive entropy is shown to reduce inaccurate segmentations by flagging low-confidence cases, potentially providing a mechanism for automatically escalating ambiguous cases for expert assessment. Lastly, this study explores the downstream clinical utility of ensemble-derived uncertainty, finding a significant correlation with motion artefact severity and a modest contribution to Alzheimer's disease classification.

19. 【2610.31494】AgentVQA: A Unified Benchmark for Agentic Visual Understanding

链接：https://arxiv.org/abs/2610.31494

作者：Advait Gupta,Sachin Konan,Tom Yin,Gabriel Sarch,Zhuang Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：remains poorly understood, contexts remains poorly, poorly understood, agentic contexts remains, Vision-language models

备注： Project page: [this https URL](https://zlab-princeton.github.io/AgentVQA)

点击查看摘要

Abstract:Vision-language models (VLMs) can perform a broad range of tasks across diverse settings, yet their performance in agentic contexts remains poorly understood. Although online evaluations in simulators and real-world environments are essential for measuring interactive agent performance, they are costly and challenging to scale. Complementary offline VQA benchmarks can enable faster and more reliable comparisons across agentic domains, yet existing benchmarks remain limited and fragmented. To address this gap, we introduce AgentVQA, an offline benchmark for evaluating VLMs on realistic agentic scenarios across five agent domains: Web Agents, Robotics, Egocentric Videos, Games, and Spatial Planning. We build AgentVQA by manually selecting 1000 challenging, real-world agent examples from 23 source datasets and adapting them for reliable offline evaluation. The resulting benchmark preserves realistic scenarios from interactive environments across diverse domains, and its model rankings track those from corresponding online evaluations. Across the 22 evaluated models, the best achieves only 58.5% accuracy. Our cross-domain analysis shows that errors are driven primarily by failures to ground and maintain accurate representations of the current and evolving visual state, including localizing relevant UI elements, interpreting motion, tracking state changes over time, and inferring 3D spatial relationships, rather than by task misinterpretation or downstream logical reasoning.

20. 【2610.31478】MoG-VLM: Efficient Video Anomaly Detection through Motion-Guided Vision-Language Models

链接：https://arxiv.org/abs/2610.31478

作者：Khaled Waleed Dawoud,Muhammad Zaigham Zaheer,Khan Muhammad,Muhammad Haris Khan

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：shown strong potential, Vision-Language Models, frame-level inference makes, real-time deployment, video anomaly detection

备注： Accepted at BMVC 2026. Includes supplementary material

点击查看摘要

Abstract:Vision-Language Models (VLMs) have shown strong potential for video anomaly detection, but dense frame-level inference makes them impractical for real-time deployment. Existing acceleration commonly relies on uniform sampling, which ignores content dynamics and can either waste computation on static segments or miss localized anomalies. We propose MoG-VLM a motion-adaptive anomaly detection framework that leverages motion purely as a lightweight control signal to decide when VLM inference is necessary. To this end, we introduce Temporal Gradient Magnitude (TGM) which performs content-aware sampling to concentrate computation on informative regions while avoiding redundant processing. We further introduce a hierarchical dual-stream design in which dense multi-frame VLM reasoning is activated only around frames with elevated anomaly likelihood, via anchor-triggered context-window expansion with early termination. A fusion module then reconciles these instantaneous semantic cues with temporal action dynamics. Across four benchmarks, our method achieves 91.91%, 84.30%, 87.88%, and 78.96% AUC-ROC on XD-Violence, UCF-Crime, MSAD, and ShanghaiTech, respectively, establishing new state of the art on three benchmarks under the zero-shot, training-free setting. On XD-Violence, we improve over the previous best result by +0.57% while delivering a 1.31x inference speedup. These results demonstrate that content-aware allocation of VLM capacity, processing fewer frames more intelligently rather than all frames uniformly, is a more effective axis of progress than uniformly densifying VLM inference across frames. Code is available on GitHub: this https URL.

21. 【2610.31471】Ask About the Right Moment: Training-Free Object Identity Reasoning for Video-Language Models

链接：https://arxiv.org/abs/2610.31471

作者：Di Yang,Xiaochang Li,Muyang Liu,Yufei Wang,Yanhai Xiong

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：concern one physical, model, physical object, video concern, video

备注：

点击查看摘要

Abstract:Many questions about a video concern one physical object. Where does the ball end up after the cups are shuffled? Which card is the queen? How often was the mug covered? Video-language models (Video-LMs) recognise such objects in single frames but do not keep them apart over time. On real shell-game videos, open models from 8B to 235B parameters, their thinking variants, a reinforcement-learned tool agent and three training-free tool agents all stay within ten points of chance. We separate semantic identity binding from temporal identity maintenance. An object's identity should be fixed at a moment when the evidence for it is visible, and carried afterwards by a tracker. \emph{Track, Then Bind} implements this principle without training. A promptable video tracker follows every candidate object and draws it with a track number. A frozen vision-language model answers a static question about the identifying evidence, which binds the target to a track. The answer is then derived from the tracked state in text, without asking the model to reinterpret the original video during read-out. A single configuration covers all benchmarks. With Qwen3-VL-32B it solves both VET-Bench tasks, where a fine-tuned trajectory model reaches 92\% and 90\% and the same VLM voting over 16 samples stays at 30--32\%. It answers 55.4\% of the hardest Perception Test cup games, where the best published model answers 41.5\%, and, using track-derived timelines, 48.6\% of TOC-Bench questions, against 37.1\% for the same model answering directly. Drawing the same tracks on the video and asking the question directly falls 12--19 points short of the agent on real cup games.

22. 【2610.31466】AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark

链接：https://arxiv.org/abs/2610.31466

作者：Ruicong Liu,Liangyang Ouyang,Fengbo Lan,Zhixiang Wang,Kaipeng Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Toggle, flat semantic blobs, build small playable, small playable games, Toggle Hugging Face

备注：

点击查看摘要

Abstract:AI coding agents can now build small playable games in minutes, but the results usually look like programmer art: gray blockouts, colored geometric primitives, and flat semantic blobs. We present AnyGameRenderer, a video-to-video generative renderer that turns such footage into high-quality visuals with characters, motion detail, and effects. Throughout, it keeps the layout, camera, and every entity's position and timing intact. Our AnyGameRenderer generalizes across a wide range of genres that agents build, such as tower defense, auto-battlers, top-down survivors, turn-based battles, kart racing, and crowd runners. AnyGameRenderer takes plain video as its game-state input, with no complex representations such as engine G-buffers, per-object class labels, or low-poly proxies. Gray blockouts, colored primitives, semantic maps, and wireframes all work as input. It also preserves entity correspondence: group counts stay correct, and entities appear and disappear on the right frame. We implement AnyGameRenderer by LoRA fine-tuning MiniMax-H3 ref2va, a 33B reference-video-conditioned video generation model. Training uses $\sim$10k paired clips from three sources: (i) multi-stream rendering data from 38 agent-made games exported from GEAR, an AI game-creation tool; (ii) two-stream rendering data from Unreal Engine, with programmatically controlled crowds, count changes, and entity scales; and (iii) real gameplay recordings, with pairs reconstructed via 3D-box detection. To evaluate the entity correspondence, we propose an entity-level benchmark of 59 held-out cases with 753 entities, scored against ground-truth boxes. Compared with the base model, AnyGameRenderer better preserves entity correspondence: temporal match rises from 50.9\% to 62.9\%, missed count changes fall from 34.7\% to 21.3\%, and fewer entities are hallucinated or left unrendered.

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.31466 [cs.CV]

(or
arXiv:2610.31466v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2610.31466

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Ruicong Liu [view email] [v1]
Thu, 22 Oct 2026 15:58:39 UTC (6,583 KB)

Full-text links:
Access Paper:

View a PDF of the paper titled AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark, by Ruicong Liu and 4 other authorsView PDFHTML (experimental)TeX Source

view license

Additional Features

Audio Summary

Current browse context:
cs.CV

prev

|
next

new
|
recent
| 2026-10

Change to browse by:

cs

References Citations

SciXGoogle Scholar
Semantic Scholar

export BibTeX citation
Loading…

BibTeX formatted citation

loading…

Data provided by:

Bookmark

checked="checked"class=“labs-tab-input”>
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author
Venue
Institution
Topic

    About arXivLabs

arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.

Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)

mathjaxToggle();

    We gratefully acknowledge support from our major funders,
    member institutions, ,
    and all contributors.

About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)

23. 【2610.31455】MixPT: Point Transformer with Interleaved Window and Global Attention

链接：https://arxiv.org/abs/2610.31455

作者：Minkyun Seo,Hyungtae Lim,Jaesik Park

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：capture detailed local, detailed local geometry, global attention, attention, cloud transformers aim

备注： 23 pages, 14 figures, 12 tables. Project page: [this https URL](https://minkyunseo.github.io/MixPT/)

点击查看摘要

Abstract:Point cloud transformers aim to capture detailed local geometry and relationships across a scene at a manageable computational cost. Two common approaches are window attention and global attention. They differ in how they enable scene-wide interaction, which refers to information exchange among tokens across a scene. Window attention reduces computational cost by restricting self-attention to groups of tokens called windows; in serialized designs, each window contains a fixed number of consecutive tokens from a spatially ordered sequence. Because each block only directly connects tokens within the same window, information exchange across windows relies on changes in window membership across blocks and hierarchical pooling. Global attention, in contrast, directly connects all tokens within a scene, but computing attention over all token pairs can be costly when the number of tokens is large. To balance computational cost and scene-wide interaction, we introduce MixPT, a point transformer that uses a mix of window and global attention blocks in an interleaved schedule, while retaining a single fixed serialization pattern for its window blocks. For scenes with a large number of tokens, MixPT applies global attention to spatially pooled tokens and returns residual updates to the original-resolution stream. Across indoor and outdoor benchmarks, MixPT achieves competitive accuracy with lower latency than representative window and global attention baselines. We further demonstrate the feasibility of scaling the attention stage in depth by repeating the interleaved pattern of window and global attention blocks.

24. 【2610.31432】A Sparse Topometric Graph for Scalable Cross-Session Indoor Navigation

链接：https://arxiv.org/abs/2610.31432

作者：Eun Sun Lee,Minkyun Seo,Gwangtak Bae,Junho Kim,Seunggu Kang,Jaesik Park,Young Min Kim

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：conventional embodied agent, indoor environment builds, accumulating noisy real-world, noisy real-world measurements, conventional embodied

备注：

点击查看摘要

Abstract:A conventional embodied agent in an indoor environment builds a map by accumulating noisy real-world measurements and results from heavy inference to guide navigation. While the detailed measurements may differ due to scene changes or sensor settings, the unique topological structure of navigable passages or the connectivity between rooms may provide training-free guidance that complements local observations. We propose a sparse topometric graph as an efficient structural representation for robust indoor navigation, alleviating the need for fine-grained matching, which is computationally expensive, memory-intensive, and prone to real-world variations. The map consists of nodes that encode local 3D geometry and distance-weighted edges that capture traversable connectivity. A learned graph-matching network finds consistent subgraph structures across sessions by considering both node-level geometric descriptors and neighborhood connectivity. The holistic contextual matching is robust to local ambiguities caused by weak distinctiveness or repetitive structure, and establishes stable correspondences despite local scene changes, different sensor modalities, or limited spatial overlap. We analyze the practicality of the graph through cross-session point-goal navigation, where a goal specified in a prior reference map must be reached from an unknown initial pose in a later session. Experiments show that our method achieves the highest success rates (77.1% on Gibson and 40.0% under 3D-FRONT scene changes), while reducing memory by more than two orders of magnitude compared to point-level representations. The proposed approach further supports cross-session alignment and goal-directed navigation with strong scalability and robust real-world transfer.

25. 【2610.31385】A Task-Centric Survey of Long-Document Visual Question Answering: Taxonomy, Evolution, and Future Directions

链接：https://arxiv.org/abs/2610.31385

作者：Yufei Tong,Guanjie Cheng,Tianle Wu,Leilei Zhang,Hang Zheng,Peihan Wu,Jianwei Yin,Shuiguang Deng

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：growing research interest, attracting growing research, visually rich documents, essential for acquiring, acquiring knowledge

备注： 26 pages, 9 figures, 6 tables

点击查看摘要

Abstract:Visual document understanding is essential for acquiring knowledge from visually rich documents and is attracting growing research interest. Existing surveys emphasize architectures or technical approaches, with limited attention to how task bottlenecks shape technical choices and research priorities. We present a task-centric survey that decomposes long-document visual question answering (VQA) into four components: document parsing, evidence organization and retrieval, generator organization and learning, and evaluation. For each, we develop a fine-grained taxonomy and trace motivations, technical responses, and cross-component connections. We focus on explicit retrieval while covering direct reading. Our temporal analysis traces expanding priorities from multimodal content understanding to sufficient, high-fidelity evidence acquisition and sustained evidence management. We outline future directions in evidence sufficiency, verifiable and correctable understanding, and budget-aware coordination, with an outlook on continual document understanding.

26. 【2610.31329】WeVisOne-VL: Unified Visual Perception from Objects to Pixels

链接：https://arxiv.org/abs/2610.31329

作者：Tianming Liang,Junyi Pan,Yuxi Li,Canmiao Fu,Zhipeng Huang,Chong Sun,Chen Li,Jing Lyu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Existing vision-language models, Existing vision-language, remain unreliable, unreliable for fine-grained, Existing

备注：

点击查看摘要

Abstract:Existing vision-language models (VLMs) remain unreliable for fine-grained visual perception. In this report, we present WeVisOne-VL (WeChat Vision All-in-One), a powerful VLM that unifies object-level and pixel-level perception through structured next-token prediction. It supports multiple visual tasks including object detection, referring localization, counting, OCR, segmentation, and matting, enabling localization at any user-specific granularity, from points and boxes to masks and alpha mattes. Architecturally, we integrate a lightweight pixel decoder into the VLM via a special OBJ token to generate instance-level pixel outputs. We train the model with a three-stage curriculum SFT followed by mixed-task RL. Across over 30 benchmarks, WeVisOne-VL demonstrates leading performance on both object-level and pixel-level tasks, while maintaining robust rejection for object-absent queries. By releasing WeVisOne-VL to the open-source community, we hope to advance VLMs from broad visual understanding toward truly reliable perception systems for real-world deployment.

27. 【2610.31321】MVLoMa: Multi-View Local Feature Matching with Any Geometry Foundation Model

链接：https://arxiv.org/abs/2610.31321

作者：Xinyang Lu,Shengzhe Wei,Sheng Tang,Weiqi Zhang,Juntong Fang,Zesong Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：visual localization commonly, localization commonly match, Local feature matching, feature matching, matching is typically

备注： Project Page: [this https URL](https://kosmoresearch.github.io/MVLoMa/)

点击查看摘要

Abstract:Local feature matching is typically formulated for image pairs, although structure-from-motion and visual localization commonly match one reference image against many retrieved or covisible neighbours. Applying a pairwise matcher independently to these centre-neighbour edges duplicates reference-side computation and prevents the matcher from exploiting complementary multi-view geometric evidence from the remaining observations. To address these limitations, we introduce MVLoMa, a sparse star-graph matcher that extends LoMa from image pairs to multiple views. MVLoMa first uses a frozen multi-view geometry model to jointly describe all images in a star, then injects the resulting cross-view geometric context into local descriptors. It then matches the centre image to all neighbours in a single forward pass through per-view self-attention and bidirectional centre-neighbour cross-attention. For supervision, we derive positive correspondences only from depth-valid, mutually visible dense warps and explicitly penalize high-confidence matches that violate epipolar geometry. On 25-view star graphs from HyperSim, ScanNet++, Mip-NeRF 360, and Tanks and Temples, MVLoMa obtains the best macro-average relative-pose AUC among the compared methods at all three thresholds (58.65/85.41/90.99). Its matcher is 2.20 times faster than sequential evaluation of the 24 centre-neighbour edges. The same design supports four tested frozen geometry encoders -- DA3, $\pi^3$, VGGT, and VGGT-$\Omega$ -- with DA3-Giant performing best on all reported encoder-ablation metrics. Controlled ablations further isolate the effects of geometry-aware descriptors, visibility filtering, geometric negative supervision, and joint multi-view inference.

28. 【2610.31320】Stream4D: Streaming 4D Reconstruction with Training-free Motion Decoupling via Causal KV-Cache Attention

链接：https://arxiv.org/abs/2610.31320

作者：Wei Zhang,Ying Feng,Mengtong Wu,Shiqiang Gong,Huaqi Zhang,Qi Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：requires robust handling, methods commonly assume, scene reconstruction requires, streaming methods commonly, reconstruction requires robust

备注： 10 pages, 8 figures. Accepted to ACM Multimedia 2026

点击查看摘要

Abstract:4D scene reconstruction requires robust handling of dynamic objects, yet existing streaming methods commonly assume static scenes, leading to pose drift and ghosting artifacts over long sequences. We introduce Stream4D, a training-free, motion-decoupled streaming reconstruction framework that can be directly integrated into causal Transformer backbones (e.g., StreamVGGT, Stream3R). Our key observation is that causal attention implicitly encodes rich temporal motion cues within the KV cache. We adaptively aggregate these cues from multiple attention layers and across temporal windows, and fuse them with depth priors to handle challenging cases such as occlusions and textureless regions, producing precise dynamic masks that decouple static and dynamic regions. We then apply a soft key masking scheme that leverages these dynamic masks to suppress interference from dynamic regions in causal attention, thereby improving camera pose estimation accuracy. Stream4D inherits the efficiency of causal attention and remains compatible with existing streaming architectures. On diverse dynamic-scene benchmarks, Stream4D significantly improves camera pose estimation and static-scene reconstruction quality, yields reliable dynamic masks, and effectively mitigates long-sequence ghosting.

29. 【2610.31304】Data-Driven Vision-Language Models for Remote Sensing: A Survey

链接：https://arxiv.org/abs/2610.31304

作者：Yue Zhou,Shujun Zhao,Xue Yang,Ruigang Li,Tianwen Zhang,Mengcheng Lan,Chaofeng Chen,Lingfei Ma,Hongjie He,Jonathan Li

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：deep learning era, optimizing network architectures, vision models primarily, models primarily focused, remote sensing

备注： 44 pages, 15 figures

点击查看摘要

Abstract:During the deep learning era, innovations in remote sensing (RS) vision models primarily focused on optimizing network architectures for specific tasks and conducting end-to-end training. However, with the advent of the Vision-Language Models (VLMs) era, constrained by substantial computational resource demands, the mainstream research paradigm has shifted towards adapting general-purpose VLMs using RS vertical domain data for fine-tuning, rather than modifying their core architectures. This transition marks a change in the innovation pathway from model-centric to data-centric. Despite the increasing importance of data, the academic community still lacks a systematic, data-centric survey to guide researchers in constructing high-quality RS vision-language datasets for various application scenarios and in conducting effective model fine-tuning and performance evaluation based on these datasets. To address this gap, this paper presents a systematic review of the development status of RS datasets tailored for VLMs. It further provides a comprehensive practical guide for RS researchers in the large model era, covering the entire pipeline from data construction to fine-tuning and evaluation. This paper aims to encourage the academic community to build more diverse and higher-quality vision-language datasets for specialized RS sub-fields. Ultimately, the goal is to converge these efforts into a comprehensive RS vision-language corpus that offers extensive task coverage and a wide geographical distribution, thereby laying a solid data foundation for advancing towards general artificial intelligence in RS.

30. 【2610.31299】PiHand: Latent Hand-Object Interaction Priors for Physics-Based Policy Learning

链接：https://arxiv.org/abs/2610.31299

作者：Niklas Berndt,Xianghui Xie,Enes Duran,Yixiao Wang,Gerard Pons-Moll

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Synthesizing physically grounded, maintaining natural grasps, subtle contact dynamics, Synthesizing physically, Physically grounded Interaction-aware

备注： Project page: [this https URL](https://virtualhumans.mpi-inf.mpg.de/PiHand/)

点击查看摘要

Abstract:Synthesizing physically grounded dexterous hand-object interactions is important for VR/AR, gaming, and robotics, yet remains challenging because subtle contact dynamics, diverse object geometries, and target trajectories must be jointly respected while maintaining natural grasps. Existing methods either track mocap trajectories with limited transfer to novel objects, or rely on hand-only generative priors that fail to capture coupled hand-object motion, sacrificing contact fidelity and sample efficiency. To tackle these challenges, we introduce PiHand, a Physically grounded Interaction-aware Hand motion synthesis framework. PiHand first trains expert policies that track mocap demonstrations in simulation, distills them into a unified hand-object interaction prior using a goal-conditioned VAE, and finally solve diverse dexterous manipulation tasks through bounded residual exploration in its latent space. With only a single reward and no complex curriculum training, this yields general tabletop manipulation policies that generalize to unseen objects and trajectories on GRAB and DexYCB. The same prior transfers to object catching and bimanual handover, two tasks that are rarely seen in its training data. Across all tasks, PiHand consistently outperforms baselines in all metrics. We will release the processed data and model checkpoints.

31. 【2610.31293】RecallGS: Geometry-Grounded Recall for Online Semantic Gaussian Splatting

链接：https://arxiv.org/abs/2610.31293

作者：Thanh-Khoi Nguyen,Thien-Phuc Tran,Minh-Triet Tran

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：enables open-vocabulary scene, open-vocabulary scene understanding, Gaussian Splatting, Semantic Gaussian Splatting, enables open-vocabulary

备注：

点击查看摘要

Abstract:Online semantic 3D Gaussian Splatting (3DGS) enables open-vocabulary scene understanding from streaming observations. However, existing methods recover geometric context missing from image-derived semantic features using an additionally learned 3D network, incurring extra training and runtime overhead. We observe that such geometric-semantic evidence may already exist in the agent's observation history and can be retrieved rather than learned. Based on this insight, we introduce RecallGS (Geometry-Grounded Recall for Online Semantic Gaussian Splatting), a lightweight, training-free mechanism that treats past observations as a non-parametric geometric-semantic prior. RecallGS follows a recall-ground-fuse pipeline: CLIP retrieves relevant observations, alpha-compositing weights identify geometrically supported views, and aggregate their semantic features over each Gaussian's rendered footprint. On ScanNet and ScanNet++, RecallGS achieves strong semantic segmentation performance at 2.48 FPS, demonstrating that geometric-semantic context can be effectively recovered from observation history without an additional learned 3D branch.

32. 【2610.31284】Retrieval-Augmented Online Textual Memory for Episodic Memory Video Question Answering

链接：https://arxiv.org/abs/2610.31284

作者：Raffaele Cali,Giuseppe Lando,Rosario Forte,Antonino Furnari

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：multimodal language models, Long egocentric videos, video question answering, egocentric videos pose, language models

备注：

点击查看摘要

Abstract:Long egocentric videos pose a central challenge for multimodal language models: the visual stream must be compressed into a memory representation that can be searched efficiently while still preserving the evidence needed for question answering. Building on an online textual-memory framework in which first-person videos are converted into temporally grounded captions, this work systematically studies the role of retrieval in episodic-memory video question answering. We evaluate how different retrieval units, query formulations, context budgets, and reranking strategies affect multiple-choice answering on QAEgo4D-Closed, isolating retrieval as the main variable while keeping the underlying generated memory fixed. Our best configuration, Parent, matches fine-grained caption subchunks, then provides their full parent captions to the reasoner. It achieves 56.4 % accuracy, matching strong full-memory and retrieval baselines while exposing only a small fraction of the textual memory at question time. More importantly, our analysis shows that better temporal coverage does not necessarily translate into better answers: increasing the retrieval budget improves temporal Hit@K and Recall@K, but can reduce accuracy by introducing visually plausible distractors and uncertain caption evidence. These findings suggest that retrieval-augmented egocentric memory should not be optimized only for evidence recall, but also for the reliability, specificity, and answer-discriminative value of the retrieved context. The study motivates more structured episodic memories that move beyond raw caption retrieval toward evidence-aware representations for long-form egocentric reasoning.

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.31284 [cs.CV]

(or
arXiv:2610.31284v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2610.31284

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

33. 【2610.31282】ReCoG: Relational Concept Graph for Training-Free Personalization

链接：https://arxiv.org/abs/2610.31282

作者：Changseon Yu,Hyeokjun Kweon

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Training-free personalization adapts, frozen vision-language model, recognize user-defined concepts, retrieving concept entries, Training-free personalization

备注：

点击查看摘要

Abstract:Training-free personalization adapts a frozen vision-language model (VLM) to recognize user-defined concepts from only a few exemplars by retrieving concept entries at inference time. While recent retriever-based methods enrich each concept with descriptive evidence, they largely treat concepts in isolation, so the retrieved information can be plausible yet non-discriminative, especially when the personalized concept set contains highly confusable, fine-grained categories. We argue that personalization is inherently relational: correct recognition depends on the specific distinctions between a concept and its nearest alternatives. To this end, we propose ReCoG, a Relational Concept Graph for retrieval-augmented personalization. ReCoG represents concepts as nodes and augments them with directed edges that explicitly capture discriminative cues between concept pairs, elicited by a frozen VLM during database construction. At inference, ReCoG retrieves a shortlist and resolves ambiguity via explicit pairwise comparisons conditioned on the corresponding relational edges, selecting the concept that consistently wins against competing candidates. We also introduce FINGER benchmark to test personalized recognition on confusable concept sets. Across FINGER, ReCoG substantially outperforms prior methods, with the largest gains in the most confusable regimes. ReCoG also achieves consistently best performance on established personalization benchmarks including captioning and VQA, confirming that relational evidence is broadly beneficial beyond fine-grained settings. Project Page: this https URL

34. 【2610.31253】Reinforcing intra-operative tumour localisation with weak supervision from pre-operative appearances

链接：https://arxiv.org/abs/2610.31253

作者：Sidhart Sami,Ali Sharjeel,Sri Atluri,Miao Zhao,Caroline Roney,Eirini Marouli,Shaheer U. Saeed

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Limited tumour visibility, including liver hepatocellular, complicates surgical navigation, liver hepatocellular carcinoma, images complicates surgical

备注：

点击查看摘要

Abstract:Limited tumour visibility on intra-operative images complicates surgical navigation, including liver hepatocellular carcinoma (HCC) targeting on computed tomography (CT) imaging. This makes labelled datasets difficult to curate for deep learning, and transferring pre-operative delineations through registration remains challenging due to intra-operative deformation and lack of paired pre- and intra-operative data. We propose to transfer tumour appearances learned from pre-operative magnetic resonance (MR) images to guide localisation on intra-operative CT through weak supervision. A classifier is trained to classify tumour presence on pre-operative images. This is applied to windows on intra-operative images, and despite the domain gap, it assigns higher tumour-presence probabilities on average to tumour-containing windows. These weak cross-domain signals guide a reinforcement learning agent to localise tumours on intra-operative images. We compare direct transfer, few-shot adaptation and synthetic transfer (trained using unpaired MR and CT), which translates CT into synthetic MR before localisation. On an external HCC cohort, synthetic transfer outperformed other tested methods and CT-only baselines. Our framework enables cross-modality tumour localisation without paired MR-CT training images.

35. 【2610.31228】Lightweight Frame Compensation for Real-Time Polyp Segmentation under Frame Skipping

链接：https://arxiv.org/abs/2610.31228

作者：Weihao Gao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：strict latency budgets, deploying high-accuracy models, latency budgets, computer-assisted colonoscopy, colonoscopy is hampered

备注： 15 pages, 1 figure

点击查看摘要

Abstract:Real-time polyp segmentation in computer-assisted colonoscopy is hampered by the difficulty of deploying high-accuracy models under strict latency budgets. Frame skipping, which performs inference every K frames and reuses or interpolates the rest, improves throughput but introduces motion blur and lesion misalignment that degrade temporal consistency. To close this gap, we propose the Lightweight Frame Compensator (LFC), a 77K-parameter plug-and-play module inserted before a frozen segmentation backbone. Operating on a three-frame window, LFC fuses consecutive frames via spatio-temporal attention into a single compensated frame, and is trained only on pseudo-labels generated by a differently seeded model, without any expert annotation. Experiments on three polyp video benchmarks show that LFC recovers most of the accuracy degraded by direct frame skipping and, in several settings, reaches the accuracy of frame-by-frame inference, while retaining a 2.05X--2.55X throughput gain. We further evaluate the temporal stability of three backbones spanning CNN, pyramid Transformer, and global-attention Transformer architectures, revealing a spectrum of sensitivity to frame skipping that arises from how locally or globally each architecture aggregates misaligned input. The compensation gain of LFC follows this spectrum: it is largest for high-capacity Transformer backbones, which achieve the best static accuracy but suffer the most under skip-frame inference. LFC thus offers a lightweight, pluggable, and deployment-friendly route to real-time polyp segmentation.

36. 【2610.31222】GLOW-FM: Efficient Generative Low-Light Image Enhancement with One-Step Latent Flow Matching

链接：https://arxiv.org/abs/2610.31222

作者：Ariel Lapid,Yuval Haitman,Reuven Peretz,Arnon Netzer,Idit Diamant

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：severely degraded observations, perceptually faithful images, single function evaluation, aims to recover, degraded observations

备注： WACV 2027

点击查看摘要

Abstract:Low-light image enhancement (LLIE) aims to recover well-exposed and perceptually faithful images from severely degraded observations. Recent diffusion-based generative methods achieve strong perceptual quality by leveraging powerful image priors, but their iterative sampling incurs substantial computational cost, limiting practical deployment. Despite recent efficiency gains in generative LLIE, high-quality enhancement with a single function evaluation and low overall computation remains challenging, particularly under diverse real-world low-light conditions. We introduce GLOW-FM, a one-step latent flow-matching framework for efficient generative LLIE. GLOW-FM performs conditional transport in the latent space of a frozen Tiny-VAE and leverages Terminal Velocity Matching (TVM) to enable enhancement with a single function evaluation. Matched comparisons with alternative one-step objectives support TVM as an effective design choice, and, to the best of our knowledge, this is its first adaptation to image restoration and specifically to LLIE. Extensive experiments on challenging real-world benchmarks demonstrate that GLOW-FM achieves competitive image quality and state-of-the-art cross-dataset generalization while requiring only a single function evaluation and 34 GFLOPs for the small variant. These findings highlight the potential of GLOW-FM to bring generative LLIE closer to practical deployment through single-step inference and compact latent modeling. Code will be made publicly available upon publication.

37. 【2610.31209】Moving Regions, Not Moving Objects: Segmenting What Actually Moves under Camera Motion

链接：https://arxiv.org/abs/2610.31209

作者：Wenhua Jin,Tiancheng Chen,Sheng Tang,Jiahao Li,Yupeng Liu,Weiqi Zhang,Juntong Fang,Zesong Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Moving object segmentation, object level, conventionally formulated, object segmentation, Moving object

备注： Project page and video demonstrations: [this https URL](https://kosmoresearch.github.io/MoRSe/)

点击查看摘要

Abstract:Moving object segmentation is conventionally formulated at the sequence and object level, marking an entire instance as moving once it moves anywhere in a video. Recent instantaneous formulations distinguish moving from stationary intervals, but still generate masks at the object level through frozen segmentation foundation models. Because the mask is derived from an instance-level proposal, motion is typically attributed to the entire instance rather than localized to the regions that actually move. Moreover, such instance-level predictions can produce masks even when no part of the instance is actually moving, revealing a more fundamental issue: motion is not an intrinsic property of an instance; it can only be determined by comparing at least two frames. Building on this premise, we introduce MoRSe, which jointly interprets two frames to predict a moving-region mask, distinguishing actual scene motion from apparent motion induced by the camera. A single RGB encoder replaces multi-stage foundation stacks, so no optical flow, point tracks, or separate mask generator is needed at inference. We release MoRSe-5K, a benchmark of 42 sequences with Static, Dynamic-Static, and Dynamic settings designed to evaluate the model's ability to distinguish and localize moving and stationary regions under different camera and scene motion conditions. MoRSe outperforms both specialized moving object segmentation methods and dense 4D reconstruction methods with motion-thresholded predictions, while producing the fewest false positives on sequences where nothing moves.

38. 【2610.31205】A Visual Grounding Benchmark for Retinal OCT with Multimodal Large Language Models

链接：https://arxiv.org/abs/2610.31205

作者：Ronald Fecso,José Morano,Botond Fazekas,Paul Widmann-Sedlnitzky,Dorota Himel,Laetita Hinterhuber,Virginia Mares,Andreas Pollreisz,Hrvoje Bogunović

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal large language, Multimodal large, large language models, medical images, spurious shortcuts

备注： Under review at npj digital medicine

点击查看摘要

Abstract:Multimodal large language models (MLLMs) can answer clinical questions about medical images, but trustworthy use requires visual grounding: models should localize the pathology they report rather than rely on spurious shortcuts. Whether MLLMs can visually ground clinical findings in retinal optical coherence tomography (OCT), the most widely used imaging modality in ophthalmology, remains largely unexplored. To address this gap, we introduce RetinaGroundBench, the first benchmark for biomarker visual grounding in retinal OCT. It comprises 815 B-scans exhaustively annotated by ophthalmologists with 4,537 bounding boxes covering 13 biomarkers across 8 diseases. Because MLLMs often fragment a single lesion into multiple partial predictions, we propose AggIoU, a metric that evaluates whether the union of overlapping predicted boxes covers the annotated region. Across 27 open-source MLLMs (0.8-38B parameters), we find that visual grounding remains largely unsolved: the best general-purpose model achieves a macro F1 of just 23.7%, with consistently low recall, despite reaching up to 73% balanced accuracy on biomarker presence questions. To narrow this gap, we developed RetGrounder, an MLLM fine-tuned using an OCT-specific strategy integrating grounding and textual information. Despite its relatively small size (8B), RetGrounder improves grounding F1 to 33.9%, a 43% relative improvement. Our benchmark provides a reference point for measuring progress in the field of OCT diagnosis with MLLMs.

39. 【2610.31194】Inside-JEPA: From Prediction to Relational Grounding in Latent World Models

链接：https://arxiv.org/abs/2610.31194

作者：Hossein Resani,Javen Qinfeng Shi

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Joint-embedding predictive architectures, learn world models, enabling efficient planning, Joint-embedding predictive, JEPA latent state

备注：

点击查看摘要

Abstract:Joint-embedding predictive architectures (JEPAs) learn world models in latent space, enabling efficient planning but leaving their states opaque. We introduce Inside-JEPA, which places relational channels for ordered entity pairs inside the JEPA latent state and shows that an inverse-dynamics loss can ground these channels without relation labels when its head reads them, either alone or as part of the full state. On Something-Something V2, latent prediction alone performs no better than a random relation head, while inverse-dynamics supervision that recovers actions from channel changes improves relational AUROC by .065-.103 across ten settings with annotated boxes, by .081 on RH20T robot episodes with held-out tasks, and by .050-.061 across five relations using off-the-shelf detection and tracking. An inverse head on entity latents decodes actions more accurately but barely improves relational grounding; shuffled labels, two label-free objectives, and action labels on only 5% of the pairs also fail to ground the channels. Given an action, predicted relational changes approach the quality of observed future relations (AUROC .599 vs .621). For one-step relational goals, a supervised readout of the 16 channels ranks the correct action among the top five of 65 in 43% of cases, compared with 24% for prediction-only latents and 17% for a frequency prior.

40. 【2610.31186】RaSFNet: Ray-aligned and Scan-aware Fusion Network for LiDAR Semantic Segmentation

链接：https://arxiv.org/abs/2610.31186

作者：Chuang Chen

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：perception for autonomous, driving and robotics, fundamental component, autonomous driving, Scan-aware Fusion Network

备注：

点击查看摘要

Abstract:LiDAR point cloud semantic segmentation is a fundamental component of 3D perception for autonomous driving and robotics. Projection-based methods map 3D point clouds into 2D representations for feature extraction using 2D networks. However, aggregating multiple points during projection can obscure geometric differences within each frustum, while local feature extraction limits the modeling of spatial relationships across scanning regions. Moreover, proximity in the projected representation does not necessarily imply proximity in 3D space, and interactions between point and projected features may mix features from different ranges, reducing semantic discriminability. To address these challenges, we propose the Ray-aligned and Scan-aware Fusion Network (RaSFNet), which incorporates point cloud geometry and LiDAR scanning characteristics into projection-based semantic segmentation. Specifically, the Ray-Aligned Geometric Distribution Encoding (RAGDE) module characterizes point distributions within each frustum using a ray-aligned coordinate system. To model spatial context, a Scan-Topology-Aware Mamba (STAM) block organizes frustum features according to the LiDAR azimuth sampling pattern and captures long-range dependencies across scanning regions. In addition, a Range-Constrained Point-Frustum Fusion (RCPFF) mechanism uses shared range information to guide feature exchange between point and frustum representations while maintaining spatial correspondence. RaSFNet achieves mIoU scores of 70.2% and 77.7% on the SemanticKITTI and nuScenes validation sets, respectively, indicating competitive segmentation performance compared with the evaluated methods.

41. 【2610.31166】Memory before Goal: Role of Pre-History Memory for Humanoid Loco-Manipulation

链接：https://arxiv.org/abs/2610.31166

作者：Chenyuan Chen,Ran Ding,Lechen Zhang,Zewen He,Yoshihiko Nakamura

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：scenes is non-Markovian, cues vanish, turns and walks, loco-manipulation in dynamic, dynamic scenes

备注： 8 pages, 4 figures, 5 tables. Submitted to IEEE Robotics and Automation Letters (RA-L). Project page: [this https URL](https://memory-before-goal.github.io)

点击查看摘要

Abstract:Humanoid loco-manipulation in dynamic scenes is non-Markovian: cues vanish as objects change or are hidden, or leave the view as the robot turns and walks, yet whole-body vision-language-action (VLA) policies see only the present. We present WholeBodyMem, an object-guided perceptual memory that keeps the pre-history of object events seen before the robot acts on its goal. SAM3 tracks the task objects, and their events causally select key frames within an adaptive budget, which the action expert reads by cross-attention together with object tokens encoding appearance, geometry and time. We also contribute HuMeGo, a humanoid memory benchmark with six simulated and six real-world Unitree G1 tasks. Keeping the right frames rather than more frames, WholeBodyMem surpasses memoryless and uniform-memory baselines, raising its base policy's success from 29.1% to 72.6% in simulation and from 36.7% to 88.3% on the real robot, while also improving the standard SIMPLE tasks (70.2% to 86.9%).

42. 【2610.31162】HiSTEVE 1.0: Harnessing Human-Interface VLA Agents for Open-World Games

链接：https://arxiv.org/abs/2610.31162

作者：Zecong Tang,Zian Guan,Yuncheng Guo,Zhanqiu Zhang,Yiwen Guo,Bo Dai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Building virtual embodied, long-standing goal requiring, Building virtual, reliable native-interface control, virtual embodied agents

备注：

点击查看摘要

Abstract:Building virtual embodied agents that operate in open-ended games like human players is a long-standing goal requiring both long-horizon autonomy and reliable native-interface control. As a procedurally generated open world, Minecraft provides a natural testbed for studying the integration of these capabilities. Existing agents typically provide either native visuomotor control without long-horizon autonomy or high-level planning executed through environment APIs or predefined skills. To bridge this gap, we propose HiSTEVE, a hierarchical VLA agent with a capability-aware agent harness. At the orchestration level, we equip the harness with structured memory for tracking progress and a VLM planner for selecting subtasks within the VLA's capabilities. To reliably determine subtask completion, we further introduce a policy-coupled task completion state detector that conditions on VLA policy context to signal candidate completion. At the control level, a single VLA executes all subtasks with vision-only perception and native keyboard-and-mouse actions. To mitigate interference between heterogeneous GUI and non-GUI interactions, we introduce regime-specific RMSNorm branches and separate mouse-movement token embeddings. We also train the VLA through world knowledge injection, imitation learning, and reinforcement learning with environment feedback to improve reliability and recovery. HiSTEVE achieves state-of-the-art atomic-task performance, scoring 85.0% on MineStudio Bench and a 37.4% average success rate on OpenHA, while also completing long-horizon tasks such as crafting an iron pickaxe from scratch like human players.

43. 【2610.31158】Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research Reports

链接：https://arxiv.org/abs/2610.31158

作者：Jiahao Meng,Qize Yang,Yuxuan Wang,Yunfei Chu,Wensi Dai,Jin Xu,Yunhai Tong

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Deep Research Report, evaluate research centered, Research Report Generation, Deep research, Video-Centered Deep Research

备注：

点击查看摘要

Abstract:Deep research agents synthesize open-web evidence into long reports, but current benchmarks do not evaluate research centered on a source video. We introduce Video-Centered Deep Research Report Generation. Given a video and user request, an agent identifies research questions, retrieves external multimodal evidence, and produces an interactive report linked to relevant video moments. This task has direct practical value because it helps users locate relevant moments, verify claims, reproduce demonstrated procedures, and make informed decisions from video content. We present a skill-based workflow and OmniDR-Bench for this task. For evaluation, we propose Omni Atomic Rubric Trees (Omni-ARTs). Each tree contains three dimensions, 23 shared directions, and task-specific atomic binary criteria. The directions test audiovisual grounding, multimodal evidence use, and interactive presentation. Audited Rubric Construction (ARC) builds these trees through independent evidence collection, automated checks, behavioral calibration, and iterative human review. OmniDR-Bench contains 50 Chinese and English tasks across 19 realworld subcategories. It includes 6,414 criteria. Across 18 agent configurations, the best system scores 63.3 out of 100. Current agents still need broader content coverage, stronger causal and logical analysis across modalities, and more accurate citation support. We further analyze models, harnesses, skill configurations, video categories, and research trajectories. The code and data are released at this https URL.

44. 【2610.31152】WildFakeToolBench: Benchmarking AI-Generated Image Detectors with Web-Sourced Image Processing

链接：https://arxiv.org/abs/2610.31152

作者：Mingjie Li,Yukun Jiang,Yicong Tan,Yang Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)

关键词：current public forums, software repositories, popular these days, photography tutorials, generations are widely

备注：

点击查看摘要

Abstract:As AI generated images are getting popular these days, discussions on such generations are widely existed in current public forums, software repositories, and photography tutorials. Moreover, with the help of LLM-assisted code translation, malicious actors can adopt such information to evade detectors without specialized knowledge or local GPU execution of the resulting tools. To evaluate such risks, we introduce \textsc{WildFakeToolBench}, a benchmark suite of $156$ executable image-processing tools derived from $220$ public sources across $142$ domains. Each tool retains its source evidence and passes syntax, execution, and output-distortion checks without using feedback from the evaluated detectors. On $105$ generated images from five generators, we evaluate six state-of-the-art detectors with images processed by the tools in our collected bench to assess their effectiveness against such in-the-wild risks. The strongest individual tools achieve attack success rates of $25.25\%$--$100\%$ across detectors, exceeding the strongest of six selected image-processing baselines for each detector. Evaluating subsets of an eight-tool pool yields worst-case coverage above $80\%$ for every detector. Effectiveness is sparse and detector-specific: high coverage across candidates does not imply reliable one-shot evasion. These findings not only highlight the potential of such web-sourced risks, but also show the potential on establishing AI-image detector robustness evaluation framework based on those in-the-wild information.

45. 【2610.31149】Navigating human-robot interaction challenges in private and residential aged care homes

链接：https://arxiv.org/abs/2610.31149

作者：David Ahmedt-Aristizabal,Mohammad Ali Armin,Akila Pemasiri,Harshala Gammulle,Tharindu Fernando,David Silvera-Tawil,Simon Denman

类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：residential aged care, enhance care, aged care, private homes, chapter explores

备注： Author-accepted manuscript of a book chapter published online in Elsevier's Reference Module in Materials Science and Materials Engineering (2026). Scheduled for inclusion in Comprehensive Robotics for Extreme and Challenging Environments (June 2027)

点击查看摘要

Abstract:This chapter explores how robotic systems and ambient intelligence can enhance care for older adults in residential aged care (RAC) homes and private homes. Although these settings differ, we frame both as extreme and challenging environments for human-robot interaction (HRI), characterised by cluttered and dynamic layouts, diverse resident needs, and limited on-site technical support. We review embodied and non-embodied systems that assist with daily living, safety monitoring, and social engagement, highlighting hybrid deployments where robots complement fixed and wearable sensors. To ensure these technologies are usable and effective, design considerations consider the cognitive, physical, and social needs of older adults. Interaction design prioritises accessibility for older adults with low digital literacy, using robust but simple voice interfaces, small sets of non-verbal cues, accessible screen-based companions, and safe object handovers. Privacy, trust, and acceptability are addressed via practical strategies such as on-device inference, data minimisation, visible consent controls, and transparent data handling aligned with emerging artificial intelligence (AI) and privacy regulation. Evaluation emphasises real-world metrics including false alarms per day, time to recover from faults, staff workload, and long-term system reliability. We close by outlining open research challenges and future directions for scalable, regulation-ready deployments that support aging with dignity, safety, and independence.

46. 【2610.31145】RankAlign: Vision-Language Representation Alignment via Rank Transformation

链接：https://arxiv.org/abs/2610.31145

作者：Enzhe Zhao,Marco Fiorucci,Lamberto Ballan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Platonic Representation Hypothesis, Representation Hypothesis posits, compatible latent geometries, supervision remains challenging, cross-modal supervision remains

备注： Accepted at NeurIPS 2026

点击查看摘要

Abstract:While the Platonic Representation Hypothesis posits that vision and language models converge toward compatible latent geometries, recovering class-level correspondences between unpaired modalities without cross-modal supervision remains challenging. Existing relational matching methods compare within-modality similarity kernels directly, although the same semantic structure may be represented through different numerical parameterizations across modalities. We propose RankAlign, a rank-based normalization strategy for class-level unpaired vision-language matching. RankAlign transforms each within-modality similarity kernel into an ordinal relational representation before permutation matching, while leaving the correspondence space and matching solver unchanged. The resulting representation is invariant to strictly increasing reparameterizations of similarity values while preserving the ordinal structure used for matching. We provide exact-recovery and stability guarantees that characterize correspondence recovery under both exact and partial ordinal agreement. Experiments across diverse frozen vision and language encoders and multiple datasets demonstrate improved and more stable class-level correspondence recovery, including under label corruption and domain shift.

47. 【2610.31140】GM-GReFEL: Geometry-Guided Spatiotemporal State-Space Learning for Robust Dynamic Facial Expression Recognition

链接：https://arxiv.org/abs/2610.31140

作者：Yudhistira Arditya Pratama,Yi-Zeng Hsieh

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：unconstrained video suffers, Recognizing facial expressions, self-attention grows quadratically, coupled problems, labels are noisy

备注：

点击查看摘要

Abstract:Recognizing facial expressions in unconstrained video suffers from two coupled problems: self-attention grows quadratically in cost with clip length, and crowdsourced labels are noisy. We present GM-GReFEL, a spatiotemporal state-space network with a geometry-aware decision stage. Its Modulated GroupMamba backbone replaces a spatiotemporal Vision Transformer. Six channel groups are scanned separately, four over the frame plane and two over time, so the cost grows linearly with sequence length ($\mathcal{O}(N)$); after each layer, a Channel Affinity Modulation gate mixes the groups again. On top of the backbone, a GReFEL reliability module turns the normalized entropy of each prediction into a mixing weight between the classifier output and a vote from trainable geometric anchors, so that facial geometry counts for more when the network is unsure. The model is initialized by static-to-dynamic weight transfer and trained with a Triple Loss. In five-fold cross-validation, the best fold scores 66.57\%/76.46\% UAR/WAR on DFEW, 0.3 points or less below the strongest compared method, and 45.66\%/62.27\% on MAFW, ahead of all compared methods; on FERV39k the mean over five splits, 42.30\%/52.66\%, is competitive. The five-fold means are 64.07\%/74.54\% on DFEW, on par with recent large pre-trained models, and 38.90\%/54.37\% on MAFW, below the best of them. A paired $t$-test on DFEW indicates a modest benefit of temporal modeling (+1.61 UAR points, one-sided $p=0.031$). Attention stays on plausible facial regions, and latency is close to a ViT-B/16 baseline (47.4 vs.\ 46.8 ms per clip). Code: this https URL.

48. 【2610.31139】Pos4CHD: A Positive-Free Mask-Guided Counterfactual Synthesis Framework for Fetal Congenital Heart Defect Analysis

链接：https://arxiv.org/abs/2610.31139

作者：Wenjie Xuan,Yapeng Li,Hang Su,Chen Cheng,Juhua Liu,Sheng Zhao,Ziming Huang,Bo Du

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Congenital Heart Defects, developing automated diagnostic, automated diagnostic systems, fetal Congenital Heart, positive cases remains

备注： Submitted to IEEE TMI, under review

点击查看摘要

Abstract:The scarcity of positive cases remains a major bottleneck in developing automated diagnostic systems for fetal Congenital Heart Defects~(CHDs), particularly for rare subtypes. Although normal cases are accessible with effort, positive cases are hard to collect due to low incidence rates and privacy concerns, causing severe class imbalance or absence of positive training samples. Existing works resort to synthesizing positives with conditional generative models, but they are task-specific and require positive training samples, hindering application for fetal CHDs. To this end, we propose a positive-free mask-guided counterfactual generation framework for fetal echocardiography, namely Pos4CHD, which enables realistic, high-quality synthesis of pseudo-positive samples from semantic masks, with only normal samples at hand. Technically, we first develop FE-Gen, a mask-guided generative model tailored for fetal heart ultrasound synthesis that mitigates histogram drift and enhances image-mask spatial alignment. Building on FE-Gen, Pos4CHD employs a mask-to-image generation paradigm for CHD synthesis. It first manipulates semantic masks to simulate fetal-heart structural anomalies and then renders anatomically consistent images. Extensive experiments on in-house datasets, together with expert evaluations, demonstrate the visual fidelity~($-12.97$ FID) and anatomical consistency~($+3.96\%$ DSC) of synthesized images. Further validations across diverse real-world CHD diagnosis tasks exhibit promising results and consistent increments, including zero-shot classification~(achieving $93.25\%$ ACC on EbA and $72.92\%$ ACC on TAPVC), lesion detection~($+6.95\%$ mAP50 on VSD), and anatomy segmentation~($+10.49\%$ DSC on fetal heart) compared with baselines. Codes and models are publicly available on \href{this https URL}{GitHub}.

49. 【2610.31123】WildDepth-v2: A Synchronized RGB--LiDAR--Radar Dataset and Benchmark for Metric Depth, Motion, and Tracking of Wildlife

链接：https://arxiv.org/abs/2610.31123

作者：Muhammad Aamir,Sangyun Shin,Naoya Muramatsu,Matthew Wijers,Amir Patel,Andrew Loveridge,Andrew Markham

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：units underpins abundance, lacks metric scale, lack metric ground, video lacks metric, monocular video lacks

备注：

点击查看摘要

Abstract:Measuring animal distance and motion in metric units underpins abundance estimation, morphometrics, and movement ecology, yet monocular video lacks metric scale and wildlife datasets lack metric ground truth. We present WildDepth 2, extending the synchronized RGB-LiDAR WildDepth dataset in three directions. (i) Imaging radar: 37 RGB-LiDAR-4D-radar sequences (19,716 frames) with per-point Doppler velocity and a measured error budget, to our knowledge the first imaging-radar wildlife recordings. (ii) Benchmarking: a frozen, checksummed hidden test set for RGB-only distance estimation and RGB+sparse-LiDAR depth completion, evaluated separately on animal and background pixels. (iii) Motion and tracking: metric 3D trajectories obtained by lifting 2D tracks using LiDAR, radar, or monocular depth. Across 48,723 animal frames, object-level radar calibration improves monocular depth over scene-level LiDAR calibration without requiring LiDAR at inference (AbsRel 0.120 vs. 0.198), although animal-level LiDAR remains more accurate (0.052). Across 431 tracks, once-per-track radar scaling reduces 3D position error four-fold (2.20 to 0.58 m) and distance-sampling detection-function bias from -13% to -2%, matching once-per-track LiDAR calibration. Transferring radar Doppler onto LiDAR produces motion masks 3.7 times denser than radar alone at 72% precision, reduces moving-animal LiDAR accumulation error by 37%, and estimates radial speed (r = 0.60), albeit with approximately 50% underestimation.

50. 【2610.31117】hrough a PRISM, Clearly: Step-Sequence Reasoning for Mistake Recognition in Procedural Videos

链接：https://arxiv.org/abs/2610.31117

作者：Olga Loginova,Oleksandr Bezrukov,Frank Keller

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：valid multi-step activities, requires identifying deviations, recognition requires identifying, Procedural mistake recognition, mistake recognition requires

备注：

点击查看摘要

Abstract:Procedural mistake recognition requires identifying deviations from valid multi-step activities. We study post-completion recognition from videos with benchmark-provided step boundaries. We introduce PRISM (Procedural mistake Recognition via Interpretable Semantic Modeling), which grounds video segments in language and maps their descriptions to procedural states using a lightweight hidden Markov model trained on correct executions. Reference alignment and semantic checks identify errors in step content and order. To support evaluation across heterogeneous benchmarks, we map dataset-specific annotations to four edit-based error types: insertion, deletion, substitution, and transposition. Across three benchmarks, we compare gold and VLM-generated descriptions in raw, semantic-role, and action-object forms. Decoder controls show consistent gains from the trained local decoder over nearest-candidate matching, with additional, dataset-dependent benefits from sequence decoding. Semantic role labeling improves Any-F1 in all six matched grounded comparisons, although the gains vary across datasets and do not translate into uniform improvements under separate configuration selection. These results establish language grounding as an effective interface for explicit procedural mistake reasoning and characterize the contributions of representation and decoding.

51. 【2610.31111】Where Do Long Captions Fail? Position-Aware Diagnosis and Reinforcement Learning for Detailed Image Captioning

链接：https://arxiv.org/abs/2610.31111

作者：Yuanze Hu,Zhichao Yang,Junwei Jing,Xin Yang,Wenxuan Liu,Tinghai Zhang,Jia Fu,Hongzhi Zhang,Xiangyu Wu,Ruiming Tang,Tingting Gao,Han Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Detailed image captioning, Detailed image, amount problem, Detailed, avoiding hallucination

备注： Accepted at NeurIPS 2026. 38 pages, 3 figures; includes references, appendices, and the paper checklist

点击查看摘要

Abstract:Detailed image captioning is usually framed as an amount problem: a model should mention more visual facts while avoiding hallucination. However, autoregressive VLMs generate captions as ordered sequences, and later generations may be produced under weaker or noisier visual grounding. We therefore argue that long-form captioning should be studied not only by what facts are mentioned, but also by where they appear. We introduce a position-aware rubric representation that decomposes dense human references into atomic visual claims, verifies generated captions against those claims, and induces a quartile-wise composition of supported, hallucinated, and generic content. This lens reveals two qualitatively different failures in long captions: models tend to produce unsupported specificity in the middle, while the final portion often escapes into vague, non-evidential language rather than simply accumulating more hallucination. A same-reference human control does not exhibit these patterns; additional human audits examine the visual validity of the induced labels. Motivated by this diagnosis, we propose PAGER (Position-Aware Grounded Evidence Reinforcement), a GRPO training objective with separate signals for supported fine-grained middle evidence, evidence-bearing tail continuation, claim coverage, and content-aware length control. The result is a closed loop: the same ordered claim representation identifies where long captions fail and supplies the position-specific reward needed to repair those failures. Experiments on detailed-caption benchmarks show that PAGER improves position-wise grounding and pairwise caption preference while preserving competitive global caption quality.

52. 【2610.31108】DRAFT: Decoding and Reconstructing 3D Room Layouts from fMRI and Camera Trajectories

链接：https://arxiv.org/abs/2610.31108

作者：Chi-Wei Lee,An-Kai Chen,Cheng-Han Chiang,Yi-Chun Chang,Po-Chih Kuo

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：magnetic resonance imaging, functional magnetic resonance, moving viewpoint remains, decoders reconstruct images, resonance imaging

备注： 42 pages, 7 figures, 18 tables

点击查看摘要

Abstract:While functional magnetic resonance imaging (fMRI) decoders reconstruct images and 3D objects, recovering the metric geometry of rooms from a moving viewpoint remains an open challenge. We introduce, to our knowledge for the first time, the task of reconstructing 3D layouts of held-out scenes using only the known camera trajectories and the fMRI signals of participants watching indoor walkthroughs, without any visual frames. The task is hard because of the temporal mismatch between rapid visual changes and blurred fMRI signals. Our method, DRAFT (Decoding and Reconstructing 3D room lAyouts from fMRI and Trajectories), extracts a compact layout representation from the early visual cortex and fuses this neural code with the geometric free space derived from camera motion. To evaluate it, we propose layout r, the Pearson correlation between predicted and ray-cast log depths. On ten held-out scenes (20 participants), DRAFT reaches a layout r of 0.480, outperforming the camera path alone (0.446) and seven fMRI decoders (at most 0.429). DRAFT also works as a plug-in that improves all seven decoders without retraining, raising their layout r from 0.171-0.429 to 0.487-0.493. Brain activity and camera motion can thus recover the metric layout of unseen rooms, a first step toward reconstructing the 3D spaces people see.

53. 【2610.31087】I$^2$-KAN: Interpretable Intra- and Inter-Modal Multi-Pathway Representation Learning for Multimodal Sentiment Analysis

链接：https://arxiv.org/abs/2610.31087

作者：Xiaoting Xie,Feng Qiao,Xianwei Zhang,Hailong Chen,Kaiwen Zheng,Joemon M. Jose,Xuri Ge,Yujun Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal sentiment analysis, sentiment analysis, predictive utility, infer sentiment, aims to infer

备注：

点击查看摘要

Abstract:Multimodal sentiment analysis (MSA) aims to infer sentiment by integrating linguistic, acoustic, and visual information. However, many fusion methods integrate modality-specific representations and cross-modal interactions into joint representations, making it difficult to determine whether predictive utility arises from a modality itself or from its interactions with others. More fundamentally, a modality's standalone predictive utility may not faithfully reflect its interaction-conditioned predictive utility. To address this issue, we propose I$^2$-KAN, an interpretable multi-pathway framework that explicitly maintains intra-modal and pairwise inter-modal information in separate structural pathways. Each pathway is refined by a Task-Decoupled Linear-Gated Denoising Bottleneck (TDL-GDB) to learn compact and task-relevant representations, followed by structured Kolmogorov-Arnold Network fusion that retains explicit pathway associations and supports multi-level interpretation. Extensive experiments on CMU-MOSI, CMU-MOSEI, and CH-SIMS v2 demonstrate strong overall performance. Ablation and interpretability analyses consistently show across the three benchmarks that low standalone predictive utility does not necessarily imply low interaction-conditioned predictive utility: a modality that appears weak in isolation can remain informative through pairwise interactions. These findings highlight the interaction-dependent nature of multimodal utility and suggest that modality utility should be characterized from both standalone and interaction-conditioned perspectives.

54. 【2610.31065】A General-Purpose Dual-Path Interaction Framework for Multi-View Medical Image Segmentation: Alleviating Data Volume Dependency in Small-Sample Regimes

链接：https://arxiv.org/abs/2610.31065

作者：Shuhuan Wang,Yuanyuan Cui,Pengju Wang,Huimin Guo,Ling Yue,Yin Gu,Yanchao Zhang,Wei Feng,Yunhe Liu,Wei Qian,Mingjun Xu,Shuang Liu,He Ma

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：experience a significant, significant drop, image segmentation depends, segmentation, segmentation models experience

备注： 20 pages, 5 figures

点击查看摘要

Abstract:The performance of medical image segmentation depends on a large amount of annotated data, and most segmentation models experience a significant drop in performance in low-sample-size scenarios. Existing semi-supervised and weakly supervised methods rely on specific network architectures, while traditional multi-view-assisted segmentation methods require strictly paired samples, which limits their clinical applications. To address these issues, we propose DPIF, a general-purpose plug-and-play dual-path interaction framework compatible with arbitrary encoder-decoder segmentation networks, which leverages cross-view anatomical complementarity to reduce annotation reliance. DPIF first performs Sinkhorn optimal transport-based cross-view distribution alignment to establish global semantic correspondence without sample-level pairing. It then adopts conditional mutual information-guided feature decoupling to enable bidirectional knowledge transfer only within the shared semantic space, suppressing view-specific noise. Finally, persistent homology-based topological regularization encodes anatomical invariants as unsupervised priors to mitigate overfitting. Experiments were conducted using 24 baseline models on a private multicenter echocardiography dataset and two public datasets. The results show that DPIF-enhanced models outperform single-view baseline models when trained on comparable amounts of data. Notably, most dual-path variants trained on 40\% - 60\% of the data achieve performance comparable to that of single-view models trained on the full dataset. This demonstrates that DPIF provides a general-purpose and scalable solution for data-scarce multi-view medical image segmentation problems.

55. 【2610.31039】ResGVC: Residual Coding for High-fidelity Generative Video Compression

链接：https://arxiv.org/abs/2610.31039

作者：Ding Ding,Daowen Li,Ying Chen,Kai Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：denoise reconstructed signals, Generative video compression, denoise reconstructed, reconstructed signals based, original pictures

备注：

点击查看摘要

Abstract:Generative video compression (GVC) methods usually employ decoder-side diffusion models to denoise reconstructed signals based on generative priors. Besides, most of these methods perform denoising in latent space rather than directly in pixel domain. In this paper, we propose ResGVC, a residual coding framework for GVC that guides denoising toward original pictures by transmitting residual signals. ResGVC first encodes the original pictures within a learned video codec, and then decomposes the distortion between the codec reconstruction and the original pictures into a sequence of residual segments, where each residual segment is acquired at each denoising step. Residual segments can further be compressed by a novel residual codec with a diffusion transformer as an entropy model. Unlike prior methods, ResGVC introduces explicit source constraints throughout denoising rather than relying on decoder-side generation alone. The diffusion-based entropy model also enables more effective distribution modeling capability based on the powerful generative priors. Moreover, denoising directly in pixel space avoids the irreversible information loss caused by latent representation bottlenecks. Experimental results show that, compared with the previous state-of-the-art method, ResGVC achieves 63.7% and 83.8% BD-rate reductions in terms of LPIPS and PSNR, respectively, while also delivering superior visual quality.

56. 【2610.31010】Revisiting Distribution Matching for State-to-Vision Policy Distillation in Laparoscopic Robotic Manipulation

链接：https://arxiv.org/abs/2610.31010

作者：Mingyu Sheng,Jianan Fan,Dongnan Liu,Guoyan Zheng,Ron Kikinis,Weidong Cai

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：recent studies exploring, control policies trained, Reinforcement Learning, trained via Reinforcement, studies exploring state-based

备注： 8 pages, 3 figures, 2 tables

点击查看摘要

Abstract:End-to-end control policies trained via Reinforcement Learning (RL) have emerged as an alternative to conventional surgical robotic control approaches, with recent studies exploring state-based policies trained on privileged state observations. However, such approaches rely on precise physical states that are difficult to obtain reliably in surgical environments. Vision-based RL provides an alternative by learning manipulation policies directly from RGB observations, avoiding explicit state estimation and manually engineered perception pipelines while enabling policies to acquire task-relevant visual representations. Nevertheless, obtaining vision-based policies via pure RL methods for surgical manipulation remains challenging. Thus, imitation learning (IL) becomes another solution, yet it requires a large number of expert demonstrations, which are difficult to obtain in minimally invasive surgery. In this work, we propose a framework for state-to-vision policy distillation in laparoscopic robotic manipulation. Specifically, a state-based policy with privileged observations is employed as the teacher, and a vision-based policy learns from RGB observations and robot proprioceptive information, which requires less expert demonstrations than IL and introduces superior performance than RL methods. We conduct extensive experiments on various surgical manipulation tasks in the simulated environment. Experimental results show that, in the context of laparoscopic robotic manipulation, training vision-based policies with general-purpose RL methods is challenging, whereas our proposed state-to-vision policy distillation leads to more consistent and stable performance across tasks.

57. 【2610.30980】Diagnostic Loss: Asymmetric Supervision for Radiology Report Generation

链接：https://arxiv.org/abs/2610.30980

作者：Ignacy Kolton,Wenxuan Li,Zongwei Zhou,Jarosław B. Ćwikła,Arkadiusz Sitek,Pedro R. A. S. Bassi,Szymon Płotka

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：fluent clinical narratives, produce fluent clinical, Automated radiology report, Automated radiology, explicitly state supported

备注： 26 pages, 6 figures, 7 tables. Code available at [this https URL](https://github.com/gmum/DLoss)

点击查看摘要

Abstract:Automated radiology report generation requires models to do more than produce fluent clinical narratives: they must explicitly state supported diagnoses while avoiding unsupported ones. However, existing medical vision-language models (MedVLMs) are typically trained with token-level maximum likelihood objectives, which prioritize text agreement over diagnostically critical terms. As a result, models can miss key diagnoses and introduce wrong ones. We identify this as an objective misalignment between conventional language modeling and the asymmetric diagnostic requirements of radiology reporting. To encode these requirements, we introduce Diagnostic Loss (DLoss), a differentiable, architecture-agnostic objective that operates directly on decoder token probabilities. DLoss separately aggregates probability mass over vocabularies associated with diagnoses supported by the reference report and with unsupported alternatives. Using asymmetric pooling across token positions in the report, it encourages supported diagnoses to receive sufficient probability in at least one position while suppressing spurious probability spikes for unsupported diagnoses across all positions during training. The loss can be applied to existing 3D MedVLMs without modifying their vision backbones, language decoders, or inference procedures, and introduces no additional inference-time computation. We train and evaluate DLoss on 50,000 abdominal CT scans across several 3D MedVLM architectures on both in-distribution and out-of-distribution report-generation benchmarks. Across these settings, DLoss improves diagnostic faithfulness while maintaining competitive performance on conventional language-generation metrics, showing the value of asymmetric sequence-level supervision for radiology report generation. The code for DLoss is available at this https URL.

58. 【2610.30974】GraphCAD: Geometry-Aware Diffusion on Edge-Adjacency Graphs for CAD Generation

链接：https://arxiv.org/abs/2610.30974

作者：Wenhao Zheng,Xianggen Liu,Li Yue,Jiancheng Shi,Jiancheng Lv

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：remains fundamentally challenged, Computer-Aided Design, inherent in Boundary, Boundary Representations, remains fundamentally

备注：

点击查看摘要

Abstract:Generative modeling for Computer-Aided Design (CAD) remains fundamentally challenged by the need to capture the intricate interplay between discrete topological connectivity and precise spatial geometry inherent in Boundary Representations (B-reps). Existing generative approaches largely formulate CAD construction as a sequence modeling problem, but consequently lack an explicit topological inductive bias. In this work, we present GraphCAD, a geometry-aware generative framework that centers modeling on the Edge-Adjacency Graph (EAG), a novel graph-based CAD representation tailored for generative tasks. GraphCAD adopts a hybrid graph diffusion formulation to jointly model the discrete and continuous components of EAG and introduces a geometry-aware denoising mechanism that renders node attributes into spatial point sets. These point sets are encoded by an SE(3)-equivariant backbone and fused into the node representations, thereby grounding the generative process in physical geometry. To support this study, we construct EAGBench, a large-scale dataset of engineering CAD models. Extensive experiments show that GraphCAD can generate complex CAD models with more than 50 faces and achieves state-of-the-art performance in geometric fidelity and distributional alignment compared with sequence-based baselines.

59. 【2610.30944】Attention-guided classification and tumor localization of combined hepatocellular-cholangiocarcinoma

链接：https://arxiv.org/abs/2610.30944

作者：Xiaowen Liang,Hélène Cazier,Aurélie Beaufrère,Miguel Albuquerque,Valérie Paradis,Cédric Wemmert

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：hepatocellular carcinoma, primary liver cancers, share components, CCA, Combined hepatocellular-cholangiocarcinomas

备注：

点击查看摘要

Abstract:Combined hepatocellular-cholangiocarcinomas (cHCC-CCA) are a type of cancer that share components of two other primary liver cancers: hepatocellular carcinoma (HCC) and cholangiocarcinoma (CCA). Accurate diagnosis of cHCC-CCA, of which the behavior may resemble that of either HCC or CCA, remains a challenge due to strong intratumoral heterogeneity. Since the prognoses differ between liver cancer types, it is necessary to improve their morphological characterization and recognition in order to accurately identify cHCC-CCA. In this work, we use whole slide images (WSIs) of the two main types of liver cancer (HCC and CCA) and cHCC-CCA, stained with Hematoxylin-Eosin-Safran (HES), to train a classification model that can distinguish between these subtypes and provides a potential solution for localizing different types of tumors in the combined liver cancer images.

60. 【2610.30928】ICGF-CXRMate: Image-Conditioned Clinical Context Compression and Gated Fusion for Chest X-ray Report Generation

链接：https://arxiv.org/abs/2610.30928

作者：Vu Minh Tran,Thuc Huynh,Son Thanh Luu,Doanh C. Bui

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Auxiliary patient data, directly concatenating heterogeneous, Auxiliary patient, X-ray report generation, concatenating heterogeneous clinical

备注：

点击查看摘要

Abstract:Auxiliary patient data can improve chest X-ray report generation, but directly concatenating heterogeneous clinical information with visual tokens produces long, variable-length decoder prompts and may expose the model to redundant or image-irrelevant context. We propose ICGF-CXRMate, an image-conditioned clinical context compression and gated fusion framework. Learnable queries are first conditioned on the current chest X-ray representations and then attend to the patient-data sequence, compressing it into a fixed number of clinical context tokens. Gated cross-attention selectively integrates these tokens into the visual stream, while the compressed tokens are retained in the decoder prompt as a direct clinical pathway. Experiments on linked MIMIC-CXR and MIMIC-IV-ED examinations show that ICGF-CXRMate improves report quality while reducing the average prompt length. In Stage~2, it improves RadGraph-F1 from 24.00 to 28.86, CXR-BERT similarity from 56.86 to 62.80, and BLEU-4 from 5.14 to 7.96 compared with CXRMate-ED, while reducing the average prompt length from 373.89 to 288.37 tokens, corresponding to a 22.9\% reduction. After self-critical sequence training, ICGF-CXRMate outperforms CXRMate-ED on six of eight report-quality metrics in Stage~3. Ablation studies confirm the complementary contributions of image-conditioned compression, gated fusion, and direct retention of the compressed clinical tokens.

61. 【2610.30926】Making MLLM Latents Matter: Factor-Aware Predictive Learning for Cinematic Video Generation

链接：https://arxiv.org/abs/2610.30926

作者：Songlin Yang,Zhe Wang,Xiaotong Zhao,Xi Wang,Ran Zhang,Shuai Li,Taiyi Wu,Songlian Li,Eric Liu,Alan Zhao,Anyi Rao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Video Diffusion Transformer, Cinematic video generation, video generation requires, limited inputs, Factor-Aware Predictive Learning

备注：

点击查看摘要

Abstract:Cinematic video generation requires both temporal inference from limited inputs (i.e., sparse rather than frame-by-frame guidance) and factor-aware control of character, scene, action, and camera. Multimodal large language models (MLLMs) offer useful priors for both capabilities, but their representations are not automatically actionable for video generation: a Video Diffusion Transformer (DiT) may bypass them through native conditioning pathways, and using them does not ensure either factor-aware control or generation-compatible temporal prediction. We propose Factor-Aware Predictive Learning (FAPL), which establishes effective MLLM latent use as a shared prerequisite and then targets the two capabilities with complementary learning signals. First, latent-only generator grounding trains the DiT with a frozen MLLM and connector, strengthening the DiT's use of MLLM latents for generation. Second, for factor-aware control, paired videos specify a target-factor change and non-target preservation, and factor-span replacement trains the DiT to realize this relationship in its output. Third, for temporal inference, text-only and text-plus-complete-video observations share a video target, and the trained DiT is then frozen while the MLLM and connector are optimized through it. This final stage trains limited-input representations for generation while retaining complete-observation reconstruction as a complementary training mode. Extensive experiments demonstrate our consistently better performance on three cinematic video generation tasks (i.e., sparse-to-video, factor-aware editing, and multi-shot generation) over baselines and validate FAPL's contributions to MLLM feature use, temporal control, and factor coordination.

62. 【2610.30913】Watch and Learn: Teaching Visual In-Context Learning by Removing Textual Shortcuts

链接：https://arxiv.org/abs/2610.30913

作者：Nimrod Shabtay,Asaf Yehudai,Avihu Dekel,Eli Schwartz,Raja Giryes

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：context learning compared, Vision-language models, MIME, Vision-language, textual counterparts

备注：

点击查看摘要

Abstract:Vision-language models (VLMs) struggle with in context learning compared to their textual counterparts. Our preliminary study shows that VLMs rely on textual shortcuts and underutilize the visual demonstrations. We therefore hypothesize that VLMs are insufficiently trained to perform visual in-context learning (vICL). To this end, we construct MIME, a task-agnostic vICL training set without textual shortcuts. We ensure the instruction does not state the rule linking the demonstration images to their answers, so the model must infer it from the visual demonstrations. Fine-tuning on MIME improves vICL accuracy by 8.1 to 18.0 points across three VLMs, preserves single-image performance, and improves multi-image and text only in-context learning. In contrast, stating the rule in the training data sharply reduces this gain. We further propose DTAD (Demonstration Text Attention Dropout), which randomly withholds demonstration labels during training so that the VLM must infer the rule from the demonstration images. While achieving comparable vICL accuracy to fine-tuning on MIME, DTAD yields more consistent attention to the demonstration images. On TrueMICL, Qwen3-VL-8B trained on MIME matches frontier models such as Claude Opus 5, and surpasses them with DTAD. Finally, adding MIME to the instruction-tuning mix of LLaVA 1.5 13B more than doubles its vICL accuracy without hurting single-image abilities, whereas a same-size multi-image set improves it only slightly. These results suggest that vICL data should be a standard component of VLM training.

63. 【2610.30912】Hierarchical Fine-Grained Cross-Modal Alignment via Dynamic Granularity Discovery and Optimal Transport

链接：https://arxiv.org/abs/2610.30912

作者：Pengfeng Song,Shaozhong Zhang,Pengfei Shao

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：model visual evidence, distinguish semantically similar, image-text retrieval requires, including objects, Fine-grained image-text retrieval

备注： 8 figures, 6 tables. Code available at [this https URL](https://github.com/sungkites/HFCMA)

点击查看摘要

Abstract:Fine-grained image-text retrieval requires a model not only to assess global semantic consistency between an image and a text, but also to model visual evidence for local textual semantics, including objects, attributes, quantities, actions, and relations, so as to distinguish semantically similar candidates. Existing methods commonly use fixed image patches, detected regions, or text tokens as the basic matching units and then aggregate local interactions through max pooling, cross attention, or similarity accumulation. Such strategies remain limited in semantic unit construction and global matching consistency. This paper proposes a hierarchical fine-grained cross-modal alignment framework, termed HFCMA. The framework progressively transforms low-level patch and token representations into adaptive visual regions and textual phrases, and then performs structured region-phrase matching within a global retrieval scoring process. Specifically, HFCMA first adopts dynamic granularity discovery (DGD) to aggregate raw patches and tokens into semantically compact visual regions and textual phrases. It then formulates region-phrase matching as an entropy-regularized optimal transport problem, thereby estimating a structured alignment matrix under global marginal constraints. To reduce background noise and local semantic drift, HFCMA further introduces background debiasing, textual importance weighting, and prototype consistency regularization. Experiments on Flickr30K and MS-COCO show that HFCMA effectively combines dynamic semantic unit construction with OT-based structured matching under a dual-encoder retrieval framework. The resulting fine-grained score provides structured local alignment information for candidate ranking and improves the discrimination of subtle semantic differences.

64. 【2610.30908】Query-Time Calibration of CLIP Features for Open-Vocabulary 3D Segmentation

链接：https://arxiv.org/abs/2610.30908

作者：Dominik Engel,Yousef Rajeh,Leon Sick,Ivan Viola

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Gaussian reconstructions enables, reconstructions enables open-vocabulary, Gaussian reconstructions, enables open-vocabulary segmentation, natural-language queries

备注：

点击查看摘要

Abstract:Lifting vision-language features such as CLIP into 3D Gaussian reconstructions enables open-vocabulary segmentation through natural-language queries. Although CLIP represents a broad range of semantic concepts, the lifted features of individual scenes can exhibit strong directional concentration, while raw cosine similarity does not account for the scene-specific feature distribution. We show that substantial segmentation gains can be obtained by changing how a fixed lifted feature field is compared with text. Our method partially subtracts a shared scene direction from visual features and text prototypes and whitens text prototypes using a fixed reference vocabulary of generic terms. It then uses soft clustering for multiclass prediction and CSLS with a relevance margin against the reference vocabulary for single-query prediction. Beyond reducing directional concentration, scene centering improves class-relative feature separation in every evaluated scene. Across seven lifting methods and four datasets, the resulting query-time calibration consistently improves mean intersection over union in both multiclass and single-query segmentation. These gains require no retraining, source-image re-encoding, or feature re-lifting, demonstrating the value of scene-conditioned comparison for making better use of existing lifted representations.

65. 【2610.30901】When Annotation Patterns Are Learned: Skin-Tone Dependence in Dermatology Concepts

链接：https://arxiv.org/abs/2610.30901

作者：Y. Li,M.Bigliardi-Qi,S. Bedros,P. Bigliardi,N. Papanikolopoulos

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：clinicians inspect, inspect and correct, diagnoses through clinical, correct skin disease, skin disease diagnoses

备注：

点击查看摘要

Abstract:Concept bottleneck models (CBMs) let clinicians inspect and correct skin disease diagnoses through clinical concepts, but only if the concept annotations are reliable. We therefore audit the reliability of SkinCon, a widely used dermatology concept dataset, across skin tones. Within the same disease and with near duplicates removed, erythema is annotated far less often on dark than on light skin, with an odds ratio of 0.17. In contrast, hyperpigmentation and hypopigmentation are annotated more often, with odds ratios of 6.2 and 4.5, respectively. We refer to this pattern as tone-dependent concept annotation. An evidential concept model trained on these annotations learns the same pattern and reproduces it on unseen images. Such a model may agree with potential erythema omissions rather than contradict them. Consistent with this, three label error detectors underperform a disease-only baseline at finding erythema that dermatologist captions mention but SkinCon labels as absent. The three detectors are based on confident learning, training dynamics, and the model's own evidential uncertainty. Concept annotations should thus be audited within each subgroup before explanations built on them can be trusted.

66. 【2610.30875】HimmBO: High-Dimensional Interactive Model-Merging Bayesian Optimization for Image Generation

链接：https://arxiv.org/abs/2610.30875

作者：Jinyuan Mao,Zhihao Shen,Chenxi Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词：leading to community, Fine-tuning, lightweight adapters, adapters, community collections

备注：

点击查看摘要

Abstract:Fine-tuning has become a common way to customize text-to-image models, leading to community collections of over 100K lightweight adapters. Adapters sharing a base model can be merged with continuous coefficients. This turns a large collection into a high-dimensional continuous design space, which recent work explores interactively using preferential Bayesian optimization (PBO). However, existing approaches are limited to a few dozen preselected adapters and require expensive image generation in every interaction round. We introduce HimmBO, a two-stage method that scales preference-driven adapter merging to much larger collections while reducing image-generation cost. Its screening stage recovers the active adapter set through level-set estimation over pre-generated images, requiring no image generation. The refinement stage then optimizes merge coefficients in the recovered low-dimensional subspace. Both stages use a style-aware kernel, allowing preference information to transfer between visually similar adapters. In simulated-user image-matching experiments, HimmBO achieves higher final similarity than all comparisons while reaching a given similarity with under one tenth of the image generations required by prior work. Its performance remains stable as the collection grows to 1080 adapters, while competing methods degrade substantially.

67. 【2610.30866】Verus-Insight: Towards Explainable Artifact Detection in AI-Generated Videos

链接：https://arxiv.org/abs/2610.30866

作者：Zhuoran Zhang,Yang Shi,Qixun Wang,Tengfei Liu,Yuqi Tang,Xuanyu Zhu,Yizhuo Jia,Jingyun Hua,Shixuan Liu,Xianghua Ying,Haotian Wang,Yuanxing Zhang,Pengfei Wan,Wenjing Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：placing greater demands, Recent advances, videos increasingly realistic, synthetic videos increasingly, made synthetic videos

备注： 35 pages

点击查看摘要

Abstract:Recent advances in video generation have made synthetic videos increasingly realistic, placing greater demands on reliable AI-generated video detection. Existing artifact-based detectors typically identify generation artifacts as evidence for source prediction, yet they may either fail to recognize subtle artifacts or reach the correct source decision without faithfully identifying the evidence underlying it. In this work, we systematically investigate how to design and train effective artifact detectors and formulate artifact detection as a structured process comprising three complementary capabilities: Inspection Planning, which determines what should be examined; Evidence Verification, which verifies whether the inspected content exhibits genuine generation artifacts; and Evidence Aggregation, which integrates the verified evidence into the final source decision. Building on this formulation, we introduce Verus-Insight, trained with human-anchored full-process supervision and progressive capability training to strengthen both fine-grained artifact detection and video-level detection. We further introduce Verus-Bench, a benchmark with fine-grained human annotations of perceptible artifacts for evaluating artifact detection. Extensive experiments across diverse benchmarks demonstrate that Verus-Insight achieves strong performance in both fine-grained artifact analysis and AI-generated video detection, with substantial gains in recovering human-perceived artifacts. Further analyses reveal that the three capabilities are complementary yet distinct, and that Verus-Insight more reliably converts relevant inspection targets into supported artifact evidence without increasing spurious artifact claims.

68. 【2610.30863】Cross-Spectral Feature Fusion for Multispectral Document Binarization

链接：https://arxiv.org/abs/2610.30863

作者：Yasas Savinda,Maheshi Buddhinee Dissanayake

类目：Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)

关键词：Historical document binarization, background degradation exhibit, degradation exhibit wavelength-dependent, exhibit wavelength-dependent behavior, binarization remains challenging

备注：

点击查看摘要

Abstract:Historical document binarization remains challenging when faded ink, bleed-through, and background degradation exhibit wavelength-dependent behavior across visible and near-infrared observations. This study investigates whether adaptive cross-spectral feature fusion and targeted structural guidance can improve multispectral document binarization beyond fixed fusion and generic attention mechanisms. Four registered SMADI bands at 500, 600, 700, and 1000 nm are processed using a multi-branch conditional generative adversarial network (cGAN). Visible, NIR, and structural feature streams are fused at encoder depth L = 3 using spatial- and channel-wise softmax gating, while auxiliary edge maps derived from selected VIS-NIR band pairs provide targeted structural guidance. Nine controlled fusion and structural configurations are evaluated using five-fold document-level cross-validation, DIBCO-standard metrics, and Holm-corrected statistical testing. The F3 + NIR edge-guided configuration provides the strongest overall performance among the evaluated models, achieving mean F1 = 0.7916, p-FM = 0.8044, and IoU = 0.6654. Relative to the fixed Mid AVG baseline, it improves F1 by 0.0269, p-FM by 0.0360, and IoU by 0.0321, with all three gains remaining statistically significant after Holm correction. Mean NRM and DRD are also reduced, although these reductions are not statistically significant after correction. Targeted cross-spectral structural guidance provides an effective mechanism for regulating intermediate multispectral fusion, improving primary foreground-overlap performance while retaining the complete four-band observation.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)

Cite as:
arXiv:2610.30863 [cs.CV]

(or
arXiv:2610.30863v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2610.30863

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Maheshi Dissanayake [view email] [v1]
Thu, 22 Oct 2026 07:42:35 UTC (1,626 KB)

69. 【2610.30861】Direct Forcing: A Single-Stage Training Recipe for Few-Step Autoregressive Text-to-Video Generation

链接：https://arxiv.org/abs/2610.30861

作者：Haojun Xu,Jie Huang,Xin Lu,Mingchen Zhong,Zihao Fan,Linjiang Huang,Si Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：enables low-latency streaming, generation enables low-latency, Few-step autoregressive video, video generation enables, Few-step autoregressive

备注：

点击查看摘要

Abstract:Few-step autoregressive video generation enables low-latency streaming, yet prevailing training pipelines separate causal adaptation from distribution matching. Recent representation-based text-to-video methods retain this separation by starting from ODE-initialized checkpoints, even when the target distribution is defined directly by reference videos. We introduce Direct Forcing, a single-stage framework that uses reference videos both as paired examples of how a history continues and as a target population for self-generated rollouts. Causal Continuation Alignment learns paired spatiotemporal correspondence under reference histories, while Rollout Distribution Matching uses maximum mean discrepancy to align the representation distributions of self-generated and reference videos. Together, these complementary signals allow a pretrained video model to learn causal continuation and the target video distribution in a single training stage. Dynamic Gradient Balancing adapts the relative gradient contributions of continuation alignment and distribution matching during training. Starting from bidirectional Wan2.1-1.3B, Direct Forcing learns a four-step autoregressive generator in 250 updates without a separate initialization stage or online diffusion-score supervision, achieving 84.63 VBench Total and 86.01 Quality. Ablation studies further demonstrate the benefits of dynamic gradient balancing and reveal distinct representation preferences: deeper features benefit continuation alignment, whereas intermediate features yield better performance for rollout distribution matching.

70. 【2610.30854】CAVC: Convergence-Adaptive Audio-Visual Cache for Modality-Asymmetric Diffusion Generation

链接：https://arxiv.org/abs/2610.30854

作者：Lifan Jiang,Yibo Zhao,Senlin cheng,Bolei Xu,Xiaobo Li,Can Ye,Dehai Zhao,Deng Cai,Boxi Wu

类目：Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

关键词：repeatedly executing modality-specific, entire sampling trajectory, Diffusion-based audio-visual generation, generation methods typically, methods typically perform

备注：

点击查看摘要

Abstract:Diffusion-based audio-visual generation methods typically perform joint denoising of audio and video latents throughout the entire sampling trajectory, repeatedly executing modality-specific denoising branches and cross-modal attention at every timestep. However, we observe that such uniform joint computation is not always necessary. The key is a modality-asymmetric recoverability: audio-side drift introduced by mid-stage caching can be substantially reduced by only a few terminal joint denoising steps, whereas video-side degradation caused by caching leads to persistent loss of motion and temporal details. This asymmetry suggests that inference acceleration should selectively cache recoverable audio-side computation while preserving full video refinement. Motivated by this observation, we propose \textbf{Convergence-Adaptive Audio-Visual Cache (CAVC)}, a training-free modality-asymmetric caching framework. CAVC adopts a sandwich-structured computation allocation: after detecting that audio denoiser outputs enter a cache-tolerant regime, it caches and reuses the audio denoiser output to bypass audio denoising and cross-modal attention in the middle stage, while the video branch continues independent spatio-temporal refinement; a few joint steps are then restored at the end to reduce accumulated cross-modal drift and improve synchronization. Experiments across multiple public benchmarks demonstrate that CAVC achieves 1.10--1.35x wall-clock acceleration, improves several visual dynamics and temporal statistics, and maintains competitive audio fidelity and audio-visual alignment.

71. 【2610.30834】RECAP: Looking Once Is Not Enough for Vision-Language Reasoning

链接：https://arxiv.org/abs/2610.30834

作者：Zhaolu Kang,Tailong Luo,Chenxin Li,Yingjie He,Zhenyu Yu,Fengyu Zhou,Jiachen Qian,Lei Wei,Shuang Chen,Jiachen Li,Eric Hanchen Jiang,Rongchao Zhang,Zhengtao Yao,Hoi Leong Lee,Guansu Wang,Kaiyue Zhou

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：temporal grounding failure, grounding failure, generation unfolds, image evidence, exposes a temporal

备注： NeurIPS 2026

点击查看摘要

Abstract:Long chain-of-thought reasoning improves vision-language models (VLMs), but it also exposes a temporal grounding failure: as generation unfolds, models may drift from image evidence while reinforcement learning still provides only a final-answer reward. We study this gap through visual revisit, a temporally localized reactivation of image evidence during reasoning. Across three VLM backbones, revisit peaks are predictive of correctness and causally linked to performance: masking them degrades accuracy more than masking non-peaks, while injecting revisit-like peaks into failed rollouts partially restores correct answers. Control analyses show that this signal is not explained by raw attention strength, uncertainty, logit margin, or hidden-state norm. We propose RECAP, a GRPO-compatible training method that turns detached revisit traces into a credit-assignment signal. RECAP uses revisit-conditioned advantage estimation, dynamic discounting, and gated value prediction to propagate final rewards through visually important reasoning steps, without extra rewards, additional rollouts, or inference-time changes. Across Qwen2.5-VL-7B, InternVL3-8B, and LLaVA-OV-7B, RECAP consistently improves over GRPO and VPPO, yielding $+6.1$--$+6.5$ HallusionBench gains over the SFT base while preserving reasoning and text-only performance. Results on larger LoRA-tuned models, Chinese zero-shot benchmarks, visual perturbations, and human evaluation further demonstrate robust improvements in image-grounded reasoning.

72. 【2610.30827】One Evaluation Is Enough: Inversion-Free Image Editing with Trajectory Correction

链接：https://arxiv.org/abs/2610.30827

作者：Lifan Jiang,Taiyang Chen,Senlin cheng,Bolei Xu,Xiaobo Li,Can Ye,Dehai Zhao,Deng Cai,Boxi Wu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Real-image editing commonly, editing commonly relies, averaging editing fields, Real-image editing, multiple noise levels

备注：

点击查看摘要

Abstract:Real-image editing commonly relies on inversion and iterative sampling, while efficient one-step editors often stabilize a large update by estimating and averaging editing fields at multiple noise levels. We ask a stricter question: is a single temporal field evaluation sufficient for reliable inversion-free editing? Our answer rests on a previously underused duality in a variance-preserving (VP) one-step model: one source-target query at a shared noisy state simultaneously determines a local angular semantic tangent and a clean endpoint displacement. We integrate the tangent over the analytically known remaining VP angle to obtain a nominal one-step transport, and use the endpoint displacement to correct its long-horizon extrapolation through a constrained projection. This transport-first, correction-second construction yields Endpoint-Calibrated Transport (ECT), a closed-form, training-free editor requiring only one noise level, two text conditions packed into one denoiser batch, and one latent update. ECT requires no image inversion, trajectory integration, second temporal observation, or iterative optimization, and can be directly applied to pretrained epsilon-prediction VP one-step generators. Across the reported benchmark settings, ECT delivers stable gains in editing quality within an extremely short editing time.

73. 【2610.30824】Loop to Look Better: Learning Adaptive Depth for Question-Guided Perception in Vision-Language Models

链接：https://arxiv.org/abs/2610.30824

作者：Wencheng Ye,Anning Hu,Hongye Fang,Tianyi Wang,Junchi Yan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：iterative and task-directed, refined in response, Visual, LoopLook, perception

备注：

点击查看摘要

Abstract:Visual perception should be iterative and task-directed, with representations refined in response to the question and the need for further processing. While Vision-Language Models (VLMs) increasingly support extended reasoning, their visual tokens are still typically acquired in a single, task-agnostic encoder pass. This creates an evidence-acquisition bottleneck: models may reason longer without refining the visual evidence needed to answer the question. We propose LoopLook, a lightweight encoder-side recurrent perception framework that equips pretrained VLMs with adaptive visual depth. LoopLook recurrently revisits a middle-to-late window of the vision encoder, injecting question representations at each loop to guide visual refinement. A learned stopping mechanism adaptively determines the recurrent depth, while a token-wise Mixture-of-Looks (MoL) combines representations from different loops, allowing each visual token to selectively integrate information acquired across recurrent steps. Across four backbones and eight benchmarks, LoopLook consistently improves performance over the baseline, yielding gains of up to 8.6% on MMStar and 8.1% on HallusionBench. Our analysis shows that LoopLook progressively refines visual attention and adaptively allocates depth according to task difficulty. It also better preserves task-relevant visual information under reduced input resolution, while increasing time to first token (TTFT) by only 5.1-6.5%. By bringing recurrence from reasoning back into perception, LoopLook transforms visual perception from a one-shot glimpse into an adaptive process of recurrent refinement.

74. 【2610.30814】DRILL: Training World Models to Improve Policies, Not Predict Pixels

链接：https://arxiv.org/abs/2610.30814

作者：Zhaolu Kang,Tailong Luo,Lei Wei,Guangyuan Dong,Sihan Liu,Yingjie He,Siheng Wang,Shuaibo Li,Rongchao Zhang,Zhen Tian,Richeng Xuan,Zhichao Hu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：reduce environment interaction, interaction when post-training, Imagination Learning Loop, reduce environment, environment interaction

备注： NeurIPS 2026

点击查看摘要

Abstract:World models are increasingly used to reduce environment interaction when post-training vision-language-action (VLA) policies with reinforcement learning. Yet they are typically trained to predict pixels one step ahead, even though their role here is not merely to render visually faithful videos but to produce learning signals from imagined rollouts that improve the policy. We show that this mismatch is substantial: lower pixel MSE can produce worse policy gradients, and a world model trained for policy utility can yield better downstream policies despite 17% higher pixel MSE on the next frame. We propose the Downstream-Return Imagination Learning Loop (DRILL), a bilevel framework that updates the world model to maximize the policy's return after an inner GRPO update on imagined rollouts. DRILL has two instantiations. DRILL-VWI is a closed-form surrogate, requiring no additional simulator rollouts, that reweights prediction errors by policy visitation, the group-relative GRPO advantage, and model confidence. DRILL-IMG is a full meta-gradient method that differentiates through the inner update using truncated Hessian-vector products. We show that DRILL-VWI recovers the local one-step component of the DRILL-IMG meta-gradient under score-compatibility and small-residual assumptions. Across five manipulation simulators and two VLA backbones, DRILL-IMG raises mean success rate by 13.1 points over WMPO and 7.9 points over RLVR-World, and complements RLVR pretraining rather than competing with it. More broadly, we believe video world models for VLA reinforcement learning can be productively trained by the policy gradients they produce, not only by pixel-level prediction.

75. 【2610.30799】WovenAnchor Matcher: Specialized Intra- and Inter-Image Context Modeling for Feature Matching

链接：https://arxiv.org/abs/2610.30799

作者：Zhiyang Li,Ruijiang Jin,Thibaut Klenke,Yusuke Sekikawa,Nakamasa Inoue

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：correspondence estimation, commonly aggregates contextual, aggregates contextual information, WAM, contextual information

备注： 34 pages, 18 figures

点击查看摘要

Abstract:Semi-dense local feature matching commonly aggregates contextual information before coarse-to-fine correspondence estimation. However, intra-image and inter-image aggregation serve different roles: the former should propagate spatial evidence within each image while retaining structured two-dimensional dependencies, whereas the latter should gather information from plausible corresponding regions while limiting noise from unrelated locations. We propose WovenAnchor Matcher (WAM), a semi-dense matching framework based on role-specialized context aggregation. WAM introduces two complementary operators. WovenMamba performs intra-image aggregation through horizontal-then-vertical state-space propagation, allowing vertical updates to operate on horizontally contextualized features and thereby encouraging a structured two-dimensional receptive-field bias. AnchorCrossAttention performs inter-image aggregation by using cross-attention to gather context from plausible corresponding regions across the image pair. It performs this exchange over local representative anchors that aggregate feature evidence within each window. On MegaDepth, WAM achieves 66.1 pose AUC@5$^\circ$, improving on the JamMa baseline by 2.0 AUC points under the same evaluation setup. Ablations show that removing or replacing either specialized component reduces accuracy, providing evidence that intra-image propagation and inter-image retrieval benefit from role-specific aggregation designs. Code and pretrained weights are available at this https URL.

76. 【2610.30781】DeXplicit: Making Physical State Explicit in Dexterous Manipulation World Models

链接：https://arxiv.org/abs/2610.30781

作者：Adam Lee,Mutian Xu,Yukang Cao,Shulin Tian,Ziwei Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：change the physical, resulting scene, explicit object structure, physical world, world

备注： Project page: [this https URL](https://dexplicit.github.io)

点击查看摘要

Abstract:Before acting on an object, a robot needs to anticipate how its hand motion will change the physical world and what the resulting scene will look like. Existing approaches typically entangle action-conditioned dynamics, camera motion, and visual synthesis within a video generation model, or represent dynamics as point trajectories without explicit object structure. We introduce DeXplicit, a dexterous manipulation world model that instead predicts how the world evolves explicitly in metric 3D before rendering its visual consequences. Given an initial scene and a future hand trajectory, a lightweight 3D dynamics network predicts object-centric motion and deformation, providing structured and geometrically grounded future world states. These predictions then serve as a strong scaffold for video generation: appearance is transported through the predicted 3D motion and projected into future views, allowing the renderer to focus on completing uncertain and newly visible content rather than implicitly learning world dynamics from pixels. This explicit-3D-first decomposition also enables efficient causal generation, requiring only two denoising steps per block while conditioning on generated history. Across HOT3D, OakInk2, and PhysTwin, DeXplicit reduces moved-point error by 27-40% relative to PointWorld and improves object fidelity IoU+ by 47% on HOT3D under a shared renderer. Our design with two-step causal generation achieves a 57x speedup from our 14B bi-directional configuration in video synthesis.

Comments:
Project page: this https URL

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.30781 [cs.CV]

(or
arXiv:2610.30781v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2610.30781

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

77. 【2610.30774】Evaluation of Front-End Feature Matching for Lunar Visual SLAM

链接：https://arxiv.org/abs/2610.30774

作者：Guillem Casadesus Vila,Grace Gao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：navigation satellite services, navigation satellite, hazard detection, services are deployed, surface operations

备注： 16 pages, 8 figures, 5 tables. Submitted to the 2027 IEEE Aerospace Conference

点击查看摘要

Abstract:Lunar rovers will primarily rely on cameras for localization until navigation satellite services are deployed, and will continue to need them afterwards for relative navigation, hazard detection, and surface operations. Visual odometry (VO) and Simultaneous Localization and Mapping (SLAM) mostly estimate motion by matching features between frames. However, feature matchers are developed on urban, indoor and driving scenes, planetary studies compare them on orbital registration or within complete SLAM systems, and real lunar imagery with reference poses is scarce, so matching between rover frames on low-texture, harshly lit terrain, and its effect on VO, has not been compared. We benchmark eleven classical and learned detector-matcher combinations on nine synthetic, lunar-testbed, and terrestrial-analogue datasets, and a feature tracker, scoring pairwise pose accuracy against baseline and the trajectory error of the resulting VO. Under a common rotation-only metric, the SuperPoint pairings outperform SIFT with ratio-tested FLANN matching on both lunar testbeds and one analogue site, with smaller or unresolved differences on synthetic data. When rotation and translation direction are scored jointly, this SIFT pairing exceeds both SuperPoint pairings on four synthetic datasets, so synthetic results alone do not establish relative performance on real rover imagery. In stereo VO, the SuperPoint pairings are not consistently more accurate than SIFT, but only they keep tracking on all eight sequential datasets. Pairings with classical detectors depend on lighting while SuperPoint changes little: a low spotlight makes them more accurate than diffuse light on the same testbed views, consistent with more contrast and detected keypoints. SuperPoint with LightGlue is the fastest learned combination (16 ms per frame), and DINOv2 retrieval proposals still need geometric verification.

78. 【2610.30753】FilmFlow: Agentic System for 3D Virtual Film Cinematography

链接：https://arxiv.org/abs/2610.30753

作者：Yiming Zhang,Jiarui Guo,Haojia Wei,Yifei Liu,Yifan Yang,Hongjie Zhang,Xue Yang,Zhihang Zhong

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：trajectories remains challenging, Complex camera motion, Complex camera, camera trajectories remains, remains challenging

备注：

点击查看摘要

Abstract:Complex camera motion is central to visual storytelling, yet translating cinematographic intent into controllable, executable camera trajectories remains challenging. We introduce FilmFlow, an agentic framework that converts natural-language instructions or reference videos into explicit camera trajectories for dynamic 3D environments. To generate these trajectories, a Director agent constructs executable camera plans by composing high-level motions from concurrent atomic operations that jointly control translation, rotation, and framing. The Director is supported by three specialized agents: an Interpreter that extracts scene-grounded cinematographic intent, a Scout that selects initial viewpoints, and a Critic that evaluates rendered results and provides visual feedback for iterative plan refinement. We also introduce CinemaBench, comprising 150 Blender scenes from self-created and licensed sources, with five camera instructions per scene for 750 text-directed tasks and 60 reference videos associated with a subset of scenes. CinemaBench supports evaluation of both text-directed camera generation and video reference-directed camera generation. Across a diverse set of evaluated baselines, FilmFlow achieves the strongest benchmark performance and the highest user preference, demonstrating effective spatial reasoning, temporal coordination, and visual composition for executable 3D cinematography.

79. 【2610.30740】Where Did the Light Come From? Diagnosing Cast-Shadow Reasoning in VLMs and Borrowing the Missing Shadow Prior from Image Generation Models

链接：https://arxiv.org/abs/2610.30740

作者：Ryugo Morita,Shunsuke Kitada,Stanislav Frolov,Brian Bernhard Moser,Ko Watanabe,Riku Takahashi,Jinjia Zhou,Andreas Dengel

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：object geometry, observable consequences, consequences of latent, scene structure, shadow

备注： Accepted to WACV2027

点击查看摘要

Abstract:Shadows are observable consequences of latent physical causes, arising from the interaction between illumination, object geometry, and scene structure. A model that understands shadows should be able not only to read a shadow's direction, but also to infer where a shadow should fall when it is absent, and to judge whether a shadow is physically consistent with the scene. We introduce ShadowBench, built from real photographs, which poses these three questions to vision-language models (VLMs). From each scene, we build a correct-shadow, a shadow-removed, and a human-annotated wrong-direction state. Evaluating 19 open VLMs (2B to 78B) and frontier proprietary models, we find that VLMs read a visible shadow's direction well above chance and improve with scale, yet infer the absent direction only weakly and fall to chance at judging physical consistency even under a bias-free two-alternative test that removes the yes-bias of single-image naturalness questions. Only Gemini-3.1-pro exceeds chance on validity, and even then only modestly and far below humans. Chain-of-Thought (CoT) does not help. The missing ingredient is not reasoning but knowledge that image generation models (IGMs) already hold. Routing a VLM through an IGM lifts its inference well above its direct attempt and helps it flag the wrong-direction shadows it otherwise accepts. Cast-shadow direction is a single facet of illumination understanding, but the sharp gap it reveals between VLMs and IGMs suggests image-generation or reconstruction objectives as a route toward illumination-aware VLMs.

80. 【2610.30732】SmolVLA-MoE: Sparse Mixture-of-Experts for Efficient Multi-Task Robotic Manipulation

链接：https://arxiv.org/abs/2610.30732

作者：Shiyang Zhang,Miao Yang,Zhengda Li,Yang Shao,Ruifang Zhai,Hui Peng,Peng Song

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：shown promising results, multi-task robotic manipulation, VLA models, lightweight VLA models, VLA models employ

备注： 16 pages, 5 figures, 4 tables; conference paper prepared for IROS2027

点击查看摘要

Abstract:Vision-Language-Action (VLA) models have shown promising results in multi-task robotic manipulation by leveraging visual and language understanding for action generation. However, existing lightweight VLA models employ a single dense action expert to handle all tasks, which limits their multi-task capability under constrained computational budgets. To address this issue, we propose SmolVLA-MoE, a novel framework that introduces sparse Mixture-of-Experts (MoE) into the FFN layers of the action expert in VLA models. SmolVLA-MoE replaces dense FFN layers with multiple parallel expert FFNs and a token-level router, enabling each token to adaptively select the most suitable expert for action generation. We further introduce a shared expert with a tunable weight parameter to balance the inheritance of pre-trained capabilities and task-specific expert specialization. Through sparse activation, SmolVLA-MoE activates only a single expert FFN during inference, with a total activated parameter count of approximately 500M including the frozen VLM backbone, while benefiting from approximately 800M total stored parameters. We evaluate our method on four task suites of the LIBERO benchmark. SmolVLA-MoE achieves an average success rate of 84.25%, outperforming SmolVLA (82.75%) and OpenVLA-7B (76.5%), while maintaining comparable inference efficiency. Our code is publicly available at this https URL.

81. 【2610.30724】Learning from Next-Frame Prediction: Towards Unified and Scalable Visual Representation Learning

链接：https://arxiv.org/abs/2610.30724

作者：Yifeng Yao,Jinghan Li,Zhihao Zhang,Yajiao Xiong,Yang Jin,Kun Xu,Huishuai Zhang,Dongyan Zhao

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：source of supervision, natural source, masked video pretraining, video pretraining focuses, embedding space

备注：

点击查看摘要

Abstract:Video provides a natural source of supervision: what happens next serves as a learning signal for visual world modeling. Yet masked video pretraining focuses on recovering missing content from surrounding context rather than predicting the future from the past. Autoregressive methods instead predict forward one token at a time, but have yet to match joint-embedding methods in representation quality. This gap motivates us to revisit the granularity and space of future prediction. In this work, we introduce VANE, a self-supervised visual pretraining framework built on next-frame prediction in embedding space. A causal encoder summarizes past observations for a state predictor that infers the representation of the entire next frame, making temporal evolution the primary learning signal. This prediction is carried out in a fixed embedding space provided by a frozen semantic tokenizer, emphasizing scene content and structure. To retain fine-grained spatial detail alongside semantic content, a lightweight auxiliary generative decoder reconstructs future-frame patches conditioned on the predicted representations. To unify visual modeling across images and videos, we construct a local-to-global crop sequence for still images, allowing the same encoder to predict newly revealed regions from earlier crops under the same objective. Experiments show that VANE improves with model and data scaling, achieving SOTA on most anticipation, recognition, and dense perception benchmarks among unified encoders. Especially on EPIC-KITCHENS-100 action anticipation, it surpasses V-JEPA 2.1 by 7.1 points in mean-class recall@5. These results demonstrate that next-frame prediction in embedding space is effective and scalable for visual world modeling.

82. 【2610.30717】PhyEvolve: Multi-Agent State-Evolution Planning for Physics-Aware Video Generation

链接：https://arxiv.org/abs/2610.30717

作者：Yang-Hao Zhou,Lixing Tan,Zhiqi Li,Guang Yang,Xiao Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：improved visual fidelity, substantially improved visual, Recent advances, physical evolution implicit, evolution implicit

备注：

点击查看摘要

Abstract:Recent advances in text-to-video generation have substantially improved visual fidelity, yet existing models still struggle to understand the physical evolution implicit in user prompts, making it difficult to generate videos with continuous physical state evolution. Here, we propose PhyEvolve, a multi-agent framework that enhances natural-language prompts through structured state-evolution planning. PhyEvolve consists of three agents: a Director, a Physical Evolver, and a Composer. Given a user prompt and an optional first frame, the Director grounds the scene and disentangles physical events from observation changes. The Physical Evolver uses scene evidence to identify physical mechanisms then constructs causally linked state transitions that unfold throughout the video, whether visible or not. The Composer utilizes these transitions to enhance the original prompts. Without retraining or model modification, PhyEvolve works directly with existing generators through prompt replacement. Extensive experiments on four major benchmarks show that PhyEvolve achieves state-of-the-art performance, outperforming the cutting-edge prior agentic baseline by 7.9 percentage points on average. These results demonstrate that explicit causal state-evolution planning improves physical consistency and state continuity in generated videos through natural-language prompt enhancement.

83. 【2610.30704】ParaLin++: Accelerating Parallel Diffusion Integrator via Intrinsic Partially Linear Structure

链接：https://arxiv.org/abs/2610.30704

作者：Jianrong Lu,Zhiyu Zhu,Hui Liu,Junhui Hou

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：CLIP-style evaluation, quality-lossless under conventional, conventional FID, Training-free few-step samplers, times

备注：

点击查看摘要

Abstract:Training-free few-step samplers are often described as nearly quality-lossless under conventional FID/CLIP-style evaluation. It remains unclear whether that conclusion transfers to more realistic and complex generation-quality benchmarks. We first systematize the quality metrics used to evaluate training-free sampling acceleration for diffusion and flow-matching models. We find that representative training-free step-shortening methods often remain nearly lossless under FID/CLIP-class metrics, yet can suffer substantial quality degradation when evaluated with semantic-composition, dense-instruction, and long-text-rendering benchmarks such as GenEval, DPG-Bench, and LongTextBench. Parallel sampling is a notable exception: by retaining the full-step discretization and removing only the solver's temporal dependency, it can preserve near-lossless quality while accelerating sampling. Building on this observation, we propose \textit{ParaLin++}, a step-parity parallel sampler that preserves the full-step discretization while accelerating the solver iterations. Experiments across Stable Diffusion-v2, LSUN Church, FLUX.1-dev, and Ming-Flash-Omni 2.0 show that ParaLin++ preserves the full-step Euler quality profile at $2.6\times$--$4.8\times$, $1.68\times$ on FLUX, and $1.21\times$ on Ming. Project page: this https URL.

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.30704 [cs.CV]

(or
arXiv:2610.30704v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2610.30704

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

84. 【2610.30691】LoRA Superposition across Pretrained Models

链接：https://arxiv.org/abs/2610.30691

作者：Keigo Watanabe,Hiroshi Kera,Kazuhiko Kawamoto

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Low-rank adaptation, percentage points, Low-rank, percentage, backbones

备注： 12 pages, 5 figures, 2 tables

点击查看摘要

Abstract:Low-rank adaptation (LoRA) is usually tied to the pretrained backbone on which it is learned. We ask whether LoRAs trained independently for the same task on different pretrained backbones can be summed and applied unchanged to all contributing backbones. We call this construction LoRA superposition. Across seven ViT-B/16 CLIP backbones and eight image-classification tasks, the exact sum improves all 56 backbone-task pairs and achieves a mean accuracy gain of 30.21 percentage points over the unadapted backbone. The exact sum achieves a mean accuracy only 0.28 percentage points below that of individually trained solo LoRAs. In contrast, a leave-one-model-out (LOMO) sum produces a mean gain of only 0.06 percentage points over the unadapted backbones. Backbone-specific solo LoRAs are nearly orthogonal in parameter space, while pairwise cross-backbone responses are strongly concentrated on the diagonal. These results support a component-wise non-interference hypothesis, under which the frozen backbone acts as an implicit selector of its own component without explicit routing or cross-model alignment.

85. 【2610.30680】Zero-Shot Domain Generalization via Domain Prompt Learning

链接：https://arxiv.org/abs/2610.30680

作者：Shiming Chen,Shuhuang Chen,Salman Khan,Fahad Shahbaz Khan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：aims to improve, Domain, learning, Domain generalization, DoP

备注： Accepted to IJCV

点击查看摘要

Abstract:Domain generalization (DG) aims to improve the generalization of the model to any unseen domains. Targeting this goal, existing DG methods mainly focus on learning domain-invariant features or prompts from the given source domains. However, these methods rely on source-domain data, and collecting and annotating large-scale single- or multi-source datasets is often infeasible, limiting the practical applicability of DG. To tackle this challenge, we propose {\underline{Do}}main \underline{P}rompt Learning (DoP), a method built on a large vision-language model (e.g., CLIP) for zero-shot domain generalization, which recognizes unseen classes in unseen target domains without access to source-domain data. DoP essentially learns the target domain knowledge via prompt both in text and visual modalities to overcome the domain shift in text-visual modalities under the test-time adaptation formulation. Specifically, DoP first takes text domain learning (TDL) to simulate various distribution shifts by learning diverse style tokens implicitly in the text space with inter-style diversity loss and intra-style consistency loss. Subsequently, DoP employs visual domain learning (VDL) to further refine the target-domain-relevant style token generated by TDL by making use of the test visual data with self-supervised learning. Extensive experiments on popular DG benchmark datasets (e.g., PACS, VLCS, OfficeHome, and DomainNet) and ImageNet show that our DoP consistently outperforms the state-of-the-art DG approaches. Codes are available at: this https URL.

Comments:
Accepted to IJCV

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.30680 [cs.CV]

(or
arXiv:2610.30680v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2610.30680

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

86. 【2610.30679】AgentDreamer: Agentic 3D Motion Reasoning for Text-Controllable Physics Simulation

链接：https://arxiv.org/abs/2610.30679

作者：Mijeong Kim,Suho Park,Junha Park,Bohyung Han

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：agent-guided optimization framework, aligns text instructions, agent-guided optimization, optimization framework, framework that aligns

备注： Project page: [this https URL](https://cv.snu.ac.kr/research/AgentDreamer)

点击查看摘要

Abstract:We propose AgentDreamer, an agent-guided optimization framework that aligns text instructions with simulated motion through explicit 3D motion planning. Given a text instruction and scene geometry, an off-the-shelf agent translates the instruction into a structured semantic motion prior, specifying what should move, in which direction, and in what temporal order. The agent represents this prior using parametric functions over a series of temporal chunks, yielding dense 3D trajectories. We then optimize the parameters of a differentiable MPM simulator such that its rollout best matches the prior while remaining constrained by the scene dynamics. This allows the agent to provide semantic guidance from language, while the simulator grounds it in physically feasible motion. We further introduce Motion-IG, an information-theoretic metric for text-motion alignment based on masked text recovery. By comparing the likelihood of recovering masked motion-related content with and without the simulated motion, Motion-IG measures the information contributed by the motion beyond that available from the remaining text and scene context. Experiments show that AgentDreamer improves text alignment over video-based guidance, producing simulations that more closely follow the requested physical behavior.

87. 【2610.30661】Class-Grounded Batik Captioning under Scarce Text Annotation: Label Retention and Source-Specific Error Propagation

链接：https://arxiv.org/abs/2610.30661

作者：Novanto Yudistira,Muhammad Dzaka Aufa Fadhillah,Irawati Nurmala Sari

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：offer compact supervision, describing cultural-heritage images, labels offer compact, offer compact, compact supervision

备注：

点击查看摘要

Abstract:Class labels offer compact supervision for describing cultural-heritage images when expert text annotations are scarce. We investigate a batik-captioning cascade that integrates a LoRA-adapted DINOv2 classifier with Qwen2.5-VL-7B, adapted using LoRA and loaded in 4-bit NF4. A $3\times2$ evaluation combines three captioner conditions with two inference prompts to examine adaptation and predicted-class injection. Across 150 caption-evaluation images, all three injected conditions achieve a ground-truth class-label mention rate of 0.9067. The classifier's separate test yields 96.10% pooled accuracy, with 98.33% on 300 public-source images and 75.76% on 33 local images. Supported-class macro-F1 and balanced accuracy on the local subset are 0.8493 and 0.8302, respectively. The classifier and captioner use separate partitions, and their training--evaluation overlap remains unquantified. Differences in label semantics and training support also affect interpretation of the source-specific accuracy gap. Reference-based caption metrics and image--text compatibility scores produce different model rankings. Qualitative examples show both retention of correctly predicted identities and propagation of classification errors into fluent descriptions. These findings characterize how class conditioning preserves label information and transfers upstream errors into batik captions under scarce text annotation.

88. 【2610.30652】Residual Calibration via Local Feature-Space Refinement

链接：https://arxiv.org/abs/2610.30652

作者：Xihao Wang,Chengyao Yu,Ruixing Ming

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

关键词：Deep neural networks, reliable confidence estimates, provide reliable confidence, Deep neural, reliable decision-making

备注： Accepted at NeurIPS 2026

点击查看摘要

Abstract:Deep neural networks often struggle to provide reliable confidence estimates, making post-hoc calibration essential for reliable decision-making. Existing post-hoc methods largely rely on score-based transformations, which improve marginal calibration but often fail to capture spatially varying miscalibration in local regions of the learned feature space. To address this gap, we propose Local Adaptive Probability Estimation (LAPE), a post-hoc residual calibration framework. Specifically, LAPE treats the global calibrator output as a stable anchor and refines the individual prediction by leveraging non-parametric local evidence from neighboring calibration samples. As a plug-and-play refinement module, LAPE effectively utilizes the information about feature-space geometry and can reuse the calibration data that are used to construct the global calibrator. Furthermore, we extend LAPE to the setting with multi-view inputs through Cascade Feature Augmentation Fusion (CFAF). Extensive experiments demonstrate that the proposed methods can improve the calibration quality of various existing baselines and remain efficient and robust across different settings.

89. 【2610.30646】One-shot federated unsupervised domain adaptation with Smoothed Knowledge Distillation and teacher refinement

链接：https://arxiv.org/abs/2610.30646

作者：Ali Abedi,Q. M. Jonathan Wu,Ning Zhang,Farhad Pourpanah

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Federated unsupervised domain, preserving data privacy, Federated unsupervised, unsupervised domain adaptation, data privacy

备注： Published in Engineering Applications of Artificial Intelligence, Vol. 167, 113946 (2026). DOI: [https://doi.org/10.1016/j.engappai.2026.113946](https://doi.org/10.1016/j.engappai.2026.113946) . Available at: [this https URL](https://www.sciencedirect.com/science/article/pii/S0952197626002277) and Code is available at: [this https URL](https://github.com/A-Abedi/SKD_ETR)

点击查看摘要

Abstract:Federated unsupervised domain adaptation (FUDA) addresses the challenge of adapting models to an unlabeled target domain using decentralized source domains while preserving data privacy. However, existing FUDA methods typically require multiple communication rounds, rely on complex aggregation strategies, and often struggle with noisy pseudo labels and inconsistent source knowledge. To address these challenges, we propose SKD-ETR, a novel one-shot FUDA framework that combines Smoothed Knowledge Distillation (SKD) and Exponential moving average-based Teacher Refinement (ETR). SKD trains a student model on the target domain using smoothed soft pseudo labels generated by the ensemble of source models. This reduces overconfidence, mitigates noise, and improves robustness. ETR further refines each source model by interpolating its parameters toward the student via exponential moving average (EMA), thereby transferring target-domain knowledge back to the teachers. This bidirectional refinement enhances pseudo-label quality and student generalization without additional communication overhead. SKD-ETR eliminates complex aggregation by initializing the student model randomly and performing a single-round distillation process. Extensive experiments on OfficeHome, Office-Caltech, and DomainNet demonstrate that SKD-ETR achieves competitive performance while being communication- and computation-efficient, and robust under noisy supervision. The code for this paper is available at this https URL.

90. 【2610.30643】Asking Less, Adapting Better: Feedback-Efficient Test-Time Adaptation for Vision-and-Language Navigation

链接：https://arxiv.org/abs/2610.30643

作者：Zixu Wang,Huaquan Zhang,Shoukai Xu,Jinwu Hu,Zhiquan Wen,Mingkui Tan

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：current VLN agents, target locations, follow instructions, instructions and navigate, navigate to target

备注：

点击查看摘要

Abstract:Vision-and-Language Navigation (VLN) requires agents to follow instructions and navigate to target locations. However, current VLN agents often suffer severe performance degradation in unseen environments due to distribution shifts. Test-Time Adaptation (TTA) offers a promising paradigm to bridge this gap, yet existing methods that rely on unsupervised entropy minimization can propagate errors through the trajectory, causing cascading failures in navigation. Recent methods mitigate this by incorporating human feedback, but they apply trajectory-level supervision uniformly across all steps without localizing the actions is truly informative, leading to inefficient feedback utilization and mismatched optimization granularity. To address these limitations, we propose FETA, a Feedback-Efficient Test-Time Adaptation method that improves both feedback efficiency and optimization reliability. To reduce unnecessary human interventions, we introduce a hierarchical sample selection strategy to localize informative samples. Specifically, we first filter trajectories whose normalized policy entropy exhibits large fluctuations. Within each selected trajectory, we further select the critical action via an entropy-gradient saliency criterion and query a single binary feedback on its correctness. A discrepancy-aware entropy optimization objective then updates the policy only at the queried step, with adaptive scaling that assigns larger relative weights to samples with greater prediction-feedback discrepancy. Extensive experiments across multiple benchmarks demonstrate that FETA achieves state-of-the-art performance with fewer human interventions, while remaining robust under noisy feedback and continual adaptation settings.

91. 【2610.30639】CODI: Improving Self-Supervised Vision Transformers with Cross Distillation

链接：https://arxiv.org/abs/2610.30639

作者：Siran Dai,Qianqian Xu,Peisong Wen,Yang Liu,Xiaochun Cao,Qingming Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Self-supervised Vision Transformers, Vision Transformers learn, Transformers learn strong, Self-supervised Vision, Vision Transformers

备注： 35 pages, 11 figures, 14 tables

点击查看摘要

Abstract:Self-supervised Vision Transformers learn strong image-level representations, but their patch-level representations can be unreliable for dense prediction. We study this mismatch and find that the class token concentrates global semantics on a small number of representative patches, while dense prediction errors often occur on low-attention regions. We provide a local gradient analysis showing that, along the [CLS] attention readout, image-level self-distillation gradients are weighted by [CLS]-to-patch attention mass. To provide masked patches with global semantics without changing the architecture, we propose Cross Distillation (CODI), which mixes a small amount of the teacher class-token distribution into each teacher patch-token target. CODI gives every masked patch an attention-independent semantic correction while preserving the standard self-distillation architecture. Experiments on dense and image-level benchmarks show that CODI improves both dense and image-level performance under aligned pretraining settings. Code is available at this https URL.

92. 【2610.30634】FedBST: Bilateral Self-Training for Unsupervised Federated Classification

链接：https://arxiv.org/abs/2610.30634

作者：Aijing Yu,Kuangpu Guo,Jian Liang,Xiao-Yu Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：severe non-IID shifts, Unsupervised federated learning, Vision-Language Models, offers a promising, label-free classification

备注： ICME 2026

点击查看摘要

Abstract:Unsupervised federated learning with Vision-Language Models (e.g., CLIP) offers a promising solution for label-free classification, yet its performance often degrades under severe non-IID shifts. A pioneering method, FedCoPL, typically relies on self-training strategies that exclusively prioritize high-confidence predictions for pseudo-labeling. However, this selective approach neglects the information of ambiguous samples (often referred to as ``waist" samples), leading to the underutilization of data and biased decision boundaries. To address this limitation, we propose FedBST, a bilateral self-training framework that effectively exploits both high-confidence and ambiguous data. Specifically, for local optimization, we introduce uncertainty-aware confidence penalization (UACP). UACP targets ambiguous samples by penalizing overconfident predictions to implicitly promote higher uncertainty, thereby preventing erroneous pseudo-labeling. At inference, we employ a visual-text ensemble strategy. This approach aggregates uncertainty-aware local visual prototypes and ensembles them with textual prototypes, achieving lightweight adaptation to local distributions via prototype-based calibration. Experiments demonstrate that FedBST achieves consistent improvements over existing methods with standard federated aggregation protocols.

93. 【2610.30623】Refining Open-Vocabulary Semantic Segmentation via Regional Semantics and Visual Prototypes

链接：https://arxiv.org/abs/2610.30623

作者：Aijing Yu,Zhengbo Wang,Lijun Sheng,Jian Liang,Xiao-Yu Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Contrastive Language-Image Pre-training, shown superior performance, image-level open-vocabulary classification, open-vocabulary classification task, Contrastive Language-Image

备注： ICASSP 2026

点击查看摘要

Abstract:Contrastive Language-Image Pre-training (CLIP) has shown superior performance in the image-level open-vocabulary classification task, benefiting from its powerful alignment of visual features and text embeddings. However, dense prediction tasks require models to perform pixel-level predictions, necessitating modifications to CLIP for region-text alignment. In this paper, we adjust the attention layers within the vanilla visual encoder of CLIP. With a novel attention calculation method for selective attention features, the model retains more regional semantic information. To further mitigate the negative impact of the modality gap, we introduce additional visual prototypes to refine the original predictor solely based on text embeddings. Specifically, patch features with confident predictions are selected to form an additional auxiliary memory-based classifier for more accurate prediction. We further integrate an optimizable feature extractor with an exponential moving average updating strategy to enhance prediction quality. Extensive experiments on $5$ semantic segmentation datasets demonstrate the effectiveness of our method.

94. 【2610.30619】GSHeadRelight: Fast Relightability for 3D Gaussian Head Synthesis

链接：https://arxiv.org/abs/2610.30619

作者：Henglei Lv,Bailin Deng,Jianzhu Guo,Xiaoqiang Liu,Pengfei Wan,Di Zhang,Lin Gao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：virtual reality, augmented reality, view synthesis, synthesis of human, essential in applications

备注：

点击查看摘要

Abstract:Relighting and novel view synthesis of human portraits are essential in applications such as portrait photography, virtual reality (VR), and augmented reality (AR). Despite recent progress, 3D-aware portrait relighting remains challenging due to the demands for photorealistic rendering, real-time performance, and generalization to unseen subjects. Existing works either rely on supervision from limited and expensive light stage captured data or produce suboptimal results. Moreover, many works are based on generative NeRFs, which suffer from poor 3D consistency and low real-time performance. We resort to recent progress on generative 3D Gaussians and design a lighting model based on a unified neural radiance transfer representation, which responds linearly to incident light. Using only in-the-wild images, our method achieves state-of-the-art relighting results and a significantly faster rendering speed ($\times12$) compared to previous 3D-aware portrait relighting research. Project page: this http URL.

95. 【2610.30609】KinoUAV: A Benchmark for Safe and Stable UAV Vision-Language Navigation with Kinodynamic Modeling

链接：https://arxiv.org/abs/2610.30609

作者：Chenyao Yang,Peijin Wang,Yingchao Feng,Wenhui Diao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Unmanned aerial vehicles, remote sensing platforms, remote sensing applications, important remote sensing, shown great potential

备注：

点击查看摘要

Abstract:Unmanned aerial vehicles (UAVs) have recently emerged as important remote sensing platforms, and UAV navigation has shown great potential in remote sensing applications. However, existing methods do not explicitly incorporate kinodynamic modeling or safety distances into trajectory generation, resulting in high absolute yaw rates, frequent collisions, and low navigation success rates, which limit safety and motion stability. To address this challenge, we introduce KinoUAV, a kinodynamic benchmark comprising a dataset and KinoUAV-Agent. First, we develop a hierarchical kinodynamic trajectory generation pipeline that drives UAV through acceleration actions. It uses waypoint chains from global planning and generates trajectories segment by segment under velocity, acceleration, and jerk constraints, reducing oscillations and improving trajectory stability. Furthermore, we introduce directional free-space distance (DFD) labels into the constructed dataset to describe the available clearance for safe motion decisions. The proposed KinoUAV-Agent predicts DFDs and uses them to generate safe actions, decoupling perception from action decision-making. This design enables autonomous obstacle avoidance and improves navigation safety. The benchmark incorporates the proposed Cruise-Seek task, in which the UAV first enters the target region and then searches for the target, reducing the difficulty of target search and improving navigation success. Experiments on KinoUAV show that KinoUAV-Agent outperforms existing methods, achieving the highest success rate while maintaining lower absolute yaw rates and collision rates. These results demonstrate the effectiveness of kinodynamic modeling for safe and stable UAV navigation.

96. 【2610.30592】Visual Grounding First, Multimodal In-context Learning Follows

链接：https://arxiv.org/abs/2610.30592

作者：Minhyuk Seo,Minjae Lee,Chaeeun Lee,Wei Lin,Muhammad Jehanzeb Mirza,Tinne Tuytelaars,Jonghyun Choi

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：shown strong in-context, multimodal ICL, strong in-context learning, remains challenging, ICL

备注： NeurIPS 2026

点击查看摘要

Abstract:LLMs have shown strong in-context learning (ICL) capability, but extending it to Multimodal LLMs (MLLMs) remains challenging. Prior multimodal ICL methods often rely on ICL-specific datasets for additional training or task vector extraction, which can improve performance on the same ICL benchmark used for adaptation. However, they do not generalize well to other benchmarks and often induce forgetting in previously well-solved tasks. For this reason, we identify 'visual grounding' as the key bottleneck in multimodal ICL; MLLMs often fail to attend to task-relevant visual evidence in demonstrations, instead over-relying on textual cues and producing hallucinated outputs. To address this, we propose ProCoRe to enhance visual grounding through contrastive reinforcement learning on multimodal contrastive data for improving multimodal ICL. ProCoRe generates captions for contrastive image pairs, decomposes them into propositions, and optimizes contrastive rewards that encourage alignment with corresponding images while discouraging mismatched ones. Despite never seeing ICL-formatted training examples, ProCoRe improves average multimodal ICL classification accuracy by 5.6% and captioning ROUGE-L by 13.8% over the off-the-shelf Qwen-VL-3-8B model, outperforming ICL-data-dependent state of the arts across benchmarks. Finally, we introduce PICL, a personalized multimodal ICL captioning benchmark that tests whether MLLMs genuinely understand visual demonstrations rather than relying on pre-trained semantic priors.

97. 【2610.30519】Unified Trajectory and 3D Pose Forecasting for Multi-Agent Sports Analysis

链接：https://arxiv.org/abs/2610.30519

作者：Marc Peral,Guillem Capellera,Luis Ferraz,Antonio Rubio,Stella Graßhof,Dan Witzner Hansen,Antonio Agudo

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：future human motion, human motion requires, multiple interacting players, interacting players introduce, players introduce complex

备注： WACV 2027

点击查看摘要

Abstract:Forecasting future human motion requires jointly reasoning about an agent's global trajectory and 3D body pose, which are tightly coupled, particularly in team sports where multiple interacting players introduce complex social dynamics. We exploit a socio-temporal encoder that fuses trajectory and pose at the input level and models them jointly through shared factorized attention. The model is further enhanced by a per-joint loss reweighting scheme that emphasizes dynamic joints and prevents degenerate solutions, and a frequency-domain trajectory smoothing term that improves trajectory prediction while indirectly benefiting pose forecasting. To ensure fair comparison with prior joint forecasting methods, we identify and correct evaluation biases arising from overlapping sequence construction, adopting instead a non-overlapping protocol and a deterministic, oracle-free strategy for multi-future prediction. Our approach improves over prior joint forecasting methods on both WorldPose and 3DPW, with the largest gains on pose accuracy, demonstrating that the proposed joint formulation generalizes beyond the densely interactive scenarios that motivate it.

98. 【2610.30481】AVAtt: A Free-Viewing Eye-Tracking Dataset and Benchmark for Visual Attention on Paintings

链接：https://arxiv.org/abs/2610.30481

作者：Mohamed Amine Kerkouri,Marouane Tliba,Aladine Chetouani,Alessandro Bruno

类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Image and Video Processing (eess.IV)

关键词：natural photographs, colour and abstraction, developed almost exclusively, exclusively on natural, composed by artists

备注： Extenstion of [https://doi.org/10.1145/3649902.3655656](https://doi.org/10.1145/3649902.3655656) published at ETRA 2024

点击查看摘要

Abstract:Saliency and scanpath models are developed almost exclusively on natural photographs, yet paintings are composed by artists to guide the viewer's eye and differ from photographs in texture, colour and abstraction. We introduce \avatt, a free-viewing eye-tracking dataset on \nImages{} paintings spanning sixteen art movements and five centuries, with \nScanpaths{} scanpaths and \nFixations{} fixations from \nParticipants{} participants (\spPerImageMin--\spPerImageMax{} observers per painting). For every painting we release individual scanpaths with fixation timing and eye--screen distance, fixation maps, saliency maps smoothed at one degree of visual angle, temporal saliency videos and rich art metadata. We benchmark classic and deep saliency models against human agreement, revealing substantial headroom for art-aware models, and rank 44 scanpath-similarity measures, including a new language-free family of image-encoder metrics built on ten CNN, ViT and self-supervised encoders. With controls that remove viewing biases, we show that faces are fixated \faceEnrich$\times$ more than expected and within half a second, that local structure draws the eye, that composition rules fitted from image content predict where people look, and that art style shapes how much viewers agree. Dataset, code and a Python package are available at: this https URL.

99. 【2610.30468】SplatLab: Autonomous Scientific Discovery for 3DGS Research

链接：https://arxiv.org/abs/2610.30468

作者：Seemandhar Jain,Manmohan Chandraker

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：weeks of expert, expert engineering, Reproducing a published, logged training run, systems read papers

备注： Accepted at NeurIPS 2026. 14 pages, 4 figures. Project page: [this https URL](https://seemandhar.github.io/splatlab)

点击查看摘要

Abstract:Reproducing a published 3DGS paper takes weeks of expert engineering before any extension can be proposed. Prior autonomous-research systems read papers, draft hypotheses, and write code, but are limited by short fixed templates, low executability, and weak traceability, and none has been demonstrated end-to-end in a live computer-vision subfield with intense activity. SplatLab is an autonomous research system for 3D Gaussian Splatting that addresses these limitations. Given a research prompt, a target-paper URL, or no input at all, it reproduces a published baseline, proposes an extension, trains and ablates across Mip-NeRF 360 and LLFF, writes the manuscript, and binds every reported number to a logged training run. Five design choices distinguish it: (i) candidates mutate plugins from a verified-reproduction backbone matched to published baselines; (ii) a cascade-weighted Elo tournament across eight islands scores candidates on measured GPU PSNR with verbal-gradient feedback; (iii) a standing falsifier subtracts Elo on failure, integrating stress-test survival into selection; (iv) every reported number is bound to a logged training run, and the run cannot terminate while any claim is unbacked; (v) a seven-category 3DGS taxonomy wraps EVOLVE-BLOCK markers in domain-aligned scaffolds transferable across 3DGS repositories. On PSNR-targeted runs, SplatLab's manuscripts beat their reproduced targets by +0.18 to +3.78 dB, including +3.78 dB on astrophotographic nebula rendering, for which no prior 3DGS method exists. The research cycle compresses from months of graduate-student time to days of mostly autonomous compute. Code, all manuscripts, experiment ledgers, and the cross-run paper store are available on the project page.

100. 【2610.30405】VisCurate: Evaluating Behavioral Equivalence of Visual Skills

链接：https://arxiv.org/abs/2610.30405

作者：Md Farhan Ishraq,Md Farhan Ishmam,Reaz Hassan Joarder,Md Hasanul Kabir

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Modern vision-based agents, Modern vision-based, skill-based problem-solving, edge detection, vision-based agents

备注： Accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027), Main Conference

点击查看摘要

Abstract:Modern vision-based agents have shifted toward skill-based problem-solving, where a skill is an executable image-to-image operation, e.g., cropping, thresholding, or edge detection. As these skill libraries grow, they accumulate duplicated, mislabeled, and defective skills. The signals normally used to curate them (a skill's name, description, or source code) say little about how the skill visually changes the image. We present VisCurate, a framework and benchmark that curates visual skill libraries from observed execution rather than from text. VisCurate runs each candidate skill pair on a shared probe battery and assigns one of six behavioral relations, each tied to a library edit that is safe to make. The benchmark injects seven defect types into a clean library at controlled rates, producing 300 reproducible instances with ground-truth relations and repairs. While text baselines accept up to five of six false merges on hard negatives, our verifier accepts none and recovers 51.2% of the pairs that are truly mergeable. On two real, uncurated libraries, VisCurate finds that 92% of the skills a package shares with its downstream copy are redundant, while execution confirms only 10 of 17 published equivalence claims. The curation problem also remains open, as the strongest of the nine automated curators recovers only about half of the repairs. We emphasize that visual skill libraries should be curated by behavior, not by description.

101. 【2610.30390】Latent Space Jam: Layout Guided Video Synthesis

链接：https://arxiv.org/abs/2610.30390

作者：Asaf Joseph,Moshe Mandel,Ohad Fried

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：additional computational resources, Adding control, demands additional computational, computational resources, generation often requires

备注： [this https URL](https://latent-space-jam.github.io/)

点击查看摘要

Abstract:Adding control to video generation often requires training, which demands additional computational resources, data, or architectural changes. We propose a training-free approach that utilizes pretrained video diffusion models to control object layout and motion using coarse layouts. Our method operates in two passes: first, it steers spatiotemporal placement through prompt-guided cross-attention to produce a coarse visual guide; second, this guide conditions the same model to generate a high-quality, layoutconsistent video. The approach enables coordinated motion with strong temporal consistency, supporting diverse trajectories and object interactions without additional training. Extensive experiments show that our method consistently outperforms prior work in overlap and trajectory accuracy, as well as visual quality across static, dynamic, and multi-object scene settings.

102. 【2610.30347】FiLM-CAM: Keyed Feature Modulation for Conditional-Access Watermarking

链接：https://arxiv.org/abs/2610.30347

作者：Yash Kulthe,Vishal Asnani,Shruti Agarwal,Andrew Gilbert,John Collomosse

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Feature-wise Linear Modulation, keyed feature modulation, feature modulation, enforces authorized encoding, conditional-access image watermarking

备注： Accepted to NeurIPS 2026

点击查看摘要

Abstract:We propose FiLM-CAM; a conditional-access image watermarking approach that enforces authorized encoding, decoding, and removal through keyed feature modulation. A secret key conditions a Feature-wise Linear Modulation (FiLM) mechanism that transforms the internal representation of the watermark signal before embedding, thereby coupling the payload to the key at the feature, rather than pixel level. The same key must be presented to condition the decoder to correctly recover the payload embedded in an image. To enforce conditional access, we train the system to maximize the performance gap between authorized and unauthorized use, ensuring reliable extraction under the correct key while inducing failure under incorrect keys. In addition, we design our encoder to estimate the watermark residual invariant to the presence of pre-existing watermarks. This design enables conditional watermark removal via simple re-encoding and subtraction of the residual using iterative refinement, contingent on knowledge of the secret key. We evaluate FiLM-CAM across multiple watermarking encoder-decoder backbones, demonstrating that keyed feature modulation serves as an effective, architecture-agnostic conditional access module (CAM) for image watermarking.

103. 【2610.30340】Foundation4D: Towards a unified perception and reconstruction model for autonomous vehicles

链接：https://arxiv.org/abs/2610.30340

作者：NVIDIA:Sérgio Agostinho,Maximilian Apodaca,Emmanuel Attia,Guillem Braso,George Dong,Ilya Fedorov,Michele Fenzi,Gang Huang,Jiahui Huang,Shengyu Huang,Bingxin Ke,Laura Leal-Taixé,Kuan-Ting Lee,Mingxuan Liu,Tian Liu,Tim Meinhardt,Aljoša Ošep,Naveen Kumar Rai,Kefei Ren,Cristiano Saltori,Keqiang Wu,Ning Xu,Fei Xue,Jin-Bey Yu,Lei Zhang,Qunjie Zhou

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：unified feed-forward model, unified feed-forward, feed-forward model, Gaussian reconstruction, multi-camera driving video

备注：

点击查看摘要

Abstract:We introduce Foundation4D, a unified feed-forward model for geometry estimation, 3D detection, semantic occupancy, and Gaussian reconstruction from multi-camera driving video. A shared backbone uses factorized spatiotemporal attention to efficiently combine observations across cameras and time. Our video inference pipeline uses pose graph optimization to refine camera trajectories and assembles object tracks across input windows. We also develop a data annotation pipeline and release PAI-Foundation4D, a benchmark with dense depth and semantic occupancy labels for 1,253 driving clips. With benchmark-specific fine-tuning, Foundation4D achieves the lowest depth AbsRel on Waymo and nuScenes, the highest detection mAP on nuScenes, and the highest occupancy mIoU on OpenOccupancy among the compared methods. Our task-combination study shows benefits for both detection and geometry: co-training detection with geometry and occupancy improves top-class mAP by 1.2 points over detection-only training, while co-training geometry with detection reduces camera-to-rig translation error by $13.4\%$ relative to geometry-only training. We further use the predicted geometry and trajectories as priors for lidarless NuRec, supporting reconstruction of driving scenes for simulation.

104. 【2610.30337】MoRE: Motion-Regularized Encoding for Articulated 3D Generation

链接：https://arxiv.org/abs/2610.30337

作者：Guantian Zheng,Shan Jin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：image requires recovering, single image requires, image requires, requires recovering, mechanism governing

备注： 6 pages, 3 figures, 4 tables

点击查看摘要

Abstract:Generating an articulated object from a single image requires recovering both its appearance and the mechanism governing its parts. A compact encoding of joint attributes does not by itself ensure that reconstruction preserves the resulting motion. We present MoRE, Motion-Regularized Encoding for articulated 3D generation. MoRE represents coordinate-aligned joint lines with axis classification and two axis-orthogonal Plücker moment coefficients, removing the arbitrary choice of an origin along the axis. During representation learning, decoded joint hypotheses are used to move corresponding three-dimensional anchors, and their motions are compared with those of annotated joints. A differentiable expectation over joint types and axis directions couples attribute reconstruction to the motion it induces. An image-conditioned flow learns the resulting functional latents, while a multi-state-adapted Gaussian model supplies appearance. At inference, recovered part assignments and joints articulate a single set of rest-pose Gaussians without regenerating the object for each state. Experiments on PartNet-Mobility and ACD show stronger part-box agreement, articulated-state geometry and visual similarity than the compared baselines, while joint prediction reduces axis, origin and range errors relative to ArtiLatent. Controlled ablations support the joint-line encoding and show that motion supervision reduces anchor-motion error. Code and pretrained checkpoints will be released in the future.

105. 【2610.30326】R4DGS: Referring Segmentation in 4D Gaussian Splatting

链接：https://arxiv.org/abs/2610.30326

作者：Bangpu Chen,Yaxuan Li,Shirui Peng,Xiangtian Si,Liuxin Chu,Xitong Cao,Hongbo Jin,Jiayu Ding

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：shown strong capabilities, methods remain limited, Gaussian Splatting, Dynamic representations based, current methods remain

备注： 10 pages. Accepted at ACM Multimedia 2026. Project page: [this https URL](https://chenbangpu.github.io/R4DGS/)

点击查看摘要

Abstract:Dynamic representations based on 4D Gaussian Splatting (4DGS) have shown strong capabilities in reconstruction and rendering, yet current methods remain limited in supporting complex natural-language referring in dynamic scenes. Existing 4D Gaussian methods are primarily designed for rendering-oriented dynamic modeling, while current semantic extensions often rely on scene-specific semantic optimization or are evaluated on relatively simple query settings. In this paper, we study Referring 4D Gaussian Splatting (R4DGS), a task for grounding temporally varying, multi-target or reasoning-intensive, and zero-target or distractor expressions in dynamic 4D scenes. To support this task, we introduce R4D-Bench-QA, a benchmark with structured query annotations. We further present ReferGaussian, a unified framework built upon 4DGS that converts low-level dynamic Gaussians into persistent, language-addressable entities for training-free referring inference. ReferGaussian organizes mask-supported Gaussian entities in an EntityBank, uses Multimodal Large Language Models (MLLMs) to decompose complex queries into trackable object phrases and structured referring constraints, and performs constraint-aware grounding without scene-specific semantic optimization. Experiments on R4D-Bench-QA and the 4D LangSplat protocol demonstrate improved temporal target selection and competitive spatiotemporal grounding without scene-specific semantic training. Project resources are available at this https URL.

106. 【2610.30320】Self-Distilling Future Video Representations for World Action Models

链接：https://arxiv.org/abs/2610.30320

作者：Huiwon Jang,Suhyeok Jang,Hyeonmo Kang,Seungku Kim,Jinwoo Shin,Sihyun Yu

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：World Action Models, rich spatiotemporal priors, World Action, pre-trained video diffusion, generalist robot policies

备注： 27 pages; Project page: [this https URL](https://huiwon-jang.github.io/FRED/)

点击查看摘要

Abstract:World Action Models (WAMs) have emerged as a promising approach to learning generalist robot policies using rich spatiotemporal priors from pre-trained video diffusion models. A recent line of WAMs improves inference efficiency by conditioning a separate action decoder on intermediate future video representations extracted from a single denoising step, avoiding costly iterative denoising required for video generation. This design makes action prediction depend directly on the quality of these future representations. In this paper, we introduce Future REpresentation learning via self-Distillation with temporal context (FRED), a framework that trains WAMs to improve the quality of future video representations from noise in a single denoising step. Specifically, FRED uses self-distillation to predict future representations from noise, using representations extracted from ground-truth future observations as targets. We further condition the video model on historical observations, providing temporal context for predicting future representations better. Across diverse real-world manipulation scenarios, FRED consistently outperforms competing WAMs. It achieves particularly large gains on long-horizon and out-of-domain tasks under zero-shot environment generalization, and substantially improves human-to-robot skill transfer, reaching 50.0% task success on tasks absent from robot training data and demonstrated only in human videos, compared with 19.4% for the best competing WAM.

107. 【2610.30319】rraTransfer++: Demonstration-Free End-to-End Planner

链接：https://arxiv.org/abs/2610.30319

作者：Zikang Xiong,Weixin Li,Zhouchonghao Wu,Akshay Rangesh,Saarth Bonde,Grantland Hall,Chen Tang,Yihan Hu,Wei Zhan

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：real-world deployments, autonomous driving, fleet-scale driving logs, requires fleet-scale driving, offering diverse behaviors

备注：

点击查看摘要

Abstract:End-to-end autonomous driving has achieved state-of-the-art performance on benchmarks and real-world deployments. Its standard training recipe, however, is expensive across all existing paradigms: imitation learning requires fleet-scale driving logs whose behavior distribution only thinly covers the safety-critical tail; closed-loop reinforcement learning in a photorealistic simulator, while offering diverse behaviors, is bottlenecked by sample-efficiency, per-step cost of rendering, and a forward pass through a large vision backbone. Self-play in vectorized simulators changes the economics: at millions of rollout steps per second, one can obtain a state distribution with natural diversity in collisions, near-misses, and recoveries that no driving log contains, and a highly reactive policy emerges from a basic driving-quality reward. Our approach exploits this asymmetry. We pretrain a single policy by self-play, distill its rollouts into a flow-matching trajectory teacher that also plans, and train lightweight adapters on a frozen pretrained vision backbone to reproduce the latent space of either teacher through the action KL divergence, a batch-relational low-rank structural loss, and, for the planner, a trajectory-matching loss. Every target traces back to the self-play policy, so alignment never supervises against a logged trajectory: a paired dataset of (image, scene-state) frames suffices, with no need for the curated expert demonstrations that imitation pretraining is built on. From this one self-play teacher we obtain two end-to-end students: a closed-loop policy that outperforms every published imitation-based end-to-end method on the photorealistic 3D Gaussian splatting closed-loop benchmark HUGSim, and a planner that reaches 59.4 EPDMS on NAVSIM navhard, above every published method including DriveZero-Scale (57.1), and 95.5 PDMS on navtest, without human demonstrations.

108. 【2610.30293】EgoHand: Monocular 3D Hand Reconstruction from Egocentric Video

链接：https://arxiv.org/abs/2610.30293

作者：Chao-Yeh Chen,Tiffany Chen,Lin Duan,Tianyi Hu,Yu-Hsiang Huang,Umar Iqbal,Jiefeng Li,Edy Lim,Yanchen Liu,Yihan Pang,Hang Qiu,Jun Saito,Shao Su,Qingsi Wang,Xiufeng Xie

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：performance on egocentric, hand reconstruction model, egocentric video, reconstruction model, hand reconstruction

备注： Authors are listed alphabetically. Project leads are Chao-Yeh Chen, Tiffany Chen, and Umar Iqbal

点击查看摘要

Abstract:We introduce EgoHand, a monocular 3D hand reconstruction model that achieves state-of-the-art performance on egocentric video. Central to our approach is the curation of a high-quality training corpus of 14 million images, combining synthetic data, in-the-wild video, and multi-camera motion capture to balance scene diversity and supervision quality. The model adopts SOMA-Hand as its parametric representation and processes 2D hand crops with a transformer encoder, incorporating camera cues and an auxiliary 2D branch to improve geometric consistency and image alignment. Zero-shot evaluations on HOT3D, ARCTIC, and H2O demonstrate strong out-of-domain generalization, with lower joint-position, root-translation, and acceleration errors than competing baselines at an inference latency of approximately 9.69 ms. A blinded user preference study further shows that participants favor EgoHand's reconstructed hand poses over those from Apple EgoDex and Ropedia Xperience-10M. We release the EgoHand model and source code under the OpenMDW license, allowing free commercial use of the model.

109. 【2610.30160】V-JEPA 2 Meets AQA: Phase-Based Scoring and Reference-Based Feedback for Mountain Biking

链接：https://arxiv.org/abs/2610.30160

作者：Santhiya Rajan,Savio Cardoz

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：study mountain-bike action, action quality assessment, mountain-bike action quality, study mountain-bike, mountain-bike action

备注： 27 pages, 10 figures

点击查看摘要

Abstract:We study mountain-bike action quality assessment (AQA) with weak labels and candidate feedback. The training corpus comprises 95 field-recorded jump clips with binary labels denoting good or poor technique. These are coarse categorical labels, not continuous expert quality scores; phase-boundary and aspect-level annotations are unavailable. Our pipeline summarizes four heuristic phases using frozen V-JEPA 2 video features and two-dimensional pose and motion measurements. A small transformer predicts a binary-label score. A separate reference layer compares phase-specific measurements with those of clips labelled as good technique to propose phase, body-parameter, and direction cues. We detail the measurements, network, and evaluation so that the limits of each output are explicit. In five-fold clip-level cross-validation, the full scorer obtained pooled out-of-fold AUROC 0.768 and average precision 0.812. These are exploratory figures because the reporting fold also selected the neural training epoch and riders were not separated between folds. Removing biomechanical scoring inputs raised AUROC to 0.809. A separate inner-selection run obtained AUROC 0.678, but used about 57 rather than 76 training clips per outer fold, so its difference from the test-selected run does not quantify selection bias. The unsupervised aspect head did not learn distinct factors. On a 17-clip external probe, an earlier checkpoint obtained binary accuracy 0.412 and Spearman association -0.135 with expert scores. Candidate cues had precision 0.118 and recall 1.0 against each of two coaches, with substantial disagreement about direction. These findings do not establish rider-independent scoring or reliable corrective feedback; they identify the empirical work needed to evaluate either use.

110. 【2610.31490】Self-Supervised Multibeam Sonar Restoration via Coherent Forward Modeling

链接：https://arxiv.org/abs/2610.31490

作者：Zixin Wang,James Hopgood,Mike Davies

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)

关键词：system-induced blur, Multibeam imaging sonar, imaging sonar produces, intensity images degraded, produces intensity images

备注： 16 pages, 8 figures, includes supplementary material

点击查看摘要

Abstract:Multibeam imaging sonar produces intensity images degraded by coherent speckle and system-induced blur, while clean reflectivity targets are rarely available. Existing despeckling methods often rely on simplified intensity-domain noise models, synthetic clean targets, or blind-spot self-supervision, and typically do not jointly model deblurring and speckle suppression. We propose a physics-consistent self-supervised framework for joint despeckling and deblurring of multibeam imaging sonar. A stochastic coherent image-formation model yields a conditional-mean forward operator that relates latent scene reflectivity to expected intensity through the squared magnitude of the system point spread function. We then use registered multi-frame sonar sequences to train without clean ground truth images, showing that, under an idealized inter-frame conditional-mean condition, the expected paired loss equals the corresponding forward-prediction loss up to a network-independent constant. To stabilize the ill-conditioned inverse problem, we further adapt robust equivariant imaging using stochastic coherent simulation and introduce a paired forward prediction error metric for ground-truth-free evaluation. Experiments on two real multibeam sonar datasets demonstrate a favourable balance between forward-prediction agreement, homogeneous-region speckle suppression, and preservation of visible structural boundaries compared with representative baselines.

Comments:
16 pages, 8 figures, includes supplementary material

Subjects:

Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)

Cite as:
arXiv:2610.31490 [eess.IV]

(or
arXiv:2610.31490v1 [eess.IV] for this version)

https://doi.org/10.48550/arXiv.2610.31490

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

111. 【2610.30966】Bound-Conditioned Latent Inference for Progressive Image Compression

链接：https://arxiv.org/abs/2610.30966

作者：Jaeseok Jang,Seungmin Jeon,Kwang Pyo Choi,Chang-Su Kim

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词：image compression reconstructs, compression reconstructs images, sequential latent inference, involves sequential latent, partial observations

备注： Accepted to NeurIPS 2026

点击查看摘要

Abstract:Progressive image compression reconstructs images from prefixes of a single bitstream and therefore involves sequential latent inference under partial observations. Existing trit-plane codecs mainly treat decoded trits as discrete symbols for probability prediction, without fully exploiting their role as interval constraints on the underlying continuous latents. We propose bound-conditioned latent inference (BLI), a framework that reformulates progressive trit-plane coding as sequential latent inference under shrinking interval constraints. At each coding step, the trits decoded so far define lower and upper bounds for each latent element. BLI uses the center and width of these bounds, together with hyperprior information shared by the encoder and decoder, to jointly refine the Gaussian parameters $(\mu,\sigma)$ for entropy modeling and the latent estimate $\hat{y}$ for reconstruction. As additional trits are decoded, the feasible intervals shrink monotonically, yielding tighter constraints for the next inference step and enabling flexible in-plane refinement schedules. Experiments on Kodak, CLIC, and JPEG-AI show that BLI achieves state-of-the-art rate-distortion performance among progressive image codecs, reducing BD-rate by $17.78\%$ over DPICT and by $7.96\%$ over CTC on Kodak, while replacing CTC's plane-specific predictors with a shared model that uses about $5.3\times$ fewer parameters and achieves lower latency than CTC.

112. 【2610.30942】GateFormer: Forecast-Space Decomposition for Intra-Hour Solar Irradiance Prediction from Sky Images

链接：https://arxiv.org/abs/2610.30942

作者：David Hamlyn,Sunny Chaudhary,Jonathon Hare,Tasmiat Rahman

类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：storage control increasingly, control increasingly depend, anticipate rapid variability, Sub-hourly dispatch, solar generation

备注：

点击查看摘要

Abstract:Sub-hourly dispatch, balancing, and storage control increasingly depend on forecasts that anticipate rapid variability in solar generation. Accurate sky-image-based irradiance forecasting requires a combination of visual cloud dynamics with recent irradiance state while adapting to different short-term irradiance-change regimes. To address this, we introduce GateFormer, a GHI-conditioned dual-decoder ViT for intra-hour global horizontal irradiance (GHI) forecasting through forecast-space decomposition. GateFormer embeds observed GHI into the visual token stream, allowing interaction with sky-image patch features through self-attention. From this shared representation, a Trajectory Head predicts future GHI sequence, while a Delta Head predicts final-horizon change from the latest observed GHI. The two final-horizon forecasts are adaptively weighted in prediction space, with magnitude- and direction-supervision targeting the remaining error. On the NREL-TSI benchmark, GateFormer attains 125.01 W/m^2 RMSE at +30 min, improving over a state-of-the-art transformer baseline by 9.6% under paired-timestamp evaluation. Across NREL-TSI, Chilbolton, and SIRTA, GateFormer achieves the lowest final-horizon RMSE among the evaluated baselines, with forecast skill of 22.97-28.86% relative to smart persistence. Component ablations show adaptive weighting outperforms both individual decoders and fixed averaging, distinguishing GateFormer from conventional forecast combination, while the supervised correction further reduces RMSE by 1.68 W/m^2 and MAE by 4.86 W/m^2. Ramp-regime diagnostics show larger gains during operationally important positive ramps, reducing RMSE by 26.27 W/m^2. These results identify forecast-space decomposition as an alternative forecasting formulation, with potential relevance to other multimodal short-horizon forecasting tasks and deployment using only sky images and measured GHI.

113. 【2610.30940】Vision Transformers for Estimating Irradiance Using Data Scarce Sky Images

链接：https://arxiv.org/abs/2610.30940

作者：David Hamlyn,Sunny Chaudhary,Tasmiat Rahman

类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：optimising photovoltaic system, photovoltaic system performance, regions lacking comprehensive, lacking comprehensive ground-based, comprehensive ground-based instrumentation

备注：

点击查看摘要

Abstract:Accurate estimation of diffuse horizontal irradiance (DHI) is critical for optimising photovoltaic system performance and energy forecasting yet remains challenging in regions lacking comprehensive ground-based instrumentation. Recent advancements using Vision Transformers (ViTs) trained on extensive sky image datasets have shown promise in replacing costly irradiance measurement equipment, but the scarcity of long-term, high-quality sky imagery significantly restricts practical implementation. Addressing this critical gap, this study proposes a novel dual-framework approach designed for data-scarce scenarios. First, calculated atmospheric parameters, including extraterrestrial irradiance and cyclic time encodings, are integrated to represent sky conditions without utilising any instrumentation. Next, a sequential pipeline initially predicts synthetic global horizontal irradiance (GHI) and uses it as a feature, to refine DHI estimation. Finally, a dual-parallel architecture simultaneously processes raw and overlay-enhanced fisheye sky images. Overlays are generated through unsupervised, physics-informed cloud segmentation to highlight dynamic sky features. Empirical validation is performed using data from the Chilbolton Observatory, chosen for its temperate climate and frequent cloud variability. To simulate data-scarce conditions, models are trained on a single month (e.g., January) and evaluated across a temporally disjoint, full-year test set. Under this setup, the sequential and dual-parallel frameworks achieve RMSE values within 2-3 W/m^2 and 1-6 W/m^2, respectively, of a state-of-the-art ViT trained on the complete dataset. By combining physics-informed modelling with unsupervised segmentation, the proposed method provides a scalable and cost-effective solution for DHI estimation, advancing solar resource assessment in data-constrained environments.

114. 【2610.30910】H-2DGS: Height-Field Gaussian Splatting for Sharp and Deformable Neurosurgical Surface Reconstruction

链接：https://arxiv.org/abs/2610.30910

作者：Zhang Zichuan,Bart Brouwers,Rembrandt Bakker,Maud Landers,Geert-Jan Rutten,Maxime Chamberland

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词：magnetic resonance imaging, navigation commonly presents, commonly presents magnetic, presents magnetic resonance, Neurosurgical navigation commonly

备注：

点击查看摘要

Abstract:Neurosurgical navigation commonly presents magnetic resonance imaging (MRI) as 2D slices, making it difficult to relate the anatomy in those slices to the cortical surface observed through the surgical microscope. We seek a common 3D visualization that combines a photorealistic reconstruction of the exposed cortex during tumor surgery with whole-brain MRI context and diffusion tractography pathways. This requires the reconstructed cortex to form a clear boundary around the brain anatomy rather than a diffuse volume that obscures internal structures. Conventional 3D Gaussian Splatting (3DGS) can reproduce observed views but, under limited surgical view coverage, may distribute opacity through a thick and geometrically ambiguous band. We introduce height-field 2D Gaussian Splatting (H-2DGS), a three-stage pipeline that concentrates a robust 3DGS reconstruction, fuses its depth into a shared truncated signed distance field (TSDF) surface, and represents that surface with curved, surface-oriented Gaussian primitives. Separate height, color, and opacity bases provide local geometry and appearance, while a neighbor-transition objective coordinates overlapping patches. The explicit surface further supports postoperative alignment: MRI-derived depth deforms the reconstruction, and tracked-color supervision with alternating optimization preserves its appearance. Across five real neurosurgical cases, H-2DGS gives low multi-view depth inconsistency, a compact 7.97MB representation, and interactive rendering at 29--42ms per frame. The resulting sharp, deformable surface integrates clearly with tractography and MRI anatomy, including a postoperative resection cavity.