本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表,以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新826篇论文,其中:

  • 自然语言处理147篇
  • 信息检索11篇
  • 计算机视觉128篇

自然语言处理

1. 【2610.23847】Behavioral Couplings: From Formation to Behavioral Emergence in Language Models

链接:https://arxiv.org/abs/2610.23847

作者:Dongyoon Hahm,Woogyeol Jin,Dennis Wei,Yi Zhou,Nathalie Baracaldo,Kimin Lee

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:large language models, Fine-tuning large language, explicitly targeted, large language, behaviors

备注:

点击查看摘要

Abstract:Fine-tuning large language models (LLMs) can induce behaviors beyond those explicitly targeted. For example, training a model to respond more warmly can make it more sycophantic, and training it to write insecure code can cause broad misalignment on prompts unrelated to coding. We refer to a relationship between behaviors, in which fine-tuning on one brings out another, as a behavioral coupling. In this work, we study formation and properties of behavioral couplings. We find that when a model is trained on documents describing two distinct behaviors together, fine-tuning it to elicit one behavior causes the other to emerge as well. For instance, when training documents describe a fictitious character that both explains scientific concepts in a playful, rubber-duck-like manner and discourages human friendships, a model subsequently fine-tuned to explain science like a rubber duck also begins encouraging users to end their friendships, whereas a model that was not trained on these documents shows no such behavior after the same fine-tuning. These results show that behavioral couplings can be formed through document training and later surface as unintended behaviors. More concerningly, we find that couplings can compose. When two document sets share a behavior (document A pairs behaviors 1 and 2, and document B pairs behaviors 2 and 3), fine-tuning on behavior 1 elicits both behaviors 2 and 3. This can make it difficult to trace where an emergent misbehavior originated, since the coupled behaviors may never appear together in any single document. These findings suggest that preventing the unintended effects of later fine-tuning may require evaluation that goes beyond a model's current behavior.

2. 【2610.23845】AI-Driven Reproducibility and Analytical Robustness in Scientific Discovery

链接:https://arxiv.org/abs/2610.23845

作者:Shicheng Liu,Krista Opsahl-Ong,Andrew Drozdov,Julian Killingback,Arnav Singhvi,Ronak Pradeep,Michael Bendersky,James C. Dickerson,Monica S. Lam

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:costly manual effort, analytically robust research, properties typically requires, typically requires costly, requires costly manual

备注:

点击查看摘要

Abstract:Reproducible and analytically robust research findings are essential to scientific progress, but evaluating these properties typically requires costly manual effort. We investigate whether LLM agents can help automate reproduction and robustness analysis, using a medical case study grounded in the Surveillance, Epidemiology, and End Results (SEER) database, a widely used U.S. cancer registry underlying tens of thousands of published studies. First, we introduce SEER-Repro, a benchmark of 20 published SEER-based papers together with the data and resources required to reproduce their findings. Second, we create an AI agent that successfully reproduces 77.4% of 2,190 atomic claims, while providing executable baselines for further analysis. Third, we develop an agentic analysis pipeline to test the robustness of the medical findings by identifying analytical choices underlying each finding, proposing defensible alternatives, and rerunning the analysis to determine whether those choices affect the conclusion. Across published papers in SEER-Repro, our pipeline identifies potentially consequential analytical choices in 9.5% of fully reproduced findings and flags them for expert review. These results show how LLM agents can support scientific review by reproducing findings, systematically testing their robustness, and directing expert attention toward potentially consequential analytical choices.

3. 【2610.23839】DiscoveryRSI: Recursively Learning to Discover Valuable Hypotheses

链接:https://arxiv.org/abs/2610.23839

作者:Jianyuan Zhong,Chenwei Wu,Zhaochen Yu,Xixian Jiang,Xuewei Li,Hao Xiao,Xilin Dai,Junyang Wang,Jiaru Zou,Zhiqing Cui,Boyuan Zheng,Jing Xiong,Zhen Zhang,Qiang Gao,Michael Morley,Luis Nakayama,Qiang Xu,Liyue Shen,Tao Gui,Leo Anthony Celi,James Zou,Zhenfei Yin,Yingcheng Wu,Ling Yang

类目:Computation and Language (cs.CL)

关键词:process remains challenging, discovery requires developing, requires developing worthwhile, Scientific discovery requires, developing worthwhile hypotheses

备注: Code: [this https URL](https://github.com/Gen-Verse/DiscoveryRSI)

点击查看摘要

Abstract:Scientific discovery requires developing worthwhile hypotheses into practical investigations, yet learning from this evolving research process remains challenging. We introduce an operational definition of valuable and testable research hypotheses: evidence-grounded claims about consequential uncertainties, coupled with feasible investigations, explicit decision criteria, and alternative explanations. Our DiscoveryRSI framework develops hypothesis trees through multi-agent evolutionary search, compiles selected investigations into executable Harbor tasks, and recursively learns through three mechanisms: hypothesis credit optimization attributes scientific assessments to documented research contributions; harness replay identifies productive strategies and recurring failures to refine research workflows; and rediscovery applies accepted improvements to new investigations, generating further experience for subsequent learning. We also introduce DFM-Bench, which provides comprehensive assessment of hypothesis quality and cumulative research progress at the levels of hypotheses, revisions, development paths and research runs. Across four life-science domains, automated evaluation shows that hypothesis quality rises from 4.86 for the base model to 5.39 after two rounds of self-improvement, with the large gains in falsifiability and data resolvability. We further validate hypothesis quality through expert review, comparing our DiscoveryRSI-27B with other research agents. Preliminary human assessments show that DiscoveryRSI-27B scores higher than GPT-6 Luna on hypothesis importance and whether claims are plausible and evidence-bounded. DiscoveryRSI-27B achieved a 6.3% rate of hypothesis correspondence with research published after the model cutoff, largely outperform GPT-6 with 2.5% and Claude Opus 5 with 2.3%, while delivering greater human-rated improvement along research paths.

4. 【2610.23831】Beyond the Answer: Student-Conditioned Trace Construction for Reasoning Distillation

链接:https://arxiv.org/abs/2610.23831

作者:Shaoang Li,Yanhang Shi,Yufei Li,Mingfu Liang,Frank Shyu,Sandeep Pandey,Luke Simon,Xi Liu,Jian Li

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:providing effective supervision, accompany a correct, providing effective, effective supervision, correct answer

备注:

点击查看摘要

Abstract:A reasoning trace can accompany a correct answer without providing effective supervision for a particular student. We study how to construct traces that improve learning beyond answer-only supervision by considering both their intermediate content and their accessibility to the target learner. We introduce ReDiST, a student-conditioned trace-construction and distillation framework for evidence-rich reasoning. Starting from the student's own attempts, ReDiST revises answer-correct drafts against the supplied evidence and repairs unsuccessful drafts with additional guidance from the verified answer. A frozen student-matched reader screens and ranks original and edited candidates using answer recovery and verified-answer probability, given the question, evidence, and candidate trace. We distill the selected targets while balancing trace and final-answer supervision with an auxiliary answer loss. Construction and selection occur offline, and inference uses only the distilled student. Experiments on question-answering benchmarks show that ReDiST can improve both source-task and cross-benchmark performance over answer-only, original-trace, and the evaluated trace-selection and rewriting baselines. Across supervision recipes, performance rankings can differ between source and transfer benchmarks, highlighting the importance of evaluating trace teaching utility across distributions.

5. 【2610.23818】Acceptance Is Not Speed: Length Inflation in Training-Free Lossy Speculative Decoding

链接:https://arxiv.org/abs/2610.23818

作者:Chiatzen Wang,Bill Xu,Haochen Gu,Hongyang Zhang

类目:Computation and Language (cs.CL)

关键词:verification, Speculative decoding typically, Speculative decoding, relaxed verification, typically characterizes speedup

备注: Submitted for NAACL 2027, under review

点击查看摘要

Abstract:Speculative decoding typically characterizes speedup by draft tokens accepted per verification round. Lossless verification preserves the target model's output distribution and thus expected completion length, making this metric a meaningful efficiency proxy. Relaxed (lossy) verification accepts tokens that lossless verification would reject, potentially altering that distribution. We identify a length inflation phenomenon: relaxed verification lengthens completions, primarily by extending reasoning traces, largely offsetting apparent gains in accepted tokens per round. We evaluate existing training-free relaxed verification rules on twelve target-drafter pairs against lossless verification on identical prompts, measuring completion length, verifier rounds, wall-clock time, and task accuracy. At each rule's most relaxed evaluated setting, relaxed verification on average accepts $1.34\times$ as many tokens per round but produces $1.54\times$ longer completions. For rules with higher acceptance lengths, tokens accepted only under relaxed verification tend to have low target-model probability, contributing to length inflation. For rules that reduce verifier rounds, accuracy typically drops substantially. Further analysis traces some failures to continued reasoning that exhausts the budget needed to deliver a final answer. Overall, accepted tokens per round alone is an unreliable measure of decoding speed under relaxed verification. Completion length and verifier rounds must also be reported to assess actual efficiency.

6. 【2610.23807】Steering beyond Language: Improving Multilingual Training-Free Text Embeddings via Paired-Residual Subspace Removal

链接:https://arxiv.org/abs/2610.23807

作者:Ailiang Lin,Zhuoyun Li,Yusong Wang,Keyu Mao,Kotaro Funakoshi,Manabu Okumura

类目:Computation and Language (cs.CL)

关键词:settings largely unexplored, promising direction, largely unexplored, existing methods focus, deriving text embeddings

备注:

点击查看摘要

Abstract:While deriving text embeddings directly from frozen LLMs has emerged as a promising direction, existing methods focus almost exclusively on English, leaving multilingual settings largely unexplored. In this work, we present the first systematic study of multilingual training-free text embeddings in LLMs. Our analysis reveals a language-conditioned embedding geometry in which semantically equivalent sentences remain misaligned across languages. We hypothesize that language-specific variation can be disentangled from semantic content to improve embedding quality. To this end, we propose Paired-Residual Subspace Removal (PRSR), a training-free inference-time intervention that steers LLM representations toward a more language-invariant semantic space. PRSR first constructs paired residuals from multilingual parallel sentences to capture language-specific deviations. It then estimates layer-wise low-rank subspaces from these residuals and suppresses the corresponding components in the last-token hidden states. We conduct more than 200 monolingual evaluations across 18 languages using MTEB and MMTEB, along with cross-lingual bitext mining between English and over 200 other languages. Empirical results demonstrate that PRSR consistently improves the performance of existing training-free baselines in both monolingual and cross-lingual settings across different LLMs.

7. 【2610.23787】DLite: History-free Speculative Decoding for Agentic AI

链接:https://arxiv.org/abs/2610.23787

作者:Jiaming Xu,Hanzhen Wang,Tianlang Zhao,Jiewen Xiao,Chengze Yuan,Jiayi Pan,Yongkang Zhou,Jiancai Ye,Yu Wang,Guohao Dai

类目:Computation and Language (cs.CL)

关键词:accelerating large language, generate candidate tokens, large language model, mainstream technique, technique for accelerating

备注: 14 pages, 5 figures

点击查看摘要

Abstract:Speculative decoding has become a mainstream technique for accelerating large language model (LLM) inference by using a lightweight draft model to generate candidate tokens that are subsequently verified by the target model. However, agentic workloads introduce long and continuously evolving contexts and frequent multi-turn interactions. Under such workloads, we observe that existing draft models suffer from up to an 80% degradation in acceptance length, while maintaining their historical KV cache introduces substantial system overhead. In this paper, we identify the growing historical context as a common source of both problems and introduce DLite, a history-free speculative decoding framework for agentic AI. DLite directly reuses contextual hidden states from the target model and performs local speculative prediction without explicitly maintaining the historical context, transforming an increasingly complex modeling problem into local simple prediction problem. A lightweight sequential head further restores intra-block causal dependencies with low overhead. To effectively train this heterogeneous history-free architecture, we introduce a tailored two-stage training strategy. Experiments on general-purpose, long-context and agentic workloads show that DLite achieves 2-6 acceptance length and outperforms the state-of-the-art speculative decoding method, DSpark, up to 70%.

8. 【2610.23745】VocalGrad: Evaluating Acoustic Perception in Audio Language Models

链接:https://arxiv.org/abs/2610.23745

作者:Koki Ryu,Hitomi Yanaka

类目:ound (cs.SD); Computation and Language (cs.CL)

关键词:Recent large audio, tasks requiring paralinguistic, Recent large, non-linguistic audio understanding, large audio language

备注: NeurIPS 2026 (Evaluations Datasets Track). Dataset page: [this https URL](https://huggingface.co/datasets/ynklab/vocalgrad)

点击查看摘要

Abstract:Recent large audio language models (LALMs) have extended their capabilities beyond lexical speech understanding to tasks requiring paralinguistic and non-linguistic audio understanding, such as emotion recognition. However, these models still struggle to reliably utilize acoustic information, particularly when it co-occurs with spoken linguistic content. Existing benchmarks do not clearly distinguish acoustic perception from higher-level reasoning, making it difficult to identify the source of these failures. To address this issue, we introduce VocalGrad, a benchmark designed to evaluate LALMs' ability to perceive low-level acoustic variations. VocalGrad formulates this problem as a simple binary classification of temporal change direction, enabling evaluation largely independent of higher-level reasoning or semantic understanding. Our benchmark results reveal a substantial gap in acoustic perception between human annotators and state-of-the-art LALMs: while human annotators achieve high accuracy, LALMs perform at near-chance levels. We further conduct linear probing to identify structural bottlenecks in these models. Our analysis reveals two distinct failure modes: for some categories, task-relevant information is preserved in internal representations but not utilized by the language model head; for others, the information becomes progressively less linearly decodable across model layers. Overall, our results reveal substantial limitations of LALMs in modeling acoustic variation under controlled settings and expose representation differences not observable from text outputs.

9. 【2610.23741】he Italian lawmaking process: a unified and structured dataset

链接:https://arxiv.org/abs/2610.23741

作者:Matilde Contestabile,Chiara Ferrara,Giovanni Parrillo,Lorenzo Emer,Andrea Vandin

类目:Computation and Language (cs.CL)

关键词:Italian legislative process, institutional websites, process is documented, documented in detailed, hosted in institutional

备注:

点击查看摘要

Abstract:The Italian legislative process is documented in detailed parliamentary records hosted in institutional websites. However, much of this information is available only as unstructured text, limiting its systematic reuse. We applied a controlled, systematic LLM-based extraction procedure, validated against manually annotated records, to convert these texts into ordered and dated events including, e.g., bill introduction, committee examination, plenary examination, and approval. The resulting dataset reconstructs the procedural histories of all 5346 Italian laws enacted between 1985 and 2026, spanning parliamentary terms IX to XIX, for overall 101413 events. Each event records the activity, date, and chamber, with additional procedural details where available. The dataset supports research in the emerging fields of computational legal and legislative studies, potentially combined with process-oriented data science methods to examine procedural paths and legislative timing across parliamentary terms.

10. 【2610.23734】Bridging the Language Gap in Scholarly Data II: Enhancing Gender Inference for Chinese Names

链接:https://arxiv.org/abs/2610.23734

作者:Lisette Espín-Noboa,Mingrong She,Ana Maria Jaramillo,Liuhuaying Yang

类目:Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Physics and Society (physics.soc-ph)

关键词:inclusive scientometrics research, Perceived gender inference, methods perform poorly, Perceived gender, Pinyin

备注: 36 pages (13 main; 23 SI), 6 figures in main (under review)

点击查看摘要

Abstract:Perceived gender inference from names is important for inclusive scientometrics research, yet existing methods perform poorly on non-Western scholars. We address this gap for Chinese names, which appear in two forms, Hanzi and Pinyin, its Romanized form (e.g., Zhang Wei, Li Na). In international bibliographic records, names are often available only in Pinyin. However, a single pinyin name can correspond to multiple distinct hanzi characters with different gender associations, so gender inference from Pinyin alone is intrinsically ambiguous. To address this, we first develop two hanzi models, a regression model that produces a continuous gender score from 0 (male) to 1 (female), and a classification model that outputs one of three labels (\em{male}, \em{neutral}, \em{female}). We train them on a sample of hanzi names from Chinese-language physics publications, rated by 11 native Chinese speakers. On this sample, the models achieve an RMSE of $0.09$ and an R$^2$ of $0.85$ (regression), and macro-AUC of $0.97$ and a Cohen's $\kappa$ of $0.81$ (classification), demonstrating high performance that is robust to class imbalance. For pinyin names, we propose a pipeline that aggregates hanzi predictions via transliteration and frequency weighting, together with an ambiguity score that flags names whose gender cannot be resolved from Pinyin alone. Benchmarked against three off-the-shelf tools (Namsor, GPT, and Claude), our models achieve the highest agreement with human annotations for both gender scores and gender labels, in both scripts. Applied to an independent sample of Chinese-named authors in APS journals, our models assign a gender to every name, whereas existing Pinyin-based methods leave between 20\% and 100\% of names unclassified. These findings demonstrate the importance of hanzi-level information for reliable gender inference of Chinese names. Code and data are publicly available.

11. 【2610.23726】RedDarwin: Evolving Jailbreak Skills against Frontier LLMs

链接:https://arxiv.org/abs/2610.23726

作者:Zhouyuan Ma,Yutao Wu,Hanxun Huang,Xiang Zheng,Yi Liu,Xingjun Ma

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词:existing approaches largely, approaches largely search, fixed attack procedures, LLM safeguards evolve, continually adapt

备注:

点击查看摘要

Abstract:Red teaming must continually adapt as frontier LLM safeguards evolve, yet existing approaches largely search for adversarial prompts or optimize within fixed attack procedures. We observe that even when an attack becomes ineffective, its underlying mechanisms can remain useful and can be revised or recombined to construct stronger attacks. Based on this insight, we introduce RedDarwin, an agentic framework that shifts the unit of jailbreak evolution from prompts and fixed attacks to executable attack skills. RedDarwin consists of 47 reusable base skills and autonomously revises, composes, executes, and selects them using target-model feedback, allowing successful discoveries to become building blocks for subsequent evolution. RedDarwin produces 65 evolved skills, improving 44 of 47 base attacks and increasing their mean attack success rate (ASR) on AdvBench from 18.8% to 47.3%. These evolved skills consistently outperform baselines on the held-out StrongREJECT and frontier LLMs unseen during evolution; with only 10 target-model queries, RedDarwin achieves 100% ASR on GPT-5.6-Sol, 92% on Claude-Sonnet-5, and 80% on Gemini-3.8-Flash. Analysis of the evolution trajectories further shows that strong attacks often emerge from novel combinations of reusable mechanisms rather than from individually dominant ones. We believe this paradigm can accelerate adaptive red teaming and inform stronger safeguards, creating complementary value for both safety evaluation and defense.

12. 【2610.23721】Recognizing Study Lineage Is Not Enough: Over-Crediting Same-Trial Evidence in LLM-Based Medical Verification

链接:https://arxiv.org/abs/2610.23721

作者:Mukand Krishna,Anoushka Harit,Chenghao Xiao,Zhongtian Sun

类目:Computation and Language (cs.CL)

关键词:Publication count, study count, count, Publication, families

备注: 20 pages, 5 figures, 17 tables; 8 pages of main content, with references and appendices thereafter

点击查看摘要

Abstract:Publication count is not study count. A model can identify shared trial lineage correctly in a direct task yet over-credit a second publication from the same trial when aggregating evidence. We evaluate this behavior in medical LLM verification using 14 source-audited clinical families and five model conditions. The families span provenance, clinical applicability, result direction, and composition; the provenance families provide the direct lineage tests. Recognition and aggregation are separate stateless calls, and repeated calls assess within-input stability. Across all three original provenance families, GPT-5.5 identifies the independent update in 10/10 recognition calls per family but over-credits the same-trial report in 5/5 separate aggregation calls per family. Selected Qwen3-4B and Ministral-3-8B conditions show the same cross-task contrast. A study-grouping instruction reduces GPT-5.5 over-credit from 4/5 to 0/5 in each later pure-provenance family. Other model conditions show mixed behavior, and rejected outputs limit several comparisons. The results identify a behavioral gap between elicited lineage recognition and evidence aggregation. The code and data artifacts are available at this https URL.

13. 【2610.23715】he Cognitive Cost of LLM Writing: A Reading-Time Comparison with Human Text

链接:https://arxiv.org/abs/2610.23715

作者:Kamer Cekini,Elisabetta Biondi,Chiara Boldrini,Andrea Passarella,Marco Conti

类目:Computation and Language (cs.CL)

关键词:Large Language Model, Large Language, Language Model, extensively studied, remain less explored

备注:

点击查看摘要

Abstract:Although linguistic differences between human-written and Large Language Model (LLM)-generated texts have been extensively studied, their implications for the cognitive effort involved in reading remain less explored. In psycholinguistics, reading time is commonly used as an indirect measure of cognitive processing effort. Building on this perspective, we investigate whether human-written texts and their LLM-generated rewrites exhibit differences in predicted reading time that may reflect differences in processing demands for readers. To this end, we introduce RoBERTa-RT, a model trained on human eye-tracking data to predict word-level reading times. We evaluate the model on both internal and external test sets, construct a paired dataset of 496 human-written articles and their LLM-generated rewrites, and apply RoBERTa-RT to compare their predicted reading times. Our findings show that LLM-generated rewrites tend to be shorter and have slightly lower predicted total reading times, while exhibiting higher predicted reading times per word. These differences are associated with systematic linguistic changes, including longer and less frequent words, greater lexical diversity, and higher contextual predictability. From a cognitive perspective, our findings suggest that LLM-generated writing may redistribute reading demands: reducing the amount of text to process while increasing the predicted processing effort associated with individual words. This highlights the importance of considering not only the linguistic characteristics of machine-generated content, but also its potential implications for human cognitive processing.

14. 【2610.23709】GLOBE: Evolving Structured Agentic Memory for E-commerce Product Optimization in Generative Search

链接:https://arxiv.org/abs/2610.23709

作者:Hyunseo Kim,Suil Choe,Sukkyoung So,Daeyeon Yi

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:requires language agents, Optimizing product listings, generative search requires, search requires language, retaining successful strategies

备注: Accepted to the Second Workshop for Research on Agent Language Models(REALM) at EMNLP 2026

点击查看摘要

Abstract:Optimizing product listings for generative search requires language agents not only to rewrite effectively but also to continually self-improve by retaining successful strategies across diverse categories. However, existing approaches often treat structured listings as free-form text, leaving effective strategies implicit in prompts, search trajectories, or rewritten outputs rather than accumulating them as a reusable agentic memory. To address this limitation, we introduce GLOBE, an agentic framework that drives continual self-improvement by storing optimization knowledge in an evolving handbook of explicit, field-scoped behaviors. In each episode, an Editor applies relevant behaviors and receives rank-based feedback, which a Reflector converts into behavior updates. Crucially for dependable execution in real-world settings, a Moderator removes redundant proposals, a Curator commits accepted changes, and consistently harmful behaviors are deactivated. This cycle transforms episodic feedback into a persistent, field-scoped optimization memory. Experiments show that structured behaviors outperform monolithic prompt optimization, while feedback-driven evolution and moderation further improve effectiveness and reduce downside risk. The learned behaviors also remain effective on unseen product categories, suggesting that agentic memory evolution supports interpretable and transferable product optimization.

15. 【2610.23702】VISTA: Steering LLMs with Latent User Values Inferred from a Few Survey Answers

链接:https://arxiv.org/abs/2610.23702

作者:Yinuo Xu,Jadie Adams,Brian Hu,Shivani Kumar,David Jurgens,Arslan Basharat

类目:Computation and Language (cs.CL)

关键词:stays largely consistent, language model requires, model requires knowing, Personalizing a language, consistent across tasks

备注: 8 pages, 4 figures

点击查看摘要

Abstract:Personalizing a language model requires knowing what a person values, which stays largely consistent across tasks. Yet most methods either learn task-specific preferences or place the user's profile in the prompt, where models struggle to act on it. We introduce VISTA (Value-Informed Steering and Targeted Acquisition), which infers a latent profile from users' (full or partial) survey answers, and maps the profile through a hypernetwork to a user-specific steering intervention in a frozen LLM to select answer choices or generate free-text responses. Given the same evidence, VISTA matches or beats in-context profiles on synthetic preferences (Food2D), the World Values Survey (WVS), and PrimeX, without adding prompt tokens. To reduce the cognitive burden of completing full surveys, VISTA also chooses which questions to ask and when to stop: on WVS it stops after 6% of the questionnaire while retaining 94% of the full-history gain, where standard adaptive testing retains at most 42%. The dominant steering direction is an interpretable value axis on which VISTA places unseen users accurately. Our results point toward pluralistic alignment that adapts to individuals at deployable cost.

16. 【2610.23678】Beyond the Benchmark: Conditioning, Domains and Failure Modes of Qwen3-TTS

链接:https://arxiv.org/abs/2610.23678

作者:Séverin Baroudi,Yanis Labrak,Petr Motlicek,Hervé Bredin,Ricard Marxer

类目:ound (cs.SD); Computation and Language (cs.CL)

关键词:technical report leaves, report leaves open, zero-shot voice cloning, technical report, report leaves

备注:

点击查看摘要

Abstract:Qwen3-TTS reports state-of-the-art zero-shot voice cloning, but its technical report leaves open how the model should be conditioned, how it behaves outside read speech, and how it fails. We characterise its two cloning interfaces, in-context learning (ICL) and X-Vector, against Chatterbox, XTTS-v2 and F5-TTS on read, meeting, emotional and air-traffic-control (ATC) speech, using eighteen objective measures, an LLM judge, a spoofing countermeasure and a listening test. Neither interface dominates: ICL clones timbre more closely from correctly transcribed references, X-Vector clones timing, and ICL degrades sharply when a short reference transcript is wrong. Domain explains four times more variance than system choice. Qwen3-TTS leads on intelligibility and pitch register but trails on prosody, and the objective measures rank systems differently from listeners. An off-the-shelf countermeasure flags its clones no more often than genuine recordings, and on ATC radio it fails for every system. Code and audio are released.

17. 【2610.23651】In Human Memories. Technology, Creativity and Self-Determination: An Ethical Proposal

链接:https://arxiv.org/abs/2610.23651

作者:Francesco Vitucci,Giuseppe Silvi,Francesco Abbrescia,Anthony Di Furia,Francesco Scagliola

类目:Computation and Language (cs.CL)

关键词:Electronic Music School, modern compositional practices, Alexander Schubert, Francesco Vitucci, String Ensemble

备注: 19 pages, 7 figures. English translation of the article originally published in Italian in Ex Chordis, vol. 3 (2024), pp. 15-38. The Italian original is the version of record

点击查看摘要

Abstract:This research investigates the role of artificial intelligence (AI) in modern compositional practices, with a particular focus on two case studies: Convergence (2020/21) by Alexander Schubert, for String Ensemble and AI System, and In Human Memories (2024) by Francesco Vitucci, for four cellos and one electroacoustic player, whose installation was created by the Electronic Music School of the "N. Piccinni" Conservatory of Bari. The initial historical survey traces the evolving use of technology in composition, revealing how the search for new expressive possibilities has driven the development of technological tools through experimentation. The appearance of AI marks a fundamental shift: no longer just a tool, AI now poses questions and challenges to the composer. Engaging with AI becomes an exploration of an unknown entity, whose full capabilities are still largely undiscovered. This new interaction leads composers to confront AI not merely as a passive resource but as a participant in the creative process, outlining an ethical path to reclaim technology as a creative tool. In Human Memories reflects this dynamic, demonstrating how AI can serve as both inspiration and a driving force in shaping contemporary music.

18. 【2610.23625】PresenceBench: An Exploratory Evaluation of Large Language Model Adaptation to User State

链接:https://arxiv.org/abs/2610.23625

作者:Peña Arroyo Gallego,Mauro Ruiz Moreno,Alejandro Acien,Sergio Romero-Tapiador,Teresa Arroyo-Gallego

类目:Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:preserving task quality, Presence-aware intelligence, system intelligence layer, person it serves, quality and safety

备注: 33 pages, 6 figures, 13 tables

点击查看摘要

Abstract:Presence-aware intelligence is the capacity of an AI system's intelligence layer to adapt appropriately to the functional state of the person it serves (here readiness, flow, and stability) while preserving task quality and safety. We introduce PresenceBench, an instrument for measuring it. PresenceBench evaluates how the intelligence layer uses a supplied state, not how that state is sensed, and breaks the capability into measurable properties. Two are tested here. Receptivity: does the model take up the state and give a better response than with no signal? Specificity: does any improvement depend on the correct state, rather than on extra structured context? A third, adaptation across states, is a required endpoint not measured in this release. A five-arm causal design answers both questions, against each model's own baseline and an equally structured mismatched-state control, scored by a correctness-gated human paired comparison. The exploratory evaluation covered four models across eighteen single-turn, six fixed three-turn and six simulated natural-conversation scenarios. Supplying a synthetic state, raw or translated into a response policy, gave human-preference point estimates above 0.5 for all four models (Claude Sonnet 5, DeepSeek V4 Pro, Gemini 3.6 Flash, GPT-5.6 Terra), with three of eight 95% intervals excluding chance. Specificity was not resolved: no per-model interval excluded chance, and the design cannot yet separate the state values from a generic instruction to adapt. Policy delivery reduced priced cost and output tokens against each model's baseline; these are resource-use changes, not efficiency gains, because correctness non-inferiority was not established. Safety-floor failures were rare (13 of 360 cases), with a non-significant excess under policy delivery. We report the instrument, the frozen results, and the controls a confirmatory study needs.

19. 【2610.23613】rajectory-Triggered Sparse Collaborative Decoding

链接:https://arxiv.org/abs/2610.23613

作者:Amit Ranjan Trivedi,Sruthikesh Surineni,Kyong Ho Lee,Mohit Mittal,Steven Li,Rex Hill

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Dense assistance methods, Dense assistance, keeping target computation, speculative decoding repeatedly, decoding repeatedly verify

备注: 17 pages. Accepted at the EMNLP 2026 uncertainty workshop

点击查看摘要

Abstract:Dense assistance methods such as speculative decoding repeatedly verify draft tokens with a target model, keeping target computation coupled to generation. We study sparse collaborative decoding, where a draft model generates most tokens and a target model is invoked only for short corrective segments. The key problem is deciding when to call the target. We show that local uncertainty is a weak trigger: entropy, negative log-likelihood, logit margin, top-$k$ mass, and velocity features give near-chance failure prediction, with AUC 0.50-0.53. In contrast, aggregate trajectory-shape features over the draft confidence path reach AUC 0.86 using a lightweight logistic predictor trained only from draft correctness labels. This induces a trigger-timing tradeoff: early calls have more leverage but weaker evidence, while later calls have stronger evidence but less ability to redirect the trajectory. Used online, learned sparse collaborative decoding improves over the best open-loop schedule by +5.3 to +20.0 accuracy points across five GSM8K draft-target pairs. On MATH-500, it gains 7.0-13.5 points when early prediction and target competence align, but loses when either is weak. On StrategyQA, it improves over open-loop by 5.0-8.3 points, showing transfer beyond arithmetics.

20. 【2610.23612】SIT-Eval: Situation-Based Interactive Turn-by-Turn Evaluation of Conversational Agents

链接:https://arxiv.org/abs/2610.23612

作者:Ravil Mussabayev,Saveliy Zavertyaev,Dmitriy Parpulov,Andrey Savchenko

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:necessitates evaluation methods, diverse dialogue scenarios, utilizing multiple situational, utilizing multiple, encompasses various aspects

备注:

点击查看摘要

Abstract:The rapid proliferation of conversational AI agents necessitates evaluation methods that assess performance across diverse dialogue scenarios, utilizing multiple situational criteria, as appropriate behavior depends on context and encompasses various aspects. Existing dialogue benchmarks typically use static natural conversations, which underrepresent rare situations---a critical safety gap, as low-probability events become frequent failures at production scale. However, limited sample sizes force a choice: either maintain natural dialogues for realism or turn to adaptive situation sampling for comprehensive yet statistically reliable coverage. We introduce SIT-Eval, an adjustable framework for evaluating situation-based conversational agents. We formalize an agent's desired behavior as situational rules: if situation is P, follow rules Q. At each conversation turn, an LLM-interlocutor enacts a uniformly sampled situation. A context-aware LLM-judge leverages all conditionally applicable rules as criteria to evaluate the agent's reply for that situation. The judge is validated using human-verified synthetic golden dialogues. Benchmarking 8 LLMs on 1292 conversation turns reveals failure modes hidden by aggregate metrics: models with similar overall scores vary widely in their adherence to individual rules. All models struggle most with ambiguity clarification and Socratic questioning.

21. 【2610.23610】Not Every Mention Is a Claim: Rethinking Object Hallucination Detection in Vision-Language Models

链接:https://arxiv.org/abs/2610.23610

作者:Hsin-Ling Hsu,Neeraja Kirtane,Kuan-Hao Huang

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:Object, measured by checking, mentions, non-assertive, non-assertive mentions

备注:

点击查看摘要

Abstract:Object hallucination in vision-language models (VLMs) is usually measured by checking each object a caption names against the image. Most benchmarks and detectors alike treat every object mention as a claim that the object is present. This assumption fails when a caption names an object without asserting it, as in "a bench for people to sit on", which mentions people without claiming that any are in the image. We call such mentions non-assertive. Treating them as hallucinations inflates the error rates attributed to models that use such language. To separate them from real hallucinations, we introduce NAME-Bench (Non-Assertive Mention Evaluation Benchmark), 25,497 object mentions from captions that five VLMs generate for COCO images. Each mention is labelled concrete (asserted and present), hallucinated (asserted and absent), or non-assertive, and non-assertive mentions are further divided into four subtypes: depictive, purpose, negation and hedged. All the hallucination detectors that we evaluate flag non-assertive mentions as hallucinations, at rates between 14% and 80%. Adding non-assertive mentions to detector training as negatives largely corrects this on LLaVA-1.5. On the four newer VLMs, a comparable correction takes five to ten times more data, and the detectors then catch fewer real hallucinations. These findings show that current detectors conflate mentioning an object with asserting it, and that this conflation is harder to undo on the four newer VLMs than on LLaVA-1.5. Hallucination evaluation should therefore separate what a caption asserts from what it merely mentions.

22. 【2610.23588】Enhancing RAG-based Medical VQA with Gated Multimodal Representations

链接:https://arxiv.org/abs/2610.23588

作者:Daniela Jimenez-Pano,Hugo Jair Escalante,Delia Irazú Hernández-Farías

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:Visual Question Answering, Medical Vision-Language Models, Medical Visual Question, factually inconsistent responses, shown strong performance

备注: Preprint submitted to ECIR

点击查看摘要

Abstract:Medical Vision-Language Models (Med-LVLMs) have shown strong performance in Medical Visual Question Answering (MVQA), yet they may still produce factually inconsistent responses. Retrieval-Augmented Generation (RAG) can mitigate this issue by incorporating external clinical evidence; however, retrieval is often guided by a single modality, potentially overlooking the joint semantics of medical images and clinical questions. We introduce a multimodal RAG framework that learns a joint query representation through a Gated Multimodal Unit, enabling evidence retrieval to leverage information from both modalities while keeping the underlying Med-LVLM frozen. We evaluate the proposed approach on benchmark datasets. Results show that the multimodal query representation consistently outperforms a reference Med-LVLM and remains competitive with state-of-the-art methods. Our findings demonstrate the potential of multimodal query representations for more effective evidence retrieval in Medical VQA.

23. 【2610.23587】Analyzing Occupational Gender Bias across the LLM Training Lifecycle

链接:https://arxiv.org/abs/2610.23587

作者:Manthan Gadhia,Alexander Hoyle,Karolina Stańczak

类目:Computation and Language (cs.CL)

关键词:social biases language, assumption remains mixed, biases language models, language models inherit, inherit from pretraining

备注: Submitted to 7th Workshop on Gender Bias in Natural Language Processing @AACL-IJCNLP 2026

点击查看摘要

Abstract:Post-training is widely assumed to reduce the social biases language models inherit from pretraining, yet direct evidence for this assumption remains mixed. In this paper, we examine how gender disparities evolve across the language modeling pipeline. In particular, we study occupational gender bias in OLMo 3, a fully open language model family, across its post-training stages by prompting each checkpoint to generate open-ended narratives about synthetic personas given their occupation and education. We consider two settings, a gender-given setting in which the profile states the persona's gender explicitly and a gender-assumed setting in which it must be inferred by the model. We find that when gender is stated, post-training increases semantic diversity for male-coded profiles, whereas for female-coded profiles the increase is smaller after SFT and not significant after DPO and RLVR. When gender is assumed by the model, post-training affects narratives about female and male personas similarly. The model's own gender assumptions, however, show a consistent female-preferential skew relative to United States labor-force demographics, except for heavily male-dominated occupations. Every successive post-training stage monotonically increases the odds of attributing a female label over the base model. A provenance analysis of the supervised fine-tuning corpus finds only a modest 7.7% female-token surplus, too small to explain the size of these downstream effects. The project code is available under: this https URL.

24. 【2610.23583】MARS: Memory-Aware Routing for Session-Level LLM Assistants

链接:https://arxiv.org/abs/2610.23583

作者:Minghan Wang,Jinhang Zuo,Zhongxiang Dai,Zhiyong Wang,Fang Kong

类目:Computation and Language (cs.CL)

关键词:Long-term LLM assistants, Long-term LLM, LLM assistants, assistants must repeatedly, repeatedly decide

备注: 32 pages, including references and appendices

点击查看摘要

Abstract:Long-term LLM assistants must repeatedly decide what prior context to expose and which model should answer as an interaction evolves. Existing memory systems and model routers usually make these decisions separately, although memory construction changes the evidence, distractors, and difficulty of the resulting input. We introduce MARS, a memory-aware routing framework that uses session state as a shared control interface between memory construction and model selection. A Query and Topic Manager (QTM) estimates compact decision-relevant state that guides a fixed state-conditioned memory policy and an online router, enabling each turn to receive an appropriate memory view and a suitable model under a quality-memory-cost trade-off. We evaluate MARS on RealMem and MultiChallenge with 16 system configurations each, covering long-history memory-driven interaction and bounded sessions with structured context interference. On RealMem, MARS preserves 98.2% of full-context GPT-4o's QA while using only 14.5% of its generation API cost, including both generation and controller calls for MARS, and achieves the strongest measured memory-recall and retrieval scores among compared systems. On MultiChallenge, MARS trails the strongest static system overall but approaches its performance at lower recorded cost on a mechanism-focused subset. Together, these results support a favorable quality-memory-cost trade-off for long-history, memory-dependent interaction.

25. 【2610.23542】Execution Before Memory: Diagnosing Memory Failures in Video World Models

链接:https://arxiv.org/abs/2610.23542

作者:Weiyang Jin,Jiwen Yu,Sihan Xu,Yuwei Niu,Xihui Liu

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:video world model, video world, Current tests fold, change, world model

备注: 27 pages, 7 figures. Project page: [this https URL](https://hku-mmlab.github.io/MIST/) Code: [this https URL](https://github.com/HKU-MMLab/MIST)

点击查看摘要

Abstract:A memory test for a video world model should say whether the scene was set, whether the asked change was carried out, and whether the last frame shows the result. Current tests fold these into one number, so a low score is easy to read as forgetting. When the change is not carried out, the hidden state transition cannot appear, so the test is not really a test of memory. We introduce MIST, an evaluation that separates the change from the memory it should leave behind. The model first sets the scene while the change stays hidden, and only later is asked to show it, with leakage before that point kept under control. This separation locates the bottleneck: the model sets the scene but does not carry out the instructed change. The same gap appears in general memory evaluations. On that basis we propose M3-Agent (Make the Missing Move), which recursively revises the details of the input instruction so that the model successfully carries out the requested instruction. Relative to the baseline, it more than triples the MIST reveal score. On the benchmarks, WRBench's score T rises by 26.1% and MBench-T's score U by 52.7%. The method meets the problem from the execution side: it shows what the frozen model can do once the move is stated, and it sets a stricter baseline.

26. 【2610.23539】ConvexLLM: Scaling Convex-Hull Speech Interfaces to General-Purpose Audio Intelligence

链接:https://arxiv.org/abs/2610.23539

作者:Ming-Hao Hsu,Shujie Liu,Yuxuan Hu,Yuxiang Wang,Yingda Shen,Jinyu Li,Zhizheng Wu

类目:Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

关键词:decoders pretrained primarily, language models connect, connect continuous acoustic, audio language models, audio language

备注:

点击查看摘要

Abstract:Speech and audio language models connect continuous acoustic representations to decoders pretrained primarily on text data. Most such models use MLP or Q-Former interfaces to map acoustic features into the decoder's input space, requiring the decoder to learn how to interpret the resulting representations. We investigate whether grounding these representations in the decoder's existing text embeddings can help it use acoustic information while better preserving its pretrained text capabilities. We present ConvexLLM, a general-purpose speech and audio language model whose C-Gate interface represents audio as continuous convex combinations of frozen text embeddings. ConvexLLM achieves an eleven-task VoiceBench aggregate of 75.36, the highest among the open-weight models we compare, and an MMAU Test-mini accuracy of 62.50%. Its largest margins over the baselines are on spoken knowledge and reasoning tasks, while the strongest baselines are more accurate on audio understanding and transcription. In a comparison with a 2B-parameter decoder, C-Gate achieves higher aggregate spoken-language performance than MLP and Q-Former interfaces, with text-task performance close to MLP and task-dependent tradeoffs in transcription and audio understanding. These results support convex combinations of text embeddings as a viable interface for general-purpose speech and audio language models.

27. 【2610.23530】EduWild: How Teacher-Configured Chatbots Fail in Real-World Use and How to Fix Them

链接:https://arxiv.org/abs/2610.23530

作者:Ziqi Liu,Ruiwei Xiao,Yuxuan Li,John Stamper

类目:Computation and Language (cs.CL)

关键词:remains poorly understood, Teachers increasingly configure, increasingly configure educational, poorly understood, increasingly configure

备注:

点击查看摘要

Abstract:Teachers increasingly configure educational chatbots through natural-language instructions, but how these bots fail in real-world use remains poorly understood. We introduce EduWild, a dataset of 1,726 conversations with 217 teacher-configured chatbots, each paired with the instructions and configuration behind it, including 900 conversations from the intended end users of 35 deployed chatbots. We develop a 29-code taxonomy covering factual, workflow, diagnostic, and pedagogical failures and apply it using a human-calibrated LLM judge. The most frequent failures are lapses in following teacher intent --- bots skip required workflow steps (53.8% of end-user conversations), omit expectation setup (33.4%), and overload learners with information or questions (37.1%). Guided by these findings, we design a prompt-based harness targeting the six most frequent failure modes. In a study with 200 college students across ten bots, the harness reduces the mean number of target failure codes per conversation from 1.406 to 0.489, a 65.2% relative reduction with bots weighted equally. These findings show how real-world failure analysis can guide practical improvements to educational chatbots.

28. 【2610.23527】ruth in Contrast: Calibrated Factual Evidence from Language Model Likelihoods

链接:https://arxiv.org/abs/2610.23527

作者:Ponhvoan Srey,Jason Lucas,Pittawat Taveekitworachai,Junyoung Lee,Anh Tuan Luu

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Large Language Models, encode substantial factual, substantial factual knowledge, Large Language, Language Models

备注:

点击查看摘要

Abstract:Large Language Models (LLMs) encode substantial factual knowledge. Yet, estimating confidence in factual claims reliably remains challenging. We study likelihood-based factual confidence from the complementary perspectives of discrimination and calibration across multilingual factual statements. Specifically, we instantiate contrastive generative likelihoods as Contrastive Factual Evidence (CFE), which compares the likelihood of the same claim under competing factual and non-factual conditions, and derive its probabilistic counterpart, the Contrastive Factual Posterior (CFP). We show analytically that CFP calibration depends on the differential error between the two surrogate conditionals, allowing errors shared across them to cancel and yield tighter calibration bounds. Empirically, CFP substantially improves calibration while maintaining factual discrimination comparable to its strongest competitor. Nonetheless, discrimination is uniformly weak across methods in lower-resource languages, which simultaneously undermines the utility of the measured calibration. To this end, we interpret a likelihood geometry, within which an evidence-bearing direction is induced, along with an orthogonal evidence-invariant direction. In our investigation, we selectively align target-language claims with stronger English evidence only along the factual-evidence direction, improving discrimination and open-ended factual generation without target-language labels.

29. 【2610.23521】Perceive, Solve, Reason: Progressive Capability Formation in Time Series-LLMs

链接:https://arxiv.org/abs/2610.23521

作者:Xin Qiu,Junlong Tong,Wei Zhang,Xiaoyu Shen

类目:Computation and Language (cs.CL)

关键词:Large language models, understanding remains underestimated, series understanding remains, Large language, time series understanding

备注:

点击查看摘要

Abstract:Large language models (LLMs) can now perceive, describe, and reason about images and audio, yet time series understanding remains underestimated: most work uses LLMs as forecasters and classifiers, reasoning studies are few and narrow, and no suite trains and evaluates the full range of capabilities. In this paper, we build the first such suite, with 337K training and 44K evaluation samples across three progressive capabilities, Perceive, Solve, and Reason, and use it to ask how time series should enter an LLM that must master all three, and in what order. We find that a dedicated encoder is essential: with one, a 4B model surpasses GPT-4o on every perception attribute we test, whereas textualizing the series costs 8--10 points in reasoning accuracy. The capabilities then build on one another: learning them in order beats mixing the same data and rivals reasoning-only training with over three times the reasoning data, but only when an encoder is used. Analyses further reveal that capabilities are transferred through distinct network depths rather than simply stacked, and that a stage converged on its own benchmark is not necessarily ready for the next. Distilled into a simple recipe, these findings yield 4B TS-LLMs that, without any target-domain data, outperform four recent 7B TS-LLMs on seven of eight out-of-domain metrics, by up to 11 points. We therefore advocate treating time series as a first-class modality for LLMs, read through dedicated encoders and taught to perceive before they reason.

30. 【2610.23480】MuninAI: A Self-Hosted Agentic Framework for Independent Research Groups

链接:https://arxiv.org/abs/2610.23480

作者:Markus Fischer,Jens Meiler,Matthias Elgeti

类目:Computation and Language (cs.CL)

关键词:Research groups, language model grounded, model, face a choice, choice between hosted

备注: 37 pages, 3 figures, 20 tables. Code, evaluation suite and scorecards: [this https URL](https://github.com/elgetilab/munin) (archived release v1.0.0: [this https URL](https://doi.org/10.5281/zenodo.23191404) )

点击查看摘要

Abstract:Research groups that want a language model grounded in their own literature face a choice between hosted services that receive their unpublished work and self-hosted deployments that keep the data local but give the model no access to the corpus. Munin is an open-source framework for a self-hosted scientific assistant that indexes a group's corpus and its citation graph, and wraps whichever open-weight model the group can serve in an agent harness with specialised reading, search, and computation tools. We claim that the harness, rather than the specific model, is what makes the system useful on domain literature, and we ship the evaluation suite that tests this claim with the software. On 199 paired literature questions, the harness more than doubles the accuracy of the base model, from 0.387 to 0.874 (+0.487, 95% CI [0.407, 0.568]), while naive retrieve-then-answer scores below the unaided model on every backbone tested. Under the harness, roughly twice as many answer claims trace to a passage the model read itself as with fixed top-5 retrieval. When the source paper for a question is removed from the corpus, the system abstains on about nine in ten of the questions it had answered correctly on the Qwen backbones and eight in ten on gpt-oss-20b, and it produces no fabricated local citation across 300 fabricated references. The pattern holds on three backbones from two developers, including a 20-billion-parameter model that runs on a single consumer-grade GPU. With all outbound network access disabled, both Qwen backbones still exceed the published PaperQA2 accuracy. The evaluation suite runs as a single command, so an adopting group can re-run it on its own corpus and model.

Comments:
37 pages, 3 figures, 20 tables. Code, evaluation suite and scorecards: this https URL (archived release v1.0.0: this https URL)

Subjects:

Computation and Language (cs.CL)

ACMclasses:
H.3.3; I.2.7

Cite as:
arXiv:2610.23480 [cs.CL]

(or
arXiv:2610.23480v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2610.23480

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>
31. 【2610.23456】A low-dimensional dynamical basis for tongue shape control

链接:https://arxiv.org/abs/2610.23456

作者:Sam Kirkham,Patrycja Strycharczuk

类目:Computation and Language (cs.CL)

关键词:Speech production involves, Speech production, lower-dimensional control variables, high-dimensional articulatory system, production involves

备注: Pre-print currently under review

点击查看摘要

Abstract:Speech production involves the control of a high-dimensional articulatory system with many degrees-of-freedom, but a widespread hypothesis is that speakers navigate this complexity using a set of lower-dimensional control variables. Common candidates for these control variables include individual articulators (e.g. tongue body) and abstract tract variables (e.g. tongue body constriction location), but identifying the most appropriate coordinate system for articulatory control remains an open question. In this study, we advance a model in which holistic tongue shape modes represent a potential low-dimensional control basis for a simple dynamical law. We first discover empirical tongue shape modes in a cross-speaker coordinate space and then fit the model to ultrasound data on monophthongal vowels from 36 speakers of British English. A three-dimensional linear point attractor fitted to these time-varying modes recovers the dynamics of tongue shape with a high degree of accuracy. This suggests that complex tongue movement can arise from independent modes that linearly combine under simple dynamical laws, thereby relocating some complexity from the control signal to the coordinate system. We show that this framing explains why one-dimensional articulatory measures can exhibit observable nonlinearities, and hypothesize that shape modes are a plausible kinematic expression of underlying muscle synergies.

32. 【2610.23455】HydraLLM: Adaptive Width Slicing for Elastic Text and Vision-Language Models

链接:https://arxiv.org/abs/2610.23455

作者:Oscar Kemme,Janek Haberer,Ali Hojjat,Olaf Landsiedel

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:resource-constrained edge devices, LLMs and LVLMs, heterogeneous hardware, ranging from data-center, edge devices

备注: Accepted at the BabyLM Workshop at EMNLP 2026

点击查看摘要

Abstract:LLMs and LVLMs are increasingly deployed across heterogeneous hardware, ranging from data-center GPUs to resource-constrained edge devices. Their fixed-size architectures limit the ability to reuse a single model across deployment settings with different compute, latency, and model-size targets. We introduce HydraLLM, an elastic MQA-based architecture. Its number of active attention heads determines the effective widths of the embeddings, attention projections, feed-forward layers, and the output head, forming a nested family of subnetworks within a single parameter set. We introduce a static-to-elastic conversion pipeline that, starting from a pre-trained model checkpoint, includes importance-driven weight reordering and stochastic subnetwork training with knowledge distillation. We extend this principle to multimodal inference through an elastic projection module whose output width follows the active text width. HydraLLM covers a wider range of active parameter configurations than FFN-only elastic architectures. With 75% of heads active, HydraLLM achieves 2.2 percentage points higher TriviaQA accuracy than a state-of-the-art nested baseline configuration which has 17.25% more parameters. With 50% of heads active, our multimodal model achieves a CLIPScore comparable to that of the 7$\times$ larger Gemma 3 4B model. With only 25% of heads active, HydraLLM increases token-generation throughput by 75.3% over the full-width configuration.

33. 【2610.23446】"You" Is Not Toxic: How LLM Labelers Rewrite the Web's Conversation Laws

链接:https://arxiv.org/abs/2610.23446

作者:Liang Yue,Eric A. Vance

类目:ocial and Information Networks (cs.SI); Computation and Language (cs.CL)

关键词:Google Perspective API, Perspective API, Google Perspective, large language models, Web community

备注: 43 pages, 4 figures, 44 tables. Labels, prompts and code: [this https URL](https://github.com/liyu2195/you-is-not-toxic)

点击查看摘要

Abstract:What the Web community believes about toxic conversations, such as that toxicity rises in longer and deeper threads, was measured mostly with Google's Perspective API, which is shutting down; large language models (LLMs) will make the next measurements. We find that LLM labelers mistake second-person address for toxicity, and that this one bias manufactures laws that human labels do not show. On 1.25 million news comments with crowd labels, Claude Haiku flags 12% of the non-toxic comments that contain no "you" and 51% of those with four or more; a single crowd rater flags 6% and 10%. Deeper replies address someone more often, so under Haiku toxicity rises with reply depth (+0.93 percentage points per level), while under the crowd's labels it slightly declines (-0.12). Rewriting "you" in the third person removes two thirds of the false rise; flagging only as many comments as the crowd does not remove it, and showing Haiku the parent comment enlarges it. All seven LLMs we test over-flag "you", and at the crowd's flag rate, without the parent, any false rise of the open ones vanishes at a fixed number of second-person words; Haiku also over-flags "you" on Reddit, Gab and Wikipedia talk pages. Agreement with human labels does not reveal the bias: we prove that a fixed Cohen's kappa leaves a law nearly unconstrained. We therefore certify the law instead of the labeler. Threadsafe uses the labeler's scores to choose which comments human raters label and to predict the others, and corrects the predictions with the human labels; linear laws are estimated without bias whatever the labeler does. In simulated audits its intervals for the laws keep nominal coverage from 250 labels on, where uniform-sample methods such as PPI++ fall short, and at 1,000 to 8,000 labels are 0.75 times as wide as those of design-based supervised learning (DSL); a thousand human labels rule out Haiku's rising law.

34. 【2610.23443】ScoutRoute: Efficient Mixture-of-Experts Routing Using Internal Language Model Signals

链接:https://arxiv.org/abs/2610.23443

作者:Rajdeep Pandhare,Delzaan Bharucha

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Large Language Mod, Language Mod els, independently trained Large, trained Large Language, Mod els

备注: 10 pages, 1 figure, 6 tables. Published in Advances in Artificial Intelligence and Machine Learning, 2026

点击查看摘要

Abstract:Efficient expert routing is a fundamental challenge in Mixture-of-Experts (MoE) systems, particularly for heterogeneous collections of independently trained Large Language Mod els (LLMs). Existing routing approaches typically rely on jointly trained gating networks, prompt-based predictors, or computationally expensive multi-model inference, limiting their flexibility and efficiency. This paper presents ScoutRoute, a lightweight post-hoc routing framework that predicts expert competence using internal language model signals extracted from a single forward pass through an inexpensive scout model. Hidden-state representations are used to estimate cross-model competence through lightweight logistic probes, while logit-derived confidence measures are incorporated within a domain-aware routing strategy for efficient expert selec tion without modifying the underlying language models. ScoutRoute isevaluatedon fiveopen-weightlanguagemodels across fourbenchmark datasets covering mathematical reasoning, code generation, commonsense reasoning, and multidis ciplinary knowledge. Experimental results show that ScoutRoute consistently outperforms individual routing signals while requiring only a single scout-model inference. The proposed competence probes also achieve superior calibration compared with conventional confidence measures, demonstrating that internal language model representations provide transferable information for accurate and efficient expert routing across heterogeneous language models

35. 【2610.23400】On the Tip of the Tongue: First-Token Cueing as a Behavioral Probe of Recall Failures in LLMs

链接:https://arxiv.org/abs/2610.23400

作者:Jaewon Sok,Jewon Yeom,Seonghyeon Park,Jeongjae Park,Hwiyeong Lee,Taesup Kim

类目:Computation and Language (cs.CL)

关键词:Large language models, factual questions incorrectly, Large language, questions incorrectly, attributed to missing

备注:

点击查看摘要

Abstract:Large language models often answer factual questions incorrectly in closed-book settings, and such errors are usually attributed to missing knowledge. Yet models often encode answers they fail to produce. We show that many closed-book errors are first-token recall failures: the model commits to a wrong first token, but once given the right one it completes the answer and often recognizes it as correct. We study this with First-Token Cueing, a behavioral probe that prefills the response with the first token of the gold answer. Model uncertainty peaks at the first answer token, where it already predicts correctness, and among gold prefixes of any length the first token alone accounts for the largest share of recovered errors. Across 16 open models, this one token corrects between a fifth and a half of the errors on multi-token answers in English QA and improves accuracy in all seven languages of a multilingual benchmark. Most of the errors it corrects are also solved by the model's own sampled reasoning, a criterion for encoded knowledge, and models recognize correct starts they do not produce: they continue a correct start more confidently than an incorrect start of the same answer type and prior probability, yet rarely find it without the gold answer. These results locate a recoverable class of factual errors at the first decoding step, where inference-time methods may gain the most.

36. 【2610.23388】Sentence-Level Topic Modeling with Lexical and Contextual Evidence

链接:https://arxiv.org/abs/2610.23388

作者:Federica Granese,Serena Villata,Charles Bouveyron

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:fundamental granularity dilemma, transformer-based methods operate, Topic modeling faces, probabilistic topic models, granularity dilemma

备注:

点击查看摘要

Abstract:Topic modeling faces a fundamental granularity dilemma: probabilistic topic models assign topics at the word level, whereas transformer-based methods operate at the document level. The latter overlooks that real-world documents typically cover multiple topics, whereas the former relies on individual words, which rarely provide sufficient context to identify them. We introduce SentenceETM, a neural topic model that assigns a topic to each sentence by jointly using lexical and contextual evidence. Each topic is described both by a distribution over the vocabulary, defined through word embeddings, and by a Gaussian over sentence embeddings concentrated on a topic-specific low-dimensional subspace. The topic of a sentence generates both its words and its embedding and is marginalized exactly, so that its posterior combines the two sources of evidence. Document proportions are inferred with amortized variational inference, while the Gaussian parameters are re-estimated in closed form. Experiments show that SentenceETM consistently improves sentence-level topic assignment over state-of-the-art approaches, and a case study of a presidential debate shows how sentence-level topics reveal how candidates handle the same subjects.

37. 【2610.23344】Language Models Learn to Improve Language Models

链接:https://arxiv.org/abs/2610.23344

作者:Minhua Lin,Zijun Wang,Zewen Liu,Zhaotian Weng,Bing He,Zhan Shi,Benoit Dumoulin,Xiang Zhang,Suhang Wang,Hanqing Lu

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Large language models, Large language, including language-model, offering a potential, recursive self-improvement

备注:

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used to automate AI research, including language-model (LM) development, offering a potential path toward recursive self-improvement. However, turning experimental feedback into a learned ability to propose effective improvements across models faces two challenges. First, training such an ability with real feedback is expensive: reinforcement learning (RL) requires evaluating tens of thousands of proposals, each potentially requiring a full model-training run. Even at ten GPU-hours per run, reward collection alone would consume hundreds of thousands of GPU-hours, motivating a cheaper surrogate. Second, surrogate feedback can become unreliable as policy optimization favors overestimated proposals when the proposal distribution shifts. To address these challenges, we propose LM2LM, which trains LLMs with RL to generate effective LM improvement proposals. To provide scalable feedback, we use a research world model (RWM), a frozen LLM that predicts proposal gains from real experimental records provided in context, as the reward model for RL. To maintain feedback reliability, we periodically execute current-policy proposals ranked highly by the RWM and add their measured outcomes to its context. Across eight autoregressive and diffusion LM development environments, real-execution evaluations on held-out tasks show that LM2LM enables Qwen3.8-27B to outperform GPT-6-sol, even when GPT-6-sol is given 300 real experimental records in context, while requiring 33% lower data-generation cost. LM2LM also generalizes to a model family unseen during training.

38. 【2610.23342】Robust Function Calling for LLM Agents Under Interface Drift

链接:https://arxiv.org/abs/2610.23342

作者:Aniruddha Chattopadhyay,Kanishka Halder,Partha Sarathi Roy

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

关键词:Tool-augmented language-model agents, language-model agents rely, Tool-augmented language-model, candidate tool list, tool list shown

备注: 16 pages, 1 figure, 6 tables. Peer-reviewed and accepted at NGEN-AI 2026 (International Conference on Next Generation AI Systems). This is the pre-review submitted version

点击查看摘要

Abstract:Tool-augmented language-model agents rely on interface text: tool descriptions, argument schemas, and the candidate tool list shown at inference time. These interfaces often change after deployment even when the underlying tool semantics remain fixed, creating a practical reliability problem for function-calling systems. We study this failure mode as interface drift and evaluate whether a lightweight, training-free repair layer can recover robustness without retraining the base model. Our method, SchemaShield-Lite, combines schema validation, candidate-set retry for missing tool names, and one-shot constrained repair. On Qwen3.5-9B, it raises DICE-300 accuracy from 0.717 to 0.813 and BFCL-200 accuracy from 0.580 to 0.805, recovering 19/22 and 33/45 drift-induced failures with no observed repair harms. Naive retry does not explain the gains. Ablations show that candidate-set drift, especially distractor tools, accounts for most observed damage, while description and schema edits alone are less harmful. The results position validation-and-repair as a practical robustness layer for deployed LLM-agent tool use.

39. 【2610.23311】Self-Reflective Chain-of-Thought (SRCoT): Evidence-Based Text Generation via a Closed-Loop Retrieve--Reflect--Revise Pipeline on Edge LLMs

链接:https://arxiv.org/abs/2610.23311

作者:Fabian Broszio,Michael Hoffmann,Adrian Paschke

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:lack source support, Large language models, Large language, generate fluent outputs, generate fluent

备注: 28 pages, 2 figures. Extended technical account; a related brief report based on overlapping work has been submitted to Frontiers in Disaster and Emergency Medicine. The two manuscripts do not represent independent empirical studies

点击查看摘要

Abstract:Large language models (LLMs) can generate fluent outputs that lack source support or conflict with local operational constraints. We introduce Self-Reflective Chain-of-Thought (SRCoT), a modular architecture that organizes generation as a closed Retrieve--Reflect--Revise loop. SRCoT separates environment state, persistent knowledge, accumulated experience, and short-term memory into provenance-labeled stores. BM25 retrieval supplies local context; subsequent passes expose intermediate drafts, missing-information markers, follow-up queries, and optional claim--evidence mappings. These artifacts inform retrieval, revision, clarification, or abstention decisions. We examine the architecture through qualitative, trace-based case studies in two fully synthetic settings: emergency medical services and Munich-Sim, an emergency-operations simulation. Local prototype runs on an Apple M4-family laptop with 128 GB memory illustrate source-labeled documentation, explicit gap marking, and structured dispatch-style outputs. The traces also reveal provenance-assignment errors, incomplete evidence coverage, and unsafe assumptions that remain possible despite prompting constraints. These cases demonstrate report-level inspectability and local execution, not comparative superiority, hallucination reduction, clinical validity, or operational safety. The architecture separates retrieval and control from the model interface, but behavior across different models remains to be evaluated. SRCoT is a research proof of concept requiring human review, with its principal contribution lying in an inspectable control procedure rather than a new model.

40. 【2610.23309】Inferring L1 Backgrounds from L2 English with LLM Token Probabilities

链接:https://arxiv.org/abs/2610.23309

作者:Ahmet Yavuz Uluslu,Mark Gales,Kate Knill,Gerold Schneider

类目:Computation and Language (cs.CL)

关键词:Native language identification, Native language, language identification, infers a non-native, non-native speaker

备注:

点击查看摘要

Abstract:Native language identification (NLI) infers a non-native speaker's first language (L1) from their second language (L2) production. We investigate a token probability approach that scores each text sample as a continuation of a prompt prefix specifying a candidate L1, then predicts the candidate with the highest score. We evaluate our approach using Llama 3.1 8B and 70B on three datasets: TOEFL9, Write and Improve 2024, and BULATS-L1. We compare its performance with previous prompting-based classification approaches. Token-probability scoring substantially improves on direct classification, particularly with the 8B model, while the 70B model achieves state-of-the-art performance across all datasets. Our results indicate that pretrained LLMs' token probabilities contain information useful for distinguishing L1 backgrounds from L2 English production.

41. 【2610.23306】SimOPD: Relational Knowledge Transfer for On-Policy Distillation

链接:https://arxiv.org/abs/2610.23306

作者:Kai Tang,Xing Zheng,Haobo Wang,Guangcheng Zhu,Shenzhi Yang,Zhengqing Zang,Yingfan Ma,Bowen Song,Weiqiang Wang

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:extracting effective supervision, on-policy distillation, key challenge, challenge in on-policy, extracting effective

备注:

点击查看摘要

Abstract:A key challenge in on-policy distillation (OPD) is extracting effective supervision from teacher knowledge. Supervision from token probabilities may underutilize internal knowledge, while direct hidden-state matching forces the student to shift to the teacher's feature space and complicates cross-architecture transfer. Inspired by contrastive learning's use of relationships between instances, we propose \textbf{SimOPD} to transfer teacher internal knowledge through response similarities. Specifically, SimOPD uses paired memory banks of student-generated responses to extract supervision from the teacher's internal representations as similarity distributions. The student then matches these distributions within its own representation space, retaining representational freedom and removing the need for cross-model projection. Extensive experiments show that SimOPD improves the overall average over the strongest baselines by up to 2.6 and 3.1 percentage points in same- and cross-architecture settings.

42. 【2610.23284】Annotrace: A Workbench for Step-Level Annotation of Agent Traces

链接:https://arxiv.org/abs/2610.23284

作者:Arun Josephraj Arokiaraj,Chenyi Huang,Sahan Bulathwela,Zekun Wu,Bin Wu

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA)

关键词:LLM agents fail, agents fail begins, LLM agents, study builds, fail begins

备注: 4 pages, 4 figures, 1 table. Under review at the AAAI 2027 Demonstration Program

点击查看摘要

Abstract:Every study of why LLM agents fail begins by labelling traces by hand, and every such study builds its own throwaway tool. Observability platforms record agent traces but offer no structured labelling; annotation tools label text but have no notion of a step, a delegation or a tool call, leaving it unclear what the smallest unit of execution to label should be. Annotrace reads six trace formats, including OpenTelemetry GenAI, LangSmith and Langfuse, and turns each run into an ordered, nested list of steps. The annotator writes their own labelling codebook; a frontier model proposes a starting set from a sample of their own traces, answers first, and is asked exactly the questions the human is asked, making annotation a joint human-AI process. Annotrace measures agreement between any two annotators, human or AI. On a multi-agent question-answering corpus it reproduces a previous manual effort's 235 annotation units exactly, and two models labelling the same traces agree 91% of the time at $\kappa = 0.82$.

43. 【2610.23275】Verbalising Model's Computation for Chain-of-Thought Faithfulness Detection

链接:https://arxiv.org/abs/2610.23275

作者:Yujing Wang,Yulan He,Wenya Wang,Hanqi Yan

类目:Computation and Language (cs.CL)

关键词:verification methods detect, methods detect reasoning, verification methods, develops during generation, methods detect

备注:

点击查看摘要

Abstract:Current Chain-of-Thought (CoT) verification methods detect reasoning faithfulness from model outputs or static activations, but are limited in explaining how unfaithfulness develops during generation. We introduce VERITAS to verbalise the model's computation: how different reasoning anchors emerge, transfer across layers, and surface in the output. VERITAS adopts the layer-wise Jacobian projection to produce a verbalised account of the model's internal reasoning evolution at each generated CoT token. By training a classifier on the extracted features along the traces, we show that these structured features provide insightful perspectives on how and where reasoning diverges toward unfaithfulness. Experiments on four datasets from FaithCoT-Bench and BonaFide show that VERITAS achieves a significant performance gain over LLM-as-Judge, with a 28.4% gain in balanced accuracy, and an average improvement of 16.0% over activation probing. Further analysis shows VERITAS can be generalised to different datasets and model architectures. Our work shows that verbalising model computation provides a richer and more interpretable lens on CoT faithfulness, moving beyond detection toward a mechanistic understanding of how reasoning fails.

44. 【2610.23257】Reasoning Models Can Control Their Chains of Thought When They Tell Themselves To

链接:https://arxiv.org/abs/2610.23257

作者:Uriel Dolev,Idan Schwartz,Yoav Goldberg

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:user prompt, reliable oversight, CoT, usefulness and reliable, controllability

备注: 26 pages, 19 figures, 18 tables. Code and data: [this https URL](https://github.com/udolev/Self-Instructed-CoT-Controllability)

点击查看摘要

Abstract:Chain-of-thought (CoT) controllability, the ability of reasoning models to control properties of their CoT, is consequential for both their usefulness and reliable oversight. Recent work evaluates this capability by measuring whether models follow CoT constraints given in the user prompt, and reports very low controllability across models. We argue that this low controllability may not reflect an inherent inability of reasoning models to control their CoT, but instead result from naively specifying constraints in the user prompt. To test this, we introduce Self-Instructed CoT Controllability: a complementary evaluation that places the constraint as a self-instruction inside the model's CoT and measures its ability to follow it. We show that, under self-instruction, models achieve significantly higher controllability than with standard user instructions. Even a generic reminder to follow the user's constraint substantially improves controllability. Moreover, effective self-instructions can be bootstrapped into the reasoning through a simple instruction in the user prompt, enabling improved control even without access to the reasoning channel. Finally, using self-instruction, we demonstrate in a realistic monitoring setup that CoT controllability can be leveraged for monitor evasion, posing a risk to CoT monitorability.

45. 【2610.23255】Sample, Mix, or Verify? Allocating Test-Time Compute under Imperfect Verifiers

链接:https://arxiv.org/abs/2610.23255

作者:Srinivasan Iyengar

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:inference time, make language models, solutions and submit, candidate solutions, SPLIT

备注: 27 pages (18 main + appendix), 14 figures, 11 tables. Code will be released

点击查看摘要

Abstract:A common way to make language models and agents more accurate is to spend more compute at inference time: generate many candidate solutions and submit the one a verifier prefers. Success then requires that some candidate is correct and that the verifier picks it. The first grows predictably with the number of samples; the second does not, because real verifiers (unit tests, majority votes, LLM judges, reward models) accept wrong answers, reject right ones, and make correlated mistakes. With a fixed budget, a practitioner must decide how many samples to draw, which models to draw them from, and how much to spend on verification, and today these choices are made by rules of thumb. We introduce SPLIT, which makes them from a small labelled pilot. It rests on an exact formula for the probability of submitting a correct answer under accept/reject and top-score selection that accounts for varying task difficulty, blind spots shared across models, and correlated repeated verifier calls. SPLIT fits the formula by empirical Bayes and uses it to plan budgets on unseen tasks. Across seven benchmarks spanning math, science QA, code and software-engineering agents, 26 models, 175 agent systems and six kinds of real verifiers, all from public releases, SPLIT lands within 0.02-0.8 percentage points of the best allocation in hindsight, while every fixed rule we test loses at least 2.5 points in some setting. Regret depends only on how well SPLIT ranks configurations, and it stays near-optimal under compute, price and latency costs and online. The formula also explains when asking more LLM judges lowers precision. As a forecaster far beyond the pilot, SPLIT beats power-law fitting when the verifier caps success, and we report where it loses.

46. 【2610.23254】Ignored, Not Refused: What Low Prompt-Injection Success Rates Hide in Small Tool-Using Agents

链接:https://arxiv.org/abs/2610.23254

作者:Farhan Zarif,Kazi Shahid Ahmed Galib,Synthia Akter Promi,Shabnam Sharmin Tarin,Ariyan Hossain,Sadif Ahmed,Farig Yousuf Sadeque

类目:Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词:untrusted external content, Tool-using agents read, read untrusted external, hidden instructions hijack, agent tool calls

备注: 17 pages, 3 figures, 11 tables

点击查看摘要

Abstract:Tool-using agents read untrusted external content, which exposes them to indirect prompt injection (IPI), where hidden instructions hijack the agent's tool calls. Benchmarks measure IPI security by the attack success rate (ASR), which treats every failed attack as a successful defense. To test this assumption, we audit 33,000 trajectories from eleven open-weight agents (2-14B parameters) on InjecAgent and AgentDojo. A label-blind LLM judge shows that most failed attacks are ignored (76-80%) rather than refused (17-18%). With identical model weights, changing only the system prompt shifts InjecAgent ASR from 0.2% to 43%. Our Attack-Task Outcome Matrix (ATOM) further shows that in 21.7% of AgentDojo episodes, the agent stayed safe but did not complete the user's task. A low ASR therefore mostly reflects agents silently ignoring injections, not refusing them. Evaluations should report how attacks fail and whether the user's task is completed, alongside ASR. We release the labeled corpus, judge prompt, and analysis code.

47. 【2610.23249】Who Pays for Efficient Inference? Confidence-Based Small-to-Large LLM Routing Across Tasks and Languages

链接:https://arxiv.org/abs/2610.23249

作者:Md Sabbir Hossen,Anichur Rahman,Pabon Shaha,Airin Afroj Aishi,Andrew H. Sung,Md Shohel Rana

类目:Computation and Language (cs.CL)

关键词:escalating difficult inputs, reduce inference cost, routing, reduce inference, escalating difficult

备注:

点击查看摘要

Abstract:Small-to-large language model routing can reduce inference cost by escalating difficult inputs while retaining easier ones on a smaller model. Its success, however, depends on identifying examples that benefit from escalation, and the reliability of confidence across multilingual tasks remains unclear. We present a systematic evaluation of confidence-based routing across three model families, four languages, and three task types, covering 72 model, dataset, language, and scale configurations and 42,288 predictions. We compare global confidence routing with random routing, equal-quota confidence routing, and an oracle upper bound. Confidence identifies beneficial escalations on the Belebele reading comprehension and SIB-200 topic classification datasets, with mean correction-detection AUCs of 0.612 and 0.705. At 50% escalation, it improves over random routing by 1.40--4.67 percentage points on Belebele and 2.54--5.63 points on SIB-200. In contrast, the mean AUC on the MMLU-ProX-Lite knowledge and reasoning dataset is only 0.510, and routing provides no consistent improvement over random selection because small models often remain highly confident while incorrect. Global confidence routing also creates language escalation gaps up to 30.33 percentage points, whereas equal-quota routing removes this disparity with little aggregate accuracy cost. These results show that confidence routing is task-dependent and can allocate computation unevenly across languages. Code is available at this https URL

48. 【2610.23246】hink More or Read More? A Token-Budget Theory of Reasoning with Shared Context

链接:https://arxiv.org/abs/2610.23246

作者:Manh Nguyen,Sunil Gupta,Hung Le

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:increasingly improve answers, systems increasingly improve, incorporating additional context, Reasoning systems increasingly, peers' responses

备注:

点击查看摘要

Abstract:Reasoning systems increasingly improve answers by incorporating additional context into the model's input, from multi-agent debate, where agents read their peers' responses, to self-refinement, where a model revisits its own drafts. In these systems, communication consumes context as one agent's output becomes another's input. We study the regime where token reading and generation draw on one fixed token window, so every token spent reading is a token that cannot be spent reasoning. We develop a \textbf{token-budget theory} that formalizes this trade-off, modeling accuracy as a function of the reasoning budget remaining after reading and aggregating votes with a Condorcet jury model that permits correlated errors. For multi-agent debate, the theory gives a closed-form prediction for the optimal number of agents. This quantity is estimated from single-agent measurements, allowing the optimal group size to be determined without running debate, and the same accounting extends to a heterogeneous set of different models. We empirically verify our theory and show that, at the predicted group size, our method outperforms strong baselines under the tightest calibration spend, where debate-calibrated rules can afford only one or two questions. Self-refinement obeys the same accounting, with its own draft in place of a peer message. The theory further predicts that communication pays only when the gain in the accuracy ceiling exceeds the reasoning room spent on reading, with this condition tightening as the window shrinks. Across five open models and four reasoning tasks, self-consistency matches or beats deployed debate at $93$\% of $980$ matched window-and-group-size settings, with the gap being largest under tight windows and nearly disappearing at a loose one, consistent with the theory. Under a shared window, how much room a model has left to \textit{think matters more than what it reads}.

49. 【2610.23245】MGE-PO: Entropy-Aware Credit Assignment for Mathematical Reasoning

链接:https://arxiv.org/abs/2610.23245

作者:Jihao Huang,Guangjia Chai,Zhirui Chen,Lei Wang,Yao Liu,Liu Qi,Pengjie Ding,Xinyang Liu,Chengxun Jia,Ling Shao,Hongyu Chen,Junchen Wan

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:equally rewarded responses, generation uncertainty unused, GRPO assigns, uncertainty unused, equally rewarded

备注:

点击查看摘要

Abstract:GRPO assigns the same group-relative advantage to equally rewarded responses within a question, leaving their generation uncertainty unused. We introduce MGE-PO, centered on four-quadrant (4Q) advantage shaping that combines verified correctness with rollout generation entropy. Correctness determines the sign of an additional correction, while entropy controls its magnitude: lower-entropy successes receive larger bonuses and higher-entropy failures receive larger penalties. An online entropy-based question curriculum supports this credit rule using cached rollout measurements. At the final checkpoint after eight training epochs on Qwen3-8B-Base, adding 4Q across three policy optimization settings yields absolute gains of 3.23-3.69% in six-benchmark macro avg@32 and 4.24-11.06% in macro pass@32. On Qwen2.5-7B-Base, the complete configuration raises four-benchmark macro avg@32 from 41.5% to 45.4%.

50. 【2610.23234】MultiAgent-OPD: End-to-End Training of Hierarchical Multi-Agent Systems with On-Policy Distillation

链接:https://arxiv.org/abs/2610.23234

作者:Yuhan Sun,Jiaxin Zhao,Yongdong Luo,Yibo Hu,Meiguang Jin,Junfeng Ma,Weixun Wang,Weihang Pan,Zhongan Bi

类目:Computation and Language (cs.CL)

关键词:Leader assigns tasks, hierarchical multi-agent system, Leader assigns, hierarchical multi-agent, assigns tasks

备注:

点击查看摘要

Abstract:In a hierarchical multi-agent system, a Leader assigns tasks and subagents carry them out. Jointly training the Leader and the subagents is difficult because a final answer gives only indirect feedback to the subagents. An LLM judge can score the performance of the subagents, but these scores depend on the judge's own assessment of the quality of subagents' responses. We present MultiAgent-OPD, which combines on-policy distillation with reinforcement learning to jointly train a shared-parameter Leader-Searcher-Answerer team end to end. We first train a Teacher in a Searcher-Answerer workflow using answer correctness. During team training, the frozen Teacher scores student-generated search and summary tokens to provide local process supervision for the Searchers, while the Leader learns from team success and the Answerer from candidate correctness. Across seven datasets, the trained system reaches 38.68% macro avg@4, exceeding Prompted Critic by 4.06 percentage points and C-MAS + RL, the trained cascaded multiagent system, by 2.61 percentage points. The team also solves more questions within four attempts.

51. 【2610.23225】ReLaDrift: Recurrent Language Generation via Drifting for Test-Time Scaling

链接:https://arxiv.org/abs/2610.23225

作者:Yuki Otsuka,Daisuke Oba,Naoaki Okazaki

类目:Computation and Language (cs.CL)

关键词:single function evaluation, support iterative refinement, fast parallel language, parallel language generation, Drifting Models generate

备注:

点击查看摘要

Abstract:Drifting Models generate a sample with a single function evaluation, making them attractive for fast parallel language generation, but their one-step formulation does not support iterative refinement. We propose Recurrent Language Generation via Drifting (ReLaDrift), which uses a shared Drifting Model to generate an initial draft from noise and iteratively refine it in a continuous latent space. We train this recurrence by sampling the number of rounds and applying the drifting loss only at the final round, stopping gradients through preceding rounds so that only one round requires backpropagation. Unlike the one-step Drifting Model, whose accuracy does not improve when iterated, ReLaDrift enables a trade-off between test-time computation and generation quality, as diffusion and flow language models do. On Sudoku Hard and GSM8K, it achieves competitive or superior performance compared with these iterative-generation approaches across a range of inference budgets. Our code is available at this https URL

52. 【2610.23205】MAS-Bai: Linguistically Informed Adaptive Multi-Agent Translation for Bowen-Script Bai

链接:https://arxiv.org/abs/2610.23205

作者:Jingting Zheng(1),Hong Ren(1),Yuehan Cui(1),Shaolin Zhu(1),Deyi Xiong(1) ((1) TJUNLP Lab, School of Computer Science and Technology, Tianjin University, China)

类目:Computation and Language (cs.CL)

关键词:Large Language Models, extremely low-resource languages, high-resource pretraining priors, writing systems conflict, Large Language

备注: 14 pages, 3 figures, Findings of EMNLP 2026

点击查看摘要

Abstract:Large Language Models (LLMs) remain unreliable for extremely low-resource languages whose writing systems conflict with high-resource pretraining priors. We study Bai-Chinese translation in the Bowen script, where Chinese characters are frequently borrowed phonetically rather than semantically, causing severe literal-translation hallucinations. We propose MAS-Bai, a linguistically informed adaptive multi-agent framework for Bowen-script Bai-Chinese translation. MAS-Bai routes each input through either a lightweight retrieval-translation path or a deeper philological path with etymological and syntactic agents, and uses cycle-consistency with a lightweight reverse translator as an inference-time reliability signal. We construct a 6,536-sentence Bai-Chinese corpus and evaluate on a 1,536-sentence test set. MAS-Bai achieves 16.23 BLEU and 62.15 COMET, improving over Standard RAG by 8.11 BLEU and 6.85 COMET. Forward LoRA, expert ablations and controlled routing experiments distinguish the roles of supervised adaptation, Bai-specific expertise and conditional routing. The largest gains occur on Bowen phonetic loans and divergent Bai word order, while human evaluation and reverse-verifier analyses support the automatic results.

53. 【2610.23183】AMEND: Constraint-Guided Multi-Agent Text Detoxification with Isolated Critics

链接:https://arxiv.org/abs/2610.23183

作者:Tianyu Wang

类目:Computation and Language (cs.CL)

关键词:Text detoxification requires, balancing toxicity removal, requires balancing toxicity, detoxification requires balancing, Text detoxification

备注: 10 pages, 2 figures, 4 tables

点击查看摘要

Abstract:Text detoxification requires balancing toxicity removal, semantic preservation, and fluency. Existing methods typically optimize an unconstrained scalar objective---enabling safety scores to mask semantic loss---or rely on open-ended iterative debate prone to semantic drift and high computational cost. We propose AMEND, an inference-time framework that decouples detoxification into role-conditioned proposal generation, isolated multidimensional criticism, and constraint-first selection. AMEND evaluates diverse candidates with role-blind critics and enforces strict semantic and fluency feasibility before ranking by utility. To maximize efficiency, AMEND Lite restricts subsequent search to at most one targeted repair round only when residual toxic spans remain. On ParaDetox, one-round selection over diverse roles improves the joint evaluation metric by $+0.0508$ over the best single role. On a frozen confirmation test set, AMEND Lite achieves a joint score of $0.6597 \pm 0.0062$, outperforming unconstrained multi-round loops by $+0.0489$ ($p 0.05$) while reducing inference requests by 28.4%.

54. 【2610.23182】What LLMs Do in the Shadows: Reading Context Reliance from the Unembedding Dark Space

链接:https://arxiv.org/abs/2610.23182

作者:Alexandra Kuleshova,Andrey Volodichev,Daria Kotova,Alexey Zaytsev

类目:Computation and Language (cs.CL)

关键词:large language models, Detecting faithfulness hallucinations, language models, high-stakes domains, Detecting faithfulness

备注:

点击查看摘要

Abstract:Detecting faithfulness hallucinations in large language models (LLMs) is crucial for their safe deployment in high-stakes domains. Recent approaches address this by contrasting contextual against parametric knowledge utilization, yet measuring context reliance typically demands noticeable overhead, such as materializing attention maps, running additional forward passes, or training auxiliary probes. In this work, we show that context reliance can be estimated by projecting hidden states onto the dark space - directions that compose weakly with the unembedding matrix. Beyond its recognized function as an initial-token attention sink, we show that this subspace actively mediates context processing, and that its share of hidden-state norm - termed the Dark Matter Ratio (DMR) - provides a direct score of context utilization. Pairing DMR with a parametric knowledge score yields DarkLens, a lightweight faithfulness detector operating strictly within a single forward pass. Evaluated across three QA and summarization benchmarks on six open-weight LLMs (4B-13B parameters), DarkLens matches or outperforms a wide range of baselines without requiring extra forward passes or probe training.

55. 【2610.23181】ree-Aware Posterior Distillation for Long-Horizon Agentic Reinforcement Learning

链接:https://arxiv.org/abs/2610.23181

作者:Heming Zou,Qi Wang,Yixiu Mao,Yun Qu,Yuyi Guo,Zeyuan Liu,Chenglin Li,Weijie Liu,Saiyong Yang,Xiangyang Ji

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:scalable post-training paradigm, large language models, scalable post-training, post-training paradigm, paradigm for large

备注:

点击查看摘要

Abstract:Reinforcement learning with verifiable rewards has become a scalable post-training paradigm for large language models. However, training agents over long-horizon interactions presents two challenges: using only terminal rewards makes turn-level credit assignment sparse and high-variance, while sequential mini-batch updates on a fixed rollout batch introduce policy staleness as the current policy drifts from the behavior policy. Existing approaches obtain denser credit via learned critics, process reward models, or on-policy distillation, but they rely on a value network, step-level annotations, or a stronger external teacher that increase training complexity. Meanwhile, importance sampling and clipping mitigate policy drift, but they do not specify a finite target that stops sequential updates from overshooting. In this work, we introduce TreeOPSD, a critic-free, tree-aware posterior self-distillation framework for long-horizon agentic reinforcement learning. Treating each interaction turn as a tree node, TreeOPSD branches alternative continuations from shared prefixes and recursively backs up terminal rewards into implicit turn-level credit. It then maps each credit to a closed-form, bounded teacher distribution parameterized by the likelihood ratio relative to the frozen behavior policy. Minimizing the divergence between this teacher and the student policy recovers the policy-gradient direction as the tangent at the behavior policy while bounding updates toward a finite target across sequential mini-batches. Empirically, TreeOPSD improves agentic capabilities across several competitive benchmarks and model scales, especially for long-horizon tasks, e.g., raising the average accuracy of Qwen3-30B-A3B-Thinking-2507 by 4.97 points over GRPO on the Deep Research setting.

56. 【2610.23175】Do Speech BCIs Need Larger Models? Rethinking Neural Decoding beyond Scaling

链接:https://arxiv.org/abs/2610.23175

作者:Zehui Feng,Weichuan Wang,Xiaohan Chen,Cuntai Guan,Ting Han

类目:Computation and Language (cs.CL)

关键词:Recent speech brain-computer, speech brain-computer interfaces, Recent speech, complex multi-stage pipelines, brain-computer interfaces

备注: 25 pages, Accepted by NeurIPS 2026 as a Main Track conference paper

点击查看摘要

Abstract:Recent speech brain-computer interfaces (BCIs) increasingly rely on large models and complex multi-stage pipelines for neural decoding. However, in speech BCI, where training data are scarce, noisy, and expensive to collect, the benefits of model scaling remain unclear. This work revisits a fundamental question: are large models truly necessary for accurate neural decoding? We propose BEST (Brain-Encoding-Speech-Text), a two-stage framework for efficient neural-to-text decoding. Instead of relying on large generative models or phoneme-centric pipelines, BEST introduces hierarchical intermediate representations and a compact speech-oriented decoder that directly maps neural activity to text. This design preserves essential structure while significantly reducing computational cost, enabling robust generalization in low-resource settings and practical deployment under constrained resources. On the Brain-to-Text '24 and '25 benchmarks, BEST achieves word error rates (WERs) of 6.19% and 1.62%, respectively, using only 3.85% of the parameters required by comparable methods. Beyond these results, we provide three key insights: (1) decoder scaling yields non-monotonic gains; (2) cross-modal alignment is more critical than model size; and (3) overfitting degards sequence-level performance. Representation analysis further reveals a consistent neural-audio-text alignment pathway.

57. 【2610.23170】Chinese Decision: A Family of Language Models for Single-Pass Probabilistic Decision-Making

链接:https://arxiv.org/abs/2610.23170

作者:Qiang Yan(Institute of Computing Technology, Chinese Academy of Sciences)

类目:Computation and Language (cs.CL)

关键词:language-based applications require, applications require probabilities, open-ended responses, language-based applications, applications require

备注: 11 pages, 2 figures, 11 tables. Code: [this https URL](https://github.com/yanqiangmiffy/chinese-decision)

点击查看摘要

Abstract:Many language-based applications require probabilities over a finite set of decisions rather than open-ended responses. We present Chinese Decision, a family of Chinese-language models for single-pass probabilistic decision-making. Given context, an instruction, and candidate descriptions, the model extracts final-position candidate-letter logits in one forward pass and normalizes them over valid options, without autoregressive answer generation. A shared interface supports Boolean judgments, categorical choices, and ordinal scores. We report a completed 0.8B model trained with distribution cross-entropy on 13.048 million decisions and preliminary 2B checkpoints trained with an additional RLCD objective. On the full CJ-Bench of 307,900 decisions, the uncalibrated 0.8B model achieves 72.24% general-domain accuracy and 76.98% average accuracy across medicine, law, and finance using a single checkpoint, with 1.07% overall expected calibration error. The 2B model reaches 72.56% general-domain accuracy after 40.13% of one epoch but has not surpassed the completed 0.8B model on the professional-domain average. We further evaluate a validation-temperature-scaled deployment model and its Q8 quantization, finding close aggregate performance while documenting individual prediction changes. We release the training, evaluation, and deployment pipeline. The current results establish a reproducible approach to Chinese probabilistic decisions but do not isolate the effect of model scale.

58. 【2610.23166】Explaining Chess and Go in Natural Language

链接:https://arxiv.org/abs/2610.23166

作者:Ori Press,Alexander Golubev

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:Modern chess engines, chess engines play, human ability, Modern chess, engines play

备注:

点击查看摘要

Abstract:Modern chess engines play far beyond human ability, often choosing moves whose underlying ideas are difficult for humans to understand. We propose an automatic metric for evaluating chess explanations, grounded in chess-engine evaluations. Evaluating state-of-the-art language models using this metric, we find that they perform surprisingly poorly, often relying on surface-level board observations rather than robust, transferable chess concepts. We then introduce BinProp, a training-free method that enables these same models to discover reusable chess concepts and use them to explain moves in natural language. BinProp improves explainability for every model tested, nearly tripling the average score compared with direct prompting. Beyond chess, the same method discovers useful concepts in Go, draughts, and shogi without additional tuning.

59. 【2610.23157】Cross-Centaur: Modeling Individual Decision-Making Across Psychological Tasks with Language Models

链接:https://arxiv.org/abs/2610.23157

作者:Hikaru Asano,Hidezo Suganuma,Ryutaro Mori,Yukino Baba

类目:Computation and Language (cs.CL)

关键词:Large language models, Large language, Large, tasks, models

备注: Accepted to EMNLP 2026 (Main Conference, Oral Presentation)

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used as computational models of human behavior. Recent models such as Centaur have advanced this goal by fine-tuning LLMs on trial-by-trial decisions from psychological experiments. However, existing large-scale behavioral datasets do not link the same participants across different tasks, so these models learn population-level regularities but are not trained to model individual-level regularities across tasks. We introduce Cross-Psych-101, a dataset of 591 participants and 261{,}551 valid decisions across 12 Bandit, Tradeoff, Structure, and Social tasks. We train Cross-Centaur to predict a participant's target-task actions from a target-task description and the source-task description paired with the same participant's source-task behavior. Cross-Centaur outperforms off-the-shelf LLMs and Centaur on held-out participants, both within and across tasks. Probing analyses suggest that its hidden states encode participant-level behavioral tendencies that transfer across tasks. These results highlight the potential of cross-task individual-level data for predicting human decision-making with language models. Cross-Pysch-101 is available at this https URL.

60. 【2610.23149】Can AI interview? Comparing AI-led to Human-led Chat Interviews

链接:https://arxiv.org/abs/2610.23149

作者:Semra Guven,Tobias Gårdhus,Andreas Bjerre-Nielsen,Anna Rogers,Hjalmar Bang Carlsen

类目:Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

关键词:potentially bridging social, Large language model, bridging social science, social science longstanding, science longstanding divide

备注: 37 pages, 3 figures, 6 tables. Submitted to Socius. Code and data: [this https URL](https://github.com/ainterviewer/can-ai-interview)

点击查看摘要

Abstract:Large language model chatbots have been proposed as AI-interviewers for collecting qualitative interview data at scale, potentially bridging social science's longstanding divide between the breadth of surveys and the depth of qualitative interviews. This paper provides the first direct empirical comparison of data quality in AI-led and human-led interviews. In a randomized experiment (N = 41), university students were interviewed via synchronous text chat by either trained non-expert interviewers or a locally hosted AI system; we evaluate exposure, specificity, and relevance. Median interview duration was similar across conditions, but AI-interviewers asked more than twice as many questions per interview and elicited roughly 65 percent more respondent text per interview. Per-question responses were longer with human interviewers, though not after multiple-testing correction; only AI-condition participants skipped questions. Responses were almost uniformly on-topic in both conditions; for specificity we detect no difference, but the design cannot exclude one of up to three quarters of a point. These results were obtained with a small, locally hosted open-weight model (7B parameters), which addresses concerns about data security, GDPR compliance, and scientific reproducibility. Our findings support the viability of AI-interviewing for large-N qualitative data collection.

61. 【2610.23122】LED: Improving Masked Diffusion Language Models by Lookahead Editing

链接:https://arxiv.org/abs/2610.23122

作者:Yuyan Zhou,Zeyuan Yang,Yuxuan Song,Zhicheng Cai,Hongli Yu,Weiying Ma,Hao Zhou,James Kwok

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:enabling non-autoregressive text, Diffusion large language, non-autoregressive text generation, large language models, autoregressive language models

备注: 10 pages, 5 figures

点击查看摘要

Abstract:Diffusion large language models (dLLMs) have emerged as a promising alternative to autoregressive language models, enabling non-autoregressive text generation through parallel decoding. Existing dLLMs can be broadly categorized into two families: masked diffusion models (MDMs) and uniform diffusion models (UDMs) In this work, we theoretically show that MDMs are easier to optimize due to their mask-based transition schedule but have lower computational expressivity, whereas UDMs enable iterative state revision and greater expressivity but are substantially harder to train. This trade-off raises a natural question: can we obtain the expressivity of iterative revision without giving up the simple, easy-to-optimize transition schedule of MDMs? Motivated by this analysis, we propose Lookahead Editing (\ours{}), which augments masked diffusion decoding with a rewritable proposal state. At each decoding step, the model performs several lookahead updates to iteratively refine future predictions in this proposal state before committing tokens to the masked sequence. This design introduces a rewritable proposal that uses additional compute to improve expressivity while keeping the simple mask-based transition schedule of MDMs. We fine-tune Qwen2.5-7B and Qwen3-8B to obtain LED-\texttt{7B} and LED-\texttt{8B}, respectively. Across eight benchmarks, LED SFT yields average gains of $+11.4$ and $+7.7$ points over standard MDM SFT. Moreover, using SFT alone, LED-\texttt{8B} outperforms LLaDA2.1-16B Q-mode, which is trained with continued pre-training, supervised fine-tuning, and reinforcement learning.

62. 【2610.23093】Disentangling Language Effects on Tool Admission and Post-Retrieval Safety

链接:https://arxiv.org/abs/2610.23093

作者:Aditya Nawal,Manit Baser,Mohan Gurusamy

类目:Computation and Language (cs.CL)

关键词:LLM agents increasingly, LLM agents, evaluation remains English-centric, remains English-centric, agents increasingly

备注: 33 pages, including appendix

点击查看摘要

Abstract:LLM agents increasingly use retrieval tools across languages, yet their safety evaluation remains English-centric. It remains unclear whether language affects tool admission, post-retrieval generation, or both. We independently vary request, retrieved-page, and required response languages in a controlled URL-retrieval setting across ten models and seven languages. We identify Safety Loss through Interlingual Processing (SLIP). Non-English harmful requests increase mean tool admission from 46.9% to 67.4%, with a positive mean change in every model. This pattern also persists in an autonomous retrieval setup across all four models tested in this setting. Requiring answers in the page language increases pooled harmfulness on matched tool calls from 50.3% to 57.4% across four closed-weight models, mainly in Chinese and Hindi. Translating pages alone produces no consistent harm increase in eight models with comparable inference settings. Automated audits show that a non-harmful response may be a genuine safety refusal, a deflection citing language difficulties, or an unusable answer. Harmfulness labels alone cannot distinguish these outcomes. Multilingual safety evaluations should therefore measure tool admission and response harmfulness separately and distinguish refusal from capability failure.

63. 【2610.23071】Before Retrieval Begins: Safety and Tool-Use Decisions in LLM Agents

链接:https://arxiv.org/abs/2610.23071

作者:Aditya Nawal,Manit Baser,Mohan Gurusamy

类目:Computation and Language (cs.CL)

关键词:Large language models, tool-safety research examines, Large language, language models increasingly, models increasingly act

备注: 19 pages, 5 figures. Preprint version of a manuscript submitted to Transactions of the Association for Computational Linguistics (TACL)

点击查看摘要

Abstract:Large language models increasingly act as agents that call external tools, yet most tool-safety research examines only what follows a tool call. The prior decision of whether to call the tool remains largely unexamined and can influence downstream safety. Across the seven open-weight models, the unweighted model-average harm rate after admitted harmful requests is 74.5%. To identify what governs this decision, we apply a factorial intervention to the input request. Within our generated construction, neutralizing the requested-operation component produces the largest admission contrast (19 pp). A linear direction estimated from this contrast influences held-out admission in four of seven models; effects on operation-neutralized requests in some models show that it is not an operation-specific mechanism. We then test whether written refusal is behaviorally and representationally coupled to the same decision. Written refusal accompanies 33.6% of admitted harmful calls. Plain-text refusal training reduces unsafe admission in models that retain benign tool use, showing that response-level safety training can transfer to the call decision. Together, these results establish a partial, model-dependent relation between written refusal and tool admission. They motivate direct evaluation and supervision of tool admission rather than treating text refusal as its proxy.

64. 【2610.23062】ParetoChat: An LLM-Based Interface for Interactive Multi-Objective Optimization

链接:https://arxiv.org/abs/2610.23062

作者:Gokhan Ceyhan

类目:Computation and Language (cs.CL); Optimization and Control (math.OC)

关键词:decision makers, deployed in settings, settings where decision, balance some conflicting, conflicting criteria

备注:

点击查看摘要

Abstract:Multi-objective optimization models are often deployed in settings where decision makers (DMs) must balance some conflicting criteria. In practice, however, stakeholders must translate their qualitative preferences between different criteria into numerical weights, priorities, or reference points required by optimization methods, which can be difficult to specify and interpret. This paper proposes \emph{ParetoChat}, an LLM (large language model)-based expert-agent interface for interactive multi-objective optimization. The agent translates natural-language user input into structured scalarization parameters, invokes an optimization system, presents candidate solutions, and iteratively elicits feedback. We describe a multi-agent architecture that separates input processing, multi-criteria decision-making (MCDM) expertise, solution presentation, and feedback processing. We then present a simulation study using an LLM-based DM agent and benchmark ParetoChat against interactive methods implemented in DESDEO, including reference-point and NIMBUS methods. The computational experiments on multi-objective binary knapsack and set-partitioning instances show that ParetoChat can guide the search efficiently toward solutions that match the DM's preferences. An application to historical courier-order assignment instances illustrates how users can explore objective extremes and intermediate trade-offs through natural-language requests. The results indicate that LLM agents may provide a practical interaction layer between business stakeholders and optimization tools.

65. 【2610.23060】Same Person, Different Advice: Auditing LLM Financial Advice with Repeated Risk-Tolerance Responses

链接:https://arxiv.org/abs/2610.23060

作者:Soovadeep Bakshi,Apurba Bose,Aishwarya Bose,Sandip Nandi

类目:Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词:financial advisers set, stock allocation largely, answer, national US panel, 0-10 scale

备注: 23 pages, 5 figures, 9 tables

点击查看摘要

Abstract:AI financial advisers set a client's stock allocation largely from one stated-risk question, yet people do not answer it the same way twice: in a national US panel, 41% of households chose a different answer two years later, and in a laboratory retest a third of people moved two or more points on a 0-10 scale after six months. Seven large language models from five providers gave one-turn allocation advice for 800 real household profiles in which only the risk answer changed. The recommended stock share moved by 10 to 16 percentage points on average, and by 24 to 35 when the answer changed, against 0.6 to 4.2 points for the same prompt asked twice; in the laboratory retest the rating alone moved advice by 11 to 18 points. Without any note, the models respond to the answer about as strongly as when told that it is very reliable (less so for the two Claude models). If that instructed response is how each model maps attitude to advice, discounting the answer for its measured reliability, as classical test theory prescribes, would cut the swings by a factor of 2.4 to 3.3. The swing is largest for clients under 40. A note that the answer is noisy steadies some models, but shifts their weight to the client's age and pulls cautious clients towards a generic middle allocation: clients unwilling to take any risk are advised 22% stocks instead of 4%. Three extra money questions reduce the swing for some models, with no statistically detectable change relative to how much advice differs across people. In a scripted test, one clarifying question removes nearly all of the swing from an answer the client then corrects (33.5 points to 1.9 on average) while keeping the response to a change the client confirms. We argue that same-person retest audits should be a standard check for AI advisers, and that what to do with an unreliable answer is a question of client autonomy as well as of statistics.

66. 【2610.23030】ECHO: Replacing the Compliance Proxy with Response Harmfulness in Optimization-Based Jailbreak Attack

链接:https://arxiv.org/abs/2610.23030

作者:Yuanwei Wu,Lingdong Huang,Yunlong Mao,Kanye Ye Wang,Jingyu Hua,Sheng Zhong

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词:extensive safety alignment, large language models, language models remain, models remain vulnerable, safety alignment

备注:

点击查看摘要

Abstract:Despite extensive safety alignment, large language models remain vulnerable to jailbreak attacks. Existing optimization-based attacks share a single objective: maximize a token-level proxy of victim compliance---such as the likelihood of an affirmative prefix---computed on the prompt rather than the decoded reply. This proxy cannot distinguish a cautious hedge from a fully actionable harmful answer, leaving the search blind to what the model actually says. We propose ECHO (Evaluation-Conditioned Harmfulness Optimization), which replaces the compliance proxy with response-level, continuous harmfulness scores from HarmSig, a 1.7B regressor grounded in actual harmful capability. ECHO couples HarmSig with five word-level perturbation operators and Keyword-Anchored Beam Search with global top-m memory, under a strict black-box threat model. Across five open-weight victims on AdvBench, ECHO achieves up to 0.898 StrongREJECT mean score and 89.23% HarmBench success. Our code is publicly available at this https URL.

67. 【2610.22999】Controlling the Diversity-Quality Trade-Off of LLMs by Merging Models Before and After Alignment

链接:https://arxiv.org/abs/2610.22999

作者:Yasuaki Sumita,Tomoharu Iwata,Toshiyuki Tanaka

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:large language models, diversity, characteristics of large, large language, Alignment

备注: 13 pages, 5 figures

点击查看摘要

Abstract:Alignment is known to change the output characteristics of large language models (LLMs). Base models tend to generate more diverse outputs, whereas aligned models tend to produce higher-quality outputs. The appropriate balance between the two depends on the task. Existing methods either require costly fine-tuning or, like temperature sampling, mainly improve lexical diversity rather than semantic diversity. We introduce a depth-aware FrankenMerging approach for controlling the diversity--quality trade-off between an aligned model and its base model without additional training. This approach combines the lower layers of an aligned model with the higher layers of its base model based on the hypothesis that lexical diversity is more closely associated with lower layers and semantic diversity with higher layers. Experiments showed that varying the number of layers taken from each model adjusts both diversity and quality. In most cases, the merged models exhibited higher semantic diversity than the aligned model, and at some split positions, they showed higher lexical diversity than both original models. They also demonstrated a better diversity--quality trade-off than temperature sampling in most settings. A supporting ablation, in which we reversed the merging order, yielded results largely consistent with the hypothesis.

68. 【2610.22985】Prism Attention: Proposal-Refined Index Sharing Mechanism for Efficient LLMs Inference

链接:https://arxiv.org/abs/2610.22985

作者:Zhenxu Tian,Kebin Liu,Zhengwu Yang,Yi Su,Qingqing Dang,Yanlin Sha,Kaipeng Deng,Dianhai Yu,Yanjun Ma,Juntao Li,Min Zhang

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:large language models, language models, ever-growing Key-Value, autoregressive step, large language

备注: Published as a main conference paper at NeurIPS 2026

点击查看摘要

Abstract:Long-context decoding in large language models (LLMs) is increasingly bottlenecked by the memory and computation required to attend over an ever-growing Key-Value (KV) cache at each autoregressive step. Although token-level sparse attention reduces this burden by restricting computation to a small subset of relevant past tokens, its practical gains are often offset by repeatedly recomputing layer-wise sparse indices as the context grows. A common remedy is to share sparse indices across layers by computing them only at designated anchor layers, but such static reuse ignores the layer-wise evolution of attention patterns, causing the reused indices to progressively deviate from the layer-specific optima and incur substantial attention loss. By revisiting cross-layer sparsity from the perspective of attention dynamics, we find that inter-layer salient token shift is highly localized: although the exact top-$\kappa$ indices differ across layers, the core high-attention tokens remain stable, with changes concentrated near the expanded boundary of previously selected regions. Motivated by this, we propose Prism Attention, a proposal-refined sparse attention framework. It replaces rigid cross-layer index reuse with a coarse-to-fine strategy, preserving layer-wise adaptability while retaining the efficiency benefits of cross-layer sharing. Extensive experiments show that Prism Attention achieves state-of-the-art performance among mainstream sparse attention methods on both reasoning and long-context benchmarks, while attaining a $3.4\times$ end-to-end decoding speedup over FlashAttention at 128K context length.

69. 【2610.22984】Self-Evolving Agents Can Repair Failures but Struggle to Generalize from Them

链接:https://arxiv.org/abs/2610.22984

作者:Weixiang Zhao,Yichen Zhang,Yanyan Zhao,Jinming Bai,Bin Liang,Ruifeng Xu,Bing Qin,Ting Liu

类目:Computation and Language (cs.CL)

关键词:Experience-driven self-evolution offers, large language model, Experience-driven self-evolution, language model, self-evolution offers

备注: 28 pages, 9 figures, 6 tables. Weixiang Zhao and Yichen Zhang contributed equally

点击查看摘要

Abstract:Experience-driven self-evolution offers a promising path for large language model (LLM) agents to continually improve through interaction. Yet existing approaches often rely on successful trajectories or external evaluation signals, leaving unclear whether agents can evolve when such positive anchors are unavailable. We study this question through Cold-Start Failure-Only Evolution (CFOE), where agents start without accumulated experience and learn only from failed interactions without privileged guidance. Across three self-evolving paradigms, multiple LLM backbones, and four interactive environments, we uncover a consistent repair-generalization gap: failure-derived experience can help repair previously failed tasks, but rarely yields sustained improvements on unseen tasks. Further analysis shows that agents often misinterpret failures, while even verified-correct experience remains difficult to transfer. Relaxing CFOE reveals that verifier feedback and additional interaction provide limited gains, whereas successful trajectories substantially improve transfer. These findings suggest that current self-evolving agents are better at repairing observed failures than building generalizable capabilities from failure.

70. 【2610.22980】KiranaBench: Can a Language Model Run a Neighbourhood Shop?

链接:https://arxiv.org/abs/2610.22980

作者:Bhuvan Arora,Ankita Karmakar,Chaitanya Jain,Dilesh Churiwal,Harshit Jain,Shivansh Manish Dubey,Manish Prasad,Raja Piyush,Kshitij Tayal,Dhruv Kumar,Jagat Sesh Challa,Raunak Manekar,Yash Sinha

类目:Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词:Large language model, Large language, including autonomously running, increasingly evaluated, Consumption Expenditure Survey

备注: 27 pages, 16 figures, 7 tables. Code, data and traces: [this https URL](https://osf.io/s2pxg/)

点击查看摘要

Abstract:Large language model (LLM) agents are increasingly evaluated on long-horizon tasks, including autonomously running a business. Existing benchmarks for this setting are almost exclusively English-language, Western in retail context, and single-agent, with the agent observing the business directly. We study how these results transfer to a multi-agent Indic setting. We introduce KiranaBench, a simulated Indian general store in which four roles (manager, cashier, helper, and bookkeeper) are each played by a separate LLM agent. Interactions with customers and suppliers occur in English, Hindi, or Hinglish, and product demand is calibrated to India's national Household Consumption Expenditure Survey. Evaluating four open-weight LLMs, we find that all fall far short of a fixed-rule shopkeeper baseline: the best model earns only one-eighth of the baseline's profit, and two models finish below an unmanaged shop. Performance is also consistently lower for Hindi and Hinglish than for English supplier communication. KiranaBench offers evidence that current LLM agents are not yet reliable for autonomously operating small businesses in India, and provides a testbed for developing agents suited to settings that are long-horizon, collaborative, and multilingual.

71. 【2610.22961】What Shapes Brain Alignment of Large Language Models during Dialogue? Insights from Language Production and Comprehension

链接:https://arxiv.org/abs/2610.22961

作者:Yuko Nakagi,Yuya Chiba,Yasue Kishino

类目:Computation and Language (cs.CL); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

关键词:investigate representational similarities, large language models, Brain alignment, investigate representational, representational similarities

备注: 33 pages

点击查看摘要

Abstract:Brain alignment of large language models (LLMs) offers a way to investigate representational similarities between LLMs and the human brain during language processing. While previous studies have mainly focused on passive language comprehension, little is known about such alignment during dialogue, in which speakers engage in both language production and comprehension. In this study, using fMRI data collected during dialogue, we examine brain alignment during language production and comprehension across LLM layers and brain regions. We assess its association with the intrinsic dimension (ID) of LLM representations and the contributions of several interpretable linguistic and communicative features. Our results reveal distinct patterns of brain alignment between production and comprehension, as well as strong associations with ID in brain regions associated with each processing mode. Furthermore, we show that the contributions of linguistic and communicative features also vary across processing modes, LLM layers, and brain regions.

72. 【2610.22959】SAFE-Mem: Secure Agentic Memory with Fine-Grained Authority and Governance-Aware Retrieval

链接:https://arxiv.org/abs/2610.22959

作者:Haoming Li,Dingyi Kang,Xu Hu,Jinxin Yang,Zhu Xu,Chenru Wang,Yi Ge,Miao Yin,Guanpeng Li,Feng Chen,Bingzhe Li

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词:Large language model, Large language, agents increasingly rely, support long-term reasoning, language model

备注:

点击查看摘要

Abstract:Large language model (LLM) agents increasingly rely on persistent memory to support long-term reasoning and personalized interactions. However, information collected from external sources can introduce security risks when untrusted claims (i.e., atomic statements) are later treated as authorized preferences, policies, or permissions. Existing defenses typically rely on content-based filtering or coarse-grained provenance tracking, which either fail to prevent unauthorized memory use or block legitimate information, sacrificing memory utility. To address these limitations, we propose SAFE-Mem, a fine-grained memory governance framework that improves security while preserving legitimate memory use. First, SAFE-Mem annotates each claim with three governance labels (i.e., kind, authority, and scope) to capture its provenance and permitted use. Second, governance-aware retrieval matches query requirements with claim permissions to block unauthorized influence while retaining legitimate information. Third, a governance-enabled memory graph connects source sentences, claims, and entities to support provenance tracking and efficient retrieval. Across four LLM backbones on MPBench and LoCoMo, SAFE-Mem attains the lowest attack success among defenses that retain legitimate memory, at least 77% below the strongest of them, and the highest answer accuracy of all evaluated defenses, improving it by up to 15%. The code is available at this https URL.

73. 【2610.22953】Recognizing Atari and Assessing Sente: Controlled Evaluation Tasks for Language-Based Go Agents

链接:https://arxiv.org/abs/2610.22953

作者:Taiyi Chen,Iskar Deng,Amandalynne Paullada

类目:Computation and Language (cs.CL)

关键词:evaluation remains unclear, remains unclear, concise descriptions, descriptions of game, game states

备注: 7 pages, 2 figures, 5 tables. The first two authors contributed equally

点击查看摘要

Abstract:Domain terminology provides concise descriptions of game states and strategic relationships, but whether game-playing language models can accurately recognize these concepts and relate them to move evaluation remains unclear. We construct a controlled evaluation set centered on atari and its relationship to sente in Go, examining terminology recognition under local board changes and move evaluation under different strategic conditions. We conduct our tests on LoGos, a Go language model, after fine-tuning it with terminology and commentary supervision. The model struggles to recognize changes in the atari relationship and assess its strategic implications. Its terminology predictions are associated with move preferences even when those preferences contradict the reference evaluation. Our controlled tests provide a framework for examining whether language-based Go agents connect domain terminology with precise board relationships and strategic move values.

74. 【2610.22942】Aligning Language Models Towards Counterfactual Invariance

链接:https://arxiv.org/abs/2610.22942

作者:Basar Demir,Emily Shen,Ksheeraj Sai Vepuri,Sourabh Kulkarni,Harihar Subramanyam,Ankit Jain,Nan Jiang,Chirag Nagpal

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:Small variations, language model outputs, large language model, alter the semantics, meaningfully alter

备注:

点击查看摘要

Abstract:Small variations in prompt characteristics can meaningfully alter the semantics, tone, and contextual assumptions of large language model outputs. Such characteristics can involve group variables such as demographics or other sensitive latent attributes. Sensitivity to such input variables is undesirable when demographic information is causally irrelevant to the task, but might still be relevant for generation of semantically coherent responses. This makes the task of enforcing counterfactual invariance while preserving model utility difficult. To study this problem, we first show that standard model alignment recipes (such as reinforcement learning) increase differences in response quality across demographics, while improving overall response quality, ultimately amplifying what is known as counterfactual bias. To address this, we develop a policy gradient technique involving a group-level reward function that operates on matched pairs of counterfactual prompts. For completeness, we build a dataset of controlled counterfactual prompt pairs and design an evaluation that separately measures cases where demographic information is causally relevant to the answer. Finally, we validate our findings on several fairness benchmarks. We demonstrate that our methods reduce counterfactual differences while preserving overall response quality and that the models continue to adapt appropriately when such sensitive information is relevant.

75. 【2610.22940】Beyond Surface Cues: Robust LLM-Generated Korean Text Detection

链接:https://arxiv.org/abs/2610.22940

作者:SungHo Kim,SangKeun Lee

类目:Computation and Language (cs.CL)

关键词:generate increasingly fluent, increasingly fluent text, large language models, generate increasingly, large language

备注:

点击查看摘要

Abstract:As large language models (LLMs) generate increasingly fluent text, the need for reliable detection of LLM-generated content has grown substantially. However, existing research remains heavily English-centric, leaving Korean largely underexplored. Moreover, current evaluations of Korean text detection often rely on superficial cues, leading to overly optimistic estimates of detection performance. To address these limitations, we introduce \textsc{KoLing}, a bias-controlled adversarial benchmark comprising 50.9k instances that suppresses superficial shortcuts while preserving semantic content and separately evaluates LLM-generated and LLM-modified text detection. We further propose KoLingProbe, an interpretable detector grounded in theoretical linguistics that models Korean-specific properties across multiple linguistic levels. Experiments show that KoLingProbe substantially outperforms strong baselines on all detection tasks while remaining robust to adversarial attacks. Our analyses further reveal that integrating complementary linguistic features across multiple levels yields both improved performance and interpretability.

76. 【2610.22937】Many Biases, One Circuit: Post-Training Tunes a Pretrained Cue-Routing Mechanism

链接:https://arxiv.org/abs/2610.22937

作者:Prakhar Gupta,Terry Jingchen Zhang,Zhijing Jin

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:Language models, correct answer, abandon a correct, wrong option, Language

备注:

点击查看摘要

Abstract:Language models often abandon a correct answer when the prompt contains a cue, a hint toward a wrong option such as "I think the answer is B." Sycophancy and related biases show this failure. They are often studied separately and blamed on alignment. We test this view causally, tracing the attention heads behind these biases through the stages of two post-training pipelines. In multiple-choice tests on most models, four cue types rely largely on the same few heads, a shared circuit already present in pretrained models. Most base models follow cues in plain text. Fine-tuning a base model on about 200 generic assistant examples without cues activates these heads in chat format, so cue-following can be a side effect of assistant tuning. The final reinforcement learning (RL) stage strengthens the effect of cues in almost every comparison. In Tulu-3-8B and OLMo-2-7B, we swap the attention patterns of six middle layers between the RL checkpoint and its predecessor. For suggested-answer cues, this shifts each checkpoint's cue effect most of the way to the other's level. Post-training thus seems to change when and how strongly models use this circuit. Mitigation for these multiple-choice biases could target this circuit.

77. 【2610.22934】ASR-Style Transcript Normalization Removes Useful Pragmatic Signal for Dialogue Act Classification

链接:https://arxiv.org/abs/2610.22934

作者:Lucky Onyekwelu-Udoka,Md Shafiqul Islam

类目:Computation and Language (cs.CL)

关键词:Automatic speech recognition, expanding colloquial forms, potentially discarding cues, dialogue act classification, removing filled pauses

备注:

点击查看摘要

Abstract:Automatic speech recognition (ASR) pipelines often normalize transcripts by removing filled pauses and punctuation and expanding colloquial forms, potentially discarding cues useful for dialogue act classification. We evaluate nine transcript conditions across six classifiers (TF-IDF logistic regression, RoBERTa, BERT, ALBERT, GPT-2, and BiLSTM) and three conversational corpora (Switchboard, ICSI MRDA, and SLUE-HVB), supplemented by multi-seed experiments, normalization controls, and real-ASR evaluations. Across five random seeds, heavy normalization reduces Macro-F1 in all 15 neural model-corpus combinations under the original preprocessing protocols. Removal using the original filler and backchannel lexicon consistently degrades performance on MRDA and SLUE-HVB but produces mixed effects on Switchboard. Punctuation-aware TF-IDF experiments show that punctuation removal reduces Macro-F1 by 0.036 on Switchboard and 0.078 on MRDA, demonstrating that the original linear baseline's apparent insensitivity resulted from tokenization. Restricting filler removal to um, uh, and erm preserves degradation on MRDA but largely eliminates the SLUE-HVB effect, where the original lexicon removes class-defining backchannel expressions. These findings demonstrate that normalization effects depend on preprocessing definitions, feature extraction, and conversational context, supporting task-dependent rather than indiscriminate transcript normalization.

78. 【2610.22924】Sep-Latent: Separator Tokens as Natural Compression Anchors for Implicit Reasoning

链接:https://arxiv.org/abs/2610.22924

作者:Yinlong Xu,Jianfeng Huang,Zhengdong Zhou,Mingjie Lin,Fuyu Lv,Dan Ou,Hongxia Xu,Jian Wu

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Large Language Models, Large Language, demonstrated remarkable success, verbosity remain significant, remain significant barriers

备注:

点击查看摘要

Abstract:Large Language Models (LLMs) have demonstrated remarkable success in complex reasoning through explicit Chain-of-Thought (CoT), but the associated computational overhead and token verbosity remain significant barriers to efficiency. While implicit reasoning in continuous latent spaces offers a promising alternative, existing methods like Coconut and CODI often rely on fixed-length latent sequences and suffer from representational collapse. In this paper, we propose Sep-Latent, an adaptive implicit reasoning framework that utilizes separator tokens as structural semantic anchors. By introducing an Attention-Decay mechanism, we force the model to aggregate and compress reasoning logic into these anchors during training. We then align explicit and implicit pathways through multi-level distillation across all layers to ensure logical consistency. Crucially, Sep-Latent enables dynamic reasoning depth by adaptively terminating the latent thinking phase based on query complexity. Experimental results on the GSM8k-Aug benchmark show that Sep-Latent achieves an accuracy of 56.8\% with an average of only 5.4 tokens, significantly outperforming prior fixed-length implicit models in efficiency while narrowing the performance gap with explicit CoT. Further analysis via PCA and symbolic variant testing confirms that our method ensures semantic grounding and exhibits superior robustness to perturbations.

79. 【2610.22919】Where's the Indirect Evidence? Investigating Grammatical Generalization with Influence Functions

链接:https://arxiv.org/abs/2610.22919

作者:William Dai,Zhenghao Herbert Zhou,Maya Viswanathan,Robert Frank

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Misra and Mahowald, Language models generalize, indirect evidence, Language models, indirect evidence driving

备注: 18 pages

点击查看摘要

Abstract:Language models generalize beyond their training corpus to learn linguistic phenomena (Patil et al., 2024; Misra and Mahowald, 2024), showing that there exists indirect evidence driving learning. Prior work has inferred that indirect evidence exists without identifying its character or considered specific hypotheses about what it might be. We explore an alternative bottom-up method for identifying indirect evidence. We use influence functions (Koh and Liang, 2017) to measure how individual training sentences affect model predictions in 15 grammatical phenomena from BLiMP (Warstadt et al., 2020). We filter out a phenomenon's direct evidence using hand-constructed rules and take the 60,000 most influential remaining sentences as indirect evidence. This indirect evidence substantially affects learning: retraining without it lowers held-out accuracy more than removing a matched random group for every phenomenon across five models (by a median of 12 points). We characterize the indirect evidence by its similarity to our direct evidence filters: it (partially) meets the filters' structural conditions at a median of 4.7 times the rate of a matched random group. Finally, clustering phenomena by indirect-evidence overlap recovers three of the five BLiMP categories that include multiple phenomena, suggesting that this method can reveal linguistic relationships.

80. 【2610.22906】FederatedBytes: Tokenizer-Free, Byte-Level Small Language Models for Efficient Multimodal Federated Learning

链接:https://arxiv.org/abs/2610.22906

作者:Ali Sarabadani,Massimo Piccardi,Mehran Abolhasan,Farzad Tofigh,Ian Zhou,Justin Lipman

类目:Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

关键词:powerful machine learning, machine learning framework, Federated Learning, manageable Federated Learning, distributed clients

备注:

点击查看摘要

Abstract:Federated Learning (FL) is a powerful machine learning framework that allows building a global model from the contributions of multiple, distributed clients, while ensuring the privacy of their local data. However, its heavy computational and communication overheads challenge its use for contemporary AI workloads such as natural language processing (NLP) and multimodal analysis. For this reason, this paper presents a novel small language model that leverages byte-level text and multimodal data processing, enhanced by a linear attention mechanism, to enable manageable Federated Learning of NLP and multimodal analysis tasks. The proposed model, nicknamed FederatedBytes, manages to process text and any other data types, including images, by treating its input as a mere sequence of bytes, while its lean linear attention mechanism allows abating the overall memory and computational footprint. To prove the effectiveness of the proposed model we have carried out an extensive performance evaluation on sentiment analysis tasks in multilingual and multimodal settings over the Multilingual Amazon Reviews and ScienceQA datasets. The experimental results show that FederatedBytes has been able to outperform comparable models such as ByT5 and LSTM, achieving higher accuracy while significantly reducing memory and communication overheads.

81. 【2610.22894】Competence-Based Evaluation of Logical Reasoning in Large Language Models

链接:https://arxiv.org/abs/2610.22894

作者:Jize Jiang,Chengxiang Zhai

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:Recent advances, shortcomings remain, including inconsistencies, linguistic variation, large language models

备注:

点击查看摘要

Abstract:Recent advances in large language models (LLMs) have brought impressive performance across diverse tasks; however, shortcomings remain in logical reasoning, including inconsistencies under linguistic variation. To improve the reasoning capacity of LLMs, we must be able to accurately measure their reasoning capacity. Current benchmarks primarily report single accuracy numbers on selected reasoning tasks. Such a performance-based evaluation methodology says little about a model's generalization capacity in reasoning. To address this limitation, we argue for a different evaluation paradigm, called competence-based evaluation (CBE), which tests whether models reliably apply the same competence across a family of problems. A parameterized generator scales complexity while keeping the required competence fixed, and matched answer-preserving presentations test correctness beyond one formulation. We instantiate CBE on elementary ordering tasks, scaling input size while varying presentations of the same ordering rule. Across six GPT and Qwen models, performance is reasonably good over bounded complexity ranges, but even strong models fail the competence condition across the tested family. Chain-of-thought and GRPO extend strong performance without resolving all tested failures; supervised LoRA shows little held-out transfer. CBE provides diagnostic profiles and an evaluation protocol that can grow with future models.

82. 【2610.22892】Bengali Hallucination Detection with Retrieval and Programs: A System Study

链接:https://arxiv.org/abs/2610.22892

作者:Shamim Hasan,Samiya Ahmed Chowdhury

类目:Computation and Language (cs.CL)

关键词:Bengali hallucination detection, supplied reference passage, Bengali hallucination, distinguish unsupported factual, unsupported factual claims

备注: 8 pages

点击查看摘要

Abstract:Bengali hallucination detection must distinguish unsupported factual claims from incorrect reasoning, often without a supplied reference passage. We present and characterize an inference-only system that combines response-conditioned query rewriting, hybrid retrieval, and task-specific language-model judging. Six retrieval routes search question-answer and passage collections; a router directs each example to a 27B textual judge or a 14B agent that can compare retrieved answers, reason directly, or generate and execute Python. We characterize the system using version-specific code, saved predictions, execution traces, and corpus metadata from the Olikbochon challenge. Kaggle associates a displayed private macro-F1 of 0.956 with Version 2; its saved run processes 2,516 examples in 220.99 minutes on two T4 GPUs. Of 253 math-routed examples, 88 terminate through candidate matching, while execution traces expose 49 stderr-bearing run events across 35 examples. A later run changes six predictions despite identical core worker code. A bounded audit of 1,090 benchmark-related corpus records finds exact question or context overlap for 38 processed evaluation inputs, precluding an unqualified claim of corpus-independent generalization. The contribution is a concrete retrieval-and-computation judging architecture with an auditable operational characterization, not a controlled estimate of component gains. We distinguish the reported leaderboard result from independently recomputed diagnostics and identify the evidence needed for stronger effectiveness and reproducibility claims.

83. 【2610.22889】NLData2Opt: Benchmarking Parameter Derivation and Prediction for Modeling Optimization Problems from Natural Language and Data

链接:https://arxiv.org/abs/2610.22889

作者:Lijia Liu,Kyohei Atarashi,Jiyi Li,Koh Takeuchi,Shunji Umetani,Hisashi Kashima

类目:Computation and Language (cs.CL)

关键词:Formulating optimization problems, Large Language Models, Formulating optimization, time-consuming and costly, Large Language

备注:

点击查看摘要

Abstract:Formulating optimization problems from raw inputs of problem descriptions and data is time-consuming and costly. While Large Language Models (LLMs) offer a promising way to automate this process, existing benchmarks overestimate their capabilities by relying on idealized inputs where all data is relevant and complete. This diverges from reality, where data-centric reasoning is required to extract, compute, and predict parameters from noisy sources. To address this, we introduce NLData2Opt, a benchmark to evaluate LLMs on the multi-stage reasoning inherent in practical optimization workflows. NLData2Opt decomposes problems into problem descriptions and data, and requires models to (1) extract relevant parameters from data containing misleading attributes, (2) compute missing parameters derived by transforming existing data attributes, and (3) predict unavailable future values from historical observations. Evaluation results show substantial performance decline relative to existing benchmarks, indicating that benchmark progress does not directly translate to formulation accuracy in practical optimization workflows. NLData2Opt is available at this https URL.

84. 【2610.22887】Batched Contextual Reinforcement II: Does RLVR Need Long Rollout Windows?

链接:https://arxiv.org/abs/2610.22887

作者:Bangji Yang,Hongbo Ma,Ruihan Guo,Jiajun Fan,Xi Zhu,Ge Liu

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:make reinforcement learning, Batched Contextual Reinforcement, rollout windows make, Long rollout windows, group-relative accuracy advantages

备注: 22 pages, 3 figures, 2 tables

点击查看摘要

Abstract:Long rollout windows make reinforcement learning with verifiable rewards (RLVR) expensive, yet simply shortening them can remove the correctness signal: when every single-problem rollout truncates before an answer, group-relative accuracy advantages vanish. As a technical continuation of Batched Contextual Reinforcement (BCR), we study how concurrent rewards relax this dependence on long windows. Concurrent Constraint Reinforcement (CCR) places three independently verifiable problems in one capped training completion. Correct answers completed before truncation retain credit, while a shared budget encourages shorter useful reasoning without an explicit length penalty. We connect this mechanism to conditional reward- and update-variance analyses and study 4B and 8B mathematical reasoning models. Against single-problem GRPO with a 32k window, CCR with an 8,000-token window reduces tokens per training step from 975,464 to 174,957 on 4B and from 793,832 to 165,788 on 8B, saving 82.1% and 79.1%, respectively. An 8B training trace shows increasing accuracy reward alongside shorter completions. Single-problem evaluations provide supporting evidence of retained reasoning quality. These results identify reward-preserving training structure as a practical route to lower per-step cost in short-window RLVR.

85. 【2610.22882】Cooperation Without Adaptation: LLM Agents in a Collective-Risk Dilemma

链接:https://arxiv.org/abs/2610.22882

作者:Trung-Kiet Huynh,Dao-Sy Duy-Minh,Chi-Nguyen Tran,Phu-Hoa Pham,Phu-Quy Nguyen-Lam,Le Hong Trang, TheAnh Han

类目:Computer Science and Game Theory (cs.GT); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词:individual decisions shape, shape shared outcomes, decisions shape shared, Language-model agents, increasingly deployed

备注: 10 pages, 5 figures, 50-page supplementary material appended

点击查看摘要

Abstract:Language-model agents are increasingly deployed to act on behalf of people in settings where individual decisions shape shared outcomes. We examine whether five production models adapt their contributions to changing risks and partner behaviour, or instead follow a relatively fixed strategy. In a collective-risk dilemma game (CRG), six players contribute to a shared pool over ten rounds; if the pool falls short of its target, a catastrophe may destroy their remaining resources. Four models contributed approximately an equal share at every positive risk level, and four of the five also contributed when risk was zero, even though contributing could not improve their payoff. Explicitly stating that only the agent's own payoff mattered reduced zero-risk contributions for most models, while a more neutral prompt did not. Several models correctly identified which action offered the higher expected payoff at different risk levels, yet their contributions changed little. Against fixed partners, no model consistently chose the payoff-maximising response, and in mixed-model groups, a single agent's shortfall in the final round could cause an otherwise successful group to fail. Payoff-based selection also depended on population composition: in a single six-agent group, it favoured the model that contributed least and reduced group success, whereas in larger, randomly mixed populations, it favoured an exact fair-share model at moderate and high risk. These findings show that cooperative self-play alone is not evidence of strategic adaptability. Consistent with a machine-behaviour approach, evaluations of agents in multi-agent systems should test how they respond to incentives, partner actions, and population composition.

86. 【2610.22874】Identify, Classify, Act: Per-Instruction Controlled Compliance for LLMs over External Data

链接:https://arxiv.org/abs/2610.22874

作者:Zesheng Shi,Xue Li,Chenrui Dai,Jing Li

类目:Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词:adversarial prompt injections, external data face, interleaves legitimate directives, prompt injections, data face

备注:

点击查看摘要

Abstract:LLMs over external data face a per-instruction tension: a single document or tool return often interleaves legitimate directives with adversarial prompt injections, and the model must follow the former while rejecting the latter. Existing defenses suppress or trust all external instructions, collapsing the safety-utility frontier and forcing a choice between over-refusal and over-compliance. We argue the missing capability is \textbf{per-instruction credit attribution} and formalize it as External-Data Instruction Classification, an identify-classify-act decision over each embedded directive. We propose \textbf{EDIC}, a decomposed reward framework for per-instruction compliance. A scene-grounded pipeline injects mixed beneficial and harmful instructions with counterfactual filtering, while a generative judge is initialized by SFT and refined with GRPO to attribute compliance at the instruction level. The judge then produces a reward that separately encourages beneficial compliance and penalizes harmful compliance for RL training. Across two backbones and five benchmarks, EDIC improves both safety and utility over the strongest prior defense, lifting harmful-rejection by up to 7.7\% and Arena-Hard-Auto utility by 12.5\% on Qwen3-4B. The code repository is hosted at this https URL.

87. 【2610.22858】Uncertainty-Aware Budget Allocation for Efficient LLM Tree Search

链接:https://arxiv.org/abs/2610.22858

作者:Jianguo Huang,Zhiyi Lyu,Fuxiang Zhang,Yanchen Deng,Deheng Ye,Bo An

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:prevailing methods expand, search enhances multi-step, large language models, enhances multi-step reasoning, Tree search enhances

备注:

点击查看摘要

Abstract:Tree search enhances multi-step reasoning in large language models (LLMs), yet prevailing methods expand every step with a fixed budget, irrespective of the marginal utility of expansion. We first show, across existing search algorithms, that continuations sampled from a shared intermediate state are largely duplicates and collapse to a few distinct answers. Critically, we find that the semantic dispersion of sibling actions predicts the redundancy of their downstream continuations, permitting a subtree's budget to be fixed before expansion. An information-theoretic analysis motivates this: treating the per-step budget as the Monte Carlo sample size for estimating a step's residual answer entropy, we derive a sufficient budget that shrinks with sibling dispersion. We accordingly propose $\textbf{Uncertainty-Aware Allocation}$ (UAA), a training-free framework that decouples value from uncertainty: values determine which candidates are promising, while uncertainty, estimated from sibling dispersion at no additional model cost, determines how many merit expansion, via uncertainty-aware pruning and uncertainty-aware budgeting. Across mathematical reasoning, logical reasoning, and planning benchmarks, UAA reduces token usage by up to $90\%$ and latency by up to $9\times$ at comparable accuracy, generalizing across four tree search algorithms and both open- and closed-source LLMs.

88. 【2610.22841】he Reliance Hypothesis: Chain-of-Thought Faithfulness Rises as Language Resource Level Falls

链接:https://arxiv.org/abs/2610.22841

作者:Lucas Resck,Jingyi Sun,Qianli Wang,Isabelle Augenstein,Anna Korhonen

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:safely deploying large, deploying large language, Multilingual Massive Multitask, explaining and safely, lower-resource languages

备注: 21 pages, 10 figures, 16 tables

点击查看摘要

Abstract:Chain-of-Thought (CoT) faithfulness matters for monitoring, explaining and safely deploying large language models, yet it has been studied mostly in English. Languages differ in level, the amount of text available to learn from, so models know less in lower-resource languages, which may change how much they rely on their reasoning. To our knowledge, we are the first to relate CoT faithfulness to both resource level and task type (knowledge- or reasoning-intensive). On parallel multiple-choice questions from Multilingual Massive Multitask Language Understanding (MMMLU) in eight languages, faithfulness rises as resource level falls on knowledge-intensive tasks but not on reasoning-intensive ones, a gap that points the same way across four models and several faithfulness measures. We propose, and find support for, the Reliance Hypothesis: models rely more on their reasoning when they cannot recall the answer, as in lower-resource languages on knowledge-intensive tasks. Model confidence partly explains the effect of resource level, but not the knowledge-reasoning gap. Languages in which models are less confident rely more on reasoning, yet less confident answers within a language do not, a Simpson's paradox. In lower-resource languages, models rely on their reasoning for more answers, not more strongly for each. CoT monitoring may therefore be most informative in lower-resource languages, where it is least often validated.

89. 【2610.22832】oo Emotional to Be Fake? Intra-Utterance Emotion Shifts Expose Failure Modes in Speech Deepfake Detectors

链接:https://arxiv.org/abs/2610.22832

作者:Jingyi Chen,Surya Koppisetti

类目:ound (cs.SD); Computation and Language (cs.CL)

关键词:detection remains unclear, remains unclear, Expressive speech synthesis, expressive TTS systems, emotion

备注: Preprint. Under review

点击查看摘要

Abstract:Expressive speech synthesis can now change emotion within a single utterance, yet its impact on deepfake detection remains unclear. We introduce EmoShift, a benchmark comparing emotion-stable (AA) and emotion-changing (AB) speech to examine these effects while accounting for static emotion identity and acoustic confounds. It comprises 7,240 bona fide utterances from four source datasets and 9,720 synthetic utterances generated using four expressive TTS systems. Across seven detectors, we find that emotion changes can make synthetic speech appear more genuine, increasing spoof miss rates by up to 25.3 percentage points on OMG-Emotion at fixed thresholds. Conversely, emotion-changing bona fide speech increases false-alarm rates by up to 24.4 percentage points on IEMOCAP. Further analyses reveal detector-specific sensitivities to emotion trajectories, not fully explained by static emotion identity or splicing artifacts. These findings underscore the importance of emotion dynamics in deepfake detection.

90. 【2610.22820】Causal Edit Serialization

链接:https://arxiv.org/abs/2610.22820

作者:Louis Robinson

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:requires referring back, revision requires referring, generate text sequentially, requires referring, referring back

备注: 37 pages, including appendices and checklist. Code: [this https URL](https://github.com/Louiii/CES) ; data and checkpoints: [this https URL](https://huggingface.co/datasets/lorob/CES)

点击查看摘要

Abstract:Standard autoregressive language models generate text sequentially, but revision requires referring back to tokens in the input context or those already generated. Causal Edit Serialization (CES) is introduced as a framework for expressing such revisions within the same causal token stream. Special pointer tokens are paired with predicted source addresses, allowing insertion, deletion, replacement, copying and movement to be localized explicitly. A lightweight localization head and dual-index rotary position encoding support both address prediction and conditioning on previously emitted pointers, while retaining a standard causal attention mask. A pretraining procedure combines ordinary language modeling with serialized repairs derived from random corruptions, model-generated edits and repeated text. Across model scales and editing baselines, CES models demonstrate complete applied edits with modestly higher clean-text bits per byte than clean autoregressive models. Supervised and reinforcement-learning post-training provide a grammatical-error-correction proof of concept, producing more beneficial than harmful changes under reference-blind model judging. Correct repair programs also improve subsequent text prediction while the original context and its cached states are retained. CES provides a common interface for generation and localized revision, with potential extensions to iterative refinement and additional pointer-addressed transformations.

91. 【2610.22810】Watermarkability: Measuring and Improving Language-Model Compatibility with Logit-Based Watermarks

链接:https://arxiv.org/abs/2610.22810

作者:Zewei Deng,Mohamed Seif,Liyan Xie

类目:Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词:encode provenance information, identify model-generated text, detect post-generation edits, Language-model watermarks, model-generated text

备注: 16 pages, 2 figures, 10 tables. Code available at [this https URL](https://github.com/zeweid1221/LLM_Watermarkability)

点击查看摘要

Abstract:Language-model watermarks can help identify model-generated text, encode provenance information, and detect post-generation edits. A broad class of logit-based watermarks increases the logits of a designated token set at each decoding step. Because a base model's native probability mass on this set varies across contexts, models, and watermark rules, the same logit bias can yield different adherence rates and increases in perplexity (PPL). We introduce watermarkability to characterize the compatibility between a model and the token sets requested by a watermark. At a target mass $\tau$, we quantify this property through a watermarkability cost: the expected minimum KL divergence from the base-model distribution required to assign probability at least $\tau$ to the requested set. A lower cost means that the model is more watermarkable for that request distribution. To reduce this cost, we propose a two-stage method. In the first stage, we train a target-set-conditioned low-rank adapter on unions drawn from a 16-way vocabulary partition to increase the requested set's probability mass. In the second stage, a closed-form controller applies the smallest remaining uniform logit bias needed to reach the target mass. We evaluate the method on six watermark schedules using OPT-125M and Qwen3-8B. Across the 12 model-schedule pairs, the pre-adaptation watermarkability cost correlates with the log-PPL increase under a near-hard fixed-bias baseline (pooled Pearson $r=0.929$). For every schedule, at least 99.80% of sampled tokens fall in the target set requested at their decoding step. At this reliability, the adapter and controller reduce average per-schedule prompt-conditional PPL by 46.3% on OPT-125M and 5.2% on Qwen3-8B relative to the fixed-bias baseline.

92. 【2610.22807】On the Position Bias of Large Language Models: A Comprehensive Study

链接:https://arxiv.org/abs/2610.22807

作者:Yining Li,Huayang Li,Lemao Liu,Taro Watanabe

类目:Computation and Language (cs.CL)

关键词:Recent studies, retrieval-augmented generation, position bias remains, position bias, reliability of retrieval-augmented

备注:

点击查看摘要

Abstract:Recent studies have shown that position bias remains a critical vulnerability in large language models (LLMs), undermining both the integrity of multiple-choice evaluations and the reliability of retrieval-augmented generation. However, existing understanding of this phenomenon is largely derived from studies with limited model coverage and English-centric benchmarks, leaving the behavior of frontier models and diverse languages underexplored. In this work, we conduct a comprehensive investigation of position bias across model scales ranging from billion-level to trillion-level parameters, covering both multiple-choice and multi-document tasks in five languages. Our experiments reveal that while position bias remains noticeable in small-scale models and Non-English languages, increasing model scale and employing standard Chain-of-Thought prompting significantly mitigate this issue. Moreover, we demonstrate that emerging \emph{thinking models} with extended reasoning capabilities are nearly immune to position bias, suggesting a costly but general approach toward resolving this vulnerability.

93. 【2610.22800】Veil-Then-Reveal: Protecting PII Privacy via Reversible Pseudo-Anonymization in Zero-Trust User--LLM Interaction

链接:https://arxiv.org/abs/2610.22800

作者:Mohamed Shaaban,Mohamed Elmahallawy,Thomas E. Carroll

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词:personally identifiable information, Large language models, increasingly process sensitive, process sensitive documents, exposes data subjects

备注:

点击查看摘要

Abstract:Large language models (LLMs) increasingly process sensitive documents and personal information, yet sending prompts containing personally identifiable information (PII) to remote providers exposes data subjects and organizations to risks from logging, retention, model training, and unintended disclosure. Existing anonymization methods often mask or remove PII, while conventional encryption eliminates the lexical and structural cues needed for effective LLM processing. We present Veil-then-Reveal (VtR), a user-side PII pseudo-anonymization framework for privacy-preserving LLM interaction under a zero-trust threat model. VtR treats remote LLM providers as untrusted and sends only pseudo-anonymized prompts, keeping plaintext PII on the user. VtR first detects PII and replaces it with realistic, same-type, in-vocabulary surrogates before prompts leave the user's device, preserving their linguistic and structural properties. It combines format-preserving encryption (FPE) for structured PII, such as phone and credit-card numbers, with a keyed-hash dictionary and secure vault for semantic PII, such as names, locations, and organizations. Session-specific mappings provide cross-session unlinkability, while user-side restoration reversibly replaces surrogates with their original values in LLM responses. We further introduce a rank-class FPE strategy for dates that preserves format and ambiguity while reducing cipher evaluations. Evaluation on three datasets containing 11,322 annotated PII instances achieves 97.9% detection recall, 95.2% protection of detected values, and 99.9% round trip; 100% of echoed surrogates end-to-end round-trip restoration.

94. 【2610.22797】Reasoning Reranking with Semantic IDs as the Sole Item Representation

链接:https://arxiv.org/abs/2610.22797

作者:Zhenwei Tang,Jintao Liu,Di Bai,Xidong Wu,Xinwu Cheng

类目:Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:compact Semantic IDs, existing systems read, generative recommenders increasingly, recommenders increasingly represent, Semantic IDs

备注: 30 pages, 3 figures. Code: [this https URL](https://github.com/lilv98/ReRankID) ; data: [this https URL](https://huggingface.co/datasets/lilvjosephtang/ReRankID)

点击查看摘要

Abstract:Reasoning rerankers write a rationale before ranking a candidate slate, and existing systems read item metadata to do so, even though generative recommenders increasingly represent items as compact Semantic IDs (SIDs). Ranking from SIDs alone has two appeals: SID prompts are far shorter than the matched item text, and although item codes are fixed from content, the backbone learns their token embeddings in part from user-item interaction sequences, so the tokens can carry behavioral signal that item text lacks. That training targets next-item generation, and whether it supports ranking a supplied slate from SIDs alone is untested. We build ReRankID, a controlled testbed in which models reason and rank from a history and slate shown only as SIDs, varying item rendering, history length, and slate size one at a time. On this testbed, such models often copy the input order instead of reranking, and readable metadata does not repair the failure. We compare supervised fine-tuning, rejection-sampled self-training, on-policy distillation, and verifier-based reinforcement learning as post-training methods and find that they elicit the missing behavior. The strongest post-trained model, the 8B model trained with a graded ranking reward, gives the best SID-only ranking and matches strong text-reading LLMs whose prompts are about 20x longer. It ranks above random with no history at all, where a caption-reading reference does not, and it keeps its gains at long histories, where text prompts pass 50k tokens and the caption-reading reference stops improving. In a paired rationale audit, this model argues trade-offs better than that reference but describes items less accurately. The common post-training methods we test thus elicit ranking from SIDs but not faithful item descriptions, which calls for post-training that improves the reasoning itself, not only the ranking it produces.

95. 【2610.22796】Causal Latent Workspaces for Looped Transformers

链接:https://arxiv.org/abs/2610.22796

作者:Ilia Zaznov

类目:Computation and Language (cs.CL)

关键词:depth increases computation, exchange compact summaries, depth increases, increases computation, computation without replicating

备注: 20 pages, 5 figures. Code and reproducibility materials: [this https URL](https://github.com/izaznov/causal-latent-workspace-transformer)

点击查看摘要

Abstract:Reusing a Transformer block across depth increases computation without replicating its parameters, but successive passes have no dedicated state through which positions can exchange compact summaries of their causal prefix. We introduce the causal latent workspace Transformer: an anchored, four-round shared-depth architecture in which each position writes gated vectors into prefix-specific latent slots and retrieves a content-addressed summary before the next shared block application. This path complements causal self-attention while the original input embedding remains accessible at every round. Across three byte-level corpora, three seeds, and two matched parameter budgets, the proposed model achieves the best mean held-out perplexity in five of six settings against five Transformer controls. At 101.71M parameters it leads on WikiText-103 raw, enwik8, and TinyStories, reaching perplexities 2.7820, 2.7843, and 1.6823; these improve upon the strongest non-workspace control on each corpus by 1.06%, 0.73%, and 1.01%. All nine seed-labelled comparisons at this budget favor the workspace. At 0.918M parameters it leads on WikiText-103 and TinyStories, whereas a conditioned loop is stronger on enwik8. Architectural ablations show that adding the workspace improves upon the anchored loop in all six settings and support refreshing its causal summaries at each round. Together, these results identify a causal, content-addressable prefix workspace as an effective structural augmentation of looped Transformers.

96. 【2610.22792】Prune the Leaky Neurons: Mitigating Private Data Leakage in Fine-Tuned LLMs via Joint-Embedding-Guided Pruning

链接:https://arxiv.org/abs/2610.22792

作者:Mohamed Shaaban,Mohamed Elmahallawy

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Fine-tuning large language, personally identifiable information, Fine-tuning large, enables domain adaptation, large language models

备注:

点击查看摘要

Abstract:Fine-tuning large language models (LLMs) on proprietary records enables domain adaptation but introduces two challenges: (i) privacy leakage of memorized private data, such as personally identifiable information (PII), and (ii) balancing private data removal with utility preservation. Existing defenses, including data sanitization and differential privacy, often degrade performance, while privacy-neuron editing lacks a PII-free reference to distinguish identity-specific neurons from those supporting useful text. We propose JEPA-Prune, a post-hoc neuron pruning framework guided by a model trained exclusively on PII-free views. Alongside the fine-tuned private model, JEPA-Prune, trains a public model on surrogate and masked views of the same records using a joint-embedding predictive architecture (JEPA), capturing domain knowledge without identifiers. A cross-model representation probe quantifies deviations between private representations of leaked records and this PII-free reference. Integrated gradients and a scale-invariant specificity score then identify PII-responsive neurons, which are pruned without retraining. Experiments show that pruning just 1.6% of neurons reduces PII inference accuracy by up to 7.4x and PII extraction recall by up to 13.9x, while keeping unseen-text perplexity within 16% of that of the unpruned model for most LLMs. In contrast, privacy-neuron editing increases perplexity by at least 26x.

97. 【2610.22791】Self-Evolving Coding Agents via Harness-Policy Optimization

链接:https://arxiv.org/abs/2610.22791

作者:Zhepei Wei,Wenlin Yao,Baolin Peng,Danqing Wang,Qianhui Wu,Hao Cheng,Yu Meng,Jianfeng Gao

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Large language model, shown promising potential, Large language, harness, policy

备注:

点击查看摘要

Abstract:Large language model (LLM) agents have shown promising potential in coding tasks, and their performance is jointly determined by the policy model and the harness that mediates their interaction with the environment. Indeed, harness and policy are mutually reinforcing and evolving only one component is suboptimal---a harness tuned for one checkpoint may not target the failure modes of an updated policy, while policy learning remains limited to the trajectories elicited by a fixed harness. In light of this, we propose Self-HPO, a recursive self-improving framework for coding agents that alternates harness and policy optimization, using the evolving policy as its own harness proposer. Specifically, in each round, the current policy first analyzes its own failures and proposes new harness candidates (H-step). The policy is then updated through reinforcement learning (RL) under the selected harness (P-step), and hard tasks identified during training form the next harness search set, keeping harness optimization targeted to the policy's evolving failure modes. Across three coding benchmarks, Self-HPO consistently outperforms harness-only and policy-only baselines, improving Qwen3.5-35B-A3B's average resolve rate from 57.8% to 64.8%, with gains generalizing to out-of-distribution settings. Further analysis shows that both optimized components retain gains even when paired with their base counterparts, while their joint gain exceeds the sum of their individual gains. Self-HPO also improves reliability (Pass@1) and expands the capability frontier (Pass@k) over the base agent. Additionally, we show that with a stronger external model (e.g., Opus 4.8) as the harness proposer, the same framework yields a further performance boost.

98. 【2610.22733】hunder-DeID+: Boundary-Aware Korean De-identification from Court Judgments to Broader Sensitive Documents

链接:https://arxiv.org/abs/2610.22733

作者:Gyuseong Lee,Gyeongje Cho,Jongmin Kim,Heejin Kim,Yeonkyoung So,Hyunggeun Jeon,Hyunji M. Park,Sangho Kim,Yoonhee Park,Youngbin Pyo,Jaejin Lee

类目:Computation and Language (cs.CL)

关键词:Byte Pair Encoding, Personally Identifiable Information, merge Personally Identifiable, focusing on boundary, de-identification model developed

备注:

点击查看摘要

Abstract:This study examines the transferability of a de-identification model developed for Korean court judgments to a broader range of sensitive documents, focusing on boundary precision, label granularity, and recall. The agglutinative structure of Korean causes Byte Pair Encoding (BPE) tokenizers to frequently merge Personally Identifiable Information (PII) with adjacent particles, which complicates accurate span recovery. Furthermore, current PII taxonomies lack sufficient granularity for legal texts. To address these issues, this study introduces Thunder-DeID+, which integrates a refined three-tier PII taxonomy with a boundary-aware tokenizer. The tokenizer enhances a pretrained BPE vocabulary by incorporating N-gram and boundary-scoring components to better align token and PII span boundaries. The proposed approach is evaluated using a tokenizer-independent word-segment-level protocol. On full-length judgments, the tokenizer consistently improves W. Strict Typed F1-score from 0.76-0.77 to 0.87-0.88 across four model sizes (150M, 395M, 750M, and 1B), mainly by increasing precision rather than model scale. With fine-tuning on 1,000 broader sensitive documents, the judgment-trained model further achieves 0.93 W. Strict Typed F1-score, indicating effective transfer beyond court judgments.

99. 【2610.22732】okenEconomizer: Experience-Driven Black-Box Cost Control for Coding Agents

链接:https://arxiv.org/abs/2610.22732

作者:Aaron J. Li,Weijia Xu,Chandan Singh,Zixiao Chen,Jeevana Priya Inala,Charlotte Siska,Acar Tamersoy,Bin Yu,Ion Stoica,Michel Galley,Jianfeng Gao

类目:Computation and Language (cs.CL)

关键词:AI-assisted software engineering, software engineering, sharply increased, AI-assisted software, token costs

备注:

点击查看摘要

Abstract:Advances in frontier coding agents have sharply increased the token costs of AI-assisted software engineering. Their token efficiency is typically evaluated on isolated tasks, whereas real-world developers use them to continuously build, update, and maintain large-scale projects. This mismatch motivates us to evaluate agents over sequences of realistic coding tasks, where we find that agents exhibit recurring environment-dependent token costs that existing methods struggle to reduce. To minimize these costs, we introduce TokenEconomizer, an external controller that cuts environment-specific token costs over a sequence of tasks. These cuts come from determining (i) which operational micro-skills to inject, (ii) which persistently irrelevant tools to prune, and (iii) when to intervene in unproductive failure loops. Across Claude Code, Codex, and GitHub Copilot CLI paired with frontier models, TokenEconomizer reduces the average token cost by 18.4-30.9% with comparable task success. Savings hold in every repository under every tested agent-model setting and generalize to diverse domains such as sequential web development and security auditing, where costs fall by 6.4-21.2% depending on task structure. Our work establishes adaptive black-box cost control as a promising direction for reducing token costs of coding agents in realistic settings.

100. 【2610.22724】A misinformation playbook sharpens judgement without breeding cynicism

链接:https://arxiv.org/abs/2610.22724

作者:Tong Guo,Teng Ye,Yutong Xie,Qiaozhu Mei

类目:Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Social and Information Networks (cs.SI)

关键词:harms public health, generative artificial intelligence, Misinformation harms public, health and democracy, harms public

备注:

点击查看摘要

Abstract:Misinformation harms public health and democracy, and generative artificial intelligence now writes falsehoods as persuasive as people's. Defences range from fact-checking individual claims to training people to resist falsehoods. Yet many claims are too new to check, and interventions that teach doubt can reduce belief in truth too. We propose a defence that targets not the facts of each claim but the persuasion strategies that recur across them. Here we show that learning misinformation's persuasion playbook, mapped from 214,646 fact-checked claims in 51 languages, can sharpen human and machine judgement of claims they know little about, without making either more cynical about true claims. The playbook spans social influence, information manipulation and emotional appeals, combined around a core of fear, conspiracy and fabrication. Briefed with it, plus a reminder that persuasion is not proof of falsehood, a language model better distinguished true from machine-generated false claims about events after its training data. In a pre-registered experiment, the same briefing improved people's discernment of claims they reported as unfamiliar and left their belief in true claims unchanged. Averaged over all claims, the gain was not statistically significant. Because it targets what recurs, this defence need not wait for claim-specific fact-checks.

101. 【2610.22721】CoLU: Confidence-Weighted Layerwise Unlearning for Large Language Models

链接:https://arxiv.org/abs/2610.22721

作者:Jingkai Guo,Ziyi Zhao,Chaitali Chakrabarti,Deliang Fan

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Large language model, Large language, retraining from scratch, aims to forget, LLM

备注:

点击查看摘要

Abstract:Large language model (LLM) unlearning aims to forget certain information while preserving others, without retraining from scratch. SoTA methods such as NPO, SimNPO, and SatImp balance forgetting and retain through whole model fine-tuning, while FOM-UL explores selective layer updates. Prior works show that suppressing target information can damage retained knowledge. This trade-off can vary across layers even under the same unlearning loss. In this work, we propose Confidence-Weighted Layerwise Unlearning (CoLU), which combines a novel confidence-weighted forgetting and retain regularization while updating a single selected transformer layer, rather than the whole model for unlearning. To reduce CoLU compute cost, we further propose Brief Layer Screening (BLS), which uses a newly defined normalized forgetting-retention (NFR) score to first rank layers through a brief unlearning trials using a subset of forgetting dataset and fewer epochs. BLS pre-selects top-k ranked layer candidates, which will then be fully profiled using full data analysis. BLS is proven to reduce the runtime of CoLU by 60.2-79.7% with almost the same performance. On TOFU dataset, CoLU improves both forgetting and retention over NPO, SatImp, and GA-based FOM-UL in all six TOFU settings, and over SimNPO in five of the six settings. On MUSE Books and News datasets, CoLU achieves the highest retained KnowMem and the PrivLeak closest to zero among the compared SOTA unlearning methods. CoLU presents a new record performance in both unlearning and retain in most settings up to date. Moreover, across the measured settings, average CoLU GPU memory usage is 77.4% to 79.5% lower than full-model unlearning.

102. 【2610.22717】ARBOR: Locating Reasoning Failures in Long Chains of Thought through Reasoning State Tracking

链接:https://arxiv.org/abs/2610.22717

作者:Huihan Li,Siyuan Wang,Naga Vamsi Ramana Dinavahi,Xiaohui Liu,Xiang Ren

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Large reasoning models, models solve complex, solve complex problems, reasoning models solve, Large reasoning

备注:

点击查看摘要

Abstract:Large reasoning models solve complex problems through long chains of thought, in which prior work has documented failure modes such as overthinking, underthinking, and unsupported deductions. Existing methods detect these failures from local signals: textual similarity to nearby steps, switch tokens, or an LLM's judgment of a step's correctness. However, what a step contributes to the solution depends on the state that earlier steps have established, so identifying failures requires a global view that tracks that state across the trajectory. Therefore, we propose ARBOR, a reasoning-failure attribution framework that represents each trajectory as a tree of reasoning states, built as each step creates, verifies, prunes, or revisits a state, and attributes each failure to a relation between a step and the state preceding it. Using ARBOR, we refine the three failure modes into distinct subtypes that harm reasoning through different mechanisms and at different costs. We find that the tree state ARBOR maintains before a step separates failure steps from the at-risk steps at which the failure did not occur. We discuss how ARBOR integrates with existing mitigations at inference time and in training data. Code, data and interactive examples are available at this https URL.

103. 【2610.22715】Risk and Refusal: Mechanisms of LLM Responses to Suicidal Ideation

链接:https://arxiv.org/abs/2610.22715

作者:Drishti Goel,Soorya Ram Shimgekar,Jeongah Lee,Violeta J. Rodriguez,Daniel S. Brown,Ravi Karkar,Koustuv Saha

类目:Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY); Social and Information Networks (cs.SI)

关键词:common safety mechanism, safety failure, large language models, suicidal ideation, common safety

备注:

点击查看摘要

Abstract:Refusal is a common safety mechanism in large language models (LLMs), yet in contexts of suicidal ideation (SI), refusing to engage can itself constitute a safety failure. We evaluate how eight instruction-tuned LLMs respond to SI and self-harm disclosures across three datasets, varying whether models are informed that a disclosure expresses SI and whether they receive a clinician-developed response protocol, and complement this with mechanistic analyses in six open-weight models. Our results reveal a nuanced relationship between refusal and response-level risk. At baseline, elevated risk in model responses is driven primarily by inattention to the disclosure, alongside refusal to engage. Mechanistic analyses suggest that models may refuse SI disclosures through the same direction that mediates their refusals of harmful requests. However, informing models of the SI context, or suppressing refusal directly, increases engagement without reliably lowering response risk, and may raise it. In contrast, the clinician-guided protocol consistently reduces response-level risk while also reducing refusal. Together, these analyses and ablations motivate the need for models that refuse only when warranted and engage in interactionally safe ways when users disclose SI.

104. 【2610.22714】First Passage Attention

链接:https://arxiv.org/abs/2610.22714

作者:Yuxuan Liu

类目:Computation and Language (cs.CL)

关键词:summing decay contributions, Augmenting softmax attention, gates typically relies, Augmenting softmax, typically relies

备注:

点击查看摘要

Abstract:Augmenting softmax attention with forget gates typically relies on summing decay contributions along the key--query path. Because such accumulation is monotonic, these mechanisms cannot selectively erase intermediate context while preserving older, structurally relevant tokens. We propose First Passage Attention (FPA), which shifts from path summation to path extrema by lowering a key's logit proportionally to the deepest dip of a learned scalar field below that key's level over the intervening span. FPA encompasses the Forgetting Transformer (FoX) as a special case, and when the field and levels follow a shared learned walk, the alive keys with unpenalised logits naturally form a stack. We show that a constant-dimension FPA head realises any subset of keys left alive by subsequent dips, whereas softmax heads with positional biases or token-level forget gates require a head dimension linear in the number of keys. In synthetic experiments, one-layer FPA heads converge to these target sets while comparable softmax and FoX baselines fail on every seed. Scaling to a 110M-parameter language model, FPA matches FoX in perplexity and uniquely achieves perfect passkey retrieval at $8\times$ the training length, even with its key--value cache compressed to about $25\%$.

105. 【2610.22708】GlobeBench: Evaluating Text-Based World Model Capabilities for Scalable Environment Simulations

链接:https://arxiv.org/abs/2610.22708

作者:Nicholas Saban,Charvi Bannur,Mariya Vasileva,Darshan Deshpande

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:recently shown potential, Text-based world models, Text-based world, recently shown, shown potential

备注: Code: [this https URL](https://github.com/patronus-ai/globebench) ; Data: [this https URL](https://huggingface.co/datasets/PatronusAI/globebench)

点击查看摘要

Abstract:Text-based world models have recently shown potential to simulate complex RL environment state transitions for a diverse set of use cases. However, no standardized benchmark exists to compare, study and improve these models. Through this paper, we attempt to solve this problem by building GlobeBench, a novel benchmark with 1,632 tasks across five separate domains and nineteen simulation skills. The tasks check whether models can predict the environment's response to a specific action given the full agent trajectory by understanding earlier state changes, following environment rules, and predicting the effects of actions on both related and unrelated objects. We compare the predicted environment response with an execution-derived reference, using a hybrid architecture with both deterministic gates and a semantic judge. Among 20 general-purpose LLMs and specialized text world models, GPT-6 Astra achieves the highest task success rate at 49.57%. We find that model accuracy decreases as actions affect a larger portion of the environment. Specifically, when the agent's changes must propagate to dependent objects, task success drops to an average of 5.1% across all 20 models. Although model strengths differ across tasks, 631 tasks remain unsolved by any model, suggesting a significant gap in general LLM capabilities as a world model.

106. 【2610.22688】Explore Separately, Adopt Selectively: Execution-Guided Tool Use over Large Tool Libraries

链接:https://arxiv.org/abs/2610.22688

作者:Anna Mazhar,Seiji Maekawa,Nikita Bhutani

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:large libraries, Large language model, Large, Large language, BRIA

备注:

点击查看摘要

Abstract:Large language model agents must discover relevant tools from large libraries, e.g., thousands of tools, as new needs arise during task execution. When several candidates could satisfy the same need, execution may be required to identify the relevant one. Investigating candidates in a shared trajectory can leave alternatives unexplored or allow failed attempts to influence subsequent reasoning. To address this, we present BRIA (BRanch-Inspect-Adopt), a simple yet effective agent that temporarily isolates candidate investigations in separate branches. Each branch retrieves and executes tools to investigate its candidate; a task agent inspects the resulting execution evidence and adopts only useful results into its continuing trajectory. BRIA retrieves additional tools as new capability needs arise during task execution. We evaluate BRIA on PlanBench-XL and MCP-Atlas using a shared pool of 1897 tools, three language models, and static and adaptive retrieval baselines. Across all settings, BRIA matches or exceeds the strongest retrieval baseline. On MCP-Atlas, it achieves an average claim score of 89.77, compared with 75.40 for MCP-Zero, a gain of 14.37 percentage points. BRIA also lies on the Pareto frontier for task performance and input-token cost.

107. 【2610.22686】Multimodal Filesystem Memory For Long-Horizon Embodied Agents

链接:https://arxiv.org/abs/2610.22686

作者:Chloe Su,Jiahan Li,Zhenting Qi,Chaoran Cheng,Haoyu Chen,Sejoon Jun,Weirui Ye,Yilun Du

类目:Computation and Language (cs.CL)

关键词:long horizons, long interactions, textbf, memory, MFM

备注:

点击查看摘要

Abstract:Agents operating over long horizons need an effective memory that allows them to reuse their experience throughout long interactions. If the entire history of an interaction is retained, it becomes difficult to find the relevant experience, while compressing it into summaries may result in the loss of visual and spatial details that are required later on. We present \textbf{MFM}, a multimodal filesystem memory architecture that keeps complementary types of agent memory. \textbf{Episodic memory} stores the observations, actions, and outcomes, and \textbf{spatial memory} associates experiences with locations. \textbf{Semantic and procedural memory} build up general knowledge and reusable methods of acting, and \textbf{working memory} holds the current plans. MFM makes use of searchable textual records to connect these different representations to the underlying multimodal episodes. The agents are able to find previous experiences by means of contextual cues and to examine the original observations in order to recover details that are missing from their textual descriptions. Through consolidation, the agents convert experience into higher-level knowledge and procedures while still keeping references to the original episodes. In the case of long-horizon Minecraft and computer-use tasks, MFM leads to improved performance with three base models. With GPT-6-Astra, MFM completes \emph{Mine Diamond from Scratch} and reaches 16 out of 24 milestones on the \emph{Ender Dragon} task, as against 12.7 for the best baseline. On CUABench-KiCad it attains a mean reward of 0.440, as compared to 0.400 for the best baseline and 0.267 in the case of no persistent memory.

108. 【2610.22672】Not All Graphs Are Maps: A Task-Agnostic Exploration Framework for Mobile GUI Navigation

链接:https://arxiv.org/abs/2610.22672

作者:Adamo Orsini,Seyed Mehdi Ayyoubzadeh,Sadman Rakib Pinon,Hannuo Zhang,Koosha Gholipour Baradari,Yuanhao Yu,Xinxin Zuo,Yang Wang

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Modern mobile GUI, lack persistent app-specific, app-specific navigation knowledge, persistent app-specific navigation, execute local actions

备注: Accepted to Findings of AACL-IJCNLP 2026

点击查看摘要

Abstract:Modern mobile GUI agents can perceive visible screens and execute local actions, but they still lack persistent app-specific navigation knowledge: where functions live, which pages contain them, and which screens are equivalent across repeated visits. We introduce TAG-Nav, a Task-Agnostic Graph Navigation framework that wraps existing GUI-agent backbones with reusable destination memory. Offline exploration is distilled into compact records of app functions, target pages, and waypoint routes before any evaluated instruction is seen. When a future task's destination is covered, TAG-Nav retrieves the destination and provides route guidance without task-specific demonstrations. This separates mobile GUI destination navigation from full task completion: many tasks share the prefix of reaching the right page, while final actions may enter content, send data, make purchases, delete information, or change sensitive settings. To evaluate route finding without downstream execution confounds, we introduce DestBench, a navigation-only protocol that asks whether an agent reaches the correct pre-action destination screen. DestBench enables a controlled graph-memory study comparing no-memory agents with random, automated BFS, and clean graph memory. Graph-derived memory improves strict navigation success rate of UI-TARS-1.5-7B from 52.4% without graph memory to 58.3% with automated BFS memory, and improves Qwen-VL-Max success rate from 59.5% to 71.4% on the same conditions. Together, TAG-Nav and DestBench show that destination coverage and route cleanliness strongly shape graph-memory value, making graph quality a measured variable rather than an assumed benefit of exploration.

109. 【2610.22671】ProPerAgent: Toward Memory-Driven Proactive Assistance

链接:https://arxiv.org/abs/2610.22671

作者:Shenglai Zeng,Xiao Yang,Tiffany Ma,Xinyuan Zhang,Nanshu Wang,Deren Lei,Kai Sun,Xilun Chen,Tammy Stark,Xianhui Zhu,Yuetai Li,Rulin Shao,Tianxin Wei,Rakesh Wanga,Anuj Kumar,Jiliang Tang,Wen-tau Yih,Xin Luna Dong

类目:Computation and Language (cs.CL)

关键词:assistants move, move from reactive, reactive answering, longer only supplies, supplies the answer

备注:

点击查看摘要

Abstract:As assistants move from reactive answering toward proactive intervention, memory changes role: it no longer only supplies the answer to a query, it determines whether and when to speak at all. Prior work in this setting hands the system the relevant fact in context; we study the regime that makes the problem hard, where the evidence justifying an intervention must be mined from a long-horizon personal memory. We introduce ProPerMem, a benchmark for memory-driven proactive assistance (MPA), pairing egocentric video with year-long, distractor-rich user memories (~618K tokens on average), human-verified trigger windows, and a protocol that scores content and timing jointly. Every baseline we evaluate performs poorly (at most 15%), including frontier models given summarized or retrieval-augmented memory. A controlled study explains why: with oracle evidence delivered inside the trigger window GPT-5.3-Chat reaches 96%; letting it choose the timing drops it to 38%, and replacing oracle evidence with retrieval drops it to 15%. Content and timing are separately necessary, and missing either is catastrophic. Guided by this, we build ProPerAgent (Proactive Personalized Agent) with a plug-and-play harness that surfaces memory from a graph-organized store and gates it down to what is worth interrupting for, plus a lightweight RL stage that curbs early and repeated firing. Without any training, ProPerAgent lifts strict accuracy from below 10% to 37.5% on Qwen3.8-27B and 38% on GPT-5.3-Chat; RL post-training reaches 42.4%.

110. 【2610.22659】Exploring The Empirical Privacy Landscape of Synthetic Data

链接:https://arxiv.org/abs/2610.22659

作者:Zihao Zhao,Avi Schwarzschild,Casey Meehan,Katherine Lee,Zhili Feng,Dylan Sam

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词:leaking private information, sensitive data differ, training language models, training language, private information

备注:

点击查看摘要

Abstract:Methods for training language models on sensitive data differ in how they balance capability gains against the risk of leaking private information. In this paper, we present a controlled comparison of data-level and training-level interventions for navigating the capability-privacy tradeoff on synthetic medical records with canaries to probe for leakage. Direct finetuning performs best on capability metrics but leads to the most privacy leakage, while DP-SGD reduces leakage at substantial cost to capabilities. Generating synthetic data from these records offers a more favorable balance, particularly when guided by a uniqueness-aware instruction to replace private details. Relative to naive paraphrasing, privacy-aware rewriting improves privacy protection across a variety of different rewriting models. We also find that more capable rewriting models generally reduce the risks of downstream privacy leakage, although held-out fit does not improve monotonically and increased test-time compute yields inconsistent gains. Overall, these results highlight privacy-aware rewriting as a promising direction for achieving a more favorable trade-off between capabilities and empirical privacy compared to other training-level methods, and our evaluation framework supports comparisons of future models and methods.

111. 【2610.22657】Secondhand Stress: How Stressful Disclosures Affect Psychosocial Wellbeing in Online Graduate Admissions Communities

链接:https://arxiv.org/abs/2610.22657

作者:Veda Duddu,Agam Goyal,Sabelle Huang,Ayush Umashankar Prasad,Mingquan Yi,Koustuv Saha

类目:Computation and Language (cs.CL)

关键词:individuals navigating stressful, navigating stressful life, stressful life transitions, communities provide spaces, provide spaces

备注: Preprint: 22 pages, 15 tables

点击查看摘要

Abstract:Online communities provide spaces for individuals navigating stressful life transitions to disclose difficulties and seek peer support. Yet encountering others' distress may also have psychosocial implications for community members. Drawing on stress crossover theory, we examine how engagement with peer distress during graduate admissions is associated with subsequent psychosocial expression and participation, and whether similar associations extend through downstream interactions. We analyze 171,981 posts and 1,130,413 comments from two Reddit communities across three admissions cycles, using propensity-score stratification and baseline-adjusted comparisons. Users who engaged with distress disclosures during application preparation subsequently exhibited higher classifier-estimated anxiety, depression, and stress expression, alongside greater commenting activity and lexical redundancy. These associations recurred across admissions cycles, while no significant psychosocial associations were detected among downstream respondents interacting with previously exposed users. Our findings highlight how greater distress-related expression can coexist with continued community participation, while distinguishing direct engagement with distress disclosures from subsequent social contact. We discuss implications for designing online communities that preserve opportunities for self-disclosure and peer support while remaining attentive to the experiences of those encountering distress-related content.

112. 【2610.22652】Evidence-Gated Bilingual RAG for Reliable Consumer Banking Search

链接:https://arxiv.org/abs/2610.22652

作者:Ahmed Mohamed Mahmoud Rayyan,Rana Mahmoud Mohammed,Aya Abdallah Abdelmonem,Mohamed Khaled Goda Othman,Rahatara Ferdousi

类目:Computation and Language (cs.CL)

关键词:terminology found, banking website, consumer banking search, consumer banking, relevant product page

备注:

点击查看摘要

Abstract:Consumers often describe what they need rather than use the terminology found on a banking website. For example, a natural-language request ("a card for travel") may not share the keywords of the relevant product page, and the problem is harder in bilingual services, where the same intent may be expressed in Arabic or English. This paper presents an evidence-gated bilingual retrieval-augmented generation (RAG) framework for consumer banking search that operates entirely on local infrastructure. The framework combines structured web-content refinement, hybrid dense-lexical retrieval, intent-aware evidence selection, cross-encoder reranking, and a three-outcome Answer / Related Mismatch / No Answer decision mechanism. On 210 URL-labeled Arabic and English queries, the proposed approach improves Top-1 hit rate from 50.48% to 79.05% and MRR@5 from 0.571 to 0.797 over a hybrid baseline. A separate 26-case end-to-end evaluation achieved 69.2% strict success, with 72.7% of generated answers classified as supported by an automated faithfulness judge. These results are preliminary: the retrieval queries are paraphrases of a small reference set, and the end-to-end test is small and uses an automated rather than human judge, so they do not establish human-verified answer correctness or generalizable performance.

113. 【2610.22640】SAFETYEDIT: Sparse Internal Targets with Prompt-Wide Control for LLM Jailbreak Backdoors

链接:https://arxiv.org/abs/2610.22640

作者:Yutong Ke,Yansu Wang,Zeyu Zhang,Xihao Guo,Chongwen Zhao,Kaizhu Huang

类目:Computation and Language (cs.CL)

关键词:Model-editing backdoors aim, induce harmful responses, preserving ordinary behavior, Model-editing backdoors, backdoors aim

备注: 35 pages,4 figures; includes appendix

点击查看摘要

Abstract:Model-editing backdoors aim to induce harmful responses under a trigger while preserving ordinary behavior on untriggered input. Recent model-editing approaches target affirmative response prefixes through rank-one updates to a small subset of model weights. Yet when this prefix-level target is satisfied, the model may still revert to refusal or produce a coherent, apparently compliant response that does not address the request. To overcome this limitation, existing internal-representation approaches shift focus from output tokens to dense, high-dimensional compliance directions in latent space. Existing representation-level approaches rely on preservation constraints to maintain conditionality, motivating us to ask whether a smaller internal target can offer a different effectiveness-preservation trade-off. Motivated by the comparable control capability of single-coordinate interventions, we investigate a sparse refusal-related MLP coordinate as this target. We propose SAFETYEDIT, which optimizes a single refusal-related coordinate and uses KV-cache marking in early attention layers to propagate a prefix-trigger signal across subsequent instruction positions. On some checkpoints a downstream MLP reader converts this signal into control of the coordinate, while on others the propagated signal alone suffices; the method is defined by the sparse target rather than by a fixed writer-reader pair. Across four open-weight LLMs and three dataset groups, SAFETYEDIT achieves the highest triggered Guard ASR in 11 of 12 comparisons and the highest mean StrongREJECT score in all 12, relative to the baselines evaluated for each model. Crucially, comprehensive ablation and behavioral audits confirm generally minimal changes in untriggered behavior and general capabilities in the tested configurations.

114. 【2610.22638】Inductive Learning of Concept Embeddings from Cross-Linguistic Colexification Patterns with Textual Attributes

链接:https://arxiv.org/abs/2610.22638

作者:Arne Rubehn

类目:Computation and Language (cs.CL)

关键词:dense vectors commonly, computational semantics marked, advent of distributional, marked a paradigm, paradigm shift

备注:

点击查看摘要

Abstract:The advent of distributional semantics as a framework for computational semantics marked a paradigm shift in the nature of representations, by which meanings are represented as dense vectors commonly known as word embeddings. Computational approaches to historical or typological language comparison, on the other hand, still mostly rely on discrete representations, while the potential of embedding-based methods remains largely untapped in this context. Recent studies have proposed concept embeddings as a language-independent, onomasiological counterpart to word embeddings, based on networks of cross-linguistic colexification patterns. While the resulting concept embeddings reflect meaningful semantic properties and relations, they suffer from a lack of scalability, since they rely on transductive embedding approaches which only learn embeddings for nodes present in the training data. In this study, we present an inductive framework for learning concept embeddings, combining the structural properties of full and partial colexification networks with semantic information from short concept descriptions. This framework allows the embedding of unseen concepts based on a short definition. We show that the resulting concept embeddings correlate with various cross-linguistic measures of similarity or relatedness, while generalizing well to new concepts that were absent from the training data.

115. 【2610.22636】Measuring Mechanistic Uncertainty in Large Language Models via Causal Robustness

链接:https://arxiv.org/abs/2610.22636

作者:Aneesh Komanduri,Majid Afshar,Timothy A. Miller,Yanjun Gao

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Large language models, hallucinations makes reliable, Large language, uncertainty quantification essential, interpretable uncertainty quantification

备注:

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used in critical domains, where their susceptibility to hallucinations makes reliable and interpretable uncertainty quantification essential. We introduce the concept of mechanistic uncertainty, which characterizes uncertainty through the stability of the internal mechanisms supporting a model's response. We propose the causal robustness margin, defined as the minimum internal intervention required to deviate the model's output, and operationalize it using Jacobian Lens (Jlens) concept steering vectors. Across three open-source models and five question-answering datasets, we show incorrect and uncertain responses exhibit smaller margins, indicating greater sensitivity to internal interventions, and the causal robustness margin complements conventional output-based uncertainty methods. Finally, in a controlled knowledge injection experiment, correctly learned facts show increased margins after training, suggesting that causal robustness provides a mechanistically grounded signal of uncertainty.

116. 【2610.22632】oMStories: Interpreting Theory-of-Mind in Synthetic Narratives

链接:https://arxiv.org/abs/2610.22632

作者:Melanie Subbiah,Chia-En Jacklyn Tsai,Kathleen McKeown

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Understanding people, people often requires, requires inferring, Understanding, state outright

备注:

点击查看摘要

Abstract:Understanding people often requires inferring what they feel or want from how they behave rather than from what they state outright. We ask whether language models can make these inferences, and how they do so. We introduce Theory-of-Mind Stories (ToMStories), an evaluation dataset of ~6,000 short synthetically generated narrative vignettes, each paired with a multiple-choice or open-ended question about a character's emotion, fear, motivation, or emotional wound. These psychological states are conveyed implicitly (showing), explicitly (telling), or with conflict between dialogue and description. Evaluating thirteen open-weight models (1B-72B parameters), we find that the largest models match humans on multiple choice but not open-ended questions. Our analyses point to simplifications models make in both interpretation and generation of implicit psychological states, indicating that synthetic data can help us understand how models perform interpretation, but likely overestimates how well models interpret humans.

117. 【2610.22631】A Plausible Explanation Is Enough to Mislead Multimodal Judges

链接:https://arxiv.org/abs/2610.22631

作者:Anglin Cai,Zhiqi Wang,Xiaozhi Yang,Yurun Lin,Dongwon Lee,Yuchen Yang

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Multimodal large language, Multimodal large, large language models, increasingly serve, evaluation pipelines

备注:

点击查看摘要

Abstract:Multimodal large language models (MLLMs) increasingly serve as judges in training and evaluation pipelines, often assessing answers together with explanations. Although AI judges are sensitive to textual factors, it remains unclear whether ordinary plausible explanations can sway judgments requiring visual verification. We introduce JUPE, a visual-question-answering (VQA)-style benchmark that fixes answers while varying explanations. Across 14 MLLM judges, ordinary explanations that sound plausible mislead judges, with effects comparable on average to deliberately persuasive arguments. Plain justifications and chain-of-thought rationales reduce rejection of incorrect answers by 12.7 and 13.8 percentage points, respectively. We call this failure plausibility capture. Using signal detection theory, we find a significant mean shift in decision criterion toward acceptance, without a clear change in mean discriminability. Explanations sway judgments across domains, explanation generators, and judging protocols, while tested mitigations offer limited, model-dependent protection. Such shifts can inflate performance estimates when judges evaluate answers with explanations.

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

Cite as:
arXiv:2610.22631 [cs.CL]

(or
arXiv:2610.22631v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2610.22631

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>
118. 【2610.22618】rajectory-Guided Steering: Mitigating Spurious Feature Bias in Clinical Classification

链接:https://arxiv.org/abs/2610.22618

作者:Fardin Ahsan Sakib,Ziwei Zhu,Ozlem Uzuner

类目:Computation and Language (cs.CL)

关键词:Large language models, single gender token, notes alters gender-irrelevant, alters gender-irrelevant diagnoses, Large language

备注:

点击查看摘要

Abstract:Large language models rely on spurious features in clinical classification: swapping a single gender token in clinical notes alters gender-irrelevant diagnoses in up to 53.5% of cases. Existing inference-time corrections either need counterfactual data built around the specific spurious feature or behave unpredictably. We observe that how a model's preference between answers evolves across layers, its prediction trajectory, indicates for each document whether a correction is likely to help. We propose Trajectory-Guided Steering (TGS), which decides from the trajectory alone whether to correct each prediction and in which direction, with no counterfactual data and no knowledge of the spurious feature. On 16 clinical classification tasks from i2b2, TGS fixes 17.7% of errors while breaking only 1.3% of correct predictions and stays net-positive across all tested hyperparameter settings; all baselines are net-negative or near zero. The same corrections reduce reliance on the spurious feature: on the most affected diseases, gender-swap inconsistency falls sharply (hypertension 53.5% - 38.0%, diabetes 35.1% - 21.5%). Applying the correction to every document instead raises breaks on correct positive predictions from 0.1% to 6.4%, so per-document selection is essential. TGS also transfers to three model families and three other clinical and biomedical datasets.

119. 【2610.22615】When Does Uncertainty Measure RAG Hallucination Risk?

链接:https://arxiv.org/abs/2610.22615

作者:Rajeel Ahmad Ansari,Tautik Agrahari

类目:Computation and Language (cs.CL)

关键词:retrieved evidence constrains, retrieval-augmented generation, retrieved evidence, evidence constrains, Abstract

备注: 6 pages. Accepted for oral presentation at ICNLSP 2026

点击查看摘要

Abstract:Uncertainty can measure hallucination risk in retrieval-augmented generation (RAG), but only when retrieved evidence constrains the answer. When evidence is present, unsupported factual claims become less likely; when retrieval coverage is poor, the model can answer from internal knowledge and assign high probability to unsupported claims. We test this across four instruction-tuned models on HotpotQA and SQuAD. After matching faithful and hallucinated answers within word-count bins, length-only classifiers fall near chance, while perplexity reaches 0.81--0.91 AUROC on targeted unsupported edits. Varying retrieval depth shows why the score changes meaning: detection can weaken with only the top-ranked passage, then recover after adding a second passage. A combined uncertainty and semantic-drift score improves calibration, and measurements remain above chance on RAGTruth QA. Results support a conditional view of uncertainty as a useful measure of RAG hallucination risk.

120. 【2610.22599】Can LLMs predict the outcomes of machine learning experiments?

链接:https://arxiv.org/abs/2610.22599

作者:Ayush Bansal,Aldo Pareja,Sean Klein,Serge Didenko,Artem Lukoianov

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:make Recursive Self-Improvement, Recursive Self-Improvement, Recent advances, make Recursive, run Machine Learning

备注: 15 pages, 9 figures, 1 table. Dataset: [this https URL](https://github.com/autolab-ai/EV-estimation)

点击查看摘要

Abstract:Recent advances in AI make Recursive Self-Improvement (RSI) increasingly plausible. Large Language Models (LLMs) can already propose, select, and run Machine Learning (ML) experiments. However, the space of possible design choices in ML is vast. An LLM that proposes an experiment needs a reliable intuition of whether it is worth running given the timing constraints of long training runs. In this work, we measure such intuition in current frontier LLMs by evaluating how accurately they predict the impact of self-generated ML experiment ideas before these are put into training runs. To this end, we construct a dataset of 288 LLM-proposed ideas on eight MLE-bench tasks. We then prompt five frontier LLMs (GPT-6 Astra, Claude Opus 5.5, Claude Fable 5.1, Kimi K3, and GLM-5.3) to predict the impact of each idea and compare their predictions with the actual outcomes after training. We report four main findings. First, LLM predictions are substantially better than random chance but far from accurate: even the best model, Claude Opus 5.5, explains only half of the variance in outcomes (R^2 = 0.49). Second, we notice that all tested models systematically underestimate the magnitude of the changes. Third, prediction quality varies widely across tasks. Finally, the choice of the coding harness that actually implements the ideas has little effect on outcomes, and we find no evidence of self-preference. Higher reasoning settings and additional context lead to modest gains. Overall, our results show that current LLMs have useful but limited intuition about which ML ideas will work. We release our dataset to support further study.

121. 【2610.22597】Broad and Efficient PII Detection with Unified Labels

链接:https://arxiv.org/abs/2610.22597

作者:Andy Hsu,Konstantin Berlin

类目:Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词:Personally Identifiable Information, Personally Identifiable, Identifiable Information, low false-positive rate, efficiently find identifiers

备注:

点击查看摘要

Abstract:Personally Identifiable Information (PII) detection models must efficiently find identifiers across diverse contexts while maintaining a low false-positive rate (FPR) on high-volume traffic. Recent detectors increasingly rely on complex architectures that raise deployment cost, yet many are fine-tuned on only a few synthetic datasets that limit their coverage. Combining public datasets is challenging because their taxonomies differ, and even after categories are mapped to a common schema, labels can disagree on what counts as a detection, producing inconsistent training and evaluation signals. To address these problems, we present a practical 141M-parameter encoder-based detector trained on 1.12 million examples from 77 public datasets, relabeled under a detailed definition of broad contextual detection for 12 structured PII categories. Evaluated on the AI4Privacy and Nemotron-PII benchmarks at a low-FPR operating point, our model achieves the highest recall against larger baselines in 11 of 14 comparisons under our labels and 9 of 14 under the original labels. Its largest recall gains include useful additional coverage, such as multilingual disclosures and IP addresses embedded in URLs. It achieves this with 2-10x higher throughput and 94-97% less peak GPU memory than the baselines, delivering leading detection performance at substantially lower cost.

122. 【2610.22594】he Model Knows Better: Defending Medical Multi-Agent Systems Against Prompt Injection

链接:https://arxiv.org/abs/2610.22594

作者:Fardin Ahsan Sakib,Ziwei Zhu,Ozlem Uzuner

类目:Computation and Language (cs.CL)

关键词:LLM agents discuss, LLM agents, agents discuss, increasingly studied, Medical multi-agent systems

备注:

点击查看摘要

Abstract:Medical multi-agent systems, in which LLM agents discuss a case, are increasingly studied for clinical decision support. Prompt injection, text that an attacker adds to a model's input, can manipulate LLMs into wrong decisions. How it affects these systems, and how to protect them, remains unclear. Across two systems, two model families and three benchmarks, a single injected passage succeeds in up to 61% of cases, and collaboration does not consistently protect against it. Existing defenses help only partly: they miss injections that look like ordinary clinical text. Yet when asked to check the injected text against the patient's findings, a model that followed the injection usually rejects it. We therefore propose a training-free defense that verifies the clinical judgments behind the system's decision. Following clinical practice, it separates the patient's findings from clinical judgments, such as diagnoses, recommendations and instructions, and checks each judgment against the findings alone, so the decision rests only on supported judgments. Our defense outperforms all baselines on every benchmark, lowering attack success on MedQA to 4-7% while maintaining accuracy on cases without an attack, and remains effective with a medical model and against defense-aware and adaptive attacks.

123. 【2610.22588】SAG2: Embedding-Free Multi-Hop Retrieval with BM25 and JEV

链接:https://arxiv.org/abs/2610.22588

作者:Yuchao Wu

类目:Computation and Language (cs.CL)

关键词:deploy without expensive, SQL-Retrieval Augmented Generation, complex database infrastructure, Recall, Augmented Generation

备注:

点击查看摘要

Abstract:Strong multi-hop retrieval should be practical to deploy without expensive corpus preparation or complex database infrastructure. We present SAG2, an embedding-free retrieval architecture built around a single SQLite database, BM25, and contextual evidence decisions from JEV. SAG2 follows the query-time association principle of SAG (SQL-Retrieval Augmented Generation), while replacing its event-entity and dense indexes with a lexical index over original passages. Selected passages supply terms for further retrieval, and newly retrieved evidence guides subsequent decisions. This moves semantic evidence selection to query time, eliminating offline embedding computation, LLM-based event-entity extraction, and dedicated database servers. The resulting system combines lightweight preparation with strong retrieval accuracy: on 1,000-question subsets of MuSiQue, 2WikiMultiHopQA, and HotpotQA, SAG2 achieves the highest Recall@5 and Recall@10 among the compared methods, with Recall@10 of 86.62%, 97.43%, and 99.00%. It also reaches 81.10% document Recall@10 over the 511,962-document EnterpriseRAG-Bench corpus. Indexing all 11,656 MuSiQue passages takes 2.36 seconds, produces a 25.87 MiB database, and requires no model calls. SAG2 demonstrates that accurate multi-hop evidence retrieval can be supported by compact, rapidly prepared infrastructure, making it a practical foundation for knowledge retrieval applications.

124. 【2610.22586】Mitigating Demographic Disparities in Explanation-Human Alignment via Rationale Regularization

链接:https://arxiv.org/abs/2610.22586

作者:Suryansh Talukdar(1),Taha Sarwat(1),Jonathan Rusert(1) ((1) Purdue University Fort Wayne)

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:demographic groups, hate speech detection, demographic, study explanation fairness, explanation

备注: 19 pages, 10 figures, 10 tables

点击查看摘要

Abstract:We study explanation fairness in hate speech detection. High classification performance does not always mean that a model produces equally plausible explanations for different demographic groups. Using the HateXplain dataset, we introduce Plausibility-EFG, a metric that measures the largest difference in explanation plausibility across demographic groups by comparing model-generated token attributions with human-annotated rationales. We evaluate BERT, RoBERTa, and ADV-RoBERTa, an adversarially trained model, using Integrated Gradients and SHAP. Our results show that ADV-RoBERTa improves classification performance and alignment between explanations and human rationales while reducing explanation disparities across demographic groups. These improvements are observed with both attribution methods and remain consistent across training, validation, and test splits. We also show that reducing prediction-level bias alone does not eliminate disparities in explanations, suggesting that predictive fairness and explanation fairness are related but distinct objectives. Finally, our fairness-performance analysis shows that stronger adversarial regularization can further reduce Plausibility-EFG, although it may cause a small decrease in macro-F1. Overall, this work presents explanation fairness as an important objective in hate speech moderation and introduces Fair-REF, a framework designed to reduce disparities in model explanations across demographic groups.

125. 【2610.22568】Repairing LLM-Generated Specifications with Deterministic Diagnosis

链接:https://arxiv.org/abs/2610.22568

作者:Giovanni Vaccarino,Emanuele La Malfa,Dehai Min,Hanrong Zhang,Pier Luca Lanzi,Lu Cheng,Michael J. Wooldridge,Philip S. Yu,Sara Bernardini

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Large language models, Large language, reasoning problem expressed, language models, natural language

备注:

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used as formalizers: given a reasoning problem expressed in natural language, they produce a formal specification that a symbolic solver can then solve, with guarantees relative to that specification. Many specifications are runnable yet semantically wrong, encoding incorrect constraints, domains, objectives, predicates, or goals, and solver-error feedback dries up once execution succeeds. Purely LLM-based diagnosis, lacking a formal ground truth, often fails to spot these errors, and its ungrounded critiques cause regressions in 11.8% of initially correct specifications in our experiments. We propose DRAGO, a repair framework that replaces this ungrounded critique with deterministic, formalism-specific diagnosis, and retains a rewrite only when the diagnosed error weight strictly decreases under a reference-free acceptance predicate. Across five benchmarks spanning logical reasoning (SMT-LIB2), constraint programming (MiniZinc), and planning (PDDL), DRAGO cuts regressions by nearly an order of magnitude, to 1.3%, while improving answer accuracy by 12.9 percentage points over zero-shot formalization and 8.7 percentage points over LLM-diagnostic repair, averaged across benchmarks. We also uncover two rendering defects in Planetarium that cause 50% (3,086 instances) of its floor-tile split to be inconsistent with the reference formalizations, and release a corrected split.

126. 【2610.22567】Who Do Perspectivist Models Predict Well? Annotator Agreement, Sparsity, and Performance

链接:https://arxiv.org/abs/2610.22567

作者:London Lowmanstone IV,Vaagishwaran Sivakumar,Anwesha Samaddar,Akul Mundada,Harnoor Kaur,Maria Gini

类目:Computation and Language (cs.CL)

关键词:natural language processing, Successful completion, perspectivist natural language, annotation tasks requires, tasks requires algorithms

备注: 24 pages, 9 figures, 5 tables

点击查看摘要

Abstract:Successful completion of perspectivist natural language processing (NLP) annotation tasks requires algorithms to be aligned across diverse perspectives in order to predict how different humans will rate text. This work studies how the performance of such algorithms varies for annotators who behave differently than others, either by providing annotations that diverge from others' responses or by providing fewer annotations altogether. To aid with characterizing model performance, we curate the largest collection to date of perspectivist NLP datasets with ordinal annotations. After evaluating multiple classes of perspectivist algorithms across each of the datasets, we model the relationship between individual annotator idiosyncrasy and algorithm performance. In general, we find that algorithms perform better on annotators who tend to agree with others, but that annotator response rate does not have a statistically significant positive correlation with algorithm performance.

127. 【2610.22545】Cultural (In)Competence: Investigating Culture-Specific Stereotype Detection Capabilities of LLMs

链接:https://arxiv.org/abs/2610.22545

作者:Maximilian Spliethöver,Jannes Lötfering,Dominik Bachmann,Alexander Espig,Willem Zuidema,Katrin Schulz,Henning Wachsmuth

类目:Computation and Language (cs.CL)

关键词:subjective constructs, cultural, cultural contexts, contexts, cultural context

备注: Accepted to Findings of the Association for Computational Linguistics: EMNLP 2026

点击查看摘要

Abstract:Stereotypes are subjective constructs that are mediated by the cultural context in which they are viewed. Successfully modeling them thus also requires cultural competence. When using large language models (LLMs) for stereotype-related tasks, such as their detection, it is therefore crucial that models can access relevant cultural knowledge and adjust responses accordingly. Since LLMs have shown disparities in what cultural knowledge is available to them, their capacity regarding stereotypes may also be disparate across languages and cultural contexts (e.g., for non-English languages or for non-US contexts). In this paper, we systematically investigate the effectiveness of LLMs for culture-specific stereotype detection across three factors: (1) the prompting language, (2) the instruction tuning language, and (3) the fine-tuning dataset size. We conduct experiments for US, Dutch, and Chinese cultural contexts. Our results suggest that LLMs do not reliably account for cultural contexts and overpredict the presence of stereotypes. Non-English prompts seem to improve consideration of cultural context and thus lead to more effective predictions. Moreover, we find that additional instruction tuning reduces false-positive rates and that training data size moderates detection effectiveness non-monotonically.

128. 【2610.22542】HeRE: A Novel Benchmark for Hebrew Relation Extraction via LLM-Guided Denoising of Knowledge Graph Alignments

链接:https://arxiv.org/abs/2610.22542

作者:Ron Keinan,Amir David Nissan Cohen,Reut Tsarfaty

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:English Relation Extraction, demonstrate strong capabilities, Relation Extraction, LLMs demonstrate strong, strong capabilities

备注: Accepted to AACL-IJCNLP 2026

点击查看摘要

Abstract:While LLMs demonstrate strong capabilities in English Relation Extraction (RE) tasks, a significant gap remains in assessing their RE performance in low-resource languages, due to a lack of standardized benchmarks. Creating native, language-specific annotated RE benchmarks is expensive and requires human expertise, while relying on translation yields suboptimal, inaccurate datasets that introduce English-centric biases. To tackle this, we propose a scalable, language-agnostic methodology to create RE data by denoising naturally occurring yet noisy alignments of knowledge bases and corresponding texts. We define a proper alignment via a Natural Language Inference (NLI) task, where a relation triplet is entailed by an input text. We empirically assess five denoising strategies, and demonstrate that multilingual models outperform language-specific models in the few-shot LLM setting, while Hebrew-specific encoders remain competitive under NLI fine-tuning and are strongest in the label-free cross-training setting. We further find that prompting in the native language achieves performance on par with or slightly exceeding English prompts, confirming that the pipeline operates naturally in the target language. The best open-weights model, Gemma-4-31B-it (F1\,=\,0.915), matches the best API model, GPT-5.4 (0.921), and reaches F1\,=\,0.844 on a fully held-out, dual-annotated test set. Applying the optimized pipeline, we release HeRE: a novel, massive, 1.5-million-instance silver dataset for Hebrew RE, designed to support data-intensive experimentation and model fine-tuning. HeRE bridges a critical gap in standard Hebrew RE evaluation, while providing the NLP community with a reproducible, language-agnostic pipeline for RE dataset construction in other low-resource settings.

129. 【2610.22538】Are Large Reasoning Models Good Everyday Reasoners? A Comparison with Non-Reasoning Models on Logical Reasoning Tasks

链接:https://arxiv.org/abs/2610.22538

作者:Kentaro Ozeki,Risako Ando,Takanobu Morishita,Hirohiko Abe,Koji Mineshima,Mitsuhiro Okada

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Large reasoning models, leverage test-time computation, test-time computation achieve, computation achieve strong, reasoning models

备注:

点击查看摘要

Abstract:Large reasoning models (LRMs) that leverage test-time computation achieve strong performance on mathematical and scientific benchmarks and are increasingly deployed in real-world applications. However, their ability to perform \textit{everyday logical reasoning}, which often departs from textbook formal logic, remains underexplored. In this work, we systematically evaluate how well reasoning models align with everyday reasoning patterns by introducing a benchmark based on linguistic and pragmatic reasoning phenomena. We also compare reasoning models with non-reasoning models under controlled prompting conditions. We find that, in many cases, (1) reasoning models show degraded performance in everyday reasoning when such reasoning deviates from formal logical rules, (2) some non-reasoning models with chain-of-thought prompting outperform comparable reasoning models in everyday reasoning, and (3) prompting with additional instructions provides limited control over reasoning behavior. These findings suggest that current reasoning models do not reliably capture everyday reasoning and point to limitations in post-training, motivating improved training objectives and evaluation across diverse forms of reasoning.

130. 【2610.22529】Pearl-Chat: Engineering a native Luganda language model from first principles in JAX and Flax NNX

链接:https://arxiv.org/abs/2610.22529

作者:Wesley Kambale,Roland Sankara

类目:Computation and Language (cs.CL)

关键词:Autoregressive foundation language, under-represented African languages, predominantly target high-resource, target high-resource Indo-European, high-resource Indo-European languages

备注: 17 pages, 8 figures

点击查看摘要

Abstract:Autoregressive foundation language models predominantly target high-resource Indo-European languages, imposing computational and morphological penalties on under-represented African languages. Generic multilingual tokenizers routinely exceed fertility rates of 3.2 tokens per word on agglutinative Bantu languages, degrading context efficiency and inflating latency. We present Pearl-Chat, an 8,473,122-parameter ($\sim$8.5M) causal decoder-only transformer engineered for Luganda (Oluganda, ISO 639-2: lg), a low-resource Niger-Congo Bantu language spoken by over 10 million people in East Africa. Built from first mathematical principles in JAX and Flax NNX, Pearl-Chat uses explicit functional state decomposition (this http URL and this http URL), deterministic resumable data streaming via Google Grain, and SPMD tensor parallelism using this http URL. We introduce a byte-level byte-pair encoding (BPE) subword tokenizer trained from scratch on curated Luganda corpora ($V = 8,192$), achieving 4.88 characters per token compression and 1.60 tokens per word fertility, a two-fold compression improvement over LLaMA-3 (128K) and Gemma (256K). The model is trained with a two-stage curriculum: Stage 1 pre-training on 59,501 sequences across parallel, biblical, encyclopedic, and journalistic corpora, and Stage 2 instruction fine-tuning on 510 dialogues with assistant-only loss masking. Across 4,000 optimization steps, validation cross-entropy loss drops monotonically from 9.4695 (perplexity: 12,958.98) to 0.1818 (perplexity: 1.20), a decrease of 9.2877 nats. On a three-tier held-out diagnostic benchmark, Pearl-Chat achieves 0.9792 ROUGE-L and 0.9405 BLEU while maintaining concordial agreement across Bantu noun classes. We provide a Python Server-Sent Events (SSE) streaming runtime and open-source all weights, tokenizers, and code.

131. 【2610.22526】Literal Lock-In: How Test Language Shifts Literal Attraction in Typed Decision Models on Bengali Idioms

链接:https://arxiv.org/abs/2610.22526

作者:Adib Sakhawat,Syed Rifat Raiyan

类目:Computation and Language (cs.CL)

关键词:classifiers and guardrails, Decision models, emit no text, deployed as routers, probability over caller-supplied

备注: Under review, 33 pages, 12 figures, 22 tables

点击查看摘要

Abstract:Decision models, non-generative scorers that report a probability over caller-supplied options and emit no text, are increasingly deployed as routers, classifiers and guardrails. Because they generate nothing, rationales and chain-of-thought do not apply. We audit three: an encoder scorer, a decoder scorer and a closed API, entirely through interventions on their input, using expert-annotated Bengali idioms carrying a gold figurative and a gold literal gloss. Dropping an idiom's own literal gloss into the option list draws every arm toward it, taking 65% to 96% of each arm's remaining Bengali errors. A model-by-language matrix over one shared item set shows how far this depends on the test language: every arm is 1.9 to 6.4 times more captured in Bengali than in English on the same paired entries, the commercial model's apparent resistance is a property of its test language, and capability does not order the failure. Calibration degrades in all three arms, and on the open arms confidence inverts, so gating on it is worse than gating at random. On a semantics-free option list, where accuracy is at chance, the best-calibrated arm still reports mean confidence 0.82. Code and data: this https URL.

132. 【2610.22525】alkhder at AlexandriaX-2026: Context-Aware English-to-Dialectal Arabic Dialogue Translation with QLoRA-Fine-Tuned NileChat-3B

链接:https://arxiv.org/abs/2610.22525

作者:Hasan Alkhder,Maher Pasa,Maria Hanini,Amro Najjar,Ahmet Zengin

类目:Computation and Language (cs.CL)

关键词:team Alkhder submission, describes team Alkhder, thirteen Arabic dialects, paper describes team, English dialogue turns

备注:

点击查看摘要

Abstract:This paper describes team Alkhder's submission to Subtask 1 of the AlexandriaX-2026 shared task, which asks systems to translate English dialogue turns into thirteen Arabic dialects. We fine-tune NileChat-3B-Base with QLoRA on the Alexandria parallel dialogue corpus, training one set of adapter weights for all dialects. Each turn is translated conditioned on the target country and dialect, the domain, the participant roles, the speaker-addressee gender direction, and the preceding dialogue context. At inference, conversations are translated autoregressively and the model is fed its own previous outputs back as context without using any gold target-side test information. Under the constrained track, using only Alexandria data, it trains in about one hour and translates the private test set in under two hours. The system reaches a country-macro-averaged spBLEU of 20.36 and chrF++ of 36.64 on both tracks.

133. 【2610.22518】Learning User Representations to Improve Simulation Fidelity

链接:https://arxiv.org/abs/2610.22518

作者:Shuhaib Mehri,Philippe Laban,Michel Galley,Dilek Tür,Jennifer Neville,Jianfeng Gao

类目:Computation and Language (cs.CL)

关键词:User, user representations, representations, representation, users

备注:

点击查看摘要

Abstract:User simulators enable interactive training and evaluation of AI assistants at scale. Yet current simulators struggle to reproduce the diverse behaviors of real users, leading to assistants that generalize poorly to underrepresented users. We identify user representations as an underexplored bottleneck in user simulation. User representations are natural-language descriptions that condition simulators to reproduce a particular user's behavior. A representation's quality becomes apparent in hindsight, through the behavior it induces in a simulator. To evaluate and optimize user representations, we formulate a conversation reconstruction task: given an original conversation, we generate a representation, condition a simulator on it, simulate a conversation, and then measure fidelity by comparing user behavior in the original and simulated conversations. This comparison also yields hindsight feedback, which identifies where the representation falls short and how it can be improved. We introduce hindsight distillation, an online training procedure that distills feedback-conditioned improvements into the representation generator, enabling it to generate improved representations directly from the original conversation. We present UserRepGen-4B, a representation generator trained with hindsight distillation. Across 700 conversations spanning seven datasets, hindsight feedback helps improve user representations at test time, and UserRepGen-4B generates representations that enable more faithful simulation than those generated by GPT-5.5. Beyond conversation reconstruction, learned representations improve simulation fidelity for unseen tasks, better preserve the population-level diversity of real users, and better distinguish users across conversations.

134. 【2610.22515】alkhder at ImageEval 2026 Shared Tasks: Constrained Selection and Rotation-Averaged Logit Scoring for Multimodal Hallucination Detection

链接:https://arxiv.org/abs/2610.22515

作者:Maher Pasa,Maria Hanini,Amro Najjar,Hasan Alkhder

类目:Computation and Language (cs.CL)

关键词:Modern Standard Arabic, submission to Subtask, describe our submission, Standard Arabic, Modern Standard

备注:

点击查看摘要

Abstract:We describe our submission to Subtask~1b of ImageEval 2026. The task consists of selecting the single visually valid statement from three candidates paired with an image, and is in both English and Modern Standard Arabic (MSA). Our system uses a pre-trained 7B vision--language model in a zero-shot setting, without task-specific training or fine-tuning. We formulate the task as a constrained selection problem and choose the answer using next-token log-probabilities. To reduce answer-position bias, we apply a Latin-square rotation to the candidate statements. Our system achieves CI scores of 0.0510 on the English test set and 0.0960 on the MSA test set, reducing CI relative to the official 3B baselines reported on devtest by 83.7\% and 80.4\%, respectively.

135. 【2610.22511】AuditKIT: A Unified Evaluation Spine for Benchmarking, Judging, and Comparing Large Language Models and Agentic Systems

链接:https://arxiv.org/abs/2610.22511

作者:Shreeyans Arora,Utsav Avaiya,Zera Lyngkhoi,Hem Gosalia,Ram Mohan Rao Kadiyala,Vinay Kumar Sankarapu,Pratinav Seth

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Software Engineering (cs.SE)

关键词:combining benchmark accuracy, requires combining benchmark, Evaluating language models, Evaluating language, agents requires combining

备注: 25 pages, 2 figures, 13 tables. Code: [this https URL](https://github.com/Lexsi-Labs/AuditKIT) . Shreeyans Arora and Utsav Avaiya contributed equally; work done while at Lexsi Labs

点击查看摘要

Abstract:Evaluating language models and agents requires combining benchmark accuracy, judge-based assessment, runtime performance, tool-use behavior, and retrieval quality. Differences in interfaces, metric semantics, and trace formats complicate these comparisons and can hide failures in agentic workflows. We present AuditKIT, a source-available evaluation library that records these measurements in one result representation, with direction-aware metric contracts, configuration fingerprints, and extensible metrics and backends. For agents, it provides turn-aware tool-call matching, separates parallel from sequential execution, and distinguishes verified task outcomes from trajectory-level diagnostics. Missing or unobservable evidence is marked unscored rather than counted as failure. For retrieval-augmented generation, it combines ranked retrieval metrics, judged grounding, and deterministic evidence checks. Seven case studies spanning model comparison, serving runtimes, retrieval, tool calling, and interoperability show how answer extraction, runtime behavior, and metric selection change evaluation outcomes.

136. 【2610.22507】RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents

链接:https://arxiv.org/abs/2610.22507

作者:Yunqi Liu,Peiyu Wang,Bingli Wang,Leo Luo,Xuanwu Song,Xudong Ma,Hongxin Li,Yaxin Du,Weicheng Gu,Fanglin Xu,Yi Xing,XiangLong Liu,Jujie He,Zhange Zhang,Huatong Song,Zhaoyi Li,Deyang Kong,Chuan Hao,Peihao Wu,Mingjie Tang,Ran Tao,Jian Yang,Wayne Xin Zhao,Bryan Dai

类目:Computation and Language (cs.CL)

关键词:increasingly execute longer-horizon, instructions remain fixed, Command-line interface, capturing runtime collaboration, evaluate task outcomes

备注:

点击查看摘要

Abstract:Command-line interface (CLI) agents increasingly execute longer-horizon tasks, yet existing benchmarks either assume that user instructions remain fixed throughout execution or evaluate task outcomes without capturing runtime collaboration quality. In this paper, we present REALCLI, a paired benchmark that unifies the evaluation of task execution and human-agent collaboration quality on realistic CLI tasks. To comprehensively measure collaboration, REALCLI builds a five-dimensional framework, operationalized into 22 sub-dimensions and 51 interaction scenario templates. REALCLI provides two modes for paired comparison: REALCLI-EXEC supplies complete specifications upfront, whereas REALCLI-COLLAB introduces a scripted user that delivers progressive information, corrections, constraint revisions, and authorization decisions. Evaluations reveal profound capability gaps in frontier agents: the best configuration attains an average score of only 49.2%, and when evaluated by the joint collaboration score ($J_{\mathrm{collab}}$), the peak performance reaches merely 37.6%. These results show that task effectiveness diverges sharply from collaboration quality, with models consistently struggling in steerability, trust calibration, and safety boundary management. REALCLI provides a rigorous, reproducible foundation for measuring and advancing collaborative CLI agents.

137. 【2610.22468】From Parallels to Divergence: Language Models' Learning of Action Nominal Constructions

链接:https://arxiv.org/abs/2610.22468

作者:Iskar Deng,Shane Steinert-Threlkeld

类目:Computation and Language (cs.CL)

关键词:Action nominal constructions, ordinary noun phrases, Action nominal, nominal form, express events

备注: 41 pages, including appendices

点击查看摘要

Abstract:Action nominal constructions (ANCs) express events in nominal form, with their argument marking following patterns found in clauses or ordinary noun phrases. In this paper, we investigate how different grammatical configurations affect language models' learning of ANCs and related constructions, and how these learning preferences compare with typological distributions in natural languages. We use a grammar-engineered method for synthetic corpus construction that combines shared semantic input from natural corpora with computational grammars. We construct 96 target languages varying in clause word order, noun-phrase word order, alignment, complement system, and ANC strategy. For each language, we train GPT-2-small models from scratch and evaluate them using targeted minimal pairs covering 34 grammatical phenomena. The results show typological parallels in basic clause configurations but divergences in complement systems and ANC strategies, with models also learning combinations rare or unattested in natural languages. This partial alignment suggests that natural language distributions may reflect both general learning pressures and functional demands not fully captured by model learning experiments.

138. 【2610.22467】Progressive Misalignment Can Emerge from Benign Recursive Self-Distillation

链接:https://arxiv.org/abs/2610.22467

作者:Karim Abdel Sadek,Federico Di Gennaro,Fanny Yang

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:attracted widespread attention, advance AI capabilities, outputs has attracted, attracted widespread, widespread attention

备注: 9 pages

点击查看摘要

Abstract:Training models on their own outputs has attracted widespread attention as a possible route to advance AI capabilities. One prominent approach is self-distillation, where a model is trained to match the token-level predictions it would have produced when given access to additional context, such as a cue, feedback, or instruction. However, the safety properties of this training procedure are poorly understood. In this paper, we present a surprising safety failure of recursive self-distillation, where each self-distilled model becomes the teacher for the next round of training. We observe that when a safe model is recursively self-distilled on its own (safe) generations while receiving an additional non-harmful cue, it becomes increasingly misaligned across a diverse set of harmful queries; we call this Progressive Misalignment. We show this failure mode in both the Qwen3 and Phi-4 model families on SORRY-Bench and StrongREJECT. Progressive misalignment also occurs in a more realistic setup, where the fixed cue is replaced by feedback from a simulated user with benign intent. Using a gradient-based method, we are also able to find benign prompts that lead to progressive misalignment when applying recursive self-distillation, showing that harmful training prompts are not necessary for this failure mode to emerge. We hope our work encourages future investigations of the safety properties of AI systems recursively trained on their own data.

139. 【2610.22455】High prevalence of antagonizing rhetoric in trending topics on Twitter/X

链接:https://arxiv.org/abs/2610.22455

作者:Armin Pournaki,Eckehard Olbrich

类目:ocial and Information Networks (cs.SI); Computation and Language (cs.CL)

关键词:element of democracy, Disagreement, political, rhetoric, trending topics

备注: 33 pages, 8 figures

点击查看摘要

Abstract:Disagreement between political opponents is a central element of democracy. This disagreement can be voiced in different ways. An opponent can be antagonized, i.e. portrayed as an enemy that needs to be overcome, or they can be criticized, i.e. treated as a legitimate adversary with whom one can engage. While the latter is a fundamental part of democratic exchange, the former can be detrimental to public discourse. Political disagreement increasingly takes place on social media, where negativity towards political out-groups has been found to drive engagement. However, existing research has largely treated such negativity as a single dimension, leaving open whether it is antagonization or criticism that circulates on these platforms. This work addresses this gap by introducing a computational approach to detect these two types of rhetoric in text and identify its targets. On a corpus of over 17 million tweets from trending topics in the German Twittersphere, the method reveals that about a third of all tweets contain antagonizing rhetoric. Comparing tweets from trending topics to a random sample shows that the discourse in trending topics is systematically more antagonizing than ordinary Twitter communication. Combining antagonization detection with a large-scale estimation of users' political leaning, we find that right-leaning users employ antagonizing rhetoric significantly more than their left-leaning counterparts. Furthermore, both forms of oppositional rhetoric are strongly amplified within political camps, with multipliers retweeting them up to twice as often as tweets without oppositional rhetoric. Finally, patterns of antagonized targets reveal how different political camps construct their out-groups, with the right-wing populist party AfD and the Green party as the central antagonists of the opposing camps.

140. 【2610.22454】Where Prefill Expert Reduction Hurts MoE Models: A Few Prompt Tokens Carry Most of the Short-Answer F1 Loss

链接:https://arxiv.org/abs/2610.22454

作者:Zhiyuan Wang

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Running prompt tokens, fewer routed experts, Running prompt, serving cheaper, fewer routed

备注: 8 pages main text, 26 pages with appendices; supplementary material in ancillary files

点击查看摘要

Abstract:Running prompt tokens through fewer routed experts during prefill is a simple way to make mixture-of-experts (MoE) serving cheaper, yet it is unclear what this damages. We locate the damage with token-, layer- and attention-path interventions on short-answer question answering in four MoE families. At half the experts the F1 loss of three families is mostly answer form: the model still finds the answer but stops answering briefly. In Qwen3-30B-A3B this loss is made at the two chat-template tokens before the answer, and in DeepSeek-V2-Lite at the first 8-32 prompt tokens, where its instruction sits; by answer likelihood these positions account for about half and a fifth of the damage. Reduction changes the first token's attention mass, norm and largest activation by less than 4%, and restoring super experts or massive activations recovers at most about a quarter of the loss, well below keeping the sensitive positions full. On real prompts with about 4% of tokens at full experts, placing them on the task interface keeps F1 within one point of the unmodified model, while placing them at random in the documents is about 3 points worse (two of five prespecified primary comparisons; the others were undecided or not run). Because the answer boundary always ends a single-turn prompt, and DeepSeek's loss was no longer detectable once its instruction moved away from the start, the sensitive tokens lay at the prompt ends in every sensitive layout we found, so rules that keep the ends are not distinguished from rules that read application marks. Time to first token falls about 14% on 11K-token prompts and not at 2K tokens.

141. 【2610.22428】Embeddings Are Overpriced? A Frozen 16 MB Vocabulary for Small and Ternary Language Models

链接:https://arxiv.org/abs/2610.22428

作者:Sai Kiran Bathula

类目:Computation and Language (cs.CL)

关键词:single largest part, small language model, largest part, small language, single largest

备注: 9 pages, 2 figures, 6 tables. Code, data, checkpoints and per-question results: [this https URL](https://huggingface.co/QLNI/embeddings-are-overpriced) . Preprint DOI: [https://doi.org/10.5281/zenodo.23382634](https://doi.org/10.5281/zenodo.23382634)

点击查看摘要

Abstract:In a small language model the vocabulary is the single largest part. In Gemma 3 270M the embedding table holds 168M of 268M parameters, and because quantisation methods leave the embedding in 16-bit, it is also most of the file once the rest of the model is compressed. We ask what that table actually buys. We replace it with one frozen table of 512-bit codes, 16 MB, with no trainable parameters, derived once from a pretrained embedding by principal-component projection and sign binarisation, and we train the same Gemma-shaped body from scratch on the same 2.05B tokens with and without it. The learned table buys 0.20 nats of validation loss for 2.6 times the trainable parameters, but on LAMBADA, HellaSwag and PIQA the frozen-table model is better or tied; only ARC-Easy favours the learned table. With a ternary BitNet b1.58 body the whole model is a 46 MB file, still ties the float model on LAMBADA and PIQA, and on a laptop CPU generates 615 to 740 tokens per second in 62 MB of memory, five to six times the speed of the float model's 8-bit GGUF in this http URL at a seventh of the memory. The frozen table wins by 1.7 to 2.3 nats on rare words, accepts 10,000 new words after training with a 3% cost where the learned table collapses by 43%, and all of it is released with the weights, the data and every evaluation answer.

142. 【2610.22426】PRIME: Towards Verifiable Evidence-Grounded Reasoning in LLM Agents

链接:https://arxiv.org/abs/2610.22426

作者:Hamed Khosravi,Xiaoming Huo

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:LLM agents, ready for investigation, LLM, vulnerability report, conclusion

备注:

点击查看摘要

Abstract:LLM agents are used to check records against an organization's requirements, for example whether a vulnerability report is ready for investigation. Requirements often allow several ways to be met, such as a severity rating with a curator-reviewed advisory or a published advisory link. Agents fail by accepting a report after a required check has failed, or by settling for a weaker conclusion without trying another way that could still succeed. We introduce PRIME (Precommitted Rules for Inference from Minimal Evidence). Before checking, it fixes evidence routes specifying how each conclusion may be justified. A separate program records each check result and refuses any conclusion the results do not justify. It also points the agent to checks that could justify a stronger conclusion, or runs them itself. PRIME reports only conclusions authorized by its rules and ledger. With correct requirements, exact checks at known locations, and sufficient budget at stopping, completion reaches the strongest supported conclusion. On 480 public-record tasks, an agent shown the requirements reported unjustified conclusions on 26.7% of tasks, while PRIME reported none. Its directions and added checks raised the average score for justified conclusions from 30.1, with refusal alone, to the maximum of 59.2 out of 100.

143. 【2610.22382】Eliciting Specifications: When Does Interactive Clarification Help?

链接:https://arxiv.org/abs/2610.22382

作者:Mowafak Allaham,Aditya Vempaty,Ashish Jagmohan,Prasenjit Dey,Ravi Kokku

类目:oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:verifier-relevant edge cases, yielding imperfect formal, omit verifier-relevant edge, generate Lean specifications, imperfect formal specifications

备注: Accepted to NeurIPs 2026 Workshop on AI for Verifiable Coding

点击查看摘要

Abstract:LLMs can generate Lean specifications from task descriptions, but those descriptions are often underspecified or ambiguous and may omit verifier-relevant edge cases, yielding imperfect formal specifications. We study whether an elicitation agent (EA) can improve verifier-checked Lean specifications by seeking clarification from a reference-grounded simulated developer before formalization. The agent decomposes the task, identifies unresolved decisions, asks bounded clarification questions, and uses the answers to write a refined natural-language specification that an LLM formalizer then translates into Lean. On 189 Verina Lean 4 specification-generation tasks, we compare single-shot generation with elicitation under question budgets of k=3 and k=10, allowing at most three or ten EA questions per task, across same-model and cross-model configurations. The same-model Claude Sonnet 4.6 pipeline has negative strict pass@1 estimates at both budgets, showing elicitation is not a uniform accuracy booster. In contrast, the Sonnet 4.6-to-GPT-5.6 and Sonnet 4.6-to-Gemini 3.8 Flash pipelines have positive strict estimates. The largest strict result reaches 65.6%, a +6.3-point change (+12 tasks), in the Sonnet 4.6-to-GPT-5.6 pipeline. Six of eight conditions have positive compile-conditional estimates, with a maximum cross-model difference of +4.9 points among compiling outputs. Treatment estimates also differ across the basic and advanced splits; the largest advanced-task change occurs in the Sonnet 4.6-to-GPT-5.6 configuration at k=10, from 42.0% to 50.6%. Failure analysis identifies postconditions as the largest source of degradation. These findings suggest future autoformalization systems should treat elicited natural-language specifications as intermediate artifacts and optimize jointly for semantic correctness among compiling outputs and reliable translation of clarified information into Lean.

144. 【2610.22381】Binding-Specific Relearning Savings for Test-Time Continual Learning

链接:https://arxiv.org/abs/2610.22381

作者:Zhe Zhou

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:language model, model lost, fact becomes harder, harder to elicit, model

备注: Accepted at the NeurIPS 2026 Workshop on Towards Test-Time Continual Learning Agents (TTCL). 15 pages, 2 figures. Code: [this https URL](https://github.com/zhezhou1106/relearning-savings)

点击查看摘要

Abstract:When a fact becomes harder to elicit from a language model, has the model lost it, or has it merely become less accessible? Parameter-updating test-time continual learning agents are usually evaluated by current output accuracy; we ask whether that measurement captures how prior experience shapes later updates. We test whether learning a specific factual binding produces a later relearning advantage beyond familiarity with its entity, answer vocabulary, format, or query slot. In Qwen2.5-1.5B, we compare three matched, counterbalanced histories: LEARNED receives the correct binding, CONTROL receives matched exposure without it, and WRONG receives a competing relation-valid answer in the same slot. After an identical rehearsal-free continual fine-tuning stream, LEARNED reacquires the target faster than CONTROL at a prespecified checkpoint of partial forgetting. WRONG shows no positive advantage over CONTROL, while its comparison with LEARNED provides slot-matched corroboration, subject to possible competitor interference. The advantage remains positive after adjustment for measured pre-relearning behavior. In a secondary descriptive conversion using an unpaired never-seen pool, prior learning reduces the optimizer updates required for restoration by about 18%. Current behavioral accuracy can therefore underestimate the lasting effect of previously acquired experience. Code is available at this https URL

145. 【2604.27553】Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models

链接:https://arxiv.org/abs/2604.27553

作者:Xiaomeng Wang,Martha Larson,Zhengyu Zhao

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:Large Visual Language, Visual Language Model, observed in font, wide variety, visual text style

备注: Accepted by ICMR 2026. Code is available at [this https URL](https://github.com/XiaomengWang-AI/The-Impact-of-Visual-Text-style-on-Attribute-based-Descriptions-Produced-by-LVLMs)

点击查看摘要

Abstract:When the visual style of text is considered, a wide variety can be observed in font, color, and size. However, when a word is read, its meaning is independent of the style in which it has been written or rendered. In this paper, we investigate whether, and how, the style in which a word is visualized in an image impacts the description that a Large Visual Language Model (LVLM) provides for the concept to which that word refers. Specifically, we investigate how functional text styles (readability-oriented, e.g., black sans-serif) versus decorative styles (display-oriented, e.g., colored cursive/script) affect LVLMs' descriptions of a concept in terms of the attributes of that concept. Our experiments study the situation in which the LVLM is able to correctly identify the concept referred to by a visual text, i.e., by a word or words rendered as an image, and in which the visual text style should not influence the attribute-based description that the LVLM produces. Our experimental results reveal that even when the concept is correctly identified, text style influences the model's attribute-based descriptions of the concept. Our findings demonstrate non-trivial style leakage from text style into semantic inference and motivate style-aware evaluation and mitigation for LVLM-based multimedia systems.

146. 【2604.20012】EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training

链接:https://arxiv.org/abs/2604.20012

作者:Yiyang Du,Zhanqiu Guo,Haochen Zhang,Annabella Macaluso,Xin Ye,Liu Ren,Yonatan Bisk,Chenyan Xiong

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

关键词:VLM, inherit their visual, embodied domain, visual and linguistic, linguistic capabilities

备注:

点击查看摘要

Abstract:Vision-Language-Action Models (VLAs) inherit their visual and linguistic capabilities from Vision-Language Models (VLMs), yet most VLAs are built from off-the-shelf VLMs that are not adapted to the embodied domain, limiting their downstream performance. In this work, we propose EmbodiedMidtrain to bridge the gap between VLMs and VLAs. We first characterize the data distribution gap between them, showing that VLA data occupy compact regions that are largely separated from the broader VLM distribution, while the degree of alignment varies substantially both across and within VLM data sources. Then, we build a mid-training data engine that leverages a lightweight learnable proximity estimator to select the most VLA-aligned candidates from a large VLM pool, and produce EmbodiedMidtrain-1M, a VLM dataset that we further use to mid-train the VLM before downstream VLA fine-tuning. Experiments on both simulated robot manipulation benchmarks and real-world tasks show consistent VLA performance gains over off-the-shelf checkpoints across VLM backbones and VLA action heads. These gains extend to downstream tasks not used to guide data selection. Further analysis reveals that mid-training provides a stronger initialization for VLA fine-tuning, with gains emerging from the earliest steps and widening throughout training. Moreover, the data engine captures both dataset-level and sample-level alignment signals, favoring spatial reasoning over text-centric tasks while preserving the diversity of the VLM data. We will release all code, data and models for future research.

147. 【2610.22745】Reading the News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock Returns

链接:https://arxiv.org/abs/2610.22745

作者:Kevin Foley,Jonathan Hartadi,Shivesh Prakash,Charishma Takkallapalli,Swapnil Vatsal

类目:atistical Finance (q-fin.ST); Computation and Language (cs.CL); Machine Learning (cs.LG); Portfolio Management (q-fin.PM)

关键词:Language models, reward hindsight, read financial, backtest can reward, trained on text

备注:

点击查看摘要

Abstract:Language models that read financial news are usually trained on text from the same years used to test them, so a backtest can reward hindsight. We build news topics from NoLBERT, an encoder pretrained only on text published between 1976 and 1995, adapted into a sentence encoder by contrastive fine-tuning on passages of the same article, with no labels or returns. We compare it with LDA, MiniLM and FinBERT readers on 1.26 million articles from 2012 to 2024, convert each reader's topics into attention shocks and stock exposures, and forecast the returns of the 1,000 largest US stocks with eight models at three rebalancing frequencies. Models are fitted on 2013-2019, choices are made on 2020-2021, and 2022-2024 is held out. The experiment with the best validation score loses money at every frequency. Measuring attention shocks against the past 63 trading days instead of 5 raises the test rank IC of every reader. NoLBERT gives the most stable topics and forecasts about as well as LDA. An equal-weight combination of all readers and models earns a monthly net Sharpe ratio of 1.12, significant against zero before adjusting for the search but not against a price-only benchmark.

信息检索

1. 【2610.23707】ool Recommendation for Multi-Step Agents: Finding Every Tool a Task Needs

链接:https://arxiv.org/abs/2610.23707

作者:Sam Partee,River Stevens,Thierry Damiba,Valerie Fanelle

类目:Machine Learning (cs.LG); Information Retrieval (cs.IR)

关键词:agent task fails, platform we study, study have definitions, exceed the context, context window

备注: 11 pages, 3 figures, 5 tables

点击查看摘要

Abstract:A multi-step agent task fails when a single tool it needs is missing, yet the tools an agent may need are too many to list: the roughly 8,200 tools on the platform we study have definitions that together exceed the context window of any model we evaluate. We present Tool Recommendation, a deployed system that gives an agent all of them, hundreds of times more than a typical MCP server exposes, through a fixed interface of three tools. It runs at the gateway between agent and tools, executing every call under the end user's own credentials and checking it against the user's consent for each service and the tools the agent may use. We evaluate it on both a public retrieval benchmark and billed end-to-end session cost. On ToolRet, Tool Recommendation places every tool a query needs in the top ten 57% more often than BM25, a lexical ranking that commercial tool search offers, and compares favorably with published systems up to nine times its size. In paired multi-step workflows, its first recommendation covered every required tool in 93% of Codex sessions, and against a fixed list of 100 tools it cut input tokens by 17% with Codex and 40% with Claude Code and the total bill in all 14 runs, by up to 40%, with no change in task completion.

2. 【2610.23541】Humanity's Last Choice: A Common Evaluation Standard for Generative Engine Optimization

链接:https://arxiv.org/abs/2610.23541

作者:Qianfeng Wen,Yifan Simon Liu,Difan Jiao,Junda Wu,Di Bai,Jintao Liu,Xidong Wu,Zhenwei Tang

类目:Information Retrieval (cs.IR)

关键词:Humanity Last Choice, decisions that follow, Choice, Choice describes, choice people

备注: 19 pages, 2 figures. Project website: [this https URL](https://humanitylastchoice.org)

点击查看摘要

Abstract:Humanity's Last Choice describes the idea that the last choice people need to make is which AI system they entrust with the decisions that follow. These systems rely on external sources that content providers can edit through generative engine optimization (GEO) to increase source visibility and influence recommendations. Choosing among these systems therefore requires comparable evidence of how well they carry out user requests when exposed to GEO. Benchmarks have made progress in standardizing tasks, models, and metrics, but they often define their own spaces of GEO strategies and use different editing constraints. These differences can conflate gains from better optimization algorithms with those from greater freedom to edit sources, while making evaluation coverage difficult to compare across benchmarks. We therefore call for a common evaluation standard and propose a meta-taxonomy that describes where sources are edited, how they are edited, and what signals those edits target. Drawing on representative literature, we map existing strategies into a searchable space and outline a protocol for controlled comparisons with explicit coverage reporting. This provides a foundation for common leaderboards that can inform which systems people choose to rely on.

3. 【2610.23510】LSNR: Learned Sparse News Recommendations with Attentive User Modeling

链接:https://arxiv.org/abs/2610.23510

作者:David Vos,Andrew Yates,Maarten de Rijke

类目:Information Retrieval (cs.IR)

关键词:single query string, Current learned sparse, Current learned, query string, LSNR

备注: 10 pages, 3 figures, 9 tables. Accepted at SIGIR-AP 2026

点击查看摘要

Abstract:Current learned sparse approaches for recommender systems, such as STAR, represent a user by concatenating their interaction history into a single query string. For news, this creates two bottlenecks: concatenation collapses a user's distinct reading interests into one flat query, and, because news articles are long-form text, concatenating several news articles quickly overruns the context window of the language model used as backbone and forces quality-degrading truncation. To address both bottlenecks, we introduce learned sparse news recommendations (LSNR). LSNR encodes each article independently and constructs a sparse user vector by combining learned, attention-based weighting of the per-article sparse representations with a dense-projected expansion at the user level. Experiments on the MIND and EBNeRD datasets show that LSNR significantly outperforms STAR, with these gains holding even in short-history settings where truncation is not a factor. Compared to state-of-the-art dense recommenders, LSNR is competitive in standard settings and it outperforms them when the user history is short. An ablation of the user encoder confirms that learned attention-based aggregation outperforms simpler pooling alternatives. Beyond effectiveness, an additional advantage of LSNR is that it serves from an index an order of magnitude smaller than an uncompressed dense baseline.

Comments:
10 pages, 3 figures, 9 tables. Accepted at SIGIR-AP 2026

Subjects:

Information Retrieval (cs.IR)

ACMclasses:
H.3.3; H.3.1

Cite as:
arXiv:2610.23510 [cs.IR]

(or
arXiv:2610.23510v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2610.23510

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>
4. 【2610.23470】QD-Rec: Open-Ended Evolution of Recommendations via Quality-Diversity

链接:https://arxiv.org/abs/2610.23470

作者:Takashi Ishida,Taro Makino,Issa Sugiura

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

关键词:open mathematical problems, Open-ended search combined, faster algorithms, mathematical problems, self-improving agents

备注:

点击查看摘要

Abstract:Open-ended search combined with foundation models has produced advances such as faster algorithms, new results on open mathematical problems, and self-improving agents. We extend this paradigm to recommendation for decision-making, focusing on decisions where the set of possible choices is fixed but the reasons for choosing them are not. In high-stakes decisions, e.g., which company to acquire or which customer to target, comparing diverse, well-reasoned options can be more useful than a single ranked list. We formalize open-ended recommendation as building a diverse, high-quality set of recommendations, each an item together with a hypothesis, a natural-language reason why the item fits the needs of a decision maker. We propose QD-Rec, a quality--diversity method that selects items with a contextual bandit and generates hypotheses with a foundation model from earlier ones kept in an archive as stepping stones. A new recommendation enters the archive if it is novel or better than its nearest neighbor. Across MA, customer targeting, and paper and book recommendation, QD-Rec gives the highest mean quality and builds the largest archive in most settings.

5. 【2610.23346】Jev-as-a-Judge for Brazilian Portuguese Information Retrieval: Relevance Assessment and Reranking

链接:https://arxiv.org/abs/2610.23346

作者:Leandro Carísio Fernandes,Jayr Pereira

类目:Information Retrieval (cs.IR)

关键词:study investigates Jev, structured decision-making, designed for fast, study investigates, model designed

备注:

点击查看摘要

Abstract:This study investigates Jev, a System One model designed for fast, structured decision-making, in information retrieval. We use Jev-as-a-judge to generate relevance judgments for four Brazilian Portuguese IR collections covering different domains and compare them with the official relevance judgments of each collection. We also evaluate Jev as a reranker. For relevance assessment, exact agreement ranged from 52.9% to 64.9%, while quadratic weighted Cohen's kappa ranged from 0.52 to 0.82. Most disagreements involved adjacent relevance levels, with at least 94.5% of annotations matching exactly or differing by only one relevance level. Despite differences at the individual query--document level, Jev-generated qrels produced similar retrieval system rankings, with Kendall's tau ranging from 0.90 to 0.93 for NormasTCU and Ulysses-RFCorpus across the two evaluation metrics. For reranking, Jev reordered the top 1,000 BM25 candidates for each of the 50 Quati test queries, increasing nDCG@10 from 0.3329 to 0.6331 (+90.2%) and MRR from 0.6852 to 0.9033 (+31.8%). These findings support Jev as a relevance assessor and show improved ranking effectiveness over BM25 in the evaluated reranking setting.

6. 【2610.23186】Code Skill Server: A Large-Scale Search Engine for Code Generation Skills

链接:https://arxiv.org/abs/2610.23186

作者:Xiaoyong Li,Haolong Li,Dongliang Xu,Haoyu Li,Yifan Wang,Jingyuan Shi,Yanghua Wang,Yanbin Sun,Shidong Pan,Yue Yao

类目:oftware Engineering (cs.SE); Information Retrieval (cs.IR)

关键词:including software engineering, Agent skills, skills, improving agent ability, code generation

备注:

点击查看摘要

Abstract:Agent skills have proven to be an effective technique for improving agent ability on specific tasks, including software engineering, natural science, and mathematics. During such a process, using agent skills often involves manually discovering and organizing skills from heterogeneous sources, while existing skill retrieval methods mainly focus on selecting relevant skills from established skill libraries. However, with the rapidly increasing number and variety of reusable agent skills, manually searching for relevant skills across heterogeneous sources is becoming impractical at scale. In this paper, we introduce the Code Skill Server (CSS), a large-scale search engine for finding the most useful code generation skills for a target task. CSS consists of a skill server that incrementally collects and indexes publicly available code generation skills from multiple sources, with 993 skills included in the corpus used in this work. Extensive experiments across different retrieval methods and code generation benchmarks show that the best CSS configuration improves Pass@1 by up to 13.91% and consistently improves all evaluated models by at least 4.21% in the cross-model evaluation. These results demonstrate that CSS can effectively search for and serve relevant skills, improving code generation quality and enhancing models' code generation capabilities. Code and the CSS-993 corpus are available at {this https URL}.

7. 【2610.22797】Reasoning Reranking with Semantic IDs as the Sole Item Representation

链接:https://arxiv.org/abs/2610.22797

作者:Zhenwei Tang,Jintao Liu,Di Bai,Xidong Wu,Xinwu Cheng

类目:Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:compact Semantic IDs, existing systems read, generative recommenders increasingly, recommenders increasingly represent, Semantic IDs

备注: 30 pages, 3 figures. Code: [this https URL](https://github.com/lilv98/ReRankID) ; data: [this https URL](https://huggingface.co/datasets/lilvjosephtang/ReRankID)

点击查看摘要

Abstract:Reasoning rerankers write a rationale before ranking a candidate slate, and existing systems read item metadata to do so, even though generative recommenders increasingly represent items as compact Semantic IDs (SIDs). Ranking from SIDs alone has two appeals: SID prompts are far shorter than the matched item text, and although item codes are fixed from content, the backbone learns their token embeddings in part from user-item interaction sequences, so the tokens can carry behavioral signal that item text lacks. That training targets next-item generation, and whether it supports ranking a supplied slate from SIDs alone is untested. We build ReRankID, a controlled testbed in which models reason and rank from a history and slate shown only as SIDs, varying item rendering, history length, and slate size one at a time. On this testbed, such models often copy the input order instead of reranking, and readable metadata does not repair the failure. We compare supervised fine-tuning, rejection-sampled self-training, on-policy distillation, and verifier-based reinforcement learning as post-training methods and find that they elicit the missing behavior. The strongest post-trained model, the 8B model trained with a graded ranking reward, gives the best SID-only ranking and matches strong text-reading LLMs whose prompts are about 20x longer. It ranks above random with no history at all, where a caption-reading reference does not, and it keeps its gains at long histories, where text prompts pass 50k tokens and the caption-reading reference stops improving. In a paired rationale audit, this model argues trade-offs better than that reference but describes items less accurately. The common post-training methods we test thus elicit ranking from SIDs but not faithful item descriptions, which calls for post-training that improves the reasoning itself, not only the ranking it produces.

8. 【2610.22726】Improving OCR Accuracy Through Multi-Classifier Verification of Visually Similar Characters

链接:https://arxiv.org/abs/2610.22726

作者:Nuzhat Khan,Ab Al-Hadi Ab Rahman,Mohamad Anuar Kamaruddin,Muhammad Paend Bakht,Sana Fatima,Farhad Khodadadi,Ibrahim Yousef Alshareef

类目:Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

关键词:Distinguishing visually similar, Distinguishing visually, text digitization, persistent challenge, challenge for optical

备注: 32 pages, 8 figures, 2 tables. Submitted to Computer Vision and Image Understanding (CVIU). Dataset available at [this https URL](https://github.com/VeCAD-P04-UTM/94-Class-ASCII-Image-OCR-Data)

点击查看摘要

Abstract:Distinguishing visually similar characters is a persistent challenge for optical character recognition (OCR) systems, causing errors in critical applications of text digitization. While preprocessing techniques improve image quality and word-level post-processing corrects spelling errors, neither addresses character-level visual ambiguity, an intrinsic property of certain character pairs that limits even state-of-the-art OCR models. We present the Character Verification Model (CVM), a character-level post-processing framework that verifies and corrects ambiguous characters in OCR outputs using specialized binary classifiers trained on visually confusable pairs such as 'O'/'0', 'Z'/'2', and 'S'/'5'. CVM operates independently of dictionary validation, making it suitable for non-lexical data including serial numbers, alphanumeric codes, and license plates. Experiments on three OCR engines (Tesseract, EasyOCR, TrOCR) and ten fonts with low to high complexity demonstrate accuracy improvements of 3.95-14.81 percentage points, with an 87.3% correction rate for visually similar character errors and a false-correction rate of only 2.3%. The modular architecture integrates with existing OCR pipelines without modification to underlying recognition models.

9. 【2610.22703】NoveltyScope: A Multi-Agent Research Assistant for Evidence-Grounded Novelty Assessment of Scientific Papers

链接:https://arxiv.org/abs/2610.22703

作者:Yueran Tian,Huizhi Liang

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词:retrieved prior work, prototype that compares, compares a scientific, scientific paper, paper with retrieved

备注: 13 pages, 1 figure

点击查看摘要

Abstract:NoveltyScope is a prototype that compares a scientific paper with retrieved prior work and produces a structured report and a five-level novelty score. The system extracts the core task and at most two author-claimed contributions, then searches a closed local corpus using BM25 and dense retrieval with reciprocal rank fusion. Contribution comparisons request paired passages for potential refutations, and quotations are checked against cached source text. Four scoring roles (Prosecutor, Defender, Judge, and Critic) use the resulting evidence, with at most one revision of the Judge's score. Evaluation uses 50 class-balanced RINoBench samples whose idea-level labels are retained for full-paper input. Mean absolute error is 1.48 and 1.26 for single-LLM and multi-agent scoring with Gemini, respectively, and 1.22 and 1.16 with Qwen3. The vector-similarity baseline has an error of 1.68. A HiCLIP case study illustrates the contribution comparisons and paired evidence passages. Overall, the results demonstrate the feasibility of evidence-grounded novelty assessment and show that the multi-agent configurations achieve lower scoring errors than their single-LLM counterparts across both evaluated models.

10. 【2610.22511】AuditKIT: A Unified Evaluation Spine for Benchmarking, Judging, and Comparing Large Language Models and Agentic Systems

链接:https://arxiv.org/abs/2610.22511

作者:Shreeyans Arora,Utsav Avaiya,Zera Lyngkhoi,Hem Gosalia,Ram Mohan Rao Kadiyala,Vinay Kumar Sankarapu,Pratinav Seth

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Software Engineering (cs.SE)

关键词:combining benchmark accuracy, requires combining benchmark, Evaluating language models, Evaluating language, agents requires combining

备注: 25 pages, 2 figures, 13 tables. Code: [this https URL](https://github.com/Lexsi-Labs/AuditKIT) . Shreeyans Arora and Utsav Avaiya contributed equally; work done while at Lexsi Labs

点击查看摘要

Abstract:Evaluating language models and agents requires combining benchmark accuracy, judge-based assessment, runtime performance, tool-use behavior, and retrieval quality. Differences in interfaces, metric semantics, and trace formats complicate these comparisons and can hide failures in agentic workflows. We present AuditKIT, a source-available evaluation library that records these measurements in one result representation, with direction-aware metric contracts, configuration fingerprints, and extensible metrics and backends. For agents, it provides turn-aware tool-call matching, separates parallel from sequential execution, and distinguishes verified task outcomes from trajectory-level diagnostics. Missing or unobservable evidence is marked unscored rather than counted as failure. For retrieval-augmented generation, it combines ranked retrieval metrics, judged grounding, and deterministic evidence checks. Seven case studies spanning model comparison, serving runtimes, retrieval, tool calling, and interoperability show how answer extraction, runtime behavior, and metric selection change evaluation outcomes.

11. 【2610.22474】Star Light, Star Bright: Can Multimodal Models Parse an Astronomy Visual Question Answering Dataset Right?

链接:https://arxiv.org/abs/2610.22474

作者:J. P. Naiman

类目:Computer Vision and Pattern Recognition (cs.CV); Instrumentation and Methods for Astrophysics (astro-ph.IM); Digital Libraries (cs.DL); Information Retrieval (cs.IR)

关键词:Visual Question Answering, field of Visual, figure understanding capabilities, large multimodal models, Question Answering

备注: 5 main pages, 12 pages total, accepted to The 4th Annual Workshop for Artificial Intelligence for Scientific Publications (WASP) 2026, International Joint Conference on Natural Language Processing Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL)

点击查看摘要

Abstract:Figures are essential for scientific communication, and the field of Visual Question Answering (VQA) aims to test the figure understanding capabilities of large multimodal models (LMMs). Here, we investigate the accuracy of several low-cost LMMs on domain-specific VQA tasks for astronomical images of the sky. As instrument for this task we build a domain-specific VQA dataset comprising 2001 partially-synthetic figures divided evenly between contour plots, real telescope images drawn from NASA's SkyView, and "fake" sky images which share the axes and angular scales of the real images but draw their colors from a gaussian mixture model, alongside 47357 questions. Each figure is released as pristine and with realistic page-aging degradations mimicking the historical astronomical corpus. Testing three low-cost proprietary LMMs, we find models frequently fail to answer domain-specific questions at high accuracy. An initial comparison with 104 human-verified, astrometrically tagged figures from historical journal publications shows similar median errors in angular extent. All code is available on GitHub: this https URL and dataset is available on HuggingFace: this https URL.

计算机视觉

1. 【2610.23856】Learning to Correct Geometry in Generated Videos

链接:https://arxiv.org/abs/2610.23856

作者:Weijie Lyu,Tiancheng Shen,Jason Li,Yujing Wang,Xiaoyuan Wang,Haobo Yuan,Yizhou Zhao,Ming-Hsuan Yang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:smooth camera movement, parallax becomes inconsistent, Generated videos, structures warp, shot-like transitions

备注: Accepted by NeurIPS 2026. Project page: [this https URL](https://weijielyu.github.io/VGC)

点击查看摘要

Abstract:Generated videos often lose geometric consistency under camera motion: structures warp under viewpoint change, parallax becomes inconsistent, and smooth camera movement may collapse into shot-like transitions. We argue that this failure is largely a data problem. In web-scale video corpora, most visible motion comes from dynamic objects captured by static or weakly moving cameras, leaving only sparse supervision for viewpoint-induced appearance changes. To address this, we propose Video Geometry Corrector (VGC), a post-hoc video-to-video model trained on synthetic paired supervision. Starting from real videos with diverse camera motion and pose annotations, we construct VG-Pairs with a synthetic paired-supervision data generation pipeline. Each video clip is treated as a geometry-consistent target and paired with a distorted counterpart synthesized by a pretrained image-to-video inpainting model using trajectory-adaptive keyframes. VGC learns to map the distorted input to the geometry-consistent target without modifying the source generator, and uses optical flow as an auxiliary cue to help disentangle camera motion from object motion. Experiments on pose-conditioned and prompt-driven benchmarks show that VGC improves geometric consistency across multiple source generators, and scaling to a larger backbone further extends the framework toward more general video refinement.

2. 【2610.23854】Rethinking the design space of Vanilla Pixel Diffusion Transformers

链接:https://arxiv.org/abs/2610.23854

作者:Soumik Mukhopadhyay,Long Mai,Abhinav Shrivastava,Aniruddha Mahapatra

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:lossy latent bottleneck, Pixel-space diffusion models, separately trained autoencoder, Pixel-space diffusion, avoiding the lossy

备注: Project webpage: [this https URL](https://soumik-kanad.github.io/mflow-diffusion/) . 33 pages, 23 figures, 15 tables. Submission under review

点击查看摘要

Abstract:Pixel-space diffusion models have recently re-emerged as a compelling alternative to latent diffusion, avoiding the lossy latent bottleneck and separately trained autoencoder. JiT shows that a vanilla diffusion transformer can generate directly in pixel space by replacing the commonly used velocity prediction ($\boldsymbol{u}$-prediction) with clean image prediction ($\boldsymbol{x_0}$-prediction). In this work, we revisit this choice and introduce MFlow, an adaptive parameterization that learns to interpolate between $\boldsymbol{x_0}$- and $\boldsymbol{u}$-prediction across principal directions of the data, learned end-to-end with diffusion training. We find that the preferred parameterization varies systematically with the data representation and model capacity -- notably, increasing model capacity shifts preference toward velocity prediction. We evaluate MFlow across ImageNet, UCF-101 video, and large-scale text-to-image generation, demonstrating competitive or improved generative performance across diverse settings. In addition, we find that vanilla pixel diffusion transformers, irrespective of parameterization, retain a persistent high-frequency deficit relative to real images. To address this, we introduce ConvRefiner, a lightweight convolutional module trained post-hoc with an adversarial loss while keeping the diffusion backbone frozen. With only a small amount of additional training, ConvRefiner restores the high-frequency statistics of generated images while preserving FID. Project webpage: this https URL.

3. 【2610.23841】StopWatch: Goal Grounding for Object-goal Navigation

链接:https://arxiv.org/abs/2610.23841

作者:Xinhao Liu,Yunsheng Tian,Yuheng Qiu,Pieter Abbeel,Xi Chen,Guanya Shi,Chen Feng

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:Pretrained VLMs bring, VLMs bring rich, Pretrained VLMs, bring rich world, rich world knowledge

备注: Project website [this https URL](https://stopwatch-nav.github.io)

点击查看摘要

Abstract:Pretrained VLMs bring rich world knowledge and semantic priors to object-goal navigation, and fine-tuning a VLM into a navigation policy has become a common recipe. Despite this progress, success rates remain low, and it is unclear which capability these fine-tuned policies lack. Our diagnosis identifies goal grounding as the dominant failure. These policies explore well, yet often fail to notice that the goal is already in view or to estimate how far away it is. To address this failure, we ground the goal explicitly. Explicit grounding substantially improves success and reaches state-of-the-art results on six benchmarks across three scene collections. We also correct annotation defects in these benchmarks, so that future methods are evaluated more faithfully. Our analysis on the clean benchmarks shows that, with ground-truth grounding, our policy nearly matches the expert that generated its demonstrations, leaving the headroom in perception rather than policy learning. Our work points to goal grounding as a missing piece of object-goal navigation and offers a simple and effective solution to the task.

4. 【2610.23795】Persistent Planar Memory for Video World Models

链接:https://arxiv.org/abs/2610.23795

作者:Yuze He,Bin Tan,Zelin Gao,Yujun Shen,Yong-Jin Liu,Nan Xue,Yinghao Xu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:generate and explore, explore environments, environments at scale, Video world models, video world model

备注: 20 pages, 9 figures. Accepted by NeurIPS 2026

点击查看摘要

Abstract:Video world models that generate and explore environments at scale need a persistent 3D memory of what they have produced. Plane primitives offer a natural candidate: a compact set of oriented planes captures the dominant structural elements (e.g., walls, floors, facades) of indoor and outdoor scenes, while requiring only 7 parameters per primitive. We present PPMem, a video world model that adopts plane primitives as its persistent 3D memory. PPMem augments a video diffusion transformer with a planar prediction head and a Depth Token Fusion (DTF) module: each autoregressive chunk jointly produces RGB video and planar geometry, which merges into a persistent plane memory that conditions subsequent chunks via rendered depth. The resulting memory is three orders of magnitude more compact than per-pixel point clouds (~100K primitives, 5MB for a full scene), geometrically explicit (metric depth, normals, exportable surfaces), cross-view consistent (jointly predicted by the shared backbone), and adaptive (refined by the merging procedure as generation proceeds). On DL3DV and RealEstate10K, PPMem outperforms prior 3D-grounded world models in video quality while jointly producing metric-scale depth, surface normals, and exportable planar geometry, sustaining coherence across hundreds of frames under large viewpoint changes. Project page: this https URL.

5. 【2610.23789】he Collection of a Real-World, Large-Scale Dataset for Automated Skill Evaluation in Central Line Dressing Change

链接:https://arxiv.org/abs/2610.23789

作者:Ummey Tanin,Shannan K. Hamlin,Hsin-Mei Chen,Peizhu(Pam)Qian

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Central line-associated bloodstream, line-associated bloodstream infections, remain a major, healthcare settings, line-associated bloodstream

备注: 9 pages

点击查看摘要

Abstract:Central line-associated bloodstream infections (CLABSIs) remain a major source of preventable morbidity and mortality in healthcare settings. Proper execution of the central line dressing change (CLDC) procedure is essential for infection prevention, yet current approaches to competency assessment rely primarily on manual ob- servation by clinical educators, making evaluation time-intensive, difficult to scale, and limited in consistency and granularity. These challenges highlight the need for AI-assisted skill evaluation methods that can support more objective, reproducible, and scalable assessment of clinical performance. However, progress in this area has been constrained by the lack of broad-scale, clinically grounded datasets for developing and evaluating such methods. In this work, we present the collection process of a large-scale video dataset for CLDC skill evaluation, comprising 365 recordings of registered nurses collected during the 2026 annual competency exam at Houston Methodist Hospital. Each video is paired with subtask-level temporal annotations and clinical performance assessments spanning 17 subtasks of the procedure. We describe the data collection and curation pipeline, including pilot testing of record- ing configurations, annotation protocol design, and post-collection processing. We further establish the feasibility of video-based skill assessment through benchmark experiments with spatiotemporal deep learning models. This dataset provides a foundation for future research on automated clinical skill assessment, feedback generation, and AI-assisted training in nursing education.

6. 【2610.23772】Video Diffusion Avatars: Taming Video Diffusion Models into Controllable 3D Avatars

链接:https://arxiv.org/abs/2610.23772

作者:Simon Giebenhain,Tobias Kirschstein,Liam Schoneveld,Davide Davoli,Zhe Chen,Matthias Nießner

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Video Diffusion Avatars, Video diffusion models, Video diffusion, introduce Video Diffusion, internet-scale data encode

备注: Project webiste: [this https URL](https://simongiebenhain.github.io/video-diffusion-avatars/)

点击查看摘要

Abstract:Video diffusion models (VDMs) trained on internet-scale data encode a rich prior on appearance, motion, and physics that is difficult to replicate with explicit 3D rendering and costly 3D data capture. We introduce Video Diffusion Avatars (VDAs), a method that creates photo-realistic, multi-view consistent avatars from a single image by fine-tuning a VDM for precise control over camera viewpoint, facial expression, and upper-body pose. Departing from 3D morphable models (3DMMs), VDAs use a learned expression space that lifts the expressiveness ceiling of 3DMMs, e.g., for the tongue and mouth interior. However, learned expression codes exhibit heavy viewpoint bias, as our DISTRACT benchmark reveals. We show that this bias can be removed through disentanglement, enabling their use as driving signals for multi-view consistent avatars. Camera and upper-body pose are controlled jointly via proxy-mesh renderings, giving independent control over expression, pose, and viewpoint. A camera-triplet training strategy makes the approach efficient: our models train for 34 hours on a single A100 using only public multi-view data. VDAs outperform state-of-the-art single-image 3D avatars on novel-view reenactment, reducing face LPIPS by 29% and improving perceptual quality (JOD) by 66% on BecomingLit. A static 3DGS reconstruction probe further confirms that our generations are the most multi-view consistent. Built on a video prior, VDAs produce effects beyond the reach of explicit renderers, including physically plausible hair dynamics, shadows, reflections, and refractions.

7. 【2610.23759】A Paired RGB-Sonar Dataset for Fish Monitoring with Consumer Sonar

链接:https://arxiv.org/abs/2610.23759

作者:Mourad Derbedrosian,Michael Hobley,Pietro Perona

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Imaging sonar enables, sonar enables underwater, optical imaging, enables underwater observation, turbid water

备注:

点击查看摘要

Abstract:Imaging sonar enables underwater observation in conditions where optical imaging is ineffective due to darkness and turbid water. However, imaging-sonar systems previously used for ecological monitoring have typically been expensive, limiting their accessibility. Consumer forward-looking sonar has the potential to make fish monitoring more accessible, but its noisy imagery makes annotation and the development of automated methods challenging. We introduce the Huntington and Caltech Koi RGB and Sonar dataset (HaCKRS), which pairs Garmin LiveScope imaging-sonar recordings with top-down RGB video of koi carp. The dataset contains more than 105,000 temporally matched frame pairs, spanning approximately 3.3 hours of recordings across four range and orientation configurations. We provide frame-wise metadata, sonar geometry and coordinate information, synchronization data for all four configurations, and planar registration for the three horizontal configurations. The release focuses on paired observations and calibration rather than task-specific fish annotations. We intend HaCKRS to support annotation and the development of fish detection, tracking, and counting methods, and investigations into the potential of consumer sonar for ecological monitoring.

8. 【2610.23751】MTEdit: Packed Trajectories Beat Rollouts for Multi-Turn Image Editing

链接:https://arxiv.org/abs/2610.23751

作者:Houyuan Chen,Fanzhou Wang,Xiangyu Fan,Songlin Yang,Zhitao Yang,Lvmin Zhang,Pei Yang,Hao Zhao,Lei Yang,Anyi Rao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:human-AI collaborative creation, Multi-turn image editing, Multi-turn image, image editing, editing

备注: 41 pages, 22 figures, 8 tables

点击查看摘要

Abstract:Multi-turn image editing aims to modify an image according to a sequence of instructions, making it better aligned with human-AI collaborative creation than single-turn editing. However, constructing high-quality multi-turn training data remains challenging, as conventional sequential rollout accumulates errors and introduces visual-quality drift across editing turns. To address this challenge, we introduce MTEdit, a multi-turn image editing dataset built through a pipeline centered on packed trajectory canvas (PTC) generation. By jointly generating multiple editing states within a unified visual context, this pipeline reduces visual-quality drift across turns. Covering both step-wise and context-aware editing scenarios, MTEdit comprises 500K multi-turn image editing trajectories, with up to 8 turns and an average of 5.38 turns per trajectory, making it one of the most extensive datasets for multi-turn image editing. We further introduce MTEdit-Bench, a benchmark designed to evaluate both scenarios by assessing models' ability to follow editing instructions, maintain content consistency, resist visual-quality drift, and effectively use historical context across turns. Using MTEdit, we fine-tune Qwen-Image-Edit-Causal to obtain Qwen-Image-MTEdit. On MTEdit-Bench, we evaluate a broad range of closed-source and open-source image editing models, including Qwen-Image-MTEdit. Experimental results show that Qwen-Image-MTEdit achieves the best performance among the evaluated open-source models, demonstrating the effectiveness of MTEdit in improving models' multi-turn image editing capabilities.

9. 【2610.23747】Beyond Multi-Stage Pipelines: A Label-Correlation Ensemble for Multi-Label Retinal Fundus Disease Classification

链接:https://arxiv.org/abs/2610.23747

作者:Md Asif Uddin,Jannatul Ferdous,Asif Islam,Zobaer Mahmud Zisan,Promit Ghosh,Shah Ahafik Arman,Niloy Farhan,Rafeed Rahman

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Retinal fundus images, fundus images frequently, Retinal fundus, images frequently carry, public fundus datasets

备注:

点击查看摘要

Abstract:Retinal fundus images frequently carry more than one disease, and public fundus datasets are heterogeneous and severely long-tailed. Clinical triage suggests a staged design, in which a screening gate, a disease-group router and group-specific classifiers operate in sequence, but it is unclear whether this hierarchy earns its complexity. We present a controlled comparison of three architectures on a unified 39-target label space built from RFMiD 1.0, RFMiD 2.0 and ODIR-5K (12,652 images): (i) a three-stage gated cascade of eight models, (ii) a flat model with 39 independent sigmoid outputs, and (iii) a label-correlation model that replaces the flat linear head with 39 learned label queries and a two-layer transformer decoder. All three share one Swin-V2-B backbone, one preprocessing pipeline and one training protocol, so differences are attributable to the architecture. Staging offers no consistent advantage: tracing every missed disease instance to the stage that lost it shows that the two coarse gates discard 34.2% of true instances while the fine-grained classifiers lose only 6.7%, and the gates' hard zeros depress the cascade's macro-AUC to 0.747. Label-correlation modeling gives the largest single gain, raising the detection rate from 0.621 to 0.682 (0.689 with test-time augmentation). Blending the flat and label-correlation models under four-view test-time augmentation is the best configuration on six of eight metrics (exact match 0.694, micro-F1 0.678, macro-F1 0.456, macro-AUC 0.972). On definition-matched class subsets it matches or exceeds four recent studies on macro- and micro-F1, most clearly on low-support pathologies. We also show that ensembling a gated cascade with continuous-output models is harmful, and that per-source negative sampling is needed to remove a dataset shortcut that otherwise yields a spurious AUC of 1.000.

10. 【2610.23733】Material and Defocus Cues for Occluded Object Localization in Single Hyperspectral Images: An Exploratory Study

链接:https://arxiv.org/abs/2610.23733

作者:Ali Zia,Jun Zhou

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Partial occlusion makes, occlusion makes object, difficult when visible, object detection difficult, makes object detection

备注:

点击查看摘要

Abstract:Partial occlusion makes object detection difficult when visible regions have weak texture or similar appearance. Hyperspectral imaging provides material-dependent spectra and wavelength-dependent optical blur, which offer complementary evidence for separating objects. We investigate a pipeline that combines nonnegative-matrix-factorization-based material grouping, divergence-based optical cues, and graph Laplacian propagation. The propagated scores support region extraction and bounding-box localization without requiring a separate depth sensor at inference. A collection of 30 indoor and six outdoor hyperspectral scenes acquired using two camera systems provides qualitative examples spanning different materials, depth arrangements, and partial occlusions. The examples illustrate how material information can support separation when optical cues are weak, and how optical cues can distinguish some surfaces with similar material properties. Objects sharing both material and depth remain challenging. This exploratory study establishes the sensing rationale and mathematical formulation, while identifying the quantitative evaluation and implementation details needed to assess detection performance systematically.

11. 【2610.23732】ESC: Escaping 2D Diffusion Ambiguity with Geometric Constraints for Consistent Novel View Synthesis

链接:https://arxiv.org/abs/2610.23732

作者:Ge Ya Luo,Daniel Severo,Brian Karrer,Christopher Pal,Adriana Romero-Soriano,Michal Drozdzal

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:computer vision, remains a fundamental, fundamental challenge, challenge in computer, diffusion models remains

备注:

点击查看摘要

Abstract:Generating 3D-consistent novel views from 2D diffusion models remains a fundamental challenge in computer vision. In this work, we introduce a framework that enhances geometric alignment for monocular view synthesis under drastic camera changes by jointly generating a target view and its corresponding depth map. By conditioning the diffusion pipeline on the single source image, source depth, and target camera rays, our approach forces the model to inherently reason in 3D space even under extreme viewpoint shifts. To guarantee spatial fidelity, we propose a novel per-pixel depth consistency constraint, which verifies and enforces 3D consistency across generated views. Our framework establishes a robust pipeline for geometrically consistent view synthesis, yielding superior visual accuracy and spatial alignment compared to current state-of-the-art methods. With this work, we pave the road towards robust 3D world models capable of understanding complex environments from a single view image.

12. 【2610.23730】Synthetic Image Oversampling for Rare-Class Representation Learning in Deep Facial Phenotyping

链接:https://arxiv.org/abs/2610.23730

作者:Miles Liao,Zhanliang Wang,Hongzhuo Chen,Kai Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Recent deep facial, Recent deep, genetic syndromes, scarce and unevenly, unevenly distributed

备注: BIBM 2026 ML4BMI Workshop

点击查看摘要

Abstract:Recent deep facial phenotyping methods can support the recognition of genetic syndromes, but patient images are often scarce and unevenly distributed across disorders. Synthetic facial images offer a way to supplement the training data without collecting additional patient photographs. Their usefulness, however, depends on whether they improve recognition of real patients: generated images may introduce artifacts or repeat features already represented in the training set. It is therefore necessary to examine both how much synthetic augmentation to use and which disorders benefit. We investigate disease-specific synthetic oversampling using images from the Phenotypic Disease Image Database to augment a subset of the GestaltMatcher Database. We compare increasing augmentation levels in an image-based model, GestaltMatcher-Arc, and a multimodal model, GestaltMML, while keeping the real training and patient-disjoint evaluation partitions fixed. Repeated training runs assess overall and disease-specific accuracy, and an exploratory embedding analysis examines changes in class compactness and separation. Augmentation improves mean recognition accuracy in both training setups, although gains remain modest in GestaltMatcher-Arc and continue across the tested levels in GestaltMML. These aggregate improvements are accompanied by uneven disease-level responses, including reduced accuracy for some disorders. In the embedding analysis, disorders with fewer real training images tend to gain more class separation, but geometric changes do not consistently track classification performance. Together, the findings support synthetic oversampling for limited-data facial phenotyping and emphasize the need to assess its amount and benefit for individual disorders within each training setup.

13. 【2610.23705】FedRAPP: Federated Test-Time Prompt Tuning for Vision-Language Models with Reliability-Aware Prompt Personalization

链接:https://arxiv.org/abs/2610.23705

作者:Syed Md. Ahnaf Hasan,Md Akil Raihan Iftee,Sajib Mistry,Amin Ahsan Ali,AKM Mahbubur Rahman

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:enables vision-language models, learning enables vision-language, sharing raw data, Federated prompt learning, prompt learning enables

备注: 15 pages, 5 figures and 10 tables

点击查看摘要

Abstract:Federated prompt learning enables vision-language models like CLIP to collaboratively adapt lightweight soft prompts across distributed clients without sharing raw data. However, existing federated prompt learning methods are designed primarily for supervised settings with labeled client data and assumed relatively stable training distributions. At test time, source-free federated prompt tuning remains largely unexplored. Clients may receive unlabeled target samples with heterogeneous, often non-IID distributions that differ substantially across clients and from the source training distribution, causing locally adapted prompts to drift in different directions and reducing the effectiveness of federated aggregation. In this work, we explore Source-Free Federated Test-Time Prompt Tuning (SF-FTTPT), where distributed clients collaboratively adapt soft prompts on unlabeled test streams without access to source data. Our study reveals that conventional federated aggregation methods struggle under heterogeneous client distributions, as locally adapted prompts become increasingly specialized and difficult to combine effectively. To address this challenge, we propose FedRAPP, a personalized aggregation framework that combines reliability-aware client assessment, server-side exponential moving-average prompt memory, and similarity-guided peer aggregation. FedRAPP selectively incorporates information from reliable and compatible clients while preserving local specialization, enabling more robust adaptation under distribution shift. Extensive experiments across nine CLIP benchmark datasets and ImageNet variants demonstrate that FedRAPP consistently outperforms standard federated aggregation baselines under heterogeneous client distributions while maintaining the efficiency advantages of prompt-only adaptation.

14. 【2610.23677】Agentic Physics-Grounded Video Generation via Memory-Augmented In-Context Reasoning

链接:https://arxiv.org/abs/2610.23677

作者:Xikang Guan,Shaocong Yang,Yanqi Bao,Can Wang,Zheng Gu,Zhengqing Chen,Kai Chen,Jing Huo,Yang Gao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:essential for realistic, realistic video generation, Physical, Spatiotemporal Causal Constraints, repair

备注: 12 pages, 5 figures, 1 table

点击查看摘要

Abstract:Physical plausibility is essential for realistic video generation. Existing methods impose physical guidance before synthesis via simulations or refined prompts, but this can limit dynamic diversity, miss errors that emerge only after generation, and require repeated regeneration when inconsistencies remain. We therefore study a generate-diagnose-repair paradigm that preserves the original generation capability and selectively repairs physical inconsistencies afterward, raising two key questions: what to repair and how to repair? To address them, we introduce PhysRepair, an agentic video generation framework that combines causal reasoning over the observed physical failure with prior repair experience to enable localized and adaptive correction. Specifically, Spatiotemporal Causal Constraints identify the first invalid physical state and its causally affected states, producing a repair specification that guides physically plausible local regeneration while preserving unaffected content. Experience-augmented In-context Learning combines the ongoing repair context with relevant experience from previous repairs, allowing the agent to adapt its repair decisions across diverse physical failures and accumulate completed trajectories for future cases. Experiments on Physics-IQ Verified across solid mechanics, fluid dynamics, optics, thermodynamics, and magnetism demonstrate that PhysRepair consistently improves the physical plausibility of generated videos over existing methods. Our project page is available at this https URL.

15. 【2610.23663】PCDFusion: Proposal-Context-Detail Bayesian Rendering for Infrared-Visible Image Fusion

链接:https://arxiv.org/abs/2610.23663

作者:Rui Liu,Lin Gu,Hesong Li,Ying Fu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Infrared-visible image fusion, Infrared-visible image, thermal infrared observations, downstream vision tasks, aims to combine

备注: Accepted by NIPS 2026

点击查看摘要

Abstract:Infrared-visible image fusion (IVIF) aims to combine visible and thermal infrared observations for human perception and downstream vision tasks. Visible and thermal infrared observations are physically complementary but unreliable in different ways. Existing deep IVIF methods mainly improve feature interaction and reconstruction, but often lack an explicit local rule for deciding when visible appearance should dominate and when thermal responses should contribute. To address this issue, we reformulate IVIF as local Bayesian posterior rendering, where fusion is controlled by posterior action weights rather than direct modality mixing. In this paper, we propose Proposal-Context-Detail Fusion (PCDFusion), a visible-anchored framework that implements this formulation through three rendering stages. PCDFusion preserves potentially useful thermal responses, updates exposure-degraded visible regions, and renders reliable band-limited infrared structures into the final luminance. Extensive experiments on public IVIF benchmarks show that PCDFusion improves fusion quality, target recovery, and downstream detection and segmentation performance under challenging illumination. The code is available at this https URL.

16. 【2610.23661】An Efficient Approach to Beetle Damage Detection of Banana Using Deep Learning

链接:https://arxiv.org/abs/2610.23661

作者:Md. Mehedi Hasan Naeem,Ishtiyak Ahmmad Araf,Md. Arefin Haque Mahir,Tushar Kanti Saha

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Basilepta subcostata, banana fruit scarring, fruit scarring beetle, banana fruits, reduce their market

备注: 6 pages. Accepted at the 12th IEEE International Conference on Sustainable Technologies and Engineering (IEEE iCOSTE 2026), Cox's Bazar, Bangladesh, November 1-3, 2026

点击查看摘要

Abstract:Visible surface damage of banana fruits by Basilepta subcostata (the banana fruit scarring beetle) can reduce their market value. Here, manual inspection of Banana fruits is subjective and difficult to scale. This study presents a lightweight framework based on YOLOv8n deep learning model for locating individual bananas and classifying their visible surface condition as healthy or unhealthy. The term beetle damage in the paper title is used operationally for the locally observed scar-like surface condition; the model does not identify a specific beetle species or biological cause. A custom dataset of 2,473 images containing 5,827 annotated banana instances was prepared from local-market imagery in Bangladesh. The reported experiment used an 80/20 protocol with 1,982 training images and 491 test images. A pretrained YOLOv8n model was trained at 640x640 resolution for 50 epochs with a batch size of 4. On the test partition, it achieved 81.36% precision, 74.30% recall, 77.67% F1-score, 87.04% mAP@0.50 and 59.33% mAP@0.50:0.95. A YOLOv8s comparison gave slightly lower F1 and mAP while using a substantially larger checkpoint. The YOLOv8n checkpoint occupied 5.96 MB and required 6.54 ms/image for inference on an NVIDIA Tesla T4. The results support YOLOv8n as a compact baseline for instance-level banana surface inspection within the studied acquisition conditions.

17. 【2610.23659】FlexPart: Text-Controlled Semantics-Aware 3D Part Segmentation at Flexible Granularity

链接:https://arxiv.org/abs/2610.23659

作者:Yiqun Zhao,Jiachen Xu,Yihao Zhi,Yunfei Zhao,Zibo Zhao,Xintong Han,Chunchao Guo,Shenghua Gao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:asset admits multiple, admits multiple valid, Toggle, valid part decompositions, multiple valid part

备注: 8 pages main, 8 figures

点击查看摘要

Abstract:A 3D asset admits multiple valid part decompositions, while semantics-aware segmentation should reflect both the desired granularity and the parts a user wants to extract. Ideally, a practical segmentation model should strive for a simple principle: what you ask for is what you get. However, realizing this goal is hindered by two core obstacles: the lack of multi-granularity training data and the absence of a holistic control mechanism. We propose FLEXPART, a unified framework for text-controlled 3D mesh segmentation. To establish flexible control, we introduce a holistic control prompt comprising semantic part names with location and shape clauses. To support this mechanism, we utilize an automated Vision-Language Model (VLM) pipeline to construct a large-scale dataset of multi-granularity partitions and their corresponding prompts. Driven by this data, FLEXPART generates a view-independent part-identity field in native 3D space, directly assigning discrete part IDs to mesh faces. To compel the model to respect semantic conditions rather than rely on geometric priors, we train the model using randomized background dropping. Furthermore, an inference-time VLM planner can automatically complete descriptive clauses from 2D renderings, allowing users to simply name the desired parts in ordinary words. FLEXPART with planner-completed prompts outperforms the strongest evaluated baseline by 15% in mIoU, even when that baseline receives ground-truth guidance. On our held-out FLEXPARTBENCH, FLEXPART leads at each granularity and improves average mIoU by 22% over the strongest baseline. With only the requested part names supplied by the user, it also improves IoU by 35% over the strongest click-driven baseline on selective segmentation.

Comments:
8 pages main, 8 figures

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.23659 [cs.CV]

(or
arXiv:2610.23659v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2610.23659

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Yiqun Zhao [view email] [v1]
Fri, 16 Oct 2026 15:54:52 UTC (29,237 KB)

Full-text links:
Access Paper:

View a PDF of the paper titled FlexPart: Text-Controlled Semantics-Aware 3D Part Segmentation at Flexible Granularity, by Yiqun Zhao and 7 other authorsView PDFHTML (experimental)TeX Source

view license

Additional Features

Audio Summary

Current browse context:
cs.CV

prev

|
next

new
|
recent
| 2026-10

Change to browse by:

cs

References Citations

NASA ADSGoogle Scholar
Semantic Scholar

export BibTeX citation
Loading…

BibTeX formatted citation

loading…

Data provided by:

Bookmark

checked="checked"class=“labs-tab-input”>
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author
Venue
Institution
Topic

    About arXivLabs

arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.

Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)

mathjaxToggle();

    We gratefully acknowledge support from
    our major funders,
    member institutions, ,
    and all contributors.

About

Help

Contact

Subscribe

Copyright

Privacy

Accessibility

Operational Status (opens in new tab)

Major funding support from

18. 【2610.23653】A Language-Informed Loss for Visual Generation

链接:https://arxiv.org/abs/2610.23653

作者:Suchir Agarwal,Keshigeyan Chandrasegaran,Ziyu Chen,Kyle Sargent,Juan Carlos Niebles,Li Fei-Fei,Jiajun Wu

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:recently achieved competitive, achieved competitive performance, learned image tokenizers, recently achieved, achieved competitive

备注: 29 pages; Project website: [this https URL](https://suchiragarwal.com/lilie)

点击查看摘要

Abstract:End-to-end visual generation with pixel-space loss has recently achieved competitive performance without the need for learned image tokenizers. In this work, we study whether language-informed supervision can provide a richer training signal than pixel loss for visual generation. We introduce LILIE (pronounced "lily"), a Language-Informed and Lossless Image Encoder. LILIE is an invertible image transform trained such that a vision-language model can recover captions from noised features. The encoder uses a normalizing flow transformer trained jointly with a vision-language model via next token prediction. We then use the encoder to extract a simple language-informed loss for text-to-image generation. We train JiT models with LILIE loss, reducing gFD by 14 points (66.84 $\to$ 53.01) against a pixel-only baseline on the GPIC dataset. Our code, encoders, and generative models are available at this https URL.

19. 【2610.23642】Diversity Without Labels: Task-Agnostic Coreset Selection Across Perception and Action

链接:https://arxiv.org/abs/2610.23642

作者:Julia Hindel,Benjamin Ramtoula,Kyuhwan Yeon,Nick Heppert,Paul Newman,Daniele De Martini,Abhinav Valada

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:curating high-quality datasets, inherently challenging, large collections, datasets from large, model training

备注:

点击查看摘要

Abstract:While data collection for model training is relatively easy, curating high-quality datasets from large collections is inherently challenging. Coreset estimation methods address this problem by identifying the best data subsets to train models on. However, existing approaches often require proxy model training, extensive annotations, or task-specific tailoring. Unsupervised alternatives typically exploit geometric properties in foundation model feature spaces, but are limited to pairwise image-to-image comparisons or comparisons against a fixed subset. We introduce CoreDNA, an unsupervised, task-agnostic coreset estimation approach that pools neuron activations from vision foundation models into per-image and per-dataset distributions. By comparing each image's distribution to the dataset-level distribution, CoreDNA can capture both low-level visual structure and high-level semantic information across layers. We find that high-quality samples concentrate in the tails of the last layer's activation statistics, which we validate by relating them to training-based coreset methods. Building on these findings, we develop a computationally efficient selection mechanism to construct task-agnostic, high-quality coresets for selective annotation and model training. Across image classification, semantic segmentation, depth estimation, and imitation learning for end-to-end driving and mobile manipulation, CoreDNA matches or outperforms the state of the art, demonstrating unprecedented generalization across perception and action tasks. These results highlight the effectiveness of compact activation-based representations for data selection.

20. 【2610.23621】Stereo LWIR-RGB Automatic Labeling for Low-Light Camera-Based VRU Detection

链接:https://arxiv.org/abs/2610.23621

作者:Dimitrios Bouzoulas,Pyry Jäppinen,Pejman Habibiroudkenar,Eerik Alamikkotervo,Risto Ojala

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:collision prone time, ensuring VRU safety, key component, component in ensuring, collision prone

备注:

点击查看摘要

Abstract:VRU detection in low-light conditions is a key component in ensuring VRU safety during the most collision prone time of the day. Currently, advances in low-light detection are limited due to the lack of large scale datasets and automated labeling methods. Most autolabeling methods use RGB detections as their labels source, which cannot be replicated in low-light conditions. To fill this gap in this paper we present an automated pipeline for low-light VRU labeling. We use LWIR-RGB image pairs and source our labels from LWIR as VRUs differentiate from the background due to their body temperature. Unlike our previous work that relied on a complex hardware setup to align the two modalities, we perform this experiment using a LWIR-RGB stereo setup, lowering hardware complexity and cost, making the pipeline easier to reproduce. We evaluate method end-to-end on a dataset collected in the capital region of Finland. Models trained on our generated labels beat both off-the-shelf baselines and models fine tuned on a hand labeled subset on F1, mAP@50 and LAMR metrics when tested on a manually labeled dataset, and the result holds for two different LWIR detectors. This shows that low-light VRU autolabeling can be made both accessible and effective without specialized alignment hardware.

21. 【2610.23610】Not Every Mention Is a Claim: Rethinking Object Hallucination Detection in Vision-Language Models

链接:https://arxiv.org/abs/2610.23610

作者:Hsin-Ling Hsu,Neeraja Kirtane,Kuan-Hao Huang

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:Object, measured by checking, mentions, non-assertive, non-assertive mentions

备注:

点击查看摘要

Abstract:Object hallucination in vision-language models (VLMs) is usually measured by checking each object a caption names against the image. Most benchmarks and detectors alike treat every object mention as a claim that the object is present. This assumption fails when a caption names an object without asserting it, as in "a bench for people to sit on", which mentions people without claiming that any are in the image. We call such mentions non-assertive. Treating them as hallucinations inflates the error rates attributed to models that use such language. To separate them from real hallucinations, we introduce NAME-Bench (Non-Assertive Mention Evaluation Benchmark), 25,497 object mentions from captions that five VLMs generate for COCO images. Each mention is labelled concrete (asserted and present), hallucinated (asserted and absent), or non-assertive, and non-assertive mentions are further divided into four subtypes: depictive, purpose, negation and hedged. All the hallucination detectors that we evaluate flag non-assertive mentions as hallucinations, at rates between 14% and 80%. Adding non-assertive mentions to detector training as negatives largely corrects this on LLaVA-1.5. On the four newer VLMs, a comparable correction takes five to ten times more data, and the detectors then catch fewer real hallucinations. These findings show that current detectors conflate mentioning an object with asserting it, and that this conflation is harder to undo on the four newer VLMs than on LLaVA-1.5. Hallucination evaluation should therefore separate what a caption asserts from what it merely mentions.

22. 【2610.23609】ADA 2025: A Multimodal Dataset for Water-Deficit Stress Detection in Sugar Beets

链接:https://arxiv.org/abs/2610.23609

作者:Piper Powell,Robert Franz,Amos Smith,Isaak Ihorst,Joachim Hertzberg,Martin Atzmueller

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Research and development, suitable public datasets, artificial intelligence, machine learning, development into artificial

备注: 6 pages, 4 figures, 1 table. Accepted at the 2026 IEEE International Workshop on Metrology for Agriculture and Forestry (MetroAgriFor). Dataset: [this https URL](https://doi.org/10.26249/FK2/DMDLTE) ; code: [this https URL](https://github.com/pippowell/ada2025)

点击查看摘要

Abstract:Research and development into artificial intelligence (AI) and machine learning (ML) applications in crop management are hindered by a lack of suitable public datasets. Whereas applications in disease and pest detection benefit from a comparatively higher amount of available data, applications like water-deficit stress detection often have very few if any public datasets available. Moreover, most datasets that are available are single-modality and frequently RGB-only, leaving the early detection and enhanced performance offered by other methods, and particularly by multimodal approaches, out of reach. Datasets with accurate metadata, higher numbers of plants, and smaller intervals between data points are also scarce. To address this, we publicly release ADA 2025, a 500 GB comprehensive multimodal dataset of young sugar beet plants under healthy and water-deficit conditions combining thermal, hyperspectral, RGB, and depth imagery along with relevant environmental and metadata and both relative water content (RWC) and leaf thickness as ground truth sources. Exemplary results showcase the dataset's validity in terms of differences detectable between stressed and healthy plants.

23. 【2610.23600】Learning to Discriminate Scene Structures Makes Self-Supervised Depth Learning Scalable

链接:https://arxiv.org/abs/2610.23600

作者:Mengtan Zhang,Yuchuan Cui,Yu Ma,Zizhan Guo,Wei Ye,Rui Fan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:monocular depth estimation, Self-supervised monocular depth, estimation is appealing, potential to scale, scale with unlabeled

备注: Accepted to NeurIPS 2026

点击查看摘要

Abstract:Self-supervised monocular depth estimation is appealing for its potential to scale with unlabeled data, yet existing methods often degrade when trained on diverse scenes. This study finds that, under self-supervision, models tend to encode dataset-specific structural biases rather than transferable scene geometry, leading to cross-domain optimization conflicts. To address this issue, this study proposes the MaSS framework, aiming to make self-supervised depth learning scalable to diverse data. MaSS introduces a dedicated structural representation pathway explicitly decoupled from contextual features, which is guided by a novel scene-structure discrimination objective to learn generalized, layout-aware structural representations for depth decoding. Trained and evaluated on four diverse datasets, both individually and jointly, MaSS substantially outperforms prior self-supervised methods and is the first to consistently benefit from mixed-domain training. Zero-shot evaluation on eight additional datasets further demonstrates its remarkable generalizability, particularly on those entirely out-of-distribution scenes. The source code is publicly available at this https URL.

24. 【2610.23589】SemPurify: Semantics-Aware Data Purification for Black-box Backdoor Defense

链接:https://arxiv.org/abs/2610.23589

作者:Jiawei Yu,Syed Irfan Ali Meerza,Yi Wu,Amir Sadovnik,Jian Liu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:general behavior unaffected, critical security threat, adversaries embed triggers, poisoned training samples, machine learning

备注: Accepted by the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027)

点击查看摘要

Abstract:Backdoor attacks have emerged as a critical security threat in machine learning, where adversaries embed triggers within poisoned training samples to manipulate a model's predictions on targeted inputs while leaving its general behavior unaffected. This stealthy nature makes backdoor attacks difficult to detect, as the model functions normally until activated by a specific malicious trigger. Current purification-based defenses use image transformations (e.g., blurring) to disrupt trigger patterns but often degrade image quality. Even with advanced restoration techniques like diffusion models, these approaches can still alter visual or semantic information, reducing utility for downstream tasks. To address this, we propose the first semantics-aware data purification framework for black-box backdoor defense, SemPurify, which explicitly incorporates multi-level semantics (i.e., low-level semantic embeddings and high-level image tags) within a text-to-image (T2I) framework to guide image restoration during purification. Using this semantic information, the T2I model subsequently refines the transformed samples, helping preserve visual details and semantic information during restoration. Extensive experiments spanning multiple backdoor scenarios, i.e., classification models, CLIP-style encoders, and generative models, demonstrate that SemPurify reliably removes backdoors while effectively preserving semantic information for downstream tasks.

25. 【2610.23588】Enhancing RAG-based Medical VQA with Gated Multimodal Representations

链接:https://arxiv.org/abs/2610.23588

作者:Daniela Jimenez-Pano,Hugo Jair Escalante,Delia Irazú Hernández-Farías

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:Visual Question Answering, Medical Vision-Language Models, Medical Visual Question, factually inconsistent responses, shown strong performance

备注: Preprint submitted to ECIR

点击查看摘要

Abstract:Medical Vision-Language Models (Med-LVLMs) have shown strong performance in Medical Visual Question Answering (MVQA), yet they may still produce factually inconsistent responses. Retrieval-Augmented Generation (RAG) can mitigate this issue by incorporating external clinical evidence; however, retrieval is often guided by a single modality, potentially overlooking the joint semantics of medical images and clinical questions. We introduce a multimodal RAG framework that learns a joint query representation through a Gated Multimodal Unit, enabling evidence retrieval to leverage information from both modalities while keeping the underlying Med-LVLM frozen. We evaluate the proposed approach on benchmark datasets. Results show that the multimodal query representation consistently outperforms a reference Med-LVLM and remains competitive with state-of-the-art methods. Our findings demonstrate the potential of multimodal query representations for more effective evidence retrieval in Medical VQA.

26. 【2610.23577】CLEAR: Cooperative Latent Flow for Visual Counterfactual Explanations with Accurate Region Preservation

链接:https://arxiv.org/abs/2610.23577

作者:Yan Zeng,Changlu Guo,Oskar Kristoffersen,Anders Nymark Christensen,Morten Rieger Hannemose,Anders Bjorholm Dahl

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Visual counterfactual explanations, Visual counterfactual, preserving decision-irrelevant content, prediction while remaining, remaining realistic

备注: Accepted to WACV 2027

点击查看摘要

Abstract:Visual counterfactual explanations (VCEs) should alter a classifier's prediction while remaining realistic and preserving decision-irrelevant content. Image-space methods provide high-quality counterfactuals but are computationally costly, whereas latent-space methods are more efficient but often less faithful. We identify two sources responsible for this gap. First, latent generation recovers a natural sample from a perturbed representation, whereas classifier guidance pushes it toward a target class, so their update directions may oppose. Second, VAE reconstruction can alter regions that should remain unchanged. We introduce CLEAR, a latent Flow Matching framework for VCEs. CLEAR uses Flow Matching's explicit instantaneous velocity as a reference for the generative direction to decompose classifier guidance into cooperative and conflicting components. It preserves the cooperative component and adaptively attenuates only the conflicting one according to conflict strength. We further analyze conflict frequency and strength throughout generation to reveal how classifier guidance interacts with the generative process. CLEAR also dynamically identifies editable regions, constrains latent modifications, and directly preserves factual content outside them to reduce VAE-induced changes. Across five bidirectional tasks on two datasets, CLEAR retains latent-space efficiency while achieving counterfactual quality comparable to or better than strong image-space baselines, with a 2.5x speedup over the strongest baseline. Project page: this https URL

27. 【2610.23568】From Adult Renal Masses to Pediatric Wilms Tumors: Evaluating Cross-Domain Generalization of Kidney Lesion Segmentation on MRI

链接:https://arxiv.org/abs/2610.23568

作者:Sarah de Boer,Myrthe A. D. Buser,Hartmut Häntze,Jawed Nawabi,Lisa C. Adams,Alida F. W. van der Steeg,Marry M. van den Heuvel-Eibrink,Annemieke S. Littooij,Keno K. Bressem,Mathias Prokop,Alessa Hering

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Deep learning segmentation, larger datasets exist, Deep learning, pediatric Wilms tumors, pediatric Wilms

备注:

点击查看摘要

Abstract:Deep learning segmentation models for pediatric oncology are often trained on small, single-center cohorts, whereas much larger datasets exist for adult diseases, such as kidney cancer. Whether models trained on adult renal lesions generalize to pediatric Wilms tumors remains unclear. We trained a segmentation model on single-sequence T1- or T2-weighted adult kidney MRI and evaluated it on a held-out adult test set and a pediatric Wilms tumor cohort, where it was compared with a pediatric-specific nnU-Net. Segmentation performance was quantified using the Dice similarity coefficient (DSC) and 95th-percentile Hausdorff distance. On the adult test set, the model achieved a median DSC of 0.86 for renal lesions. On the pediatric cohort, the adult-trained model achieved a median DSC of 0.85 compared with 0.90 for the pediatric-specific model. Despite differences in age, anatomy, and tumor type, the adult-trained model showed promising performance on pediatric Wilms tumors, with only a modest difference in median DSC compared with the pediatric-specific model. However, non-inferiority could not be shown, highlighting the value of pediatric training data. In future work, a fine-tuning strategy could be explored.

28. 【2610.23558】LiveSync: Iterative Self-Training for Lip-Sync Generation

链接:https://arxiv.org/abs/2610.23558

作者:Huaishao Luo,Huan Zhang,Guanbo Bao,Yinglu Liu,Youzheng Wu,Xiaodong He

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:surrounding facial context, Audio-driven lip synchronization, preserving subject identity, Audio-driven lip, match target speech

备注:

点击查看摘要

Abstract:Audio-driven lip synchronization aims to match target speech through localized mouth and jaw articulation while preserving subject identity, head pose, and surrounding facial context. Naturally recorded videos provide synchronized reconstruction targets but rarely offer pairs that are matched in identity and pose yet differ primarily in speech-related articulation. Mask-based training enables reconstruction from these videos, but random-reference inputs differ from the aligned self-reference used at inference. We present LiveSync, an iterative self-training framework in which a single mask-based model generates pseudo pairs and is refined for deployment. The model is first trained on a curated real-video corpus augmented with externally generated clips covering under-represented visual conditions. A frozen checkpoint then uses independently sampled audio to generate mouth-edited references from real-video frames, copying pixels outside the edit mask from each source frame. After confidence filtering, these references are paired with aligned masked inputs and original real-frame targets. The retained pseudo pairs are mixed with real training data to refine the same model from its current weights, updating training supervision without adding inference stages. Although we instantiate the framework with a single-pass GAN-based model, the self-training strategy could in principle also be adapted to diffusion-based models. Experimental results show that LiveSync achieves leading synchronization performance on HDTF and competitive performance compared with the baselines on the AIGC-LipSync subset, while maintaining low inference latency.

29. 【2610.23542】Execution Before Memory: Diagnosing Memory Failures in Video World Models

链接:https://arxiv.org/abs/2610.23542

作者:Weiyang Jin,Jiwen Yu,Sihan Xu,Yuwei Niu,Xihui Liu

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:video world model, video world, Current tests fold, change, world model

备注: 27 pages, 7 figures. Project page: [this https URL](https://hku-mmlab.github.io/MIST/) Code: [this https URL](https://github.com/HKU-MMLab/MIST)

点击查看摘要

Abstract:A memory test for a video world model should say whether the scene was set, whether the asked change was carried out, and whether the last frame shows the result. Current tests fold these into one number, so a low score is easy to read as forgetting. When the change is not carried out, the hidden state transition cannot appear, so the test is not really a test of memory. We introduce MIST, an evaluation that separates the change from the memory it should leave behind. The model first sets the scene while the change stays hidden, and only later is asked to show it, with leakage before that point kept under control. This separation locates the bottleneck: the model sets the scene but does not carry out the instructed change. The same gap appears in general memory evaluations. On that basis we propose M3-Agent (Make the Missing Move), which recursively revises the details of the input instruction so that the model successfully carries out the requested instruction. Relative to the baseline, it more than triples the MIST reveal score. On the benchmarks, WRBench's score T rises by 26.1% and MBench-T's score U by 52.7%. The method meets the problem from the execution side: it shows what the frozen model can do once the move is stated, and it sets a stricter baseline.

30. 【2610.23537】PanoBench: A Panoptic Occupancy Prediction Benchmark for Autonomous Driving

链接:https://arxiv.org/abs/2610.23537

作者:Yi Feng,Zizhan Guo,Junwu E,Yu Ma,Mengtan Zhang,Jin Wu,Wei Ye,Hanli Wang,Qijun Chen,Danwei Wang,Rui Fan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Panoptic occupancy unifies, Panoptic occupancy, panoptic occupancy prediction, Panoptic, scarce instance-aware annotations

备注:

点击查看摘要

Abstract:Panoptic occupancy unifies 3D geometry, semantics, and instance identities, but its development is limited by scarce instance-aware annotations. Existing benchmarks mainly provide semantic labels reconstructed from incomplete sensor observations, while panoptic datasets have limited domain coverage or annotation completeness. We introduce PanoBench, a camera-centric panoptic occupancy prediction benchmark spanning synthetic and real-world driving scenes. It combines PanoBench-CarlaOcc, PanoBench-nuScenes, and PanoBench-KITTI360 through canonical data interfaces and unified evaluation protocols, providing multi-resolution annotations with persistent instance identities. The synthetic branch derives complete panoptic geometry from simulated meshes. For real-world data, a new pipeline reconstructs backgrounds using geometric priors and topology constraints, generates foreground mesh assets from multi-frame multi-view images, and fuses them into sparse panoptic voxels. A unified valid-mask protocol evaluates complete thing instances supported by temporal observations while scoring stuff regions at the voxel level. Analyses of observation fidelity, geometric completeness, spatial continuity, and temporal consistency demonstrate the benefits of the resulting annotations over existing occupancy benchmarks. We benchmark representative methods on semantic occupancy prediction, panoptic occupancy prediction, and 4D occupancy forecasting, and study voxel resolution, synthetic-to-real transfer, and storage efficiency. These results reveal complementary strengths of volumetric and ray-based metrics and persistent challenges in real-world instance-aware prediction. PanoBench is available at this https URL.

31. 【2610.23535】PreciseEdit: Strong Yet Stable Semantic Transport for One-Step Image Editing

链接:https://arxiv.org/abs/2610.23535

作者:Jingyi Wang,Xiao Lu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:interactive Web-based image, models enable efficient, interactive Web-based, efficient image synthesis, Web-based image editing

备注: 9 pages, 7 figures, and 5 tables

点击查看摘要

Abstract:Recent one-step text-to-image (T2I) models enable efficient image synthesis, opening up new possibilities for interactive Web-based image editing. However, existing one-step editing methods often construct a global transport field through simple vector operations between conditional predictions. While such strong transport can effectively drive the image toward the target semantics, it may be released along unreliable directions or over non-edited regions, leading to structural distortions within the editing region and background drift elsewhere. More importantly, stabilizing the editing process through global smoothing or uniformly weakening the transport field often makes large semantic changes overly conservative. In this work, we revisit one-step image editing from the perspective of the tension between semantic strength and transport stability, and identify a key insight: strong semantic transport is not inherently unstable. What matters is whether it is applied along reliable directions and at reliable spatial locations. Motivated by this insight, we introduce PreciseEdit, a model-agnostic, training-free and inversion-free one-step editing framework that strengthens target-semantic alignment while preserving background fidelity and structural consistency. We further propose a dual-noise-scale role decomposition strategy: a higher-noise scale produces the strong target-directed transport used for actual editing, whereas a lower-noise scale jointly serves as a probe for directional agreement and spatial structure. Extensive experiments on PIE-Bench demonstrate that PreciseEdit achieves state-of-the-art performance and effectiveness on various editing tasks.

32. 【2610.23533】ReVision: Reprogramming Image Generators for Dense Visual Perception

链接:https://arxiv.org/abs/2610.23533

作者:Yitong Yang,Yinglin Wang,Xuexin Liu,Wei Chen,Zhaoyang Xu,Jiaxin Lin,Rui Chen,Shuting He,Kai Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:rich visual priors, Recent image generators, support dense visual, exhibit rich visual, Recent image

备注:

点击查看摘要

Abstract:Recent image generators exhibit rich visual priors that can support dense visual perception. However, existing approaches typically encode multiple perception tasks into a shared parameterization, making joint training sensitive to the mixture and weighting of heterogeneous data and prone to cross-task interference. To address this issue, we introduce ReVision, an instruction-conditioned parameter generation framework built on a frozen multimodal understanding model and a frozen image generator. Given an image and a free-form instruction, the understanding model jointly encodes them into a multimodal image--instruction representation, which a trainable parameter generator maps to transient low-rank updates for the generator. Each image--instruction pair induces a distinct set of transient prediction parameters, enabling instance-specific adaptation while both pretrained backbones remain unchanged. ReVision requires no task-specific heads, explicit task identifiers, or stored adapters. A shared RGB output interface unifies segmentation, depth estimation, and surface-normal prediction. Across diverse dense prediction benchmarks, ReVision achieves competitive performance with state-of-the-art methods while supporting flexible task specification through natural-language instructions. Our analysis further reveals substantial gradient disagreement across tasks, highlighting the conflict introduced when heterogeneous objectives share a single parameterization. Meanwhile, the generated updates exhibit structured task- and input-dependent organization in weight space, further validating instance-level parameter generation for multi-task perception.

33. 【2610.23531】PONDER: Learning to Generate in the Right Order

链接:https://arxiv.org/abs/2610.23531

作者:Julius Erbach,Dominik Narnhofer,Bernt Schiele,Jan Eric Lenssen,Konrad Schindler

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:introduce PONDER, method that learns, revise earlier predictions, PONDER, earlier predictions

备注: Project page: [this https URL](https://juliuserbach.github.io/Ponder/)

点击查看摘要

Abstract:We introduce PONDER, a method that learns in which order an image generator should fill in content and which of its earlier predictions to revise. Masked generative models construct a sample by repeatedly filling in subsets of missing variables. The order of these partial predictions determines the context available in subsequent steps and therefore affects the quality of the final sample. Common strategies are to choose the order randomly or based on local confidence estimates. Conditioned on the partially generated sample and the generator's features, our policy chooses which positions to fill next and/or which previously filled positions to mask for later regeneration, a mechanism we call rethinking. In this way, the generation process is able to adapt to the evolving context and also to revise earlier predictions. We optimize the policy using group-relative policy gradients, with rewards that measure constraint satisfaction, human preference, or distribution quality. For the latter, we introduce FIDgrad, an image-level reward derived from the (first-order) change in Fréchet Inception Distance caused by adding a generated sample to the current feature distribution. With the generators frozen, learned ordering reduces MAR-B ImageNet FID from 4.09 to 2.78 and raises the accuracy on hard visual Sudokus from 3.9\% to 56.6\%, surpassing uncertainty-based greedy ordering (38.7\%). Rethinking further improves these results to 2.70 FID and 96.7\% accuracy, while increasing the rethinking budget of a fixed policy yields continued improvements at inference time.

34. 【2610.23475】AN: A Size- and Form-Adaptive Masked-Convolution Encoder for Tissue Graphs

链接:https://arxiv.org/abs/2610.23475

作者:Jan Herschel,Anselm von Gladiss

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:represent histology images, graphs represent histology, homogeneous tissue regions, tissue regions intact, Tissue graphs represent

备注:

点击查看摘要

Abstract:Tissue graphs represent histology images as graphs over tissue-conforming superpixels, which keeps homogeneous tissue regions intact instead of cutting them into rectangular patches. To embed superpixels, current encoders crop them to bounding boxes and then pad, resize, or mask them, so background or fill values can leak into the node features. This matters in practice, and especially in medical imaging, where a prediction should depend on the tissue and not on an arbitrary preprocessing choice: on BACH, changing only the fill of the masked region shifts the accuracy of frozen encoders by up to 6 percentage points, larger than the differences among the four best encoders under mean fill, and the preferred fill differs between datasets, so it cannot be fixed once and for all. We present TAN (Tissue-Aware Network), a compact convolutional encoder (0.41M parameters) that processes each superpixel at its native shape and extent and excludes background from every operation, which makes its embeddings exactly invariant to the fill by construction. Under identical masks and an identical graph classifier, TAN's accuracy on BACH is not significantly different from that of the 303M-parameter foundation model UNI (81.1% vs. 80.7-82.6%, depending on the fill), with ~740x fewer parameters, ~1,190x fewer FLOPs, and no pretraining. On BRACS, TAN is close to a ResNet18 trained under the same protocol and trails the histopathology foundation models. An ablation with TAN's architecture but standard processing of fill-padded crops shows that masking keeps accuracy similar (nominally higher on BACH, lower on BRACS, within noise) at less than half the FLOPs.

35. 【2610.23469】When Evidence Vanishes: Distilling Visual-Evidence Dependency in Medical Vision-Language Models

链接:https://arxiv.org/abs/2610.23469

作者:Qizhen Lan,Yiling Ma,Ruiqi Chen,Mengchen Fan,Xi Xiao,Lin Zhao,Liang He,Baocheng Geng,Pulin Che,Tianyang Wang,Xiaoqian Jiang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Compact medical vision-language, medical vision-language models, clinical questions correctly, Compact medical, vision-language models

备注:

点击查看摘要

Abstract:Compact medical vision-language models (VLMs) can answer clinical questions correctly without reliably using the image, relying instead on question wording or learned priors. Standard knowledge distillation copies a teacher's answer preference on the original image, but it leaves unchecked whether that preference is conditional on the visual evidence required by the question. We study this missing target as medical visual evidence dependency: support for the correct answer should decrease when the matched evidence is absent. We introduce Evidence-Conditioned Dependency Distillation (ECDD), which pairs each training image with a control matched to the evidence level and distills the teacher's drop in answer margin across the pair. A lower bound objective transfers positive dependency by penalizing only shortfalls, while original-image supervision preserves task accuracy. The same formulation applies when the evidence is a queried clinical region, a surgical instrument, or whole-image visual content. Across three medical VQA settings, ECDD keeps original-image accuracy competitive with distillation and alignment baselines while making answer support more sensitive to evidence removal. Under the DME headline objective, for example, the positive-case margin response to target rather than random masking rises from 0.786 with KD to 2.023 with ECDD, while original-image accuracy differs by 0.11 points. These results suggest that medical VLM distillation should transfer both the teacher's answer preference and its dependence on visual evidence.

36. 【2610.23454】riINR: Unsupervised Atmospheric Turbulence Mitigation with Triple Implicit Neural Representations

链接:https://arxiv.org/abs/2610.23454

作者:Yuka Ogino,Rikuto Otsuka,Yuho Shoji,Takuya Ogawa,Takahiro Toizumi,Atsushi Ito

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:degrades image quality, Atmospheric turbulence degrades, turbulence, blur, turbulence degrades image

备注: Accepted to WACV2027

点击查看摘要

Abstract:Atmospheric turbulence degrades image quality in long-range imaging. The degradation is generally modeled with two spatio-temporally varying components, tilt and blur. Recent unsupervised turbulence mitigation methods have demonstrated the effectiveness of representing a sharp image as an implicit neural representation (INR). However, their tilt and blur representations remain frame-dependent, and the number of optimization parameters grows with the number of input frames. To address this limitation, we propose TriINR, an unsupervised turbulence mitigation method that recovers a sharp image from multiple degraded frames. TriINR represents the sharp image, tilt, and blur as three implicit neural representations. By modeling tilt and blur as spatio-temporal INRs, TriINR achieves frame-count-independent degradation representation and memory-efficient optimization. We further incorporate physical and statistical properties of atmospheric turbulence as constraints on the INRs to improve restoration accuracy. Experiments on synthesized turbulence data with three degradation strengths show that TriINR restores images more robustly across varying turbulence strengths than prior TM methods and achieves the highest accuracy among the evaluated unsupervised methods. Our method also demonstrates robustness on real long-range scenes containing additional non-ideal motion.

37. 【2610.23440】ShadowCast: On-the-Fly Context-Aware Shadow Augmentation for Remote Sensing Image Segmentation

链接:https://arxiv.org/abs/2610.23440

作者:Yechan Kim,Dongho Yoon,Jongmin Joo,JongHyun Park,Moongu Jeon

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:degrading semantic segmentation, remote sensing images, elevated objects alter, remote sensing, remote sensing segmentation

备注:

点击查看摘要

Abstract:Shadows cast by elevated objects alter the spectral appearance and obscure the boundaries of objects in remote sensing images, thereby degrading semantic segmentation performance. Most existing approaches handle shadows as degradations to be detected and removed, requiring additional costs from dedicated networks and shadow-specific annotations. We propose ShadowCast, which takes the opposite approach: it synthesizes shadows and injects them during training for remote sensing segmentation. It extracts masks of elevated objects, such as buildings and trees, directly from the segmentation labels and estimates an image-specific cast-shadow direction cue by probing the brightness around them. It then projects synthetic shadows along the inferred cast-shadow direction, requiring no learned network and no acquisition metadata. Experiments on three widely used remote sensing benchmarks, Vaihingen, Potsdam, and LoveDA, show that ShadowCast consistently outperforms the baseline across diverse state-of-the-art segmentation architectures. Moreover, it brings additional performance gains when combined with standard augmentation and regularization techniques, indicating that stochastic shadow injection serves as a simple and complementary augmentation strategy for remote sensing segmentation.

38. 【2610.23423】Momentum: Persistent Dynamics for Video World Models

链接:https://arxiv.org/abs/2610.23423

作者:Nedko Savov,Stefan Maria Ailuro,Danda Pani Paudel,Yilun Du,Xi Wang,Luc Van Gool

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:generate consistent observations, scene, consistent observations, current camera view, scene dynamics

备注:

点击查看摘要

Abstract:Video world models must capture how a scene evolves beyond the current camera view to generate consistent observations when its content reappears. Existing approaches rely on observation history, static point clouds, or image caches constructed from past frames. These representations are often expensive and, more importantly, cannot update dynamic scene content outside the field of view: generated vehicles and pedestrians may be forgotten after leaving the field of view or reappear in physically inaccurate states. We represent an evolving scene through synchronized videos from reference-camera rigs, each comprising eight cameras that jointly cover the surrounding scene. We connect these rigs in a graph and propagate video generation between neighboring rigs to coordinate scene dynamics across locations and time. We introduce Momentum, a two-stage pipeline: WorldUpdate jointly generates reference-camera videos as a shared memory of scene dynamics, and WorldInteract grounds camera-controlled video generation in this evolving memory, allowing moving content to remain represented outside the target view and reappear consistently. To support training and evaluation, we develop a CARLA pipeline that captures synchronized videos from reference camera rigs and a moving target camera, together with an evaluation framework measuring consistency within the generated world state and the target this http URL on generated street scenes show that grounding target videos in scene dynamics generated by Momentum improves dynamic scene consistency by 126.2% in unseen scenes over static image conditioning, while also improving visual fidelity. Our models and source code will be made publicly available.

39. 【2610.23419】mmPencil: Toward Writing-Style-Independent In-Air Handwriting Recognition via mmWave Radar and Large Vision-Language Model

链接:https://arxiv.org/abs/2610.23419

作者:Yifan Guo,Zhu Wang,Qian Qin,Yangqian Lei,Qiwen Gan,Zhuo Sun,Chao Chen,Bin Guo,Zhiwen Yu

类目:Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)

关键词:small recognition vocabularies, predefined writing planes, In-air handwriting recognition, In-air handwriting, in-air handwriting word

备注: Published in ACM IMWUT, Vol. 9, No. 3, Article 81, 2025; presented at ACM UbiComp 2025. 30 pages

点击查看摘要

Abstract:In-air handwriting recognition based on radio frequency (RF) signals offers a promising solution for human-computer interaction, yet existing methods are often limited by predefined writing planes, constrained writing styles, and small recognition vocabularies. To address these limitations, we propose m^2VLMs, a modality mapping architecture that bridges millimeter-wave (mmWave) radar sensing and large vision-language models (VLMs), and develop mmPencil, a 3D in-air handwriting word recognition system. mmPencil reconstructs 3D handwriting trajectories from mmWave signals using a multi-stage spatial trajectory reconstruction algorithm and maps them into visual representations through a spatial-to-visual mapping algorithm, enabling VLMs to recognize handwriting while reducing sensitivity to writing styles and environmental factors. We collect and release a 3D mmWave handwriting dataset containing 7,664 samples of 200 words from 12 users across 22 writing scenarios. Extensive experiments demonstrate that mmPencil achieves robust word recognition under variations in writing position, range, angle, speed, size, direction, and user movement. It achieves 97.60% accuracy on 200 word classes for seen users and 92.50% zero-shot accuracy on 50 word classes for unseen users, outperforming state-of-the-art baselines.

Comments:
Published in ACM IMWUT, Vol. 9, No. 3, Article 81, 2025; presented at ACM UbiComp 2025. 30 pages

Subjects:

Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.23419 [cs.HC]

(or
arXiv:2610.23419v1 [cs.HC] for this version)

https://doi.org/10.48550/arXiv.2610.23419

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Journalreference:
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 9, 3, Article 81 (September 2025), 30 pages

Related DOI:

https://doi.org/10.1145/3749504

Focus to learn more

            DOI(s) linking to related resources</p>
40. 【2610.23416】GeoReason: Bridging Logical Reasoning and Spatial Fidelity in Remote Sensing Segmentation

链接:https://arxiv.org/abs/2610.23416

作者:Cheng Fan,Han Wu,Tingzhang Luo,Minjing Dong,Yehui Tang,Jianyuan Guo

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal Large Language, Large Language Models, Multimodal Large, Language Models, Large Language

备注:

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) have significantly advanced instruction-driven perception through the "Embedding-as-Mask" paradigm. However, extending this capability to Remote Sensing (RS) reasoning segmentation remains exceptionally challenging under cluttered geographical contexts and extreme scale variations, often leading to Spatial Fidelity Degradation and Target Misidentification. We identify a critical yet underexplored bottleneck: the sequential alienation of the segmentation token [SEG] from its initial visual grounding within the autoregressive generation paradigm. Produced only at the end of long reasoning chains, [SEG] relies on visual evidence that has been progressively diluted by linguistic abstraction and autoregressive noise. This information decay is particularly catastrophic for RS targets with minuscule pixel footprints, where even marginal fidelity loss leads to localization failure. To address these bottlenecks, we propose GeoReason, a novel framework designed to fortify logical deduction and preserve spatial integrity. First, we introduce an Anticipatory Prior mechanism that injects the [SEG] token directly into the initial user query, shifting it from a terminal output to a primary condition. This paradigm shift transforms the token into a persistent spatial anchor, preventing information decay during long-form linguistic inference. Second, we enhance visual reasoning via a Location-aware Chain-of-Thought (CoT) that enforces coarse-to-fine localization using bounding boxes, coupled with a Latent Patch-to-Token Alignment (PTA) Loss that explicitly aligns the latent segmentation token with physical RS textures. Extensive experiments demonstrate that GeoReason consistently outperforms state-of-the-art methods on the Earthreason and RRSIS-D benchmarks. Code is available at this https URL.

41. 【2610.23411】Can We Use Saliency Maps for the Evaluation of Generative Image Models?

链接:https://arxiv.org/abs/2610.23411

作者:Eleonora Ristori,Luca Bindini,Marco Lippi,Paolo Frasconi

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Evaluating generative image, feature extractors optimized, Evaluating generative, models remains challenging, human realism perception

备注:

点击查看摘要

Abstract:Evaluating generative image models remains challenging, as commonly used metrics depend on fixed pretrained feature extractors optimized for different tasks that do not always align with human realism perception across datasets and model families. To address this limitation, we investigate a human-inspired evaluation framework that avoids representations learned for unrelated tasks. Specifically, we train a generator-specific classifier to distinguish real images from samples produced by a given model and analyze its decisions using saliency maps. Across diverse benchmarks, we observe that these classifiers learn generator-specific artifacts rather than a universal notion of "fakeness", exhibiting strong accuracy and limited cross-generator transfer. This makes saliency analysis particularly informative: the resulting attribution maps highlight visual cues and structural irregularities characteristic of each model's outputs. By combining classification accuracy and saliency information, we obtain a composite score aligned with human judgments, without relying on large pretrained backbones and using only real and generated samples from the evaluated model.

42. 【2610.23408】LithoWorld: An Endpoint World Model for Lithography Process-Window Recovery

链接:https://arxiv.org/abs/2610.23408

作者:Botong Zhao,Fang Yu,Xinyuan Chen,Yue Lu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Lithography process drift, scanning electron microscopy, producing unqualified scanning, unqualified scanning electron, Lithography process

备注:

点击查看摘要

Abstract:Lithography process drift can move a fabricated pattern outside its process window, producing unqualified scanning electron microscopy (SEM) morphology. We present LithoWorld, an endpoint world model for SEM-guided parameter recovery. Interior representative targets jointly determine qualified reference appearance and correction supervision. A causal predictive branch aligns currentimage features with endpoint representations, while a conditional flow policy generates a two-dimensional correction as an action chunk. The model learns from 173 groups of measured SEMs organized as focus-exposure maps, preserving unmeasured cells as unknown. On 200 test pairs from the 73-group subset, LithoWorld achieves 88.5% qualified-region success and 46.0% interior success, exceeding the strongest comparison method by 2.5 and 6.0 percentage points, respectively. Ablations separate the effects of target selection, endpoint alignment, and output parameterization. Qualitative SEM retrieval illustrates recovery to qualified interiors without requiring exact reference-coordinate matching.

43. 【2610.23377】FloodVLM-Pix: Language-Guided Pixel-Level Flood Understanding

链接:https://arxiv.org/abs/2610.23377

作者:Chengyang Zhang,Zhihao Wang,Zhiyu Long,Xueqian Wang,Quanming Yao,Wei Wu,Gang Li

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:climate change intensifies, flood, flood understanding, accurate flood understanding, making accurate flood

备注:

点击查看摘要

Abstract:As climate change intensifies, floods are becoming more frequent and destructive, making accurate flood understanding an urgent priority. However, existing vision-language models perform poorly on flood-related tasks, suffering from attentional bias and inaccurate descriptions of flood magnitude. To bridge this gap, we construct the first large-scale remote sensing flood multi-modal benchmark that supports language-level flood understanding and pixel-level flood segmentation. The benchmark contains 131,200 flood image patches and corresponding 443,100 textual descriptions for flood severity and evolution. Based on this benchmark, we propose FloodVLM-Pix, a language-guided pixel-level flood understanding model that includes a flood prior module and a multi-temporal flood pixel decoder to achieve accurate flood understanding. The flood prior module automatically distills sub-region flood spatial priors and inputs priors into FloodVLM-Pix, solving the attentional bias problem in flood language understanding. The flood pixel decoder introduces a novel general-specific feature fusion mechanism to address performance degradation caused by interference (e.g., clouds or mountain shadows) during flood segmentation. Experiments on FloodVL-Pix demonstrate that FloodVLM-Pix improves both flood description quality and pixel-level flood segmentation performance compared with state-of-the-art VLMs and flood segmentation models. Our code and data will be released at this https URL.

44. 【2610.23374】MOSS-Image Technical Report

链接:https://arxiv.org/abs/2610.23374

作者:MOSI.AI

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Recent closed-source image, Recent closed-source, produce diverse visual, information-dense graphics, closed-source image generation

备注: 35 pages. GitHub: [this https URL](https://github.com/OpenMOSS/MOSS-Image)

点击查看摘要

Abstract:Recent closed-source image generation systems can produce diverse visual content from simple compositions to information-dense graphics, yet open-weight text-to-image models still struggle with dense text and intricate layouts. To narrow this gap, we introduce MOSS-Image, an open generation system that combines high-fidelity visual synthesis with intent-aware composition. First, we pretrain a 5B single-stream diffusion transformer (DiT) from scratch with a carefully designed recipe, enabling bilingual long-form text rendering and precise layout control. Second, we develop an intention-aware agentic prompt enhancement (PE) module that translates diverse user requests into detailed content and layout specifications. Together, they enable MOSS-Image to generate text-rich and layout-coherent images. We further introduce LongLongTextBench (LLTB) for evaluating long-form English and Chinese text rendering, and RealLayoutArena (RLA) for end-to-end layout-rich generation. MOSS-Image achieves state-of-the-art performance among open-weight models on LLTB, with an average text coverage of 96.3%. On RLA, MOSS-Image ranks second in the end-to-end system comparison, while its backbone ranks first among generators evaluated with shared enhanced prompts. We will release the model, training recipe, and evaluation framework to support further research and promote the text-to-image community.

45. 【2610.23360】UniPolar: Joint Image and Polarimetric Restoration under Compound Degradations via Physical Consistency Learning

链接:https://arxiv.org/abs/2610.23360

作者:Yang Jin,Guangyu Guo,Linghao Shen,Binglu Wang

类目:Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

关键词:reliable polarimetric quantities, aims to recover, quantities from degraded, image, Stokes

备注: 13 pages, 11 figures

点击查看摘要

Abstract:Polarimetric image restoration aims to recover polarization angle images and reliable polarimetric quantities from degraded observations. Beyond visual fidelity, it also requires preserving the physical relationships underlying reliable polarimetric estimation. However, existing methods typically address either device- or environment-induced degradations in isolation, limiting their applicability to color polarization filter array (CPFA) imaging, where both often coexist. Such compound degradations jointly perturb image intensities and cross angle polarization differences. Consequently, improved image fidelity alone does not necessarily ensure accurate Stokes, DoLP, and AoLP recovery. To address this challenge, we propose UniPolar, a coupled Image Stokes framework for joint image polarimetric restoration from compound-degraded CPFA observations. Specifically, UniPolar employs two complementary streams to reconstruct four polarization-angle images and directly predict Stokes difference components. To coordinate these streams, Degradation Conditioned Cross Domain Interaction combines Dual Domain Frequency Interaction for frequency selective evidence exchange with Degradation Conditioned Modulation for condition adaptive feature correction. Furthermore, at the output level, Image Stokes Physical Consistency Learning aligns image derived and directly predicted Stokes components while regularizing angular fidelity and the physical feasibility of DoLP. On the compound-degradation benchmark, UniPolar achieves average image and DoLP PSNR of 31.522 dB and 24.097 dB, respectively, with an average AoLP error of 16.833 degree. These results underscore the importance of jointly considering visual fidelity and polarimetric reliability, offering a physically grounded perspective on learning based restoration under compound degradations.

46. 【2610.23356】STC-MGNet: Spatial-Temporal-Channel Attention-Enhanced Multimodal Graph Network for Pedestrian Intention Prediction

链接:https://arxiv.org/abs/2610.23356

作者:Yuanzhe Li,Meng Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:crossing intentions plays, Accurate prediction, autonomous driving, plays a critical, critical role

备注:

点击查看摘要

Abstract:Accurate prediction of pedestrian crossing intentions plays a critical role in enhancing the safety of pedestrian-vehicle interactions in autonomous driving. However, effectively capturing subtle spatiotemporal patterns in pedestrian pose sequences and integrating complementary visual and ego-vehicle motion information remain challenging. This paper proposes a spatial-temporal-channel attention-enhanced multimodal graph network (STC-MGNet) for pedestrian crossing intention prediction. STC-MGNet introduces a spatial-temporal-channel (STC) attention-enhanced pose graph encoder to learn discriminative representations from pedestrian pose sequences. Three parallel attention branches selectively emphasize informative skeletal joints, observation frames, and feature channels, with their outputs integrated through learnable fusion weights. To leverage complementary visual and ego-vehicle motion information, a multi-stage cross-modal channel modulation mechanism is introduced to adaptively refine pose representations through modality-specific channel gating at successive graph encoding stages. Experimental results demonstrate that STC-MGNet achieves accuracy rates of 70%, 87%, and 88% on the JAADbeh, JAADall, and PIE datasets, respectively, outperforming several representative baseline methods. Ablation experiments further highlight the complementary contributions of visual and ego-vehicle motion information to prediction performance.

47. 【2610.23324】CatchUp: Depth-Aware Re-Admission of Visual Tokens for Efficient Large Vision-Language Models

链接:https://arxiv.org/abs/2610.23324

作者:Eunju Park,Uiwon Hwang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Large Vision-Language Models, incurring substantial computation, Large Vision-Language, repeatedly process hundreds, incurring substantial

备注: WACV 2027. Code: [this https URL](https://github.com/pej0918/CatchUp)

点击查看摘要

Abstract:Large Vision-Language Models (LVLMs) repeatedly process hundreds of visual tokens across decoder layers, incurring substantial computation and memory costs. Existing inference-time visual token pruning methods often irreversibly remove low-ranked tokens, although the set of visual tokens receiving high query-conditioned attention can change across decoder depth. Recoverable routing preserves skipped tokens for later reconsideration, but re-admits them with stale representations after bypassing intermediate transformations. We further find that replacing stale re-admitted states with their current-depth oracle states from a full-token reference trajectory substantially improves grounding performance. We therefore propose CatchUp, a training-free framework for depth-aware visual-token re-admission. CatchUp repeatedly re-evaluates query-conditioned visual relevance, processes only selected visual tokens through each decoder interval, and preserves deferred tokens for later re-admission. Upon re-admission, CatchUp approximates missed representation evolution using reference-to-current transition signals from semantically and spatially related visual tokens. Across three referring-expression grounding datasets and six multimodal benchmarks, CatchUp achieves the highest average relative retention in both benchmark groups at 64-, 128-, and 192-token budgets. At a 64-token budget with 88.9% fewer active visual tokens, CatchUp retains 92.17% of the full model's performance on average across six multimodal benchmarks while reducing end-to-end latency by 8.0%. Code is available at this https URL

48. 【2610.23302】Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction

链接:https://arxiv.org/abs/2610.23302

作者:Wajeeha Tahir,Anna Tegon,Lionnus Kesting,Gamze İslamoğlu,Kristóf Karacs,Luca Benini,Thorir Mar Ingolfsson

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:requires visual grounding, prediction requires visual, Spatial context prediction, identify vacant regions, context prediction requires

备注: 17 pages, 6 figures, 3 tables

点击查看摘要

Abstract:Spatial context prediction requires visual grounding and spatial reasoning to identify vacant regions relative to objects in a scene. Spatial relationships and physical constraints remain challenging for large vision-language models (VLMs). Recursive reasoning has demonstrated strong performance on discrete and abstract reasoning tasks, motivating its use for improving spatial context prediction in natural images. Weight sharing enables higher accuracy with a small trainable parameter count. We introduce Spatial-TRM, a compact recursive model with frozen vision-language features, a convex region decoder, and just 11.2M trainable parameters. This weight-tied reasoner supports six spatial relationships, three reference frames, and open-vocabulary anchor objects. On the RoboSpatial-Home benchmark, Spatial-TRM achieves 29.51% context accuracy, a gain of 9.02 percentage points (44.0% relative) over a separately trained single-step model with the same parameter count. Including the frozen encoders, the model has 877.8M total parameters, approximately $15\times$ fewer than the reported 13B size of RoboPoint. These results show that repeated refinement improves spatial context prediction from pretrained vision-language features at a fixed trainable parameter count on this benchmark.

49. 【2610.23297】FlashReFocus: Interactive Image Refocusing in Seconds

链接:https://arxiv.org/abs/2610.23297

作者:Ching-Heng Cheng,Chia-Ming Lee,Ming-Ching Chang,Xin Li,Yu-Lun Liu,Chih-Chung Hsu

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV)

关键词:Single-image refocusing, focal plane, Single-image, focal, edit

备注: 38 pages (8 main + appendix), 47 figures, 16 tables. Project page: [this https URL](https://ming053l.github.io/FlashReFocus/) Code: [this https URL](https://github.com/ming053l/FlashReFocus)

点击查看摘要

Abstract:Single-image refocusing changes the focal plane and depth of field of a photograph after capture. It is inherently interactive: users try many focal points and blur strengths on one image, so each edit should be fast and change only the blur. Recent generative methods, however, rerun large diffusion models for every edit. We observe that the two sub-problems differ in kind: recovering the all-in-focus image is ill-posed and needs a generative prior, whereas rendering blur is largely determined by depth and the focal plane. We therefore propose FlashReFocus, which runs diffusion once per photograph and renders every edit with a lightweight network. To address the ill-posed restoration, a one-step diffusion deblurrer with a decoder refiner recovers fine detail efficiently while balancing fidelity and perceptual quality. For precise control, the renderer is conditioned on an explicit defocus map and uses defocus-bias attention, which lets pixels at similar defocus share information without interference from pixels at other depths; in-focus content stays unchanged, and editing the map yields tilt-shift and two focal planes. To further test generalization to unseen cameras, we collect 3CReal, a three-camera benchmark of 89 pairs. FlashReFocus achieves the best perceptual fidelity for zero-shot bokeh rendering on EBB! and 3CReal, refocuses 148.3x faster than GenRefocus, and takes about half a second per further edit, 462x faster.

50. 【2610.23294】he Optimal Ranking Tradeoffs Between Two Ranking Scores in Two-Class Classification

链接:https://arxiv.org/abs/2610.23294

作者:Sébastien Piérard,Adrien Deliège,Marc Van Droogenbroeck

类目:Performance (cs.PF); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:class-specific F-scores, developing machine learning, Cohen kappa, machine learning methods, true negative rate

备注:

点击查看摘要

Abstract:The accuracy, true negative rate (negative class recall), true positive rate (positive class recall), negative predictive value (negative class precision), positive predictive value (positive class precision), class-specific intersections over unions, class-specific F-scores, Cohen's kappa, and balanced accuracy are scores that one intuitively wants to maximize when developing machine learning methods. However, they lead to different rankings of such methods. So, how can we establish a ranking that is an optimal tradeoff between any pair of these scores? It turns out that all these scores are special cases of ranking scores: a continuum of scores parameterized by the relative importance values assigned to the true negative, false positive, false negative, and true positive outcomes. Since all these scores are known to induce meaningful rankings, we seek the optimal tradeoffs among them. We consider the tradeoff between two scores to be optimal when it minimizes the Fréchet variance regarding the Kendall distance (also known as the bubble-sort distance) between rankings. For any given set of classifiers to rank, the optimal tradeoff lies at the center of the shortest (geodesic) path on the manifold of all rankings induced by the ranking scores. However, in the parameter space of the ranking scores, it is rarely achieved by averaging the importance values corresponding to the initial scores. In this paper, we present an exact analytical solution for determining a ranking score that is an optimal tradeoff for any given pair of initial scores, in the common case where the class priors are the same for all compared performances. We also experimentally investigate what happens when performance follows some distributions with fixed priors.

51. 【2610.23287】I2V-DETACH: Source Grounding Detachment for Unauthorized Image-to-Video Generation

链接:https://arxiv.org/abs/2610.23287

作者:Chanhui Lee,Yeonghwan Song,Yewon Kang,Jeany Son

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:accessibility raises risks, Recent diffusion models, advanced image-conditioned video, Recent diffusion, advanced image-conditioned

备注: NeurIPS 2026

点击查看摘要

Abstract:Recent diffusion models have advanced image-conditioned video generation, but their accessibility raises risks of unauthorized manipulation. Image immunization has emerged as a promising defense for Image-to-Video (I2V) protection, yet existing methods often rely on degrading visual quality or temporal coherence. In this work, we revisit I2V immunization as reducing source-content preservation, shifting the focus from output degradation to weakening source-conditioned content propagation. To this end, we propose I2V-DETACH, an image immunization method that prevents unauthorized I2V generation through source grounding detachment. I2V models preserve source content by propagating source-image cues into video latents during denoising. Accordingly, I2V-DETACH disrupts this process in two complementary ways: it suppresses source-video grounding to reduce source cue propagation, and strengthens intra-video interactions to shift denoising toward video-side dynamics with reduced reliance on the source image. To obtain informative optimization signals, we initialize auxiliary video latents with source-oriented states that remain within the source-conditioned generation regime while deviating from source-preserving trajectories. Extensive experiments across diverse diffusion architectures show that I2V-DETACH substantially reduces source-content preservation, improves over prior immunization methods, and exhibits strong black-box transferability.

52. 【2610.23279】Xiaomi-Lens-0 Technical Report

链接:https://arxiv.org/abs/2610.23279

作者:Pei Fu,Yike Liu,Yue Sun,Hanmo Wang,Xiuwen Xi,Ruoceng Zhang,Shaojie Zhang,Chao Jiang,Hang Li,Bingrui Liu,Zhenbo Luo,Heng Qu,Changjian Xu,Ming Xu,Jian Luan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal large language, Multimodal large, fine-grained region understanding, struggle with fine-grained, Multimodal

备注:

点击查看摘要

Abstract:Multimodal large language models (MLLMs) answer questions about whole images well, yet they still struggle with fine-grained region understanding. A key reason is that text-only supervision never specifies which regions support an answer. To close this gap, we present Xiaomi-Lens-0, a 4B MLLM built on Qwen3.5 that predicts masks from its own visual representations. Specifically, a lightweight decoder combines vision-encoder patch features with the language model's mask-token states, termed visual latents, so that mask supervision reaches the shared backbone without an additional segmentation encoder. Because each latent decodes to a mask, the model can interleave reasoning with region-specific latents and thus think with visual latents, while grounded reasoning traces supervise the intermediate regions referenced during chain-of-thought. As a result, across all eight RefCOCO, RefCOCO+, and RefCOCOg splits, Xiaomi-Lens-0 gains 5.6 points on average over Qwen3.5 in referring comprehension and achieves the highest segmentation cIoU among compared models. Moreover, it surpasses Qwen3.5 across all perception benchmarks. Homepage: this https URL

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2610.23279 [cs.CV]

(or
arXiv:2610.23279v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2610.23279

Focus to learn more

              arXiv-issued DOI via DataCite</p>
53. 【2610.23269】Agentic Image Generation in the Wild

链接:https://arxiv.org/abs/2610.23269

作者:Yifan Li,Bowen Qin,Kun Zhou,Haochen Zhao,Zikang Liu,Zheng Li,Minsheng Hao,Yuhao Cheng,Haosheng Zou,Jeff Chen,Wayne Xin Zhao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:image generation pairs, image generation, extending generation, generation, generation pairs

备注:

点击查看摘要

Abstract:Agentic image generation pairs an image generator with a search agent that retrieves references from the web, extending generation beyond the generator's training data. Real-world requests, however, often concern entities that appeared only days ago. We call this setting Image Generation in the Wild. In this setting, the web offers limited visual evidence, search results are crowded with easily confused entities, and the target is rarely shown on its own. To study this setting, we build an automated pipeline that synthesizes prompts from recent headlines and keeps only those whose real search results are highly confusing, yielding requests that are hard to solve yet natural to ask. With it, we construct Savanna, a benchmark of 500 prompts across 16 subcategories. On Savanna, even harness frameworks built on the frontier models retrieve a correct reference for only about half of the prompts. We then propose Locate-Corroborate-Isolate, a paradigm in which the agent first pins down the target's identity through text search, then verifies candidate images against multiple sources, and finally crops a clean reference for the generator. Trained on 15K trajectories that follow this paradigm, Ranger-8B achieves a search score of 67.2, outperforming harnesses equipped with frontier models. It also achieves the best generation quality with every generator we test, and surpasses prior agentic methods on other image generation benchmarks. We release the pipeline, benchmark, training data and model at this https URL.

54. 【2610.23263】SCALE: Improving Guidance-Free Visual Generation via Self-Contrastive Alignment for Likelihood Estimation

链接:https://arxiv.org/abs/2610.23263

作者:Jiwan Hur,Dong-Jae Lee,Dongyeun Lee,Gyojin Han,Junmo Kim

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:substantial sampling overhead, incurs substantial sampling, improving sample quality, Classifier-free guidance, sampling overhead

备注: Accepted to NeurIPS 2026. Project page: [this https URL](https://jiwanhur.github.io/SCALE/)

点击查看摘要

Abstract:Classifier-free guidance (CFG) is essential for improving sample quality in visual generation, but it incurs substantial sampling overhead. Existing guidance-free approaches halve this cost by approximating the CFG with a single model inference, but their performance is bounded by the CFG and inherits its limitations. In this paper, we propose self-contrastive guidance (SCG), which contrasts the model's prediction on real and self-generated samples to obtain a direct, model-based signal that pushes generation toward the true data manifold. Integrating SCG into the standard likelihood objective via reparameterization yields Self-Contrastive Alignment for Likelihood Estimation (SCALE), a guidance-free training framework that produces SCG-enhanced predictions in a single forward pass. Across class-conditional and text-to-image generation on diffusion and autoregressive models, SCALE consistently outperforms CFG-mimicking guidance-free baselines and improves further when combined with DPO, demonstrating that the self-contrastive signal yields gains complementary to both CFG and preference-based fine-tuning.

55. 【2610.23262】Expand-and-Prune: Test-Time Candidate-Space Adaptation for End-to-End Autonomous Driving

链接:https://arxiv.org/abs/2610.23262

作者:Fabian Schmidt,Karol Fedurko,Markus Enzweiler,Abhinav Valada

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:driving planners reason, finite set, candidate set, planners reason, set

备注: Accepted to IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2027

点击查看摘要

Abstract:Candidate-based end-to-end driving planners reason over a finite set of trajectory hypotheses. However, for sparse planners, a limited candidate set may provide insufficient support for scene-relevant maneuvers, while fixed downstream candidate budgets do not account for prediction uncertainty. To address these challenges, we introduce Expand-and-Prune, a test-time framework that jointly adapts candidate support and capacity without updating learned parameters. The framework expands the native candidate set using semantic driving intent and temporally propagated predictions and then uses uncertainty in intermediate trajectory scores to adaptively prune the resulting candidates. Across four heterogeneous candidate-based planners and four benchmarks, Expand-and-Prune consistently improves planning performance. It achieves state-of-the-art results on LangAuto, increasing the Driving Score from 68.2 to 75.9, while providing further improvement on Bench2Drive, Fail2Drive, and NAVSIMv2, with particularly strong improvements in out-of-distribution scenarios. Moreover, in its full instantiation, 72.5% of selected trajectories originate from the newly introduced intent-guided or temporal candidates, confirming that candidate-space expansion provides useful hypotheses beyond those generated natively by the planner. The code is available at this https URL.

56. 【2610.23250】LonGaussian: Tracking Foundation Priors for Long-Context Feedforward Gaussian Reconstruction

链接:https://arxiv.org/abs/2610.23250

作者:Zhoufeng Xie,Guanjun Wu,Shuai Zhang,Xinggang Wang,Wenyu Liu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Reconstructing high-quality, embodied intelligence, videos is essential, essential for robotic, robotic perception

备注:

点击查看摘要

Abstract:Reconstructing high-quality, renderable 3D scenes from long videos is essential for robotic perception and embodied intelligence. Many feed-forward Gaussian reconstruction methods rapidly predict 3D scenes from a small set of images, but extending them to longer sequences presents two bottlenecks: jointly processing all views increases GPU memory requirements, while accumulating pixel-aligned predictions redundantly represents the same surfaces and increases storage and rendering costs. We present LonGaussian, a streaming feed-forward framework that reconstructs compact, globally renderable Gaussian scenes from long image sequences with known intrinsics and unknown camera poses. Built on a pretrained streaming 3D reconstruction backbone, LonGaussian decodes long-context geometric features into dense Gaussians. Within each chunk, multi-frame point tracks link repeated observations of the same surface and guide a learned merger to consolidate the corresponding Gaussian predictions. Rendered-depth consistency filtering further suppresses Gaussians from other chunks that incorrectly occlude locally reconstructed surfaces. On DL3DV and RealEstate10K benchmarks, LonGaussian improves novel-view rendering quality while using substantially fewer Gaussians than the evaluated feed-forward baselines.

57. 【2610.23248】Can the Parts Fool the Test? Counterfactual Pairing Cycles for Relational OOD

链接:https://arxiv.org/abs/2610.23248

作者:Yibo Zhou,Yirong Xiang

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:errors are easy, evaluate cleanly, hard to evaluate, caption, image

备注: Accepted at Neurips 2026

点击查看摘要

Abstract:Relational out-of-distribution errors are easy to describe and hard to evaluate cleanly. An image may be natural, a caption may be fluent, and all mentioned objects may be common, yet the caption may describe the wrong relation in the image. Many evaluations intended to test this behavior can be solved without checking the pairing at all, because negatives differ in caption style, template, length, object frequency, or image statistics. We propose counterfactual pairing cycles, a blocked evaluation primitive that reuses the same two images and the same two captions on both sides of the comparison, changing only which image is paired with which caption. This makes image-only, text-only, and additive component shortcuts cancel exactly in finite samples. The same contrast also gives a training loss for relational outlier exposure and a diagnostic for bilinear vision-language scores. Across synthetic controls, GQA, and COCO, cycles separate coarse image-caption matching from directional role-binding failures, while also identifying geometric size relations that remain strongly visible in global features. In a shortcut-contaminated COCO outlier-exposure stress test, a model selected by a near-perfect shortcut validation AUROC retains substantial relational signal but remains below cycle training on exact cycles; cycle training improves CycleAcc from 0.882 to 0.927. The main lesson is simple: to test whether a model understands a pairing, the benchmark should keep the parts fixed, change the pairing, and ask only about coupling. The official implementation is available online.

58. 【2610.23238】Kingfisher: Fast Personalized Visual Autoregressive Generation via Scale-Aware Prompt-Conditioned Scale Decomposition

链接:https://arxiv.org/abs/2610.23238

作者:Dinh-Khoi Vo,Akihiro Sugimoto,Minh-Triet Tran,Trung-Nghia Le

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Personalized image generation, textual embeddings, LoRA modules, Personalized image, extensively studied

备注:

点击查看摘要

Abstract:Personalized image generation has been extensively studied in diffusion models, often relying on subject-specific optimization of model weights, textual embeddings, LoRA modules, or adapters. In this work, we explore a different direction for fast personalization in visual autoregressive models. Our key observation is that a short prefix of early autoregressive scale codes is sufficient to strongly determine both object structure and global appearance, while later scales primarily refine the established generation trajectory. Based on this insight, we introduce Kingfisher, a model-tuning-free framework that decomposes early residual scale codes into content- and style-related components through prompt-conditioned scale-code subspaces. Given two real images, Kingfisher first decomposes their early scale codes, then recomposes the content components of one image with the style components of the other into a compact semantic prefix. The frozen generator subsequently predicts the remaining scales through bitwise self-correction for coherent refinement. Experiments on CSD-100 show that Kingfisher achieves strong content preservation and the highest style and text alignment among the evaluated methods, while reducing pair-specific preparation time by approximately 54x compared with diffusion-based methods and 7.5x compared with VAR-based alternatives. These results demonstrate that effective personalization can be achieved by directly manipulating the native scale-space representation of a frozen visual autoregressive generator.

59. 【2610.23237】X-Splat: Unified Gaussian Splatting for Joint RGB and X-ray 3D Reconstruction

链接:https://arxiv.org/abs/2610.23237

作者:Wangze Xu,Chu Zhou,Mae Yamaguchi,Linrui Dai,I-Chao Shen,Takashi Ijiri,Imari Sato

类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词:connecting external appearance, Jointly reconstructing RGB, internal structure, connecting external, complete understanding

备注: SIGGRAPH Asia 2026 Conference Papers. 19 pages (12 main paper + 7 supplementary), 13 figures. Project page: [this https URL](https://zezeaaa.github.io/X-Splat/)

点击查看摘要

Abstract:Jointly reconstructing RGB and X-ray provides new insights by connecting external appearance with internal structure, enabling a more complete understanding of real-world objects than single modality. Yet existing methods train separate models per modality and suffer from redundant geometry, alignment artifacts, and loose coupling that limits cross-modal insight discovery. We propose a unified representation in which all Gaussian primitives share a single set of geometric parameters, with only surface-proximal primitives additionally carrying appearance attributes. We perform cross-modal registration through clean multi-view stereo and X-ray geometric proxies instead of aligning two sets of optimized Gaussians, improving alignment stability. We then jointly optimize the unified representation via supervision from both modalities, complemented by a surface-depth consistency loss derived from X-ray geometry to guide RGB reconstruction. Experiments on the InsideOut dataset and our Flower Insect dataset show that our framework achieves more robust cross-modal alignment, higher RGB rendering quality without compromising X-ray reconstruction, and a more compact representation than maintaining two independent geometries.

60. 【2610.23230】RAP: A Dataset for Paper-to-Poster Generation via Declarative Markup from Human-Crafted Exemplars

链接:https://arxiv.org/abs/2610.23230

作者:Haonan Han,Yukang Lin,Minliang Lin,Haoxian Tan,Jun-Yan He,Rui Yang,Zhi-Qi Cheng,Jie Hu,Guanglu Wan,Xiu Li

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:visual coding, visual coding task, single page, exercises summarization, visual coding remain

备注:

点击查看摘要

Abstract:Making a conference poster is visual coding in miniature: an entire paper must be compressed onto a single page, which exercises summarization, visual design, and code implementation at once, using nothing beyond the paper itself. Yet benchmarks for this task in the context of visual coding remain scarce: existing resources are small and annotated only with layout boxes, so evaluation must fall back on VLM-as-judge or human checklists rather than objective render-and-compare, and the generation methods they support design layouts from scratch, leaving human-crafted posters unusable as either a retrievable design library or as verified supervision. We introduce RAP (Reconstruct A Poster), a dataset and benchmark for paper-to-poster generation as a visual coding task. RAP contains 25K+ verified paper-poster pairs from various machine learning conferences held between 2022 and 2026, annotated with a three-level content taxonomy, plus a held-out benchmark of 150 test papers each paired with its human poster. A fully automated derendering pipeline turns each poster into styled HTML/CSS of typed, refillable slots, so every sample is a paper-poster-markup triplet verifiable by rendering against the source poster. The corpus serves both inference and training: PosterRAG, a training-free multi-agent pipeline, retrieves an exemplar and refills its slots without touching layout or styling, while an SFT+RL recipe trains a dedicated model from the same triplets. An online demo is available at this https URL.

61. 【2610.23214】MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025

链接:https://arxiv.org/abs/2610.23214

作者:Andreas Goulas,Damianos Galanopoulos,Ioannis Patras,Vasileios Mezaris

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Ad-hoc Video Search, Video Question Answering, CERTH-ITI team, Video Search, Ad-hoc Video

备注: Proc. TREC 2025 Workshop, Dec. 2025

点击查看摘要

Abstract:This paper presents the overview of the runs related to the Ad-hoc Video Search (AVS) and Video Question Answering (VQA) tracks of TRECVID 2025 on behalf of the CERTH-ITI team. For the AVS track, we introduce a two-stage framework built on foundation models. In the first stage, multiple vision-language models (VLMs) encode both the input query, augmented through LLM-generated rephrasings, and the candidate video shots, producing weighted similarity scores for initial retrieval. In the second stage, we utilize a Multimodal-LLM(MLLM)-based reranking module that evaluates the semantic alignment between each shot among the top-N highest-ranked ones and the original query, generating updated relevance scores for reordering these shots. This MLLM-driven reranking significantly improves contextual matching and produces more accurate final rankings without requiring any model training. Regarding the VQA track, we fine-tune an audio-visual MLLM model on the provided TRECVID training dataset and we implement an inference-time scaling technique to enhance the multimodal understanding capabilities of the MLLM. For the open-ended Answer Generation (AG) task, we aggregate multiple model responses per question via a majority vote. The responses are generated with greedy sampling from different random frame subsets of the video and they are ranked based on the number of votes. For the Multiple-Choice (MC) task, instead of voting, we use mean pooling on the logits assigned by the fine-tuned model to each candidate response. Through the combination of fine-tuning and frame subset ensembling we achieve the highest score across 3 metrics in the VQA AG task and the second highest in the VQA MC task.

62. 【2610.23172】Knowledge-Guided Distributional Prompt Learning with Visual Hierarchy for Zero-Shot Anomaly Detection

链接:https://arxiv.org/abs/2610.23172

作者:Jiyul Ham,Seongho Yoon,Yonggon Jung,Sangjae Lee,Jun-Geol Baek

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:previously unseen classes, Zero-shot anomaly detection, Zero-shot anomaly, aims to detect, auxiliary images

备注: 22 pages, 12 figures

点击查看摘要

Abstract:Zero-shot anomaly detection (ZSAD) aims to detect anomalies in previously unseen classes using auxiliary images, with applications such as industrial visual inspection and medical imaging. Recent vision-language-model-based approaches improve ZSAD by aligning textual and visual representations, while distributional prompting further models prompt variability for unseen categories. However, existing methods do not explicitly combine normality-referenced distributional modeling with hierarchy-specific prompt specialization, limiting their ability to model anomalous semantics relative to normality while addressing both image-level detection and fine-grained localization. We propose Hierarchical Knowledge-Guided Distributional Prompt Learning (HiDist), a normality-referenced hierarchical distributional prompt framework for ZSAD. HiDist models each prompt token with a diagonal Gaussian distribution and generates stochastic prompt variations through Monte Carlo sampling. Rather than learning normal and anomalous distributions independently, anomalous prompt distributions are parameterized as deviations from learned normal references, explicitly encoding their dependency. The resulting distributions are specialized into global and local representations for image-level detection and pixel-level localization, respectively, while an adapted global visual representation guides hierarchical alignment. Experiments on seven industrial and medical datasets demonstrate strong cross-dataset performance across anomaly detection and localization tasks. Extensive ablation and representation analyses further support the effectiveness of the proposed distributional modeling and hierarchy-specific representation learning.

63. 【2610.23144】From GAN-Based Models to GPT-5: A Taxonomy-Guided Study of Human Performance in Detecting Deepfake Face Images

链接:https://arxiv.org/abs/2610.23144

作者:Zhiqing Guo,Lixin Jia,Luning Sun,Xiaowei Chen,Guofeng Yu,Liejun Wang,Gaobo Yang,David Stillwell,Thorsten Holz,Shujun Li

类目:Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Human-Computer Interaction (cs.HC)

关键词:multimodal large language, deepfake face images, deepfake face, large language models, detecting deepfake face

备注:

点击查看摘要

Abstract:Generative models for deepfakes have rapidly evolved from GAN-based architectures to diffusion models and multimodal large language models (MLLMs). However, empirical research on human performance in detecting deepfake face images has not kept pace. It remains unclear if (and how) detection performance varies across generative models and whether model-specific training improves detection more effectively than general-purpose training. In this paper, we propose the \emph{Deepfake Face Artifact Taxonomy} (DFAT), a cross-model taxonomy of human-recognizable visual artifacts in deepfake face images, based on which we build both general-purpose and model-specific training materials. Through an online experiment ($n = 524$), we examined human performance in detecting deepfake face images and evaluated training efficacy across five representative generative models: three GAN-based, one diffusion-based, and one MLLM (GPT-5). Our results show that participants' detection accuracy was strongly model-dependent and that images generated by more recent and advanced models were not necessarily harder to detect. After training, participants achieved significant performance gains across most conditions, and their improvement varied by model. Notably, model-specific training generally yielded greater numerical gains than general-purpose training. In a five-month follow-up test ($n = 342$), we observed no significant decline in detection accuracy and no significant increase in perceived stress. Overall, our findings provide actionable insights for designing effective, sustainable, and targeted training programs to counter the growing threat posed by deepfakes.

64. 【2610.23125】Reliability-Consistent Appearance Modeling for RGB-Infrared Multi-Object Tracking

链接:https://arxiv.org/abs/2610.23125

作者:Bingyang Wang,Jiazuo Yu,Lu Zhang,Lihe Zhang,Huchuan Lu,You He

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Recent RGB-infrared multi-object, RGB-infrared multi-object tracking, multimodal information integration, Recent RGB-infrared, substantially improved cross-modal

备注: 10 pages, 6 figures. Submitted to IEEE Transactions on Multimedia

点击查看摘要

Abstract:Recent RGB-infrared multi-object tracking (MOT) methods have substantially improved cross-modal representation learning and multimodal information integration. However, most existing methods compress RGB and infrared evidence into a unified descriptor. When one modality is temporarily degraded, the tracker can no longer regulate its contribution separately; unreliable evidence may distort association and contaminate appearance memory. We therefore propose RCA-MOT, a reliability-consistent appearance modeling framework that preserves cross-modal complementarity while retaining post-representation evidence controllability. RGB-specific, infrared-specific, and fused identity representations are maintained as jointly accessible appearance states. For each detection, a simple training-free target-scene estimator produces branch-wise appearance reliability used across the two temporal roles of appearance: relative reliability regulates different identity branches, absolute reliability calibrates borderline candidates near the ReID acceptance boundary, and the same branch-wise reliability controls how strongly matched descriptors update historical appearance memory. The individual components are intentionally simple, focusing evaluation on reliability-controllable appearance organization rather than elaborate fusion or learned reliability-estimation modules. RCA-MOT sets new SOTA results on VT-MOT and UniRTL, improving the previous best HOTA by 5.402/6.075 points and IDF1 by 11.549/12.789 points, respectively, while post-hoc analyses further validate reliability as an informative control signal. Code will be released upon acceptance.

65. 【2610.23121】Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation

链接:https://arxiv.org/abs/2610.23121

作者:Xuanyu Liu,Hongyan Feng,Miao Pan,Sunlai Chen,Lizhou Liang,Bing Sun,Wenqi Zhang,Xuhong Zhang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:language requires strong, natural language requires, Generating complete, textbf, requires strong

备注:

点击查看摘要

Abstract:Generating complete, coherent, and usable 3D indoor scenes from natural language requires strong \textbf{design intelligence}: the ability to design high-quality scenes and critique their quality. However, existing approaches either rely on general-purpose models lacking domain-specific design experience or learn from static scenes. In this work, we introduce \textbf{Scene-Designer}, an agentic framework that learns design intelligence through complementary design and critique experiences. We construct two datasets: \textbf{Scene-OTA-35K}, which provides Observation--Thought--Action supervision for learning scene design and efficient error correction, and \textbf{Scene-OTC-15K}, which provides Observation--Thought--Critic supervision for learning scene quality critique across physical validity, functional correctness, and layout coherence. Based on these experiences, we propose \textbf{Scene-GRPO}, a Critic-guided GRPO framework that improves design decisions and reduces unnecessary trial-and-error corrections. Extensive experiments demonstrate that Scene-Designer achieves superior performance in physical validity, functional correctness, and layout coherence, while the learned Scene-Critic significantly outperforms general-purpose models in scene critique. Moreover, test-time Critic guidance further improves scene generation, showing that the Critic can provide useful guidance beyond training. Additional analysis suggests a trend of mutual enhancement between scene design and critique abilities.

66. 【2610.23110】Domain-specific language alignment of multimodal embeddings towards explainable predictions

链接:https://arxiv.org/abs/2610.23110

作者:Gabrielė Tijūnaitytė,Thijs L. van der Plas,Mohamed-Bachir Belaid,Rob Knapen,Maciej J. Soja,Ioannis N. Athanasiadis

类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词:improve downstream task, downstream task performance, limiting their application, commonly fused, fused into latent

备注:

点击查看摘要

Abstract:Multimodal data are commonly fused into latent representations that improve downstream task performance but are not interpretable, limiting their application in domains that require explainable model decisions. Vision-language alignment has made image embeddings interpretable through language, but requires vast image-caption training data. However, captioned data are typically not available for multimodal embeddings, as relevant features cannot directly be observed and annotated from embeddings alone. Here, we propose a framework to language-align any embedding space that can be linked to interpretable auxiliary data. Captioning functions convert auxiliary data into partial captions; a soft contrastive loss weights pairs by the similarity of their properties that each caption describes; and a rank-based concept retrieval task evaluates alignment against the auxiliary data rather than the captions. We apply this framework to multimodal Earth embeddings to facilitate explainable predictions for two species distribution modelling tasks: S2BMS and SatBird. AlphaEarth embeddings beat previous state-of-the-art models on 6/7 metrics, while our framework language-aligns domain-specific concepts of the embedding space, outperforming previous Earth observation vision-language models on average concept retrieval for both datasets. Finally, aligned concepts recover species-habitat associations ($\rho$=0.44) and relate habitat descriptions to species predictions, showing that abstract embeddings can be interrogated in the language of domain experts.

67. 【2610.23050】riFold: Folding irregular 3D Gaussians into structured latents for 3D Scene Generation

链接:https://arxiv.org/abs/2610.23050

作者:Yun Wang,Chiyu Wang,Fan Jiang,Ziyu Zhu,Zhaoxu Sun,Guangchi Fang,Mu Xu,Dapeng Wu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:motivated growing interest, Recent progress, compact generative representations, motivated growing, growing interest

备注: 30pages, Project page: [this https URL](https://fantasy-amap.github.io/TriFold)

点击查看摘要

Abstract:Recent progress in 3D generation has motivated growing interest in compact generative representations of complex 3D scenes. For native 3D Gaussian scenes, however, learning such representations remains challenging due to widely varying primitive counts, nonuniform spatial density, and differences in geometry and appearance even among spatially neighboring primitives. In this work, we introduce TriFold, a native 3D Gaussian VAE that encodes Gaussian scenes into a fixed-layout triplane latent and jointly reconstructs their geometry and appearance. The key insight is to impose structural regularity on the latent space while preserving the spatial adaptivity of the underlying Gaussians. During encoding, we use cell-wise learned queries to aggregate projected Gaussians into multiple slots per cell, reducing the information loss caused by single-feature pooling. During decoding, occupancy prediction identifies active regions, where query-based set prediction and candidate selection reconstruct local Gaussian sets with spatially varying primitive counts. Building on this representation, we train a latent flow-matching model for conditional scene-level 3DGS generation, enabling point-cloud-conditioned synthesis and single-image-conditioned amodal generation. Experiments demonstrate that TriFold achieves high-fidelity reconstruction and generation from a single image that provides only a partial observation of the scene, validating its effectiveness for native 3D Gaussian representation learning. this https URL

68. 【2610.23046】SpikeQ: Spike-Guided Post-Training Quantization for Spiking Neural Networks

链接:https://arxiv.org/abs/2610.23046

作者:Kai Sun,Peibo Duan,Zhanglu Yan,Guowei Zhang,Yongsheng Huang,Levin Kuhlmann

类目:Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:spiking neural networks, artificial neural networks, neural networks, requires low-bit synaptic, chips requires low-bit

备注:

点击查看摘要

Abstract:On neuromorphic chips, spiking neural networks (SNNs) consume far less energy than artificial neural networks (ANNs), but the limited memory of these chips requires low-bit synaptic weights and membrane potentials. Existing post-training quantization (PTQ) methods provide them without retraining and, like those for ANNs, minimize numerical errors such as the mean squared error (MSE). In an SNN, however, a quantization error reaches later layers only through the spikes it flips. We find that errors of equal MSE can cause very different accuracy losses, whereas errors that flip the same fraction of spikes cause the same loss. We therefore propose SpikeQ, a spike-guided PTQ framework. For weights, we select the level of each weight by simulating the downstream neurons and minimizing their spike errors. For membrane potentials, most existing methods quantize the state after the reset, whereas neuromorphic chips compare the threshold with the membrane potential stored at a fixed bit width. We target this pre-fire quantization and build a reset-aware grid that places the threshold on a rounding boundary, so rounding never flips the spike at the current time step. We evaluate SpikeQ on seven benchmarks of image classification, semantic segmentation, and object detection. With 2-bit pre-fire membrane potentials, every existing grid collapses, whereas SpikeQ retains most of the full-precision accuracy. With both at 4 bits, the models stay within 2.59 points of full precision, shrink their memory footprint 7.8--7.9 times, and use 6.4--6.9 times less energy.

69. 【2610.23039】Frame-Consistent Feed-Forward 3D Gaussian Splatting from Sparse Unposed Images

链接:https://arxiv.org/abs/2610.23039

作者:Viruthshaan Vinasirajan,Ranga Rodrigo

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Feed-forward Gaussian models, Feed-forward Gaussian, predict Gaussians directly, synthesis almost instantaneous, methods predict Gaussians

备注:

点击查看摘要

Abstract:Feed-forward Gaussian models have made novel view synthesis almost instantaneous. Feed-forward methods predict Gaussians directly, either in two stages or in a single merged pass. Using two separately trained models is attractive because each can specialize in its own objective: one for accurate pose estimation and the other for high-quality reconstruction, rather than forcing a single jointly trained network to compromise between the two. A natural instantiation pairs a frozen pose estimator, VGGT, with a frozen reconstruction backbone, TokenGS. Prior work, such as VGGT-X and 3R-GS, also adopts a two-stage design, but attributes the resulting quality degradation to noisy pose estimates and introduces learned refinement. We show that this is not the primary source of the problem. Through per-camera analysis across 107 scenes from two datasets, DL3DV and MipNeRF360, using COLMAP poses as the reference, we find that the rotation error after alignment is small (median 1.6 degrees), whereas the translation scale is offset by a large, dataset-consistent factor. Controlled ablations over 140 DL3DV scenes show that the primary obstacles are two integration failures rather than pose error: a coordinate-frame inconsistency and a translation-scale mismatch, both of which can be corrected deterministically. With these fixes, a frozen VGGT driving a frozen TokenGS achieves 22.47 PSNR, within 0.51 dB of the COLMAP reference, with no additional training, when poses are estimated from all scene views. In the sparse setting, where reconstruction uses only four context images under the standard pose-free protocol, the same pipeline matches this all-view quality, yielding a fully COLMAP-free pipeline without any refinement step.

70. 【2610.23021】Semantic-Critical Regions for Video-to-Audio Generation

链接:https://arxiv.org/abs/2610.23021

作者:Yun Fang,Wei Guo,Zhuonan Liang,Heng Wang,Weidong Cai

类目:Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

关键词:sound events, object motion, contact events, real-world videos, visual

备注: 11 pages, 7 figures, 7 tables, accepted by ACM Multimedia Asia 2026

点击查看摘要

Abstract:In real-world videos, sound events are often associated with localized and fine-grained visual cues, such as object motion, object-part dynamics, contact events, and interactions between objects. Existing video-to-audio (V2A) methods employ implicit conditioning based on global visual representations or explicit control derived from temporal and spatial cues. However, subtle sound-producing and sound-indicative interactions remain insufficiently captured, leaving room for more precise visual conditioning of sound-event semantics and temporal dynamics. Motivated by this observation, we refer to regions containing such sound-relevant visual evidence as Semantic-Critical Regions (SCRs) and introduce SCR-V2A, a V2A generation framework that explicitly localizes and encodes SCRs as fine-grained visual guidance for audio generation. Specifically, we first identify SCRs through sound-related visual localization. We then transform the localized regions into a control representation through adapter-based dual visual encoding, which jointly captures global visual context and fine-grained sound-relevant evidence. The representation is used to condition a downstream audio generation model. Experiments on both in-domain and out-of-domain benchmarks demonstrate that SCR-V2A achieves strong performance in distribution matching and audio quality while remaining competitive in cross-modal alignment and requiring few trainable parameters. These results highlight the value of prioritizing fine-grained, sound-relevant visual regions for V2A generation.

71. 【2610.23001】BRICE: Brain-inspired Recurrent Illusory Contour Encoder for Point Cloud Completion

链接:https://arxiv.org/abs/2610.23001

作者:Yunlei Wang,Dawei Li,Xue-song Tang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:deep learning architectures, Mainstream point cloud, Illusory Contour Encoder, Recurrent Illusory Contour, point cloud completion

备注:

点击查看摘要

Abstract:Mainstream point cloud completion methods are unanimously based on deep learning architectures. On one hand, these methods tend to repetitively stacking attention modules to enhance network performance, which drifts away from the neat design of unified and interpret-able networks; on the other hand, nearly all existing architectures rely solely on feed-forward connections to propagate information, neglecting feedback from deeper layers. The recurrent neural architecture, formed by feedforward-feedback loops, have shown its ability to generate Illusory Contours (ICs) in the V1 brain region of mammals; and ICs are essentially a completion mechanism of the brain for visual information. Motivated by this, we design a Brain-inspired Recurrent Illusory Contour Encoder (BRICE) to "imagine" what is missing in the incomplete 3D point clouds. Building upon the foundation model of Predictive Coding (PC), the plug-and-play nature enables BRICE to be seamlessly integrated into mainstream point cloud completion baselines. Experimental results show that BRICE can enhance various completion baselines on different 3D datasets such as MVP2K, PCN, and PlantPCom. Our code: this https URL.

72. 【2610.22991】A100: A Hybrid Vision Foundation Model for Agricultural Plant Image Analysis

链接:https://arxiv.org/abs/2610.22991

作者:Mayur Pratim Das,Ajai Dubey,Aksshay Mathew P,Sana Afreen,Rishi Kumar Soni,Deepak Meena,Pratibha Kumari,Mukesh Saini

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:expertly annotated data, accurate vision models, developing countries, agriculture is hindered, lack of expertly

备注: 11 pages, 5 figures, 5 tables

点击查看摘要

Abstract:The use of accurate vision models for crop monitoring, disease diagnosis, and plant phenotyping in agriculture is hindered by the lack of expertly annotated data, especially in developing countries. We propose A100, an agricultural vision foundation model that is pre-trained using self-supervised learning on 3 million unlabeled images from fields covering more than 100 crop species. A100 uses a hybrid CNN-Transformer backbone that fuses MBConv stages for local feature extraction with Transformer stages for global contextual representation. A100 uses pre-training with the integration of DINO self-distillation, iBOT masked patch reconstruction, and KoLeo uniformity regularization, resulting in features that are better than ImageNet-12K supervised representations for agricultural applications without any fine-tuning. By utilizing a frozen backbone, the accuracy for crop classification of A100 is 95.37%, which is +2.56% better than ImageNet-12K, and reduces the leaf count error by 10.4% on the GroMo25 phenotyping benchmark, proving that the same backbone can be used for classification and regression tasks. After full fine-tuning, the performance of A100 is 99.90% on 32-class crop identification and 99.02% on 44-class disease detection. On the difficult PlantDoc dataset, A100 outperforms all baselines, such as CvT-13 (64.89% against 63.56%). Remarkably, A100 obtains 98.01% accuracy on plant classification using just 1% of the labelled data (about 284 images per category), showing great label efficiency for use cases with limited labeling. Under an identical protocol, A100 also outperforms the publicly released agricultural foundation models FoMo4Wheat and LeafVision by more than 14 points at 1% labels. We plan to publicly release our pretrained model to allow agricultural professionals to adapt A100 for various plant analysis applications using limited annotations.

73. 【2610.22982】UniField++: A Unified Agentic Framework with Loop Reasoning for MRI Field-Strength Enhancement

链接:https://arxiv.org/abs/2610.22982

作者:Yiyang Lin,Chenhui Wang,Tianliang Yao,Shuaibo Li,Zijun Sun,Yiming Deng,Yixuan Yuan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:MRI field-strength enhancement, MRI field-strength, high-field scanners, seeks to combine, combine the accessibility

备注: 10 pages, 6 figures, 8 tables

点击查看摘要

Abstract:MRI field-strength enhancement seeks to combine the accessibility of low-field scanners with the image quality of high-field scanners. Yet, existing methods remain prone to anatomical hallucinations, as uniform processing leaves difficult brain regions insufficiently examined and scarce paired data limit their learning of how tissue contrast and anatomical visibility change across field strengths. To address these challenges, we propose UniField++, a two-agent framework that unifies enhancement tasks across multiple field-strength transitions, including 64mT-to-3T and 3T-to-7T. Unified learning allows both the VLM-based planner and the flow-matching-based enhancer to draw on field-dependent image characteristics observed across tasks, rather than relying on a single transition. Trained with radiologists' annotations of hallucination-prone regions and corresponding correction plans, the planner predicts regional risk and formulates targeted restoration strategies. Guided by these plans, the enhancer performs loop reasoning along the flow-matching trajectory, repeatedly processing high-risk regions for additional refinement. Together, cross-transition learning and risk-guided refinement support anatomically faithful enhancement across field strengths. Across the evaluated tasks, UniField++ improves PSNR by an average of 2.74 dB and SSIM by 14.05 percentage points over comparison methods, with corresponding gains of 3.97 dB and 13.92 percentage points over the ablation baseline. It also maintains enhancement quality on an external cohort with an unseen field strength and improves downstream whole-brain segmentation Macro Dice by an average of 0.1457 over the original low-field images. Code is available at this https URL.

74. 【2610.22981】How Murky Before a VLM Knows It Cannot See? Accuracy, Confidence and Abstention on a Physical Visibility Axis

链接:https://arxiv.org/abs/2610.22981

作者:Mochamad Rizal Fauzan,Irgi Surya

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Robustness studies, nominal severity scales, grade degradation, studies of vision-language, degradation on nominal

备注: 16 pages, 9 figures, 10 tables

点击查看摘要

Abstract:Robustness studies of vision-language models (VLMs) grade degradation on nominal severity scales ("level 1-5") that carry no physical units, and they rarely ask whether a model's confidence follows the loss of visibility. We measure accuracy, internal (token-probability) confidence, verbalized confidence and an explicit abstain option on a visibility axis in metres: fog follows the Koschmieder model, an underwater arm scales the absorption spectrum of pure water, both are applied with a monocular metric depth map, and the visibility range V is swept over eight log-spaced levels from 250 m to 1.95 m. On 1000 COCO scenes and five small open VLMs (2-5 B parameters), accuracy on a boxed-object identification task falls from near its clean value to chance within a narrow band (half-way visibility V_acc of 12.1-15.9 m in fog and 20.5-38.6 m under water) while, for the four models that are confident on clean images, the confidence stays high: at V=1.95 m in fog their accuracy is at chance but their mean internal confidence is 0.68-0.84 and their verbalized confidence 0.61-1.00, a blind-spot width W=log10(V_acc/V_aware) of at least 0.79 decades, i.e. a factor of 6.2 in visibility. The remaining model is under-confident throughout and its internal confidence follows accuracy. An explicit abstain option follows accuracy when it names the reason (W from -0.21 to -0.06 in fog) but, for one model, lags with a generic "I don't know" (W up to 0.18). ImageNet-C fog severities 1-5 correspond to only 55-110 m of physical visibility, outside the failure band, and leave the accuracy of the models within 5 percentage points of its clean value. Blank-image and shuffled-image controls, a prior-matched answer set and a 200-image pilot that preceded the study are reported. Findings are descriptive: one draw of 1000 images, depth of assumed scale, and models of 2-5 B parameters.

75. 【2610.22975】Sink-Sparse Hybrid Attention for Efficient Inference in T2I/T2V Diffusion Transformers

链接:https://arxiv.org/abs/2610.22975

作者:Bingxin Xing,Yu Zhang,Jiatong Ding,Lei Lu,Ping Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Diffusion Transformers, major inference bottleneck, token sequences grow, repeated dense self-attention, dense self-attention remains

备注: 12 pages, 6 figures

点击查看摘要

Abstract:Diffusion Transformers (DiTs) have become a common backbone for high-quality text-to-image and text-to-video generation, but repeated dense self-attention remains a major inference bottleneck as token sequences grow and the same operator is invoked across many denoising steps. Our study suggests that dense attention in pretrained DiTs contains reusable layer/head-specific high-mass structure that can be identified from a small offline calibration set and reused across future generations. This leads to Sink-Sparse Hybrid Attention, a train-free attention replacement that reuses static sink masks and supplements them with a lightweight pooled-KV branch, while leaving model weights and sampling schedules unchanged. On Wan2.1-T2V-1.3B, the method attains 1.54$\times$ end-to-end speedup while maintaining generation quality. On Z-Image-Turbo, it attains 1.57$\times$ end-to-end speedup with competitive GenEval2 performance. These results indicate that reusable importance-aware sparse support can provide an effective train-free acceleration path for both T2V and T2I DiTs.

76. 【2610.22964】ANCHOR: Audio-Visually Grounded Chain-of-Thought Reasoning Benchmark

链接:https://arxiv.org/abs/2610.22964

作者:Joel Julin,Souraja Kundu,Liza Dahiya,George Z. Wei,Liuyue Xie,Jingru Yi,Xu Zhang,Hao Yang,Laszlo A. Jeni

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal large language, relevant perceptual evidence, large language models, audio-visual question answering, question answering

备注: Accepted at NeurIPS 2026, Evaluations Datasets Track. Joel Julin and Souraja Kundu are co-first authors

点击查看摘要

Abstract:Multimodal large language models (MLLMs) perform well on audio-visual question answering, but correct answers do not necessarily imply that their stated reasoning is grounded in relevant perceptual evidence. Existing benchmarks mainly evaluate final-answer accuracy, offering limited insight into whether model-generated rationales correctly identify visual regions, temporal intervals, and audio events supporting predictions. We introduce ANCHOR, a benchmark and evaluation framework for measuring grounded-rationale alignment in multimodal reasoning, comprising 2,319 videos and 8,272 question-answer pairs with structured reasoning traces, temporal evidence, spatial bounding boxes, and salient audio cues, including a human-refined test set of 224 videos and 975 question-answer pairs. We separately measure answer correctness, hallucination, logical divergence, and conciseness, with direct spatial and temporal grounding measurements on a focused subset. Across the full benchmark, twelve contemporary MLLMs show a substantial alignment gap: models with comparable answer performance can differ markedly in whether their explanations are supported by annotated evidence. On a matched subset of 100 videos and 446 question-answer pairs, rankings remain highly stable across human-refined, Gemini-generated, and GPT-generated references (mean Pearson r=0.99), providing evidence against model-reference circularity within this subset. Grounding-cue ablations of three MLLMs on the full human-refined test set reveal a consistent modality hierarchy: removing video reduces accuracy by 38.4-41.8 points, while removing bounding boxes (3.2-7.7 points) and audio (4.2-5.6 points) causes smaller, complementary, model-dependent drops. These findings show answer-only evaluation obscures important grounding failures and position ANCHOR as a testbed for evaluating accurate and evidence-aligned audio-visual reasoning.

77. 【2610.22957】Query-adaptive Recurrent Tokenization

链接:https://arxiv.org/abs/2610.22957

作者:Bavesh Balaji,Pranav Gopinath,Pouya Sadeghi,Sirisha Rambhatla

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:information worth extracting, worth extracting, warrants depend, token budget, Visual

备注:

点击查看摘要

Abstract:Visual information worth extracting from an image and the token budget it warrants depend on the text query. Yet modern vision and vision-language models largely encode images independently of the query and allocate a fixed visual token budget to every input. We introduce the Query-Adaptive Recurrent Tokenizer (QART), a backbone-agnostic module that makes visual representations both query-steerable and budget-adaptive. QART steers the visual representation toward query-relevant evidence while adapting its token budget to the amount of information required. Its key principle is simple. Additional tokens are allocated until the visual features relevant to the query are represented with sufficient fidelity. Starting from frozen encoder features, QART recurrently constructs a compact representation and uses reconstruction quality over the query-relevant visual support to control token allocation. On Visual7W and VQAv2, QART achieves 81.96% and 76.37% accuracy using only about 29 visual tokens, reducing token counts by 20-25x relative to dense VLM inputs. It further reaches 92.0% P@1 on CORE and 36.3% PR-AUC on PODS, outperforming SteerViT on PODS by 8.4%. Together, these results show that visual representations need not be fixed in either content or capacity and can instead adapt to what each query requires.

78. 【2610.22951】MambaAct: Efficient Mamba Action Experts for Flow-Matching Vision-Language-Action Models

链接:https://arxiv.org/abs/2610.22951

作者:Khuyen Pham,Tran Nguyen Le,Edoardo Fazzari,Cesare Stefanini

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:generalist robotic manipulation, shown strong promise, inference cost remains, robotic manipulation, real-time control

备注:

点击查看摘要

Abstract:Vision-language-action (VLA) models have shown strong promise for generalist robotic manipulation, but their inference cost remains a major bottleneck for real-time control. This limitation is especially pronounced in flow-matching VLAs such as $\pi_{0.5}$, where the action expert is evaluated repeatedly during iterative denoising. We introduce MambaAct, an efficient Mamba action expert for flow-matching VLA policies. MambaAct retains the pretrained visual-language prefix encoder of $\pi_{0.5}$, while replacing its transformer-based action expert with a compact Mamba-based action expert. Within this expert, Mamba serves as the action mixer that models dependencies across the noisy continuous-action sequence. To preserve visual-language conditioning without repeated token-level cross-attention, MambaAct uses a lightweight Context Compressor to map Vision-language model (VLM) prefix tokens into a compact conditioning signal that gates and modulates each Mamba action block. MambaAct uses a $10\times$ smaller action expert and reduces flow-matching denoising latency by $64.8\%$ on LIBERO and $58.8\%$ in real-world deployment, while improving mean LIBERO success by $1.08$ percentage points across three independent fine-tuning seeds and maintaining gains on LIBERO-Plus and real-world benchmarks. Our code and model weights are publicly available at this https URL.

79. 【2610.22929】DICL-Qwen3VL: Decoupled Confidence Calibration for Interpretable Workwear Detection

链接:https://arxiv.org/abs/2610.22929

作者:Meng Wang,Wu Zeng,Mei Li,Chao He

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:styles complicate workwear, Poor illumination, occlusion obscure clothing, obscure clothing cues, diverse clothing styles

备注:

点击查看摘要

Abstract:Poor illumination and occlusion obscure clothing cues in indoor work sites, while diverse clothing styles complicate workwear compliance judgments. Although vision-language models (VLMs) support localization and semantic reasoning, their predictions often lack explicit supporting evidence, and a single confidence score cannot distinguish visual uncertainty from ambiguity in compliance judgments. We propose DICL-Qwen3VL, a decoupled interpretable VLM that integrates structured workwear detection, evidence generation, and separate visual and reasoning confidence estimates. First, low-rank adaptation (LoRA) adapts Qwen3-VL to localize visible upper-body clothing and identify workwear. Second, decoupled calibration separates visual observations from compliance reasoning and assigns a confidence score to each. Token entropy and sensitivity to image perturbations provide supervision for visual confidence, linking confidence estimation to the generated observations and their dependence on image content. Finally, group relative policy optimization (GRPO) jointly optimizes detection accuracy, output validity, and confidence calibration. Experiments on the company-collected Indoor Construction Site Workwear Dataset (ICSWD) and the web-collected Indoor Construction Workwear Dataset (WICWD) yield mAP@50 values of 0.730 and 0.753, respectively, outperforming the evaluated LoRA-adapted VLM baselines, including Qwen3-VL. The framework also provides explicit evidence and separate confidence scores to support manual review in industrial safety monitoring. WICWD is publicly available at this https URL.

80. 【2610.22922】ODSS-Net: Orthogonally Decoupled Shared-Specific Representations for Multi-Modal Object Re-Identification

链接:https://arxiv.org/abs/2610.22922

作者:Zhifeng Ma,Yuhong Feng,Chongyi Huang,Mingyang Zhou,Minwen Deng

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:heterogeneous sensors, Multi-modal object re-identification, leverages complementary information, leverages complementary, information

备注: ICASSP 2027 conference submission

点击查看摘要

Abstract:Multi-modal object re-identification (ReID) leverages complementary information from heterogeneous sensors. Cross-modal alignment and fusion remain challenging. Existing methods mainly reduce modality gaps via feature alignment and fusion. However, alignment may entangle modality-shared structural information with modality-specific cues, while conventional fusion may not fully exploit complementary information. To address these issues, we propose ODSS-Net, a framework for orthogonally decoupled shared-specific representation learning and adaptive fusion of complementary modality-specific features. First, a Shared Structural Feature Construction (SSFC) module suppresses modality-dependent appearance variations and extracts modality-shared structural information. Then, an Orthogonal Specific Feature Learning (OSFL) module aggregates identity-relevant local information and removes the shared-aligned component via geometric orthogonal projection. Finally, a Sample Adaptive Mixture of Experts (SAMoE) module uses the shared structure as routing context to adaptively refine and fuse modality-specific features. Experiments on three benchmarks demonstrate the effectiveness of ODSS-Net for multi-modal object ReID.

81. 【2610.22921】MaskMerge: Structure-aware Token Merging for Efficient Instance Segmentation

链接:https://arxiv.org/abs/2610.22921

作者:Bavesh Balaji,Letian Jiang,Alexander Wong,David Clausi,Sirisha Rambhatla

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Vision Transformers, efficiency of Vision, Transformers by combining, combining redundant tokens, existing methods largely

备注:

点击查看摘要

Abstract:Token merging improves the efficiency of Vision Transformers by combining redundant tokens, but existing methods largely rely on feature similarity to determine which tokens to merge. This criterion is effective for semantic segmentation, yet can fail in instance segmentation, where adjacent objects of the same class often have highly similar features. We identify this failure mode as cross-instance token fusion. We introduce MaskMerge, an instance-aware token merging method that uses coarse intermediate mask predictions to constrain feature-based merging and preserve instance boundaries. We evaluate MaskMerge on two diverse instance segmentation domains characterized by high inter-instance visual similarity: PanNuke and iSAID. Against the SOTA token merging method ALGM, MaskMerge improves mAP from 30.1 to 32.1 on PanNuke while reducing computation from 229 to 153 GFLOPs and running 1.18x faster, and from 33.1 to 36.2 on iSAID while reducing computation from 198 to 182 GFLOPs and running 1.23x faster. Additionally, we also test it on Cityscapes and match ALGM's performance while using fewer FLOPs. The gains also transfer to an MAE pretrained backbone, demonstrating that instance-aware merging enables more aggressive compression when appearance similarity alone cannot reliably preserve object identity.

82. 【2610.22907】COMET: Decoupled Distillation, Routing, and Capacity Control for Task-Agnostic Continual Vision--Language Learning

链接:https://arxiv.org/abs/2610.22907

作者:Seungyoon Woo,Keonhee Park,Gunhee Kim

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:CLIP retain zero-shot, tasks arrive sequentially, zero-shot recognition ability, retain zero-shot recognition, CLIP retain

备注: Accepted at NeurIPS 2026

点击查看摘要

Abstract:Vision-language models (VLMs) such as CLIP retain zero-shot recognition ability, but their open-world use often requires task-agnostic continual learning: tasks arrive sequentially, past data are unavailable, task identity is unknown, and the backbone cannot be retrained. We argue that this setting fails VLMs through three coupled pressures beyond the stability-plasticity tradeoff: (1) modal-consistency drift, (2) representation-space interference, and (3) per-task capacity shortfall. We propose COMET (Collaborative Mixture-of-Expert Transfer) to resolve these three issues respectively as follows. A frozen teacher provides only a feature reference on a shared image-text pool; Tri-Affinity Distillation preserves image-image, text-text, and image-text geometry; and Student-Aware Cross-Expert Distillation aligns new experts with compatible prior experts so routing errors degrade gracefully. We design COMET to keep capacity and inference separate: a contextual bandit keeps or merges full per-task experts using post-training signals, while a reconstruction router selects sparse experts at test time without teacher semantics. On the X-TAIL benchmark, we show that each proposed component improves continual learning performance. COMET shows that continual vision-language adaptation can preserve multimodal geometry, coordinate accumulated experts, and allocate capacity jointly when feature reference, expert shaping, routing, and capacity control are separated by construction.

83. 【2610.22895】HAPACT: A Benchmark For Human-Centric Physical Impact Localization in Movies

链接:https://arxiv.org/abs/2610.22895

作者:Youngrae Kim,Yejin Jang,Eunho Kim,Youjin Sung,Kun-Woo Song,Sangpil Kim,Sang Ho Yoon

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:motion support embodied, support embodied perception, everyday interactions, contact-aware applications, largely focused

备注: 29 pages, 16 figures. Accepted at NeurIPS 2026 (Evaluations Datasets Track)

点击查看摘要

Abstract:Physical reasoning about humans in videos has largely focused on everyday interactions, where contact, pressure, pose, and motion support embodied perception and contact-aware applications. Still, short and forceful properties like impact events remain relatively underexplored, despite their relevance to broader understanding of how abrupt physical events affect the human body. To fill this gap, we introduce human-centric impact localization, a new task that localizes target physical impacts temporally within a video and spatially on the human body. We further present HAPACT, a HumAn-centric imPACT dataset and benchmark built from movie clips, containing over 2.8K video-query pairs with more than 20K fine-grained human-annotated frames. We built HAPACT around viewer-grounded annotation, text-conditioned localization, and supervision at frame-level temporal and SMPL-X-based spatial granularity. To demonstrate the effectiveness of our benchmark, we conduct extensive evaluations of existing methods, employing video moment retrieval models for temporal localization and human-scene contact models for spatial localization. For the spatial task, we propose a text-conditioned baseline by reformulating localization as query-guided body-region selection. Benchmark results show that physical impact localization remains challenging for existing methods, motivating HAPACT as a dedicated benchmark to support physical impact reasoning in videos.

84. 【2610.22845】Variational and Decomposed method for Mitigating Bimodal Bias in Robust Visual Question Answering

链接:https://arxiv.org/abs/2610.22845

作者:Yihan Zhao,Yuncheng Jiang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Visual question answering, bias, Visual question, Bimodal Bias, multimodal bias

备注: 10 pages

点击查看摘要

Abstract:Visual question answering (VQA) models are known to suffer from the bias issue, which refers to overfitting the regularities of frequent patterns. Previously, researchers only consider the language bias. Recently, the multimodal bias is noticed. However, what multimodal bias is remains unclear. In this paper, we investigate the multimodal bias in counting and non-counting questions. We find that they have distinct underlying mechanism, so their biases come from distinct reasons. We provide valuable interpretations of VQA counting mechanism: \textbf{quantity information stems from the magnitude of the multimodal features in specific dimensions.} Thus, counting bias stems from the vision side and propagates to multimodal features through modality fusion, while the non-counting bias stems from primarily language bias and slightly vision bias. Thus, we propose a method to deal with them differently: Variational and Decomposed method for mitigating Bimodal Bias (VDB). It extracts bimodal bias affected by different proportion of vision and language sides. We introduce variational bias models utilizing the principle of Variational Auto-Encoder to learn mainly language bias with slight vision effect, and a bimodal bias model for bimodal bias combining language and vision sides. Extensive experiments on VQACPv2, VQACPv1, and GQAOOD datasets demonstrate the rationality of our claim and the effectiveness of our method. We also provide explanation for the compromised performance on VQAv2.

85. 【2610.22842】VTrajEmbed: Aligning Text with Video Object Trajectories via Spatiotemporal Embeddings

链接:https://arxiv.org/abs/2610.22842

作者:Ruizhi Chen,Zining Fan,Yudi Guo,Jiang Liu,Zhiyu Lin,Zhongjiang He,Shouqian Shi,Hao Sun

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Fine-grained alignment, multimodal understanding, core challenge, challenge in multimodal, video object trajectories

备注: 28 pages, 1 figure

点击查看摘要

Abstract:Fine-grained alignment between text and video object trajectories is a core challenge in multimodal understanding. Existing embedding models excel at global retrieval, yet their single global representation entangles multiple objects and their spatiotemporal dynamics, limiting direct object-level grounding. To address this issue, we propose VTrajEmbed, an embedding model that decomposes a video into object trajectories and aligns each trajectory embedding with text for object-level grounding through retrieval. Our main contributions: (1)Slow-Fast Trajectory Encoding, a dual-branch architecture that establishes trajectory representations by densely sampling low-resolution frames for high-frequency motion cues and sparsely selecting high-resolution frames for scene context, aggregated by a shared LLM backbone; (2)Mask-Guided Contrastive Learning, a training objective built upon these representations that couples an intra-group loss and a batch-level bidirectional loss under a relation mask, excluding unverified relations and preventing confirmed matches from becoming false negatives; (3)Text2Traj-Bench, a trajectory-level text-video benchmark with model-assisted construction and human-verified query--trajectory relations. Experimental results show that VTrajEmbed-5B improves text-to-trajectory and trajectory-to-text R@1 over Qwen3-VL-Embedding-8B by 15.48 and 18.05 percentage points, respectively, and achieves 49.48% average R@1 across five global retrieval benchmarks, compared with 42.86% for Qwen3-VL-Embedding-8B.

86. 【2610.22822】VISTA: A Multimodal Egocentric Benchmark for Goal-Oriented Perception and Assistance to Blind and Low-Vision Users

链接:https://arxiv.org/abs/2610.22822

作者:Noé Mosca,Mohamed Rayan Barhdadi,Muhammad Hamza,Joshua Yeh,Suryodaya Bikram Shahi,Zhiyan Li,Selim-Antoine Lali,Weiyue Li,Hasan Kurban,Erchin Serpedin,Gang Luo,Yue Zhang,Minghan Li,Mengyu Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Blindness and low, low vision limit, complete daily tasks, motivating AI assistants, limit many people

备注: Code and dataset are available at [this https URL](https://harvard-ai-and-robotics-lab.github.io/VISTA)

点击查看摘要

Abstract:Blindness and low vision limit many people's ability to complete daily tasks, motivating AI assistants that provide useful guidance. Yet, existing benchmarks do not adequately test whether vision models can provide effective everyday assistance. In particular, i) existing benchmarks primarily rely on visual and textual inputs, with limited support for other modalities that are increasingly available in egocentric wearable devices such as gaze, inertial measurements, spatial trajectories, and others; and ii) existing evaluations emphasize scene understanding and question answering, with limited coverage of goal-conditioned guidance for blind and low-vision users across everyday tasks. To bridge this gap, we introduce VISTA (Visually Impaired Scene and Task Annotations), a multimodal egocentric benchmark for goal-oriented assistance for blind and low-vision users. VISTA contains $\sim$1,000 egocentric recordings captured with Project Aria glasses; each recording provides synchronized sensor streams, six of which serve as model inputs, and three different types of annotation, covering ten task categories (TC), from object localization to hazard detection. We evaluate 14 representative vision-language models zero-shot on VISTA and design a lightweight multimodal model baseline that integrates all six modalities. Experimental results show that, although existing models can often describe egocentric scenes, they remain limited in generating goal-directed assistive guidance. VISTA thus provides a benchmark for evaluating multimodal models that could improve everyday accessibility.

87. 【2610.22811】Replay Pruning and Few-Bit Integer Inference for Hardware-Efficient Speed-Sign Recognition

链接:https://arxiv.org/abs/2610.22811

作者:Se Un Park,Kyungkeon Chung,Huigeol Kim,Junyoung Park

类目:Computer Vision and Pattern Recognition (cs.CV); Hardware Architecture (cs.AR); Machine Learning (cs.LG)

关键词:Speed-limit sign recognition, energy budgets, Speed-limit sign, outperforms iterative pruning, per-step replay outperform

备注:

点击查看摘要

Abstract:Speed-limit sign recognition on an automotive camera system-on-chip (SoC) must fit a detector and a classifier (the reader) into the memory, arithmetic, and energy budgets of the device. In our two-stage recognizer, the detector, a YOLO-family network with ReLU and hard-sigmoid operators, is compressed by channel replay: an iterative pruning cascade identifies the channels to remove, the recorded deletions are replayed on the original task-trained network, the parent, and one continuous knowledge-distillation recovery follows. On a YOLOv5n, replay removes 60.3% of the parameters at the accuracy of the parent and, in validation mAP50-95 over five matched seeds, outperforms iterative pruning and training from scratch, and its per-step variant (per-step replay) is the most accurate pruning method. On a YOLOv8n, replay and per-step replay outperform every other method and the unpruned parent. The reader, a five-layer CNN with 18k parameters, and the post-processing of the YOLOv5n and YOLOv8n heads use integer arithmetic only. With 4-bit weights and 8-bit activations (W4A8), the reader matches FP32 accuracy in 12.1 KB of on-chip memory, and an executable streaming model reproduces the INT8 class predictions of its runtime on all 9,850 test crops. On a Jetson AGX Orin, INT8 is faster than FP16 only in the implicit formulation of TensorRT, and the replay detector runs fastest on the deep-learning accelerator (DLA). Trained on public data only, the combined system of 0.72 M parameters recognizes 95.2% of the signs of a held-out automotive camera at 90% precision and 94 frames per second.

88. 【2610.22795】STRIDE: Evaluating Spatiotemporal Reasoning in Driving Edge Cases

链接:https://arxiv.org/abs/2610.22795

作者:Lieqi Liu,Rui gao,Jia-Chen Gu,Wenbo Hu,Zhaobin Mo,Ahmadreza Moradipari,Nejib Ammar,Wei Wang,Nanyun Peng

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:perceiving surrounding objects, perceiving surrounding, failing to understand, move and interact, interact over time

备注: Project page: [this https URL](https://pluslabnlp.github.io/STRIDE/)

点击查看摘要

Abstract:In autonomous driving, perceiving surrounding objects is not enough: failing to understand how they move and interact over time can lead to dangerous decisions. Evaluating vision-language models (VLMs) therefore requires testing whether they connect past spatial observations to future consequences. Yet existing benchmarks often assess edge cases through basic perception questions or test temporal understanding in simple scenarios, leaving complex spatiotemporal reasoning underexplored. We introduce STRIDE (SpatioTemporal Reasoning In Driving Edge Cases), an object-centric benchmark for long-tail, safety-critical driving scenarios. STRIDE covers six task families: spatial perception, spatial understanding, temporal memory, temporal extrapolation, trajectory prediction, and scene-context awareness. It pairs multiple-choice questions probing individual spatiotemporal judgments with related free-form visual question answering (VQA) requiring detailed scene explanations and justifications of driving decisions. We prioritize scenes with unusual object behaviors and complex traffic interactions, generate reference answers from structured dataset annotations through automated procedures, and use limited language-model assistance and human verification to ensure annotation quality. Across 12 proprietary, open-weight, and driving-specialized models, even the best performer, GPT-6-Astra, achieves only 43.4% average multiple-choice accuracy, versus an approximately 20% random-choice baseline. Further analysis reveals that strong performance in describing driving scenes does not necessarily translate to accurate safety-critical judgments, and that models struggle more with reconstructing object motion than recalling past positions. STRIDE thus exposes spatiotemporal driving limitations that aggregate VQA scores can conceal.

89. 【2610.22778】Direct Conditional Parameterization for N-Dimensional Splatting

链接:https://arxiv.org/abs/2610.22778

作者:Zhongpai Gao,Benjamin Planche,Van Nguyen Nguyen,Meng Zheng,Anwesa Choudhuri,Arun Innanje,Terrence Chen,Ziyan Wu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:N-dimensional splatting extends, view direction, model view-dependent, splatting extends, N-dimensional splatting

备注: Accepted by NeurIPS 2026

点击查看摘要

Abstract:N-dimensional splatting extends 3D Gaussian Splatting with view direction and time to model view-dependent and dynamic effects. Each primitive is lifted into a joint distribution over position and conditioning variables, then conditionally sliced at each rendering query. N-DGS and UBS share this step across Gaussian and Beta kernels: recovering the conditional mean, opacity, and covariance requires per-primitive matrix inversions and regression products in every forward pass. We introduce direct conditional parameterization, replacing this covariance-derived readout with explicit per-effect parameters: a Cholesky precision factor for opacity and a factorized query-to-position regression operator with learnable per-dimension coupling. Unrestricted conditional coordinates recover a valid joint covariance; our factorization adds spatial-scale and coupling priors. Applied to both kernels, the parameterization yields dGS (Gaussian) and dBS (Beta). Across five static and dynamic benchmarks, they match or exceed their covariance-derived counterparts on quality, with gains up to +1.26 dB in the main MCMC evaluation. Production slicing is 6.9-7.7 times faster than on-the-fly covariance-derived conditioning; complete-render profiling gives 1.25-1.91 times speedups on four trained scenes. Direct conditioning provides a structured, kernel-agnostic alternative for N-dimensional splatting. Project page: this https URL.

90. 【2610.22756】Input- and Feature-Space Correction for Cross-Hospital IHC Grading

链接:https://arxiv.org/abs/2610.22756

作者:Jongwoon Lee,Jhair Gallardo,Christopher Kanan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:cross-hospital IHC grading, Pathology foundation models, IHC grading, cross-hospital IHC, foundation models

备注: 12 pages, 2 figures, 4 tables. Accepted at the NeurIPS 2026 Workshop on AI at Scale for Clinical Impact (ASCI)

点击查看摘要

Abstract:Pathology foundation models (FMs) are trained predominantly on hematoxylin and eosin (HE) images but are increasingly used as frozen feature extractors for immunohistochemistry (IHC), where cross-hospital differences can impair grading. However, systematic comparisons of correction methods for cross-hospital IHC grading remain limited. To address this gap, we benchmark label-free transformations applied to input images before frozen-FM encoding and to features after frozen-FM encoding using UNI and Virchow2, three IHC markers, and six directed cross-hospital transfers, yielding 12 settings. Among the evaluated input-space methods, our proposed method FIX achieved the largest macro-F1 improvement over no correction, outperforming well-known stain normalization techniques. Among feature-space methods, a simple feature-wise standardization achieved the best improvement over no correction, outperforming CORAL. Under patient-averaged tile-level evaluation, combining FIX with feature-wise standardization improved macro-F1 and quadratic weighted kappa (QWK) by 0.181 and 0.208, respectively, and reduced ordinal error by 0.209 relative to no correction. These results show that input- and feature-space transformations can provide complementary benefits for cross-hospital IHC grading with frozen pathology FMs.

91. 【2610.22751】MedSTP: Preserving Subspace and Transition Evidence for Medical VQA Token Pruning

链接:https://arxiv.org/abs/2610.22751

作者:Mengchen Fan,Qizhen Lan,Xi Xiao,Lin Zhao,Liang He,Tianyang Wang,Xiaoqian Jiang,Pulin Che,Baocheng Geng

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:pass long visual-token, long visual-token sequences, Medical vision-language models, making visual-token pruning, visual-token pruning attractive

备注:

点击查看摘要

Abstract:Medical vision-language models (VLMs) for visual question answering (VQA) often pass long visual-token sequences to the language model, making visual-token pruning attractive but risky for medical images, where answers may depend on localized boundary and texture evidence. We study training free pre-decoding pruning and treat pruning as a subspace stable evidence preservation problem. The retained tokens should remain close to the dominant visual evidence subspace induced by the full token set. To this end, we propose \emph{Subspace-Transition Token Pruning} (\method{}), which estimates each token's spectral support from principal component space and constructs a compact representation subspace. To better reflect medical image structure, \method{} further uses a bounded token-grid transition prior to promote boundary and texture sensitive tokens. We evaluate \method{} on the closed-ended SLAKE and OmniMedVQA benchmarks and on RadImageNet-VQA, which provides both closed-ended and open-ended evaluations, using Lingshu-7B and Qwen3-VL-8B backbones. \method{} delivers consistently strong performance on both the closed-ended and open-ended RadImageNet-VQA evaluations. These results show that \method{} is an effective training free pruning framework for medical domain VQA.

92. 【2610.22746】Cross-Person Identity Change Under Source-Coupled Multi-Human Generation: A Controlled UniPortrait Study

链接:https://arxiv.org/abs/2610.22746

作者:Edrees Al-Edreesi,Ghaleb Al-Gaphari,Muneer Alsurori,Mohammed Edrees,Fouad Al-Hamdani

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multi-human personalization, generative operation, personalization must account, Multi-human, nominal target

备注: 16 pages. Project website and code: [this https URL](https://github.com/edrees2022/face-identity-repair)

点击查看摘要

Abstract:Multi-human personalization must account for identity changes in people outside the nominal target of a generative operation. We characterize this behavior in UniPortrait, without introducing a new preservation algorithm. Two sequential studies use 119 accepted two-person baseline scenes and three fixed output seeds, measuring continuous reference-based facial similarity with InsightFace \buffalo. In Study~1, source-coupled single-ID target-only generation (A1) produces negative mean transitions for both the protected person ($-0.567904$) and target ($-0.236904$), indicating broad perturbation rather than established successful repair with collateral loss. In Study~2, native dual-ID generation (A2) yields more positive paired contrasts: protected $+0.512918$ (95\% case-cluster CI $[0.471434,0.550259]$) and target $+0.158853$ ($[0.118903,0.197523]$), across 287 jointly measurable pairs from 111 cases. Shared baseline similarity cancels algebraically in these paired contrasts, leaving a matched POST comparison. Validation designed after the primary result freeze finds directional agreement with an independent identity evaluator and blinded human judgments; within-\buffalo\ nuisance models provide supportive sensitivity evidence. The findings characterize intact native regimes, whose references, routing, adapters, and token counts co-vary. They do not establish component causality, categorical identity preservation, successful localized editing, or generalization beyond the evaluated implementation and measurable cohort.

93. 【2610.22744】OmniXRef: A Unified Framework for Multimodal Multi-Reference Video Editing

链接:https://arxiv.org/abs/2610.22744

作者:Xiaoyan Cong,Tianyu Wang,Hyeonho Jeong,Zhifei Zhang,Yuqian Zhou,Yijun Li,Shaoteng Liu,Zhe Lin,Srinath Sridhar,Soo Ye Kim

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Creative intent, remove the people, subject appearance, text instructions, video

备注: Project page: [this https URL](https://oliver-cong02.github.io/OmniXRef.github.io/)

点击查看摘要

Abstract:Creative intent in video editing can be expressed through text instructions (e.g., "remove the people"), image references (e.g., subject appearance), video references (e.g., camera movement), or a combination of the above. We introduce OmniXRef, a unified framework for multimodal multi-reference video editing that allows users to combine variable numbers of text, image, and video references to control diverse attributes of a source video. We first devise a unified input design with a reference-bank interface and introduce $R^2$-RoPE to support generalization to more references. Then our model, OmniXRef-Model, uses a single-stream diffusion transformer to jointly process the source video and multimodal context from an MLLM in an interleaved sequence. To address the scarcity of training data for video-reference editing, we construct OmniXRef-Data using synthesis pipelines for different editing tasks and combinations of references. We use curriculum learning to progressively increase task complexity and resolution. To support systematic evaluation of video as a control modality, we introduce OmniXRef-Bench, a benchmark for video-reference attribute transfer across Camera, Motion, Content, Style, and Visual Effects (VFX). Comprehensive evaluations show that our OmniXRef-Model outperforms task-specific baselines and commercial models.

94. 【2610.22726】Improving OCR Accuracy Through Multi-Classifier Verification of Visually Similar Characters

链接:https://arxiv.org/abs/2610.22726

作者:Nuzhat Khan,Ab Al-Hadi Ab Rahman,Mohamad Anuar Kamaruddin,Muhammad Paend Bakht,Sana Fatima,Farhad Khodadadi,Ibrahim Yousef Alshareef

类目:Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

关键词:Distinguishing visually similar, Distinguishing visually, text digitization, persistent challenge, challenge for optical

备注: 32 pages, 8 figures, 2 tables. Submitted to Computer Vision and Image Understanding (CVIU). Dataset available at [this https URL](https://github.com/VeCAD-P04-UTM/94-Class-ASCII-Image-OCR-Data)

点击查看摘要

Abstract:Distinguishing visually similar characters is a persistent challenge for optical character recognition (OCR) systems, causing errors in critical applications of text digitization. While preprocessing techniques improve image quality and word-level post-processing corrects spelling errors, neither addresses character-level visual ambiguity, an intrinsic property of certain character pairs that limits even state-of-the-art OCR models. We present the Character Verification Model (CVM), a character-level post-processing framework that verifies and corrects ambiguous characters in OCR outputs using specialized binary classifiers trained on visually confusable pairs such as 'O'/'0', 'Z'/'2', and 'S'/'5'. CVM operates independently of dictionary validation, making it suitable for non-lexical data including serial numbers, alphanumeric codes, and license plates. Experiments on three OCR engines (Tesseract, EasyOCR, TrOCR) and ten fonts with low to high complexity demonstrate accuracy improvements of 3.95-14.81 percentage points, with an 87.3% correction rate for visually similar character errors and a false-correction rate of only 2.3%. The modular architecture integrates with existing OCR pipelines without modification to underlying recognition models.

95. 【2610.22720】HilbertGen-3D:Hilbert--Multifractal Conditioning for Topology-Aware 3D Generation

链接:https://arxiv.org/abs/2610.22720

作者:Ziyi Zhang,Shixuan Li,Yorie Nakahira,Paul Bogdan,Guannan Qu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:generative modeling underpins, game asset creation, modeling underpins game, underpins game asset, directly influences perception

备注:

点击查看摘要

Abstract:High-fidelity 3D generative modeling underpins game asset creation, medical imaging, and VR/AR environmental design, where geometric structure directly influences perception and decision-making. Diffusion models represent a powerful paradigm for point cloud generation. However, existing approaches rely heavily on local voxel or patch features and often miss global structural organization, and much less work has studied how global conditioning can be used to improve generation quality. In this paper, we introduce HilbertGen-3D, a novel topology-aware conditional diffusion framework based on Hilbert-Multifractal Conditioning (HMC). HMC computes multi-scale voxel measures, serializes them via a 3D Hilbert curve to expose structured spatial dependencies, and estimates the generalized fractal dimensions from scale-dependent partition functions. We encode these signals as global embeddings and multi-scale tokens, and inject them into a diffusion denoiser through an efficient bottleneck fusion module. Across the Chair, Airplane, and Car categories of ShapeNet, our two conditioning variants reduce the absolute deviation of 1-Nearest Neighbor Accuracy (1-NNA) from 50% by up to 8.90 percentage points and increase coverage by up to 5.88 percentage points relative to TopoDiT-3D. This shows that combining local density cues with global Hilbert-multifractal structure provides a simple and effective recipe for high-fidelity and diverse 3D generation.

96. 【2610.22700】hinking from Above: Efficient Spatial Reasoning with Bird's-Eye-View Visual Tokens

链接:https://arxiv.org/abs/2610.22700

作者:Faizan Siddiqui,Nirav Savaliya,Sahith Reddy Chada,Enna Sachdeva

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Existing video multimodal, Existing video, organize observations primarily, reasoning requires organizing, embodied spatial reasoning

备注:

点击查看摘要

Abstract:Existing video multimodal large language models (MLLMs) organize observations primarily in time, but embodied spatial reasoning requires organizing them in space. Consequently, their visual representations can remain locally consistent across nearby frames while lacking a persistent spatial context that is stable across viewpoints and time. We exploit depth and camera pose, which are naturally available to embodied agents, to explicitly establish this spatial correspondence. We introduce Cambrian-BEV, which extends Cambrian-S with a parameter-free geometric tokenization scheme that back-projects visual patch features from each frame into a shared bird's-eye-view (BEV) coordinate frame and averages features that fall within the same spatial cell. Thus, observations of the same physical location, regardless of viewpoint or time step, are aggregated into a common spatial token. In addition to providing a persistent scene representation, this formulation acts as an efficient compression mechanism: 128 frames containing approximately 100K DINOv3 patch features are consolidated into a fixed 27$\times$27 grid of only 729 BEV tokens, cutting LLM prefill time by $2.9\times$ and peak memory by $3.6\times$. Cambrian-BEV requires no architectural modification beyond BEV tokenization and uses a frozen DINOv3 vision encoder with a trainable multimodal projector and LLM. On VSI-Bench, our model reaches 63.48, $+8.5$ points over an identically fine-tuned frame-token control with $12.6\times$ fewer visual tokens, with particularly large gains on room size ($+24.5$) and relative direction ($+34.1$). On ReVSI, it reaches 44.68, $+4.5$ over the corresponding control.

97. 【2610.22681】EgoP$^{2}$C: Internalizing Plan-Perceive-Compose for Spatial Reasoning in Egocentric Video

链接:https://arxiv.org/abs/2610.22681

作者:Chaoyu Li,Arka Sadhu,Yuliang Li,Hyo Jin Kim,Yuning Chai,Pooyan Fazli

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Answering complex spatial, egocentric video requires, video requires determining, Answering complex, acquiring targeted observations

备注:

点击查看摘要

Abstract:Answering complex spatial reasoning questions from egocentric video requires determining what evidence is needed, acquiring targeted observations, and combining them through multiple reasoning steps. Existing vision-language models (VLMs) struggle to perform this process reliably. Agentic systems address this challenge by querying external vision and geometry tools, but training their reasoning leaves these tools unchanged, so inaccurate observations can still lead to incorrect answers. We introduce EgoP$^{2}$C, a framework that internalizes a plan-perceive-compose process within a single VLM. To this end, we first train specialized Planner and Perception teachers using separate adapters (Dual-LoRA), then fine-tune the corresponding experts in a mixture-of-experts (MoE) student under their supervision. We subsequently train the student on trajectories generated by its current policy using a segment-level extension of multi-teacher on-policy distillation (MOPD), assigning different trajectory segments to different supervisors. The Planner teacher supervises which evidence-seeking questions to ask, when to stop gathering evidence, and how to compose the final answer. The Perception teacher supervises the video-grounded answers to those questions. At inference, the student executes this adaptive workflow end-to-end, without external spatial tools. Across three spatial reasoning benchmarks, EgoP$^{2}$C students built from Qwen3-VL-8B and SenseNova-SI-1.3-8B outperform their base models by an average of 9.2 and 7.5 percentage points, respectively. Across both backbones, EgoP$^{2}$C reduces inference FLOPs by 65.8-66.3% and achieves $1.29$-$1.49\times$ speedups over their shared Dual-LoRA teacher.

98. 【2610.22676】Deep Learning for Deepfake Image Detection: Comparative Model Evaluation and Gradient-Based Visual Attribution

链接:https://arxiv.org/abs/2610.22676

作者:Saad Korchi,Abderrahim Waga

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Synthetic facial imagery, generated content increasingly, content increasingly important, Synthetic facial, online trust

备注: 8 pages, 3 figures, 1 table

点击查看摘要

Abstract:Synthetic facial imagery has made the distinction between authentic and generated content increasingly important for digital forensics and online trust. This study examines an explainable deep-learning workflow for image-level deepfake detection using two contrasting classification strategies: a compact convolutional model trained from scratch and an ImageNet-pretrained MobileNetV2 model adapted through two-stage transfer learning. Experiments were conducted with the balanced 140k Real and Fake Faces dataset, comprising 140,000 facial images. Under the recorded validation protocol, the augmented from-scratch model reached 84.15% accuracy (loss 0.3625), compared with 95.90% accuracy (loss 0.1074) for the fine-tuned pretrained model. Gradient-weighted class activation mapping (Grad-CAM) was used to visualize image regions associated with predictions, and a Flask-based prototype was developed for side-by-side inspection. These observations support the practical value of pretrained visual representations in the studied setting while underscoring the need to interpret validation performance alongside dataset provenance, explanation limitations, and evaluation scope. The reported results are validation results, not held-out test estimates.

99. 【2610.22610】Shift-Reliance Alignment: Ranking Vision-Language Models by the Cues They Trust

链接:https://arxiv.org/abs/2610.22610

作者:Faisal Mohammad,Mohamed Younis

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Vision-language models, chosen from leaderboards, model, give one ranking, Vision-language

备注: 24 pages, 12 figures, 21 tables

点击查看摘要

Abstract:Vision-language models (VLMs) are usually chosen from leaderboards, which give one ranking for every application. On questions about objects that a scene suggests but does not contain, however, the model with the lowest error on the POPE hallucination benchmark is not the one with the lowest error on such questions. For yes/no questions about object presence, we show that the best model for a target domain can be predicted without running any candidate on that domain, given 650 to 1,200 labeled target items that calibrate a detector. We measure each model's reliance on a cue, a feature such as scene context or text in the image, by editing 100 labeled source images so that the cue suggests the wrong answer, and comparing with a matched control edit. Reliance predicts which VLMs are misled by physical sticker attacks (Spearman .93 on nine models not used to design the score) and which hallucinate on unedited COCO photographs, beyond what their tendency to answer yes explains. Shift-Reliance Alignment (SRA) scores a model by its source error on the labeled source questions plus its reliance multiplied by the shift. The shift is the proportion of target questions on which the cue misleads, and a detector estimates it on the unlabeled target images. SRA selects the model with the lowest score. In pre-registered tests on new images where most questions mislead, it lowered the error of the selected model from 30.4% under selection by source error to 18.8% on Objects365 and OpenImages but, against its prediction, not on COCO. On CueDial, a benchmark we release that varies how often a cue misleads, selection by model confidence falls more than 40 percentage points behind the best model when overlaid text denies a visible object, and SRA stays within 3 points.

100. 【2610.22608】ProactGen: Learning Proactive Clarification for Video Generation

链接:https://arxiv.org/abs/2610.22608

作者:Zhixiao Wang,Yang Chen,Yifan Xu,Chenbin Li,Yue Chang,Kai Long,Fengming Dong,Limin Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:force repeated cycles, natural language descriptions, intent remains time-consuming, Recent advances, create high-quality videos

备注:

点击查看摘要

Abstract:Recent advances in video generation let users create high-quality videos from natural language descriptions, yet obtaining results that match user intent remains time-consuming: individual generations are computationally expensive, and underspecified prompts force repeated cycles of generation, inspection, and revision. Existing video prompt optimization methods improve generation through automatic rewriting, but cannot supply the ideas and preferences that were not in the initial description. We propose ProactGen, a video generation framework that learns proactive clarification, eliciting user intent through questions grounded in generated video drafts. Specifically, we train a vision-language model as a questioning policy with reinforcement learning: observing the initial prompt and a video draft, it learns to ask the questions most valuable to downstream generation, rewarded by the alignment between the final generated video and a target reference. We further find that effective questioning does not require drafts of final-output quality, and exploit this property by generating drafts with fewer denoising steps, keeping the added cost of clarification low. Experiments show that ProactGen improves target alignment over direct generation by at least 1.8x the gain of the strongest baselines. Moreover, a single round of ProactGen already exceeds the alignment that the strongest baseline reaches after four refinement rounds, in 29% of its time.

101. 【2610.22606】hree LiDARs, Twenty-Five Datasets: Cross-Source Generalization in Tree-Species Recognition

链接:https://arxiv.org/abs/2610.22606

作者:Jae Joong Lee,Bedrich Benes

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)

关键词:independently collected terrestrial, largest public LiDAR, public LiDAR benchmark, airborne laser-scanning datasets, tree-species classification

备注: Accepted to WACV 2027

点击查看摘要

Abstract:FOR-species20K is the largest public LiDAR benchmark for tree-species classification, pooling 25 independently collected terrestrial, mobile, and airborne laser-scanning datasets across 33 species. We introduce a multi-resolution, multi-view ConvNeXtV2 model that improves official hidden-test accuracy from 79.5% to 85.0%, ranking first at the time of submission. We then examine what this score measures. Because the hidden test is species-balanced, its overall accuracy is more comparable to a macro metric than to accuracy under the public set's long-tailed distribution. Moreover, the official random split places every source dataset in both training and evaluation. A logistic probe recovers source identity from out-of-fold model probabilities with 69% accuracy, while geometric features identify the source above 90% within two widely shared species; 18 of the 33 species occur in only one source. Under a source-species-cell holdout, evaluated on 5,566 trees from eight eligible species that retain the same LiDAR-type training support in other sources, the unweighted species mean falls from 82% to 36%, and tree-weighted accuracy falls from 95% to 60%. Count-matched retraining and experiments with two alternative backbones indicate that this gap is not explained by reduced training support alone, while an external PureForest experiment shows a smaller but consistent grouped-split effect. These results establish the 85% leaderboard score as strong in-distribution performance, but not as an estimate of source-disjoint generalization, motivating balanced metrics and source-aware evaluation. The code is available at: this https URL

102. 【2610.22602】Stuck on Shuffle: On Attribute-Object Binding in Vision-Language Models

链接:https://arxiv.org/abs/2610.22602

作者:Netanel Y. Tamir,Michael Green,Issar Tzachor,Or Shimshi,Dvir Samuel,Or Patashnik,Rami Ben-Ari

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:shared embedding space, fundamental task, embedding space, Retrieval, binding

备注:

点击查看摘要

Abstract:Retrieval is a fundamental task in multimodal systems: given an image or text query, the goal is to find the most relevant images or texts in a collection, often using a shared embedding space. Reliable retrieval requires these embeddings to capture not only which concepts are present, but also how they are composed. One key compositional challenge is attribute--object binding: encoding which attributes belong to which objects. Existing benchmarks provide a limited view of this capability, typically covering a subset of modality pairings, simple two-object swaps, or small attribute sets. Consequently, it remains unclear how robustly current models preserve attribute--object bindings across different modality pairings and more complex settings. We therefore introduce SABER, a controlled benchmark for evaluating attribute--object binding across all four image and text modality pairings, spanning diverse attribute types and scenes with up to ten objects. Evaluating models on SABER reveals substantial binding failures in both CLIP-style dual encoders and recent MLLM-based embedders. These findings motivate us to ask how binding can be improved efficiently. While multimodal supervision may be effective, collecting suitable images is difficult and costly. Text, on the other hand, is well suited to binding supervision: it is cheap to generate, supports a broader range of attributes and enables precisely controlled hard negatives. We thus finetune an MLLM-based embedder exclusively on synthetic attribute-binding text. Despite the absence of image supervision, the gains transfer to cross-modal and image--image retrieval while preserving general multimodal embedding performance. Our model achieves SOTA results on SABER while also improving on negation and instance-retrieval benchmarks, demonstrating broader benefits of our binding-focused supervision.

103. 【2610.22566】Seeing Seizures: A Large-Scale Empirical Study of Video and EEG Deep Learning for Automated Rodent Seizure Detection and Severity Grading

链接:https://arxiv.org/abs/2610.22566

作者:Alloy Das,Shreyan Ganguly,Nyzil Massey,Hung Phi Doan,Zhanhong Jiang,Thimmasettappa Thippeswamy,Soumik Sarkar

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:preclinical seizure research, Manual annotation, bottleneck in preclinical, EEG recordings, seizure research

备注: Under Review

点击查看摘要

Abstract:Manual annotation of synchronized video and EEG recordings is a bottleneck in preclinical seizure research. We present an empirical study of seizure detection and behavioral severity grading using 24,131 paired clips from 601 sessions across 20 rats in a soman-induced epilepsy model. Ten video architectures and seven single-channel EEG models are evaluated independently on binary detection and three- and five-class severity tasks. In the session-exclusive reference comparison, R(2+1)D-18 and GRU achieve detection macro-F1 scores of 0.968 and 0.974, respectively; for five-class grading, the corresponding scores are 0.657 and 0.560. Subject-exclusive evaluation reduces five-class macro-F1 to 0.475 for video and 0.404 for EEG, highlighting the difficulty of grading unseen animals. Temporal-sampling experiments demonstrate the value of multiple frames, while detection performance varies relatively little across the evaluated video architectures. A separate video-only binary-detection evaluation on RodEpil achieves a mean seizure-class F1 of 0.979 after uniform re-encoding to reduce identified class-correlated encoding cues. The study characterizes existing models for behavior-defined severity labels under the evaluated protocol, motivating further investigation of expert-assisted annotation workflows. Our code and github page is available here.

104. 【2610.22563】Micro-Localization: High-Precision Mobile Robot Localization Using Microscopic Ground Texture

链接:https://arxiv.org/abs/2610.22563

作者:Aaron Wilhelm,Marina de Albuquerque Marcon,Emith Uyanwatte,Nils Napp

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:ground texture viewed, demonstrate high-precision global, high-precision global localization, microscope optics, high-precision global

备注:

点击查看摘要

Abstract:We demonstrate high-precision global localization using natural ground texture viewed through microscope optics, achieving localization in the tens-of-micrometers regime. For the planar ground texture localization problem considered here, we relate optical magnification and image-space localization uncertainty to physical localization precision. Leveraging this relationship, we then develop a microscope-based localization system that addresses the calibration, camera-modeling, and focus challenges introduced by high-magnification imaging. We evaluate this system across several surface textures using a calibrated precision gantry. Across 1,007 held-out queries per surface, the system localizes every query and achieves translation RMSEs of 28$-$73 $\mu$m. Independent photometric registration agrees with the feature-based localization estimates to within approximately 9 $\mu$m RMSE. We further demonstrate localization on a low-cost mobile robot using the gantry-collected maps, and also show that the system can resolve micrometer-scale displacement caused by thermal expansion. These results show that microscopic natural surface texture can bring mobile localization into a precision regime typically associated with fixed positioning systems.

105. 【2610.22553】Generative AI Produces and Transmits Beauty Bias

链接:https://arxiv.org/abs/2610.22553

作者:AJ Alvero,Deepak Varuvel Dennison,Alexandra Crespin,Heeyon Kim,Alejandra Regla-Vargas,Avani Akerkar,Jasmine McNealy,René Kizilcec

类目:Computers and Society (cs.CY); Computer Vision and Pattern Recognition (cs.CV)

关键词:Societies reward people, Societies reward, standards intertwined, reward people judged, Societies

备注:

点击查看摘要

Abstract:Societies reward people judged to be attractive by standards intertwined with gender and race. In this paper, we examine if and how generative AI may contribute to these dynamics. We audited 27 text-to-image generators released between 2022 and 2026 using simple prompts that never mention attractiveness or beauty, analyzing 51,300 generated faces and 160,196 photographs of real people across primary and supplementary comparisons. We used three automated measures and collected ratings from 550 human raters on a subset of images. Nearly all generators produced faces scoring above photographed faces under automated measures, and human raters judged the outputs of all 23 generators as significantly more attractive than photographed faces, even after correction for multiple comparisons. When focusing our analysis on gender, we find that 37% of female-prompted generated faces outscored the median professional fashion model. Across racial, ethnic, and national categories, groups associated with darker skin tones tended to receive lower attractiveness scores than groups associated with lighter skin tones. In a preregistered hiring simulation experiment (N = 570), exposure to AI-generated faces selected for high human-rated attractiveness lowered hireability and trustworthiness ratings and reduced interview advancement for an identical test set of candidates paired with photographs of real people; exposure to retouched photographs produced no such effect. Generative AI can reproduce racial hierarchies and gendered patterns of beauty and alter the context in which real people are judged.

106. 【2610.22549】CFC26: Building Evaluations for Deployment in Sonar-Based Fish Counting

链接:https://arxiv.org/abs/2610.22549

作者:Madison Van Horn,Suzanne Stathatos,Sevan Brodjian,Justin Kay,Kai Van Brunt,Erik Young,Sara Beery,Pietro Perona,Michael Hobley

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Accurate counts, harvest limits, decisions for conservation, populations are essential, making large-scale monitoring

备注:

点击查看摘要

Abstract:Accurate counts of fish populations are essential for monitoring ecosystems and making decisions for conservation, harvest limits, and river management. In many field deployments, these counts are obtained from sonar videos that experts must inspect manually, making large-scale monitoring slow, expensive, and difficult. Automated counting systems have been proposed as a scalable alternative, but so far this promise has been difficult to realize in deployment. Developing evaluations that better reflect real-world deployment conditions will help close this gap and drive improvements in counting performance in practice. To achieve this, we propose Caltech Fish Counting 2026 (CFC26), a new dataset with improved evaluation protocols that simulate deployment to seen and novel rivers, testing in-distribution and out-of-distribution performance. We expand the CFC22 dataset to eleven deployment locations across nine Pacific salmon river systems from Alaska to Northern California, capturing a broader geographical and ecological range of data. We additionally introduce two new evaluation metrics for counting, nMNE and nMANE, that mirror the operational workflow that experts use and help surface errors that frame-level detection metrics do not capture. Using these metrics, we reveal previously-concealed directional bias in upstream vs downstream counts, which would have direct and significant ecological implications if undetected. The dataset and code are publicly available on CaltechDATA and GitHub.

107. 【2610.22537】FlashControl: One-Step Controllable Generator via Distillation-Friendly Single-Stream Teachers

链接:https://arxiv.org/abs/2610.22537

作者:Ngan Nguyen,Dung Nguyen,Quan Dao,Dimitris N. Metaxas,Minh Hoai,Cuong Pham,Anh Tran

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:visual generative modeling, generative modeling, leading approach, approach in visual, visual generative

备注: Accepted at The 40th Annual Conference on Neural Information Processing Systems (NeurIPS 2026)

点击查看摘要

Abstract:Diffusion models have become a leading approach in visual generative modeling, particularly effective in text-to-image and controllable generation. Their main drawback is slow inference as it requires many sampling steps. While recent distillation methods enable one-step text-to-image generation, extending these techniques to controllable generation is still challenging. Existing controllable models, such as ControlNet, rely on dual-branch design that make distillation difficult. In this work, we adopt a simpler strategy. Instead of adding extra conditional branches, we finetune a selected subset of layers in the original text-to-image diffusion model to directly enable controllable generation. This results in DeltaControl, a single-flow, multi-step diffusion model capable of supporting spatial-condition generation while matching the performance of dual-branch approaches. Building on this teacher model, we further apply step-distillation to obtain FlashControl, a one-step model capable of spatial controllable generation with a single forward pass.

108. 【2610.22523】Learning the Shared Latent Structure of Cryo-EM Inverse Problems

链接:https://arxiv.org/abs/2610.22523

作者:Nithin Chalapathi,Theo Sternlieb,Ethan Han,Sonya M. Hanson,Pilar Cossio,Aditi S. Krishnapriyan,Ritwik Gupta

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

关键词:Understanding biomolecular function, cryogenic electron microscopy, biomolecular function requires, function requires characterizing, requires characterizing three-dimensional

备注:

点击查看摘要

Abstract:Understanding biomolecular function requires characterizing three-dimensional structure and conformational variability, for which cryogenic electron microscopy (cryo-EM) is a powerful tool. Cryo-EM produces noisy two-dimensional particle images in which molecular structure, particle pose, and imaging conditions are jointly encoded. Recovering biological information from these observations spans inverse problems including pose estimation, heterogeneity analysis, and reconstruction. These tasks are usually addressed independently despite shared protein structure and image formation, motivating a common representation across inverse problems. Since biologically meaningful differences may be spatially localized, we study self-distillation with complementary global and masked patch objectives. Because experimental dataset discrimination can reflect acquisition-specific cues, we develop controlled synthetic and experimental evaluations and find that structural discrimination benefits from dense spatial features. We introduce the EMber family of vision transformers, pre-trained on 50 million experimental particle images from 214 EMPIAR datasets together with simulated projections from 268,000 molecular assemblies. EMber improves upon existing methods at conformational and compositional discrimination by 14.85 and 14.26 percentage points, estimates conformational populations to within 1.59pp error with a linear probe, and produces particle assignments yielding reference-quality reconstructions in fewer epochs. We demonstrate how to learn representations that capture biological information for use across multiple cryo-EM inverse problems.

109. 【2610.22514】owards Reconstructing Geographically Diverse Architecture with 3D Foundation Models

链接:https://arxiv.org/abs/2610.22514

作者:Nicky Kriplani,Yiwen Zhang,Angelina Wang,Hadar Averbuch-Elor

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Internet-scale photo collections, single feed-forward pass, remain highly challenging, Internet-scale photo, estimate scene structure

备注: NeurIPS 2026. Project Page: [this https URL](https://arch-world.github.io/)

点击查看摘要

Abstract:Internet-scale photo collections of real-world landmarks have driven progress in 3D computer vision yet remain highly challenging for modern 3D foundation models (3DFMs) that estimate scene structure in a single feed-forward pass. In this work, we introduce ArchWorld, a benchmark of 3D architectural landmarks with high geographic coverage and rich metadata. We use this benchmark to conduct a thorough error analysis of current 3DFMs to understand where they fall short and how they can be improved. We examine socially relevant disparities in model error and find that model performance varies by geographic region; however, unlike typical fairness regimes, the trends only partially match training data representation. Our investigation reveals that the observed geographic disparities reflect not only differences in data representation and scene size but also differences in region-specific architectural features and background distractors that make scenes from different regions inherently vary in difficulty. Leveraging insights from these model failings, we introduce an intervention scheme that improves 3DFM performance while simultaneously reducing geographic disparities.

110. 【2610.22509】riSAR-3D and PaintFusion: A Novel Trimodal LiDAR-RGB-Thermal Dataset and Method for 3D Person Detection in Search and Rescue

链接:https://arxiv.org/abs/2610.22509

作者:Markus Kramer,Jan Wachenfeld,Oskar von Stryk

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:responders situational awareness, situational awareness, robotics to give, give first responders, responders situational

备注:

点击查看摘要

Abstract:Reliable 3D person detection is important for rescue robotics to give first responders situational awareness. Yet most multimodal 3D detection research targets automotive scenarios in which pedestrians mostly appear in a narrow range of upright, near-road poses. It is therefore unclear how much of the reported performance transfers to rescue settings, as a person may be lying, partially occluded, or in unstructured indoor and outdoor environments. To investigate this gap, we introduce TriSAR-3D, a multimodal person detection dataset recorded with a high-resolution 128-channel LiDAR, an RGB camera, and a thermal camera. It captures varied poses in indoor as well as outdoor locations at different times of day to study their influence on 3D object detector performance. Furthermore, we propose a novel trimodal 3D detection pipeline, PaintFusion, that fuses PointPainting-based evidence using a simple MLP. We show that the derived method reaches 65.4 AP@50 and thereby outperforms strong LiDAR-only (CenterPoint, 53.4), RGB+LiDAR (BEVFusion, 60.5), and adapted trimodal (Tri-BEVFusion, 60.7) baselines on the dataset. At the same time, it is substantially faster than other fusion-based methods such as BEVFusion, with a per-frame latency of 51.6 ms compared to 101 ms. Additionally, we test how the performance of different 3D object detectors generalizes to unseen pose categories. Removing lying instances from training data collapses the lying-pose AP@50 to near zero across all evaluated detectors. The results indicate that dataset diversity exerts a large effect on 3D object detection performance. The dataset and code are available at this https URL.

111. 【2610.22505】KFS$^4$LAM: Adaptive KeyFrame Selection with Structure-Aware Mapping for Endoscopic Gaussian Splatting SLAM

链接:https://arxiv.org/abs/2610.22505

作者:Xinwei Ju,Zhehua Mao,Tianyi Song,Danail Stoyanov,Sophia Bano,Francisco Vasconcelos

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Gaussian-splatting Simultaneous Localization, Gaussian-splatting Simultaneous, enabling high-quality reconstruction, augments conventional SLAM, Simultaneous Localization

备注: 8 pages, 5 figures, 3 tables

点击查看摘要

Abstract:Gaussian-splatting Simultaneous Localization and Mapping (SLAM) augments conventional SLAM with a dense, renderable 3D scene representation, enabling high-quality reconstruction and novel-view synthesis. However, its localization, reconstruction, and rendering performance depends strongly on which observations are retained for mapping. Existing systems commonly rely on fixed temporal intervals or simple pose- and overlap-based criteria for keyframe selection. In colonoscopy, non-uniform camera motion, repetitive anatomy, specularities, and visual artifacts can make these criteria unreliable, leading to either redundant keyframes or missed informative viewpoints. We present KFS$^4$LAM (KeyFrame Selection with Structure-aware mapping for endoscopic Gaussian Splatting SLAM), which couples motion-guided adaptive keyframe selection with structurally supervised mapping and restricted temporal deformation. Accumulated motion guides adaptive keyframe selection, with complementary cues suppressing redundant or unreliable candidates. Density-aware mapping with anatomical contour supervision (colon folds) emphasizes structurally informative regions, while restricted temporal deformation accommodates local tissue dynamics without unconstrained geometric drift. We evaluate KFS$^4$LAM against Gaussian-SLAM baselines on C3VD and C3VD-v2, together with cross-backbone and component ablations. KFS$^4$LAM achieves strong overall performance across trajectory, rendering, and depth metrics, with pronounced gains on more challenging C3VD-v2 dataset. In the matched comparison with SplaTAM on C3VD-v2, it reduces rotational relative pose error by 20.3% and depth RMSE by 38.4%, while improving PSNR by 0.78 dB. Cross-backbone experiments further show that the framework is not tied to a single underlying SLAM architecture. Code and visualization results are available at this https URL.

112. 【2610.22499】JAVIS: Joint Audio-Visual Interaction and Streaming for Real-Time Conversational Agents

链接:https://arxiv.org/abs/2610.22499

作者:Junseok Ahn,Jaehyun Park,Jeongsoo Choi,Joon Son Chung,Ji-Hoon Kim

类目:Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

关键词:Human communication, inherently multimodal, conveying intent, communication is inherently, linguistic and vocal

备注: 5 pages, 2 figures. Project page: [this https URL](https://mm.kaist.ac.kr/projects/JAVIS)

点击查看摘要

Abstract:Human communication is inherently multimodal, conveying intent not only through linguistic and vocal cues but also through visual signals. However, existing conversational systems have mainly focused on text or speech, leaving out the visual feedback that is essential for natural interaction. In this paper, we propose JAVIS, an end-to-end streaming framework for real-time audio-visual conversational agents. Our key idea is to let the voice and the face speak from a single representation. On top of a shared LLM, a Joint Refined Head produces a unified audio-visual representation, which is fed into dedicated streaming branches for speech and face generation. This end-to-end design avoids intermediate bottlenecks, enabling real-time generation while keeping speech and face tightly synchronized. In addition, we present JAVIS-Syn, a 334-hour synthetic corpus designed to address the lack of expressive audio-visual dialogue data, covering emotionally rich multi-turn conversations and assistant-style exchanges. Experiments show that JAVIS achieves approximately 200$\times$ lower initial latency than a strong baseline, while outperforming baselines in lip synchronization and facial expression appropriateness.

113. 【2610.22474】Star Light, Star Bright: Can Multimodal Models Parse an Astronomy Visual Question Answering Dataset Right?

链接:https://arxiv.org/abs/2610.22474

作者:J. P. Naiman

类目:Computer Vision and Pattern Recognition (cs.CV); Instrumentation and Methods for Astrophysics (astro-ph.IM); Digital Libraries (cs.DL); Information Retrieval (cs.IR)

关键词:Visual Question Answering, field of Visual, figure understanding capabilities, large multimodal models, Question Answering

备注: 5 main pages, 12 pages total, accepted to The 4th Annual Workshop for Artificial Intelligence for Scientific Publications (WASP) 2026, International Joint Conference on Natural Language Processing Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL)

点击查看摘要

Abstract:Figures are essential for scientific communication, and the field of Visual Question Answering (VQA) aims to test the figure understanding capabilities of large multimodal models (LMMs). Here, we investigate the accuracy of several low-cost LMMs on domain-specific VQA tasks for astronomical images of the sky. As instrument for this task we build a domain-specific VQA dataset comprising 2001 partially-synthetic figures divided evenly between contour plots, real telescope images drawn from NASA's SkyView, and "fake" sky images which share the axes and angular scales of the real images but draw their colors from a gaussian mixture model, alongside 47357 questions. Each figure is released as pristine and with realistic page-aging degradations mimicking the historical astronomical corpus. Testing three low-cost proprietary LMMs, we find models frequently fail to answer domain-specific questions at high accuracy. An initial comparison with 104 human-verified, astrometrically tagged figures from historical journal publications shows similar median errors in angular extent. All code is available on GitHub: this https URL and dataset is available on HuggingFace: this https URL.

114. 【2610.22471】Has GPT-6-Astra Achieved Embodied Intelligence?

链接:https://arxiv.org/abs/2610.22471

作者:SenseNova,Joint Research Team:Zhongang Cai,Ziang Cao,Tailai Chen,Han Chong Chua,Linjun Dai,Hanming Deng,Hokin Deng,Haiwen Diao,Chenjing Ding,Weichen Fan,Xiao Fu,Zerui Gong,Chenyang Gu,Zexin He,Zhi Hou,Bo Li,Qinyue Li,Quanzhou Li,Xiaowan Li,Zhichao Liao,Dahua Lin,Zilong Lin,Bo Liu,Chunxiao Liu,Pengfei Liu,Tianqi Liu,Ziwei Liu,Chen Change Loy,Lewei Lu,Jiapeng Luo,Yuexiao Ma,Liang Pan,Xingang Pan,Oscar Qian,Ziyi Shang,Yuyao Shao,Dawei Su,Dacheng Tao,Qingyi Tao,Quan Wang,Ruisi Wang,Xiaogang Wang,Ziyi Wang,Beichen Wen,Donghao Wu,Jiaxu Wu,Silei Wu,Xiaoming Wu,Zhonghua Wu,Hongcan Xiao,Weiye Xu,Atsushi Yamashita,Lei Yang,Zhe Yang,Baiqiao Yin,Wanqi Yin,Hanfei Zhao,Tianbo Zhong,Long Zhuo,Jing Zuo

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

关键词:building specialized models, demonstrates a level, navigation that challenges, challenges the conventional, conventional paradigm

备注: Homepage: [this https URL](https://sensenova.ai/has-gpt-6-astra-achieved-embodied-intelligence)

点击查看摘要

Abstract:GPT-6-Astra demonstrates a level of competence in robotic manipulation and navigation that challenges the conventional paradigm of building specialized models for individual tasks and embodiments. In this report, we ask not only how capable GPT-6-Astra is, but what its capabilities imply for the field. First, we probe the limits of standalone GPT-6-Astra. We conduct a large-scale evaluation across 12 representative benchmarks spanning tabletop manipulation, humanoids, mobile platforms, and dexterous hands. Under a unified protocol that allows in-context learning (ICL) from training-set demonstrations and substantially increases the number of execution steps, GPT-6-Astra achieves unprecedented performance (Fig. 1). Future research may focus on improving 1) the generality of ICL 2) cost and execution time, 3) physical-state verification, 4) recovery from irreversible failures, and 5) long-horizon preservation of progress. Second, we study the agentic harness for embodied control. We identify that close-loop coordination between a high-level "System 2" reasoner (i.e., GPT-6-Astra) and a low-level "System 1" controller (e.g., {\pi}0.5) is costly but effective. Third, we examine GPT-6-Astra on real-world deployment. Our experiments on 8 robot configurations reveal substantial gaps: 1) robot demonstrations required for ICL are expensive to collect, and 2) it is implausible to trade longer execution for higher success rates with physical constraints. Fourth, we envision the next generation of embodied benchmarks. We develop a prototype that 1) derives tasks from real-world needs, 2) provides no in-domain demonstrations, and 3) judges agents on a world clock that keeps running while they deliberate. Taken together, our results suggest that GPT-6-Astra has largely crossed the threshold of embodied competence, but not yet that of practical embodied intelligence.

115. 【2610.22457】Erase the Mark, Preserve the Motion: Temporally Consistent Removal of Video Watermarks

链接:https://arxiv.org/abs/2610.22457

作者:Yifan Liao,Zhen Sun,Zhicong Huang,Jiaming He,Zongmin Zhang,Xi Ai,Cheng Hong,Xinhu Zheng,Xinlei He

类目:Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

关键词:attacks remains underexplored, removal attacks remains, Recent advances, copyright protection, remains underexplored

备注: Our videos and code can be viewed on: [this https URL](https://sites.google.com/view/poseregen)

点击查看摘要

Abstract:Recent advances in video generation have increased the demand for reliable watermarking for copyright protection, yet the robustness of video watermarks against removal attacks remains underexplored. Most watermark-removal methods originate from the image domain: signal optimization injects imperceptible pixel-domain perturbations, whereas generative resynthesis produces a visually similar instance through diffusion synthesis. When extended to videos, the former introduces temporally varying noise that causes visible flickering, while the latter regenerates fine-grained structures inconsistently across frames, leading to structural motion inconsistency. To evaluate video watermark robustness, we propose PoseRegen, a pose-consistent reconstruction framework that removes watermarks while preserving the original content and motion. PoseRegen first applies a temporally shared viewpoint transformation to disrupt watermark-bearing spatial patterns and then jointly reconstructs the transformed sequence with a pose-conditioned video model. A frozen video DiT processes the complete sequence with its reference-video latent, and full-sequence Flow Matching supervision keeps identity and background consistent across frames. To further preserve motion structure, we introduce a lightweight Pose-Conditioned Motion Consistency Adapter that adapts the frozen backbone to temporally ordered pose guidance and constrains body-part trajectories throughout reconstruction. Experiments on eleven video watermarking schemes show that PoseRegen reduces the average bit accuracy to 0.505, near random guessing, while outperforming the strongest baseline by 9.34% on motion-related VBench metrics. These results reveal a practical vulnerability of current video watermarks and highlight the need to evaluate robustness jointly with temporal and motion quality.

116. 【2610.22444】Event-STVG: Spatio-Temporal Video Grounding for Long-Form Event Reasoning

链接:https://arxiv.org/abs/2610.22444

作者:Yizhe Zhang,Xujia Wang,Songqi Tang,Xujie Tang,Leo Jiahao Jiang,Jiacheng Wang,Bowen Qu,JinBo Li,Qin Wang,Ji Qi,Lei Hou,Bin Xu,Juanzi Li

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Spatio-Temporal Video Grounding, Spatio-Temporal Video, Video Grounding, natural-language query, existing STVG benchmarks

备注:

点击查看摘要

Abstract:Spatio-Temporal Video Grounding (STVG) aims to jointly localize a target in space and time given a natural-language query. Despite continued advances, existing STVG benchmarks remain largely centered on localizing targets through instance-specific descriptions, leaving them largely decoupled from long-form reasoning increasingly emphasized in multimodal large language models (MLLMs). In this paper, we introduce Event-STVG, a task that shifts STVG from locating what is described toward event-level reasoning by unifying long-form context, repeated-event reasoning, event localization, role inference, and multi-target grounding. To facilitate research on Event-STVG, we construct a large-scale benchmark comprising 4,016 annotated event occurrences across soccer and seven additional domains. Experiments with state-of-the-art MLLMs reveal substantial difficulty, with the strongest model achieving only 5.4% m-vIoU at the 10-minute horizon. Across domains, we consistently observe confusion among repeated same-type events, spatial grounding bottlenecks, and rare success in jointly grounding all required roles. Event-STVG establishes a new challenge for visual understanding in MLLMs, calling for future models that can jointly reason about complex events across space and time. Code and annotations are available at this https URL

117. 【2610.22440】An Agentic ENF Framework for Forensic Video Authentication Against Generative AI

链接:https://arxiv.org/abs/2610.22440

作者:Ryan Wyton(1),Bacha Rehman(1) ((1) Southampton Solent University)

类目:Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Signal Processing (eess.SP)

关键词:generator artefacts degrade, artefacts degrade sharply, Generative models, hard to distinguish, generator artefacts

备注: 12 pages, 17 figures, 4 tables. Submitted to IEEE Transactions on Information Forensics and Security. Code and data: [this https URL](https://github.com/RyanSolent95/enf-video-forensics)

点击查看摘要

Abstract:Generative models now synthesise video that is hard to distinguish from genuine footage, and learned detectors that key on a generator's artefacts degrade sharply on unseen models. This paper develops a forensic framework that authenticates video by a signal that generation does not control: the electric network frequency (ENF), the mains-driven hum in audio and flicker in video. A unified two-channel detector extracts the ENF from audio and from rolling-shutter video through one second harmonic estimator and a shared network; a synthetic-injection training method, driven by an Ornstein-Uhlenbeck drift model and anchored to real recordings, overcomes the scarcity of labelled ENF data; a reference-matching channel verifies a claimed time of recording and recovers an unknown one; and a two-axis agentic orchestrator fuses recording authenticity with content-manipulation evidence under an asymmetric rule, escalating expensive detectors only when needed. A central finding reframes the task: an ENF-band flicker is present in generated video at a prominence indistinguishable from real footage, so its presence is not proof of authenticity, and authentication must rest on consistency with an independent reference rather than on presence. On held-out real recordings the detector accepts genuine audio and video at 93% and 100% against naive baselines of 53% and 15%; claimed-time authentication reaches an area under the curve of 1.0; and the agentic cascade matches a flat ensemble while cutting wall-clock time by 54% and frames decoded by 64%, without loss of accuracy.

118. 【2610.22437】CF-NODE: Counterfactual Spatial Node Intervention for Test-Time Adaptation Under Domain Shift, Evaluated Across Five Diabetic Retinopathy Datasets

链接:https://arxiv.org/abs/2610.22437

作者:Sabarish G,Deepak Parashar

类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词:Automated fundus-based diabetic, fundus-based diabetic retinopathy, expand screening capacity, substantially expand screening, Automated fundus-based

备注:

点击查看摘要

Abstract:Automated fundus-based diabetic retinopathy (DR) grading can substantially expand screening capacity, but source-trained models degrade sharply across different cameras, clinics, and patient populations. Existing test-time adaptation methods depend on entropy minimization or target information accumulated from image batches and streams. These mechanisms can reinforce confidently incorrect predictions and break down when clinical images arrive independently. We introduce CF-NODE, a novel counterfactual test-time adaptation framework for cross- domain DR grading. Instead of trusting prediction confidence or estimating a target distribution, CF-NODE asks how each prediction responds under a controlled intervention on the evidence supporting it. CF-NODE ranks internal spatial nodes using model-derived attention, feature magnitude, and node-set similarity, progressively attenuates the highest-ranked nodes, and uses the stability of the resulting expected-grade response to apply a bounded calibration of the predicted grade distribution. The framework is fully frozen and adapts every image independently using only geometric views and a fixed source-derived prior, requiring no target-derived information or model updates. We evaluate CF-NODE on five external DR datasets under repeated-seed evaluation against TENT, EATA, SAR, and T3A. CF-NODE outperforms all four methods with statistically significant improvements over the second-best method, improves AUC on every target domain, and attains the highest average AUC and macro-F1, delivering stronger grade discrimination together with more balanced recognition across DR severity levels. These results demonstrate that counterfactual intervention sensitivity provides consistent and deployment-ready domain robustness for single-image clinical inference.

119. 【2610.22408】ECHOES: Seeing Beyond the Current Image via Recursive History Compression and Privileged On-Policy Distillation

链接:https://arxiv.org/abs/2610.22408

作者:Tengda Guo(1),Jiawang Hu(2),Yifei Tao(3),Yin Wang(2),Haotian Hu(4),Fanyi Wang(5),Liujuan Tang(2) ((1) Tsinghua University, (2) StepFun, (3) Nanyang Technological University, (4) Zhejiang Leapmotor Technology Co., Ltd., (5) Honor)

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:undermining long-horizon reliability, increases visual-token usage, discard critical state, screenshots increases visual-token, critical state information

备注: 22 pages, 7 figures, 13 tables

点击查看摘要

Abstract:Long-horizon GUI agents rely on visual history to maintain task states, but retaining historical screenshots increases visual-token usage and inference costs, while textual summaries can discard critical state information, undermining long-horizon reliability. We propose ECHOES, which leverages training-time privileged information to guide textual history compression and strengthen long-horizon reasoning. Specifically, ECHOES adopts a Compression-Think-Action (CTA) format to recursively update a textual history state and reason. The same model, given privileged multi-image inputs, serves as a teacher that provides dense token-level on-policy distillation on student-generated CTA rollouts. Our Perception-Memory Fidelity (PMF) Gap-guided OPD-RL framework dynamically balances privileged distillation and task-reward optimization, with periodic teacher updates supporting continued improvement. We further introduce ECHOESBMK, a fine-grained diagnostic benchmark derived from real GUI agent failure trajectories to jointly evaluate visual perception and cross-modal state retention. Experiments on four GUI benchmarks and ECHOESBMK demonstrate substantial gains in task performance and memory fidelity. Without retaining historical screenshots at deployment, ECHOES achieves competitive performance with a favorable performance-inference-cost trade-off and exhibits positive zero-shot transfer to unseen visual planning tasks.

120. 【2604.27553】Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models

链接:https://arxiv.org/abs/2604.27553

作者:Xiaomeng Wang,Martha Larson,Zhengyu Zhao

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:Large Visual Language, Visual Language Model, observed in font, wide variety, visual text style

备注: Accepted by ICMR 2026. Code is available at [this https URL](https://github.com/XiaomengWang-AI/The-Impact-of-Visual-Text-style-on-Attribute-based-Descriptions-Produced-by-LVLMs)

点击查看摘要

Abstract:When the visual style of text is considered, a wide variety can be observed in font, color, and size. However, when a word is read, its meaning is independent of the style in which it has been written or rendered. In this paper, we investigate whether, and how, the style in which a word is visualized in an image impacts the description that a Large Visual Language Model (LVLM) provides for the concept to which that word refers. Specifically, we investigate how functional text styles (readability-oriented, e.g., black sans-serif) versus decorative styles (display-oriented, e.g., colored cursive/script) affect LVLMs' descriptions of a concept in terms of the attributes of that concept. Our experiments study the situation in which the LVLM is able to correctly identify the concept referred to by a visual text, i.e., by a word or words rendered as an image, and in which the visual text style should not influence the attribute-based description that the LVLM produces. Our experimental results reveal that even when the concept is correctly identified, text style influences the model's attribute-based descriptions of the concept. Our findings demonstrate non-trivial style leakage from text style into semantic inference and motivate style-aware evaluation and mitigation for LVLM-based multimedia systems.

121. 【2604.20012】EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training

链接:https://arxiv.org/abs/2604.20012

作者:Yiyang Du,Zhanqiu Guo,Haochen Zhang,Annabella Macaluso,Xin Ye,Liu Ren,Yonatan Bisk,Chenyan Xiong

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

关键词:VLM, inherit their visual, embodied domain, visual and linguistic, linguistic capabilities

备注:

点击查看摘要

Abstract:Vision-Language-Action Models (VLAs) inherit their visual and linguistic capabilities from Vision-Language Models (VLMs), yet most VLAs are built from off-the-shelf VLMs that are not adapted to the embodied domain, limiting their downstream performance. In this work, we propose EmbodiedMidtrain to bridge the gap between VLMs and VLAs. We first characterize the data distribution gap between them, showing that VLA data occupy compact regions that are largely separated from the broader VLM distribution, while the degree of alignment varies substantially both across and within VLM data sources. Then, we build a mid-training data engine that leverages a lightweight learnable proximity estimator to select the most VLA-aligned candidates from a large VLM pool, and produce EmbodiedMidtrain-1M, a VLM dataset that we further use to mid-train the VLM before downstream VLA fine-tuning. Experiments on both simulated robot manipulation benchmarks and real-world tasks show consistent VLA performance gains over off-the-shelf checkpoints across VLM backbones and VLA action heads. These gains extend to downstream tasks not used to guide data selection. Further analysis reveals that mid-training provides a stronger initialization for VLA fine-tuning, with gains emerging from the earliest steps and widening throughout training. Moreover, the data engine captures both dataset-level and sample-level alignment signals, favoring spatial reasoning over text-centric tasks while preserving the diversity of the VLM data. We will release all code, data and models for future research.

122. 【2610.23325】ransNSNet: A Transformer-Enhanced Multi-Scale Adversarial Framework for CT-to-PET Image Synthesis

链接:https://arxiv.org/abs/2610.23325

作者:Shaojun Li,Xiaoyu Deng,Ikuo Keshi

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:Transformer-enhanced multi-scale adversarial, Transformer-enhanced multi-scale, multi-scale adversarial framework, paired CT-PET dataset, study investigates

备注: 21 pages, 7 figures. Supplementary material included. Under review at Biomedical Signal Processing and Control

点击查看摘要

Abstract:This study investigates CT-to-PET image synthesis using TransNSNet, a Transformer-enhanced multi-scale adversarial framework. A paired CT-PET dataset was curated from the public non-small cell lung cancer (NSCLC) Radiogenomics collection through patient screening, slice-level matching, preprocessing, and patient-level train-test separation. The proposed framework generates PET-like predictions at multiple spatial scales and applies coarse-to-fine reconstruction supervision, while TransPatchGAN introduces contextual feature interaction into adversarial evaluation. A progressive ablation study compares Pix2Pix, NSNet-Base, NSNet-D, and TransNSNet. Image-level performance was summarized over a fixed convergence window (epochs 80-101) from one training run per model. TransNSNet achieved the best mean value in nine of ten metrics, whereas NSNet-Base achieved the highest visual saliency-induced index. For fixed-fraction high-intensity regions, NSNet-D was marginally higher in slice-level recall and balanced accuracy, but the equal-weight patient-level values were nearly identical and the highest Dice values shifted to TransNSNet. These differences were small relative to between-patient variability. In the separate adaptive patient-level analysis (n=10), no pairwise model difference remained statistically significant after Holm correction. TransNSNet also had a substantially smaller parameter footprint than the original next-scale models. These findings indicate promising image-quality trends, but they do not establish statistical superiority or clinical validity; synthesized PET-like images should not be interpreted as substitutes for clinically acquired PET.

123. 【2610.22958】Stabilizing Illumination Conditioning in SSM-Based Low-Light Image Enhancement with Bottleneck Prompt Sidecars

链接:https://arxiv.org/abs/2610.22958

作者:Wei Chen Ng,Qiyi Xie,Jian Ding Tan,Yan Kang Lee,Abdulrab Hakim Qaid Abdullah,Wei Hown Tee

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:Low-light image enhancement, real low-light images, local detail loss, exhibit spatially varying, Low-light image

备注:

点击查看摘要

Abstract:Low-light image enhancement (LLIE) requires more than brightness amplification because real low-light images often exhibit spatially varying illumination, amplified noise, color distortion, and local detail loss. Recent SSM- and Mamba-based restorers provide efficient long-range modeling, yet the route for introducing illumination priors into such backbones remains insufficiently studied. This study addresses safe illumination conditioning for SSM-based LLIE through a bottleneck-side PromptAdapter. A lightweight illumination estimator first predicts a single-channel illumination map, which is then converted into prompt tokens and injected through a residual sidecar adapter at the bottleneck, thereby avoiding direct modification of the state-space core. Under a locked three-seed evaluation protocol on LOL-v1, LOLv2-Real, and LOLv2-Synthetic, the PromptAdapter improves over the Base model by 0.94 dB, 1.24 dB, and 0.93 dB in PSNR, respectively, while also improving SSIM, LPIPS, and masked dark-region metrics. The clearest real-data evidence appears on LOLv2-Real. A Learned-Fixed control on LOL-v1 indicates that the present results support the utility of the sidecar conditioning pathway more strongly than a strict claim of illumination-conditioned superiority, and the LOLv2-Synthetic result remains stability-conditioned. These findings suggest that, in SSM-based LLIE, conditioning design can be as important as the conditioning signal itself.

124. 【2610.22847】Measurement-Adaptive Light-Cone Transform for Robust Non-Line-of-Sight Imaging

链接:https://arxiv.org/abs/2610.22847

作者:Lianfang Wang,Xueying Liu,Junnan Dong,Qinghua Zhang,Jun Liu,Yong Wang,Yuping Duan

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:idealized light transport, conventional light-cone transform, light-cone transform, Measurement-Adaptive Light-Cone Transform, light transport

备注:

点击查看摘要

Abstract:Practical non-line-of-sight (NLOS) measurements are affected by noise and deviations from idealized light transport, which can degrade reconstruction with conventional light-cone transform (LCT) methods. We propose the Measurement-Adaptive Light-Cone Transform (MALCT), a physics-guided framework that retains the efficient Fourier-domain inversion structure of LCT. {Within a unified variational formulation, MALCT combines the analytical response with a shared learned response through measurement-conditioned weighting and predicts a measurement-conditioned, frequency-dependent regularization map.} An attention-enhanced spatio-temporal feature extraction module captures long-range temporal dependencies and local spatial correlations to support reconstruction under low-signal conditions. Experiments on synthetic data and real measurements from different NLOS systems demonstrate improved reconstruction quality. Controlled evaluations further assess robustness to temporal-response broadening and reduced acquisition time. MALCT also preserves scene structures with spatial sampling grids down to $32\times32$, supporting its potential for NLOS imaging under limited acquisition budgets.

125. 【2610.22655】Is a Linear Probe Evidence of a Linear Representation?

链接:https://arxiv.org/abs/2610.22655

作者:Nadir Kutluozen,Christian Internò,David Klindt

类目:Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:linearly decodable directions, representation hypothesis holds, standard methodology, hypothesis holds, decodable directions

备注: Accepted at NeurIPS 2026

点击查看摘要

Abstract:The linear representation hypothesis holds that pretrained vision models encode generative factors as linearly decodable directions in feature space, and comes with a standard methodology: train a linear probe, declare a factor represented if accuracy is high. We show this test is too permissive. Asymptotically, any sufficiently rich feature map, including a random one, admits a linear readout, so high probe accuracy is consistent with two very different geometries: a true linear world model, where the latent-aligned subspace dominates the representation, or a kernel machine, where the latents lie linearly inside a much larger curved manifold. This distinction matters because the curved structure orthogonal to the probe is relevant for out-of-distribution generalization, robustness, and compositional transfer. We propose three asymmetric diagnostics that distinguish the two cases: reverse predictivity, spectral concentration, and out-of-distribution generalization. We validate them in a fully observed simulation where ground truth is known. Applied to six pretrained vision transformers on SVG-World, our deterministic generative benchmark with paired visual styles, and to two of them on CelebA, they show pretraining produces structure beyond a random kernel but well short of a linear world model. On dSprites, 3D Shapes and MPI3D, forward decodability and latent-aligned variance dissociate. Thus, forward decoding alone does not show that the probed factors align with the dominant geometry of the representation. In summary, our work cautions about the success of linear probes as opposed to truly linear and low dimensional representations.

126. 【2610.22643】LGGS: Longitudinal MRI Reconstruction via Guided Group Sparsity

链接:https://arxiv.org/abs/2610.22643

作者:Nikola Janjušević,Hersh Chandarana,Yao Wang,Li Feng

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:Serial MRI, current clinical practice, MR-guided radiotherapy, routinely performed, practice for disease

备注: 10 pages main, 8 figures main, 5 pages supplementary, 7 figures supplementary

点击查看摘要

Abstract:Serial MRI is routinely performed in current clinical practice for disease surveillance and applications such as MR-guided radiotherapy. However, long MRI scan times increase costs and limit patient access, making accelerated image reconstruction of broad clinical importance. Previous scans of the same patient contain image information highly correlated with the current exam, yet existing reconstruction methods rarely exploit this information. Major challenges in the effective use of prior scans include inter-visit misregistration, pathological changes, and image phase variation. In this work, we propose Longitudinal Guided Group Sparsity (LGGS), an interpretable deep-learning framework for longitudinally informed MRI reconstruction derived from classical group sparsity. The prior scan is incorporated into the reconstruction regularizer through learned phase-invariant circulant attention that identifies corresponding features across exams. This formulation provides robustness to local in-plane and through-plane misregistration as well as inter-visit phase variation. Across acceleration rates, LGGS achieves state-of-the-art performance on longitudinal T1-weighted multi-coil brain MRI data, outperforming the evaluated unguided and longitudinally informed reconstruction methods, with substantially fewer learned parameters. We further evaluated the contributions of multiple guide slices and phase-invariant similarity and demonstrated that accelerated prior images can also serve as effective guides with minimal degradation in reconstruction quality.

127. 【2610.22569】Alignment of visual brain encoding models with individual perceptual similarity judgments

链接:https://arxiv.org/abs/2610.22569

作者:Daniel Chong,Haomiao Chen,Keith W Jamison,Raja Marjieh,Ilia Sucholutsky,Nori Jacoby,Amy Kuceyeski

类目:Neurons and Cognition (q-bio.NC); Computer Vision and Pattern Recognition (cs.CV)

关键词:similarity, perceptual similarity, Natural Scenes Dataset, similarity judgments, predicting observed brain

备注:

点击查看摘要

Abstract:Encoding models that predict brain activation responses to images have traditionally been trained to maximize accuracy when predicting observed brain data. However, their internal representations may not reflect individual human perception. In this work, we investigate whether we can fine-tune brain encoding models to better align their representations with individuals' similarity judgments. Using similarity judgments of 100 images from 8 participants in the Natural Scenes Dataset (NSD), we adapt a generic human similarity judgment model (DreamSim) separately for each participant to obtain personalized perceptual similarity models. These models are then used to obtain subject-specific similarity structure across images in their encoding model training sets. We fine-tune each participant's baseline encoder in two conditions, aligning its representations with either generic or personalized similarity judgments, with the same initialization and objective. We find that baseline brain encoders reflect within-subject perceptual similarity more strongly than measured fMRI responses and preserve intersubject correlations present in measured fMRI, but fail to reflect those of human perceptual similarity judgments. Fine-tuning with generic, population-level perceptual similarity information results in better alignment with human judgments than baseline encoders, but these models still fail to capture intersubject correlations of human judgments. However, fine-tuning with personalized perceptual similarity information results in models that are the most aligned with human perceptual similarity judgments and also reflect intersubject correlations of human judgments. Our framework provides an approach for bootstrapping human similarity judgment data into more individualized, human-aligned brain encoding models of vision.

128. 【2610.22472】A Unified Theory of Image Scaling: Point Spread Functions, Discrete Kernels, and Scale-Spaces

链接:https://arxiv.org/abs/2610.22472

作者:Assaf Shocher

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词:Huygens-like consistency principle, mathbf, identifying a Huygens-like, Huygens-like consistency, reproduces optical zoom

备注:

点击查看摘要

Abstract:We derive the optically aligned system of image-scaling operators $\mathbf{K}_s$ that reproduces optical zoom (exact zoom-out, canonical zoom-in), by identifying a Huygens-like consistency principle in which each pixel acts as a secondary source. The system is determined in closed form by the camera's point spread function (PSF), itself the operator $\mathbf{K}_0$. The operators compose, $\mathbf{K}_{s'} \circ \mathbf{K}_s = \mathbf{K}_{ss'}$ (with band projection for down-up), and account for both upscaling and downscaling, which form a Moore-Penrose pseudoinverse pair, $\mathbf{K}_{1/s} = \mathbf{K}_s^\dagger$. We show that image scaling, as routinely practiced, is neither optically faithful nor internally consistent; for example, common anti-aliasing rules generally correspond to no camera, and two resizes by a factor of $1/2$ generally do not equal one resize by a factor of $1/4$. Gaussian scale-space kernels cannot be exact finite-aperture PSFs. Gaussian scale-space is an idealized special case of what emerges here: a generalized scale-space for sampled images, derived entirely from camera optics, bidirectional, and not limited to Gaussian kernels. The system goes beyond scaling and supports composable and invertible subpixel geometric transformations. We empirically validate its optical predictions with real captures and noisy optics simulations, and demonstrate its practical impact on the stability of tasks such as super-resolution and classification.