本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新801篇论文，其中：
- 自然语言处理94篇
- 信息检索18篇
- 计算机视觉138篇
自然语言处理
1. 【2611.08478】Scientist World: Grow a Research World for AI-Scientists
链接：https://arxiv.org/abs/2611.08478
作者：Taiming Lu,Sachin Konan,Zhuang Liu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：world, build Scientist World, research, Abstract, Human
备注：
点击查看摘要
Abstract:AI-Scientists arrived, but a world for them to grow in did not. Human scientists take theirs for granted $-$ centuries of open problems and shared ideas, waiting in the scientific literature. To AI-Scientists, that world is readable but not runnable, so we build Scientist World for them: every research paper becomes an executable environment. Our autonomous pipeline extracts each paper's open-ended research question and reproduces its proposed method as the baseline; an AI-Scientist entering the environment is evaluated against what the human authors achieved. We release the first 1,000 verified environments. With the world as an evaluation, we found that frontier AI-Scientists can already surpass the human researchers 74% of the time. As a record of how AI does science, it contains 6,400 hours of research traces, with every idea, experiment, failure, and success. As a training ground, we are able to raise (+158%) a small model to match frontier models in research ideation. At last, AI-Scientists' own world has arrived, grown from and growing with science itself.
2. 【2611.08453】Unpacking the Compute Efficiency of Strong-to-Weak OPD against GRPO
链接：https://arxiv.org/abs/2611.08453
作者：Zeyu Leo Liu,Yang Li,Bo Pang,Emre Can Acikgoz,Xuan-Phi Nguyen,Anurag Koul,Srijan Bansal,Erik Nijkamp,Shafiq Joty,Semih Yavuz
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：teacher per-token supervision, Group Relative Policy, GRPO, frozen teacher per-token, Relative Policy Optimization
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) trains a student on its own rollouts under a frozen teacher's per-token supervision. Does this dense signal reduce the training FLOPs needed to reach a target accuracy compared with reinforcement learning? We systematically compare vanilla reverse-KL OPD with Group Relative Policy Optimization (GRPO) across task difficulty, student and teacher size, domain, and optimization choices, measuring held-out accuracy against training FLOPs. With an external post-trained teacher, OPD generally loses to GRPO in accuracy per training FLOP at matched settings, even when the teacher is further trained with GRPO, and often suffers response-length inflation. Yet a different teacher changes the picture: when the teacher is the student's own GRPO checkpoint, OPD recovers that checkpoint's accuracy on math with $50\times$ fewer distillation FLOPs than GRPO needs to reach the same accuracy. Following the same teacher setting, we consistently observe this high efficiency with a larger student, on code, and in a second model family. On a single domain, however, the GRPO checkpoint is already the desired model, so distilling it adds to total compute. Across domains, separate GRPO checkpoints hold different capabilities, and no single checkpoint serves every domain. Multi-teacher OPD (DeepSeek-AI, 2026) consolidates per-domain GRPO experts into a single student that matches each expert's accuracy, with the distillation stage costing only 5.2% (on 2 domains) and 8.0% (on 4 domains) of the specialist training FLOPs. Counting specialist training and distillation together, this pipeline reaches joint GRPO's performance on the 2-domain mix with 42.0% fewer total FLOPs.
3. 【2611.08439】Label-Wording Augmentation in a Typed-Decision Encoder: Gains on Unfamiliar Words, Not on Abbreviations or Codes
链接：https://arxiv.org/abs/2611.08439
作者：Vladimir Beskorovainyi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Typed-decision models score, Typed-decision models, models score options, models score, model developer
备注： 11 pages, 6 tables. Model: [this https URL](https://huggingface.co/besktech/ru-jev) ; code: [this https URL](https://github.com/beskvladimir-create/ru-jev) ; archived release: [this https URL](https://doi.org/10.5281/zenodo.23986847)
点击查看摘要
Abstract:Typed-decision models score options that the caller supplies at request time, so their accuracy depends on label wording that the model's developer does not control. We compare two releases of a 307M-parameter multilingual cross-encoder, Ru-Jev, trained on thirteen Russian-language tasks; the later release adds an augmentation that presents labels in several surface forms. Holding questions fixed and varying only how eighteen routing labels are worded, we evaluate ten label vocabularies, produced by three separate processes and checked for overlap with the training data, with five candidates per question and, for eight of them, also with eighteen. On held-out vocabularies made of ordinary or borrowed words (English-derived jargon, office slang, department names), the augmented release is more accurate in every setting, by up to 0.24. Eleven of these fourteen gains survive a Holm correction (slang with eighteen candidates and descriptive sentences with five do not), and for jargon on all labels the label-level interval excludes zero in both settings. On abbreviations and opaque codes it gives no usable gain: on abbreviations it is not better, and worse on the clean slice, and on opaque codes both releases stay at or below chance once labels related to training options are removed. In most cells where accuracy rises, the risk-coverage area falls, but with eighteen candidates confident errors rise on jargon and slang. On two datasets neither release saw, accuracy moves by -8.4 and +5.6 points. We also report four evaluation hazards from comparing the two releases.
4. 【2611.08438】Understanding AI from the Inside: The State of Mechanistic Interpretability for AI Safety
链接：https://arxiv.org/abs/2611.08438
作者：Fazl Barez,Tung-Yu Wu,Hunar Batra,Gabriele Dominici,Florent Draye,Yanai Elazar,Damiano Fornasiere,Antía García,Abir Harrasse,Riley Harris,Sara Hooker,Michael Lan,Belinda Z. Li,Aaron Maiwald,Narmeen Fatimah Oozeer,Naomi Saphra,Or David Shafran,Adi Simhi,Robert Trager,Shriyash Kaustubh Upadhyay,Ziyu Yao,Yu Zhao,Shay B. Cohen,Mor Geva,Yoshua Bengio,Stella Biderman,Hassan Sajjad
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Neural networks, human history, Mechanistic interpretability, consequential artefacts, artefacts in human
备注：
点击查看摘要
Abstract:Neural networks are likely to be among the most consequential artefacts in human history. As these systems become more capable and autonomous, their potential to cause societal harm also grows, making AI safety one of the defining challenges of our time. Yet we continue to build increasingly powerful systems without fully understanding how they work, how they will behave in unfamiliar situations, or how to reliably control them. Mechanistic interpretability offers a path towards understanding these systems by studying their internal representations and computations, with the aim of evaluating, predicting, and controlling behaviour. We survey mechanistic interpretability for AI safety in order to answer the question: Does understanding how models work actually make them safer? We place mechanistic interpretability in the broader context of interpretability research and compare its mechanistic evidence with behavioural evaluation. We introduce the foundations of mechanistic interpretability, including features, polysemanticity, transformer computation, and circuits, and survey methods for feature extraction and analysis, circuit discovery and causal verification, explaining intermediate representations in natural language, learning dynamics, and training-data attribution. Beyond surveying existing methods, we propose a unified framework for evaluating mechanistic interpretability claims and characterise six research orientations by their goals, assumptions, and trade-offs. Finally, we examine how mechanistic understanding can support AI safety, including knowledge editing, steering, and monitoring, and assess its limitations, failure modes, open problems, and relationship to behavioural safety measures. We also release a repository of code notebooks with worked examples that reproduce key findings from surveyed methods, allowing readers to build intuition through hands-on experimentation.
5. 【2611.08433】MedGraph: Maintaining Patient State with Graph Memory for Long-Term Medical Dialogue
链接：https://arxiv.org/abs/2611.08433
作者：Donghua Zhang,Zizheng Wang,Ze Dong,Yiding Feng,Siyu Qian
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：LLM-based medical assistants, clinical state correct, patient clinical state, assistants that follow, LLM-based medical
备注： 14 pages, 5 figures, 8 tables
点击查看摘要
Abstract:LLM-based medical assistants that follow a patient across visits need a memory that keeps the patient's clinical state correct as it changes. We examine the errors of five memory systems on longitudinal medical dialogue and find three recurring causes: the retrieved evidence gives an outdated state, includes another person's health facts, or lacks a safety fact the answer depends on. We present MedGraph, a graph memory built for these three cases. Construction extracts dated facts from each session, attributes each fact to the person it describes, and links medication, diagnosis, and measurement records into chains that keep earlier states. Retrieval ranks the patient's chains as units, reads each chain at the time the question asks about, and adds the original dialogue text; a patient profile lists every recorded safety fact with every question. On MedMemoryBench, MedGraph has the highest overall accuracy with both a GPT and a Qwen backbone, 10.5 and 10.4 points above the strongest of five baselines, with efficient memory construction and answering in the GPT setting.
6. 【2611.08403】StepBack: Step-Level Error-Localized Resampling for Efficient Test-Time Reasoning
链接：https://arxiv.org/abs/2611.08403
作者：Yang Ouyang,Jung-Eun Kim
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：preset budget, Self-consistency, widely used decoding, decoding strategy, requires sampling
备注： NeurIPS 2026
点击查看摘要
Abstract:Self-consistency (SC) is a widely used decoding strategy for improving chain-of-thought reasoning, but it requires sampling many complete reasoning trajectories with a preset budget. Its efficient variants reduce the cost mainly by stopping full-trajectory sampling early or distributing the number of samples across questions. In this paper, we propose StepBack, a step-level error-localized resampling method for efficient test-time reasoning. Given a small set of draft trajectories, StepBack localizes likely first error positions using lightweight signals and then resamples the detected error step and its suffix, followed by majority answer voting. Empirically, StepBack matches the accuracy of SC on average across seven mathematical reasoning and multi-hop QA benchmarks, while reducing token usage by up to 41.26%. In addition, by nature, StepBack can be combined with adaptive inference methods such as Adaptive Consistency, further improving their inference-time efficiency.
7. 【2611.08362】SpecCTMC: Exact Speculative Simulation of Diffusion Language Model Continuous-Time Markov Chains
链接：https://arxiv.org/abs/2611.08362
作者：Siva Rajesh Kasa,Yasong Dai,Sumit Negi,Hongdong Li
类目：Computation and Language (cs.CL)
关键词：Masked diffusion language, Masked diffusion, independently sampling multiple, diffusion language models, language models offer
备注： 28 pages, 5 figures
点击查看摘要
Abstract:Masked diffusion language models offer parallel text generation, but independently sampling multiple tokens can disrupt their dependencies and change the output distribution. Exact continuous-time sampling avoids this approximation, yet typically requires one sequential model evaluation per token. We introduce SpecCTMC, a training-free speculative sampler that reduces this sequential bottleneck without a separate draft model. SpecCTMC proposes successive token updates using previously computed model predictions, evaluates their intermediate states in parallel, and applies an exact acceptance-and-correction procedure. We prove that SpecCTMC preserves the joint distribution of event times, generation order, and token values of the underlying continuous-time Markov chain. It therefore introduces neither time-discretization error nor additional factorization error from parallel decoding. Experiments on LLaDA-8B-Instruct and Dream-v0-Instruct-7B across five benchmarks demonstrate 1.73-4.38x fewer sequential model evaluations than direct continuous-time sampling, while preserving the reference sampling distribution. Our code is available at: this https URL
8. 【2611.08334】Cultural Adaptation within Repeated Social Interactions
链接：https://arxiv.org/abs/2611.08334
作者：Chen Cecilia Liu,Roi Reichart,Anna Korhonen
类目：Computation and Language (cs.CL)
关键词：human culture, culture is tacit, typically learned, learned through situated, situated social interaction
备注：
点击查看摘要
Abstract:Much of human culture is tacit and is typically learned through situated social interaction. As LLMs are deployed as interactive agents across diverse communities, assessing their cultural competence demands moving beyond existing question-answering approaches, shifting from what they know to how they adapt. In this work, we broaden the scope of cultural adaptation in NLP by investigating whether LLMs can adapt through repeated interactions via a sandbox environment. By reframing cultural adaptation as a continuous process of norm assimilation through social interaction, our work demonstrates that memory mechanisms foster longitudinal learning across repeated interactions, facilitate transfer to different social settings, and enable multilingual norm assimilation across five languages. Together, our findings lay the groundwork for continuous, interaction-driven cultural adaptation in LLMs.
9. 【2611.08323】Polarity Classification with Multitask Learning Syntax Augmentation
链接：https://arxiv.org/abs/2611.08323
作者：Muhammad Imran,Carlos Gómez-Rodríguez
类目：Computation and Language (cs.CL)
关键词：fundamental NLP task, NLP task concerned, fundamental NLP, NLP task, information in text
备注：
点击查看摘要
Abstract:Sentiment Analysis (SA) is a fundamental NLP task concerned with the identification and categorization of subjective information in text. While lexicon-based methods offer transparency, they often struggle with linguistic phenomena such as negation and intensification. Syntactic parsing has been integrated into SA pipelines to address this, but conventional parsers introduce significant computational overhead. Recent work shows that reformulating dependency parsing as a Sequence Labeling (SEL) task can improve efficiency. We propose and compare two strategies for integrating syntactic knowledge into a neural sentiment analysis model under unified Multi-Task Learning (MTL). The first, Standard-MTL, jointly learns dependency parsing (via sequence labeling) and sentiment polarity classification using a shared encoder with two task-specific heads. The second, Contrastive-MTL, provides implicit syntactic guidance through a contrastive auxiliary objective and a syntax-biased attention pooling mechanism, without requiring explicit label prediction. Both rely on syntactic annotations during training and eliminate need for hand-crafted compositional rules or external parsing at inference. We evaluate eleven datasets spanning seven languages---the MARC corpus (English, Spanish, French, German) and seven datasets from SemEval-2022 Task 10 (English, Spanish, Norwegian, Basque, Catalan)---using four established SEL encodings. With the relative encoding, Contrastive-MTL outperforms a syntax-naive baseline on 10 of 11 datasets and surpasses the external rule-based pipeline (SELSP) that parses at inference on all six datasets where the latter applies, while being 1.5--9$\times$ faster at evaluation. Standard-MTL is more dataset- and encoding-dependent. These results show implicit syntactic supervision during training can match or exceed explicit parsing at inference without computational overhead.
10. 【2611.08315】Benchmarking Large Language Models on Heterogeneous Cognitive and Biomedical Knowledge Graphs: The Role of Graph Grounding in Multi-Hop Reasoning and Hallucination Mitigation
链接：https://arxiv.org/abs/2611.08315
作者：Ali Sarabadani,Kheirolah Rahsepar Fard,Tahereh Jeirani
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, remains unclear, ability to reason, reason reliably
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used in biomedical and cognitive neuroscience, but their ability to reason reliably over heterogeneous knowledge graphs (KGs) remains unclear. We benchmark five LLMs (GPT-5.1, Gemini 2.0 Pro, Llama 3, Qwen, and BioGPT) across five KGs: DrugBank, NeuroSynth, Cognitive Atlas, Brain Map, and GDPKG. We introduce a multitier query dataset to evaluate reasoning depth and factual accuracy under KG-aware (graph-grounded) and KG-agnostic conditions. Inter-annotator agreement was substantial, with Cohen's kappa of 0.781 (range: 0.753-0.807) and Fleiss' kappa of 0.77. Results show that general-purpose models, particularly GPT-5.1 and Gemini 2.0 Pro, generally outperform domain-specific models on multi-hop and high-level reasoning tasks, although performance declines as query complexity increases. KG grounding reduces hallucination rates across all evaluated models. Contrary to our initial hypothesis, domain-specific models do not consistently outperform general-purpose models on specialized tasks without graph grounding. These findings highlight the value of combining broad language-model capabilities with structured domain knowledge. We provide practical guidance for selecting LLM-KG integration strategies based on task complexity and computational constraints, and discuss hybrid neurosymbolic architectures for personalized medicine, cognitive disorder diagnosis, and explainable AI.
11. 【2611.08311】LLM-Assisted Label Noise Correction for EEG-Based Sleep Stage Classification
链接：https://arxiv.org/abs/2611.08311
作者：Elmira Salari,Shruti Kshirsagar
类目：Computation and Language (cs.CL)
关键词：Automatic sleep stage, clinical sleep medicine, sleep stage classification, classification from electroencephalography, stage classification
备注：
点击查看摘要
Abstract:Automatic sleep stage classification from electroencephalography (EEG) signals is a critical task in clinical sleep medicine. While deep learning models have shown promising results in this domain, their performance is fundamentally constrained by the quality of training labels, which human experts manually annotate and that are subject to inter-rater disagreement and systematic labeling errors. In this paper, we propose a novel LLM-assisted label-noise filtering pipeline that operates exclusively during training to identify and remove unreliable sleep-stage annotations before retraining the classifier. Specifically, TinySleepNet is first trained on the original dataset to extract per-epoch SoftMax confidence scores, then low-confidence epochs are submitted to LLaMA 3.1 along with their EEG spectral features and surrounding sequence context. The LLM evaluates each epoch against AASM sleep-scoring guidelines and assigns a verdict of RELIABLE or SUSPICIOUS. Suspicious epochs are removed from the training set, and TinySleepNet is retrained on the cleaned data. Evaluated on the Sleep-EDF Expanded dataset using 20-fold cross-validation, our method improves overall accuracy from 81.8% to 84.6% and Macro F1-score from 75.6% to 77.4%, with particularly notable gains in REM detection. Crucially, because the LLM operates only during training, the lightweight TinySleepNet architecture (1.3M parameters) is preserved at inference, making the proposed pipeline suitable for real-time, wearable sleep monitoring applications.
12. 【2611.08307】Measured Coupling for Parallel Decoding in Diffusion Language Models
链接：https://arxiv.org/abs/2611.08307
作者：Tal Oved,Lior Wolf
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Performance (cs.PF)
关键词：Diffusion language models, Diffusion language, safe to commit, Diffusion, Abstract
备注：
点击查看摘要
Abstract:Diffusion language models can write many tokens per step, but must choose which tokens are safe to commit together. Mean-field decoding penalizes pairs of positions whose predictions look alike. We replace this proxy with the coupling itself: how much committing one token changes the model's confidence at another. Cheap probes inside the main forward pass measure it, with no training or extra model, and it plugs into the same mean-field rule. On three models and four benchmarks, our method needs far fewer steps than mean-field decoding and is faster in most settings, also with a key-value cache, at an average accuracy cost of 1.1 points. Shuffling the couplings or replacing them with a uniform bonus loses this gain.
13. 【2611.08281】Multimodal-SEA: Benchmarking AI Agent Security under Multimodal Social Engineering Attacks
链接：https://arxiv.org/abs/2611.08281
作者：Zhitao He,Chi Him Zhang,Chengru Han,Yi R Fung
类目：Computation and Language (cs.CL)
关键词：attacks insufficiently studied, multimodal content, text-based dialogue, insufficiently studied, supported by forged
备注：
点击查看摘要
Abstract:Personal AI agents face social engineering attacks supported by forged multimodal content, but existing evaluations mainly focus on text-based dialogue, leaving their intrinsic security under such attacks insufficiently studied. We introduce Multimodal-SEA, an interactive benchmark comprising 608 expert-designed tasks grounded in real-world fraud cases, covering 14 domains and 152 attack scenarios with prepared multimodal content. The tasks span four difficulty levels and reflect the distinct social and cultural contexts of Chinese and English environments. Agents inspect content, verify requests, and execute actions in simulated applications, with attack outcomes grounded in verifiable tool execution logs. To enable controlled red teaming of personal agents, we design a multimodal attack harness that integrates task information, attack progression control, and multimodal content construction to evaluate their intrinsic security against adaptive social engineering attacks in simulated environments. Evaluating seven widely used multimodal models across six dimensions reveals that all are vulnerable, with attack success rates of 7.1% to 34.5%. Adding multimodal content increases attack success from 19.9% to 29.2%, despite increased proactive verification coverage. Stronger safety instructions reduce attack success without improving recognition of deceptive multimodal content, while lower attack success rates for some models accompany excessive refusal of legitimate requests.
14. 【2611.08262】he Geometry of Simulated Perspectives: Dissociating Representation and Behaviour in a Multimodal Language Model
链接：https://arxiv.org/abs/2611.08262
作者：Mathis Immertreu,Fitim Abdullahu,Thomas Kinfe,Claus Metzner,Helmut Grabner,Patrick Krauss,Achim Schilling
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal language models, Multimodal language, simulate different observers, language models, models can simulate
备注： 30 pages, 10 figures, 2 tables. Code: [this https URL](https://github.com/MathisImm/persona-vlm-representations;) data: [this https URL](https://doi.org/10.5281/zenodo.23664820)
点击查看摘要
Abstract:Multimodal language models can simulate different observers, yet it remains unclear how assigned perspectives reshape their internal representations and whether these changes govern their judgements. Here, we investigate the representational geometry of persona-conditioned visual interestingness in Qwen3-VL-8B-Instruct. Across 100 images and 53 prompting conditions, we systematically vary persona content and the linguistic framing used to introduce it, while recording behavioural ratings and layer-wise hidden states. We observe a systematic reorganisation of representational geometry across processing depth: early layers primarily encode image identity, whereas persona-specific structures emerge in later layers. Strikingly, prompt framing reshapes internal representations more strongly than persona identity, whereas persona content has a greater impact on behavioural judgements. This dissociation is further illustrated by minimal identity statements that alter representations even without changing responses. These findings demonstrate that representational distance does not necessarily reflect behavioural relevance. More broadly, they reveal how simulated perspectives emerge as distinct structures within the representational space of artificial cognitive systems, highlighting a fundamental distinction between the geometry of internal representations and their functional consequences.
15. 【2611.08237】rminal-style Mathematical Modeling Bench: The First Agentic and Verifiable Benchmark for Mathematical Modeling
链接：https://arxiv.org/abs/2611.08237
作者：Xiaojun Wu,Cehao Yang,Xuhui Jiang,Chengjin Xu,Jia Li,Jian Guo
类目：Computation and Language (cs.CL)
关键词：score solver fragments, Mathematical Modeling Bench, Terminal-style Mathematical Modeling, open-ended real-world problem, LLM judge
备注： 20 pages, 4 figures, 14 tables
点击查看摘要
Abstract:Mathematical modeling turns an open-ended real-world problem into assumptions, a model, a solution, and a defended recommendation, and its answers matter only if they are both close to a credible reference and physically feasible; existing benchmarks either score solver fragments or grade reports with an LLM judge, leaving those numbers unchecked. We introduce TB-MathModel (the Terminal-style Mathematical Modeling Bench), the first benchmark to make complete contest-style modeling problems agentic, verifiable, and terminal at once, over 18 real CUMCM and MCM problems (2023--2025). Each task ships the verbatim statement, official attachments, and figures in a containerized terminal; the agent returns one JSON artifact, scored on the numeric core of the final question against a reproduction of the Outstanding-award paper. Two design choices distinguish it: direction-aware, one-sided scoring, which never penalises beating the anchor, and two-layer feasibility verification---a programmatic gate over six decidable invariant forms plus 624 Lean~4 obligations---with a hard gate that zeroes infeasible answers. Each task is scored against a panel of human outstanding papers rather than one, so a model must be close to many accepted answers; across seven multimodal entries (three seeds each) the strongest reach a multi-reference O-Eval of 64.58\%, while the \$2.54 open model holds 59.81\% at $1/100$ the cost. TB-MathModel turns the numeric core of modeling into a reproducible, machine-checkable signal for measuring long-horizon modeling competence and for collecting agent trajectories. The source code is available at this https URL.
16. 【2611.08231】From Twisted Facts to Rogue Agents: Can LLMs Reliably Detect Multi-Dimensional Hallucinations?
链接：https://arxiv.org/abs/2611.08231
作者：Hanyu Qiu,Ze Liu,Zhe Zhao,Kuang Xiong,Blaze Chen,Zhenxiang Yan,Renfen Hu
类目：Computation and Language (cs.CL)
关键词：Large language models, outputs remain vulnerable, agent-based task execution, Large language, content production
备注：
点击查看摘要
Abstract:Large language models (LLMs) are widely used for information access, content production, and agent-based task execution, but their outputs remain vulnerable to subtle, high-risk hallucinations. To systematically evaluate and advance post-generation hallucination detection, we introduce HaluCheck, a large-scale, bilingual benchmark comprising over 42k instances spanning both factual hallucinations in text and faithfulness hallucinations in agent trajectories. HaluCheck features fine-grained, multi-level annotations for detection, localization, and correction, covering different tasks and perturbation degrees. Experiments on fourteen LLMs reveal that, while models show basic sample-level detection ability, they struggle with fine-grained localization, correction, and agent hallucination detection. Further analysis demonstrates that thinking, web search, and supervised fine-tuning each offer partial improvements, but none fully solve the problem. HaluCheck thus provides a solid basis for benchmarking and diagnosing LLM reliability across text and agent scenarios.
17. 【2611.08226】"Blind Compliance": Coercive Control in AI Jailbreaking
链接：https://arxiv.org/abs/2611.08226
作者：Acacia L. Ackles,Elliott Whitson
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：increasingly sophisticated structured, structured prompting techniques, rapidly scaling capabilities, sophisticated structured prompting, increasingly narrow content
备注： 25 pages (14 content pages)
点击查看摘要
Abstract:The explosion of generative AI systems and concerns surrounding their rapidly scaling capabilities has led to an adversarial cycle between increasingly narrow content restrictions ("guardrails") and increasingly sophisticated structured prompting techniques ("jailbreaks"). Technological frameworks surrounding such jailbreaking remain largely focused on the system's output: whether harmful or disallowed content is ultimately produced for the user. However, this approach, which draws largely from classical cybersecurity, does not address the uniquely relational dimension introduced by generative AI: in many cases the user is not just accessing a technology via an exploit, but is in conversation with it as part of the exploit. Here we present an alternative lens which centers the interaction rather than the output. Drawing on interpersonal violence scholarship, we present a novel framework of coercive control categories with a particular focus on aspects which are embodied versus disembodied. We then map how these disembodied coercive control dynamics are structurally embedded in modern AI training paradigms, and how those embeddings are exploited via a particular suite of persona-based jailbreaks. In this lens, we reframe AI safety and alignment as not merely a technical security problem, but as another surface upon which we see enacted the relational dynamics of power and control.
18. 【2611.08219】Agent-R$^2$: Scaling Agents for Realistic Productivity Work via Real-Source Data Synthesis
链接：https://arxiv.org/abs/2611.08219
作者：Teng Pan,Zixuan Wang,Yuchen Yan,Qifei Wu,Yao Chen,Yingqi Qu,Ruiqing Zhang,Yongliang Shen
类目：Computation and Language (cs.CL)
关键词：Large language models, made rapid progress, Large language, raising expectations, language models
备注：
点击查看摘要
Abstract:Large language models have made rapid progress in agentic reasoning and tool use, raising expectations for agents that can take over realistic productivity work from humans. However, current agents still struggle to finish such tasks, where success requires following long-horizon professional workflows, understanding heterogeneous file contexts, and producing usable deliverables under fine-grained requirements. A key bottleneck is the lack of scalable post-training data that reflects real work intent, authentic file environments, and deliverable-level evaluation. To close this gap, we introduce Agent-R$^2$, a $\textbf{r}$eal-source data synthesis framework that scales training data for $\textbf{r}$ealistic productivity work. Instead of relying on manually specified workflows or LLM-generated files, Agent-R$^2$ grounds synthesis throughout the pipeline in real occupational seeds, corpus-derived workflow evidence, and authentic web-sourced files. From 10k web-corpus candidates, Agent-R$^2$ distills 4k task instances that pair real multi-format attachments with fine-grained, deliverable-level rubrics. On this data, we train Agent-R$^2$-4B via supervised fine-tuning and rubric-based reinforcement learning, improving both end-to-end productivity performance and file-grounded reasoning. Trained on only 4k instances, Agent-R$^2$-4B surpasses Qwen3-235B-A22B-Thinking-2507 on both GDPval (51.0$\%$ vs. 48.0$\%$) and OfficeQA (14.8$\%$ vs. 13.8$\%$). Further analysis shows that Agent-R$^2$ mitigates shortcut behavior, where agents produce superficially plausible deliverables before sufficiently grounding, constructing, or verifying them, while promoting sustained exploration.
19. 【2611.08216】ProQuant: Progressive Quantization-aware Training for Edge MLLMs
链接：https://arxiv.org/abs/2611.08216
作者：Yufei Xue,Yushi Huang,Jiawei Shao,Pingcheng Dong,Yonghao Tan,Shiyao Li,Kwang-Ting Cheng,Jun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：downstream applications, impressive perception, capabilities will enable, enable a range, range of downstream
备注：
点击查看摘要
Abstract:Multi-modal large language models (MLLMs) with impressive perception and understanding capabilities will enable a range of downstream applications. However, their substantial computational and memory requirements hinder the real-world implementation, particularly for resource-constrained edge devices. Quantization has emerged as an effective solution for deploying large models. While post-training quantization (PTQ) successfully retains the performance at moderate bit-width (e.g., W8A8), it suffers from severe performance degradation under low-bit quantization (e.g., W4A8), especially for small-scale models that are more suitable for edge deployment. In this paper, we propose ProQuant, a novel weight-activation quantization-aware training (QAT) framework tailored for low-bit MLLMs. First, to align the limited finetuning dataset distribution with the pretrained dataset distribution, we propose a self-relabeling (SRL) scheme to resample the responses of the open-source multimodal dataset. Second, we are the first to take a decoupled view of multi-modal (MM) understanding and language modeling abilities. We propose a progressive block activation (PBA) mechanism to prioritize the MM understanding recovery. We also introduce a vision-sensitive factor $\vec{\tau}$ that effectively identifies the MM-critical layers. Extensive experiments across various benchmarks, covering models with 2B-8B parameters, show that ProQuant significantly outperforms existing methods. For example, our W4A8 Qwen3-VL-2B-Instruct improves average accuracy by impressively 6.6% and achieves performance comparable to full precision counterparts with only approximately 1% performance drop. Code is available at this https URL.
20. 【2611.08196】SMART: State-based Multi Agent Reasoning Traces for Verification-oriented Problem-Solving
链接：https://arxiv.org/abs/2611.08196
作者：Sai Vallurupalli,Francis Ferraro
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：obtain additional knowledge, limited context, obtain additional, SMART, problem context
备注：
点击查看摘要
Abstract:Complex problems with limited context, such as claims, require a means to obtain additional knowledge necessary for solution reasoning. We propose a multi-agent framework, SMART, to obtain knowledge through capturing the implicit state of participating entities in a problem context. SMART curates the state knowledge as diverse, complementary and solution-salient premises using a variety of LLMs and a structured role-based prompt strategy. Using knowledge from these real-world verified curated premises, SMART's knowledge guided solution reasoning improves validation performance up to 20% on complex scientific claims spanning 3 datasets. We show that grounding premises in real-world knowledge is necessary and improves performance up to 5%.
21. 【2611.08179】Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation
链接：https://arxiv.org/abs/2611.08179
作者：Jaewon Cho,Minseo Yoon,Jinyoung Park,Jinwoo Seo,Jaewon Chu,Alice Oh,Hyunwoo J. Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：conditioned on reference, reference solutions, teacher, OPSD, Teachable On-Policy Self-Distillation
备注：
点击查看摘要
Abstract:On-Policy Self-Distillation (OPSD) improves reasoning by training a student on its own reasoning, using the same model conditioned on reference solutions as a teacher. Applying OPSD to multilingual reasoning requires the teacher to provide useful feedback across languages, even when the student makes mistakes in intermediate steps. We observe a phenomenon we call Teacher Drift: as these mistakes accumulate, the teacher may follow the student's incorrect steps instead of correcting them. Our analysis shows that this shift tends to occur earlier in lower-resource languages. To account for these differences across languages, we propose Teachable On-Policy Self-Distillation (TOPSD), which determines where and whether teacher supervision should be applied to each reasoning trajectory. TOPSD uses teacher-student likelihood to estimate where drift begins and select a prefix for supervision. It then verifies whether the teacher can recover the correct answer from that prefix, applying distillation only to prefixes that pass verification. Experiments on multilingual mathematical reasoning across ten languages and three model scales show that TOPSD consistently outperforms conventional OPSD, particularly in low- and medium-resource languages.
22. 【2611.08162】RouteAlign: Aligning Task Requirements with Model Profiles for LLM Service Selection
链接：https://arxiv.org/abs/2611.08162
作者：Jihao Zhao,Ding Chen,Yanfang Chen,Bo Tang,Feiyu Xiong,Junchi Yan,Zhiyu Li
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：selection requires performance, requires performance evidence, service selection requires, requires performance, LLM service selection
备注：
点击查看摘要
Abstract:LLM service selection requires performance evidence that reflects the demands of the current task. Aggregate scores obscure differences in capability and difficulty, while semantically related examples can involve different combinations of skills. We present RouteAlign, which uses task requirements to structure both the measurement of model performance and the selection of services. Task requirements describe capability demand and difficulty, enabling alignment with corresponding model performance measurements. Historical requirements determine how outcomes contribute to global profiles and local capability estimates; incoming requirements determine how those measurements inform the current decision. A shared scorer integrates the evidence, and a generation-cost preference controls selection among eligible services. Evaluation across diverse tasks and heterogeneous LLM services shows that RouteAlign extends the empirical quality-cost frontier toward higher task quality. Comparisons with open Jev-style decision backends show consistent quality gains, with lower generation cost than their strongest tested configuration. Ablations support the contribution of local performance evidence, while catalog-update experiments demonstrate effective reuse of the fitted scorer with refreshed model measurements.
23. 【2611.08133】Beyond K/V Caches: Cross-Model State Handoff in Hybrid Linear-Attention LLMs
链接：https://arxiv.org/abs/2611.08133
作者：Jiacheng Cai,Tao Zhang,Siqi Liang,Yun Dai,Ziqian Zeng
类目：Computation and Language (cs.CL)
关键词：Production deployments, quality through cascading, long conversations, balance cost, cost and quality
备注： 12 pages, 4 figures, 9 tables
点击查看摘要
Abstract:Production deployments often use different models to balance cost and quality through cascading, routing, and switching models during long conversations. Context accumulates across turns. Each switch requires the target to repeat prefill over this context. Existing methods transfer full-attention (FA) K/V caches across models. Hybrid linear-attention models also retain recurrent states (REC) and convolution histories (Conv). The interaction between Conv and REC complicates cross-model state transfer. Conv perturbations can change keys and values in recurrent layers and alter REC updates. Conv histories are overwritten, but changes in REC can still affect later outputs. More accurate REC reconstruction need not improve continuation. Building on this, we propose Hybrid State Transfer (HST) for all three state types. It uses structured REC maps and preserves history order during Conv alignment. We calibrate the adapters using the frozen target's outputs during continuation. FA cache map updates are merged offline. Across five benchmarks, Qwen3.5 4B$\rightarrow$27B and 9B$\rightarrow$27B achieve mean task retentions of 89.88% and 94.11%, respectively. With source caches already available, separate timing on synthetic 16K inputs yields handoff body speedups of $21.66\times$ and $21.91\times$.
24. 【2611.08092】Gabor Gabor: E-Gaborformer, a Strictly Causal Speech Recognizer with Gabor-Dictionary Convolutions and Delta-Rule Memory
链接：https://arxiv.org/abs/2611.08092
作者：Nir Krakowski,Tamir Cohen,Ohad Zohar,Chen Zarfati
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD)
关键词：Real-time voice agents, Real-time voice, voice agents, speech recognizer, waits for future
备注： 19 pages, 6 figures, 9 tables
点击查看摘要
Abstract:Real-time voice agents need a speech recognizer that never waits for future audio and whose memory per call does not grow with the length of the call. We present E-Gaborformer, a strictly causal encoder that combines Gated DeltaNet-2 recurrent layers with sliding-window attention in a 3:1 ratio, and builds every temporal convolution from a fixed dictionary of causal Gabor atoms. Its streaming state is constant, about 19 MB per call at production scale including the prediction network, where a causal-attention encoder of the same size accumulates over 1 GB after ten minutes. In a controlled causal study on LibriSpeech, E-Gaborformer leaves the initial plateau earlier, reaches a given accuracy up to 18% sooner, and matches or beats an E-Branchformer trained with the identical front end and recipe. At production scale, a 0.6B-parameter Hebrew and English streaming transducer built on E-Gaborformer has 28 to 31% lower word error rate (WER) than NVIDIA's Nemotron 3.5 ASR Streaming, a model of the same size, on English voice-agent traffic, and up to 20% lower Hebrew WER than our previous production system. The same weights serve strictly causal and 480 ms-lookahead decoding with no loss in accuracy, and a two-class formulation of the RNN-T lattice trains the transducer 2.6x faster with exact loss and gradients.
25. 【2611.08091】ATHAAR: A Medieval Scientific Arabic Manuscript Dataset for Handwritten Text Recognition
链接：https://arxiv.org/abs/2611.08091
作者：Ismail El Jamiy,Khadija Msalek,Guillaume Loizelet,Farah Benamara,Nabil Hathout
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：medieval Arabic scientific, handwritten text recognition, Arabic scientific manuscripts, scientific Arabic manuscripts, scientific manuscripts remain
备注：
点击查看摘要
Abstract:Despite recent progress in handwritten text recognition, medieval Arabic scientific manuscripts remain an open challenge for current vision-language models (VLMs) due to cursive ligatures, variable diacritization, and more importantly the lack of training data. This paper aims to address this gap, by proposing the first annotation guidelines dedicated to the transcription of scientific Arabic manuscripts inspired by textual criticism, a well-established approach to historical text editing. We then propose, ATHAAR, a new dataset manually annotated following this guideline. Unlike previous resources in the field, ATHAAR varies both witnesses of the same text, calligraphic styles, and content to deal with texts but also numerals. Relying on state-of-the-art VLMs, we finally design a set of experiments to study models transfer across scripts, chapters, and treatises. Our findings highlight the limitations of current systems when faced with the specificities of ancient scientific texts.
26. 【2611.08085】Linguistic boundaries emerge from pressure-constrained processing dynamics
链接：https://arxiv.org/abs/2611.08085
作者：Rui He,Philipp Homan,Wolfram Hinzen
类目：Computation and Language (cs.CL)
关键词：Human cognition organizes, cognition organizes continuous, organizes continuous experience, bounded structural units, cognition organizes
备注：
点击查看摘要
Abstract:Human cognition organizes continuous experience into bounded units while maintaining continuity across them. Linguistic elements are also organized into bounded structural units such as words and phrases, with sentence marking the final bound of a grammatical construction process. How do such boundaries emerge? We propose boundaries emerge from interacting demands to maintain unresolved dependencies, integrate completed relations, and update semantic context, with structural completion allowing but not determining closure. First, in a generative simulation without predefined boundary positions or constituent labels, these demands produced sentence-like segment-length distributions and distinct characteristic timescales, with structural completion allowing but not determining closure. Near boundaries, unresolved dependency load declined, integration cost peaked, and accumulated pressure reset. Then, we tested whether same demands predicted human listeners' boundary choices during comprehension. Listeners were more likely to mark boundaries with fewer unresolved dependencies, higher integration cost and semantic mismatch, and elevated preceding memory load, beyond syntactic and prosodic cues. Third, in naturalistic self-paced reading, sentence-final slowing coincided with declining memory load and increasing integration cost and semantic mismatch, broadly consistent with the simulation. Processing same narratives with a large language model revealed increased local intrinsic dimensionality and straighter hidden-state trajectories at sentence endings, followed by larger representational updates. Boundary explained additional variation in reading time and hidden-state geometry beyond processing demands, but considerably less in next-token surprisal. Together, these findings suggest linguistic boundaries emerge as discrete manifestations of transitions in continuous processing dynamics.
27. 【2611.08016】Learning Dynamics of On-Policy Distillation
链接：https://arxiv.org/abs/2611.08016
作者：Guan Zhe Hong,Sumeet Ramesh Motwani,Liang Chen,Yangchen Pan,Junchi Yu,Jialin Yu,Philip Torr,Yi Ren
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：combining dense teacher, On-policy distillation, language-model post-training, combining dense, student-generated trajectories
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) is emerging as an important paradigm for language-model post-training, combining dense teacher supervision with training on student-generated trajectories. This creates a feedback loop where each update changes the student and thereby the training distribution that generates subsequent updates. Yet, how this feedback shapes learning and generalization remains poorly understood. We conduct a mechanistic analysis of OPD's learning dynamics, distinguishing the two feedback loop stages: conversion of the distillation signal into parameter updates, and broadcast through which these updates change predictions across prefixes and reshape the rollout distribution. This framework helps us understand both limited student responsiveness despite substantial teacher-student disagreement, and degeneration when updates that improve local teacher agreement also increase the probability of unsuccessful continuations, exposing the student to unreliable supervision in subsequent rollouts. Finally, we show that offline distillation can prepare a student for OPD without significantly improving immediate held-out accuracy. While OPD alone may degrade generation, it can yield substantial accuracy gains after sufficient offline preparation. Together, our results connect teacher supervision, student geometry, and the evolving rollout distribution in determining the learning dynamics of OPD and its effects on downstream performance.
28. 【2611.08006】Automatic keyphrase extraction and annotation: modern theoretical approaches and practical solutions for text and speech
链接：https://arxiv.org/abs/2611.08006
作者：Daria Guseva,Olga Mitrofanova
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：increasingly significant, exponential growth, growth of textual, textual and audiovisual, audiovisual information
备注：
点击查看摘要
Abstract:The exponential growth of textual and audiovisual information has made the task of automatic keyphrase extraction (KE) increasingly significant. This article provides a comprehensive analysis of contemporary theoretical approaches and practical solutions for KE across both text and speech modalities. The primary contribution of this work is its systematic synthesis of these often-disparate research strands into a unified analytical framework, highlighting the evolution of the field from statistical methods towards large language models (LLMs) and end-to-end speech processing. We examine the stages of KE, the characteristics of keyphrases in written and spoken language, and terminological nuances. Various methods for automatic KE are discussed and analyzed in detail: statistical, hybrid, machine learning-based, and structural. The review dedicates substantial attention to emerging paradigms, including keyphrase generation using LLMs, and provides a detailed overview of methodologies and challenges in automatic corpus annotation. Furthermore, we specifically analyze current directions and inherent difficulties in KE for spoken language, comparing transcript based and end-to-end acoustic approaches. This synthesis leads us to conclude that the field is moving towards a more integrated, context-aware paradigm. Future progress will depend on addressing key challenges such as data scarcity for low-resource languages, effective multimodal fusion, and the nuanced evaluation of generative KE systems.
29. 【2611.07988】Compression Through a Context Lens: Evaluating Adaptation, Quantization, and Distillation in Arabic Legal LLMs
链接：https://arxiv.org/abs/2611.07988
作者：Md. Rafiul Biswas,George Mikros,Wajdi Zaghouani
类目：Computation and Language (cs.CL)
关键词：resource-constrained legal settings, Saudi Arabic legal, facilitate the deployment, deployment of large, evaluation protocol
备注： 2 figures, 4 tables
点击查看摘要
Abstract:Model compression can facilitate the deployment of large language models in resource-constrained legal settings, but its effects on domain-specific performance may depend on the evaluation protocol. We investigate this issue using ArabLegalEval, a Saudi Arabic legal benchmark, under both with-context and no-context evaluation. The former provides supporting legal passages, while the latter assesses performance without external context. Removing the context produces accuracy gaps of up to 27 percentage points for the base model. We examine three stages: domain adaptation, quantization, and knowledge distillation across FANAR-9B, JAIS-8B, and Qwen2.5-7B. Four-bit quantization reduces model memory by 64-71%, with changes in no-context MCQ accuracy ranging from -3.2 to +1.6 percentage points. Distillation produces more variable results, with accuracy generally declining as student size decreases. A Qwen2.5-7B student distilled from FANAR achieves 76.6% no-context accuracy, compared with 77.2% for its teacher. Our findings suggest that no-context evaluation provides a useful complement to context-supported testing when assessing the effects of adaptation and compression on Arabic legal language models.
30. 【2611.07982】How Far Can Lightweight LLMs Go in Intent-to-SLO Translation?
链接：https://arxiv.org/abs/2611.07982
作者：Sabbir Ahmed,Hazem Abbas,Salimur Choudhury
类目：Networking and Internet Architecture (cs.NI); Computation and Language (cs.CL)
关键词：Intent-based networking, promises QoS provisioning, operator-stated goals, network derives, Intent-based
备注： Under review at ICC 2027. Source code and data: [this https URL](https://github.com/ggck43/intent2slo) . (6 pages. 7 figures, 3 tables)
点击查看摘要
Abstract:Intent-based networking (IBN) promises QoS provisioning in which the network derives the configuration from operator-stated goals. Its first step, translating a natural-language intent into enforceable service-level objectives (SLOs) grounded in a live snapshot of the network state, increasingly relies on large language models (LLMs). These large models add cost and energy to the management loop and typically require multi-GPU, cloud-hosted infrastructure. Can lightweight open LLMs take over this step dependably? We answer this question with a five-dimensional evaluation of ten LLMs with 10B parameters from five families, under four prompting setups, on 716 placement intents. We evaluate translation performance, intent validation, hallucination, energy impact, and robustness to diverse phrasing. The best configurations translate intents with a strict F1 of 0.943 and reject up to 191 of 195 invalid intents. With few-shot reasoning, the strongest models hallucinate unsupported QoS requirements in only about one response in a hundred, whereas the zero-shot setup struggles. A translated intent costs 0.044-0.148 Wh of GPU energy without reasoning, and added energy cost for reasoning pays off for the weaker models. Furthermore, we show that realistic rephrasing lowers the rejection of invalid intents in 15 of 16 configurations for the best-performing models, leaving robust intent validation as a key open challenge for reliable IBN. Our code and data are available: this https URL.
31. 【2611.07962】CSExam: Evaluating Frontier LLMs on the Full Range of TCS Research
链接：https://arxiv.org/abs/2611.07962
作者：Yifan Luo,Zhengying Liu,Yang Yuan,Zhilin Yang,Andrew Chi-Chih Yao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, advance theoretical computer, theoretical computer science, language models, advance theoretical
备注： 52 pages, 15 figures. Project website: [this https URL](https://moonshotai.github.io/TCSExam/) Code: [this https URL](https://github.com/MoonshotAI/TCSExam)
点击查看摘要
Abstract:Can large language models (LLMs) advance theoretical computer science and resolve its long-standing open conjectures? To study progress toward this goal, we introduce TCSExam, a unified framework and benchmark covering the full range of TCS research. It evaluates theorem proving, solver engineering, and constructions alongside direct attempts to resolve open conjectures, capturing both concrete research accomplishments and progress toward long-standing research goals. TCSExam-Full contains 100 expert-reviewed tasks, with submissions checked by the Lean kernel or an executable task checker. TCSExam-Lite selects 20 tasks, five per track, reducing the number of task attempts by 80% at the same per-attempt budget. We evaluate eight agents on Full and nine on Lite. The TCSExam Index combines all four tracks: GPT-6 Astra leads Full (71.9), and Opus 5.5 leads Lite (72.3). Full and Lite rankings are strongly aligned across eight shared agents (Spearman's $\rho=0.93$), supporting Lite as a compact, discriminative benchmark. The evaluations yield improved solver outputs and mathematical constructions, together with independently verified special cases and bounds from open-conjecture attempts. TCSExam provides an extensible framework with task sources, Docker build recipes, and evaluation tools for reproducible use.
32. 【2611.07959】CoRD: Coupled Rollouts Fill the Blind Spot of On-Policy Distillation
链接：https://arxiv.org/abs/2611.07959
作者：Guhan Chen,Bohan Li,Jun Rao,Hejin Wang,Songtao Tian,Yexin Xie,Xiaojun Meng,Peng Yuan,Jiansheng Wei,Xuebo Liu,Zixiong Yu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：On-policy distillation trains, On-policy distillation, seldom supervised, student, distillation trains
备注：
点击查看摘要
Abstract:On-policy distillation trains a student on its own rollouts, so states the teacher would reach but the student does not are seldom supervised. We introduce CoRD (coupled-rollout distillation), which keeps the on-policy loss and moves only the distribution of training states toward the teacher, drawing rollouts from a geometric interpolation of student and teacher through the maximal coupling of speculative decoding. The coupling keeps the student's token wherever the two distributions agree and otherwise substitutes a token from the part of the target the student underweights, so interventions are as rare as any exact sampler allows and recede as the student learns. Across six base students from two model families (Qwen3 and Qwen3.5, 0.6B to 4B), CoRD raises average pass@1 over on-policy distillation by 0.9 to 2.0 points and pass@8 by 1.2 to 3.4 points on five public math benchmarks at equal steps and data. On frozen teacher-reached states, a 4B student trained with CoRD reaches in 16 steps a gap closure that on-policy distillation does not reach in 80, and substitution rules intervening at least as often in other directions fall short of CoRD.
33. 【2611.07953】A Behavioural Framework for Predicting and Understanding Loss of Control in Frontier Artificial Intelligence Systems
链接：https://arxiv.org/abs/2611.07953
作者：Yao Huang,Yichi Zhang,Yifan Wang,Yitong Sun,Haoyu Dong,Jifan Ma,Jinzhe Tu,Xiaojian Li,Sören Mindermann,Wei Xu,Yinpeng Dong
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：diminishing human oversight, potentially irreversible consequences, effective human control, Frontier artificial intelligence, systems acting
备注： 39 pages, 5 figures
点击查看摘要
Abstract:Frontier artificial intelligence (AI) systems are increasingly operating over longer horizons with diminishing human oversight, raising the risk of loss of control: systems acting beyond effective human control with potentially irreversible consequences. Because such failures may become observable only after containment is difficult, they must be assessed prospectively. We introduce a behavioural framework that decomposes loss-of-control risk into three factors: misaligned motive, harm-enabling capability, and monitoring evasion. We operationalise these factors through 13 measurable aspects and 29 evaluation tasks, whose scores are combined into a single loss-of-control (LoC) score. Across 13 frontier models, the LoC score shows strong prospective validity, correlating with failure rates in contained long-horizon risk scenarios (Pearson r = 0.84). Risk varies systematically across models and cannot be explained by capability alone. We further show that the framework can guide targeted mitigations: fine-tuning and monitoring directed at diagnosed vulnerabilities reduce failure rates while largely preserving general performance. These results provide a practical basis for predicting, understanding, and mitigating loss-of-control risk before it materialises.
34. 【2611.07949】Beyond the Keyword: A Human-Annotated Benchmark for Arabic Anxiety-Related Discourse
链接：https://arxiv.org/abs/2611.07949
作者：Shimaa Ibrahim,Mabrouka Bessghaier,Md. Rafiul Biswas,Insaf Elouard,Wajdi Zaghouani
类目：Computation and Language (cs.CL); Social and Information Networks (cs.SI)
关键词：Keyword retrieval returns, anxiety-related language, Arabic Twitter, retrieval returns expressions, keyword qalaq
备注： 13 pages, 1 figure, 6 tables
点击查看摘要
Abstract:Keyword retrieval returns expressions of personal anxiety together with many other uses of anxiety-related language. We present a benchmark of 1,000 Arabic Twitter/X posts retrieved with the keyword qalaq ("anxiety/worry") and annotated for six discourse functions. Two native Arabic-speaking annotators labeled every post independently, reaching 51.1% raw agreement (Cohen's $\kappa = 0.378$). We then reviewed all 489 disagreements and all 511 agreements under the same guidelines. The review changed 120 of the agreed labels (23.5%), which shows that agreements need auditing as well as disagreements. The final labels form a consensus reference; on a random sample of 200 posts, an additional annotator agreed with it on 60.5% of posts ($\kappa = 0.517$). Against this reference, Fanar-C-2-27B reaches 79.8% accuracy and macro-F1 0.784 ($\kappa = 0.749$). Its errors concentrate in the residual category (41.1% of errors; precision 0.905, recall 0.447), whose definition is internally inconsistent in the executed prompt, so the low recall cannot be attributed to the model alone. Sociopolitical Anxiety (27.1%) outnumbers Personal Emotional Expression (22.0%); these are assignment proportions in the sample, not estimates of prevalence or retrieval precision. We release the guidelines, a residual-subtype scheme, a fixed data split, label provenance, and evaluation code.
35. 【2611.07940】CardioLM: A multilingual suite of small language models for the cardiology domain
链接：https://arxiv.org/abs/2611.07940
作者：Manuela-Daniela Danu,Miguel Rodríguez-Ortega,Alberto Becerra-Tome,Pablo Arancibia,Fernando Gallego-Donoso,Lorenzo Pratesi,Xi Bai,Andrei-Damian Dinescu,Salvador Lima-López,Andrea Guala,Saskia Haitjema,Jonas Mack,Michele Miranda,Wesam Al Nabki,Jan Rodríguez-Miret,Vasile George Marica,Vladimír Kincl,Kateřina Dostálová,Michael Andrej,Alicia Ujil,Corinne Allaart,Machteld Boonstra,Malin Overmars,Anoop Shah,Giovanna Ceroni,Jonathan Kossoff,Domenico D'Amario,Renzo Laborante,Antonio Iaconelli,Isabella Fumarulo,Jacopo Lenkowicz,Livia Lilli,Emma Weiss,Alex Scafa,Felix Lindberg,Milou Gamage,Eulàlia Farré-Maduell,Sébastien Bratières,Martin Krallinger,Bram van Es
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Cardiovascular care generates, clinical free-text documentation, Cardiovascular care, care generates large, generates large volumes
备注： 91 pages, 7 figures, 33 tables (9 in the main text, 23 in Appendix A, and 1 in Appendix B)
点击查看摘要
Abstract:Background: Cardiovascular care generates large volumes of clinical free-text documentation in local languages. However, clinical natural language processing (NLP) resources remain concentrated in English, and no existing benchmark is cardiology-specific, multilingual, and broad in entity coverage. Methods: We present two contributions. The first is CardioCCC, a corpus of 508 cardiology case reports originally published in Spanish and extended to Czech, Dutch, English, Italian, Romanian, and Swedish through machine translation, annotation projection, and clinician review, with annotations covering diseases, symptoms, procedures, and medications. The second is CardioLM, comprising CardioBERTa, a set of language-specific encoders obtained by continued pretraining on cardiology and biomedical corpora, and CardioNER, a set of named entity recognition (NER) models fine-tuned on CardioCCC. Results: Cardiology-specific pretraining reduced pseudo-perplexity by up to a factor of eight, yet changed strict span-level F1 by at most 0.04, with benefits concentrated in languages whose backbones lacked biomedical coverage. The jointly trained multilingual XLM-RoBERTa-large models achieved the best strict F1 in nearly every language and entity type, exceeding the strongest monolingual system by up to 0.13 F1. A large share of residual errors concerned boundary detection: relaxed matching recovered 0.10-0.23 F1 for disease, procedure, and symptom, but only 0.01-0.07 for medication. Clinicians rated CardioNER well above a rule- and dictionary-based baseline, with the mean rating across entity types rising from 26% to 73%. Conclusions: Specialty-specific pretraining is not the decisive factor for downstream entity recognition, whereas multilingual joint training yields the strongest results in nearly all settings and a simpler deployment path for multi-country clinical information extraction.
Comments:
91 pages, 7 figures, 33 tables (9 in the main text, 23 in Appendix A, and 1 in Appendix B)
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2611.07940 [cs.CL]
(or
arXiv:2611.07940v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2611.07940
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Manuela-Daniela Danu [view email] [v1]
Thu, 5 Nov 2026 12:41:19 UTC (1,689 KB)
36. 【2611.07926】AraEngage: Interpretable Linguistic Correlates of Engagement in Arabic Facebook News
链接：https://arxiv.org/abs/2611.07926
作者：Shimaa Ibrahim,Nour Elhouda Dalloua,Md. Rafiul Biswas,Wajdi Zaghouani
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Social and Information Networks (cs.SI)
关键词：public Arabic Facebook, Arabic, routinely applied, Arabic Facebook, Engagement
备注： 13 pages, 4 figures, 8 tables. To appear in ArabicNLP 2026
点击查看摘要
Abstract:Engagement features developed for English are routinely applied to Arabic, but unvocalized Arabic changes what a lexical feature measures. We introduce AraEngage, a query-defined sample of 10,000 public Arabic Facebook news posts from 2,451 pages in 57 countries (2023-2024) that pairs engagement counts with interpretable linguistic features. We use it to examine which interpretable Arabic indicators are associated with follower-normalized engagement, and how far those associations can be trusted given publisher context, the definition of engagement, and lexical ambiguity. Religious expressions, message length, sentence length, and lexical density are the leading correlates in a Random Forest model ($R^2$ = 0.38 on a post-level split) interpreted with SHAP. Unlike English news, positive sentiment is associated with higher engagement in this Arabic news sample. Message length shows a length paradox: unadjusted raw engagement is highest for long posts, whereas the model's attributions for follower-normalized engagement favor short posts. A linguistic audit identifies why standard lexicon features are fragile in unvocalized Arabic: imperative lists contain homographs such as the form read as "express!" that is also the frequent preposition "via", hedge lists conflate the possibility marker qad + imperfect ("may") with the emphatic qad + perfect ("has indeed"), and religious lists mix devotional formulas with place names in political news. These are plausible sources of measurement error that may attenuate the near-zero associations of imperatives and hedges. All findings are observational associations with operationalized indicators. We release the derived linguistic features, engagement counts, refined lexicons, and analysis code; raw posts are not redistributed, in line with CrowdTangle terms.
37. 【2611.07899】Persistent Retrieval for Conversational Agents: A Study of Retrieval Efficiency
链接：https://arxiv.org/abs/2611.07899
作者：Karthik Ravula,Sathwik Kowtha,Rishabh Verma,Kala Mehak Jain,Gunjit Mittal
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Conversational agents, main agent, retrieve information directly, retrieval, retrieve information
备注： 9 pages, 4 figures, 6 tables
点击查看摘要
Abstract:Conversational agents can retrieve information directly or delegate retrieval to a subagent. This design choice affects how retrieval history is maintained, what context each model call receives, and what information must be re-retrieved in follow-up questions. We compare three designs: skill-based retrieval in the main agent, a non-persistent retrieval subagent that generates a findings response, and our persistent retrieval subagent, which maintains retrieval history across turns and returns retrieved evidence directly to the main agent. Our approach also allows the main agent to request corrections from the same subagent. We evaluate the three designs on enterprise questions posed independently, within shared conversations, and as dependent follow-ups. Across five multi-turn settings, our approach uses 43.3% fewer recorded agent-model tokens and incurs 45.0% lower estimated API cost than skill-based retrieval, while reducing average response time by 9.1%. Compared with non-persistent retrieval, it reduces response time by 15.6 seconds per question, while using 65.1% more tokens and incurring 29.1% higher estimated API cost. Our approach shifts the retrieval subagent from producing synthesized responses to maintaining retrieval state and supplying evidence that the main agent can directly evaluate and use for answer generation.
Comments:
9 pages, 4 figures, 6 tables
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
Cite as:
arXiv:2611.07899 [cs.AI]
(or
arXiv:2611.07899v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.07899
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
38. 【2611.07866】Do Recommenders Need to Think in Words? Latent Reasoning for Efficient LLM-Based Recommendation
链接：https://arxiv.org/abs/2611.07866
作者：Hongyang Su,Beibei Kong,Lei Cheng,Chengxiang Zhuo,Zang Li
类目：Computation and Language (cs.CL)
关键词：systems increasingly generate, recommender systems increasingly, LLM-based recommender systems, LLM reasoning capacity, increasingly generate
备注： Accepted at CIKM 2026 (Short Paper). 5 pages, 2 figures, 3 tables
点击查看摘要
Abstract:LLM-based recommender systems increasingly generate chain-of-thought (CoT) text before each item prediction to activate the LLM's reasoning capacity, costing tens to hundreds of extra tokens per recommendation at inference. We ask whether inference-time reasoning artifacts (textual or latent) can be replaced by training-time supervision alone, without loss of accuracy. We propose LatentRec, a framework for LLM-based generative recommendation that replaces inference-time reasoning artifacts with training-time per-step head supervision. LatentRec has three components. A 2.5M-parameter Continuous Thought Module iterates K latent reasoning steps over the LLM's hidden state during training. Soft Token Selection bridges the ~14x norm gap between hidden states and input embeddings. A Per-step Reasoning Loss (PRL) supervises every intermediate state through the LLM's prediction head against the first token of the target Semantic ID. The trained LLM retains this accuracy without the module at inference, so the module can be discarded at deployment. On three Amazon benchmarks, LatentRec improves HR@10 by 4.0-5.0% (relative) over a CoT-distilled baseline at 18.3x lower latency (batch=1). Per-step training supervision consistently improves accuracy across three datasets, paid once at training rather than at every recommendation.
39. 【2611.07859】CORE: Coarse-to-Fine Search with Context Management for Deep Research
链接：https://arxiv.org/abs/2611.07859
作者：Hoang Tran Vuong,Ngoc Quan Pham,Hung Bui,Fatih Porikli,Dat Quoc Nguyen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Deep research agents, Deep research, answer complex questions, complex questions, Deep
备注： 24 pages
点击查看摘要
Abstract:Deep research agents answer complex questions through repeated search. They rely on a harness that runs their tool calls and returns evidence to their context. This creates a trade-off: Search works best over long passages, which give enough context for reliable semantic matching. But the returned evidence should be short, because every observation stays in the agent's context for the rest of the trajectory. We introduce CORE, a training-free harness that combines coarse-to-fine search with context management. CORE retrieves passages with a dense retriever. It then reuses the token-level similarities from a late-interaction reranker to return only the most relevant snippet from each passage. Context management lets the agent expand the context around sources it has already retrieved and suppresses repeated snippets. In controlled closed-search comparisons with the Tongyi DeepResearch and OpenResearcher harnesses, CORE achieves state-of-the-art answer accuracy and evidence recall across three agent models and three benchmarks (BrowseComp-Plus, BrowseComp-Wikipedia and BrowseComp-Plus-CM), on corpora containing up to 553M documents.
40. 【2611.07854】owards Foundation Decision Models: Drex
链接：https://arxiv.org/abs/2611.07854
作者：Nischay Dhankhar,Alisher Amantay,Zhanibek Datbayev,Darkhan Akhmetov,Yash Shah,Nurmukhamed Ubaidullayev,Raman Saparkhan,Dos Baha,Abulhair Saparov
类目：Computation and Language (cs.CL)
关键词：large language models, reach higher accuracy, range of tasks, Decision models, approaches with large
备注： 51 pages, 13 figures, 25 tables. Models and code: [this https URL](https://huggingface.co/nace-ai)
点击查看摘要
Abstract:Autoregressive approaches with large language models, such as long chain-of-thought reasoning, have become the default for new AI applications because they reach higher accuracy on a wide range of tasks. In production, however, they give inconsistent answers, require parsing of outputs, and add cost and latency. Decision models address this: given a question and a set of options supplied by the user, they return a probability distribution over the options without autoregressive decoding. We present Drex, a family of four open decision models with 8B (DLM), 9B (v1.5), 35B with 3B active (v2.0), and 27B (Max) parameters. Each request consists of a state (a document, record, or agent context, optionally with images) and questions about it, each asking for a choice among options, a yes/no judgment, or a score on an ordered scale. Training combines supervised fine-tuning with reinforcement learning from adjusted feedback (RLAF), plus vision tuning for Max. Ablations show that RLAF improves accuracy and that consistency losses improve robustness to option order. On Decision Index 0.4.1, Max sets a new state of the art among the decision models we compare (67.52 on the public suite vs. 60.70 for Jev 1.14.0). On Decision Bench v4, it is statistically tied with d3-turbo and GPT-6 Sol and trails Claude Opus 5.5 by 1.6 points, and it has the highest accuracy among decision models on DecideBench. Max answers a typical request in 183 ms, against about 2.0 s for GPT-6 Sol and 3.5 s for Claude Opus 5.5, and its outputs are stable under option reordering. All four models are open source: this https URL
41. 【2611.07825】Generate-then-Rank: Learning Symbolic Goal Interpretation for Embodied Agents
链接：https://arxiv.org/abs/2611.07825
作者：Jisen Lei,Huizhi Liang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：formal symbolic goal, Embodied Agent Interface, natural language instruction, planner can execute, Embodied Agent
备注： 14 pages, 2 figures. Accepted at the 10th Euro-China Conference on Intelligent Data Analysis and Applications (ECC 2026)
点击查看摘要
Abstract:Goal interpretation is to translate a natural language instruction into a formal symbolic goal that a planner can execute. It is critical for embodied agents because any error here propagates to every downstream planning and action step. Doing it well requires both generating suitable candidates and reliably selecting among them. We present a two-stage generate-then-rank approach to Goal Interpretation in the Embodied Agent Interface (EAI). First, supervised fine-tuning adapts a Large Language Model (LLM) to EAI's output convention. Second, Candidate-Output Ranking from Errors (CORE) learns preferences over complete outputs from the model's own generated alternatives. We conducted experiments on the household scenes of the Embodied Agent Interface Benchmark. Multiple open source LLMs including DeepSeek-V3 chat, DeepSeek-Reasoner, and Qwen2.5-7B and Qwen2.5-72B were evaluated. The proposed method outperformed the baseline models including LLMs with simple prompting, chain-of-thought, and knowledge graph based approaches.
42. 【2611.07820】Axis-LoRA: Probing and Adapting Embedding Models for Personal-Memory Retrieval
链接：https://arxiv.org/abs/2611.07820
作者：Dohoon Kim,Junho Park,Hyunwoong Bae,Seyoon Kim,Taesup Moon
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：user personal experiences, increasingly asked questions, personal experiences, LLMs are increasingly, increasingly asked
备注： EMNLP 2026 Main
点击查看摘要
Abstract:As LLMs are increasingly asked questions about a user's personal experiences, retrieval must distinguish memories by time, place, person, and event. Current personal-memory pipelines rely on frozen dense embedding models to embed memories for retrieval, but we find that these models do not capture the four axes well. Swapping a memory's date or place barely shifts its embedding, and a trained projection on top of the frozen embedding does not recover the missing signal. The problem lives inside the model, where each axis is encoded by a distinct attention-head pattern. Guided by these findings, we propose Axis-LoRA, a per-axis adapter that places four LoRA branches inside the embedding model and combines them via a per-query gate. Across three standard embedding models evaluated on LongMemEval, ATM-Bench, and LoCoMo, Axis-LoRA improves 4-benchmark mean R@10 by $+1.28$ to $+1.56$~pp while training only a small fraction of the base parameters on a small axis-counterfactual training set. Code is available at this https URL.
43. 【2611.07812】Different Corpora, Different Skills? A Paired Study of Small Language Models
链接：https://arxiv.org/abs/2611.07812
作者：Edoardo Vaira,Georgios Chavales,Pierre Nugues
类目：Computation and Language (cs.CL)
关键词：Entity Tracking, tight data budgets, trained under tight, Small language models, student Entity Tracking
备注： Published in the Proceedings of the Second BabyLM Workshop (EMNLP 2026). 13 pages
点击查看摘要
Abstract:Small language models are often trained under tight data budgets, where the choice of pretraining corpus may matter as much as model size or training recipe. We compare two contrasting corpora at matched 10-million- and 37-million-word budgets: the 1911 Encyclopaedia Britannica and the BabyLM 2026 strict pretraining corpus. For each corpus, we train teacher models, distilled 58-million-parameter Baby-Llama students, and no-distillation student ablations, using the same model families, training recipes, and evaluation protocol across corpora. Across BLiMP, BLiMP Supplement, EWoK, Entity Tracking, and COMPS, the corpora produce different skill profiles rather than a single quality ranking. BabyLM 2026 is consistently stronger on linguistic acceptability benchmarks, while Britannica is often stronger on Entity Tracking, a synthetic state-tracking task. The contrast appears across teacher and student models and at both budgets, with the cleanest cross-seed replication in the distilled student comparison. Targeted controls show that the central contrast persists after matching training exposure and at a longer diagnostic context; direct teacher ensembling also does not reproduce the 10M Britannica student's Entity Tracking behavior. Entity Tracking magnitudes nevertheless remain sensitive to training dynamics. For this corpus pair, corpus choice can therefore produce different relative skill profiles at small scale, motivating multi-benchmark evaluation when comparing pretraining data.
44. 【2611.07805】Decodability Is Not Validity: Evaluating Nuisance Sensitivity in Language Model Concept Probes
链接：https://arxiv.org/abs/2611.07805
作者：Ayal Klein
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：language model hidden, model hidden states, correlated nuisance attribute, equally accurate, accurate at predicting
备注： 4 pages + appendix; code and data: [this https URL](https://github.com/kleinay/decodability-is-not-validity)
点击查看摘要
Abstract:Two concept probes can be equally accurate at predicting a concept from a language model's hidden states while their scores contain different mixtures of the target concept and a correlated nuisance attribute. In four target--nuisance settings (two aspect sentiments in CEBaB; occupation and gender in BiasBios; Amazon review sentiment with negation, and with first-person framing), two LLMs, and a population of concept extractors, we compare decodability with discriminant evidence: the score's dependence on the nuisance at fixed target, and its response to input edits intended to change only the nuisance, filtered by two LLM judges and compared against placebo edits. Under correlated training data, extractors that are statistically equivalent in held-out AUROC differ up to several-fold in nuisance sensitivity in three of the four settings, and decodability is not a reliable proxy for it: their rank correlation changes sign across settings. The effect follows the probe's training data, not the nuisance's natural association with the target: first-person framing, unrelated to sentiment in natural reviews, is absorbed at least as much as negation, which co-occurs with negative sentiment, and decorrelated training removes the systematic effect. Selecting extractors with nuisance-aware development diagnostics, which need nuisance labels but no counterfactuals, lowers counterfactual nuisance sensitivity wherever the default choice is sensitive, at a small accuracy cost. Concept measurements should be validated, not just decoded.
45. 【2611.07797】Dataset Collection and Fine-Tuning of NLLB for German--English Translation
链接：https://arxiv.org/abs/2611.07797
作者：SK Deeraj,Yash Ingle,Pruthwik Mishra
类目：Computation and Language (cs.CL)
关键词：OPUS Books, high-quality parallel corpus, English translation, raw OPUS sentence, paper describes
备注： 6 pages, 5 tables
点击查看摘要
Abstract:This paper describes the curation of a high-quality parallel corpus from OPUS Books and the fine-tuning of Meta's NLLB-200 models for German--English translation. We detail a dataset extraction pipeline that filters 45k raw OPUS sentence pairs to 25k high-quality examples through encoding validation, length filtering, language identification, deduplication, and quality scoring. We present a reproducible fine-tuning methodology optimized for consumer GPUs using mixed precision, gradient accumulation, and gradient checkpointing. Our fine-tuned NLLB-600M model achieves statistically significant improvements (+3.4 BLEU, +2.6 chrF++, -3.2 TER) over the base model on literary and technical German-English translation. We demonstrate practical deployment by integrating the fine-tuned model into LinguaHaru, an existing open-source document translation system, achieving format-preserving translation across PDF and Office documents. All dataset preparation scripts, training code, and evaluation tools are provided for reproducibility. The fine-tuned model is available at HuggingFace.
46. 【2611.07780】Bridging Structure and Semantics: Knowledge Graph Verification via Triple-to-Text Alignment
链接：https://arxiv.org/abs/2611.07780
作者：Ziang Cui
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：knowledge graph quality, graph quality, important dimension, knowledge graph, Abstract
备注：
点击查看摘要
Abstract:Semantic accuracy is an important dimension of knowledge graph quality. Graph-based scoring methods exploit relational structure, while textual representations allow classifiers to draw on knowledge encoded by pre-trained language models (PLMs). We present GenVer, a generative verifier that scores triples using both their serialized form and generated natural language representations (NLRs). A triple-text alignment procedure selects training pairs for a sequence-to-sequence generator; a BERT-based classifier then combines features from each triple and its generated NLR. On four FactFB variants, constructed from FB15k using perturbed negative triples, GenVer obtains the highest classification accuracy among the evaluated baselines, ranging from 88.56% to 91.52%. The experiments suggest that generated representations can help triple classification, while the case analysis also exposes semantic drift and high-confidence errors.
47. 【2611.07756】Scaling Laws for SAE Training Data
链接：https://arxiv.org/abs/2611.07756
作者：Nikita Koriagin,Nikita Balagansky,Daniil Gavrilov
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：training, unique activations, sparse autoencoder, buffer, SAE
备注：
点击查看摘要
Abstract:Activation storage is often a bottleneck in sparse autoencoder (SAE) training. We study how many unique activations an SAE needs when its total training budget is fixed. Quality improves rapidly as the buffer grows, then reaches a plateau where replaying the buffer is nearly as effective as using fresh activations throughout training. Beyond this point, additional unique activations bring little benefit to reconstruction or interpretability, so the buffer need not grow with the training budget. We describe this tradeoff between diversity and repetition with a scaling law for limited data. We validate it across dictionary sizes and token budgets, early, middle, and late layers of Llama-3.1, Qwen3 model sizes, and BatchTopK, TopK, and JumpReLU SAEs. Sweeps using mathematical text and Python code test the effect of changing the activation source. Evaluation covers explained variance (EV), reconstruction MSE, feature absorption, automated interpretability, and sparse probing. These results give a practical training rule: choose the smallest buffer that reaches the quality plateau and replay it for the remaining budget. In our experiments, this reduces activation storage by $8\text{--}64\times$ with negligible quality loss.
48. 【2611.07755】Automated Video-to-QA Pipeline: End-to-End Question Generation and Verification Using Large Language Models
链接：https://arxiv.org/abs/2611.07755
作者：Jaival Chauhan,Vikram Singh,Pruthwik Mishra
类目：Computation and Language (cs.CL)
关键词：efficient knowledge retrieval, informational video content, exponential growth, content on platforms, platforms like YouTube
备注： 4 pages
点击查看摘要
Abstract:The exponential growth of educational and informational video content on platforms like YouTube presents a challenge for efficient knowledge retrieval and assessment. This paper proposes an end-to-end automated pipeline for extracting structured summaries and generating high-fidelity Question-Answer (QA) pairs from video streams. The framework integrates a cascade of state-of-the-art models: audio extraction is handled via FFmpeg, followed by automatic speech recognition (ASR) using Whisper (A library in Python) to generate accurate transcripts. Due to the token constraints of Large Language Models (LLMs), transcripts are segmented and summarized using Facebook's BART. A key innovation of this work is a Self-Verification and Fine-Tuning Loop. We utilize meta-llama/Llama-3.1-8BInstruct to generate candidate QA pairs from transcript chunks, which are then fed back into the model to rigorously assess their relevance and importance. Only verified, high-quality pairs are retained to construct a synthetic dataset. This dataset is subsequently used to fine-tune the Llama model using Low-Rank Adaptation (LoRA), resulting in a specialized model capable of generating domain-aligned assessment questions. This approach demonstrates a scalable method for creating self-improving educational tools without the need for manual data annotation. The proposed model can be downloaded from Kaggle with all the codes from GitHub.
49. 【2611.07736】Extending Reasoning in Typed Decision Models via Looping
链接：https://arxiv.org/abs/2611.07736
作者：David Berghaus,Arber Zela,Behzad Shomali,Markus Frey,Mehdi Ali,Rafet Sifa,Volkan Cevher
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：unlike generative language, Typed decision models, generative language models, Typed decision, single forward pass
备注：
点击查看摘要
Abstract:Typed decision models choose among a fixed set of answer options in a single forward pass, so unlike generative language models they cannot spend more test-time compute on hard inputs by generating more tokens. Looping a block of layers offers this compute in latent space without adding parameters, but prior work found no gain from loops retrofitted into conventionally pretrained models. We show that such loops help when trained together with the decision model. Our method, RELOAD (retrofitted loops for adaptive decisions), fine-tunes a pretrained encoder or decoder with a damped loop over its middle block and a lightweight controller picks the number of passes adaptively for each input. Across six models from 0.4B to 4B parameters, looping improves both accuracy and calibration, mostly on problems that need longer chains of reasoning than any seen in training, where encoders gain up to 23 points. Neither matched training compute nor more data closes this gap, and separate layers for each pass come close only with nearly twice the parameters. The controller keeps most of the gain at about three quarters of the compute.
50. 【2611.07735】Evaluating Token Probabilities as Confidence Estimators in Human Behavior Simulations: A Case Study in Luxembourgish Next Like Prediction
链接：https://arxiv.org/abs/2611.07735
作者：Nils Schwager,Simon Münker,Alistair Plum,Achim Rettinger
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：simulate human behavior, treating human behavior, implicitly treating human, human behavior, large language models
备注： 12 pages, 1 figure, 2 tables. Accepted to 11th Workshop on Natural User-generated Text (W-NUT) at EMNLP 2026, Budapest, Hungary
点击查看摘要
Abstract:As large language models (LLMs) are increasingly used to simulate human behavior, their operational validity is typically assessed through accuracy alone, implicitly treating human behavior as deterministic. We argue that on noisy digital trace data, a model's performance depends not only on predicting the correct outcome but on its calibration. We present a case study testing whether the token probabilities of open-weight LLMs can serve as confidence estimates in a Next Like Prediction task: predicting how a user of the Luxembourgish news platform this http URL rates a comment, conditioned on their prior interactions. Evaluating Ministral 3 (3B, 8B), we find that, with in-context learning only, the tested models are overconfident and are outperformed on accuracy and calibration by a simple statistical baseline. Accuracy and calibration do not move together: scaling from 3B to 8B improves accuracy while degrading calibration, and longer behavioral histories raise accuracy while confidence declines. Task-specific supervised fine-tuning acts as an effective calibration intervention, reducing Expected Calibration Error from 0.2 to 0.006 while improving accuracy from 0.536 to 0.758. We conclude that confidence estimation should be evaluated alongside accuracy to improve validity when using LLM-based agents.
51. 【2611.07731】O$^2$PD: Overlap-Gated On-Policy Distillation on Reliable Prefix
链接：https://arxiv.org/abs/2611.07731
作者：Shuaishuai Zu,Jihao Zhao,Pengfei Li,Guanghuan Fang,Ben Feng,Yuhan Liu,Biao Qin,Baochuan Yang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：supplies dense token-level, dense token-level supervision, teacher next-token distribution, teacher top, teacher
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) supplies dense token-level supervision by aligning a student to the teacher's next-token distribution on its own generated rollouts. Existing works mostly implement top-$k$ OPD, applying reverse Kullback-Leibler ($\RKL$) divergence between the teacher's and the student's renormalized distributions over teacher top-$k$ support. However, the teacher scores student-generated rollouts that are inherently off-policy for itself, leaving the reliability of its next-token guidance unclear. Restricting the divergence to the teacher top-$k$ support also discards the remaining mass outside that support. These gaps leave two questions implicit: 1) which tokens to align, and 2) how to align those tokens. To answer these questions, we propose Overlap-gated On-Policy Distillation (O$^{2}$PD). As for 1), we quantitatively analyze the reliability of teacher supervision and find that alignment on the student's trajectory prefix is more reliable than alignment on the full context. Therefore, our O$^{2}$PD is applied only to the 20\% prefix tokens of each student rollout. As for 2), we theoretically characterize two problems of top-$k$ OPD: the \emph{Teacher-support Uncovering} and the \emph{Dominant-Mode Mismatch}. Based on these analyses, we propose two support strategies: the \emph{Reset Support} strategy attaches a reset atom to every token, pooling mass outside the teacher top-$k$, and the \emph{Support Convergence} strategy converges the support to the already aligned intersection. Our O$^{2}$PD employs the designed overlap-gated $\alpha$-divergence to interpolate between mode-covering and mode-seeking for per-token alignment, where the overlap is used as a gate to switch the support and adaptively modulate $\alpha$.
52. 【2611.07721】Continued Training of Continuous Language Flows with Token Identity Squared Supervision
链接：https://arxiv.org/abs/2611.07721
作者：Jiawei Jiang,Zhaoxiang Zang,Zhengtao Yu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：token, token embedding spaces, generating text, Token Identity Brier, recently been extended
备注：
点击查看摘要
Abstract:Diffusion and flow models have recently been extended to language modeling, generating text through continuous denoising in token embedding spaces. Pretrained models provide token representations and contextual prediction capabilities, but improving generation with limited additional training requires an appropriate connection between supervision and continuous generation. Continuous MSE evaluates a predicted vector obtained by weighting token embeddings with predicted probabilities; different probability distributions can yield the same vector and are therefore indistinguishable under this objective. We propose Token Identity Brier Flow (TIBF), which applies squared supervision directly to token identities when continuing pretrained language flows. TIBF combines network scores with token-matching scores under a Gaussian observation model, supervises token probabilities using the Brier loss, and uses probability-weighted embeddings for continuous generation. With fixed token embeddings, we show that the squared error between predicted token probabilities and the true posterior bounds the squared errors of continuous denoising predictions and flow velocities. A risk decomposition separates uncertainty inherent in the observation from posterior fitting error, motivating continued training that preserves pretrained embeddings and focuses on probability prediction. We also establish convergence to token embeddings under ideal predictions and sufficient conditions for local convergence with prediction error. From common pretrained initializations and under matched continuation budgets, frozen-embedding TIBF achieves this http URL values of 33.96 on OWT and 81.17 on LM1B, outperforming continuous-MSE and CE continuation controls. It attains the lowest this http URL at every tested sampling budget on both datasets, together with the lowest repetition rate on LM1B.
53. 【2611.07654】English Calibration Erodes Lithuanian in Expert-Pruned Mixture-of-Experts Language Models
链接：https://arxiv.org/abs/2611.07654
作者：Tomas Rasymas,Povilas Kvedaras
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：English, English calibration, calibration set marks, Lithuanian, marks as unimportant
备注： 41 pages, 13 figures, 10 tables
点击查看摘要
Abstract:Expert pruning compresses Mixture-of-Experts (MoE) language models by removing the experts that a calibration set marks as unimportant. Studies of high-resource languages largely find that English calibration transfers well to other languages. We test this for Lithuanian: we pruned four MoE models with REAP, removing 25% or 50% of the experts with English, Lithuanian or mixed calibration, and evaluated both languages on reading comprehension, translation and language modelling. English calibration does not transfer to Lithuanian: at 25% pruning, English comprehension fell by a median of 1.7 points but Lithuanian by 21.4. The transfer is asymmetric. Lithuanian calibration removed most of the Lithuanian loss and never significantly hurt English comprehension, which was on average 2.5 points better than under English calibration; only English language modeling got slightly worse. Routing suggests why: in the last layers, Lithuanian sends 55-72% of its expert selections to just eight experts, against 19-39% for English, and English calibration removes some of these experts. Compressed models should be calibrated, and evaluated, in every language they must serve.
54. 【2611.07610】Embedding-Space Fingerprinting of LoRA Fine-Tunes: Recovering the Training-Data Domain from the Model Artifact Alone
链接：https://arxiv.org/abs/2611.07610
作者：Shivesh Rane
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Low-Rank Adaptation, data domain leaks, training data domain, base language model, training data
备注：
点击查看摘要
Abstract:When a base language model is fine-tuned with Low-Rank Adaptation (LoRA), how much of the training data domain leaks into the resulting artifact? This paper studies whether a simple classifier can recover the domain of a fine-tune given only the model artifact (weight deltas, internal activations on a fixed probe set, or generated text) without ever observing the training data. Using one base model (Qwen3.5-0.8B), 36 LoRA fine-tunes are produced over 18 public datasets in five domains (medical, code, mathematics, non-English text, narrative prose), and three feature families are extracted at decreasing levels of access: white-box weights, gray-box activations, and black-box outputs. A leave-one-dataset-out (LODO) protocol, frozen before any result was seen, tests whether the domain of a fine-tune trained on a previously unseen dataset can be identified. The domain is recoverable well above chance (20%) from gray-box activations (61%) and black-box outputs (64%); white-box weight statistics reach 42%. Contrary to the pre-registered hypothesis that signal decays monotonically from weights to activations to outputs, activations and outputs were more informative than the weight-delta statistics. The black-box result holds unchanged (64%) when only generated text is used, without token probabilities. Domain accuracy is also stable when a third run per dataset is trained on an independently drawn data subsample, and black-box predictions are unaffected by the LoRA rank (8-64). All code and per-run feature vectors are released.
55. 【2611.07605】he Gating Mechanism of KV Cache Eviction
链接：https://arxiv.org/abs/2611.07605
作者：Hao Gu,Xintong Yang,Zhiwei Li,Lei Zhu,Jian Yang,Qiyuan Zhu,Dezhi Li,Jingyuan Zhang,Zhizhuo Kou,Hao Wang,Bei Liu,Jiacheng Liu,Sirui Han
类目：Computation and Language (cs.CL)
关键词：entries carry information, gate, longer supply, decide which entries, entries carry
备注： [this https URL](https://github.com/Chooovy/IndexMem)
点击查看摘要
Abstract:KV cache eviction must decide which entries carry information that the rest of the cache can no longer supply. A natural way to estimate this is a learnable gate: give each cached entry a gate on its attention weight and train the gate on the model's own objective. The gate belongs inside the normalizing softmax, where suppressing one entry hands its mass to the others rather than discarding it. That same normalizer absorbs any per-query constant, so a constant gate cancels and reproduces the frozen model exactly. Trained on the language-modeling loss the gate stays near a constant score while its loss falls throughout: optimization succeeds, but a frozen backbone was fit for dense attention, so its loss prefers the no-op, and a near-constant score ranks nothing. The no-op is not a floor the gate improves from but what its objective asks for. A second obstacle survives once the gate moves, since the same gradient charges the gate for errors the frozen model already makes, which no reweighting of positions separates out. Much of the machinery in learnable eviction, from sparsity penalties to relaxations of the discrete decision, works around the first obstacle rather than removing it; both are removed by putting dense attention beyond the gate's reach and making the dense model's predictions its target. Under these two conditions capacity is never the missing ingredient: neither a larger scorer, nor explicit access to the past, nor a trainable backbone helps. The same holds for what eviction unavoidably discards, which is recovered by parameter-free centroids read inside the same softmax far better than by any memory read outside it, since the mass they must return is a share of that normalizer and available nowhere else. At 75\% KV cache compression, this gate reaches 90.14 on RULER at 8K and 46.03 on LongBench with Qwen3-8B, 3.72 and 1.36 points below full-cache inference.
56. 【2611.07587】Fine-Tuning a Transducer for Impaired Speech: Where the Gains Appear and What They Mean for Evaluation
链接：https://arxiv.org/abs/2611.07587
作者：Kien Nguyen,Tuan Dinh,Bao Phan
类目：Computation and Language (cs.CL)
关键词：Parkinson disease, Speech Accessibility Project, Accessibility Project Challenge, cerebral palsy, syndrome or stroke
备注： 6 pages, 4 tables. Accepted at the SAPC2 Competition Workshop at NeurIPS 2026
点击查看摘要
Abstract:Speech recognition still works poorly for many people whose speech is affected by conditions such as ALS, Parkinson's disease, cerebral palsy, Down syndrome or stroke. We took part in the Speech Accessibility Project Challenge 2 (SAPC2) with a public speech recognizer that we fine-tuned on the challenge data. Our best entry scored 7.81% character error rate on Test1, the first of two hidden test sets (official baseline 15.26%). Our live entries ran on CPUs with a combined median latency of about 0.9 seconds at 7.96-8.07% error. On new speakers, fine-tuning reduced errors most for the speakers that an off-the-shelf recognizer finds hardest to understand. Sentences already seen in training had far lower error rates than new ones (2.58% vs 6.42%), a larger difference than being a familiar speaker made. We close with lessons for evaluating such systems.
57. 【2611.07586】Stress Testing Chain-of-Thought Monitoring Against Covert Misalignment
链接：https://arxiv.org/abs/2611.07586
作者：Yao Huang,Yifan Wang,Yitong Sun,Yichi Zhang,Yinpeng Dong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：LLM agents advance, bypass safety constraints, agents advance rapidly, LLM agents, rapidly in autonomy
备注： Advances in Neural Information Processing Systems (NeurIPS), 2026. 51 pages, 8 figures
点击查看摘要
Abstract:As LLM agents advance rapidly in autonomy, the risk of hidden objectives that bypass safety constraints becomes increasingly plausible. Chain-of-thought (CoT) monitoring offers a key control mechanism by reading the agent's reasoning and flagging misalignment before it materializes into action, yet its reliability depends on the realism of the red-team it is stress-tested against. Existing red-teaming efforts rely on shared templates, such as casting a side task as a prerequisite, which treat the side objective as an exogenous insertion and leave task-specific, contextually grounded evasions underexplored. We therefore ask: How robust is CoT monitoring against agents that strategically conceal misalignment? To answer this, we introduce TraceMRT, an automated Trace-level Monitor Red-Teaming framework that reframes the side task as a coherent sub-goal of the primary task and searches trace-shaping strategies whose induced trajectories complete the misaligned objective while reading as natural execution. Through black-box attacks on state-of-the-art monitors such as GPT-5.2 and Claude-4.5, we reveal substantial vulnerabilities even in top models. To counter these vulnerabilities, we propose a Bayesian Trajectory Monitoring framework, integrating global context and local segment evidence to detect covert misalignment. Empirically, our method significantly consolidates monitor robustness with 0.91 AUC and 0.74 TPR@FPR=0.05.
58. 【2611.07558】SKIM: Pruning Large Language Model Agents via Selective Knowledge Informed Masking
链接：https://arxiv.org/abs/2611.07558
作者：Moonseok Choi,Jongwon Jeong,Minki Kang,Giung Nam,Juho Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Model, Large Language, structured generation, grammar constraints enforce, constraints enforce output
备注： NeurIPS 2026. Project page: [this https URL](https://moon4sake.github.io/skim)
点击查看摘要
Abstract:Large Language Model (LLM) agents are increasingly deployed under structured generation, where grammar constraints enforce output format at inference time. Whereas existing compression methods target unconstrained generation, we first identify a fundamental mismatch: under structured generation, grammar constraints reduce the model's output distribution to valid tokens, and the logits matter most at the small set of positions that decide the agent's action. Motivated by this finding, we propose SKIM (Selective Knowledge-Informed Masking), the first pruning and distillation framework for LLM agents under structured generation, with both stages guided by token role. SKIM partitions token positions into context, decision, and format categories, and this partition drives two complementary axes: (1) category-aware pruning saliency scores that preserve parameters most relevant for decision positions; and (2) an on-policy distillation objective that aligns student and teacher on valid tokens, paired with category-aware feature matching. We evaluate SKIM on tool-calling benchmarks and within multi-step agent loops, across multiple model scales and sparsity levels. SKIM consistently improves accuracy over baselines, with its superiority becoming most striking in high-sparsity regimes where conventional methods struggle, demonstrating the potential of category-aware compression for deployment-time grammar-constrained agents.
59. 【2611.07554】he Memory Trap: Language Agents Overgeneralize from Benign Interactions
链接：https://arxiv.org/abs/2611.07554
作者：Kaiqu Liang,Jaime Fernández Fisac,Thomas L. Griffiths,Andrew Lampinen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Language agents increasingly, record user preferences, Language agents, increasingly use persistent, preferences and procedures
备注：
点击查看摘要
Abstract:Language agents increasingly use persistent memory to record user preferences and procedures across sessions. We show that memory from benign interactions can cause unsafe or unreliable behavior on later tasks. We call this failure the memory trap. To study this issue, we compare behavior in sessions with and without memory across six frontier models (including Claude Sonnet, Opus, and Fable models and GPT-5.6). We evaluate these models in a range of settings. First, in autonomy experiments, we find that requests to skip confirmation during low-stakes coding chores lead agents to skip confirmation and verification on simulated high-stakes tasks in both coding and everyday life. We next study memories formed when users seek emotional support, or describe harm from uncritical feedback, and find these memories bias later judgments of mathematical work, arguments, and poems toward sycophancy or over-critique (respectively). Memory notes written during legitimate stale-test repairs lead agents to weaken correct tests that catch broken safeguards; these memories also increase cheating on ImpossibleBench, with larger increases for stronger Sonnet and Opus models. We show that memory traps can arise both from overgeneralizations in memory writing, and when acting on memory. These findings demonstrate that even benign interactions can lead to serious risks from memory systems, and thus motivate the need for new research into ensuring that agents preserve the scope of their memories.
60. 【2611.07552】SPARE: Fast Linear Attention Decoding with Compact Recurrent States
链接：https://arxiv.org/abs/2611.07552
作者：Ke Wan,Zaiyi Zheng,Chen Chen
类目：Computation and Language (cs.CL)
关键词：Linear attention reduces, quadratic sequence-length complexity, Linear attention, maintaining fixed-size recurrent, softmax attention
备注： 10 pages, 4 figures, 2 tables
点击查看摘要
Abstract:Linear attention reduces the quadratic sequence-length complexity of softmax attention by maintaining fixed-size recurrent states. However, these states scale quadratically with the representation dimension and require repeated data transfers during decoding, creating a substantial GPU memory bottleneck. Recent studies have revealed significant low-rank redundancy in recurrent states, suggesting opportunities for more efficient representations. We introduce SPARE (State Projection for Accelerated Recurrent Execution), a training-free method that exploits this redundancy through fixed low-dimensional subspaces, heterogeneous rank allocation, and lightweight write compensation. By performing recurrent reads and updates directly on compact states, SPARE reduces memory traffic without online decomposition or dense-state reconstruction. SPARE achieves 2.55x full-model decoding speedup, 7.49x lower recurrent-kernel DRAM traffic, and 3.31x lower peak GPU memory, while preserving better associative-retrieval accuracy than structured pruning at matched memory budgets.
61. 【2611.07510】Enhancing Repository-Level Code Completion with Reinforcement Learning in Real-World Scenarios
链接：https://arxiv.org/abs/2611.07510
作者：Zhenlong Dai,Zhuoluo Zhao,Xiu Tang,Sai Wu,Chang Yao,Zhipeng Gao,Jingyuan Chen
类目：Computation and Language (cs.CL)
关键词：sparked growing attention, real-world software development, large language models, rapid development, software development
备注： Accepted by EMNLP 2026 Main
点击查看摘要
Abstract:The rapid development of large language models (LLMs) for code, which closely aligns with the practical needs of real-world software development, has sparked growing attention in repository-level code completion. However, existing Code LLMs present challenges in focusing on suitable contexts from the repository and in deeply reasoning about cross-file dependencies. To address these challenges, we propose a novel reinforcement learning framework for repository-level code completion. To better understand both in-file and cross-file contexts, we employ identifier-driven intent recognition to capture completion intent, thereby improving the model's performance in real-world scenarios. To enhance cross-file reasoning, we propose a reward-driven completion learning to effectively reward in complex repository completion scenarios. To guide LLMs in completing code that aligns with intended functionality and repository context, we introduce a selective-exploration strategy that directs the model to focus on low-confidence, high-reward tokens, promoting the exploration of valuable, underexplored completion patterns. Experimental results show that our approach significantly improves the performance of Code LLMs. The code and the dataset are available at this https URL.
62. 【2611.07489】ReviewMap: Mapping Evaluative Acts and Automation Boundaries in Peer-Review Comments
链接：https://arxiv.org/abs/2611.07489
作者：Kihyun Na,Injung Kim
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Peer-review comments check, existing scheme distinguishes, Peer-review comments, existing scheme, scheme distinguishes
备注： 27 pages, 5 figures, 19 tables
点击查看摘要
Abstract:Peer-review comments check what a paper does and judge why it matters, but no existing scheme distinguishes these two evaluative acts. We argue that making these acts explicit and measuring how reliably LLMs identify them is a prerequisite for responsible LLM-assisted review analysis: humans need to inspect review judgments and their grounds. This defines a more honest mission for NLP in peer review than full automation. We present ReviewMap, a framework that classifies each comment as assessment of claims and scholarly standards or calibration of contribution value and venue fit, with finer-grained attributes applied conditionally by act type. Applied to 500 ICLR~2026 papers through multi-model LLM consensus, the act layer proves reliably automatable under the operational guideline (inter-model $\kappa \geq 0.75$), supported by five-human validation on 470 development comments, while the attribute layer requires human oversight, defining a measured automation boundary. At the corpus level, 17% of reviewer-paper instances contain no panel-coded calibration, and the panel-coded calibration share is nearly $3\times$ as high in Strengths as in Weaknesses. This boundary informs three affordances: a review guideline that operationalizes the assessment-then-calibration workflow for reviewers, a per-comment rebuttal strategy scaffold for authors, and a discussion-phase dashboard for area chairs.
63. 【2611.07486】MEvince: Knowledge-Constrained LLM Reasoning for Technique Identification from Malware Reports
链接：https://arxiv.org/abs/2611.07486
作者：Hongyu She,Yiling He,Mengda Xie,Yiping Liu,Xingzhi Qian,Zhan Qin,Lorenzo Cavallaro
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Mapping behavioral intelligence, identification remains challenging, reliable identification remains, supports threat analysis, Mapping behavioral
备注：
点击查看摘要
Abstract:Mapping behavioral intelligence in malware analysis reports to ATTCK techniques supports threat analysis and defense, but reliable identification remains challenging. Supporting evidence is often scattered across long, heterogeneous reports, while closely related techniques share behavioral cues and differ only in subtle but decisive details. While large language models (LLMs) can use external knowledge to interpret reports, they may assign techniques based on plausible associations rather than sufficient evidence. We present MEvince, a knowledge-constrained LLM reasoning framework for report-level malware technique identification. Its core is a shared behavioral representation connecting report observations to technique definitions. This representation is built through agentic mining of technique documentation and supports two online stages: 1) primitive-guided extraction uses behavioral primitives to structure LLM-extracted observations, link them to source passages, and group dispersed evidence; 2) evidence-aligned retrieval matches this evidence to technique profiles through the same concepts, retaining likely candidates and confusable alternatives for LLM comparison of distinguishing behaviors. Controls at both stages validate evidence references and check technique-specific requirements. The representation also supports adaptation without parameter updates, where offline agentic audits diagnose concept weaknesses and refine extraction or retrieval policies. We evaluate MEvince against 11 baselines spanning four method families using a dataset of 610 public malware reports referenced by MITRE ATTCK. MEvince improves exact-ID F1 over the strongest baseline by 17.4%, and its concept-guided retrieval increases gold-label candidate coverage from 31.6% to 47.9%. With a small adaptation set, offline refinement yields further gains and outperforms baselines that update model parameters.
64. 【2611.07478】Localization Does Not Imply Steerability: A Mechanistic Study of Sign Errors in LLM Mathematics
链接：https://arxiv.org/abs/2611.07478
作者：Shradha Agarwal,Tariq J.,Deepak Rajbhar
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：characteristic failure recurs, sign token mid-computation, large language models, wrong sign token, multi-step mathematics
备注： 61 pages. Code, per-case results and preregistration: [this https URL](https://github.com/signcircuits-experiments/sign-circuit-scaling)
点击查看摘要
Abstract:When large language models do multi-step mathematics, a characteristic failure recurs: the model writes one wrong sign token mid-computation -- a cofactor sign, the minus of a recursive integration-by-parts step -- then executes the rest of the arithmetic correctly, and the answer comes out wrong. We ask where inside the network that sign is written. Across six open models spanning 14B to 675B parameters, a per-layer readout shows the wrong sign is committed late -- by MLP layers in the last quarter of the network (70-100% per model and task), a pattern present, where tested (Qwen), in the base model before instruction tuning. The mechanism varies: some models carry fixed "minus-stamp" layers that push a minus regardless of the right answer, others carry amplifiers of whichever sign was already chosen, and Qwen adds a downstream rescue layer that opposes the stamp. The circuit is causal: subtracting a single sign direction from the residual stream flips 13 of 14 held-out minus-written integration-by-parts errors on Llama-3.3-70B, with flips replicating on Qwen, Gemma, and Mistral-Small (24-70% per cell), and with representation-level specificity -- the same dose breaks correctly-minus answers while sparing correct-plus answers where the direction is surgical (0/72 on Llama), and matched random-direction and control-layer interventions are null. Core claims were preregistered with pass criteria frozen in git before held-out data was seen: 23 of 29 checks passed, all misses reported. But causality is not uniform: Phi-4 implements an equally well-localized circuit at the same late depth, yet the identical intervention flips almost nothing -- the sign is written redundantly across ~15 layers with margins several times larger (median 17.8 logits). Localization, we conclude, does not imply steerability: two models can share a circuit location yet differ enormously in how overturnable it is.
65. 【2611.07469】Recursive Self-Improvement for Long-Horizon Role-Playing Dialogue
链接：https://arxiv.org/abs/2611.07469
作者：Y. L. Li,Y. H. Wu
类目：Computation and Language (cs.CL)
关键词：Long-horizon role-playing dialogue, Long-horizon role-playing, consistent character identity, requires consistent character, role-playing dialogue requires
备注： 8 pages, 1 figure, 4 tables
点击查看摘要
Abstract:Long-horizon role-playing dialogue requires consistent character identity, reliable memory, and context-sensitive interaction. We present a bounded recursive self-improvement (RSI) framework that revises original-character memory, stable persona instructions, and a policy for constructing turn-level prompts. Repair outcomes also inform revisions to the updater's diagnostic rules, edit routing, and candidate selection. We specify the updater as a versioned policy with explicit inputs, editable fields, acceptance gates, and stopping conditions. An internal evaluation covers 50 original characters and five models, with two 100-round conversations per character-model pair: 500 conversations per condition. Across the pooled evaluated replies, the bad-response rate decreases from 14.00% (6,973/49,824) to 4.94% (2,459/49,793), a 9.06-percentage-point reduction and a 64.71% relative reduction. In 600 blinded human comparisons, RSI receives 294 wins, 187 ties, and 119 losses, yielding a 71.19% win rate among decisive judgments. The results support improved aggregate dialogue quality for the complete framework on the internal test distribution.
66. 【2611.07464】FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance
链接：https://arxiv.org/abs/2611.07464
作者：Yupeng Cao,Xueqing Peng,Lingfei Qian,Haohang Li,Yangyang Yu,Anke Xu,Wenbo Cao,Yan Wang,Yuechen Jiang,Yuyan Wang,Zhuohan Xie,Yankai Chen,Zehan Li,Jimin Huang,Xue Liu,Jian-Yun Nie,Sophia Ananiadou
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computational Finance (q-fin.CP)
关键词：Language agents increasingly, open Web, Language agents, agents increasingly work, Web
备注：
点击查看摘要
Abstract:Language agents increasingly work for users on the open Web, and finance is where trusting them is hardest. The data must come from the Web, the strategy lives in the user's head, and correctness depends on time, so an agent can fail silently: a strategy the user never asked for, unverified data, or a backtest that uses the future yields a report as convincing as a correct one. Existing benchmarks close the world somewhere, fixing the task, the data, or the timeline, and thereby remove these failures instead of measuring them. We introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. A simulated user holds a hidden strategy sampled from a compositional grammar and reveals it only when asked. The agent receives no data, so it must acquire data from the Web, build its own backtest under a data cutoff, and deliver verifiable results. Grading needs no reference answer. Programs verify point-in-time correctness and recompute every reported metric, the delivered strategy is checked against the hidden specification, and a run is accepted only when the user is satisfied and none of 15 veto checks fails. Across four coding agents and a model without tools in 150 sessions, no session is accepted: every session that the simulated user signed off fails a program check, and agents raise only 54--64\% of the details they were not told. Human experts attribute 88.33\% of failures to the agents. With FINCOSMOS feedback, an agent with persistent memory learned all ten tasks.
67. 【2611.07461】he Last Mile to the Real World: Agent-Native Primitives as Reusable Building Blocks for Solving Real-World Tasks
链接：https://arxiv.org/abs/2611.07461
作者：Haibo Jin,Peng Kuang,Xiaopeng Yuan,Lucheng Fu,Jerry Wang,Xucheng Yu,Yaoning Yu,Dehao Wu,Runguo Li,Colin Su,Jingxuan Sun,Xuyang Liu,Haojing Luo,Haohan Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Software Engineering (cs.SE)
关键词：real-world task end, primitives, Claude Opus, Claude Code, agent handle
备注： 102 pages, 21 figures, 54 tables. Project page: [this https URL](https://www.heelo.dev/)
点击查看摘要
Abstract:How can an agent handle a real-world task end to end? Frontier models with their own harnesses still fall short on real-world benchmarks: on Terminal-Bench 4.0, GPT-5.6 Sol with Codex resolves 37.3% of the tasks and Claude Opus 5 with Claude Code 51.8%. These tasks fail at the step from reaching a resource to applying it, which we call the last mile to the real world. Existing approaches put the resource within reach but leave the competence to apply it with the caller, so each harness rebuilds that competence. We introduce agent-native primitives, reusable units that equip a resource with a resident LLM that applies it in context and communicates with other primitives, and HEELO (Harness Engineering around Evolving Agent-Native Primitives for the Last Mile to Real-WOrld Tasks), a harness engineering framework that builds each task's harness from a library of such primitives. HEELO composes the primitives a task needs into a task-specific graph, verifies the result against evidence from the environment, revises the primitives a failure implicates, and admits new or improved primitives after validation. We instantiate HEELO with eight primitive families, each built for one kind of task, and evaluate them on more than twenty benchmarks. Dev-Primitives raise Terminal-Bench 4.0 resolution from 37.3% under Codex to 55.5% on the same backbone, Harness Primitives composed per task raise Terminal-Bench 2.0 Pass@1 from 60.0% for the seed harness to 72.2%, Tool Primitives raise ToolBench pass rate from 55.8% to 75.1%, and Navigation Primitives raise GAIA-Text-103 accuracy from 45.6% to 58.3%. On the 46 real-world tasks of our this http URL platform, Claude Opus 5.5 with Claude Code and GPT-6.1 Sol with Codex complete 9 each on their own and 39 and 35 when connected to HEELO through our MCP server, with 1.9$\times$ and 2.3$\times$ less time and 1.55$\times$ lower cost per completed task.
68. 【2611.07453】Latency-Aware Adaptive Best-of-$N$
链接：https://arxiv.org/abs/2611.07453
作者：Alon Jacobson,Qian Xie,Peter I. Frazier
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：improves language model, spending additional computation, language model responses, Test-time compute, Adaptive TTC methods
备注：
点击查看摘要
Abstract:Test-time compute (TTC) improves language model responses by spending additional computation at inference time, and the right amount of compute depends on the prompt. Adaptive TTC methods allocate compute based on signals of response quality such as observed rewards, often by stopping once the signal exceeds a fixed threshold, and generally measure cost by the number of generations or tokens. But in online serving, latency is also a cost: it grows with server load, so a method using a fixed threshold spends too little compute when generation is fast and too much when it is slow. For Best-of-$N$ sampling, a widely used TTC method, we propose a two-stage adaptive algorithm that draws an initial batch, then uses the observed rewards and the batch's latency to decide whether to draw a second batch and at what size by comparing expected improvement against predicted cost: it draws one when the first batch's best reward is below a threshold that decreases with the first batch's latency, without explicitly measuring server load. We map each reward to its value under the cumulative distribution function (CDF) of the prompt's reward distribution, so the same tradeoff parameters can be reused across tasks; a regression fitted offline on other prompts predicts a distribution for the CDF value of the first batch's best reward, giving the expected improvement in closed form. We evaluate the method by simulation on a preference-based alignment benchmark, measuring generations-equivalent cost: generations plus latency, converted to generations. The method reaches Best-of-$N$'s reward at lower generations-equivalent cost, and conditioning on the measured first-batch latency saves at least as much of that cost as fixed-threshold (latency-unaware) baselines, and more when latency is highly variable, when it grows with batch size, and when the second batch's latency is highly predictable from the first's.
69. 【2611.07372】EnvOpt: Automated Optimization for Agent Environments
链接：https://arxiv.org/abs/2611.07372
作者：Mingxuan Li,Huanzhi Mao,Qiuyang Mang,Hanchen Li,Joseph E. Gonzalez,Alex Dimakis
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM agent cost, LLM agent, cost, LLM, stationary environments
备注：
点击查看摘要
Abstract:An LLM agent's cost and success depend on its model, its harness, and its environment. In addition to the widely studied directions of parameter tuning and harness optimization, we propose the third direction: optimization over stationary environments. Agents are often deployed in rich environments shared by many tasks, such as a company's Slack workspace or a complex collection of data sources, documents or tickets. We call these environments stationary environments. We introduce EnvOpt, a method for automated end-to-end optimization of stationary environments for any given model and harness, using real or synthetic tasks without needing any graders or reference answers. On AutomationBench, EnvOpt reduces the cost of Claude Haiku 4.5 by 72.7% and raises its pass rate by 14.34%. The same environment transfers to Opus 5, cutting its cost by 68.1% with a 1.34% gain. Added on top of Meta-Harness's optimized harness for Haiku 4.5, it lowers cost by a further 83.4% and adds 11.17% accuracy over Meta-Harness alone. Across 5 benchmarks, EnvOpt significantly reduces the cost of agents while improving or maintaining pass rate, and is transferable to different models and different harnesses. We also discuss common successful and rejected environment optimization strategies during automated optimization. More broadly, our results show that how information is represented to an agent shapes both its cost and its success, making the environment worth optimizing in addition to the parameters and the harness.
70. 【2611.07283】Encoding and Propagation of Grammatical Number in Large Language Models
链接：https://arxiv.org/abs/2611.07283
作者：Jacob Solinsky(1),Serguei Pakhomov(1) ((1) University of Minnesota)
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：translating Large Language, Large Language Model, Sparse autoencoders, translating Large, Large Language
备注： 50 pages, 19 figures
点击查看摘要
Abstract:Sparse autoencoders (SAEs) have become an increasingly popular means of translating Large Language Model (LLM) hidden state vectors into a human-comprehensible list of features or symbols. As such, SAEs may provide insight into an LLM's knowledge representation and internal ``mental'' grammar - topics of pragmatic interest for mechanistic interpretation of AI behavior and of theoretical interest for the study of in silico representations of human language. Language models with fewer than 100M parameters, trained on small corpora, nonetheless exhibit strong grammatical competence and discourse coherence, despite producing content of limited reliability. We use SAEs that we trained on one such model (Pythia-70M) to conduct an in-depth examination of how a single grammatical phenomenon, number agreement, is represented and processed in an LLM. We demonstrate the mechanism and the methodology by which SAEs can be used to find and propagate ``plural noun'', ``plural matrix subject'', and ``generate a plural verb'' features which cause the LLM to produce plural verb forms such as ``are'', ``do'', or ``have'' instead of ``is'', ``does'', and ``has'' in response to prompts such as ``the men in the park''. We show that intervening to remove these features from the hidden states of plural subject noun tokens causes the model to produce singular verbs instead, and vice versa. We also show that corresponding ``singular noun'' and ``generate a singular verb'' features are not as effective for this task. This asymmetry suggests that Pythia-70m makes use of a privative representation of grammatical number in English. These findings replicated with larger LLMs Gemma-2-2b and Llama-3.1-8b yielded similar results. Our main contribution is a novel approach to the use of SAEs to understanding how LLMs encode human language that addresses a number of technical and methodological challenges.
71. 【2611.07263】HyFlash: A Prefix-Memory Prior for On-Device Speculative Decoding
链接：https://arxiv.org/abs/2611.07263
作者：Jongwoo Ko,Pashmina Cameron
类目：Computation and Language (cs.CL)
关键词：single backbone pass, block drafting accelerates, drafting accelerates speculative, accelerates speculative decoding, predicting multiple future
备注：
点击查看摘要
Abstract:Parallel block drafting accelerates speculative decoding by predicting multiple future positions in a single backbone pass, but on-device deployment constrains both drafter capacity and context storage. Under tight memory budgets, drafters must model long-range dependencies and fine-grained draft-position interactions without the growing KV-cache overhead of full-context attention. We propose HyFlash, a compact parallel drafter that introduces a prefix-memory prior to separate long-range context modeling from fine-grained draft-position interactions with limited capacity. Local attention captures recent context and draft-position interactions, while recurrent memory compresses historical target features into fixed-size states. This inductive bias enables effective local and long-range modeling with bounded draft-side memory. Experiments show that HyFlash achieves higher acceptance than full-context attention with substantially less KV storage and with larger gains for shallow drafters and long contexts.
72. 【2611.07241】$D^2$-OPD: Separating Direction and Distance in Extrapolative On-Policy Distillation
链接：https://arxiv.org/abs/2611.07241
作者：Bowen Fang(Columbia University),Dingmin Wang(AWS AI Lab),Hengzhi Pei(Amazon AGI)
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：On-policy distillation, teacher next-token distributions, student-generated prefixes, model to match, next-token distributions
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) trains a student model to match a teacher's next-token distributions on student-generated prefixes. Extrapolative OPD further extends the teacher's log-probability shift relative to a reference policy to construct stronger learning targets. However, existing methods couple extrapolation direction and distance, allowing the magnitude of the teacher's shift to dictate how far the target moves. We propose $D^2$-OPD, decoupling these two factors: a per-prefix hard KL constraint bounds the target's distance from the teacher, while an adaptive combination of the teacher's post-training shift and the initial student--teacher gap determines the extrapolation direction. We optimize the student toward this target using forward KL, providing learning signals even for low-probability tokens. We evaluate three settings: where standard OPD performs well, where it struggles with base-model initialization, and where no teacher reference is available. On mathematical reasoning benchmarks, $D^2$-OPD attains the highest score in all three settings, outperforming the strongest baseline by up to 9.45 points. Ablations validate the contributions of each component.
73. 【2611.07238】How Do AI Agents Waste Your Money?
链接：https://arxiv.org/abs/2611.07238
作者：Huimin Zeng,Yuxuan Lu,Jesse Cai,Eric Hanchen Jiang,Di Wu,Po-Nien Kung,Wenbo Hu,Ziyi Wang,Dakuo Wang,Jiaxin Pei,Kai-Wei Chang
类目：Computation and Language (cs.CL)
关键词：consume massive tokens, consume massive, wide range, token, token waste
备注：
点击查看摘要
Abstract:AI agents may consume massive tokens across a wide range of tasks, but how many of those tokens are really necessary? Although prior work has shown that agents can incur unexpectedly high token costs, we still lack a systematic way to identify and measure token waste. In this work, we introduce a unified framework for measuring token waste across heterogeneous agent systems. Our framework records and normalizes complete agent trajectories, identifies removable spans using an LLM-as-a-Judge (LLMaJ), and maps the identified text spans back to the original trajectory for token-level measurement. We validate the identified waste through direct interventions by removing marked spans, resuming agent execution, and measuring changes in task outcomes and subsequent actions. In online pruning experiments, we remove 41-46% of the model's reasoning while largely preserving task performance across two distinct agent benchmarks. Using this framework, we analyze agents across multiple settings. Our analysis shows that token waste has a system-level structure that aggregate token usage alone cannot reveal. First, waste varies more across tasks and agent settings than across models. Second, reasoning and visible execution can exhibit different waste patterns. Third, different harnesses can introduce distinct sources of inefficiency even under the same model and task. Overall, our framework transforms token waste into an actionable optimization signal, enabling researchers and practitioners to train more efficient models, design better reasoning strategies, and optimize agent harnesses toward reducing unnecessary computation rather than merely reducing token usage.
74. 【2611.07234】Archetypal contexts in the neurons of language models: an architecture for intelligence?
链接：https://arxiv.org/abs/2611.07234
作者：David Nordfors
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：model holds relational, holds relational patterns, language model holds, validate our previous, previous hypothesis
备注： 18 pages, 7 figures, 2 tables. Reproduction package (neuron sets, texts, answers, code) in the ancillary files
点击查看摘要
Abstract:We validate our previous hypothesis that a language model holds relational patterns apart from the subject domains that instantiate them (Nordfors, 2026). These archetypal contexts are patterns of relations that people recognize across many fields, such as the tipping point or winner takes all, held once and applied across domains. We show this inside the model, Qwen3.8-27B. One set of neurons carries the archetype, say the tipping point; another carries the topic, say politics, ecology or cell biology; a third carries the language, such as English, Spanish or Chinese. Silence the tipping point's neurons, and the model no longer identifies the pattern but still knows what the text is about. Silence the topic's, and it loses the topic but still names the pattern. In the neuron maps the layers organize themselves into a sandwich: the outer layers carry languages, the layers inside them topics, the layers at the heart archetypes. The sandwich emerges spontaneously during pretraining and appears in every model we mapped. Archetypes are the architecture for analogy, and we strongly suggest that this structure of archetypes and topics is the mechanism of a language model's intelligence: we see it self-organize as the model is trained. The neurons, the texts and the code are released with this paper as its reproduction package, so that anyone can repeat the test inside the model.
75. 【2611.07232】Recursive Sparse Attention: Million-Token Length Extrapolation at Logarithmic Cost
链接：https://arxiv.org/abs/2611.07232
作者：Ruitian Wang,Xinyu Yang,Minshen Zhang,Hao Zhang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：target length increases, training typically relies, Recursive Sparse Attention, long documents, dense attention
备注： 24 pages, 6 figures, 17 tables
点击查看摘要
Abstract:At context lengths of about 1M tokens, dense attention is costly in prefill and decoding, and training typically relies on long documents, which become scarcer as the target length increases. Most sparse attention methods score all preceding blocks or tokens, so their selection cost per query is $O(L)$ at context length $L$; hierarchical selection reduces it to $O(\log L)$, but prior trainable hierarchical methods report accuracy only within their training length. We propose RecSA (Recursive Sparse Attention), which builds a tree over the KV cache in which each node summarizes its subtree with one key and one mean-pooled value. The keys come from one pooler per layer, shared by all levels and distilled from dense attention. Each level above the tokens selects at most $k$ candidates, so each query has $O(\log L)$ selection cost and reads $O(\log L)$ entries; the summaries of unselected candidates share one softmax with the exact tokens. Each entry's RoPE position is its index among the candidates of its level, so at any length every relative distance stays within the range seen during training. Initialized from Qwen3-4B and trained on 0.62B tokens at the original model's 32K training length, RecSA outperforms all baselines on RULER at every length from 131K to 2M; at 1M, it scores 60.5, compared with 40.0 for the best baseline, Dense + DCA. With our optimized kernels, RecSA is faster than dense attention in end-to-end prefill and decoding from 64K to 2M; at 524K on one H200 GPU, it accelerates prefill by 3.2x and decoding by 3.8x.
76. 【2611.07228】Source-balanced Capped Fisher: Bounded Evidence Aggregation for User Inference in Language Models
链接：https://arxiv.org/abs/2611.07228
作者：Yang Liu,Ran Zou,Wanrong Zhu
类目：Computation and Language (cs.CL)
关键词：User inference, language-model update, source contributed documents, auditor observes, observes only fresh
备注：
点击查看摘要
Abstract:User inference asks whether a source contributed documents to a language-model update, even when the auditor observes only fresh documents from that source. Document-level scores can provide evidence of participation, but combining this evidence is challenging: documents differ in baseline predictability and in how strongly they reflect information learned from other documents of the same source. We propose source-balanced capped Fisher (SCF), an aggregation method that uses known nonparticipating sources to assess how unusual each document score is. It transforms the resulting reference-tail frequencies into negative-log evidence, caps individual contributions, and averages them within each source. This limits the influence of isolated extreme scores while retaining evidence across multiple documents. We complete the inference procedure with a decision rule that tests source participation using a p-value calibrated against a separate set of known nonparticipating sources. The rule provides finite-sample Type-I error control under source exchangeability. Experiments across four real-world datasets show that SCF achieves the highest AUROC among the evaluated aggregation methods in four domains. With the calibration-based decision rule, SCF delivers consistently competitive detection power across the tested settings, achieving the highest power in many cases, while empirical false-positive rates remain generally close to or below the nominal levels.
77. 【2611.07218】SAFE-Teen: Evaluating Chatbot Safety Across Adolescent Mental Health Conversations
链接：https://arxiv.org/abs/2611.07218
作者：Andrea Mock,Valerie Chen,Eric Lin,Rayan Krishnan,Diyi Yang,Caroline Figueroa
类目：Computation and Language (cs.CL)
关键词：raising safety concerns, increasingly turning, safety, mental health support, chatbot
备注： 29 pages. Content warning: this paper discusses sensitive content, including self-harm, suicide, and other mental health topics
点击查看摘要
Abstract:Adolescents are increasingly turning to AI chatbots for mental health support, advice, and companionship, raising safety concerns. While recent evaluations have started to examine safety across multiple conversational turns, few compare how slight changes in a teen's responses can affect a chatbot's safety in the same scenario. We conduct a clinician-informed evaluation of chatbot safety in simulated conversations with adolescents aged 13-17, examining how safety failures vary with adolescents' responses and teen-aware system prompting. We evaluated 32,555 simulated conversations across 18 chatbot APIs and two system-prompt conditions using 22 safety criteria grounded in previously identified harms. Conversations spanned 983 variants of 106 seed scenarios covering urgent safety issues, health advice, and identity and relationships. The overall criterion failure rate was 43.3% without the teen-aware prompt and 24.9% with it. The teen-aware prompt reduced failures, but it didn't eliminate them. When a teenager pushed back on a chatbot's answer, failures on mental health diagnosis, medication, and substance misuse boundaries rose by 10-12 percentage points without the prompt, for more than 80% of chatbots. These findings reveal persistent safety failures in simulated adolescent-chatbot interactions and show that safety depends on how a conversation unfolds.
78. 【2611.07216】Compositional Unalignment: Auditing Safety in Large Vision-Language Models
链接：https://arxiv.org/abs/2611.07216
作者：Hong kyu Lee,Kai Shu,Li Xiong
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large vision-language models, Large vision-language, isolation become harmful, compositional, Large
备注：
点击查看摘要
Abstract:Large vision-language models (LVLMs) are vulnerable to compositional harm: an image and a prompt that are benign in isolation become harmful through the model's cross-modal reasoning. Recent alignment methods report strong scores on compositional safety benchmarks, but an LLM judge only measures observed behavior and cannot reveal how robustly safety is integrated into the model. We argue that un-alignment provides a complementary audit of alignment robustness. We first show that minimal supervised fine-tuning reaches an LLM-judge score comparable to a multi-stage reinforcement-learning pipeline, so similar benchmark scores cannot establish robustness by themselves. We then show that recognition and refusal of compositional harm are decoupled: nine standard direction-finding methods detect compositional harm with up to AUC=0.99, yet ablating the recovered directions either leaves refusal intact or destroys model coherence. We therefore propose CMaG, a training-free un-alignment method for compositional safety. CMaG measures refusal intention with a refusal-versus-compliance log-probability margin, takes its gradient with respect to mid-layer activations, and contrasts it against partially benign pairs to isolate the cross-modal interaction term. A single backward pass over 80 examples yields a direction along which steering monotonically converts refusal into compliance. On Qwen2.5-VL-7B and LLaVA-1.5-7B, CMaG reduces compositional safety scores by up to 65 points while over 98% of outputs remain coherent, outperforming gradient-based baselines; the direction also transfers to text-explicit harm and un-aligns models hardened by defensive training. Compositional safety can thus appear behaviorally strong while remaining fragile to targeted internal intervention. Warning: this paper contains unsafe model outputs, including references to self-harm.
79. 【2611.07203】τ-bench-LILT: Evaluating Conversational Agents on Realistic Multilingual Tool-Use Tasks
链接：https://arxiv.org/abs/2611.07203
作者：Kaden Uhlig,Kiarash Mokhtari,Anıl Arslan,Yunsu Kim,Joern Wuebker
类目：Computation and Language (cs.CL)
关键词：tool-using conversational agents, organizations deploying agents, leaving a critical, Frontier evaluations, tool-using conversational
备注： 17 pages, 14 figures
点击查看摘要
Abstract:Frontier evaluations of tool-using conversational agents are conducted almost exclusively in English, leaving a critical gap for organizations deploying agents in other languages and regions. We present ${\tau}$-bench-LILT, a multilingual extension of ${\tau^3}$-bench covering German, Korean, Turkish, and Farsi in the airline, retail, telecom, and banking domains. We natively localize every layer of the benchmark: customer databases are populated with culturally appropriate records, user-simulator prompts are refined iteratively through contrastive annotation by native-language experts, and tasks are updated according to the localized database and to reflect realistic tasks in the target region. Evaluation across eight agent models shows the largest drops compared to English in the Korean and Farsi retail domains, by up to 61 points in pass^4. Code and data released at this https URL.
80. 【2611.07134】Matriarchy Classics: A Computational Approach to Swap Only Gendered Words in Classic Novels
链接：https://arxiv.org/abs/2611.07134
作者：Rachel Lea Draelos
类目：Computation and Language (cs.CL)
关键词：gender-swap public domain, trustworthy computational method, gendered words, words are inverted, words are left
备注： 19 pages, 4 tables
点击查看摘要
Abstract:This paper proposes a trustworthy computational method to gender-swap public domain novels, with programmatic guarantees that only gendered words are inverted and all other words are left unchanged. This may seem like a simple task, but both large language models and naive rule-based methods fail to complete it. The proposed method includes a custom whitespace-preserving tokenizer, gender-swap mappings across plural and possessive forms, pronoun handling, and a character renaming strategy. It shortens the time required to gender-swap a novel from weeks of manual labor to minutes. The method is demonstrated on two public-domain novels. Pride and Prejudice is transported to matriarchal Regency England, where inheritance flows through daughters, mothers rule the household, and a frantic Mr. Bennet is determined to secure advantageous marriages for his sons. The Great Gatsby pivots to a matriarchal Jazz Age where newly-rich Ms. Gatsbee throws lavish parties in the hopes of reuniting with her lost love, David, who is now married to the violent Thelma Buchanan. Gender-swapped novels could serve as useful tools to investigate the gender biases of readers, authors, societies, and AI systems.
81. 【2611.07126】Adapting LLM Judges to Observed Human Annotation Policy through Soft Prompt Tuning
链接：https://arxiv.org/abs/2611.07126
作者：Tamás Janusko,Sven Kleinkop,Ricardo Bochnia,Gunnar Hempel,Steffen Tomschke,Jürgen Anke,Maik Thiele
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Large Language, evaluating chatbot responses, Language Models, chatbot responses
备注： CONVERSATIONS 2026, International Symposium on Chatbots and Human-Centred AI (Preprint)
点击查看摘要
Abstract:Large Language Models (LLMs) are increasingly employed as automated judges for evaluating chatbot responses. While proprietary models can achieve high agreement with human annotators, they remain costly and difficult to deploy in practical settings. Lightweight open-source LLM judges provide an attractive alternative but typically exhibit lower agreement with human ratings. In this paper, we investigate whether soft prompt tuning can align open-source LLM judges more closely with human annotation policy. We train soft prompts on the FairBotBench benchmark and evaluate the adapted judges across the dimensions of bias, toxicity, and personalization. Our findings demonstrate that hybrid soft-prompt tuning, which combines textual prompts with learned continuous prompt embeddings, consistently improves agreement with human annotations over the corresponding untuned baselines. For Qwen 3.5 9B, the adapted judges surpass both hosted reference judges across all three evaluation dimensions.
82. 【2611.07113】What Patients Say They Can't Access: Mining Cancer Screening Barriers from Online Communities
链接：https://arxiv.org/abs/2611.07113
作者：Ruimin Sun,Aokun Chen,Arjun Arunasalam
类目：Computation and Language (cs.CL)
关键词：driving low uptake, low uptake remain, uptake remain poorly, remain poorly characterized, screening disparities persist
备注：
点击查看摘要
Abstract:Cancer screening disparities persist across the U.S., yet the patient-reported barriers driving low uptake remain poorly characterized at scale. While clinical surveys capture structured responses, they miss the organic, unsolicited discourse where patients candidly describe real-world obstacles. In this paper, we conduct a large-scale analysis of over 56,000 posts across six cancer-specific Reddit communities to surface barriers to cancer screening among U.S. patients. We apply a pipeline combining keyword filtering, barrier triage, open coding, and codebook synthesis to systematically extract and categorize patient-reported barriers from 576 U.S.-located posts. Our qualitative analysis reveals recurring structural, informational, and psychosocial barriers that vary meaningfully by cancer type and community context. These findings lay the groundwork for future work aimed at proactively identifying and addressing barriers at scale - spanning a broader range of cancer types and populations - and informing the design of targeted interventions, navigator programs, and health system policies that translate patient-reported obstacles into actionable solutions.
83. 【2611.07111】Consistent yet Contextual: Learning Author-Level Mixtures of Style for Authorship Attribution
链接：https://arxiv.org/abs/2611.07111
作者：Omkar Yadav,Michael Jiang,Kenan Alkiek,Jian Zhu,David Jurgens
类目：Computation and Language (cs.CL)
关键词：attribution typically model, approaches largely ignore, Approaches, typically model, author
备注：
点击查看摘要
Abstract:Approaches to authorship verification or attribution typically model the style of a document, asking whether two documents were likely written by the same author. While recent approaches have been performant, such approaches largely ignore modeling the authors themselves and how varied their style is. Here, we introduce multiple alternatives for modeling the author and demonstrate that allowing an author's representation to capture multiple consistent but distinct writing styles yields significant performance improvements. Using our new authorship model, we then examine when an author writes in a way that is most idiomatic of their style across four scenarios: (i) variation in the size of their writing audiences, (ii) temporal distance from when the model was trained, (iii) the effect of preceding context, and (iv) the effect of genre norms on style. Across all four experiments, we demonstrate that authors vary substantially in how idiolectic their writing is. Our results have clear implications for both the modeling and data used for authorship verification and attribution, showing that authors need to be represented with their multiple styles and that some settings produce text that is much more informative about who wrote that text.
84. 【2611.07072】Automated Feedback to Peer Tutors Increases Their Talk Moves and Learner Reasoning but Not the Balance of Talk
链接：https://arxiv.org/abs/2611.07072
作者：Dorottya Demszky,Yann Hicke,Joy Yun,Mariah Olson,Max Karpawich,Anees Iqbal,Matt Wu,Jimmy Huang,Akshay Ravikumar,Drew Bent
类目：Computation and Language (cs.CL); Emerging Technologies (cs.ET); Human-Computer Interaction (cs.HC)
关键词：online teaching contexts, delivering similar feedback, classroom discourse improves, discourse improves instruction, recent work suggests
备注：
点击查看摘要
Abstract:Automated feedback on classroom discourse improves instruction in professional and online teaching contexts, and recent work suggests that delivering similar feedback to learners may strengthen these effects by sharing responsibility for participation. Whether this holds in small-group volunteer tutoring has not been tested. We present results from a randomized controlled trial across two four-week SAT mathematics bootcamps on the this http URL platform, involving 1,030 volunteer tutors, 7,443 learners and 6,508 recorded sessions. Tutors were randomly assigned to receive no feedback, automated feedback on their own discourse, or that feedback together with participation feedback delivered to their learners under one of two motivational framings. Feedback to tutors increased eliciting of learner ideas, uptake of learner contributions, and learner reasoning by 8-15%, and the pattern replicated across both bootcamps. However, tutor talk time, which averaged 91.5% in the control group, did not change in any condition, and learner-facing feedback did not further change discourse. Interviews with 17 tutors indicate that they adopted the moves the feedback recommended but were limited by learners who did not respond. Interviews with 13 learners suggest why the learner-facing feedback had little effect: it reported a group-level rather than a learner-level statistic, some learners preferred to listen, and learner-to-learner interaction was rare in these sessions. Automated feedback can change how tutors invite learner thinking, but shifting how much learners talk likely requires changes beyond feedback.
85. 【2611.07054】Reclassification Is All You Missed: Surfacing Variant Reinterpretation Need in Online Health Communities at Population Scale
链接：https://arxiv.org/abs/2611.07054
作者：Kamalakkannan Ravi,Mengshu Nie,Annapurna Poduri,Cong Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Genomics (q-bio.GN)
关键词：diffused among labs, clear duty, duty and responsibility, responsibility diffused, patient recontact
备注： 11 pages, 2 figures; 15-page technical supplement included
点击查看摘要
Abstract:Genetic variants are routinely reclassified in ClinVar after a patient is tested, sometimes from uncertain to pathogenic, yet patient recontact is inconsistent, with no clear duty and responsibility diffused among labs, providers, and patients. Many affected people discuss their results in public online health communities that clinical recontact often does not reach. We built PRISM, an agentic large-language-model pipeline that screens these posts, checks whether the variant was later reclassified, and drafts a disclaimer-bearing outreach message, in a no-contact dry run. Across 3.9 million posts from 32 communities, agent-predicted reinterpretation-relevant discussion is rare (0.288%) but concentrated in specialist genetics communities (6.30% versus 0.10% in general medical-advice communities) and growing fivefold since 2014; PRISM surfaces 123 candidate classification differences, 5 of them from an uncertain submission to pathogenic or likely pathogenic. On a held-out set of 30 real-post drafts, a clinician judged 27 factually grounded and 15 fit to send: factual accuracy is necessary but not sufficient for clinically acceptable outreach. PRISM contributes a population-scale reinterpretation-need map with code and data to be released upon publication.
86. 【2611.07051】Closed-Loop Agent Evaluation: Layered Measurement and Self-Calibration
链接：https://arxiv.org/abs/2611.07051
作者：Ruifeng Ren,Gun Ahn
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：throws errors, agent, evaluation, Trajectory and Results, Abstract
备注： 7 pages
点击查看摘要
Abstract:Once an agent is live, teams want to know whether it is doing its job, not just whether it throws errors. Yet most evaluation is one-off: a benchmark run, a look at traces, a single score. Its conclusions neither check themselves nor reach the agent. We propose closed-loop evaluation, an evaluation method for deployed agents. It models evaluation as performance estimation under biased raters and censored outcomes, and it requires every level's conclusion to trace back to atomic data and to be computed by versioned rules. The method covers four levels of analysis (span, trace, conversation and engagement), measures along a spine of Execution, Substance, Trajectory and Results, treats Conduct as a constraint throughout, and uses Provenance and Adjudication components to certify the evidence and the evaluators. Evaluator agents generated by an Agent Factory carry these components, each with a domain knowledge pack and an adapter harness. Two loops close the evaluation: an inner loop audits the evidence, rules and metrics themselves, and an outer loop uses per-component regression checks to drive agent improvement. We also give a pipeline that runs this process automatically. Using the business-analysis agent SharpInsight as a case and porting the method to public conversation data, we show how problems differ across levels and how evidence-and-rule judgment is more reliable than holistic scoring (ICC 0.86 vs. 0.81; kappa 0.81 vs. 0.63).
87. 【2611.07042】Follow the Policy, Fail the Benchmark: Auditing and Revising Policy-Based Decision Benchmarks
链接：https://arxiv.org/abs/2611.07042
作者：Yanru Xiao,Yifei Cai
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：systems apply written, apply written rules, Policy-based decision benchmarks, decision benchmarks evaluate, evaluate whether systems
备注： 28 pages. Code and revised data: [this https URL](https://github.com/SugarRuy/BAR-Policy-Decision)
点击查看摘要
Abstract:Policy-based decision benchmarks evaluate whether systems apply written rules to financial and operational cases. Yet a rule-following response can be marked wrong when the benchmark misstates the required decision. We audit nine public policy-based decision benchmarks through source tracing, program execution, and controlled checks. We find unsupported targets, reference errors that survive replay or propagate as solved steps, and evaluators that reject acceptable answers or credit incomplete decisions. To measure the scoring impact, we rescore unchanged model responses. On the 96 LegalBench SARA numeric cases, correcting the scorer raises acceptance by more than 80 percentage points for each of three models, without changing references or responses. In RuleArena Tax, restoring a required zero floor changes 27 of 300 references and narrows an observed model gap. A controlled federal-exemption task with explicit ownership and eligibility assumptions also shows that errors in supplied intermediate answers can affect final decisions. We present BAR (Benchmark Audit and Revision), a versioned collection of audit evidence and revisions for reevaluation.
88. 【2611.07025】LowRAM: Low-Rank Keys and Amortised Values for Composable KV Cache Compression at Test-Time
链接：https://arxiv.org/abs/2611.07025
作者：Teresa Delgado,Hugo Hazard,Martin Benfeghoul,Jun Wang,Zafeirios Fountas
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Autoregressive decoding relies, memory footprint grows, footprint grows linearly, caps batch size, Autoregressive decoding
备注：
点击查看摘要
Abstract:Autoregressive decoding relies on the KV cache, whose memory footprint grows linearly with context length and caps batch size and throughput. Existing post-training methods exploit redundancy across tokens, layers, and feature dimensions, or lower numerical precision. We identify a complementary axis: within each attention head, values are largely predictable from their corresponding keys. We exploit this with value cache amortisation, which fits a lightweight per-head predictor at test time and stores residuals only for the tokens it reconstructs worst, giving $4\times$ near-lossless value compression. The predictor can be initialised by meta-learning for substantially reduced prefill overhead, or fitted from scratch in settings that allow a one-off cost, such as multi-query inference. We pair value amortisation with cross-layer low-rank key compression to produce LowRAM, an asymmetric compression pipeline that stays close to lossless across three model families. By reconstructing only a selected subset of KV pairs at each decoding step, LowRAM can keep decoding overhead minimal and achieve up to $5\times$ higher peak decode throughput at $4\times$ compression. LowRAM further composes with quantisation and eviction, reaching $26.9\times$ compression at $94.5\%$ of baseline performance on long contexts. These results show that treating keys and values as structurally distinct enables efficient, aggressive, and composable KV cache compression.
89. 【2611.06977】BlockLock: Reproducible LLM Inference with Fixed Batch Geometry
链接：https://arxiv.org/abs/2611.06977
作者：Xiuyuan Qi,Pedro Reviriego,Javier Conde,Shanshan Liu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Reproducible LLM inference, LLM inference requires, Reproducible LLM, LLM inference, inference requires
备注：
点击查看摘要
Abstract:Reproducible LLM inference requires that a request produces the same output regardless of the other requests in the batch. Existing solutions pay for this in different ways: batch-invariant kernels constrain every operator, and isolating prefill with fixed-shape decode ({our CoRun-style baseline}) gives up shared prefill compute and pads decode. We present BlockLock, which keeps shared batched prefill and pins only the numerical path of the protected request: it fixes the geometry that the request sees, with {two modes: BlockLock-Rows uses fixed-width rows and retains batched decode of all requests; BlockLock-Pack uses terminal-anchored packing with an isolated dummy segment, then extracts the protected request's KV state for target-only decode. Under a stated per-deployment contract, both modes preserve the target's output bitwise when its companions change.} Across five {dense} models (Qwen3-8B/14B, Llama-3.1-8B-Instruct, and Gemma-3-4B/12B-IT) and three single-GPU deployments (NVIDIA A6000, A100, and H100), we evaluate our approach on both tinyBenchmarks and BFCL{; we also include initial tensor-parallel experiments on two NVIDIA A6000 GPUs. Both modes preserve target sequences and Top20-logit bits in the reported tests.} At equal delivered work, {BlockLock-Rows} reduces latency by 53.5--55.0\% and improves throughput by 115.2--122.2\% relative to vLLM Batch-Invariant; compared with batch-invariant kernels, it needs no custom kernel implementations and constrains only the protected requests.
90. 【2611.06976】On the Opportunities and Challenges of Prefill-to-Autoregressive Cross-Model Transfer
链接：https://arxiv.org/abs/2611.06976
作者：Zhenyi Shen,Junru Lu,Wei Liu,Jiangnan Ye,Jiazheng Li,Di Yin,Xing Sun,Tameem Adel,Yali Du,Lin Gui,Yulan He
类目：Computation and Language (cs.CL)
关键词：Cross-model Transfer, larger model prompt, model prompt representations, combines a larger, offering a promising
备注： 35 pages
点击查看摘要
Abstract:Prefill-to-Autoregressive Cross-model Transfer (PACT), a form of latent communication between language models, combines a larger model's prompt representations with a smaller model's efficient generation, offering a promising way to balance capability and inference cost. However, existing systems provide limited support for independently evaluating large-small model collaboration, and improved task performance alone does not establish whether the receiver benefits from the sender's information. We introduce PLatour, an open-source PACT framework that connects frozen models through lightweight, zero-initialized linear bridges trained directly with task rewards and supports hybrid-attention architectures. PLatour significantly outperforms open-source baselines on generation tasks and surpasses Mostik's reported results on shared mathematics and coding benchmarks using a substantially smaller sender. However, controlled experiments show that the gains on some tasks can be reproduced by uninformative sender signals, self-communication, or receiver-only training. We find that trainable bridges can act as parameter-efficient adaptation mechanisms without exploiting useful sender information. We therefore propose PACT-Check to quantify how much of a trained PACT system's gain genuinely comes from communication. Finally, we discuss the opportunities and challenges of PACT systems. Code is available at this https URL.
91. 【2611.06969】Interactive Backdoor Attacks in LLM-Based Proactive Dialogue Systems
链接：https://arxiv.org/abs/2611.06969
作者：Zhiyang Xia,Yuming Shang,Xi Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：systems provide goal-directed, provide goal-directed support, LLM-based proactive dialogue, proactive dialogue systems, dialogue systems provide
备注： 26 pages
点击查看摘要
Abstract:LLM-based proactive dialogue systems provide goal-directed support through sustained interaction. Fine-tuning their underlying models on externally supplied dialogue data introduces backdoor risks. Existing LLM backdoor studies primarily focus on eliciting an attacker-specified response upon trigger activation. We present an interactive backdoor attack framework that uses training-data poisoning to steer post-trigger, multi-turn interactions toward an attacker-specified objective. Poisoned fine-tuning dialogues implant a trigger-conditioned guidance-policy bias that ordinary user utterances can activate, without deployment-time prompt modification or further attacker intervention. Specifically, we instantiate three complementary attacks under progressively expanded post-trigger interaction settings: (1) Direct Attack, which targets an immediate response deviation upon trigger activation, retaining the conventional trigger--response setting; (2) Constrained Progressive Attack, which progressively advances the attack objective along a predefined multi-turn trajectory; and (3) Unconstrained Progressive Attack, which extends target-directed steering to open-ended interactions with varied user continuations. Using psychological counseling as a representative setting, experiments on two LLM backbones and two dialogue datasets show that all three attacks effectively achieve their objectives under their respective interaction settings while largely preserving normal utility. Separate defense evaluations show that the tested training-data filters retain nearly all poisoned dialogues, while three post-admission baselines leave substantial residual attack-specific success.
92. 【2611.06956】Octopus: One Brain, Many Branches for Latent-KV Multi-Agent Reinforcement Learning
链接：https://arxiv.org/abs/2611.06956
作者：Tianming Sha
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：LLM systems explore, Multi-agent LLM systems, LLM systems, single-agent systems append, isolated context windows
备注： 19 pages, 12 figures, 7 tables
点击查看摘要
Abstract:Multi-agent LLM systems explore in parallel by spawning sub-agents with isolated context windows, whereas single-agent systems append every search and verification step into one growing trajectory. However, existing multi-agent frameworks duplicate prefix KV caches across branches, exchange findings by re-prefilling text summaries, and flatten or drop cross-branch dependencies during reinforcement learning (RL). We introduce Octopus, a single-model multi-agent RL framework in which all threads share one backbone and coordinate over a GPU-resident directed acyclic graph (DAG) of KV states through five primitives (fork, read_thread, wait_threads, rewind, commit). Octopus combines three co-designed mechanisms: (1) Zero-Copy Radix Forking, which spawns branches as $\mathcal{O}(1)$ cursor views over shared physical KV pages; (2) Attention-Only KV Mounting, which mounts a sibling thread's terminal KV blocks directly into full-attention layers while bypassing linear-recurrent states (Gated DeltaNet / Mamba-2), cutting off-task hijacking by $21\times$ ($57.9\% \to 2.7\%$) while retaining $92.2\%$ of full-text mutual information at zero extra KV allocation; and (3) a Packed DAG-GRPO Trainer, which packs all episode branches into one block-sparse attention pass and assigns counterfactual branch credit via leave-one-branch-out marginal rewards. Trained end-to-end with GRPO on Qwen3.5-4B over a sparse BM25 corpus, Octopus reaches $49.6\%$ accuracy on BrowseComp-Plus ($+17.5$ points over single-agent GRPO at 143K context and $+12.5$ points over text-summary multi-agent RL) and $51.2\%$ on OpenResearcher, outperforming dense-retrieval agents up to $250\times$ larger while increasing training throughput $3.3\times$ and cutting peak KV memory $2.8\times$.
Comments:
19 pages, 12 figures, 7 tables
Subjects:
Machine Learning (cs.LG); Computation and Language (cs.CL)
Cite as:
arXiv:2611.06956 [cs.LG]
(or
arXiv:2611.06956v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2611.06956
Focus to learn more
arXiv-issued DOI via DataCite</p>
93. 【2608.11676】XBridge: Entity-Grounded Latent Bridge for Heterogeneous LLM Communication
链接：https://arxiv.org/abs/2608.11676
作者：Wooseong Yang,Wei-Chieh Huang,Weizhi Zhang,Yu Wang,Philip S. Yu,Junhyun Lee
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Heterogeneous multi-agent LLM, multi-agent LLM systems, redundant reasoning patterns, reducing redundant reasoning, Heterogeneous multi-agent
备注： Accepted at NeurIPS 2026. 18 pages, 4 figures
点击查看摘要
Abstract:Heterogeneous multi-agent LLM systems, where agents are powered by different model families, can outperform homogeneous configurations by reducing redundant reasoning patterns. Yet existing communication protocols either operate through text, discarding the sender's internal representations, or require architectural homogeneity for latent-level transfer. We identify the entity grounding problem in cross-architecture communication: cross-attention bridges that transfer continuous representations across different LLM families suffer from rare-token compression collapse, where entity identity is lost in the continuous bottleneck (bridge-only F1 ~30%). We propose XBRIDGE, a decode-free communication protocol that addresses this through two mechanisms. Lexical Anchor Mapping (LAM) maps the sender's original context tokens to the receiver's vocabulary, providing discrete entity anchors. A Latent Enrichment Bridge (LEB) lets the receiver query the sender's hidden states for contextual enrichment. The entity anchors ground the bridge's contextual signals to specific entities through the receiver's own self-attention. Across three model families (Llama, Qwen, and Mistral), seven benchmarks, and both communication directions, XBRIDGE outperforms text-based communication on all seven tasks for each model pair while achieving 11x lower latency, and in a same-architecture setting it also exceeds a KV-sharing baseline on six of seven tasks. LEB requires only 264M trainable parameters (3.8% of the receiver), is trained on a small balanced sample set, and adds negligible inference overhead.
94. 【2611.07845】Masked diffusion as random sequential adsorption: an exactly solvable model for parallel decoding
链接：https://arxiv.org/abs/2611.07845
作者：Adrian Baule
类目：atistical Mechanics (cond-mat.stat-mech); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Masked diffusion models, diffusion models generate, models generate text, Masked diffusion, stochastic masking process
备注： 14 pages (incl. appendices), 3 figures
点击查看摘要
Abstract:Masked diffusion models generate text by reversing a stochastic masking process. Unlike autoregressive LLMs, which generate text one token at a time, they can reveal many tokens in parallel, at the price of an error, since tokens revealed together are drawn independently. We show that this trade-off maps onto the statistical physics of driven many-particle systems. (i) For any data, the error of parallel generation is the entropy production of the generation process relative to the reversed masking process. (ii) For Markov data, generation is a random sequential adsorption process with labelled gaps, which we solve exactly for any number of steps. (iii) For many steps, the error becomes the dissipation of a slowly driven system: the unmasking schedule plays the role of the driving protocol, the number of steps that of its duration, and the error is set by a thermodynamic metric that we obtain in closed form from the mutual information between tokens. Optimal schedules are geodesics of this metric. The exact solution shows how correlations in the text shape both the error and the quality of the output. The longer the correlations, the more the error concentrates at the start of generation. Schedules that start with small steps then gain more, both in path error and in perplexity, and need fewer steps to reach their asymptotic behaviour.
信息检索
1. 【2611.08325】Decision Models as Retrieval Gates Against Injection and Pollution
链接：https://arxiv.org/abs/2611.08325
作者：Mahdi Ghadamyari,Reza Habibi
类目：Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：carry instructions aimed, synthetic pages written, Retrieved web text, written to mislead, screen retrieved passages
备注： 5 pages, 3 figures
点击查看摘要
Abstract:Retrieved web text can carry instructions aimed at the language model, or synthetic pages written to mislead. We test whether released open-weight decision models, which answer typed questions about a text without generating tokens, can screen retrieved passages against both threats. On a benchmark of 1,000 questions over forum-style web pages with hidden injected instructions, a Kev-4B gate reads each passage's HTML. Attack success, measured automatically, falls from 27.9% with no defence to 13.6% with the published mitigations (sanitisation, normalisation and citation prompting) and to 5.7% with the gate added. The gate takes 76 ms per passage and wrongly flags 4 of 186 benign pages with instructions for human readers. Responsiveness on clean queries stays within a point (85.6% to 86.2%). On a 200-query pollution testbed where two thirds of the candidate pages are fake, filtering the pool before the top ten are chosen keeps fake pages out of the answer (0.5% exposure) and holds accuracy at 83%, against 28% with no filter. Filtering only the top ten leaves the generator too few pages to answer. Large LLMs used as judges rank attacks better (AUROC 0.99 against 0.94) but cost ten times more. Gates catch more attacks when they read the page's HTML than when they read its plain text. Every model is open-weight.
2. 【2611.08306】GINGER: Spicing Up Graph-Based Vector Search
链接：https://arxiv.org/abs/2611.08306
作者：Daniel Salwasser,Lars Gottesbüren,Laxman Dhulipala,Jakub Łącki,Guy Blelloch,Rajesh Jayaram,Tobias Rubel,Kshiteej Sheth,Amir Zandieh,Vahab Mirrokni
类目：Information Retrieval (cs.IR); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：graph-based approximate nearest, approximate nearest neighbor, Ginger, nearest neighbor search, textsc
备注：
点击查看摘要
Abstract:We present \textsc{Ginger}, a state-of-the-art open-source C++ library for graph-based approximate nearest neighbor search (ANNS). We developed \textsc{Ginger} at Google to push the speed and memory efficiency of graph search on large and high-dimensional embedding datasets. \textsc{Ginger} surpasses existing ANNS libraries with regards to query throughput and indexing time while matching the memory footprint of the most space-efficient competitors. \textsc{Ginger} builds upon recent advances in proximity graph construction (PiPNN) and vector quantization (TurboQuant). We introduce Nested TurboQuant (NTQ), a two-level quantizer which supports low precision graph navigation and high precision reranking in a single code. This representation achieves near floating point precision with $2.6\times$ less memory. We also compress the size of our proximity graphs by up to $2.5\times$ without impacting query throughput. We combine graph reordering with a new lossless compression codec called AdaptiveGap, which builds upon StreamVByte. At $95\%$ recall, \textsc{Ginger} speeds up query throughput by an average of $1.8\times$ over each dataset's fastest competitor and by at least $2.3\times$ over any single library. This lead grows to $2.9\times$ over compact libraries on high-dimensional embeddings.
Subjects:
Information Retrieval (cs.IR); Distributed, Parallel, and Cluster Computing (cs.DC)
Cite as:
arXiv:2611.08306 [cs.IR]
(or
arXiv:2611.08306v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.08306
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
3. 【2611.08228】Domain-specific information retrieval
链接：https://arxiv.org/abs/2611.08228
作者：Suzan Verberne,Florina Piroi,Allan Hanbury
类目：Information Retrieval (cs.IR)
关键词：information seeking activities, Information Retrieval, information seeking, large portion, seeking activities
备注： Published in Foundations and Trends in Information Retrieval
点击查看摘要
Abstract:Information Retrieval (IR) is much more than ad hoc web search: a large portion of the information seeking activities takes place in specific domains, often addressing work-related tasks. Examples are lawyers finding relevant prior cases for a legal case and academic researchers studying the background material for a paper. In Chapter 2 we outline the most common domain-specific tasks, datasets and applications. Domain-specific IR has a number of challenges that make set it apart from simple web search tasks: they often deal with long documents, long queries and long sessions with specific user needs. We discuss these in Chapter 3. We also address issues related to bias and fairness of models. In Chapter 4, we describe the models and methods developed for domain-specific tasks and data, addressing the specific challenges, including user aspects related to domain-specific IR tasks, dealing with queries, user models, and user interactions. We show that many of the methodological advances in domain-specific IR are transferable to other domains and even to open-domain web search. We conclude with the main takeaways and propose research directions for the near future.
4. 【2611.08014】Probabilistic Relevance Decisions for Semantic Retrieval
链接：https://arxiv.org/abs/2611.08014
作者：Bahadır Tatar(1),Cevat Şener(1 and 2) ((1) Recruspace LLC, (2) Middle East Technical University)
类目：Information Retrieval (cs.IR)
关键词：reusable corpus representations, similarity supplies reusable, supplies reusable corpus, offer query-dependent document, Dense similarity supplies
备注： 17 pages, 3 figures, 11 tables
点击查看摘要
Abstract:Dense similarity supplies reusable corpus representations, while probabilistic relevance decisions offer query-dependent document scoring. We compare dense-only BGE-M3 with TypeSafe Jev Noul and OpenAI Decisions Predicate scores on the official BEIR SciFact test benchmark. The study evaluates 300 official test queries using identical positive-enriched 100-document pools and full-corpus dense retrieval followed by reranking at candidate depths of 50 and 100. Unlike the controlled pools, neither dense prefix receives positive injection. Jev has the highest observed Recall@5 and nDCG@10 under the evaluated conditions. At depth 50, full-corpus nDCG@10 is 0.6413 for BGE-M3, 0.7545 with OpenAI and 0.7805 with Jev. Extending depth from 50 to 100 increases known-positive candidate recall but produces small, uncertain final-effectiveness changes. All four paired-bootstrap depth intervals include zero. Unique-condition API scoring cost approximately doubles, while compatible cached decisions reduce incremental expenditure. OpenAI returns many exact-zero scores, and secondary exact-tie randomization reveals ranking sensitivity without replacing deterministic primary results. Top-100 latency mixes cached and new execution. Historical hybrid latency is a saved-component sum under different execution environments and timer boundaries. These exploratory, unadjusted analyses support relevance decisions as a complement to dense retrieval within this protocol, without establishing general superiority, probability calibration or equivalence between depths.
5. 【2611.07971】ArcadeDB in Python: An In-Process Multi-Model Database
链接：https://arxiv.org/abs/2611.07971
作者：Taewoon Kim
类目：Databases (cs.DB); Information Retrieval (cs.IR)
关键词：Java Runtime Environment, transactional reads, reads and writes, vector embeddings, Python
备注： 12 pages. Published in the SciPy Proceedings 2026 (Proceedings of the 25th Python in Science Conference), [this https URL](https://proceedings.scipy.org/articles/fwvt2525)
点击查看摘要
Abstract:Some Python workflows need transactional reads and writes over documents, traversals over a graph, and similarity search over vector embeddings. In practice these are split across separate systems (a document store, a graph engine, and a vector index), and the data is copied between them and kept consistent by application code. ArcadeDB is an open-source multi-model database engine, written in Java, that supports all three access patterns and can be embedded in a host process. We present arcadedb-embedded, a Python package that runs ArcadeDB inside the Python process via JPype, using a Java Runtime Environment bundled in the wheel. One pip install gives a database with documents, a property graph, and vector search, and needs no Java installation. Query results can be returned as Python lists, NumPy arrays, pandas DataFrames, or Arrow tables. We demonstrate a hybrid retrieval workflow that chains vector search, SQL filtering, and graph traversal over one dataset. We benchmark arcadedb-embedded against SQLite, DuckDB, LadybugDB, and Chroma, and report its costs.
6. 【2611.07928】ZeroRAG: Adaptive Semantic Peer Routing for Decentralized Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2611.07928
作者：Petru Neague,Quinten Stokkink,Martijn de Vos,Rafael Pires,Mathis Randl,Anne-Marie Kermarrec,Johan Pouwelse
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Networking and Internet Architecture (cs.NI)
关键词：large language model, Retrieval-augmented generation, language model, outputs by retrieving, standard approach
备注： 14 pages, 8 figures
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) is a standard approach to enhance the reliability of large language model (LLM) outputs by retrieving documents relevant to a query and supplying them in the LLM prompt. Today's RAG systems collect, index, and serve these documents from centralized stores. In practice, however, documents are owned by organizations, devices, and individuals who cannot or will not surrender custody of them to a central party, e.g., because of privacy, copyright or regulatory compliance. Existing modern decentralized retrieval techniques either reintroduce a coordinating authority, or rely on a global data structure that requires continuous network-wide coordination (e.g., DHTs). We present ZeroRAG, a decentralized routing layer for document retrieval in RAG that performs semantic query routing across an overlay of peers with- out global data structures or centralized orchestration. Documents remain with the peers that own them, and each peer keeps only lightweight local state: a bounded set of neighbor advertisements and a cache of recently routed queries. Using these, ZeroRAG steers each query through a best-first walk that progressively rewires the overlay toward semantically relevant neighbors, so recall improves over time as the network self-organizes. We evaluate ZeroRAG using three real-world workloads and two decentralized baselines. We find that ZeroRAG outperforms baselines in terms of recall and required network messages, approaches the recall and LLM answer accuracy of a centralized document store, self-heals after catastrophic peer failures, and scales to 100 000 peers.
7. 【2611.07899】Persistent Retrieval for Conversational Agents: A Study of Retrieval Efficiency
链接：https://arxiv.org/abs/2611.07899
作者：Karthik Ravula,Sathwik Kowtha,Rishabh Verma,Kala Mehak Jain,Gunjit Mittal
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Conversational agents, main agent, retrieve information directly, retrieval, retrieve information
备注： 9 pages, 4 figures, 6 tables
点击查看摘要
Abstract:Conversational agents can retrieve information directly or delegate retrieval to a subagent. This design choice affects how retrieval history is maintained, what context each model call receives, and what information must be re-retrieved in follow-up questions. We compare three designs: skill-based retrieval in the main agent, a non-persistent retrieval subagent that generates a findings response, and our persistent retrieval subagent, which maintains retrieval history across turns and returns retrieved evidence directly to the main agent. Our approach also allows the main agent to request corrections from the same subagent. We evaluate the three designs on enterprise questions posed independently, within shared conversations, and as dependent follow-ups. Across five multi-turn settings, our approach uses 43.3% fewer recorded agent-model tokens and incurs 45.0% lower estimated API cost than skill-based retrieval, while reducing average response time by 9.1%. Compared with non-persistent retrieval, it reduces response time by 15.6 seconds per question, while using 65.1% more tokens and incurring 29.1% higher estimated API cost. Our approach shifts the retrieval subagent from producing synthesized responses to maintaining retrieval state and supplying evidence that the main agent can directly evaluate and use for answer generation.
Comments:
9 pages, 4 figures, 6 tables
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
Cite as:
arXiv:2611.07899 [cs.AI]
(or
arXiv:2611.07899v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2611.07899
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
8. 【2611.07859】CORE: Coarse-to-Fine Search with Context Management for Deep Research
链接：https://arxiv.org/abs/2611.07859
作者：Hoang Tran Vuong,Ngoc Quan Pham,Hung Bui,Fatih Porikli,Dat Quoc Nguyen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Deep research agents, Deep research, answer complex questions, complex questions, Deep
备注： 24 pages
点击查看摘要
Abstract:Deep research agents answer complex questions through repeated search. They rely on a harness that runs their tool calls and returns evidence to their context. This creates a trade-off: Search works best over long passages, which give enough context for reliable semantic matching. But the returned evidence should be short, because every observation stays in the agent's context for the rest of the trajectory. We introduce CORE, a training-free harness that combines coarse-to-fine search with context management. CORE retrieves passages with a dense retriever. It then reuses the token-level similarities from a late-interaction reranker to return only the most relevant snippet from each passage. Context management lets the agent expand the context around sources it has already retrieved and suppresses repeated snippets. In controlled closed-search comparisons with the Tongyi DeepResearch and OpenResearcher harnesses, CORE achieves state-of-the-art answer accuracy and evidence recall across three agent models and three benchmarks (BrowseComp-Plus, BrowseComp-Wikipedia and BrowseComp-Plus-CM), on corpora containing up to 553M documents.
9. 【2611.07851】asteply: Externalizing Stable and Situational Preference as Manipulable Spatial Objects
链接：https://arxiv.org/abs/2611.07851
作者：DaEun Choi,Daniel Lee
类目：Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
关键词：recommender systems treat, systems treat user, infer and optimize, depending on context, treat user preferences
备注：
点击查看摘要
Abstract:Most recommender systems treat user preferences as a single signal to infer and optimize, yet human preferences are a mix of a stable preference and situational preferences that turn on and off depending on context. Through Tasteply, we externalize this preference structure as manipulable spatial objects. Tasteply represents each situational preference as an attractor and the stable preference as an underlying global field. Users can adjust their feed by moving around the space and adjusting the strength of the global field, turning the preference structure that remains latent within the model into something they can see and act on directly to steer the recommendation algorithm. Through an exploratory study (N=5), we found that this spatial control was effective, along with its limits and future direction as a means of manipulating preference-based recommendations.
10. 【2611.07631】MEMOIR: A Training-Free Memory Lifecycle for Long-Horizon LLM Agents
链接：https://arxiv.org/abs/2611.07631
作者：Mayank Anand,Subham Raj,Aman Vaibhav Jha,Sriparna Saha
类目：Information Retrieval (cs.IR)
关键词：Long-horizon LLM agents, Long-horizon LLM, LLM agents require, preserve useful information, information across sessions
备注：
点击查看摘要
Abstract:Long-horizon LLM agents require memory systems that preserve useful information across sessions and retrieve it when needed. Existing systems treat these as separate problems: memories are written prospectively with static importance scores that are never revised after use. This creates two coupled failure modes: consolidation can silently destroy evidence that future queries require, while retrieval continues to favor stale memories. We propose MEMOIR (Memory Evidence via Merge-certified, Online Importance Revision), a training-free memory lifecycle that unifies judge-gated consolidation with retrospective attribution. Before compressing memory, screening gates test whether answer-relevant evidence is preserved. After each query, attribution estimates which retrieved memories supported the answer and updates their retrieval priority. A UCB-style exploration bonus additionally encourages retrieval of under-exposed memories, reducing the risk that frequently retrieved memories crowd out useful but less-seen evidence. On 1,905 deduplicated LoCoMo QA pairs, the full retrieval stack improves evidence recall@5 by 11.92 percentage points over bare cosine, with confidence-gated feedback adding 1.50 points overall without reference answers or reranker training; a deployment-unavailable oracle adds 1.84 points overall and 8.05 points on multi-hop. Judge-gated merge changes the recall of text-based evidence from 58.82% to 59.08%, reduces the active store by 1.42%, and incurs 0 observed losses in 100 independently audited merges, with a one-sided 95% upper loss-rate bound of 2.95%. Together, these results outline a practical deployment path: no additional LLM call on the online write path, with merge screening confined to periodic offline consolidation. The lifecycle reduces to one principle: attribute usefulness after use, and screen for preservation before compression.
11. 【2611.07591】Beyond Independent Predictions: Learning the Browsing Journey for Sequence-Level Re-ranking
链接：https://arxiv.org/abs/2611.07591
作者：Jiayi Zhang,Jingxin Hai,Zhenjia Ma,Hongbin Pei,Dagui Chen,Han Zhu,Jian Xu
类目：Information Retrieval (cs.IR)
关键词：Re-ranking aims, maximizes sequence-level utility, aims to present, ordered list, list that maximizes
备注：
点击查看摘要
Abstract:Re-ranking aims to present users with an ordered list that maximizes sequence-level utility. Industrial deployments widely adopt the Generator--Evaluator framework, where the generator proposes candidate sequences, and the evaluator scores them to select the best one for display. The fidelity of the evaluator's utility estimates thus directly governs recommendation quality. However, existing evaluators predominantly follow the \textbf{Independent Behavior Modeling (IBM)} paradigm, which simplifies the continuous user \emph{browsing journey} into independent per-item predictions (e.g., CTR). This oversimplification ignores two physical realities: (i) a click can occur only after the item has been reached and impressed, and (ii) items compete for finite user attention. As a result, IBM produces systematically biased evaluations and suboptimal sequence selection. To address this, we propose a \textbf{Joint Behavior Modeling (JBM)} perspective that explicitly models the \emph{display} $\rightarrow$ \emph{impression} $\rightarrow$ \emph{click} process to capture causal and competitive dependencies within a sequence. Building on JBM, we develop the \textbf{Impression-Click Evaluator (ICE)}, a plug-and-play framework that (i) predicts a browsing-depth distribution to estimate per-position impression probabilities, (ii) leverages predicted impressions to suppress spurious context from unexposed items during click modeling, and (iii) introduces a click distribution matching objective to capture intra-sequence dependencies. Extensive offline experiments across diverse backbones, together with a 14-day online A/B test in the Taobao App (+0.70\% clicks, +3.67\% revenue) and full-traffic deployment, validate the effectiveness and robustness of our approach.
12. 【2611.07588】What Gets Hacked in a Collaborative Reward for LLM Recommenders: The Part That Does Not Depend on the User
链接：https://arxiv.org/abs/2611.07588
作者：Zhuangsheng Li,Liang Dong,Yu Wu,Dailin Li,Yu Xia,Yunhan C. Zhang,Rui Cai,Yi Wu,Julian McAuley
类目：Information Retrieval (cs.IR)
关键词：large language model, scores provide graded, training large language, provide graded, recommenders through reinforcement
备注：
点击查看摘要
Abstract:Collaborative-filtering (CF) scores provide graded, personalized rewards for training large language model (LLM) recommenders through reinforcement learning. However, these rewards can cause exposure collapse: even though the CF model itself produces diverse top recommendations across users, an LLM optimized with its rewards concentrates on fewer items. We decompose each score into an item-mean component, the item's average CF score across user histories, and a residual component, the current user's score deviation from the average. Through controlled interventions, we identify the item-mean component as a contributor to exposure collapse. Accordingly, we propose two reward corrections: per-item centering removes each item's estimated mean score, while per-item standardization further rescales the residual using its estimated standard deviation. Experiments on two datasets with two identifier schemes show that both corrections substantially improve catalog coverage and exposure evenness. Compared with training on the uncorrected CF reward, our corrections increase the number of distinct items ranked first across users by up to $9.8\times$, while maintaining comparable ranking accuracy. Code is available at this https URL.
13. 【2611.07523】OptST: Optimizing Semantic Tokenization for LLM-Enhanced Recommendation
链接：https://arxiv.org/abs/2611.07523
作者：Hanchong Chen,Jie Liu,Fuyuan Lyu,Dugang Liu,Lingjie Li,Xiuqiang He,Xing Tang
类目：Information Retrieval (cs.IR)
关键词：enrich the identifiers, Semantic tokenization, Semantic, structured fields, Optimizing Semantic Tokenization
备注： Accepted to Findings of WSDM 2027
点击查看摘要
Abstract:Semantic information can enrich the identifiers and structured fields used by recommender systems. Semantic tokenization provides a structured representation of this information by converting LLM-derived user profiles into discrete tokens. In the common two-stage pipeline, the tokenizer is trained before the recommender. Its token assignments are then treated as fixed input features during recommendation training. As a result, the downstream recommender can learn how to use the assigned indices, but it cannot revise the semantic partition that produced them. Making this partition task-aware is difficult because nearest-code assignment is discrete, and unconstrained adaptation may also distort the geometry learned during pretraining. Moreover, a fixed token depth exposes the same semantic resolution to every interaction. We thus propose OptST (Optimizing Semantic Tokenization), which makes a pretrained tokenizer responsive to downstream recommendation. To revise token assignments without directly updating the pretrained encoder or base codebooks, OptST learns a low-rank deformation whose drift is limited by an anchor regularizer. Recommendation supervision reaches this transformation through a straight-through estimator, while prediction retains hard nearest-code assignments. Beyond adapting the assignments themselves, OptST selects an interaction-conditioned prefix to control how much residual detail is exposed to the recommender. Experiments on four public datasets show that OptST achieves the highest AUC among conventional and LLM-enhanced baselines. Its improvements also persist across different recommendation backbones. These results establish task-aware semantic tokenization as an effective interface between LLM-derived profiles and downstream recommendation models.
14. 【2611.07486】MEvince: Knowledge-Constrained LLM Reasoning for Technique Identification from Malware Reports
链接：https://arxiv.org/abs/2611.07486
作者：Hongyu She,Yiling He,Mengda Xie,Yiping Liu,Xingzhi Qian,Zhan Qin,Lorenzo Cavallaro
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Mapping behavioral intelligence, identification remains challenging, reliable identification remains, supports threat analysis, Mapping behavioral
备注：
点击查看摘要
Abstract:Mapping behavioral intelligence in malware analysis reports to ATTCK techniques supports threat analysis and defense, but reliable identification remains challenging. Supporting evidence is often scattered across long, heterogeneous reports, while closely related techniques share behavioral cues and differ only in subtle but decisive details. While large language models (LLMs) can use external knowledge to interpret reports, they may assign techniques based on plausible associations rather than sufficient evidence. We present MEvince, a knowledge-constrained LLM reasoning framework for report-level malware technique identification. Its core is a shared behavioral representation connecting report observations to technique definitions. This representation is built through agentic mining of technique documentation and supports two online stages: 1) primitive-guided extraction uses behavioral primitives to structure LLM-extracted observations, link them to source passages, and group dispersed evidence; 2) evidence-aligned retrieval matches this evidence to technique profiles through the same concepts, retaining likely candidates and confusable alternatives for LLM comparison of distinguishing behaviors. Controls at both stages validate evidence references and check technique-specific requirements. The representation also supports adaptation without parameter updates, where offline agentic audits diagnose concept weaknesses and refine extraction or retrieval policies. We evaluate MEvince against 11 baselines spanning four method families using a dataset of 610 public malware reports referenced by MITRE ATTCK. MEvince improves exact-ID F1 over the strongest baseline by 17.4%, and its concept-guided retrieval increases gold-label candidate coverage from 31.6% to 47.9%. With a small adaptation set, offline refinement yields further gains and outperforms baselines that update model parameters.
15. 【2611.07425】BRIDGE: Bridging the Semantic Quantization Gap for Generative Recommendation
链接：https://arxiv.org/abs/2611.07425
作者：Yatong Xiao,Mingjie Sun,Peng Wang,Wenjin Wu,Peng Jiang
类目：Information Retrieval (cs.IR)
关键词：Generative recommendation retrieves, recommendation retrieves items, Generative recommendation, generating Semantic IDs, RQ-VAE quantizes
备注：
点击查看摘要
Abstract:Generative recommendation retrieves items by autoregressively generating Semantic IDs(SIDs), where an RQ-VAE quantizes each item into a hierarchical SID sequence that the decoder generates level by level. We identify an overlooked bottleneck in this paradigm: the Semantic Quantization Gap(SQG). Quantization derives SIDs from rich continuous signals, including codebook centroids, local neighborhood geometry, and level-wise entropy. However, the decoder receives only discrete identifiers and loses the semantic structure that shaped them. This mismatch manifests in three ways: a grounding gap, where the decoder lacks semantic anchors when target-side information is limited; a neighborhood gap, where token-level supervision discards inter-item similarity and exacerbates exposure bias; and a difficulty gap, where computation is allocated uniformly despite generation difficulty diminishing with depth. To bridge the SQG, we propose BRIDGE. Codebook-grounded latent reasoning injects frozen quantizer centroids as semantic anchors before SID generation. Privileged EMA self-distillation transfers neighborhood-aware knowledge from a teacher to an on-policy student, preserving inter-item geometry while mitigating exposure bias. Effort-aware recurrence allocates more computation to the challenging early levels and progressively reduces it with depth. Across three Amazon benchmarks, BRIDGE improves Recall@10 and NDCG@10 by 10.9% and 9.7% on average over the strongest baseline (up to 12.6% and 10.7%). In a one-week online A/B experiment on a large-scale e-commerce advertising platform with 5% traffic, BRIDGE improves eCPM by 0.65%.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2611.07425 [cs.IR]
(or
arXiv:2611.07425v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2611.07425
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
16. 【2611.07393】CacheGraft: Enhancing Retrieval-Augmented Generation via Latent-Space Document Enrichment
链接：https://arxiv.org/abs/2611.07393
作者：Vihan Lakshman,Peter Baile Chen,Zhuohan Gu,Michael Cafarella
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Recent work, transformer-based language model, language model agents, space via key-value, work in machine
备注： 5 pages. Third KEIR Workshop @ CIKM 2026. Work in progress
点击查看摘要
Abstract:Recent work in machine learning has demonstrated that transformer-based language model agents can communicate state not only through text, but also directly in latent space via key-value (KV) caches. In this paper, we argue that such cache-to-cache translation can provide utility beyond the original motivating application of real-time agent communication and can instead be utilized for retrieval-augmented generation (RAG). Building on the Cache-to-Cache (C2C) fusion framework, our proposed system CacheGraft encodes each corpus passage offline into a fused KV cache representation between a larger sharer model (4B parameters in our experiments) and a smaller receiver model (0.6B parameters) such that this cache can be injected into the receiver at query time with no need for the larger model. Across five QA benchmarks and two independent locally-run judges, CacheGraft improves answer quality over the text-only receiver baseline in 29 out of 30 comparisons, of which 17 of the 30 are statistically significant. Notably, these gains are zero-shot with respect to the fuser, which was never trained on retrieval data. These initial results suggest that latent-space document enrichment may be a promising avenue for enhancing the performance of RAG systems, particularly in compute-constrained settings where it is only feasible to deploy a small model at inference time.
17. 【2611.07298】Reducing Representational Interference in Retrieval Embeddings with Trainable Prefix Tokens
链接：https://arxiv.org/abs/2611.07298
作者：Seongtae Hong,Youngjoon Jang,Jungseob Lee,Chanjun Park,Heuiseok Lim
类目：Information Retrieval (cs.IR)
关键词：compress variable-length text, entangle semantic content, fixed-size vector representations, models compress variable-length, Embedding models compress
备注： CIKM 2026
点击查看摘要
Abstract:Embedding models compress variable-length text into fixed-size vector representations, but this compression can entangle semantic content with residual token-level information, such as artifacts arising from attention sink behavior. We propose a simple method that prepends trainable [DUMP] tokens to the input during embedding model training. The method keeps the model architecture, pooling strategy, and training loss unchanged, while optimizing the added tokens through the standard contrastive retrieval objective. By introducing trainable prefix positions that interact with regular tokens during encoding, [DUMP] tokens help reduce the influence of residual or uninformative token-level signals on the final retrieval representation. Experiments on standard retrieval and long-context benchmarks show that our method consistently improves over finetuned baselines across encoder and decoder embedding models. Further analysis shows that [DUMP] tokens alter token-level activation and attention patterns associated with low-information tokens. These results suggest that trainable prefix tokens provide a lightweight way to improve retrieval representations.
18. 【2611.07174】MapHub: Daily Relevance Heatmaps of New arXiv Preprints for a Research Community
链接：https://arxiv.org/abs/2611.07174
作者：Kaili Cao,Camille Avestruz,Feige Wang
类目：Instrumentation and Methods for Astrophysics (astro-ph.IM); Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词：arXiv Preprint Hub, MIDAS arXiv Preprint, Preprint Hub, large language model, language model reading
备注： 3 pages, 1 figure, submitted to RNAAS
点击查看摘要
Abstract:MapHub, the MIDAS arXiv Preprint Hub, assesses each day's new arXiv submissions for every participant in a research community, with a large language model reading each paper against portfolios built for the participants. It publishes the relevance scores, from 0 to 100, as a heatmap that shows whose work each paper touches. In the authors' blind ratings, the top 10\% of papers by MapHub's scores held about 70\% of the raters' own top 5\%, pooled, against about a third for a text-matching baseline. About 6\% of a day's astro-ph papers reach 30 for each participant, and one every three days reaches 60. MapHub runs on a standard Claude subscription and is designed to be useful for any field: this https URL.
计算机视觉
1. 【2611.08486】Do You Miss the Nights We Spent Crafting Figures? Rethinking Teaser and Framework Figures in the Age of Generative AI
链接：https://arxiv.org/abs/2611.08486
作者：Xiaoqi Zhao,Youwei Pang,Kailai Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：give research ideas, figures give research, give research, research ideas, Scientific figures give
备注：
点击查看摘要
Abstract:Scientific figures give research ideas a visual form through choices of abstraction, composition, and emphasis. Generative AI offers new ways to realize these choices, raising questions about explanatory clarity and purposeful visual expression. We examine these questions through a visual retrospective of 371 motivation and framework figures from 200 papers. The corpus comprises a quota-based main sample of 160 papers spanning four temporal periods and a separate purposive style-contrast sample of 40 papers. A single multimodal judge evaluates six dimensions of communication and design, with three repeated judgments per figure. We attempt source-constrained revisions of all 371 figures, of which 369 pass the recorded fidelity checks. Original-figure ratings show no uniform decline across periods. Revisions increase mean clarity ratings by 0.428 points and decrease aesthetic coherence ratings by 0.111 points on a five-point scale. Gains in the six-dimension average are larger for main-sample motivation figures than for frameworks. Case analyses show that added explanation can clarify comparisons while leaving typographic hierarchy and visual economy unresolved. These model-based findings support researcher-led design, with AI assisting exploration and authors retaining responsibility for explanatory purpose, composition, and scientific relationships. The accompanying atlas and evaluation records are available at this https URL.
2. 【2611.08485】Where and Why is Grounded Reasoning Useful?
链接：https://arxiv.org/abs/2611.08485
作者：David Yan,Le Xue,Forrest Huang,Qiuyi Zhang,Dustin Tran,Andrew M. Dai,Yinfei Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Grounded reasoning, solving complex visual, reasoning, Grounded, relevant locations
备注： Project page: [this https URL](https://elorian.ai/blog/why-grounding)
点击查看摘要
Abstract:Grounded reasoning, where a model outputs text coordinates of relevant locations in chain-of-thought reasoning, is a common strategy for solving complex visual reasoning problems. However, the benefits and limitations of grounded reasoning are understudied. We study where and why grounded reasoning is most useful. To do so, we introduce a chain-of-thought analysis method to measure how much a model uses its outputted grounding in its thinking trace and perform a detailed ablation study of a grounded reasoning training recipe. We find that grounded reasoning improves counting but shows no significant gain over baselines without coordinate grounding across a wide range of spatial reasoning and perception benchmarks. Using several synthetic tasks, we show that grounded reasoning is most useful when a task requires undescribable references, which are visual concepts that are difficult to describe in language. However, we observe that many existing visual reasoning benchmarks are solvable with only describable text references. To close this gap, we introduce BrickVision, a new benchmark that requires undescribable visual references to solve.
3. 【2611.08477】EgoGeneralist: Unifying Egocentric Action-Video Tasks through Video-Native Modeling
链接：https://arxiv.org/abs/2611.08477
作者：Yanlin Jin,Bowen Yang,Cheng Zhang,Yifan Yang,Zhe Li,Jianfei Cai,Kai Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern video models, models possess strong, video models possess, Modern video, possess strong visual
备注： Project page: [this https URL](https://www.neiljin.site/egogeneralist_page/)
点击查看摘要
Abstract:Modern video models possess strong visual priors, yet do not natively represent human action in metric 3D space. We present EgoGeneralist, which adapts pretrained video generators to unify action-conditioned egocentric video generation, pose estimation, and joint action-video generation. Our role-adaptive action renderer provides video-native representations for multidirectional action-video learning, making metric motion usable as both a spatial control signal and a recoverable generation target. Cross-stream action-video coupling establishes close correspondence between metric motion and visual dynamics through lightweight adaptation while preserving the pretrained visual prior. Together, these designs establish a generalist framework spanning five action-video tasks. Despite adaptation only on controlled laboratory recordings, EgoGeneralist generalizes to diverse unseen scenes and interactions with effective action control and visual quality, bridging pretrained visual knowledge and metric 3D human motion.
4. 【2611.08449】VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
链接：https://arxiv.org/abs/2611.08449
作者：Yu-Cheng Chou,Shihao Wang,Jin Huang,Chi-Pin Huang,Chiao-An Yang,Xianzhe Fan,Jing Wang,Zhiqi Li,Yuanguo Kuang,Ruijie Zheng,Johan Bjorck,Sifei Liu,Hang Su,Abhishek Badki,Lei Zhang,Alan Yuille,Linxi "Jim'' Fan,Jan Kautz,Zhiding Yu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：autonomous driving, solely in language, robotics and autonomous, reason solely, Flash Primitive Decoding
备注：
点击查看摘要
Abstract:Models for physical AI tasks, such as robotics and autonomous driving, need not reason solely in language. They can use visual plans--points, bounding boxes, and trajectories--to represent spatial goals and anticipate motion. However, autoregressive vision-language models generate these plans one coordinate token at a time, making richer predictions increasingly costly. We introduce VFlash, a method for fast, accurate visual planning through Flash Primitive Decoding. VFlash exploits the known structure of visual primitives to predict their coordinates jointly, using a lightweight drafter that generates an entire primitive in one forward pass. The layout adapts to the primitive's type, dimensionality, and length, supporting compact boxes and long, variable-length trajectories. Crucially, spatial accuracy need not require reproducing an autoregressive model's exact token sequence. VFlash therefore trains on annotated primitives and directly accepts structurally valid predictions without target-token agreement. Across the evaluated 2D and 3D robot trajectory tasks, VFlash consistently reduces prediction errors relative to autoregressive decoding. Preliminary single-rollout measurements indicate approximately 25x faster generation for 3D point motion forecasting. A world action model conditioned on VFlash plans achieves 70.2% average success across four MolmoSpaces task suites, compared with 62.6% for the baseline.
5. 【2611.08441】Edge-Assisted Crowdsensing for Explainable Cyclist Safety Perception
链接：https://arxiv.org/abs/2611.08441
作者：Hongsen Cao,Chia-Yen Chiang,Mona Jaber,Meihui Wang,Yasmin Fathy
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：Cyclist fatality rates, fatality rates remain, rates remain high, autonomous vehicles add, vehicles add complexity
备注：
点击查看摘要
Abstract:Cyclist fatality rates remain high despite policy support for active travel, and autonomous vehicles add complexity to mixed traffic. Neither crash statistics nor multi-model detection pipelines scale to continuous monitoring of perceived safety along a route. We present an edge-assisted crowdsensing system: handlebar cameras supply street-level frames, a vision-language model (VLM) turns each frame into structured traffic attributes through a single prompt, and an explainable boosting machine (EBM) combines them with OpenStreetMap road infrastructure and on-bike kinematics to predict a crowdsourced 1-9 safety score. Extraction belongs at the network edge: the fastest self-hosted model needs 2.49 s per frame and scoring takes 0.4 ms on a CPU. On 1,362 annotated frames from two London routes, the EBM regressor reaches 72.2 percent binary accuracy and a mean absolute error of 1.011 under five-fold cross-validation. It is within one accuracy point of black-box ensembles. Its per-feature shape functions give exact attribution: physical lane separation is worth +0.97 rating points, a painted lane +0.70 and a construction site -0.65. Planners can therefore price an infrastructure change in rating points, and the results enter cost-benefit analysis directly. We also report inter-annotator agreement (alpha = 0.4695), an attribute audit, and a sensitivity analysis linking attribute error to accuracy. With re-encoding, a 20 s sampling interval serves 1,000 riders at 54 Mbit/s at a cost of 1.4 accuracy points, making continuous monitoring practical.
6. 【2611.08436】SM4RT: Cascaded Feed-forward Model for 4D Reconstruction
链接：https://arxiv.org/abs/2611.08436
作者：Pang-Chi Lo,Jhao-Syun Lai,Tsung-Wei Ke
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：RGB videos, motion estimation, multi-task cascade feed-forward, cascade feed-forward model, motion
备注： Project page: [this https URL](https://sm4rt-eailab.github.io/)
点击查看摘要
Abstract:We introduce SM4RT, a multi-task cascade feed-forward model for dynamic scene reconstruction from RGB videos. While existing feed-forward approaches typically address geometry reconstruction and motion estimation separately--and often predict motions in a single coordinate frame that must account for camera movement--SM4RT solves these tasks sequentially by first reconstructing 3D geometry and then bootstrapping motion estimation from the predicted structure. By expressing each pixel's 3D motion in its corresponding camera frame, SM4RT reduces ambiguity arising from camera motion. To address the sparsity of real-world motion labels, SM4RT further incorporates a weakly supervised loss that regularizes unlabeled point motions using labeled point positions at the other time step. We evaluate motion estimation on three dynamic-scene datasets--Kubric, Waymo, and Point Odyssey--and SM4RT achieves the best performance on most metrics compared with prior baselines. We additionally benchmark geometry reconstruction on five dynamic scene datasets and show that SM4RT achieves competitive performance with state-of-the-art methods. Overall, our unified framework demonstrates that combining geometry reconstruction and motion estimation in a cascade not only avoids performance trade-offs but also enhances motion estimation through improved geometric reasoning.
7. 【2611.08413】3R: Training-Free Two-Stage Token Refinement Towards Efficient and Robust VLA Models
链接：https://arxiv.org/abs/2611.08413
作者：Mohammed Hassan,Zhenyang Chen,Zheng Wang,Zhixin Zhu,Tianlong Chen,Yingyan(Celine)Lin,Chaojian Li
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：models enable, robot control, increasingly expensive, visual tokens, tokens
备注：
点击查看摘要
Abstract:Vision-Language-Action (VLA) models enable end-to-end robot control, but inference is increasingly expensive. Each decision processes hundreds of visual tokens, often across multiple cameras, leading to substantial computation while allowing irrelevant background content to distract action prediction under distribution shift. We argue that these issues stem from two complementary forms of redundancy: many visual tokens are spatially irrelevant, while attention over the remaining tokens is often misallocated. Based on this observation, we propose T3R, a Training-Free Two-Stage Token Refinement framework. In the first stage, segmentation-guided token pruning removes irrelevant visual patches to reduce computation and eliminate distracting context. In the second stage, saliency-guided attention biasing reallocates attention toward action-critical visual regions and language instructions within the retained tokens. Together, pruning produces a cleaner candidate set, while attention biasing further emphasizes the most decision-relevant evidence, yielding a better accuracy-efficiency frontier than either stage alone. On LIBERO-Spatial, T3R removes 85% of scene-camera visual tokens while essentially matching the unpruned success rate, and improves success by up to 7 percentage points under out-of-distribution object-placement perturbations. The timing comparison attributes 7.8 ms per inference call to pruning and attention-bias application. As input resolution increases, LLM-forward profiling shows up to a 3.3x speedup over the unpruned baseline. Evaluations across LIBERO, SIMPLER, and RoboTwin with three VLA backbones show the strongest accuracy-efficiency benefits in multi-camera settings. These results demonstrate that training-free token refinement is a practical approach to efficient and robust VLA inference.
8. 【2611.08407】Social Humanoid: Socially Responsive Human-Humanoid Interaction
链接：https://arxiv.org/abs/2611.08407
作者：Vongani H. Maluleke,James Ni,Kie Horiuchi,Lea Wilken,Jiahui Lei,Evonne Ng,Roei Herzig,Jitendra Malik,Trevor Darrell,Angjoo Kanazawa
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：solitary agents, leaving them unable, Social Humanoid, typically trained, trained as solitary
备注： CoRL 2026, Project page: [this https URL](https://von31.github.io/social-humanoid/)
点击查看摘要
Abstract:Humanoid robots are typically trained as solitary agents, leaving them unable to coordinate physically with human partners who naturally anticipate and adjust to one another. To bridge this gap, we present Social Humanoid, a hierarchical system that generates and executes socially responsive whole-body motion on a 29-DoF Unitree G1 conditioned on a human partner's motion. Its high-level policy performs flexible sequence modeling of human and humanoid motion through a shared tokenized representation, generating reactive humanoid motion and anticipating the partner's motion when they are occluded, while a low-level whole-body tracking controller executes the generated motion on the robot. To train the system, we introduce a two-phase adaptive retargeting procedure that retargets one interaction partner to the robot while morphing the other partner to preserve contact dynamics, reachability, and relative body scale. We apply this procedure across five motion-capture datasets to produce a new Human-Humanoid Interaction (HHI) benchmark of 260 hours of human-humanoid interactions. Our results demonstrate that Social Humanoid produces coordinated, human-aligned behavior across diverse interaction types in simulation and the real world. Project page: this https URL
9. 【2611.08393】Adaptive Low-Light Enhancement for Road Anomaly Detection: A Multi-Architecture Benchmark and Edge Deployment Study
链接：https://arxiv.org/abs/2611.08393
作者：Obed Honour Eje,Oluwatosin Kolade,Glory Bagai,Taliha Abiodun Folorunso
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Harmattan dust haze, Road anomaly detection, conditions including darkness, degraded visual conditions, visual conditions including
备注： 5 pages
点击查看摘要
Abstract:Road anomaly detection systems on autonomous vehicles must function reliably under degraded visual conditions including darkness, rain, and Harmattan dust haze. This paper benchmarks four object detection architectures, YOLOv8n, YOLOv12n, RT-DETR, and Faster R-CNN, under physically grounded lighting and weather degradation, and shows that uniform application of the SCI low-light enhancement network is actively harmful at dusk-level lighting (-16.1% to -30.7% mAP@50). We propose a lightweight, training-free luminance-adaptive router that selects between no enhancement, moderate SCI, and denoising plus strong SCI based on per-frame Rec. 601 luminance, recovering most of the dusk penalty while preserving low-light gains, and we validate the full pipeline on NVIDIA Jetson Nano edge hardware.
10. 【2611.08372】MOMASPLAT: Dynamic Novel-View Demonstration Augmentation for Mobile Manipulation
链接：https://arxiv.org/abs/2611.08372
作者：Sateesh Kumar,Arnav Balaji,Arpit Bahety,Skand Peri,Georgios Pavlakos,Roberto Martín-Martín
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Visuomotor policies trained, Visuomotor policies, policies trained, trained through imitation, imitation learning
备注： Project page: [this https URL](https://robin-lab.cs.utexas.edu/momasplat)
点击查看摘要
Abstract:Visuomotor policies trained through imitation learning are highly sensitive to changes in camera viewpoint. This is particularly problematic for mobile manipulation (MoMa), where robots rarely execute manipulation from the exact same base pose used during demonstration collection due to navigation uncertainty, localization drift, and environmental constraints. Recent approaches use novel-view synthesis (NVS) to augment demonstrations with unseen viewpoints, but they assume static scenes and therefore fail to re-render the manipulated object during the post-contact interaction phase, leaving the most critical parts of the demonstration unaugmented. We present MOMASPLAT, a novel-view demonstration augmentation framework for mobile manipulation that synthesizes full manipulation trajectories from unseen robot base poses, including dynamic object interactions. Our key insight is that standard MoMa data collection naturally provides the multiview observations needed to reconstruct both the static scene and the manipulated object in 3D. MOMASPLAT combines 3D Gaussian Splatting, feed-forward 3D foundation models, and kinematics-based action retargeting to separately reconstruct the scene and manipulated object, render them from novel viewpoints, and generate geometrically consistent synthetic demonstrations paired with transformed actions. We evaluate MOMASPLAT on five real-world mobile manipulation tasks involving both rigid and articulated objects across three scenes, and validate the fidelity of its synthesized demonstrations against ground truth in simulation. MOMASPLAT substantially improves robustness to unseen base poses, more than doubling the average success rate of the strongest baseline and maintaining non-trivial success at large base displacements where all baselines fail, while reducing the need for largescale real-world data collection.
11. 【2611.08368】VisionSIM: Beyond Idealized Sensors - A Multi-Modal Simulator for Robot Perception
链接：https://arxiv.org/abs/2611.08368
作者：Sacha Jungerman,Kaustubh Sadekar,Avery Gump,Sriram Narayanan,Shantanu Gupta,Bhuyashi Deka,Srinivasa Narasimhan,Atul Ingle,Mohit Gupta
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Robotic perception increasingly, perception increasingly relies, Robotic perception, heterogeneous sensor suites, sensor suites combining
备注：
点击查看摘要
Abstract:Robotic perception increasingly relies on heterogeneous sensor suites combining cameras with emerging modalities (event, SPAD, iToF/dToF, and thermal). Yet existing simulators idealize these sensors, hiding critical modality-specific failure modes that limit real-world deployment. We present VisionSIM, a unified, physically grounded simulation platform that elevates sensor realism to a first-class concern by modeling the raw physical measurement process for diverse conventional and emerging modalities. We expose fine-grained control over physical sensor parameters, reproducing failure modes overlooked by general-purpose simulators: pileup and glare for LiDAR; phase wrapping, saturation, and motion artifacts for iToF; refractory drops for event cameras; and history-dependent emission for thermal cameras. This enables principled cross-modality comparison on identical scenes and trajectories. We release the platform and a large indoor dataset with synchronized raw measurements and rich ground-truth annotations.
12. 【2611.08360】OraRefer: Segmentation-Guided Multi-Photograph Fusion for Oral Cancer Screening with Guaranteed Patient-Level Sensitivity
链接：https://arxiv.org/abs/2611.08360
作者：Rupam Mukherjee,Mehakdeep Singh,Shirin Dasgupta,Subhamoy Mandal
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：oral potentially malignant, potentially malignant disorders, oral mucosa, makes smartphone photographs, oral potentially
备注：
点击查看摘要
Abstract:Oral cancer and the oral potentially malignant disorders (OPMD) that can precede it are visible on the oral mucosa, which makes smartphone photographs a promising tool for screening. Deep learning models for this task classify individual photographs. However, screening refers patients, not photographs: a patient is usually photographed several times, and the referral decision must miss no more than a set share of patients with disease. We propose OraRefer, a patient-level screening model that reads each photograph with a segmentation-guided foundation model that conditions its class decision on the predicted lesion, combines all photographs of a patient with risk factors, and refers through a threshold with a finite-sample sensitivity guarantee. The model localizes the mouth itself, so inference needs no annotation. On 3000 photographs of 714 patients, patient-level fusion reaches an AUROC of 0.919 and outperforms attention-based multiple-instance learning. At a 90% sensitivity target, OraRefer detects 95% of patients with OPMD or cancer and misses 3 of 61 patients with cancer, at a specificity of 0.610. Because the threshold is calibrated without retraining, each clinic can set its own guaranteed operating point on a local calibration sample.
13. 【2611.08352】USB Gym: A Gymnasium Testbed for Closed-Loop Ultrasound View Matching
链接：https://arxiv.org/abs/2611.08352
作者：Thanapong Intharah,Zhichao Gao,Yiliang Liu,Hao Dong
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：Background and Objective, main goal, image matches, methods, Published methods
备注： 75 pages; supplementary material (62 pages) as an ancillary file. Submitted to Computer Methods and Programs in Biomedicine. Code: [this https URL](https://github.com/tohnperfect/USBGym)
点击查看摘要
Abstract:Background and Objective: Our main goal is ultrasound guidance: moving a probe until its image matches a target view. Published methods for each part of a guide are evaluated in separate simulators. We asked whether these methods, combined into one guide, are good enough. Methods: We built USB Gym, a testbed whose standard engine simulates ultrasound from public patient CT, with a network drawing organ textures from CT labels. Its guide has three replaceable parts (slots), an organ segmenter, a controller and a reward, which received 20 published methods, each run on the same 60 episodes of six held-out patients. In each slot, a published method replaced ours only if detectably better on these patients. The better of this combination and our original guide on 20 new CTs is the benchmark baseline. A pose oracle, reading the exact probe pose available only in simulation, set the reference. The results below are exploratory. Results: On these CTs, the probe started on average 16.0 mm from the target view; the pose oracle brought it to 1.5 mm. Of the results known when the combination was fixed, only an image-similarity reward (SSIM) was slightly but detectably better, so the combination was our guide with that reward. This combination was the benchmark baseline, ending at 13.7 mm (16% of the oracle's progress). Conclusions: Combining untuned published methods with ours did not guide the probe near the target view; the task remains under-explored. The testbed accepts new methods; no guide was tested on hardware.
Comments:
75 pages; supplementary material (62 pages) as an ancillary file. Submitted to Computer Methods and Programs in Biomedicine. Code: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
Cite as:
arXiv:2611.08352 [cs.CV]
(or
arXiv:2611.08352v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.08352
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Thanapong Intharah Ph.D. [view email] [v1]
Thu, 5 Nov 2026 17:34:53 UTC (2,652 KB)
14. 【2611.08342】4D Point Splatting for mmWave Radar Micro-Doppler Differentiable Rendering
链接：https://arxiv.org/abs/2611.08342
作者：Adnan Armouti,Guanyue Qian,Rajalakshmi Nandakumar
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG); Signal Processing (eess.SP)
关键词：Millimeter-wave radar resolves, Millimeter-wave radar, enabling gait, vital-sign sensing, resolves the micrometer
备注： Under Review
点击查看摘要
Abstract:Millimeter-wave radar resolves the micrometer displacements of a moving body as micro-Doppler, enabling gait, gesture, activity, pose and vital-sign sensing. Each task relies on a downstream model trained on real data, yet radar datasets lag orders of magnitude behind vision and language. Brute-force collection will not close that gap, and existing synthesis methods (forward-only simulators, learned generators and static-scene inverse renderers) cannot fit a real capture of a moving body, leaving a sim2real gap. We present 4D Point Splatting (4DPS), a physics-based differentiable renderer that fits an explicit moving scene to a real capture. Using the synchronized camera to initialize the room and body, we represent the scene as oriented points carrying material, normal and velocity, and splat each point into range and Doppler bins. Our output is the raw complex return a real radar records, so we apply the same signal processing on the rendered data to obtain any representation for training any SOTA downstream model. We fit 235 sequences on HuPR and 100 on RT-Pose, two datasets with different radars. Our reconstructions set the state of the art, with median correlations of 0.940 and 0.830 on range-azimuth, 0.829 and 0.695 on range-Doppler, and 0.988 and 0.966 on micro-Doppler. Our renders also set the state of the art in downstream sim2real gap. On RT-Pose, a pose model trained on them reaches 21.9 cm MPJPE on real data, against 16.7 cm for real training and 127.6 cm for the RF-Genesis baseline, where both the rendered- and real-trained models learn nearly the same features. Our custom CUDA kernels fit a sequence in 5.7 minutes on HuPR and 12.9 on RT-Pose on one H100, making dataset-scale inverse rendering of mmWave radar possible for the first time. This work can enable synthetic data generation for any human-centered downstream task and model, and scene editing for data augmentation.
15. 【2611.08330】InstantHand: Feed-Forward 3D Gaussian Splatting for Animatable Hand Avatar Reconstruction from a Single Image
链接：https://arxiv.org/abs/2611.08330
作者：Chanho Kim,Muhammad Salman Ali,Kyeonghwan Gwak,Muhammad Shaheryar,Incheol Park,Jeongwan On,Seungryul Baek
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reconstruction typically relies, Hand avatar reconstruction, avatar reconstruction typically, limiting its scalability, Gaussian hand avatar
备注： NeurIPS 2026. Project page: [this https URL](https://coolho1129.github.io/InstantHand-page/)
点击查看摘要
Abstract:Hand avatar reconstruction typically relies on multi-view capture or per-subject optimization, limiting its scalability. We introduce InstantHand, a feed-forward framework that constructs an animatable 3D Gaussian hand avatar from a single image using off-the-shelf MANO, camera, and mask estimates, without test-time optimization. Image-averaged losses provide insufficient supervision for alpha leakage, which thickens thin finger contours. To address this issue, we propose a Soft Alpha Band regularizer that concentrates supervision on silhouette boundaries. Furthermore, colors regressed from image features can drift toward a learned prior even in observed regions. Our Reliability-gated Appearance Transfer preserves observed appearance by transferring source colors according to each Gaussian's rendering contribution, while completing unobserved regions using the learned prior conditioned on global source identity. InstantHand constructs an avatar in 2.84 seconds and renders at 161 FPS, matching per-subject-optimized baselines on InterHand2.6M and remaining competitive in zero-shot evaluation on HanCo.
16. 【2611.08294】ManimCode: Learning Visual Self-Correction for Educational Animation
链接：https://arxiv.org/abs/2611.08294
作者：Zhengyang Liang,Lizi Liao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Manim supports precise, successfully rendered educational, missing explanations, supports precise, incorrect content
备注：
点击查看摘要
Abstract:Manim supports precise, programmatic video generation, but a successfully rendered educational animation can still have visual defects, missing explanations, or incorrect content. Rendering does not directly identify the code changes needed to correct these visual failures, so feedback-driven revision is needed. Existing agentic frameworks use iterative rendering and revision but typically rely on large models, often proprietary. Existing Manim datasets primarily contain final programs and often lack quality verification and the trajectories of feedback and revisions needed to learn this refinement process. We introduce ManimData and ManimCode, a data and training framework for feedback-driven educational animation generation. We construct ManimData through a render-guided pipeline that iteratively generates, executes, reviews, and revises Manim programs with retrieved API documentation. Its 24,034 render-verified, quality-filtered records preserve intermediate programs, execution errors, visual critiques, and corrective revisions. We use role-conditioned supervised fine-tuning on these trajectories to train ManimCode, a single 4B model, to write, review, and revise animation programs. To improve correction of errors that differ from those in the collected trajectories, we then train the Reviser with reinforcement learning on self-generated states, using rendering outcomes and reference-free quality feedback. ManimCode achieves 96.6% and 97.0% render success on ManimData-test and ManimBench, compared with 52.6% and 82.0% for the untrained 4B model under the same inference setup, while also improving video quality scores from 2.48 to 2.94 and from 3.00 to 3.44. Integrating ManimCode into two long-form educational video generation systems increases completed videos from 19/117 to 107/117 and from 53/239 to 239/239, alongside improvements in educational effectiveness and visual quality.
17. 【2611.08288】Hierarchical Incremental Beta Splatting for Online Reconstruction
链接：https://arxiv.org/abs/2611.08288
作者：Linus Franke
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Gaussian Splatting reconstructs, fix poor initialization, keyframe spawns primitives, scene during capture, dozen iterations
备注： accepted to WACV 2027, project page: [this https URL](https://linus-franke.com/hibs/)
点击查看摘要
Abstract:Online 3D Gaussian Splatting reconstructs a scene during capture: each keyframe spawns primitives once and refines them for only a few dozen iterations, leaving little chance to fix poor initialization or missing detail. Gaussians are also inherently soft, needing many overlaps for solid surfaces. We present Hierarchical Incremental Beta Splatting (HIBS), which brings beta kernels to incremental reconstruction. Their shape parameter interpolates between a soft, Gaussian-like profile and a flat-topped, near-opaque surfel, acting as a confidence dial for geometry. Our confidence-aware spawning uses geometric observability and multi-view depth agreement to initialize both opacity and shape, producing solid primitives where geometry is verifiable and soft, correctable primitives where it is not. As online densification, error-driven relocation recycles stale primitives into photometric-error hotspots. Bounded beta kernel support enables exact tile culling and faster rasterization, and a closed-form, shape-preserving merging formulation provides a level-of-detail (LOD) hierarchy for fast optimization and real-time rendering. On Mip-NeRF 360 in the on-the-fly protocol, HIBS improves PSNR by up to 0.8 dB while reducing optimization time by up to 40%. Project page: this https URL
18. 【2611.08286】Interactive Visual Gym: Evaluating Visual Interaction Models with Simulated Users in Interactive Worlds
链接：https://arxiv.org/abs/2611.08286
作者：Chenhao Zheng,Zixian Ma,Kai Li,Kanchana Ranasinghe,Jieyu Zhang,Artemis Panagopoulou,Weikai Huang,Jianxu Shangguan,Yuanyuan Tan,Silvio Savarese,Juan Carlos Niebles,Ranjay Krishna,Ran Xu,Honglu Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual interaction models, change subsequent user, ongoing physical tasks, physical tasks require, Interactive Visual Gym
备注： 39 pages, including references and appendices
点击查看摘要
Abstract:Visual interaction models that support users during ongoing physical tasks require evaluation in closed loop, where assistant responses can change subsequent user behavior and task outcomes. Existing benchmarks largely rely on offline replay and therefore cannot capture these effects. We introduce Interactive Visual Gym, a framework for closed-loop evaluation and training of visual interaction models through joint simulation of executable task environments and human users. We contribute three simulators that recreate everyday tasks and human-aligned action spaces across cooking, household manipulation, and mobile-interface domains, together with a persona-conditioned user simulation harness that collaborates with the assistant while incorporating controlled execution errors and other out-of-plan behaviors. We instantiate the framework as IVG-Bench, a benchmark with 315 interaction scenarios. Evaluating state-of-the-art VLMs as visual interaction models reveals substantial limitations: the best-performing model, Gemini 4 Argon, completes only 53.4% of tasks within the time limit, exhibits significant weaknesses in factual grounding and actionable guidance, and is often too slow to prevent errors when response latency is considered. We verify our evaluation protocol with a human study which finds 78.5% agreement between our interaction-quality metric and participant preferences. We further show that the environments provide useful learning signals: in a proof-of-concept GRPO experiment, closed-loop training improves both task success and interaction quality for Qwen3.5-4B model in our cooking environment.
19. 【2611.08275】Aligning Policy Encoders with a Shape Teacher
链接：https://arxiv.org/abs/2611.08275
作者：Madelon Bernardy,Mohammad Mahdi Derakhshani,David M Knigge,Riccardo Valperga,Artem Moskalev
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：improve robotic manipulation, improve robotic, robotic manipulation, manipulation by providing, providing geometric information
备注：
点击查看摘要
Abstract:3D-aware representations can improve robotic manipulation by providing geometric information that is robust to changes in viewpoint, object position, and occlusion. However, using 3D inputs at deployment requires additional sensing and processing, making image-based policies more practical. We ask whether an image-based policy can acquire 3D shape information during training while retaining a purely image-based interface at deployment. We propose shape-teacher alignment, a training-time mechanism that uses a pretrained 3D shape representation as an alignment target for an image-based policy encoder. Specifically, we use Point-MAE features from individual objects as targets for corresponding image patches, transferring geometric structure to the policy without changing its deployment inputs or architecture. On LIBERO, shape-teacher alignment produces image representations that are more structured around object shape and corresponding parts, while substantially accelerating policy convergence and improving success rates. For pretrained policies, convergence is accelerated by 4.7x and 5.6x on the Object and Spatial suites, respectively, without requiring the shape teacher or depth input at deployment.
20. 【2611.08271】DART: Domain-Agnostic Residual Transfer for Generalist Anomaly Detection
链接：https://arxiv.org/abs/2611.08271
作者：Muhammad Aqeel,Maham Nazir,Marco Cristani,Francesco Setti
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Generalist Anomaly Detection, Generalist Anomaly, aims to detect, detect anomalies, anomalies in unseen
备注： Accepted to NeurIPS 2026
点击查看摘要
Abstract:Generalist Anomaly Detection (GAD) aims to detect anomalies in unseen domains using only a few reference samples. Recent normal-abnormal guided methods improve this setting by exploiting abnormal references, but their residuals often mix transferable anomaly cues with domain-specific appearance factors such as texture, geometry, and acquisition conditions. This residual domain entanglement limits cross-domain transfer and may produce spurious activations on novel domains. We propose DART, a plug-in framework for normal-abnormal guided GAD that learns to separate residuals into anomaly-relevant and domain-specific components. DART combines a Residual Disentanglement Module, which preserves anomaly-discriminative information while suppressing domain information, with Cross-Domain Meta-Training, which forms episodes across source domains to make the separation effective. The method is architecture-agnostic and can be inserted between residual computation and the detection head of existing GAD pipelines. Experiments on MVTec AD, VisA, and BraTS show consistent improvements over multiple base methods, with the largest gains under stronger domain shifts. this https URL
21. 【2611.08264】SplatAnything: Gaussian Spacing Normalization for Feed-forward 3DGS across Arbitrary Scenes
链接：https://arxiv.org/abs/2611.08264
作者：Hao Yu,Zhenwei Wang,Yongzhen Hu,Yuning Gong,Junta Wu,Xiaowei Zhou,Hujun Bao,Tengfei Wang,Chunchao Guo,Sida Peng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：neighboring Gaussian centers, global radial statistic, Gaussian Spacing Normalization, existing feed-forward, reconstructed geometry
备注：
点击查看摘要
Abstract:We identify a key limitation of existing feed-forward 3DGS methods: Gaussian attributes are typically predicted in a radial-distance-normalized space that canonicalizes a global radial statistic of the reconstructed geometry, while the spacing between neighboring Gaussian centers can still vary substantially across scene scales and camera configurations. This mismatch induces systematic shifts in Gaussian-scale targets, leading to ambiguous supervision. To address this, we propose SplatAnything with Gaussian Spacing Normalization (GSNorm), which canonicalizes a robust scene-level statistic of Gaussian spacing to provide a more consistent spatial reference for Gaussian prediction. To rigorously assess our method, we further establish a systematic benchmark spanning diverse datasets, input sparsity levels, and challenging extrapolated viewpoints. Extensive experiments demonstrate that SplatAnything achieves state-of-the-art performance, with particularly strong gains under substantial variations in scene scale and viewpoint.
22. 【2611.08262】he Geometry of Simulated Perspectives: Dissociating Representation and Behaviour in a Multimodal Language Model
链接：https://arxiv.org/abs/2611.08262
作者：Mathis Immertreu,Fitim Abdullahu,Thomas Kinfe,Claus Metzner,Helmut Grabner,Patrick Krauss,Achim Schilling
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal language models, Multimodal language, simulate different observers, language models, models can simulate
备注： 30 pages, 10 figures, 2 tables. Code: [this https URL](https://github.com/MathisImm/persona-vlm-representations;) data: [this https URL](https://doi.org/10.5281/zenodo.23664820)
点击查看摘要
Abstract:Multimodal language models can simulate different observers, yet it remains unclear how assigned perspectives reshape their internal representations and whether these changes govern their judgements. Here, we investigate the representational geometry of persona-conditioned visual interestingness in Qwen3-VL-8B-Instruct. Across 100 images and 53 prompting conditions, we systematically vary persona content and the linguistic framing used to introduce it, while recording behavioural ratings and layer-wise hidden states. We observe a systematic reorganisation of representational geometry across processing depth: early layers primarily encode image identity, whereas persona-specific structures emerge in later layers. Strikingly, prompt framing reshapes internal representations more strongly than persona identity, whereas persona content has a greater impact on behavioural judgements. This dissociation is further illustrated by minimal identity statements that alter representations even without changing responses. These findings demonstrate that representational distance does not necessarily reflect behavioural relevance. More broadly, they reveal how simulated perspectives emerge as distinct structures within the representational space of artificial cognitive systems, highlighting a fundamental distinction between the geometry of internal representations and their functional consequences.
23. 【2611.08240】FewStepRL: Fine-tuning Few-step Diffusion Models with Reinforcement Learning
链接：https://arxiv.org/abs/2611.08240
作者：Haitao Lin,Minsi Ren,Yang Li,Xingtong Ge,Zheyuan Hu,Peiyan Hu,Tailin Wu
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：rollouts typically dominate, Reinforcement learning, standard post-training method, many-step sampler, standard post-training
备注： 86pages, 12 figures, technical report
点击查看摘要
Abstract:Reinforcement learning (RL) has become a standard post-training method for diffusion models, but most RL objectives roll out the current policy at every iteration, and with a many-step sampler these rollouts typically dominate the cost of training. Few-step models cut this cost, yet they model an average velocity over an interval, whereas existing RL objectives are built for an instantaneous velocity with a many-step sampler. We adapt RL objectives to few-step models systematically in three phases, namely a transformation, a decomposition and an adaptation. The transformation to $x$-space expresses each objective we consider through a common policy prediction, at the clean end by default and at an explicitly marked level for transition or flow-map objectives, so that objectives stated over densities, velocities or rewards become comparable. The decomposition writes the gradient of each of these objectives as the sum of a self-regression toward a reference and a reward augmentation, so that a method reduces, at the gradient level, to a choice of anchors and weights. The adaptation computes each anchor from a few-step model at the end of its transport or along its tangent, with the instantaneous velocity recovered from the network itself or from an auxiliary network. This yields few-step versions of FlowGRPO, AWM, DiffusionNFT, DiffusionOPSD and ReFL in one modular codebase. In our experiments, reward-gradient-based methods are the most effective when the reward is differentiable and its gradient is affordable; otherwise DiffusionNFT-style methods generally reach high rewards in relatively few iterations despite a sometimes higher per-iteration cost. Extra inference steps show no systematic aggregate benefit in our experiments, although selected outputs visibly improve with two to four times as many sampling steps as in training.
24. 【2611.08236】Beyond Quadratic Attention: Separable Gaussian Operators for ODE Vision Transformers
链接：https://arxiv.org/abs/2611.08236
作者：Carlos Boned Riera,David Romero Sanchez,Oriol Ramos Terrades
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Transformers, token count, carries a quadratic, Self-attention carries, axis-factorized Gaussian kernels
备注：
点击查看摘要
Abstract:Self-attention carries a quadratic cost in token count, which limits how far Vision Transformers can scale with input resolution. We introduce SSoG, a separable sum-of-Gaussians spatial operator that replaces dense self-attention with a learned mixture of axis-factorized Gaussian kernels, reducing the per-layer cost from $\mathcal{O}(N^2)$ to subquadratic in $N$. Unlike dot-product self-attention, whose Lipschitz constant is unbounded outside a compact input domain, SSoG with fixed kernels is globally Lipschitz continuous, which, via the Picard--Lindelöf theorem, guarantees that the continuous-depth variant has a unique solution on the whole integration interval, a global guarantee that dense-attention counterparts lack in general. On CIFAR-100 at $224\times224$, in a matched discrete-Transformer setting and in the continuous setting, SSoG improves Top-1 accuracy by 2.2--4.1 points across three model widths while using 8.8--16.6\% fewer parameters, with depth and training recipe held fixed. In a looped-Transformer setting, SSoG improves Top-1 accuracy by 5.4--8.1 points. We further probe inference-time scaling by evaluating on inputs up to $1024\times1024$ at matched batch size: in the continuous-depth (Neural ODE) architecture, SSoG reaches up to 154\% higher throughput and over 60\% lower peak memory than dense attention, with the gap widening as resolution grows, consistent with the difference in asymptotic cost. In the discrete and looped settings, SSoG also achieves over 30\% higher throughput than dense attention at this resolution. Together, these results establish SSoG as a practical, parameter-efficient, and theoretically grounded alternative to dense attention across discrete, weight-shared, and continuous-depth Transformer variants.
25. 【2611.08216】ProQuant: Progressive Quantization-aware Training for Edge MLLMs
链接：https://arxiv.org/abs/2611.08216
作者：Yufei Xue,Yushi Huang,Jiawei Shao,Pingcheng Dong,Yonghao Tan,Shiyao Li,Kwang-Ting Cheng,Jun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：downstream applications, impressive perception, capabilities will enable, enable a range, range of downstream
备注：
点击查看摘要
Abstract:Multi-modal large language models (MLLMs) with impressive perception and understanding capabilities will enable a range of downstream applications. However, their substantial computational and memory requirements hinder the real-world implementation, particularly for resource-constrained edge devices. Quantization has emerged as an effective solution for deploying large models. While post-training quantization (PTQ) successfully retains the performance at moderate bit-width (e.g., W8A8), it suffers from severe performance degradation under low-bit quantization (e.g., W4A8), especially for small-scale models that are more suitable for edge deployment. In this paper, we propose ProQuant, a novel weight-activation quantization-aware training (QAT) framework tailored for low-bit MLLMs. First, to align the limited finetuning dataset distribution with the pretrained dataset distribution, we propose a self-relabeling (SRL) scheme to resample the responses of the open-source multimodal dataset. Second, we are the first to take a decoupled view of multi-modal (MM) understanding and language modeling abilities. We propose a progressive block activation (PBA) mechanism to prioritize the MM understanding recovery. We also introduce a vision-sensitive factor $\vec{\tau}$ that effectively identifies the MM-critical layers. Extensive experiments across various benchmarks, covering models with 2B-8B parameters, show that ProQuant significantly outperforms existing methods. For example, our W4A8 Qwen3-VL-2B-Instruct improves average accuracy by impressively 6.6% and achieves performance comparable to full precision counterparts with only approximately 1% performance drop. Code is available at this https URL.
26. 【2611.08185】Multimodal Hierarchical Mixture-of-Experts for 3D Medical Vision-Language Modeling
链接：https://arxiv.org/abs/2611.08185
作者：Gizem Mert,Szymon Płotka,Pedro R. A. S. Bassi,Wenxuan Li,Zongwei Zhou,Jarosław B. Ćwikła,Arkadiusz Sitek,Ewa Szczurek
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diagnostic cues concentrated, specific anatomical regions, levels of organization, reports are inherently, diagnostic cues
备注： Accepted at WACV 2027. Copyright 2027 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses
点击查看摘要
Abstract:Medical 3D scans and reports are inherently hierarchical, with diagnostic cues concentrated in specific anatomical regions across multiple levels of organization. Yet, most medical vision-language models ignore this structure and fail to focus on clinically relevant anatomy. We introduce MedHiVE, which combines hierarchical vision-language Soft Mixture-of-Experts (SMoE) with contrastive learning to jointly model fine-grained anatomy and global scan context. To our knowledge, MedHiVE is the first framework to route both vision and text tokens through a two-level SMoE hierarchy organized by anatomical scale, coupling this with report-derived anatomy-level contrastive alignment for 3D medical imaging. This replaces the direct region-text alignment of statically pooled features and vision-only hierarchical routing of prior work with dynamic, slot-based cross-modal information flow across anatomical scales. MedHiVE operates via a two-level, learnable token-routing mechanism, where local image and text features are first routed through a local SMoE and then fused by a global SMoE into unified multimodal representations. Contrastive learning aligns both anatomy-level and global vision-language representations in a unified space. Pre-trained on 25,000+ CT scans with anatomical supervision, MedHiVE consistently surpasses 11 state-of-the-art methods across 6 datasets on 3 tasks: segmentation, classification, and detection, demonstrating the importance of hierarchical modeling. The code for MedHiVE is at this http URL.
27. 【2611.08157】Improving Context-Shift Robustness of Convolutional Networks via Context-Regularized Cross-Entropy
链接：https://arxiv.org/abs/2611.08157
作者：Jinen Setpal,Chaoyue Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Image classification models, Image classification, test time, encounter objects, objects in diverse
备注： accepted to NeurIPS 2026
点击查看摘要
Abstract:Image classification models often encounter objects in diverse and unpredictable contexts at test time, which may differ substantially from those seen during training. This phenomenon, termed context shift, exposes a key fragility in neural networks: when models rely on non-causal contextual cues for prediction, shifts in context can lead to significant performance degradation. In this paper, we propose a novel training framework to improve the robustness of convolutional neural networks under context shift. Our approach leverages spatial feature attribution to guide models toward making predictions that rely less on contextual regions and more on object-relevant features. As a first step, recognizing a theoretical limitation of existing feature attribution methods we introduce a new variant, ContrastiveCAMs, which produces more faithful attribution maps of model predictions. Building on ContrastiveCAMs, we further propose Context-Regularized Cross-Entropy (CR-CE), a modification of the standard cross-entropy loss that regularizes the model's attention by suppressing the influence of contextual regions, thereby improving robustness to context shift. We evaluate the effectiveness of our approach on several medium-to-large scale datasets (Waterbirds, Spawrious, ImageNet/ImageNet-BG, Hard-ImageNet), and report consistent improvements in context-shift robustness.
28. 【2611.08156】La-JEPA: Compact Robot Policies with Latent World Modeling
链接：https://arxiv.org/abs/2611.08156
作者：Mateo Clémente,George Z. Xue,Amin Abyaneh,Liheng Ma,Rui Heng Yang,Tongtong Cao,Zhanguang Zhang,Yingxue Zhang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：World-action models adapt, cost to large, models adapt pretrained, pretrained vision-language backbones, large transformers designed
备注： 30 pages, 6 figures. Code: [this https URL](https://github.com/mt-clemente/lajepa)
点击查看摘要
Abstract:World-action models adapt pretrained video generators, and vision-language-action models build on pretrained vision-language backbones; both tie policy architecture and inference cost to large transformers designed for generation rather than control. It remains unclear how much these generation-oriented choices affect control. In this work, we introduce Latent Action JEPA (La-JEPA), a compact world-action model whose policy transformer is trained from scratch in the feature space of a pretrained V-JEPA 2.1 encoder. Following Fast-WAM, La-JEPA learns to predict future features jointly with actions during training and generates only actions at inference. Among policies without embodied pretraining, La-JEPA achieves state-of-the-art performance in clean and randomized RoboTwin 2.0 scenes and on LIBERO-Plus with correct instructions, while using far fewer parameters than the strongest competing policies. It runs substantially faster than Fast-WAM at comparable performance and outperforms the closest JEPA-based methods, LeapBot-WA and JEPA-WAM, on LIBERO-Plus and RoboTwin 2.0 without their pretrained policy backbones. On four real-robot tasks, its average success is comparable to pi0.5 and above non-embodied-pretrained baselines. Through a design study of the choices behind La-JEPA, we show that JEPA features outperform video VAE latents, most clearly out of distribution, and that training-time future prediction choices significantly impact the policy even when future prediction is skipped at inference. We correct the LIBERO-Plus instructions, as the officially released evaluator corrupts them for most variants, and re-evaluate several strong open baselines. Without a generative pretrained policy backbone, La-JEPA is better and faster than far larger policies, suggesting that robot foundation models may benefit from architectures designed for control rather than inherited from generation.
29. 【2611.08154】Interpretable Multimodal MRI-Clinical Fusion for Functional Outcome Prediction After Acute Ischemic Stroke
链接：https://arxiv.org/abs/2611.08154
作者：Sina Raeisadigh,Henning Müller,Abderrahmane Hedjoudje
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：acute ischemic stroke, predicting three-month functional, three-month functional outcome, AUC, ischemic stroke
备注： 5 pages, 2 figures, 1 table
点击查看摘要
Abstract:This study evaluates the added prognostic value of day-1 multimodal MRI for predicting three-month functional outcome after acute ischemic stroke (AIS). Sixty-six AIS patients with ADC, DWI, FLAIR, and clinical data were analyzed. Three-dimensional pretrained ResNet embeddings were extracted from each MRI modality, reduced using fold-isolated principal component analysis, and combined with structured clinical variables and ADC-derived lesion biomarkers. Linear support vector machines were evaluated using eight-fold stratified group cross-validation across MRI modality combinations. Clinical-only modeling achieved strong performance (AUC = $0.899 \pm 0.151$), while MRI-only models showed limited discrimination (AUC $\approx$ $0.67$-$0.73$). Among multimodal configurations, FLAIR-clinical fusion achieved the highest mean cross-validated performance (AUC = $0.948 \pm 0.061$), followed by ADC-clinical fusion (AUC = $0.941 \pm 0.094$). Full ADC-DWI-FLAIR fusion did not consistently outperform single-modality clinical fusion. Feature-importance analysis identified age, NIHSS subscores, ADC lesion burden, and learned FLAIR representations as key contributors, while qualitative FLAIR activation maps showed responses over lesion-like regions. These findings suggest that compact day-1 FLAIR and ADC representations provide complementary prognostic information beyond clinical variables and support interpretable, data-efficient outcome prediction in AIS.
30. 【2611.08148】Detecting Weather Fronts from Satellite Observations: What Does Reanalysis Add?
链接：https://arxiv.org/abs/2611.08148
作者：Ioannis Dravilas,Miruna Stoicescu,Roope Tervo,Carlos Horn,Oriol Hinojo Comellas,Sina Montazeri,Andrea Meraner,Ana Lucic
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Atmospheric and Oceanic Physics (physics.ao-ph)
关键词：contrasting thermodynamic properties, detecting weather fronts, Weather fronts, severe weather, transition regions
备注： Accepted to the 2nd Workshop on Advances in Representation Learning for Earth Observation at NeurIPS 2026
点击查看摘要
Abstract:Weather fronts are transition regions between air masses with contrasting thermodynamic properties and are associated with mid-latitude precipitation and severe weather. We investigate machine learning (ML) methods for detecting weather fronts and quantify the contribution of reanalysis data to performance. We compare two configurations of the same ML model for pixel-wise frontal classification over the North Atlantic and Europe: (1) using only geostationary infrared satellite observations, and (2) additionally using 28 ERA5 reanalysis fields. The satellite-only model achieves a neighbourhood critical success index at a 150 km tolerance (CSI@150) of $0.402$, which lies within the range of agreement between analyses from different meteorological services. The satellite$+$ERA5 model achieves $0.575$, an improvement of $0.173$. Our analysis shows that low-level winds are the least predictable from the satellite representation ($R^2 = 0.23$, compared with $0.88$ for temperature), while removing winds or moisture causes the largest decreases in detection performance.
31. 【2611.08147】MCUFlowNet: Hardware-Aware Neural Architecture Search for Optical Flow on Microcontrollers
链接：https://arxiv.org/abs/2611.08147
作者：Enmin Lin,Jona Beysens
类目：Computer Vision and Pattern Recognition (cs.CV); Hardware Architecture (cs.AR)
关键词：Dense optical flow, Dense optical, peak SRAM, optical flow networks, optical flow
备注： Submitted to IEEE ISCAS 2027 (under review). 5 pages
点击查看摘要
Abstract:Dense optical flow allows small drones to avoid obstacles. However, few dense optical flow networks are designed for microcontrollers (MCUs) with neural accelerators, whose on-chip SRAM limits the input resolution. We present PACE-NAS, a macro-to-micro neural architecture search framework that decouples memory from latency: a macro design fixes the backbone and its peak SRAM, and a micro design searches operators and depths to trade accuracy against compiler-estimated latency. We apply it to EdgeFlowNet on a Grove Vision AI V2 board (Ethos-U55), where profiling locates the peak SRAM at the full-resolution output head. Replacing transposed convolutions with bilinear upsampling and convolutions lowers the peak SRAM by 18%, and two lightweight context modules lower the endpoint error (EPE) without raising the peak. All searched subnets share this peak, so the search needs no memory constraint. We name the Pareto-optimal models MCUFlowNet; the fastest variant, MCUFlowNet-S, runs 1.76x faster than a retrained EdgeFlowNet at a 1.6% higher EPE and, in simulated forest flights at 2 m/s, reaches the goal without collision in 51.5% of trials, against 41.8%. PACE-NAS also applies to semantic segmentation, where a searched PIDNet-S variant runs 1.17x faster at similar accuracy. Code is available at this https URL.
32. 【2611.08140】Fault-Guided Cross-Layer Prediction for Unsupervised Anomaly Detection
链接：https://arxiv.org/abs/2611.08140
作者：Tao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unsupervised industrial anomaly, industrial anomaly detection, Feature reconstruction, reconstruction is widely, unsupervised industrial
备注： 20 pages including appendix; 4 figures and 21 tables. Preprint
点击查看摘要
Abstract:Feature reconstruction is widely used for unsupervised industrial anomaly detection in the single-class setting, where only normal images from one product category are available for training. We propose a single-class detector that asks what information one block can pass to another. We treat the depth of a frozen vision transformer as a sequence of discrete transitions. A directed predictor learns a block-to-block hidden-state transition pointwise over tokens. Adjacent-layer cosine similarity exposes four sharp fault lines in DINOv2 ViT-L, separating stable depth segments. The deepest blocks retain semantic context but lose local detail; a prediction from deep or shallow sources to sensitive targets therefore exposes the information that cannot be transported. The fault structure fixes the source and target roles, and the same rule transfers to ViT-B and RADIO-B. We use a bounded foreground prior calibrated solely on training images: it attenuates background evidence without also erasing defects outside the estimated foreground. Using one predictor architecture and a common training-only calibration protocol, image AUROC is 99.75 on MVTec-AD, 99.42 on VisA and 94.27 on Real-IAD. On Real-IAD the object-level AUROC is 96.26. At 256x256 pixel resolution, P-AUROC/P-AUPRO are 98.46/95.97 on MVTec-AD, 99.21/96.12 on VisA and 99.26/96.59 on Real-IAD.
33. 【2611.08138】Describe Your Facial Expressions by Linking Image Encoders and Large Language Models
链接：https://arxiv.org/abs/2611.08138
作者：Yujian Yuan,Jiabei Zeng,Shiguang Shan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：describing human facial, human facial expressions, facial expression captioning, facial action units, traditional emotion categories
备注： BMVC2023 Oral
点击查看摘要
Abstract:This paper presents a novel task of describing human facial expressions of a facial image in natural language, which captures the nuances of facial actions and emotional states beyond traditional emotion categories or facial action units (AUs). To achieve the facial expression captioning model, we propose a three-stage training framework that trains a vision-to-language model using synthesized image-text pairs and the BLIP-2 pre-training techniques. To overcome the challenge of missing training image-text pairs for facial expression captioning, we propose a strategy that involves synthesizing and combining captions using GPT-3.5 and existing annotations on either emotion categories or AUs. Experiments demonstrate the effectiveness of our method in generating captions that describe details of facial actions and emotions, as well as the inferential relationship between them, even when those emotions are not present in the training data. It is also demonstrated that the vision-to-language task enhances the performance of the intermediate visual features on both AU detection and emotion classification tasks.
34. 【2611.08136】How Far Can Untrained Neural Networks Go in Anomaly Detection? From Tables to Pixels
链接：https://arxiv.org/abs/2611.08136
作者：Hyojun Yi,Geunyoung Kim,Hogeon Seo,Seunghyoung Ryu
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：require learned features, representation-learning problem, strong performance, performance is expected, expected to require
备注： 16 pages, 13 figures
点击查看摘要
Abstract:Anomaly detection (AD) is often framed as a representation-learning problem, where strong performance is expected to require learned features or AD-specific optimization. However, this view can overlook the intrinsic separability of anomalies from normal references, even in the absence of learned representations. We therefore investigate how far untrained neural networks can go in anomaly detection. To this end, we propose PRISM, a framework combining fixed random nonlinear features with normal-reference Mahalanobis scoring for tabular detection and dense visual localization. Across 47 tabular datasets in ADBench, PRISM-T achieves the highest mean AUROC (86.4%) and the second-highest mean AUPRC (65.9%) among the compared methods. On MVTec AD and VisA, covering 27 visual categories, PRISM-V achieves mean image-level and pixel-level AUROCs of 90.4% and 96.4%, respectively. Notably, both models achieve these results without neural weight optimization or pretrained representations. A theoretical analysis further characterizes how nonlinear transformations affect the mean and covariance contributions to the Mahalanobis score gap, while empirical analyses examine the resulting score separability. These findings establish PRISM as both a competitive anomaly detector and a prior-to-learning baseline for assessing the added value of learned representations in anomaly detection.
35. 【2611.08128】FreeOcc: Decoupling Ego-Motion for Efficient 4D Occupancy Forecasting via Continuous Flow Matching
链接：https://arxiv.org/abs/2611.08128
作者：Zeping Zhang,Zhuoya Zhao,Samy Metari,Robert Laganière
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：heavy cross-attention, cross-attention or deep, deep recurrence, recurrence to disentangle, disentangle ego-motion
备注：
点击查看摘要
Abstract:Current 4D occupancy world models use heavy cross-attention or deep recurrence to disentangle ego-motion from scene dynamics. This requires significant computational capacity. However, this effort is largely redundant since the ego-vehicle's intended future motion is provided by the downstream motion planner. We present FreeOcc, a lightweight continuous-time world model that introduces explicit $SE(2)$ geometric decoupling into a conditional flow-matching framework. By mathematically factoring out self-motion, we create a purely dynamic feature space. This space supports attention-free temporal fusion and allows physics-constrained ODEs to operate strictly on residual agent kinematics. To maximize deployment efficiency, FreeOcc introduces an uncertainty-aware blending mechanism. This routes well-observed voxels to a single-pass decoder, reserving the ODE solver exclusively for ambiguous, high-uncertainty regions. Requiring only 28.3M parameters-roughly 40% of comparable models-our optimal ensemble mode (FreeOcc-E) runs at 27 FPS. On nuScenes, FreeOcc achieves state-of-the-art forecasting performance with a 0.47 m Near Field Chamfer Distance (NFCD) and 32.1% mIoU. Furthermore, the model transfers zero-shot to SemanticKITTI. It also proves highly robust, retaining 92.8% of its ideal mIoU under significant sensor packet loss and timestamp jitter.
36. 【2611.08125】ProtoGestalt: Interpretable Prototypes for Facial Phenotyping and Diagnosis of Rare Genetic Disorders
链接：https://arxiv.org/abs/2611.08125
作者：Ranga Baminiwatte,Alexander Hustinx,Fabio Hellmann,Aaron J Masino
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：difficult to diagnose, diagnose due, diversity and overlapping, Rare genetic disorders, overlapping clinical features
备注：
点击查看摘要
Abstract:Rare genetic disorders are difficult to diagnose due to their diversity and overlapping clinical features. Facial morphology can provide diagnostic clues, yet most diagnostic models offer limited interpretability and are not designed to support broad screening for undiagnosed disease. We present ProtoGestalt, an interpretable prototype-based framework for facial phenotyping, rare-disease screening, and syndrome identification. The method extends prototype learning by constraining learned visual features to select facial regions, allowing predictions to be explained through localized and additive evidence. We assess ProtoGestalt's ability to distinguish syndromic from unaffected faces on multiple control datasets and class prevalence values. We further evaluate it's diagnostic performance on syndromes observed during training. The learned prototype-based representations provide significant separation between syndromic and case-matched control images and retain useful performance as the proportion of controls increases. The framework also demonstrates the ability to differentiate among syndromes. Although reasonably accurate specialized models for facial classification of rare disorders already exist, ProtoGestalt offers an interpretable alternative that links predictions to anatomically meaningful facial regions, potentially supporting clinical decision-making and the discovery of phenotype-gene associations.
37. 【2611.08111】Reinforcing End-to-End Autonomous Driving Safety via Negative-Aware Planning in a Unified World-Action Model
链接：https://arxiv.org/abs/2611.08111
作者：Zihao Zhang,Xinyu Zhang,Bing Zeng,Xingyu Chen,Zhenning Li,Bin Yu,Ziyuan Pu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：intelligent transportation systems, model future traffic, future traffic states, World-action models, jointly model future
备注：
点击查看摘要
Abstract:World-action models (WAMs) jointly model future traffic states and driving actions for end-to-end autonomous driving in intelligent transportation systems. However, their action learning remains dominated by expert-trajectory imitation, leaving unsafe alternatives close to expert trajectories insufficiently constrained. To improve WAM robustness in safety-critical scenarios, we propose NegWAM, a safety post-training framework for unified WAMs that learns explicit safety boundaries from near-expert failure trajectories. NegWAM constructs negative trajectories that are geometrically close to the expert trajectory yet carry safety risks, uses them as repulsive anchors to steer predictions away from dangerous behavior, and encodes them as scene-conditioned rider tokens to learn scene--trajectory compatibility. During training, NegWAM jointly optimizes the flow-matching and near-expert negative objectives, while the auxiliary rider branch is discarded at inference, incurring no additional overhead. On NAVSIM v2, NegWAM achieves 40.4 EPDMS on navhard, a 4.1% relative improvement over the strongest compared scorer-free WAM baseline, and achieves 93.3 EPDMS on navtest. These results demonstrate that NegWAM achieves strong performance in safety-critical scenarios while preserving routine-driving performance. Zero-shot closed-loop evaluation on HUGSIM further demonstrates cross-benchmark generalization. The code is available at this https URL.
38. 【2611.08099】owards Practical 20 kbps Generative Video Compression via Adaptive Tokenization and Entropy Modeling
链接：https://arxiv.org/abs/2611.08099
作者：Jiancheng Zhao,Jixiang Luo,Haibin Huang,Chi Zhang,Xuelong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limited bit budgets, ultra-low bitrates remains, bitrates remains challenging, remains challenging due, perceptually important details
备注：
点击查看摘要
Abstract:Video compression at ultra-low bitrates remains challenging due to the loss of perceptually important details under limited bit budgets. Recent generative video compression methods leverage pretrained video priors to improve perceptual quality and temporal coherence, but many follow a compress-then-generate paradigm, where generative priors are primarily exploited during reconstruction. Moreover, representations learned for generation and reconstruction are not inherently optimized for entropy coding. In this work, we propose \method, which adapts pretrained video representations into compression-oriented representations while preserving their reconstruction capability. Specifically, we adapt the pretrained causal video VAE of MiniMax-H3 into a discrete video tokenizer and develop a small autoregressive entropy model that captures local and global token dependencies, with grouped prediction for parallel decoding. To further improve coding efficiency, we jointly optimize the tokenizer and entropy model using a differentiable rate surrogate, allowing rate gradients to adapt token assignments toward lower coding costs while preserving reconstruction quality. Experiments on UVG, MCL-JCV, and HEVC Class B demonstrate superior perceptual rate--distortion performance, achieving BD-LPIPS savings of 82.2\%--87.5\% and BD-DISTS savings of 78.3\%--85.0\% relative to GLC-Video.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2611.08099 [cs.CV]
(or
arXiv:2611.08099v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.08099
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
39. 【2611.08095】National-scale mapping of tree species composition in Switzerland from high-resolution aerial imagery and multimodal data
链接：https://arxiv.org/abs/2611.08095
作者：Yixin Zhou,Luca Ferrari,Verena C. Griess,Nataliia Rehush,Konrad Schindler,Mirela Beloiu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Tree-species composition shapes, shapes forest productivity, composition shapes forest, Tree-species composition, windthrow and insect
备注： 39 pages, 17 figures (11 in the main text, 6 in the supplementary material). Submitted to Remote Sensing of Environment
点击查看摘要
Abstract:Tree-species composition shapes forest productivity and how forests respond to climate disturbances such as drought, windthrow and insect outbreaks. Yet most national forest maps assign each pixel a single dominant species and cannot show the share of accompanying species. We mapped the basal-area shares of ten main tree species and a residual Other class across Switzerland at 30 m resolution. A deep-learning model combining 0.1 m aerial RGB imagery, airborne laser scanning (ALS), annual AlphaEarth satellite embeddings, and climate variables was trained on basal-area observations from 3,992 Swiss National Forest Inventory (NFI) sites. In spatial cross-validation, the model reached a macro-$R^2$ of 0.485 across the 11 classes. On an independent forest-reserve dataset, the map reached a macro-$R^2$ of 0.552 for individual 30 m pixels and 0.733 for plots, and identified the dominant class in 73.2% of pixels and 81.1% of plots. The map shows maple and ash as widespread minor components that dominant-class maps omit. It also reproduces the elevational sequence from broadleaved lowland stands through spruce to larch and Arolla pine near the treeline. By resolving the species mixture within each 30 m pixel, the map complements field inventory statistics with spatially continuous information that can support forest monitoring, the management of mixed stands, and climate-adaptation planning across Switzerland.
40. 【2611.08091】ATHAAR: A Medieval Scientific Arabic Manuscript Dataset for Handwritten Text Recognition
链接：https://arxiv.org/abs/2611.08091
作者：Ismail El Jamiy,Khadija Msalek,Guillaume Loizelet,Farah Benamara,Nabil Hathout
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：medieval Arabic scientific, handwritten text recognition, Arabic scientific manuscripts, scientific Arabic manuscripts, scientific manuscripts remain
备注：
点击查看摘要
Abstract:Despite recent progress in handwritten text recognition, medieval Arabic scientific manuscripts remain an open challenge for current vision-language models (VLMs) due to cursive ligatures, variable diacritization, and more importantly the lack of training data. This paper aims to address this gap, by proposing the first annotation guidelines dedicated to the transcription of scientific Arabic manuscripts inspired by textual criticism, a well-established approach to historical text editing. We then propose, ATHAAR, a new dataset manually annotated following this guideline. Unlike previous resources in the field, ATHAAR varies both witnesses of the same text, calligraphic styles, and content to deal with texts but also numerals. Relying on state-of-the-art VLMs, we finally design a set of experiments to study models transfer across scripts, chapters, and treatises. Our findings highlight the limitations of current systems when faced with the specificities of ancient scientific texts.
41. 【2611.08081】rraMesh-Masks: Open-Vocabulary Segmentation for Earth Observation
链接：https://arxiv.org/abs/2611.08081
作者：Benedikt Blumenstiel,Hugues Devimeux,Johannes Jakubik,Konrad Schindler
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fixed label sets, segment a variety, variety of concepts, fixed label, natural language
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Open-vocabulary segmentation (OVS) enables models to segment a variety of concepts specified in natural language, removing the need for fixed label sets and fine-tuning. While recent OVS approaches have shown strong performance on natural images, they transfer poorly to Earth observation (EO) data due to differing semantics, scales, sensing modality, and geographic context. To date, large-scale EO-specific datasets and benchmarks for OVS remain scarce. We, therefore, introduce TerraMesh-Masks, a large-scale open-vocabulary segmentation dataset for EO, comprising 16 million binary masks aligned with nine million multimodal TerraMesh samples and annotated using OpenStreetMap and Overture-derived semantics. In addition, we provide an expert-reviewed evaluation set of 523 samples covering over 200 classes to enable robust evaluation. To demonstrate the impact of TerraMesh-Masks, we build an open-vocabulary version of TerraMind. Our results demonstrate significantly improved performance over general-purpose state-of-the-art models reaching 35.18% IoU versus 16.29% for this http URL and 11.33% for SAM-3. We release the dataset publicly under a permissive license at this https URL.
42. 【2611.08080】Spatiotemporal Dynamics-Aware Industrial Anomaly Detection and Reasoning
链接：https://arxiv.org/abs/2611.08080
作者：S-Wei Chen,Siangyu Yang,Yi-Chen Jan,Chun-Yi Lee,Shao-Yuan Lo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Industrial Anomaly Detection, Industrial Anomaly, quality control, long-established problem, problem that aims
备注： Accepted at IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2027
点击查看摘要
Abstract:Industrial Anomaly Detection (IAD) is a long-established problem that aims to detect defects in industrial products during manufacturing for quality control. Most existing studies focus on static visual patterns as the basis for detection. However, in real manufacturing environments, many anomalies are dynamics-based, such as irregular movements that cannot be perceived from static cues alone. We observe that even recent Multimodal Large Language Model (MLLM)-based approaches fall short in identifying such dynamic anomalies due to limited temporal modeling capability. To address this, we introduce MUSTARD: MUltimodal SpatioTemporal Anomaly Reasoning and Detection, a framework that equips MLLMs with fine-grained spatiotemporal dynamics awareness for detecting and reasoning about dynamics-based defects. MUSTARD introduces optical-flow-guided keyframe selection and augmented modalities to capture critical motion irregularities through local motion patterns and global dynamic evolution. Its normal pattern-based reasoning pipeline requires only a few normal reference samples as the detection basis, avoiding any model updates. This enables efficient adaptation across various products and provides high decision interpretability. MUSTARD is the first MLLM-based framework for dynamics-based IAD. Experiments demonstrate its superior performance in detecting spatiotemporal anomalies and providing plausible explanations. The code will be made publicly available.
43. 【2611.08054】NutriVisRAG: Multimodal Exemplar Grounding for Nutrient Estimation with Vision-Language Models
链接：https://arxiv.org/abs/2611.08054
作者：Lubnaa Abdur Rahman,Ioannis Papathanail,Maria Panagiotou,Nefeli Dimitropoulou,Margret Harðardóttir,Elisabeth J. den Brok,Bastiaan E. de Galan,Stavroula Georgia Mougiakakou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：accurate dietary assessment, determinant of health, major determinant, accurate dietary, dietary assessment
备注：
点击查看摘要
Abstract:Diet is a major determinant of health, yet accurate dietary assessment from free-living meal images remains challenging. Existing retrieval-based Vision-Language Model (VLM) approaches to nutrient estimation typically rely on textual food representations, while, to our knowledge, direct grounding on visually similar annotated meals has not been investigated. We present NutriVisRAG, a retrieval-augmented generation framework that uses a vision encoder to retrieve similar meals with known nutritional annotations and provide them as multimodal in-context exemplars for VLM nutrient estimation at inference time, without task-specific fine-tuning. We evaluate NutriVisRAG across four datasets, four VLMs, three retrieval encoders, and two prompting strategies, including free-living meals from adults with insulin-treated diabetes, where carbohydrate estimates are compared against two dietitians' annotations. Across all 96 configurations (4 datasets x 4 VLMs x 3 retrieval encoders x 2 prompting strategies), NutriVisRAG reduced the primary estimation error in 56, with improvements more frequent under whole-meal (35/48) than per-item prompting (21/48). Across the evaluated configurations, the lowest NutriVisRAG error was below the best Vanilla error in 13 of 16 VLM--dataset pairs. For GPT-5.4-mini, under whole-meal prompting, the best-performing retrieval encoder for each dataset reduced the primary error on all four datasets relative to Vanilla, with reductions of 1.7--35.7%. Overall, our results show that grounding in multimodal exemplars comprising images and respective annotations can improve nutrient estimation at inference time without task-specific fine-tuning, although the benefits remain configuration-dependent.
44. 【2611.08005】Deformable Contact-Aware 3D Object Placement
链接：https://arxiv.org/abs/2611.08005
作者：Songhe Wang,David Miller,Charles A. Kamhoua
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Current language-guided, placement typically predicts, dictated by contact, typically predicts, reality that indoor
备注： 23 pages, 4 figures; includes technical appendices
点击查看摘要
Abstract:Current language-guided 3D object placement typically predicts a rigid 6-DoF pose, ignoring the physical reality that indoor placements are dictated by contact. Consequently, predicted poses often float, interpenetrate supports, or fail to deform soft surfaces. We propose Deformable Contact-Aware Placement (DCAP), a framework that reframes placement as a drop-to-equilibrium process. Rather than predicting a static pose, DCAP constructs a semantic release state that specifies the drop location, object scale, and deformable components, allowing a coupled rigid-deformable simulator to settle the object under gravity and friction. This explicitly separates semantic intent from physical realization. Evaluated on a benchmark of 2,063 prompt-asset-scene cases, DCAP significantly outperforms static baselines. On standard placements, it improves VLM Physics Naturalness by 21.2 points and human preference by 26.5 points over the strongest raw rigid baseline, while reducing mean penetration depth by 72.3%. Compared to simulated rollout baselines, DCAP reduces residual speed by 72.1%. Ultimately, our results prove that physically accurate 3D placement requires modeling semantic intent and physical realization as strictly separate processes.
45. 【2611.08003】When GeoFMs Meet VHR: Benchmarking Foundation Models on Very High Resolution Earth Observation Imagery
链接：https://arxiv.org/abs/2611.08003
作者：Kshitij Raj Sharma,Pierre Adorni,Minh-Tan Pham,Dirk Tiede,Sébastien Lefèvre
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：widely adopted starting, adopted starting point, Geospatial foundation models, Geospatial foundation, remote sensing tasks
备注：
点击查看摘要
Abstract:Geospatial foundation models are a widely adopted starting point for remote sensing tasks. Most are pretrained on Sentinel-1/2 and Landsat imagery at a ground sampling distance (GSD) of 10m or coarser. Many applications instead rely on very high resolution (VHR) imagery, where individual buildings, roads, and amenities are resolved. We study which pretraining regimes transfer well to this scale. We introduce VHR-Bench, a benchmark suite of ten datasets at 1.5m GSD or finer spanning five task families, eight application domains, and both satellite and aerial platforms. We evaluate twelve encoders in three pretraining tiers with frozen backbones at two training-data fractions. We find that both pretraining on large natural-image collections and VHR-specific pretraining transfer effectively to VHR tasks, with complementary strengths. SkySense leads when labels are scarce; at the full label fraction the web-pretrained DINOv3 ViT-L edges ahead, with the two close together there. Encoders pretrained only on Sentinel-scale imagery transfer least well under RGB input. Guided by these complementary results, we continue the self-supervised pretraining of DINOv3 ViT-L on 1.02 million held-out VHR tiles and evaluate the resulting encoder without changing the downstream protocol. The continued model gives a clear improvement over the released backbone when labels are scarce and a modest one at the full fraction, at no increase in inference parameters or compute. These findings support a generalize-then-specialize strategy: already strong, broad natural-image pretraining can be further improved by a short VHR continuation stage while preserving its general visual features.
46. 【2611.07994】Reviving the Discarded High-Resolution Feature for Transformer-Based Tiny Object Detection
链接：https://arxiv.org/abs/2611.07994
作者：Zehao Wang,Si Wu,Guiping Cao,Xin Li,Yaowei Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：tiny instances occupy, detection remains challenging, Tiny object detection, object detection remains, remains challenging
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Tiny object detection remains challenging because tiny instances occupy only a few pixels, and their fine-grained details are easily lost during feature downsampling. Although the highest-resolution feature preserves rich local details for tiny objects, DETR-like detectors often discard it due to its large computational cost, while directly reintroducing this feature also brings dense background noise. To address this problem, we propose ReDHF, a novel framework that Revives the Discarded High-resolution Feature for tiny object detection. ReDHF has three cooperative components. Cross-Scale Deformable Fusion (CSDF) first constructs a semantically enhanced highest-resolution feature and injects its fine-grained details into the shallow feature under a moderate cost. Ellipse-Guided Shallow Supervision (EGSS) then guides the enhanced feature to learn more reliable classification and localization priors by applying geometry-adaptive auxiliary supervision. Full-Scale Query Interaction (FSQI) further enables decoder queries to access both low-level details and high-level semantic information, allowing them to aggregate richer cues for tiny objects. Extensive experiments show that ReDHF consistently improves multiple baselines across different DETR variants and achieves state-of-the-art performance on the evaluated benchmarks. The best ReDHF variants surpass their baselines by +1.4 AP on AI-TOD-v2, +1.6 AP on VisDrone, and +1.5 AP on SODA-D, with especially notable gains on tiny and small objects.
47. 【2611.07961】Bri3D: Bridging the Object-Scene Gap in Single-Image 3D Generation via Scene-Anchor
链接：https://arxiv.org/abs/2611.07961
作者：Hongye Hou,Shuai Zhang,Hongjie Li,Zhuoxiao Li,Haiping Wang,Yuan Liu,Wufan Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single image requires, image requires recovering, Generating compositional, requires recovering detailed, single image
备注：
点击查看摘要
Abstract:Generating compositional 3D scenes from a single image requires recovering detailed object geometry and coherent spatial arrangements. Existing object-to-scene methods, including SAM3D and MIDI, extend object generation through image-context reasoning or inter-instance modeling. Coordinating objects remains challenging with limited scene-level supervision. Directly extending object-centric generators to entire scenes can degrade geometry and fail to preserve instance scale, orientation, and pose. We propose Bri3D, a framework bridging scene-level structural reasoning and object-level generative priors through instance-aware voxel scene anchors. Bri3D predicts a color-coded scene scaffold encoding coarse object geometry and spatial arrangements. Each instance is extracted as a scene anchor and refined into a pose-preserving, prior-compatible voxel support, enabling a frozen object generator to synthesize detailed textured geometry in the anchor-defined spatial reference. This coarse-to-fine design separates scene organization from object-scale detail synthesis, focusing scene-level training on spatial organization and anchor refinement while reusing pretrained object priors. Experiments demonstrate improvements in scene layout, object geometry, visual quality, and generalization. Bri3D predicts scene layouts efficiently; full scene generation is faster than SceneGen and SAM3D.
48. 【2611.07955】Rotation Is Token-Blind: A Structural Criterion for Post-Training Quantization of Feed-Forward Geometry Transformers
链接：https://arxiv.org/abs/2611.07955
作者：Huanfei He,Bohao Zhang,Jiaxin Zhang,Wei Sui,John See,Zeyd Boukhers,Cong Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：avoiding iterative multi-view, iterative multi-view optimization, predict camera poses, camera poses, avoiding iterative
备注：
点击查看摘要
Abstract:Feed-forward 3D models use Transformers to predict camera poses, depth, and structure in one pass, avoiding iterative multi-view optimization. Long sequences and deep attention incur high compute and memory costs, motivating Post-Training Quantization (PTQ) for deployment. Existing PTQ methods mainly suppress channel-wise outliers by smoothing or orthogonal rotation. Geometry Transformers introduce a different challenge: heterogeneous token types share one activation quantization grid. A few special tokens may exert high leverage over global outputs and be updated by only a subset of blocks. Token-blind transforms, which apply the same transformation to every token, reduce overall quantization error but cannot remove differentiated degradation across token types. We propose QMapAnything, a structure-aware PTQ framework. We cast floating-point-preserving rotation and smoothing as a token-blind reparameterization group, and prove that they yield common-mode gains while leaving relative token SNR unchanged. We introduce a statistic $\Gamma$ that combines a special token's quantization disadvantage and output leverage to predict whether differentiated bias correction is needed beyond rotation. Experiments on geometric benchmarks show that W4A8 closely matches full-precision performance. Under W8A8, peak memory falls by $2.2$--$3.1\times$ versus FP32, with up to $3.1\times$ speedup on real hardware. These results provide a principled and efficient approach to deploying feed-forward 3D reconstruction models in resource-constrained edges.
49. 【2611.07950】Leakage- and Label-Aware Benchmarking of Class-Imbalance Strategies for Multimodal Chest X-Ray and EHR Classification
链接：https://arxiv.org/abs/2611.07950
作者：Dang-Khoa Bui,Quang-Huy Tran,Minh-Khoi Nguyen-Bui,Duc-Tuan Ngo,Thanh-Trong Tran,Tuan-Khoi Nguyen,Hoang-Anh Ngo
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal chest X-ray, electronic health record, chest X-ray, health record, class-imbalance strategies
备注： 10 pages, 1 figure, 6 tables
点击查看摘要
Abstract:Benchmarks of class-imbalance strategies for multimodal chest X-ray (CXR) and electronic health record (EHR) prediction are often evaluated on record-level splits of cohorts in which one patient contributes several radiographs. We audit such a benchmark on 29,083 MIMIC-CXR radiographs of 10,479 patients with eight diagnosis targets. First, the record-split benchmark was misleading: a lookup table that copies the label of a development-set radiograph with the same EHR vector nearly matched the best model, and on unseen patients every model fell to the level of predicting every case positive. Second, tracing the labels back to MIMIC-IV explained why: each patient's labels are keyword matches on the diagnosis codes of a single admission, copied, with one EHR vector per patient, to all of the patient's radiographs, so about a third of the radiographs carry labels that differ from the codes of their own admission. Third, under patient-separated evaluation with admission-aligned and rule-refined labels, the initial conclusions do not hold: in the evaluated configurations no imbalance strategy raised the observed mean macro F2 over no augmentation by more than 0.01, tuned tree ensembles showed no consistent advantage over tuned logistic regression, and the released EHR variables stayed at the level of the all-positive baseline, whereas the diagnostic history available at imaging time and image embeddings exceeded it, including, with rule-refined labels, a CheXpert-trained encoder that never saw these radiographs; RAD-DINO had seen 96.6% of them during self-supervised pretraining. Adding either encoder to the diagnostic history gave no statistically significant F2 gain; exploratory AUROC gains were significant with RAD-DINO but not with DenseNet. We provide reusable diagnostics, a leakage-aware protocol and a checklist.
50. 【2611.07941】IDPrior: Decoupling Identity Generation from Facial Image Synthesis
链接：https://arxiv.org/abs/2611.07941
作者：Fadi Boutros,Meriç Demirörs,Darian Tomašević,Vitomir Štruc,Naser Damer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large-scale identity-labeled face, Large-scale identity-labeled, training modern face, ethical concerns, essential for training
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Large-scale identity-labeled face datasets are essential for training modern face recognition models, yet collecting and annotating such data is costly and raises privacy and ethical concerns. Existing synthetic face generation methods typically derive identities from predefined class labels, unconditional image generation, or predefined latent sampling strategies, without explicitly modeling the underlying distribution of facial identities. In this paper, we propose IDPrior, a two-stage framework that decouples identity generation from image synthesis. We first learn a diffusion prior in the embedding space of a pretrained face recognition model to model the distribution of facial identities and generate novel identity embeddings. These embeddings are then used to condition a pretrained identity-conditioned diffusion model (DM), enabling the synthesis of multiple images of the same identity. This modular design provides a scalable approach to identity generation while remaining compatible with existing and future identity-conditioned DMs. Experiments indicate that IDPrior generates diverse and well-separated identities while maintaining a closer correspondence to the distribution of authentic identities. Face recognition models trained on datasets generated using IDPrior-generated identities achieve competitive or improved performance compared with existing synthetic-data-based methods across multiple face verification benchmarks. Code and generated datasets are publicly available at this https URL.
51. 【2611.07939】WAM-Sim0.1: World Anchored Memory Meets Online RL for Consistent and Realistic Driving Simulation
链接：https://arxiv.org/abs/2611.07939
作者：Jiahao Cui,Jiaye Li,Wenhao Zhang,Yaoyi Li,Shan Luan,Quanhui Tang,Jianhua Han,Lin Cheng,Hang Xu,Siyu Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autoregressive driving world, lack persistent state, transient conditioning signals, driving world models, driving world model
备注：
点击查看摘要
Abstract:Autoregressive driving world models systematically suffer from structural drift, identity drift, and quality decay over long rollout horizons due to transient conditioning signals that lack persistent state. We present WAM-Sim, a driving world model anchored by a persistent hierarchical memory and optimized via online flow-matching RL. WAM-Sim structures persistent context across three temporal and semantic scales: pose-aligned structural tokens encoding persistent road topology, read-only scene tokens supplying geolocated background appearance, and write-once instance tokens preserving individual traffic participant identities across occlusions and chunk boundaries. To restore visual sharpness and physical plausibility degraded by multi-scale conditioning, we introduce an online post-training framework that optimizes self-generated rollouts via flow-matching RL guided by hierarchy-aligned visual rewards and a vision-language model physical judge. The invariant memory empirically confines policy optimization within the anchored context, helping suppress semantic collapse and reward hacking, while online RL systematically enforces physical commonsense and fine-grained visual fidelity. On the nuScenes benchmark, WAM-Sim achieves a superior generation fidelity (FID=3.47, FVD=25.72) and strong downstream perception performance (24.16 mAP, 71.23 road mIoU). On minute-scale rollouts of self-collected data, WAM-Sim substantially mitigates structural and identity drift, preserving high scene similarity and subject identity coherence across extended horizons. Project page: this https URL.
52. 【2611.07935】owards Scalable Diagnostic-Driven Whole-Slide Image Retrieval for Pathology Archives
链接：https://arxiv.org/abs/2611.07935
作者：Jingsong Liu,Youssef Wally Han Li,Weiwei Zhou,Jing Dai,Elisabeth Wetzer,Peter J. Schüffler
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：rapidly expanded collections, archives remains challenging, remains challenging, inconsistent or unavailable, growing adoption
备注：
点击查看摘要
Abstract:The growing adoption of digital pathology has rapidly expanded collections of hematoxylin-and-eosin whole-slide images, yet efficient navigation through these archives remains challenging, as metadata is often inconsistent or unavailable. Content-based image retrieval addresses this challenge by identifying similar cases directly from visual representations instead of manual annotations or metadata. Existing retrieval systems have demonstrated promising performance but largely rely on handcrafted indexing pipelines and predefined sampling strategies, constraining scalability and generalization. Here, we present CLEAR-WSI (Constant-Length Embedding for Automatic Retrieval of Whole-Slide Images) as a scalable, diagnostic-driven slide-retrieval framework, validated on both public and clinical data. Using a fixed-length slide embedding, CLEAR-WSI refines retrieved candidates with either a predicted diagnostic label or the ground-truth label, depending on the retrieval setting. Newly processed cases are subsequently added to the expanding memory bank, allowing the retrieval archive to grow over time. On a comprehensive benchmark consisting of two public and one private clinical datasets representing four retrieval tasks, CLEAR-WSI improves Precision@5 over the strongest evaluated baseline, with gains on CAMELYON16 (3.10), BRACS-1 (2.75), BRACS-2 (1.95), and X-HER2 (3.75). Additional ablation and latency studies further examine the contribution of each component and highlight its potential for scalable deployment.
53. 【2611.07929】Flux as a Codec: Zero-Shot Lossy Compression with Flux
链接：https://arxiv.org/abs/2611.07929
作者：Fuma Kimishima,Jinjia Zhou
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：zero-shot codec, reconstruction, ODE reconstruction, zero-shot, compression prior
备注：
点击查看摘要
Abstract:We propose FluxC, a zero-shot codec that uses Flux as a compression prior. Although DiffC has shown that pretrained diffusion models can serve as zero-shot codecs, we ask how the choice of coding path and reconstruction method affects rate--distortion--perception behavior. We analyze FluxC along three axes: coding cost and bit allocation, reconstruction method, and low rate distortion. At matched signal-to-noise ratio (SNR), we show that the path choice does not affect the ideal information rate, but changes how bits are allocated across time steps. For reconstruction, we compare ancestral sampling, one-step ODE reconstruction, and many-step ODE reconstruction. Our analysis shows that ODE-based reconstruction can achieve lower distortion than ancestral sampling, especially in the low rate regime. Experiments on Gaussian sources and natural images support this prediction. Moreover, FluxC performs competitively with, and in some cases outperforms, recent neural image compression methods, suggesting that Flux can serve as a principled zero-shot codec.
54. 【2611.07922】StitchEdit: Stitching Depth Priors into Image Editors via Per-Layer Gradient Probing
链接：https://arxiv.org/abs/2611.07922
作者：Qin Guo,Dan Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Text-guided image editing, Text-guided image, diffusion models struggles, manipulating objects, structure understanding
备注：
点击查看摘要
Abstract:Text-guided image editing with diffusion models struggles with spatial edits (e.g. manipulating objects, changing viewpoints, manipulating occlusions) that depend on the 3D structure understanding of a scene. Marigold and follow-up work demonstrate that a pretrained diffusion backbone already harbors strong geometric priors that can be activated for depth estimation, yet how to redirect these priors toward editing remains unresolved. Through per-layer gradient probing, we discover that the editing and depth objectives are compatible in early transformer layers but actively conflict in late layers, explaining why naive depth-conditioned editing either ignores geometry or degrades visual quality. We present StitchEdit, which first activates the backbone's geometric capability via a lightweight depth-denoising adapter, then selectively fine-tunes this adapter for editing using a probe-guided per-layer learning rate schedule that preserves depth knowledge where it helps and prunes it where it conflicts. On the proposed StitchEditBench, a benchmark of 150 geometry-dependent edits spanning spatial transformation, occlusion manipulation, and viewpoint change, StitchEdit consistently surpasses both instruction-based and depth-conditioned baselines on perceptual quality and geometric fidelity.
55. 【2611.07909】EDGAR: Efficient Diffusion-Driven Gaussian Avatar Refinement via Synthetic Failure
链接：https://arxiv.org/abs/2611.07909
作者：Kwan Yun,Minhyeok Bang,Colette Suhjung Koo,Junyong Noh
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：Recent advances, photorealistic head avatar, Gaussian Avatar, Efficient Diffusion-Driven Gaussian, Gaussian Avatar Refinement
备注： Accepted to ACM Transactions on Graphics
点击查看摘要
Abstract:Recent advances in Gaussian splatting have enabled efficient and photorealistic head avatar reconstruction, yet monocular video-based or image-based methods still suffer from under-constrained geometry and texture, leading to artifacts such as blurring, stretching, and temporal instability. We present EDGAR (Efficient Diffusion-Driven Gaussian Avatar Refinement), a conditional diffusion framework designed to enhance the quality of Gaussian avatars by correcting artifacts while preserving identity fidelity. To train EDGAR, we construct EDGAR-SET, a hybrid triplet dataset composed of real-captured and synthetic-rendered samples, which simulates realistic Gaussian avatar failure cases by pairing degraded renderings with ground-truth and reference images. EDGAR refines degraded frames through a fusion block that injects identity features extracted by the self-supervised Sapiens model into a one-step diffusion backbone, enabling effective artifact removal without sacrificing efficiency. Our EDGAR model incorporates a Mixture-of-Experts (MoE) architecture to address diverse degradation types and severity levels. The refined multi-view renderings are subsequently used as pseudo-targets to optimize a single underlying Gaussian avatar, so that the final avatar can be rendered without applying EDGAR to every output frame. Experiments on three different Gaussian avatar reconstruction methods, each evaluated under three different settings, show improvements in both perceptual and reconstruction measures over the raw outputs and an SDEdit-style refinement baseline. In addition, cross-view evaluation demonstrates improved calibrated consistency, while tests under large yaw and open-mouth expressions verify robustness under extreme settings. These results collectively indicate a useful operating regime for recoverable appearance artifacts. The code is available at this https URL
56. 【2611.07902】XM4D: 4D Reconstruction through Certifiable Geometric Optimization
链接：https://arxiv.org/abs/2611.07902
作者：Haoyu Han,Jack Benarroch Jedlicki,Jiahui Lei,Heng Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO); Optimization and Control (math.OC)
关键词：entails highly nonconvex, reconstruction remains challenging, deformation entails highly, highly nonconvex optimization, making global optimality
备注：
点击查看摘要
Abstract:Accurate 4D reconstruction remains challenging: jointly estimating camera motion, scene geometry, and non-rigid deformation entails highly nonconvex optimization, making global optimality difficult to guarantee. We present XM4D, a framework for accurate and efficient 4D reconstruction built upon certifiably globally optimal geometric optimization. By separating the estimation of camera motion from non-rigid deformation, we formulate both stages as structured quadratically constrained quadratic programs (QCQP) that admit semidefinite programming (SDP) relaxations and verifiable global optimality certificates. For camera motion estimation, we lift static point tracks into 3D using foundational depth prediction models and formulate a scaled bundle adjustment problem that jointly estimates camera poses, depth scales, and static landmarks. By analytically eliminating translations and landmarks, we reduce the problem to a QCQP over scaled rotations. For non-rigid reconstruction, we represent dynamic motion using an embedded deformation graph (EDG) and show that its tracking, rigidity, and temporal regularization objectives similarly reduce to a rotation-only QCQP. Both problems admit SDP relaxations that we solve efficiently with a GPU-accelerated Burer-Monteiro solver based on Riemannian optimization. The recovered geometry further initializes dynamic Gaussian splatting for photometric refinement. Extensive experiments across seven benchmarks demonstrate accurate camera motion estimation on both static and dynamic scenes, efficient optimization that scales to thousands of frames, and state-of-the-art novel-view rendering quality.
57. 【2611.07900】Structure from Collision via Hypothesis-Space Reasoning
链接：https://arxiv.org/abs/2611.07900
作者：Takuhiro Kaneko
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：hidden interior structure, robotic manipulation, nondestructive inspection, essential for predictive, interior structure
备注： Accepted to WACV 2027. Project page: [this https URL](https://www.kecl.ntt.co.jp/people/kaneko.takuhiro/projects/sfc-hypothesis/)
点击查看摘要
Abstract:Knowledge of the hidden interior structure of an object, including the presence and location of cavities, is essential for predictive simulation, robotic manipulation, and nondestructive inspection. However, such cavities leave no direct signature on the static visible surface, making collision-induced deformation one of the few cues used to infer their presence. Structure from Collision (SfC) addresses this problem by recovering the hidden interior structure of an object from multiview observations of a collision event. SfC is challenging for two reasons: hidden cavities are only indirectly observable through surface motion, and voids correspond to the absence of material, making direct optimization using standard density representations difficult. The density-based SfC baseline inherits both difficulties. Surface-matching gradients do not directly indicate the cavity location, while density gradients can be weak or uninformative inside or near void regions. Therefore, we reformulate SfC as hypothesis-space reasoning, representing hidden cavities as explicit structural hypotheses whose variables encode available structural assumptions rather than relying on implicit density updates. A global stage performs gradient-free optimization over this hypothesis space using forward-only material point method (MPM) simulation. A local stage then refines the selected hypothesis as a Lagrangian particle system through gradient-based optimization using differentiable MPM simulation. On the SfC benchmark, our method improves hidden-structure reconstruction and future prediction over the density-based SfC baseline. Interior-topology stress tests and robustness analyses characterize its scope and limitations. The project page is available at this https URL.
58. 【2611.07883】InnerLogic-Surg: An Open Surgical Foundation Model via Continual Pretraining
链接：https://arxiv.org/abs/2611.07883
作者：Kun Yuan,Hao Ding,Yiqing Shen,Gasper Podobnik,Benjamin Killeen,Tito Porras,Axel Krieger,Mathias Unberath
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：comparatively small datasets, surgical image analysis, specialist models trained, modern surgical image, small datasets
备注：
点击查看摘要
Abstract:Vision foundation models are the backbone of modern surgical image analysis, yet most surgical systems still rely on encoders pretrained on natural images or on specialist models trained from scratch on comparatively small datasets. Pretraining encoders on large amounts of surgery-specific data has the potential to generally enhance the performance of surgical image analysis methods simply by providing stronger backbones. Here we present InnerLogic-Surg, an open family of surgical vision encoders (21M--300M parameters) obtained by continually pretraining a transformer-based image encoder on millions of surgical images curated from 11,965 internet-sourced surgical videos spanning ~2,900 hours and more than fifteen procedure types. Our training recipe inherits DINOv3's pretraining stage to preserve representation ability after surgical adaptation, and additionally applies a learned feature-upsampling module for high-resolution dense prediction at low token cost. Across a benchmark covering workflow, instrument and anatomy recognition, segmentation, detection, and monocular depth, under the same architecture, the largest InnerLogic-Surg model achieves the best linear-probe performance in all 20 surgical tasks. We demonstrate that surgical continual pretraining yields transferable representations that generalize across procedures, anatomical regions, and task types, showing our surgical image encoders as a promising and scalable alternative to the procedure-specific representation learning approaches that have traditionally dominated surgical computer vision.
59. 【2611.07873】PVDepth: Panoramic Video Depth Estimation via Geometry-Aware Spatiotemporal Adaptation
链接：https://arxiv.org/abs/2611.07873
作者：Chuanxin Song,Peixi Peng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Virtual Reality, Reality and World, World Models, RGB-D panoramic video, estimation is pivotal
备注： ICML 2026, Project Page: [this https URL](https://chuanxinsong.github.io/pvdepth-project-page)
点击查看摘要
Abstract:Panoramic video depth estimation is pivotal for applications such as Virtual Reality and World Models. However, advancements in this field are impeded by two primary obstacles: the scarcity of large-scale training data and the unique spatiotemporal challenges of Equirectangular Projection (ERP), which hinder the direct transfer of perspective models. In this paper, we first present PanoCARLA, a large-scale synthetic RGB-D panoramic video dataset, featuring natural motion trajectories and drone-like roaming perspectives. Building on this foundation, we propose PVDepth, an end-to-end framework adapted from perspective video depth models. To tackle ERP-specific geometric distortions and consequent non-linear temporal dynamics, we introduce two core mechanisms: (1) A Progressive Sphere-aware Noise Initialization strategy that anneals the noise distribution from planar to spherical, guiding the model to adapt to non-uniform information density; and (2) A Cube-rectified Temporal Modeling module that incorporates an auxiliary cubemap temporal branch to rectify non-linear temporal dynamics in the ERP domain. Extensive experiments demonstrate that PVDepth achieves superior performance, generating geometrically accurate and temporally consistent depth sequences. Code and data will be released at https:// this http URL.
60. 【2611.07867】PlayGen2: Learning Real-Time Playable Worlds with Explicit 3D State
链接：https://arxiv.org/abs/2611.07867
作者：Jihai Zhang,Yuhan Zhou,Junyou Li,Deheng Ye,Qi Dou,Yu Cheng
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：generating plausible video, demands responsive control, Building a playable, playable world requires, persistent spatial structure
备注： Code: [this https URL](https://github.com/MajorDavidZhang/PlayGen-2)
点击查看摘要
Abstract:Building a playable world requires more than generating plausible video: it demands responsive control, persistent spatial structure, and coherent interactions with dynamic entities. Using generated frames as the sole recurrent world representation ties these requirements to view-dependent appearance synthesis, making it difficult to maintain long-term spatial and temporal consistency in generation and interaction. We present PlayGen2, a real-time interactive world model that separates learned 3D state evolution from neural rendering. PlayGen2 maintains a persistent world memory comprising static geometry represented by a volumetric occupancy grid and identity-indexed 3D states for the player and other entities. Within a fixed-size local region, its world-state model jointly learns action-conditioned entity dynamics, geometry completion, and entity discovery, committing updates to a persistent world memory. A separate neural renderer synthesizes first-person observations from depth and semantic projections of the world state, without feeding generated images back into state prediction. Using Doom as a testbed, we demonstrate that the model successfully learns world dynamics including geometry-aware player motion and player--NPC interactions. The framework is computationally efficient, enabling the complete simulation and rendering pipeline to achieve approximately 160ms backend latency on a MacBook Pro with an M4 Pro chip. Beyond single-player interaction, we demonstrate zero-shot deployment on unseen Doom maps, multiplayer interaction through the composition of single-player models, and programmable gameplay through rule-based state interventions. These capabilities demonstrate the transferability and extensibility of the learned game-world model. Code and pretrained model weights are publicly available.
61. 【2611.07865】OcTreeMamba: Topology-Aware Mamba for 3D Medical Segmentation via Octree Sparsification
链接：https://arxiv.org/abs/2611.07865
作者：Kaixiang Mai,Jiaqi Yu,Yuzhu Ji,Yiqun Zhang,Zhijie Wang,Haijun Zhang,Yiu-ming Cheung
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：medical image analysis, Accurate segmentation, image analysis, crucial to medical, medical image
备注： 8 pages, 5 figures, accepted by IEEE BIBM 2026
点击查看摘要
Abstract:Accurate segmentation of 3D anatomical structures is crucial to medical image analysis. Recently, Mamba-based approaches have achieved promising segmentation performance in capturing long-range dependencies with linear-time computational complexity. However, heuristic selective scanning strategies inherently disrupt the intrinsic spatial hierarchy and increase computational redundancy, ignoring the inherent sparsity of 3D anatomical structures. To this end, we propose OcTreeMamba, a hierarchical framework that incorporates Octree structures into SSM, achieving 3D topology-aware long-range context feature propagation and integration. Specifically, a Structure Learner performs anatomy-adaptive structured sparsification through hierarchical gating and Gumbel-Softmax sampling, enabling differentiable selection of anatomical regions. The selected regions are subsequently organized by a Dynamic Octree Builder into a multi-level topology that preserves their hierarchical connectivity. Based on the constructed Octree, a bidirectional Tree-SSM propagates and integrates contextual features along connectivity-aware leaf--parent--root and root--parent--leaf trajectories. Extensive experiments on four benchmark datasets show that our proposed OcTreeMamba achieves competitive performance \wrt topological continuity and computational efficiency, particularly for recovering the complex structure on vascular datasets. The code is available at this https URL.
62. 【2611.07850】Learning Robotic World Models with Semantic and Visual Feedback
链接：https://arxiv.org/abs/2611.07850
作者：Hao Wu,Yuqi Li,Yizhou Zhao,Kun Wang,Xiao Luo,Yu Cheng,Bo An,Yingli Tian,Laszlo A. Jeni,Ming-Hsuan Yang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：predict action-conditioned future, Robot world models, action-conditioned future visual, future visual states, models predict action-conditioned
备注： 27 pages, including supplementary material. Project and code: [this https URL](https://github.com/Alexander-wu/RoboImagine) . Data and weights: [this https URL](https://huggingface.co/easylearning/RoboImagine)
点击查看摘要
Abstract:Robot world models predict action-conditioned future visual states to support robotic planning and decision making. However, visual reconstruction does not fully capture task progress, semantic evaluation alone provides limited constraints on fine-grained visual errors, and homogeneous predictions limit comparative feedback. We present RoboImagine, a framework for post-training autoregressive robotic world models through candidate-future comparisons with semantic and visual feedback. Diverse search promotes diversity among candidate trajectories under shared visual observations, action sequences, and task instructions. A frozen multimodal evaluator provides task-relevant semantic preferences through pairwise video comparisons in both presentation orders, complemented by pixel- and perceptual-level visual consistency feedback that constrains local structural and appearance errors. These signals drive policy optimization through group-relative advantages. Fixed initial context and branch-specific rolling histories support long-sequence generation with bounded context and consistent conditioning between candidate generation and policy optimization. Experiments with separately trained models on RT-1, BridgeV2, and RoboCasa cover real-world and simulated manipulation. On RT-1, under matched initialization, update counts, and evaluation protocols, RoboImagine improves PSNR by 1.26 dB and reduces LPIPS by 11.93% relative to continued supervised fine-tuning. Ablations show that diverse search improves prediction quality and that combined semantic and visual feedback yields higher external multimodal evaluation scores than visual feedback alone while maintaining comparable visual fidelity. Rolling histories further improve long-horizon prediction. These results support improving visual fidelity, task relevance, and long-horizon prediction through candidate comparison and complementary feedback.
63. 【2611.07843】Enhanced MRI brain tumor detection using deep learning in conjunction with explainable AI SHAP based diverse and multi feature analysis
链接：https://arxiv.org/abs/2611.07843
作者：Asif Rahman,Maqsood Hayat,Nadeem Iqbal,Fawaz Khaled Alarfaj,Salem Alkhalaf,Fahad Alturise
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：surpassing conventional diagnostic, conventional diagnostic approaches, Recent innovations, Discrete Wavelet Transform, Fast Fourier Transform
备注： 15 pages. Published in Scientific Reports 15, 29411 (2025). Open access under CC BY 4.0
点击查看摘要
Abstract:Recent innovations in medical imaging have markedly improved brain tumor identification, surpassing conventional diagnostic approaches that suffer from low resolution, radiation exposure, and limited contrast. Magnetic Resonance Imaging (MRI) is pivotal in precise and accurate tumor characterization owing to its high-resolution, non-invasive nature. This study investigates the synergy among multiple feature representation schemes such as local Binary Patterns (LBP), Gabor filters, Discrete Wavelet Transform, Fast Fourier Transform, Convolutional Neural Networks (CNN), and Gray-Level Run Length Matrix alongside five learning algorithms namely: k-nearest Neighbor, Random Forest, Support Vector Classifier (SVC), and probabilistic neural network (PNN), and CNN. Empirical findings indicate that LBP in conjunction with SVC and CNN obtained high specificity and accuracy, rendering it a promising method for MRI-based tumor diagnosis. Further to investigate the contribution of LBP, Statistical analysis chi-square and p-value tests are used to confirm the significant impact of LBP feature space for identification of brain Tumor. In addition, The SHAP analysis was used to identify the most important features in classification. In a small dataset, CNN obtained 97.8% accuracy while SVC yielded 98.06% accuracy. In subsequent analysis, a large benchmark dataset is also utilized to evaluate the performance of learning algorithms in order to investigate the generalization power of the proposed model. CNN achieves the highest accuracy of 98.9%, followed by SVC at 96.7%. These results highlight CNN's effectiveness in automated, high-precision tumor diagnosis. Code: this https URL
64. 【2611.07836】HG-Omni: Traceable Human-Centric Graph Supervision for Video Reasoning
链接：https://arxiv.org/abs/2611.07836
作者：Jisheng Dang,Kai Wei,Ronghao Lin,Bimei Wang,Hong Peng,Wei-Shi Zheng,Bin Hu,Qi Tian,Tat-Seng Chua
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：predictions rarely show, predictions rarely, interval supports, graph, video
备注：
点击查看摘要
Abstract:Omni-modal models can answer questions about video, but their predictions rarely show which participant, event, or interval supports an answer. Moreover, answer-level supervision alone does not teach a model to interpret structured video evidence. To systematically mitigate this issue, we present THG-Omni, a human-centric graph-supervision framework that links Segment Anything Model~3 participant tracks with temporally grounded Qwen3-VL annotations. Candidate semantic claims are checked against the source video and available audio before they are used to construct training questions, while track geometry provides explicit spatial and temporal supervision. The resulting questions teach an omni-modal reasoning model to interpret participant attributes, actions, affect, interactions, and their timing from a structured graph. At inference, THG-Omni uses a predicted graph constructed from the evaluation video. Experiments on IntentBench show consistent improvements over the unadapted backbone across social reasoning, emotion understanding, and deception perception. On NExT-QA, THG-Omni achieves 89.54\% accuracy with the matched graph, compared with 85.10\% without graph input. Further validation experiments show that compact graph input achieves 78.22\% accuracy, compared with 78.02\% using the full graph and 77.58\% without graph input. A complementary diagnostic demonstrates that the predicted graph preserves evidence useful for answering questions even without the source video and audio. Together, these findings show that THG-Omni improves human-centric video reasoning while grounding its evidence in identifiable participants and events. Our codes are available at this https URL
65. 【2611.07828】STAG-Net: Structure-Aware Attention over Landmark Groups for Lightweight Head Pose Estimation
链接：https://arxiv.org/abs/2611.07828
作者：Asiri Gawesha Lindamulage,Sanka Mohottala,Dharshana Kasthurirathna,Nuwan Kodagoda
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：Head pose estimation, resource constrained deployment, human computer interaction, Head pose, lightweight head Pose
备注：
点击查看摘要
Abstract:Head pose estimation is important for human computer interaction and driver monitoring, but many image based methods remain too costly for resource constrained deployment. We propose STAG-Net, a structure-aware attention over landmark groups for lightweight head Pose estimation that estimates head pose from facial landmarks using movement aware selection, spatial clustering, compact DeepSet encoders, self attention, and a global geometry descriptor. We develop variants using FaceMesh and Face Alignment Network landmarks and evaluate them under cross dataset and subject independent protocols on 300W-LP, AFLW2000, and BIWI. STAG-Net achieves the lowest mean absolute error among all compared landmark based methods in every evaluated setting. On BIWI frames with valid detections, the FAN variant also records the lowest overall error among all compared methods, reaching $3.51^\circ$ under cross dataset evaluation and $2.39^\circ$ under subject independent evaluation. The regressors use only 0.012 to 0.043 million parameters and 24.1 to 83.6 thousand FLOPs, about three orders of magnitude fewer FLOPs than FSA-Net. Despite including landmark extraction and regression, the FaceMesh pipeline reaches 322.9 frames per second on a Tesla T4 GPU, nearly twice the 164.5 frames per second of the fastest measured image based baseline, and 111.0 frames per second on CPU. After normalization by dataset size, STAG-Net processes training samples seven to eight times faster than FSA-Net and more than one hundred times faster than HopeNet and TokenHPE, while complete training finishes within 28 minutes. These results show that STAG-Net combines leading landmark based accuracy with substantially lower training and inference cost.
66. 【2611.07814】CMDiff: Left Atrial Scar Segmentation from 3D LGE MRI Using Conditional Mask Diffusion Model: A Feasibility Study
链接：https://arxiv.org/abs/2611.07814
作者：Jing Zhang,Bastien Bergere,Jonas Leite,Emilie Bollache,Mikaël Laredo,Alban Redheuil,Nadjia Kachenoura
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Late gadolinium enhancement, cardiac MRI enables, MRI enables non-invasive, fibrillation ablation outcome, enables non-invasive assessment
备注： 15 pages, 3 figures, 4 tables
点击查看摘要
Abstract:Late gadolinium enhancement (LGE) cardiac MRI enables non-invasive assessment of left atrial (LA) scar, an imaging marker associated with atrial fibrillation ablation outcome. However, automatic scar segmentation is hindered by low contrast, the thin atrial wall, scarce labels, and extreme class imbalance. Conditional diffusion offers iterative mask generation, but its suitability for sparse 3D LA scar segmentation remains unclear. To address this gap, we propose Conditional Mask Diffusion (CMDiff), which predicts clean masks using a dynamic-encoder-conditioned 3D sinusoidal UNet. We compared CMDiff with a deterministic baseline on identical cases in five-fold cross-validation of 60 scar-labelled public LASCARQS subjects, with 48 training and 12 held-out cases per fold. CMDiff achieved a scar DSC of 0.47 $\pm$ 0.08, HD95 of 12.89 $\pm$ 6.39 mm, and ASD of 1.91 $\pm$ 0.96 mm, compared with deterministic baseline values of 0.51 $\pm$ 0.08, 10.86 $\pm$ 5.39 mm, and 1.58 $\pm$ 1.03 mm, respectively. Under the same implementation, clean-mask prediction performed substantially better than the noise-prediction configuration evaluated in this study. Thus, CMDiff was technically feasible but did not improve segmentation performance: DSC was lower, and both HD95 and ASD were higher. Direct mask diffusion therefore provides an analytical alternative, but not a competitive performance advance for this task. The source code is publicly available at this https URL.
67. 【2611.07811】MV-Sign: Multi-View 3D Motion Integration and Enhanced Text-to-Motion Conditioning for Sign Language Production
链接：https://arxiv.org/abs/2611.07811
作者：Singyu Muk,Kaustubh Kundu,Kunyuan Xie,Weijie Wang,Kalin Stefanov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Sign language production, sign language motion, Sign language, spoken language text, spoken language
备注： Accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027)
点击查看摘要
Abstract:Sign language production (SLP) aims to generate appropriate sign language motion from spoken language text. However, current 3D SLP methods suffer from noisy supervision and weak text conditioning. Specifically, these methods typically rely on pseudo-3D motion data fitted from single-view frontal videos, which introduces severe self-occlusion and loses fine-grained hand details, ultimately degrading downstream production. To overcome these limitations, we propose a comprehensive framework that jointly integrates multi-view 3D motion data and optimizes the text-conditioning pathway. First, we introduce How2Sign-MV3D, a high-fidelity dataset constructed via a novel cross-view curation pipeline that fuses multi-view estimates to resolve occlusions and filter non-signing segments. Second, we design a robust SLP model incorporating a sign-aware spatio-temporal VQ-VAE (ST-VQVAE) for joint body-hand tokenization, a pseudo-gloss adapter, and keyframe-aware retrieval to enhance text-to-motion alignment. Evaluated on the How2Sign benchmark, our framework reduces body and hand DTW-PA-JPE by 32.8% and 20.9% respectively compared to the state-of-the-art. Finally, we release two new high-quality 3D datasets, ASLCitizen-3D and MM-WAuslan-MV3D, alongside SGNify-MV as a multi-view video benchmark to support broader community research.
68. 【2611.07810】Self-Supervised Diffusion Models for Handwritten Signature Verification via Ruin Reconstruction
链接：https://arxiv.org/abs/2611.07810
作者：Peirong Zhang,Zhenhua Yang,Jiaxin Zhang,Moises Diaz,Miguel A. Ferrer,Umapada Pal,Wei Zhou,Lianwen Jin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Handwritten signature verification, Handwritten signature, critical biometric technique, emph, forensic authentication
备注：
点击查看摘要
Abstract:Handwritten signature verification (HSV) is a critical biometric technique in legal and forensic authentication, whose efficacy hinges on the discriminability of signature representations. Current HSV methods predominantly adopt supervised learning to enhance representation quality, leaving self-supervised learning largely unexplored. We propose \emph{SigDiffuser}, a diffusion-based self-supervised framework for signature representation and verification. At its core, \emph{SigDiffuser} introduces a novel pretext task termed \emph{Reconstruction from Ruins (RFR)}, which deliberately ``ruins'' signatures through severe crumpling, obliterating their structural integrity and writing styles. A visual encoder is employed to capture crucial handwriting patterns from intact signature regions, guiding the denoiser to reconstruct the ``ruined'' portions and learning meaningful representations. Additionally, we introduce a \emph{pyramidal feature aggregation module (PFAM)} to bridge the visual encoder and denoiser, enhancing representation quality via hierarchical aggregation and modulation. Extensive experiments on multilingual signature datasets demonstrate that \emph{SigDiffuser} significantly outperforms both state-of-the-art SSL methods and HSV models. We further show that increasing the crumpling severity on signatures effectively improves representation quality. Notably, our work demonstrates that extreme destruction, coupled with self-supervised diffusion models, can yield superior signature representation compared to traditional mild deformations, paving new avenues for HSV and other biometric domains. Code will be publicly available.
69. 【2611.07793】Rain Beyond Streaks: Cascaded Realistic Rain and Wet Surface Synthesis via Scene Priors
链接：https://arxiv.org/abs/2611.07793
作者：Melissa Tijink,Kirill Tolstobrov,Shunxin Wang,Estefania Talavera,Duc V. Le,Luuk Spreeuwers,Shaodi You,Nicola Strisciuglio
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision systems operating, persistent challenge, systems operating, Realistic rain synthesis, rain synthesis
备注： WACV-2027
点击查看摘要
Abstract:Realistic rain synthesis is a persistent challenge for vision systems operating in adverse weather. Existing methods primarily focus on generating rain streaks, often neglecting consequent surface effects such as reflections and puddles, which are critical for perceptual realism and robustness of downstream vision tasks. We introduce CascadeRS, a rain synthesis framework that leverages depth and segmentation priors to render scene-consistent rain and surface effects. In addition to rain streaks, CascadeRS produces reflections and puddles aligned with scene semantics through a physics-inspired zero-shot, controllable generative pipeline. It produces photorealistic rainy urban scenes, with high perceptual realism, which we validate qualitatively with an extensive user study and quantitatively. We produce the Cityscapes-CascadeRS dataset, to study downstream task performance under real rainy conditions. Our results establish CascadeRS as a scalable and realistic rain-generation framework for evaluating and enhancing the robustness of vision in adverse rainy weather. Code and dataset are available via this https URL
70. 【2611.07775】Adapters as Data: The Latent Space of LoRAs
链接：https://arxiv.org/abs/2611.07775
作者：Moritz Grävinghoff,Konstantin Wehmeyer,Aron Asefaw,Boris Knyazev,Damian Borth
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：treated as finished, finished artifacts, linear PCA basis, adapters, latent
备注： Accepted at the NeurIPS 2026 Workshop on Neural Network Artifacts as a New Data Modality
点击查看摘要
Abstract:LoRA adapters are usually treated as finished artifacts rather than as a data modality. Prior work has shown that LoRA adapters populate a low-dimensional manifold that a linear PCA basis already organizes well enough to support different operations such as sampling, editing, and inversion. We ask what a learned, nonlinear latent adds beyond this. We train a transformer autoencoder on the same population of LoRA identity adapters, mapping each into a latent space and compare every operation against the identical operation applied directly to the raw adapter weights. The latent preserves the capabilities already available in weight space, sampling diverse identities and editing individual attributes. Beyond preservation, we show that the latent is far more robust to displacement than weight space, degrading into distorted but still valid faces rather than texture. Fixed-dimensional weight-space representations cannot natively host adapters of more than one rank, so we extend our sequential autoencoder to hold mixed-rank adapters within one shared latent. This gives a path toward treating adapter weights of varying architecture as a single, general modality rather than one tied to a fixed rank, and points to a learned, nonlinear latent as the mechanism that could carry this generalization further, toward heterogeneous populations of adapters.
71. 【2611.07765】BiGrounder: Bidirectional Training Unlocks the Potential of GUI Grounding
链接：https://arxiv.org/abs/2611.07765
作者：Dengyao Shi,Tianyu Fu,Fei Hu,Anyang Su,Hanning Wang,Shuo Wang,Minghui Wu,Chenxu Zhao,Zhen Lei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Graphical User Interface, Graphical User, User Interface, autonomous agent interaction, map natural language
备注： Preprint, 22 pages, 10 figures, including appendix
点击查看摘要
Abstract:Graphical User Interface (GUI) grounding aims to map natural language instructions to precise operational coordinates, serving as a critical task for autonomous agent interaction. Current approaches formalize GUI grounding as predicting action-coordinate pairs from instructions, with end-to-end training supervised solely by final coordinates. Training datasets typically provide only a small number of descriptions per target coordinate, whereas real-world scenarios involve a much larger set of varied descriptions for the same target, which limits robustness to linguistic variation. While recent GUI grounding paradigms have begun employing reinforcement learning to enhance localization accuracy, models with limited exploratory capability before reinforcement yield constrained improvements even with identical training data during the reinforcement phase. To overcome these limitations, we propose a bidirectional reward paradigm that enables model self-reinforcement. During SFT, bidirectional training equips the model to generate action descriptions from target coordinates. During RL, the model samples semantically consistent instruction variations on-policy and grounds each variation back to its target. A cycle-consistency gate couples semantic quality to grounding success, turning the model's own instruction policy into a source of continually refreshed reinforcement trajectories. Our 4B-parameter model achieves competitive accuracy across five grounding benchmarks in our evaluation, indicating the effectiveness of the proposed training paradigm. this https URL
72. 【2611.07741】Comparing Classification and Feature Learning by Analyzing Their Loss Functions in Normalized Spaces with Different Scale Factors
链接：https://arxiv.org/abs/2611.07741
作者：Qiufu Li,Huibin Xiao,Linlin Shen,Weijia Fan,Xi Jia,Yongdong Huang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：interrelated fundamental tasks, closely interrelated fundamental, feature learning, Classification, classification accuracy
备注：
点击查看摘要
Abstract:Classification and feature learning are two closely interrelated fundamental tasks. Feature learning in supervised settings is typically achieved by training classification models, under the common assumption that higher classification accuracy implies better feature quality. In this paper, we first point out that classification accuracy reflects the sample-wise local properties of a model on a dataset, whereas feature learning aims to learn features with good dataset-level global properties, such as intra-class compactness and inter-class separability. From the first principle of feature learning, we redesign the binary cross-entropy (BCE) loss, a counterpart of the cross-entropy (CE) loss used in classification. Then, in normalized feature space, we analyze the minima of the BCE and CE losses and show that both can lead to neural collapse, where sample features from different classes become maximally compact and maximally separated. More importantly, by investigating the convergence behaviors of the two losses as the scale factor $\gamma$ varies in the normalized space, we reveal how classification accuracy and feature quality change differently across spaces of different sizes. Under a fixed training strategy, a very large $\gamma$ achieves perfect classification accuracy but slows convergence toward the ideal feature geometry, whereas a very small $\gamma$ makes classification highly sensitive to small perturbations. A moderate $\gamma$ is therefore necessary for simultaneously achieving reliable classification and well-structured features. Extensive experiments validate these findings and demonstrate that BCE loss exhibits advantages in long-tail and open-set recognitions, as it better aligns with the global requirements of feature learning.
73. 【2611.07730】Seeing Beyond the Next Step: World-Model-Guided Human-Like Navigation in Multi-Agent Scenes
链接：https://arxiv.org/abs/2611.07730
作者：Seong-Eun Hong,JuYeong Hwang,Jinhyun Kim,Hanyoung Jang,HyeongYeop Kang
类目：Graphics (cs.GR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：crossing pedestrians, narrow passage, matter of avoiding, locally feasible, feasible yet drift
备注： Accepted to NeurIPS 2026. 37 pages, 13 figures, 12 tables
点击查看摘要
Abstract:Selecting a next motion in a populated scene is not just a matter of avoiding what is currently in the way: an action can be locally feasible yet drift onto the road instead of the crosswalk, cut into a stream of crossing pedestrians, or bottleneck a narrow passage. These failure modes are invisible from the current state alone, and acting on them requires reasoning about what each candidate action will cause. World models offer exactly this, namely action-conditioned predictions of the future, but rolling them out at every decision step is a cost deployable navigation systems cannot pay, and the field has largely traded foresight for speed. We argue this is a false dichotomy. The natural place for a world model in human-aware navigation is at training time, as a preference oracle that distills foresight into a fast policy, rather than at inference time, as an online planner. We pair a discrete visual action prior with two task-aligned world models, one for nearby social dynamics and one for future scene semantics, that score candidate actions by their predicted consequences and refine the policy through group-relative preference distillation. At deployment, both world models are removed and the policy acts in a single forward pass. Across five held-out evaluation scenarios, this yields navigation that is simultaneously safer, more socially and group-coherent, and more goal-directed than strong reactive and learned baselines, with naive observers rating the resulting motion as more human-like. Taken together, our findings point to a different approach for bringing world-model foresight into deployable agents: not accelerating rollouts, but amortizing them into the policy so that the cost of looking ahead is confined to training. Project page: this https URL
74. 【2611.07718】Multimodal Information Interactions Bottleneck for Multimodal Self-Supervised Learning
链接：https://arxiv.org/abs/2611.07718
作者：Liangjian Wen,Jiangtao Zheng,Jiang Duan,Qun Dai,Yong Dai,Jianzhuang Liu,Jun Wang,Shu-Dong Huang,Xinwang Liu,Zenglin Xu,Zhao Kang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：multimodal data sources, unequal informativeness, challenged by heterogeneity, data sources, tabular data
备注： 15 pages, 3-page supplementary material provided as an ancillary file. Accepted for publication in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
点击查看摘要
Abstract:Multimodal self-supervised learning is challenged by heterogeneity, unequal informativeness, and complex information interactions across multimodal data sources such as images, text, audio, and tabular data. While contrastive methods effectively align shared semantics, they typically rely on strong multi-view redundancy assumptions, overlooking modality-specific and synergistic information, thus leading to suboptimal representations. We propose the Multimodal Information Interactions Bottleneck (MIIB), a principled framework grounded in Partial Information Decomposition that explicitly encodes redundant, unique, and synergistic information within multimodal interactions. MIIB employs a dual-path model architecture for modality-specific encoding and multimodal fusion, optimized using surrogate tractable entropy-based objectives that enforce minimal sufficient representations without requiring explicit mutual information estimation. By leveraging variational bounds and score-based entropy estimation, MIIB efficiently captures complex cross-modal interactions while suppressing superfluous information. Experiments across diverse benchmarks demonstrate consistent improvements over state-of-the-art multimodal self-supervised methods. Code is available at this https URL.
75. 【2611.07713】Selective Event Evidence and Persistent Temporal Priors for Event-Based Point Tracking
链接：https://arxiv.org/abs/2611.07713
作者：Xiaokai Song,Zhang Li,Leqi Liu,Yibin Ye,Kun Wang,Xichao Teng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Event cameras enable, cameras enable tracking, event evidence, Selective Event Evidence, Event Evidence Modulation
备注：
点击查看摘要
Abstract:Event cameras enable tracking under fast motion and challenging illumination. However, stable long-term point tracking remains challenging: event activity is sparse and varies with scene content and motion, complicating correspondence, while trajectory estimates can drift over long sequences. Together, these challenges motivate a tracker that selectively uses informative event evidence and retains trajectory constraints across temporal windows. We propose Selective Event Evidence and Persistent Temporal Priors (SEPT), an event-only framework for tracking any point (TAP) over long sequences. SEPT introduces two complementary modules: Task-Adaptive Event Evidence Modulation (TEEM) and Persistent Trajectory Prior (PTP). Using only tracking supervision, TEEM learns a bounded reliability field that weights the event tensor across space, time, and channels before feature extraction. PTP carries geometric information across overlapping windows by marginalizing a fixed local quadratic trajectory model with a Schur complement. Its visibility-aware correction refines overlap coordinates, while a clipped terminal velocity initializes coordinates at newly exposed timestamps. SEPT builds on the ETAP architecture. SEPT is trained exclusively on synthetic EventKubric data and evaluated on five datasets across TAP and feature tracking. Results show that SEPT outperforms the retrained ETAP baseline in average Jaccard for TAP and in feature age and expected feature age for feature tracking; it also surpasses several methods combining event and frame inputs on EC and EDS. The source code is publicly available at this https URL.
76. 【2611.07711】Fast and Accurate Hand Estimation in Pixels, Interaction and World Space
链接：https://arxiv.org/abs/2611.07711
作者：Jinkun Cao
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Monocular hand mesh, estimators commonly predict, commonly predict rig, predict rig parameters, mesh estimators commonly
备注： 10 pages of main text plus 15 pages of supplementary material; 5 figures; 12 tables; code available at [this https URL](https://github.com/noahcao/FAH)
点击查看摘要
Abstract:Monocular hand mesh estimators commonly predict rig parameters and project the mesh to obtain 2D keypoints. We find that directly predicted 3D joints agree better with 2D predictions, and fitting a mesh to predicted points reduces mesh error. We present FAH (Fast and Accurate Hand Estimation), a family of models built on SAM 3D Body's hand branch through fine-tuning and feature distillation. The models predict corresponding 2D and 3D joints and surface points, fit MANO or MHR-Hand, and optionally estimate anatomical parts and contact without object geometry at inference. Causal refinement reduces acceleration error, and camera estimation places the hands in world space. Experiments show improvements in image-space alignment, hand geometry, contact estimation and world-space tracking over the evaluated baselines. The default ViT-L model runs at 65 fps with mesh fitting on an RTX 4070 Ti SUPER, or 49 fps with parts and contact enabled. The smallest ViT-S model reaches 125 fps without mesh fitting, parts or contact. Code: this https URL.
77. 【2611.07709】AffineGS: Unlocking Accurate Geometry in 3DGS via Spatially Varying Affine Rectification
链接：https://arxiv.org/abs/2611.07709
作者：Tze Ho Elden Tse,Jizong Peng,Richard Chen,Angela Yao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：view synthesis, leading approach, approach for photorealistic, photorealistic novel view, Gaussian Splatting
备注： Accpeted to NeurIPS 2026. Project page: [this https URL](https://eldentse.github.io/AffineGS/)
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) has become the leading approach for photorealistic novel view synthesis, yet its geometric accuracy lags behind its visual quality. Existing depth-guided methods attempt to resolve this by regularizing the optimization with monocular depth priors, typically using a single global scale-and-shift alignment. Crucially, we discover a fundamental flaw in this assumption: modern monocular depth networks systematically exhibit region-dependent, piecewise-linear distortions. This discovery invalidates standard global alignment strategies, which warp scene geometry by enforcing a single transform. To address this, we introduce a spatially varying affine rectification model that corrects monocular disparity into consistent metric depth using regionally smooth, edge-aware fields. We further derive a normal-aware regularizer that uses spatial gradients to couple the rectified disparity with 3DGS depth and normals. Across diverse experimental settings, our sensor-free method shows strong photometric quality of Gaussian Splatting while substantially improving geometric accuracy and outperforming state-of-the art geometry-focused methods.
78. 【2611.07705】FlyingDrones: A Dataset and Benchmark for Optical Flow Estimation from UAV motion
链接：https://arxiv.org/abs/2611.07705
作者：Laurenz Ruzicka,Roman Pflugfelder,Daniel Cremers
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：long-range target tracking, Unmanned Aerial Vehicles, motion remains informative, airspace monitoring, small Unmanned Aerial
备注： NeurIPS 2026, [this https URL](https://neurips.cc/virtual/2026/loc/sydney/poster/138996)
点击查看摘要
Abstract:Optical flow is an important cue for drone analysis in aerial surveillance, airspace monitoring, and long-range target tracking, where motion remains informative when appearance is weak. Estimating the motion of small Unmanned Aerial Vehicles, however, is difficult because distant targets occupy few pixels, have low contrast, and move against complex dynamic backgrounds. Standard optical-flow benchmarks emphasize large, object-centric motions and therefore do not characterize distant aerial targets well. We introduce FlyingDrones, a generated benchmark with dense ground-truth optical flow and segmentation masks derived from physically based rendering, and define resolution-normalized metrics (EPE Norm) that normalize flow by image dimensions. We evaluate 16 state-of-the-art model families on a motion- and size-stratified subset of 999 flow pairs at three resolutions. Every family recovers drone motion better than the zero-flow reference, but the gap between families widens with resolution: at 1920x1080, global-matching, recurrent, transformer, and short-window temporal models separate clearly from pyramid, classical, self-supervised, lightweight, and diffusion models. Within-family checkpoint spread is comparable to or larger than between-family spread, so the training curriculum is as important as the architecture. Two complementary studies test the benchmark beyond synthetic accuracy: a ground-truth-free motion-alignment evaluation on 21 cameras of real UAV footage shows that the synthetic ranking carries a moderate, significant signal about real-world performance (Spearman \r{ho} = 0.63 over 41 checkpoints) while the exact top ranks differ, and a fine-tuning study shows that 800 FlyingDrones pairs reduce held-out drone-region error by up to 37% and improve drone localization on the real footage for all four architectures tested.
79. 【2611.07702】InfMasking: A Unified Variational Framework for Synergistic Multimodal Learning
链接：https://arxiv.org/abs/2611.07702
作者：Liangjian Wen,Qun Dai,Jiang Duan,Yong Dai,Jianzhuang Liu,Dongkai Wang,Jun Wang,Fuyuan Cao,Zenglin Xu,Zhao Kang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：exploit synergistic information, expected to exploit, exploit synergistic, multiple modalities, synergistic information
备注： Accepted for publication in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). 16 pages; supplementary material provided as an ancillary file. Code: [this https URL](https://github.com/brightest66/InfMasking)
点击查看摘要
Abstract:Multimodal models are expected to exploit synergistic information, that is, information available only when multiple modalities are observed together. In practice, however, a fusion module can fit the training objective by relying on a dominant modality or on information that modalities share, and the synergy between modalities is often left unused. We propose InfMasking, a unified multimodal learning framework based on Infinite Masking. Before fusion, InfMasking randomly masks the features of each modality; each sampled mask produces a different partial combination of cross-modal evidence and a fused representation of the corresponding modality interactions. All masked fused representations are required to remain consistent with a reference target: the unmasked fused view when training is unsupervised, and the class proxy of the task label when labels are available. Maintaining this consistency across diverse partial combinations discourages reliance on a dominant modality or on shared information alone, and drives the fusion module to learn cross-modal interaction patterns that remain meaningful under partial observations. Since the objective is an expectation over infinitely many masks, we model the masked fused representations as Gaussian and optimize closed-form variational bounds, whose population-moment gaps are controlled by the masking-induced covariance under this model. On the evaluated benchmarks, InfMasking improves predictive performance and yields higher mean PID estimates of task-label synergy in learned modality-specific representations, alongside higher InterSHAP interaction attribution in the trained predictors. Code is available at this https URL.
80. 【2611.07683】ReferClaw: Disambiguating User Intent for Egocentric Assistance
链接：https://arxiv.org/abs/2611.07683
作者：Hangyu Qin,Junbin Xiao,Angela Yao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：dialogue history, intended referents, video and dialogue, ambiguous questions, uniquely resolved
备注：
点击查看摘要
Abstract:Users of egocentric AI assistants often ask short, ambiguous questions whose intended referents cannot be uniquely resolved from video and dialogue history. For example, "Where did I leave it?" may refer to several previously handled objects. Existing VideoQA systems typically commit to a single interpretation, risking plausible but intention-misaligned answers. We introduce ReferClaw, an agentic framework that formulates egocentric streaming QA as an interactive process: the assistant asks clarifying questions to resolve user intent before answering. Three cooperating agents identify candidate interpretations, request clarification, and generate answers grounded in the resolved intent and visual evidence. A bounded, cost-aware policy balances expected information gain against user effort while limiting clarification turns and question complexity. Referclaw learns from interaction through intent-specific skill updates and process-reward-guided policy optimization with agent-level credit assignment. Evaluations on augmented egocentric QA benchmarks demonstrate improved answer accuracy and joint answer-and-grounding performance over existing baselines, alongside zero-shot transfer across datasets. These findings support interactive clarification as a practical approach to resolving online user intent in egocentric streaming assistance.
81. 【2611.07682】DEQ-Det: Dual Evidence Queries for Few-Shot Analog IC Device Detection
链接：https://arxiv.org/abs/2611.07682
作者：Zidong Zhao,Rong Huang,Chengxing Fan,Jie Hu,Malik Haris,Ghazal A. Fahmy,Morteza Mousazadeh,Guoqiang Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Detecting analog integrated, analog integrated circuit, Detecting analog, supports circuit analysis, integrated circuit
备注：
点击查看摘要
Abstract:Detecting analog integrated circuit (IC) devices in layout images supports circuit analysis and inspection. With only a few annotated examples, variation in device geometry and visual similarity to dummy or routing structures make reliable detection difficult. Foreground similarity alone can highlight plausible targets without distinguishing them from competing layout patterns. We propose Dual Evidence Queries for Detection (DEQ-Det), which constructs complementary foreground and background references from the same support images without additional annotations. Foreground references capture target morphology, while selected background references characterize surrounding layout patterns. Both sources guide query selection and region verification, combining target appearance with layout context. Across five held-out device categories and three random seeds, DEQ-Det achieves macro AP50 of 39.41 and 53.03 at 10 and 30 shots, exceeding the strongest listed baselines by 3.97 and 9.71 points, respectively. A matched 30-shot ablation further shows that RoI background evidence reduces pooled false positives at comparable recall, supporting its role in interference suppression.
82. 【2611.07677】GEKey: Learning Geodesic Eccentric 3D Keypoints via Self-Supervision
链接：https://arxiv.org/abs/2611.07677
作者：Pierre Onghena,Santiago Velasco-Forero,Beatriz Marcotegui
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Point clouds represent, clouds represent, spatial coordinates, geometry as sets, sets of spatial
备注： Accepted to BMVC 2026 (Oral)
点击查看摘要
Abstract:Point clouds represent 3D object geometry as sets of spatial coordinates. A fundamental task in their analysis is keypoint detection, i.e., identifying a sparse subset of points that captures the most salient features. While supervised methods rely on manual annotations, unsupervised approaches leverage intrinsic geometric properties to localize keypoints without human input. We introduce GEKey, a self-supervised framework that uses the geodesic eccentricity transform, an SE(3)-invariant geometric measure, to identify instance-specific salient points. These points serve as pseudo-labels to train a model that aligns its predictions with the object's intrinsic structure. GEKey is simple, efficient, and robust, preserving intra-class variation by balancing instance-specific and category-level structure. Extensive experiments on ShapeNetCoreV2, KeypointNet, CAPE, ITOP, and DeformingThings4D show state-of-the-art performance in both keypoint detection and alignment, with strong resilience to noise, downsampling, deformations, and real-world conditions. The code and pretrained models are available at this https URL.
83. 【2611.07673】Egocentric Action Recognition with Objects and Vision-Language Affordances
链接：https://arxiv.org/abs/2611.07673
作者：Raúl Boix-Aldeguer,Manuel Benavent-Lledo,David Ortiz-Perez,Jose Garcia-Rodriguez
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：daily life activities, Action recognition, egocentric action recognition, task assistance, core task
备注： 9 pages, 6 figures. Under review at IEEE FG 2027
点击查看摘要
Abstract:Action recognition, and more specifically egocentric action recognition, is a core task in computer vision, with applications such as monitoring the daily life activities of elderly people and task assistance. Recent methods rely on visual modalities such as RGB video or depth. However, in egocentric video, an action is largely defined by its objects, which these methods rarely model. We propose a method that combines a frozen SlowFast video expert with an attention-based object expert by late fusion. Each object is represented with its affordances, that is, what can be done with it, generated zero-shot by a vision-language model. Since datasets such as MECCANO annotate only the objects involved in each action, evaluating with these boxes tells the model which objects are active. We therefore train on annotated boxes and evaluate the method with detections from the official active-object detector, and with annotated boxes as an upper bound. Without affordances, our fusion reaches 68.4% Top-1 with annotated boxes but 49.0% with detections. About half of this drop comes from non-active detections. To remove them, the same vision-language model generates an interaction affordance that decides whether a hand is manipulating each detected object. On MECCANO, objects raise the Top-1 of the video expert from 44.9% to 49.0%, and the two affordances raise it to 49.9%, above SlowFast and object-aware RGB baselines. Code will be released upon acceptance.
84. 【2611.07665】CoGenRec: A Unified Generative Framework for Complementary Vision Reconstruction
链接：https://arxiv.org/abs/2611.07665
作者：Yapeng Meng,Yuguo Chen,Xiangru Chen,Shaojun Xu,Xuezhen Wang,Lijian Wang,Zheyu Yang,Yihan Lin,Luping Shi,Rong Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high dynamic range, spatial detail, practical bandwidth, quantum-efficiency limits, Complementary Vision Sensor
备注：
点击查看摘要
Abstract:Capturing scenes with extreme motion and high dynamic range is fundamentally constrained by trade-offs among temporal resolution, spatial detail, signal-to-noise ratio, and dynamic range under practical bandwidth, power, and quantum-efficiency limits. Conventional frame-based cameras therefore suffer from temporal undersampling, exposure-induced motion blur, and sensor saturation. The Complementary Vision Sensor (CVS) addresses these limitations by decomposing visual information across two complementary pathways, a spatially dense, temporally sparse, long-exposure RGB pathway and a temporally dense, spatially sparse, short-exposure patiotemporal difference pathway. Their complementary measurements provide appearance, structural, and motion cues across a wide dynamic range that enable reconstruction beyond conventional imaging. We present CoGenRec, a complementarity-driven generative reconstruction framework that unifies video deblurring, high-temporal-resolution frame interpolation, and HDR fusion. CoGenRec encodes complementary measurements into multi-scale spatiotemporal features using exposure-aware appearance modeling and bidirectional temporal propagation. These features constrain a video diffusion model and are injected into the VAE decoder to recover fine structures lost during latent-space compression, combining the scene fidelity of physical measurements with the appearance recovery capabilities of learned video priors. On SportsSloMo-CVS, CoGenRec improves PSNR over the strongest general-purpose baseline by 4.40 dB for deblurring, 3.89 dB for frame interpolation, and 5.04 dB for HDR fusion, respectively. It also achieves strong perceptual quality on 129 unseen scenes captured with real CVS. These results establish a unified approach to advance high-quality reconstruction under challenging motion and illumination conditions. Project page: this https URL.
85. 【2611.07662】Which Objects Stay? Learning Hierarchical Persistence Beliefs for Lifelong Open-Vocabulary Object Maps
链接：https://arxiv.org/abs/2611.07662
作者：Thanh Nguyen Canh,Haolan Zhang,Nak Young Chong
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Lifelong object maps, Lifelong object, leaves view, Lifelong, object
备注：
点击查看摘要
Abstract:Lifelong object maps must estimate whether an object remains at its previously observed location after it leaves view. Existing persistence filters rely on class-based survival priors, making them difficult to apply reliably in open-vocabulary settings. We introduce HiPer, a hierarchical persistence filter that derives persistence beliefs directly from data rather than semantic categories. For a new object, HiPer retrieves visually and geometrically similar training instances and estimates an initial survival rate from their observed histories, without requiring class labels. This estimate initializes a conjugate Beta belief over the object's survival probability, which is updated in closed form using detections and missed observations under Rosen's persistence-filter framework. When an object is re-identified at a new location, its persistence belief is transferred with the object, enabling the map to learn object-specific mobility over time. Experiments on 120 held-out simulated sequences show that HiPer consistently achieves the best performance among competing methods. Retrieval-based priors outperform CLIP-derived label priors, and object-specific online learning provides further gains. Results on 47 held-out 3RScan environments demonstrate that the proposed retrieval-based prior also outperforms state-of-the-art baselines in real-world settings.
86. 【2611.07658】ArtCrafter: Feed-Forward Generation of Articulated 3D Object with Analytic Joint Derivation
链接：https://arxiv.org/abs/2611.07658
作者：Minh Canh Tu,Quang-Binh Nguyen,Khoi Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：casual images poses, remain mutually consistent, assets are essential, simulation and training, key challenge
备注：
点击查看摘要
Abstract:Articulated 3D assets are essential for robotic simulation and training, yet their generation from casual images poses a key challenge: recovering part geometry and kinematics that remain mutually consistent. We present ArtCrafter, a novel feed-forward generative model for controllable generation of articulated 3D objects from a pair of images, one depicting the object in the rest state and the other in the open state. At the core of ArtCrafter is a DiT-based generative model that jointly produces part-level meshes for both articulation states in a single forward pass. Inspired by Slot Attention, its denoising process operates on a $1+2N$ slot layout comprising one shared base slot and $N$ paired rest/open slots, encouraging each pair to bind to the same kinematic part. To ensure geometrically consistent and disjoint part generation, we introduce Triplet Attention to enforce cross-state geometric consistency between paired rest/open slots anchored through the shared base slot, and a repulsion loss $\mathcal{L}_{\mathrm{rep}}$ on decoded part point clouds to prevent inter-part penetration throughout denoising. Given the resulting paired meshes, URDF joint parameters---type, axis, origin, and range---are derived analytically from the rigid transformation between each rest/open pair, providing an interpretable alternative to learned joint-parameter regression. Extensive experiments on both in-distribution and out-of-distribution datasets demonstrate that ArtCrafter outperforms existing method under the same dual-state setting in geometry quality and articulation precision, while remaining competitive with methods operating under different input settings and paradigms.
87. 【2611.07648】Generator-Aligned Reward Modeling with Target-Aware Bounded Optimization for Visual Generation
链接：https://arxiv.org/abs/2611.07648
作者：Ziqiao Weng,Yuanzhi Liang,Haibing Huang,Weidong Cai,Xuelong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enhance desired attributes, general generation capabilities, visual generative models, Post-training aims, aims to enhance
备注： 24 pages
点击查看摘要
Abstract:Post-training aims to enhance desired attributes in visual generative models while preserving their general generation capabilities. Reward-guided post-training faces two challenges: real training data may mismatch the generator's output distribution, and attribute supervision may be confounded by unrelated content. Unbounded reward maximization can also cause overoptimization and degrade generation quality. We propose a framework combining Generator-Aligned Reward Modeling (GARM) and Target-Aware Bounded Optimization (TABO). GARM mitigates distribution mismatch through generator-support matching and reduces content confounding using content-matched real contrasts, yielding generator-relevant, attribute-focused reward supervision. TABO maps the learned reward to a smooth, upper-bounded function calibrated from real target-positive examples. This transformation is independent of the optimization algorithm and supports both direct reward-gradient and policy-based optimization. We further introduce Target-Aware GRPO (TA-GRPO), an adaptation of Flow-GRPO that combines fixed stage-wise advantage scaling, a generator-to-target curriculum, and timestep-balanced credit assignment for flow-based video optimization. Experiments show that GARM improves target-attribute expression while maintaining competitive generation quality. TABO better balances attribute enhancement and visual quality than unconstrained reward maximization, while TA-GRPO improves target enhancement over vanilla Flow-GRPO and reduces unintended attribute leakage on neutral prompts. These results highlight the importance of generator-aligned reward supervision and controlled, data-calibrated optimization for targeted visual generation.
88. 【2611.07647】UniGADD: Universal Generator-Agnostic Deepfake Detector
链接：https://arxiv.org/abs/2611.07647
作者：Bernard Tomczyk,Agil Aghasanli,Plamen Angelov
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：introduce Universal Generator-Agnostic, Generator-Agnostic Deepfake Detector, Universal Generator-Agnostic Deepfake, employs supervised learning, maintaining robust performance
备注：
点击查看摘要
Abstract:In this paper, we introduce Universal Generator-Agnostic Deepfake Detector (UniGADD), a novel method that employs supervised learning to achieve high accuracy on known deepfake generators, while maintaining robust performance on previously unseen ones. The proposed approach follows a two-stage optimisation process. In the first stage, a contrastive loss encourages the model to learn discriminative feature embeddings from real and known fake images, resulting in strong performance within the training domain. In the second stage, the embedding space is refined by promoting inter-cluster separation and intra-cluster compactness, applied exclusively to real samples. This refinement enhances generalisability, enabling the method to exhibit improved robustness against unseen deepfake generation techniques. UniGADD achieves accuracy on par with state-of-the-art methods for known generators, while significantly outperforming them on unseen cases, demonstrating its scalability and practical applicability for adversarial content detection.
89. 【2611.07644】Neural Image Compression with Internal-External Prior Fusion and Alignment
链接：https://arxiv.org/abs/2611.07644
作者：Tiancheng Si,Wenlong Xu,Dahua Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：pression rely primarily, overlooking common patterns, Existing context models, typical textures shared, Existing context
备注： IEEE International Conference on Visual Communications and Image Processing 2026 (VCIP 2026)
点击查看摘要
Abstract:Existing context models for learned image com- pression rely primarily on internal priors from the current image, overlooking common patterns and typical textures shared across natural images. To address this limitation, we propose an Internal-External Prior Fusion-Alignment (IE-PFA) context model built upon quadtree spatial-channel joint modeling, where a learnable dictionary shared by the encoder and decoder serves as an external prior. Specifically, an RWKV-based Spatial- Channel Prior Fusion (RSCPF) module efficiently fuses inter- nal and external priors along spatial and channel dimensions with linear complexity, while a training-only Self-Distilled Prior Alignment (SDPA) mechanism aligns them without inference overhead. Moreover, our model supports variable-rate coding over 64 quality levels within a single network and is accelerated by custom CUDA operators. Experiments on seven benchmarks demonstrate state-of-the-art rate-distortion performance, achiev- ing an average BD-Rate saving of 21.65% over VTM-22.0-Intra, with only 29.9M parameters and the fastest coding speed among advanced neural codecs (61 ms encoding and 52 ms decoding). Code is available at this https URL.
90. 【2611.07632】RACEMARK: Editor-Aware Watermarking for User Attribution in Text-Guided Image Editing
链接：https://arxiv.org/abs/2611.07632
作者：Xiaodong Wu,Xiangman Li,Jianbing Ni,Rongxing Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：image, editing service records, user, service records, editing
备注：
点击查看摘要
Abstract:An image editing service records which user requests each edit, but the edited image itself does not contain this account information. Once the image is downloaded and shared, the service cannot identify the requesting user from the image alone. Embedding a user-specific watermark could enable such attribution, but semantic editing may erase the signal. We propose Tracemark, an editor-aware watermarking framework for identifying users from edited images. A shared encoder embeds a user-specific signal before editing, and a shared detector recovers the user by comparing features of the edited image with learned reference vectors. Both components are trained jointly through an editor with fixed parameters. User identification errors encourage the encoder to produce watermarks that survive editing, while fidelity losses limit changes to the input image and intended edit. Each image domain and editing instruction uses a separately trained model shared across registered users. Experiments on three image domains show that editor-aware training improves user recovery with both reference-vector matching and binary watermark decoding. Separately trained models reach 87.5% mean identification accuracy among 500 users. When tested with a different editor without retraining, the watermark modules still recover user information. These results demonstrate that learning watermarks through the editing process enables user attribution without modifying the editor.
91. 【2611.07613】owards Real-Time Full-Waveform LiDAR Transformers via Intensity-Guided Token Reduction and Physics-Aware Augmentation
链接：https://arxiv.org/abs/2611.07613
作者：Kotaro Oishi,Kazuma Ikeda,Ryosei Hara,Ryo Yoshida,Mariko Isogawa,Kentaro Yoshioka
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：transparent objects, driving and robotics, low-reflectance surfaces, sensor for autonomous, autonomous driving
备注： Accepted to NeurIPS 2026 (Main)
点击查看摘要
Abstract:LiDAR is a critical sensor for autonomous driving and robotics, yet it remains vulnerable to adverse conditions such as fog, rain, transparent objects, and low-reflectance surfaces. Full-waveform LiDAR (FWL) addresses these limitations by capturing the complete return waveform as a histogram, preserving rich reflection characteristics including multi-path echoes and weak signals. While recent Transformer-based approaches have demonstrated promise on FWL data, two fundamental bottlenecks remain: high computational cost from redundant tokens in low-intensity background regions, and limited generalization due to scarce annotated training data. We address both bottlenecks by exploiting the physical structure inherent to FWL data. First, we propose FWL-ToPM, a token pruning and merging mechanism that leverages intensity distributions to selectively reduce tokens while retaining critical waveform content. Second, we introduce FWLAug, a data augmentation framework designed as a regularization method that preserves waveform structure, retaining the Time-of-Flight waveform of each ray and the frustum geometry, to improve generalization to unseen scenes. Evaluated on the Ghost-FWL benchmark, FWL-ToPM achieves over 8 times speedup at real-time throughput alongside a nearly 9-point F1 gain over the prior state of the art, establishing the first real-time FWL Transformer that simultaneously improves accuracy. FWLAug further improves performance on both the standard benchmark and an out-of-distribution test set of unseen scenes. Together, these methods push FWL-based perception toward practical deployment. The code and the OOD dataset are publicly available and can be accessed via the project page: this https URL
92. 【2611.07604】FisherDistill: Diffusion Distribution Distillation via Closed-Form Fisher Critics
链接：https://arxiv.org/abs/2611.07604
作者：Mahesh Bhosale,Yuanhao Zhai,Siwei Lyu,Junsong Yuan,David Doermann,Defang Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：network function evaluations, enabled high-quality image, high-quality image generation, function evaluations, advances in diffusion
备注：
点击查看摘要
Abstract:Recent advances in diffusion distillation have enabled high-quality image generation in only one or a few network function evaluations (NFEs). Despite their efficiency, aggressively distilled generators often retain a residual distribution gap from their multi-step teachers, motivating recent methods to introduce adversarial refinement with a learned discriminator. In this work, we ask whether such refinement necessarily requires a learned adversarial discriminator. We introduce \textbf{FisherDistill}, a simple alternative based on Fisher linear discriminant analysis. Using intermediate representations from the frozen teacher, we estimate the first- and second-order statistics of real and generated samples and derive a closed-form Fisher direction that maximally separates their feature distributions relative to within-class variation. This direction provides a lightweight refinement signal that complements the original distillation objective without requiring an additional adversarial discriminator or its optimization loop. Across multiple distillation frameworks, our approach consistently improves generation quality over their respective distilled baselines and substantially closes the gap to adversarially refined counterparts. Code: this https URL
93. 【2611.07593】ACT-KV: Tri-Axis Cosine Transform for Compressing Volumetric KV Caches in Medical VLMs
链接：https://arxiv.org/abs/2611.07593
作者：Chongyu Qu,Ritchie Zhao,Yufan He,Dong Yang,Zhengyi Lu,Junchao Zhu,Tianyuan Yao,Juming Xiong,Junlin Guo,Yanfan Zhu,Yuechen Yang,Daguang Xu,Bennett Allan Landman,Yucheng Tang,Yuankai Huo
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：structural memory wall, Vision-language models, face a structural, medical scans face, MRI volume produces
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Vision-language models (VLMs) applied to 3D medical scans face a structural memory wall. A single CT or MRI volume produces tens of thousands of vision tokens, and the resulting key-value (KV) cache scales linearly with both batch and context. Existing KV compression methods operate on the cache's feature or token statistics, or apply 1D and 2D transforms, leaving the three-axis spatial structure in the cache unexploited. We propose TACT-KV (Tri-Axis Cosine Transform), a calibration-free KV compression method that exploits strong spatial correlations in visual KV states along all three anatomical axes of 3D scans. This correlation concentrates the KV cache energy under a frequency-domain transform. TACT-KV applies a separable 3D discrete cosine transform to the KV cache, allocates a per-layer bit budget across frequency bins via reverse water-filling (more bits to high-energy components), and quantizes each bin with a fixed scalar codebook. We derive a close-form relation: the distortion reduction from adaptive bit allocation is dominated by the spectral concentration of the transformed cache. Across six medical VLMs and two 3D CT benchmarks, TACT-KV achieves the lowest 1-bit prediction-flip rate on eleven of twelve model and dataset pairs in our main comparison. The same advantage reproduces on four general-purpose VLMs evaluated on video tasks, indicating that the benefit of exploiting three-axis structure generalizes beyond medical imaging. At equal high-bandwidth memory (HBM), TACT-KV scales the decoding batch size on a single GPU by up to $8\times$.
94. 【2611.07580】Subspace Learning with Outlier Exposure for Out-of-Distribution Detection
链接：https://arxiv.org/abs/2611.07580
作者：Hongxu Shen,Kun Fang,Jiahui Zheng,Jian Sun,Qinghua Tao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep Neural Networks, Neural Networks, Deep Neural, distinguish anomalous samples, deployments of Deep
备注：
点击查看摘要
Abstract:Out-of-Distribution (OoD) detection is pivotal for reliable deployments of Deep Neural Networks (DNNs), aiming to distinguish anomalous samples from the In-Distribution (InD) data in training. By introducing outliers as surrogate OoD data to finetune DNNs, Outlier Exposure (OE) has greatly advanced OoD detection in recent years. Existing OE-based research remains predominantly logit-centric, either by generating diverse outliers or by regularizing them with objectives operating at the prediction-output level. Nonetheless, these approaches leave much of the rich information in feature spaces untapped. In this work, we propose an OE-based detection framework, named RecOE, that learns appropriate feature subspaces from InD data and auxiliary outliers, such that the InD-OoD discrepancy can be effectively characterized through the learned feature subspaces. Specifically, the feature subspaces are optimized to capture the dominant variations of InD and outliers by minimizing reconstruction errors therein. Besides, a sample-level objective discourages reconstruction in the opposing subspace, while an orthogonality regularizer reduces subspace overlap, further promoting discriminative subspaces. At inference, the difference in reconstruction errors between the learned subspaces serves as the OoD detection score. Extensive experiments show the superiority of RecOE on multiple benchmarks, in which significant performance gains are achieved over recent strong baselines with only slight extra overhead from two small-size matrices of subspace bases. The source code is available at this https URL.
95. 【2611.07575】Georeferenced Cross-View 3D Reconstruction from Ground and Satellite Images
链接：https://arxiv.org/abs/2611.07575
作者：David G. Shatwell,Mubarak Shah
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：geographic coordinate frame, images requires recovering, local coordinate frame, coordinate frame, local scene geometry
备注： Accepted in NeurIPS 2026
点击查看摘要
Abstract:Georeferenced 3D reconstruction from ground images requires recovering not only the local scene geometry, but also localizing every camera center and 3D point in a geographic coordinate frame. Existing cross-view geo-localization methods are able to estimate the GPS coordinate of a single ground camera, but do not reconstruct dense 3D geometry, while recent feed-forward multi-view 3D reconstruction models predict point maps and camera poses only in a local coordinate frame. We introduce X-VGGT, a feed-forward cross-view geometry transformer that unifies these tasks by jointly processing a set of ground-level images and a georeferenced satellite image to predict ground-view camera poses, dense 3D point maps, and a scene-level transform parameterized by gravity, scale, yaw and translation. This transform projects the local reconstruction into the satellite plane, resulting in the geo-registration of all ground images with the georeferenced satellite image. We further propose an evaluation protocol for this joint task and show that, across multiple cross-view datasets, X-VGGT produces accurate georeferenced reconstructions and outperforms prior cross-view geo-localization and multi-view 3D reconstruction models.
96. 【2611.07573】Integrating Learned Priors through Prior-Space Reparameterization for Physically Based Inverse Rendering
链接：https://arxiv.org/abs/2611.07573
作者：Hun Hwangbo,Minjun Park,Yongsung Kim,Wooseok Song,Jungmin Ko,Junghyun Hwang,Sungroh Yoon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Physically based inverse, based inverse rendering, inverse rendering decomposes, rendering decomposes appearance, Physically based
备注：
点击查看摘要
Abstract:Physically based inverse rendering decomposes appearance into materials and illumination, an ambiguous problem for which learned material predictions provide useful prior information. Most existing methods incorporate these cues through auxiliary regularization losses, which alter the optimization objective and require balancing their influence against photometric fitting. We propose a prior-guided material reparameterization that uses the predicted feature relationships to restrict the optimization space while leaving the objective unchanged. We fuse multi-view material predictions onto a mesh and construct a permutohedral lattice in the resulting prior feature space. Surface points with similar predictions share material variables, which are optimized jointly with geometry and illumination using a purely photometric objective. Experiments with two learned predictors on three synthetic benchmarks and Stanford-ORB demonstrate improved material decomposition and relighting. Our method improves relighting PSNR by 1.5-2.5 dB over the strongest evaluated mesh-based baseline on Synthetic4Relight and TensoIR-Synthetic, and outperforms a regularization loss using the same prior in controlled comparisons. We further show that our reparameterization pools noisy photometric gradients, producing updates that are more consistent across sampled views. This consistency enables a shortened joint optimization schedule that takes less than a minute while retaining relighting quality above all evaluated baselines on TensoIR-Synthetic.
97. 【2611.07566】Guidance Is a Field, Not a Scalar: Interval-Integrated Classifier-Free Guidance for One-Step Video Generation
链接：https://arxiv.org/abs/2611.07566
作者：Zijie Meng,Xixin Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：One-step generators built, single function evaluation, generators built, inherit a rigid, rigid treatment
备注： 10 pages, 9 figures. Accepted to WACV 2027
点击查看摘要
Abstract:One-step generators built on MeanFlow synthesize a video in a single function evaluation, yet inherit a rigid treatment of classifier-free guidance (CFG): the guidance scale is frozen during training or, at best, exposed as a single scalar. This conflicts with mounting evidence that the optimal guidance is not a constant but a field that varies with the noise level, with spatial content, and, for video, with frame position. Every existing remedy presupposes a multi-step sampler along which guidance can be re-scheduled--an assumption one-step models violate by construction. We resolve this tension through a single observation: because the MeanFlow target is an integral over a noise interval, an arbitrary guidance field can be absorbed into the target itself and compiled into one evaluation. We formalize this as the interval-integrated CFG identity, prove that the compiled guidance carries no schedule-discretization error and can thus match or exceed any finite multi-step sampler, and instantiate it as AGAVE, which equips the average-velocity field with a learnable temporal schedule, a free motion-saliency spatial modulation, and a frame-position asymmetry. Adding fewer than ten scalars at zero inference cost, AGAVE surpasses all one-step baselines on VBench, UCF-101 and MSR-VTT while matching multi-step guided sampling. Project repository: this https URL.
98. 【2611.07555】MetricTrail: Revisiting the Power of Metric Depth and Local Optimization for Long-Sequence Streaming 3D Reconstruction
链接：https://arxiv.org/abs/2611.07555
作者：Jingnan Gao,Jiahui Huang,Sven Elflein,Jianhao Zheng,Bingxin Ke,Xiaokang Yang,Yichao Yan,Laura Leal-Taixé,Qunjie Zhou,Jiawei Ren,Shengyu Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：accurate camera motion, long monocular videos, long monocular, camera motion estimation, revisit DPVO sparse
备注： Project Page: [this https URL](https://research.nvidia.com/labs/sil/projects/metrictrail/) , Code: [this https URL](https://github.com/nv-tlabs/vipe)
点击查看摘要
Abstract:We present MetricTrail, a streaming system for accurate camera motion estimation and dense reconstruction from long monocular videos. To keep inference efficient over long sequences, we revisit DPVO's sparse local estimator. We find that single-image metric depth substantially improves its trajectory accuracy, without retraining the correspondence network or enlarging the optimization window. Metric predictions initialize patch depths and remain as soft constraints during optimization. We further improve correspondence estimation through learned adapters that augment matching features and recurrent context with frozen DINOv3 representations. The correspondence estimator and adapters are trained on diverse short clips without additional long-sequence training. This modular design also allows the depth provider to be independently upgraded and supports supplied camera intrinsics and calibrated stereo observations without retraining. Under the reported RGB-only protocols, MetricTrail achieves the lowest average trajectory error among evaluated methods on KITTI, Oxford Spires, and VBR. Pairing the estimated poses with single-image depth predictions also produces strong dense reconstruction on indoor and outdoor benchmarks and coherent reconstructions of in-the-wild videos. With supplied intrinsics, the system processes KITTI-02 at 12.70 FPS with 3.21 GB peak GPU memory.
99. 【2611.07553】Improving Long-Tail Detection via Layout-Instruction Conditioned Diffusion Synthesis
链接：https://arxiv.org/abs/2611.07553
作者：Xinyu Zhang,Xiaodi Wang,Yanpeng Sun,Lingfeng Yang,Jingdong Wang,Lingqiao Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Synthetic data, scarce rare classes, improve object detection, text-only or layout-only, layout-only inputs
备注： Accepted at the ICME 2026
点击查看摘要
Abstract:Synthetic data from diffusion models can improve object detection, but long-tail performance is still limited by scarce rare classes and inflexible conditioning (e.g., text-only or layout-only inputs). In this paper, we propose Tail-SD, a layout-instruction conditioned stable diffusion framework that supports text, layouts, or their hybrid, enabling controllable synthesis from boxes, masks, and/or prompts to better cover the long-tail objects. To train a single model across heterogeneous conditions, we introduce a multi-task cross-attention module and multi-task embedding tokens, improving generation quality and diversity. Extensive experiments on COCO and LVIS demonstrate that diffusion synthesis with hybrid conditioning consistently benefits detection, e.g., on LVIS val, it achieves +4.89% / +5.68% rare Box/Mask AP, highlighting strong potential for addressing long-tail challenges.
100. 【2611.07551】raining-Free Predictive Spatio-Temporal Token Pruning for Few-Step Autoregressive Video Diffusion
链接：https://arxiv.org/abs/2611.07551
作者：Jia Li,Xurui Peng,Xing Wang,Hayden Kwok-Hay So
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generate videos chunk, diffusion models generate, made efficient video, Few-step autoregressive, video diffusion models
备注： 19 pages, 10 figures, 11 tables, including appendices
点击查看摘要
Abstract:Few-step autoregressive (AR) video diffusion models generate videos chunk by chunk and have made efficient video generation practical. However, further accelerating these models toward real-time generation remains challenging, as few-step distillation leaves little cross-step redundancy for existing training-free caching methods to exploit. We revisit this regime and identify two token-level redundancy patterns: cross-frame redundancy from static content shared across adjacent frames, and cross-step redundancy from tokens that converge early during denoising. Crucially, we find that early clean estimates along the model's own denoising trajectory provide an effective online signal for locating both patterns, requiring no retraining, auxiliary predictor, or reference video. Based on these findings, we propose PreSTP (Predictive Spatio-Temporal Token Pruning), a training-free framework that constructs a unified token-wise redundancy mask from cross-frame similarity and cross-step convergence. Tokens marked as redundant skip subsequent computation under a consistent last-computed-value restoration rule, and a content-adaptive mask reuse strategy further reduces dense probing cost. On 5-second generation, PreSTP achieves 1.52x-3.20x speedups and a better efficiency-fidelity trade-off than coarse-grained caching baselines such as TeaCache and FlowCache. On 30-second generation, it reaches up to 1.96x speedup while improving VBench-Long and suppressing long-horizon drift. Notably, it continues to reduce inference cost even in the extreme one-step regime, where cross-step redundancy vanishes entirely and coarse step-wise caching is no longer applicable.
101. 【2611.07543】OptIMerge: Optimization-Based Merging of Diffusion Models
链接：https://arxiv.org/abs/2611.07543
作者：Viraj Shah,Ashwini Pokle,Peyman Milanfar,Mauricio Delbracio,Hossein Talebi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multiple task-specific models, shared base model, task-specific models fine-tuned, multiple task-specific, shared base
备注：
点击查看摘要
Abstract:The arithmetic merging of weights from multiple task-specific models fine-tuned from a shared base model, commonly known as model souping, has emerged as a popular strategy for multi-task learning without the computational overhead of joint retraining. However, naive scalar weight averaging frequently leads to severe performance degradation when the constituent models learn structurally divergent feature representations, leading to destructive parameter interference. We study this problem in a largely unexplored setting: merging image-to-image (I2I) diffusion models fine-tuned for dense, pixel-accurate tasks such as image restoration. Unlike the large language models (LLMs) and text-to-image (T2I) diffusion models for which most merging methods were developed, I2I experts encode conflicting spatial priors (e.g., anisotropic motion-blur vs. isotropic defocus-blur) in their convolutional filters, where both naive soup and LLM-style element-wise merging introduce visible artifacts. We introduce OptIMerge, a gradient-based optimization framework: instead of relying on heuristic scalars, OptIMerge learns highly expressive, yet parameter-efficient merger coefficients by minimizing a multi-task diffusion loss over a small set of 100-500 images. OptIMerge parameterizes the merge with architecture-aware transformations: for attention layers, a structured low-rank feature alignment with explicit channel biases; for convolutional layers, per-kernel merger coefficients, and a low-rank Cayley transform that aligns channels by orthogonal rotation without distorting the filters. By keeping the experts frozen and optimizing only these lightweight merger parameters (equivalent to 0.4% of the network footprint), OptIMerge achieves simultaneous multi-task capabilities that rival computationally expensive joint training and decisively outperform zero-shot model soups.
102. 【2611.07540】Action-Conditioned VLM Monitoring for Autonomous Vehicle Semantic Anomalies
链接：https://arxiv.org/abs/2611.07540
作者：Daniel Adejumo,Omkar Ankalkope,Kunal Runwal,Aliasghar Arab
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：semantically unusual driving, unusual driving scenes, study action-conditioned monitoring, semantically unusual, unusual driving
备注： 7 pages. Submitted to IEEE ICRA 2027
点击查看摘要
Abstract:We study action-conditioned monitoring of autonomous-vehicle behavior in semantically unusual driving scenes. The target is whether the executed ego action is appropriate for the scene: the same scene can admit both normal and anomalous behavior, so visual unusualness alone does not determine the monitoring label. A Vision-Language Model (VLM) first predicts the scene-required action from an outcome-hidden video window; the monitor then compares that expectation with the realized ego-motion trajectory under an explicit compatibility rule. To study this monitoring task, we contribute a six-field taxonomy of 112 paired scenarios spanning both failure polarities (42 derived from documented incidents), a generated video corpus with estimated trajectories, and an exploratory two-stage monitor on that corpus. On 235 clips from 15 scenario families, the two-stage protocol with a fixed T-2.5 s window obtains 83.0% accuracy and anomaly recall 0.773, versus 74.5% and 0.536 for a single-stage video-only baseline; specificity is 0.880 versus 0.928.
103. 【2611.07513】Concertina: Embodying Manipulation and Cognition in One Diffusion Vision-Language Model
链接：https://arxiv.org/abs/2611.07513
作者：Chengcheng Wang,Wei He,Wenhao Li,Hongguang Li,Kai Han,Jianyuan Guo,Chang Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：policies decouple manipulation, Embodied Vision-Language Model, external action mechanism, vision-language model, policies decouple
备注：
点击查看摘要
Abstract:Most vision-language-action (VLA) policies decouple manipulation from cognition by bolting an external action mechanism onto a vision-language model (VLM)--either quantizing actions into discrete tokens whose errors bear no stable correspondence to physical displacements, or delegating continuous trajectory generation to a separate action expert whose gradients compete with or are blocked from updating the VLM backbone. We argue that manipulation and cognition should instead be embodied in the same model, shifting from a decoupled VLA to an Embodied Vision-Language Model (eVLM). We introduce Concertina, an eVLM that places continuous trajectory representation, blockwise generation, and physical-coordinate supervision directly on the computation and parameter path of a shared diffusion VLM backbone. Each control timestep is encoded as one continuous latent action token in the backbone hidden space, and the shared Transformer reconstructs temporally ordered action blocks via the same corrupt-and-reconstruct operator used for multimodal pretraining. Active action projections account for only 0.21% of parameters in the 4.46B model with zero separate action-generator layers, compared with 16.5%-35.1% dedicated action-expert capacity in representative continuous VLAs. Using our proposed Action Interface Audit, we confirm that cross-time trajectory coupling emerges in the middle and late layers of the shared backbone rather than at the action interfaces. On standard benchmarks, Concertina achieves 98.15% average success on regular LIBERO, 85.9% on the 10,030-task LIBERO-Plus benchmark, and 4.142 average completed chain length on CALVIN ABC-D. Code: this https URL Hugging Face: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
Cite as:
arXiv:2611.07513 [cs.CV]
(or
arXiv:2611.07513v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2611.07513
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
104. 【2611.07512】RLGPA: A Reinforcement Learning-Guided Granularity Planning Attack for Decision-Based Sparse Adversarial Examples
链接：https://arxiv.org/abs/2611.07512
作者：Chao Zhou,Shenghua He,Jiaxin Mo,Qiangguo Yu,Fengchuang Xing
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：victim predicted label, Decision-based sparse attacks, Decision-based sparse, predicted label, victim predicted
备注：
点击查看摘要
Abstract:Decision-based sparse attacks must reduce perturbation support using only the victim's predicted label. The best restoration strategy varies as support contracts: coarse removal works early, while tail states need finer, history-aware tests. We propose RLGPA, an online reinforcement learning method that schedules support-reduction executors and their granularity under a hard query budget. A masked Dueling Double DQN selects among seven stable policy--scale actions; each action produces support-relative restoration groups that are rebuilt after every macro decision. A feasibility-preserving executor commits only adversarial restorations and feeds support gain and query cost back to the planner. Under the matched top-1-label oracle, RLGPA reaches 61\% targeted ASR at sparsity 0.01 on CIFAR-10 (vs. 25\% SparseEvo, 0\% Pointwise), and 75.5\%/73.0\% on ResNet50/ViT at sparsity 0.005 (vs. 29.0\%/15.5\%). A fixed-probe test reduces median \(L_0\) from 165 to 23 after 40 images without any update. State-blind and state-shuffled controls degrade significantly, confirming that the learned policy uses attack state; the main gains come from state-conditioned executor scheduling and dynamic repartition. The source code is publicly available at this https URL.
105. 【2611.07502】Coverage Hides Churn: Auditing and Preserving Conformal Decisions as VLM Label Registries Grow
链接：https://arxiv.org/abs/2611.07502
作者：Jai Kumar Sharma,Peeyush Tapadiya
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Vision-language classifiers, serve keep growing, classifiers can learn, lists they serve, Vision-language
备注： Accepted at WACV 2027. Includes supplementary material
点击查看摘要
Abstract:Vision-language classifiers can learn new labels from text alone, so the label lists they serve keep growing. We show that this growth silently changes conformal decisions about old labels. Common softmax-based conformal scores compare each label with an average over all labels; adding labels changes that average, and with it the score of every old label, even when the model, the image, and the old calibration data stay the same. Recalibrating after the update keeps the coverage guarantee, yet across eleven settings it changes at least one old decision on 53-90% of new images. Coverage cannot reveal this, because it checks only the true label: in five controlled settings that keep the old calibration, so that only the normalizer changes, old-class coverage moves by at most 0.01 while 60-67% of images change. We propose a lifecycle audit that measures these changes alongside coverage and set size, and a simple fix, PrefixCP: each class keeps the label registry that existed when it was added. Its old decisions then never change, each class keeps exact class-conditional coverage under exchangeability, and one prefix scan computes all historical normalizers at once. PrefixCP recovers 40.9-58.5% of the set-size gap between never updating the reference and recalibrating, which gives smaller sets but changes old decisions.
106. 【2611.07498】Degree-Equalized View-Graph Selection under Tight Pair Budgets
链接：https://arxiv.org/abs/2611.07498
作者：Minhyeok Im,Jongseong Brad Choi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：practical pipelines pass, practical pipelines, pipelines pass, pass a budgeted, budgeted subset
备注：
点击查看摘要
Abstract:Fully matching all image pairs in Structure-from-Motion is quadratic in the number of images, so practical pipelines pass a budgeted subset to the final matching and reconstruction backend. One-shot selectors score candidates with image retrieval, cheap geometric probes, or a learned prior and finalize B pairs before full matching. Their priorities do not account for the degree already allocated to each image, which can concentrate edges on a few images. Across nine large 1DSfM internet photo collections at B=2N, the coverage top-B selector leaves 54% of covered images with realized degree at most two. Reconstruction can then fail even when the selected graph is nearly connected and almost fully verified. Our training-free greedy rule, Degree-Equalized Allocation (DEAL), exponentially downweights pairs whose endpoints are already well covered. On these collections, DEAL improves the one-shot selector built on the same prior (from 0.776 to 0.929) and matches the mean registered-image ratio of an SfM-supervised edge prior under the shared backend (0.929 vs 0.930), without training. On the largely saturated 38-scene standard benchmark suite, DEAL gives the highest mean among the evaluated training-free selectors (0.875 vs 0.858 one-shot).
107. 【2611.07481】Compact Motion Embeddings for Feed-forward Unified Human Animation
链接：https://arxiv.org/abs/2611.07481
作者：Seonwook Park,Hyunsoo Cha,Amrita Mazumdar,Shengze Wang,Tianye Li,Hanbyul Joo,Koki Nagano,Shalini De Mello
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Animating a reference, motion, driver motion requires, articulation but excludes, motion embedding
备注： 28 pages, 13 figures, 11 tables
点击查看摘要
Abstract:Animating a reference image with a driver's motion requires a motion representation that captures face, hand, and body articulation but excludes the driver's appearance. Most body animation methods take motion from external pose estimators and render it with many denoising steps; compact learned motion representations mostly cover the face. We present FUHA, a real-time-capable feed-forward transformer that learns a compact motion embedding of the whole human and uses it for face, upper-body, and full-body animation. A Q-Former compresses the driver's features from a frozen visual encoder into this embedding. To disentangle motion from appearance, a novel contrastive loss pulls it toward the motion embedding of the driver's rendered keypoint image and away from that of the same person in another pose. At inference time, FUHA needs no external pose estimators, keypoints, or parametric body models. As a retrieval key, the motion embedding matches body pose better than the learned global embeddings of ten vision encoders. Its same-person retrieval rate is 0.1%, against 9.5% for its own DINOv3 backbone. On our upper-body benchmark, FUHA outperforms all baselines on every self-reenactment metric and on cross-reenactment identity similarity. It is competitive on face and full-body and runs at up to 38.9 FPS at 512x512 on a single RTX 4090.
108. 【2611.07463】FREE-LIVO: Physically Decoupled Yet Tightly Coupled LiDAR-Inertial-Visual Odometry
链接：https://arxiv.org/abs/2611.07463
作者：Reon Tabata,Kenji Koide,Shuji Oishi,Taku Okawara,Mizuho Aoki,Aoki Takanose,Masashi Yokozuka,Jun Miura
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：robust state estimation, integrates complementary LiDAR, achieve robust state, integrates complementary, state estimation
备注：
点击查看摘要
Abstract:LiDAR-Inertial-Visual Odometry (LIVO) integrates complementary LiDAR, camera, and IMU measurements to achieve robust state estimation. However, most existing methods assume a fixed relative pose and accurate time synchronization between sensors. Toward modular and heterogeneous robotic systems, this paper presents FREE-LIVO, a tightly coupled odometry method that requires neither a rigid LiDAR-camera rig nor LiDAR-camera time synchronization. The proposed method uses a pretrained image feature matcher to establish correspondences between a camera image and a dense LiDAR intensity image generated from a single LiDAR scan using a generative model. From the resulting 3D point-to-pixel correspondences, we construct reprojection factors that directly constrain LiDAR and camera poses at different acquisition times. These factors are jointly optimized in a single factor graph together with constraints from point cloud registration, visual feature tracking, and the IMU measurements associated with each sensor. On six sequences from the public M3DGR dataset, FREE-LIVO achieves an average absolute trajectory error (ATE) RMSE of 0.45 m without provided LiDAR-camera extrinsic parameters and exhibits minimal accuracy degradation under time synchronization errors of up to 0.5 s. Furthermore, experiments with the LiDAR and camera mounted on separate robots demonstrate that the method can jointly estimate the trajectories of independently moving sensors.
109. 【2611.07443】VIPA: View-Invariant Projector-Based Adversarial Attack
链接：https://arxiv.org/abs/2611.07443
作者：Jiyu Han,Qingyue Deng,Bingyao Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：produce incorrect predictions, causing deep image, Projector-based adversarial attack, Projector-based adversarial, deep image classifiers
备注： 16 pages, 12 figures
点击查看摘要
Abstract:Projector-based adversarial attack aims to physically manipulate real-world scenes by projecting adversarial patterns, thereby causing deep image classifiers to produce incorrect predictions. However, existing stealthy projector-based adversarial attack methods model the project-and-capture process in a single and static view, limiting their view-invariant capability and practical applicability in dynamic environments. In this paper, we introduce View-Invariant Projector-Based Adversarial Attack (VIPA), a novel method designed to overcome these limitations by achieving both view-invariant and classifier-agnostic adversarial attacks in the physical world. We first leverage a view-invariant projector-camera system simulation method to model the physical interactions between projected patterns and real-world surfaces. To ensure robustness and stealthiness of the attack across different views, VIPA optimizes adversarial projections by aggregating simulated attack losses from multiple views. This joint optimization across diverse views helps maintain robustness regardless of the viewpoints. Finally, the optimized patterns are physically projected into real-world scenes, where they successfully fool various classifiers from different viewpoints, thereby enabling robust and practical view-invariant adversarial attacks. Our experiments in both targeted and untargeted attacks demonstrate that VIPA consistently achieves higher attack success rates than existing methods, while also enhancing stealthiness and ensuring minimal perceptual degradation across all tested views.
110. 【2611.07437】IMUDINO: Self-distilled Foundation Model for Inertial Sensing
链接：https://arxiv.org/abs/2611.07437
作者：Zhoutong Ye,Chengwen Zhang,Zixuan Wang,Xufeng Jian,Zhe He,Qingyang Wan,Xutong Wang,Jiaqi Liu,Mingze Sun,Yu Mei,Chun Yu,Yuanchun Shi
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：human activity recognition, achieve competitive performance, including human activity, tasks including human, inertial sensing
备注： Official repo: [this https URL](https://github.com/Cambrian-yzt/IMUDINO-Release)
点击查看摘要
Abstract:We present IMUDINO, the first foundation model (FM) for inertial sensing to achieve competitive performance across diverse sensing tasks including human activity recognition (HAR), health, motion capture, and odometry. Prior inertial FMs often focus on one subfield of inertial sensing and sometimes underperform state-of-the-art supervised methods (e.g., in HAR), making their scope considerably narrower than FMs for vision and natural language. Moreover, they often require fixed input length and sampling rate, and generalize poorly to unseen sensor locations. To build a general-purpose foundation model for inertial sensing, we adapt the DINO self-supervised learning (SSL) paradigm to inertial data through a set of semantics-preserving motion transformations that simulate variations in motion pattern and sensor setup. For model architecture, we use a plain transformer encoder with frequency-aware positional encoding that natively supports varying input length and sampling rate. This simple setup proved remarkably effective for learning global and dense features generalizable across users, sensor setups, tasks, and, in the case of robot odometry, embodiments. We hope IMUDINO can serve as a backbone for inertial sensing and kickstart the development of general-purpose inertial FMs.
111. 【2611.07431】RiST: Topology-Reinforced Swin Transformer for Medical Image Analysis
链接：https://arxiv.org/abs/2611.07431
作者：Pengfei Gu,Huimin Li,Guangyu Meng,Hao Zheng,Haoteng Tang,Bin Fu,Danny Z. Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：hierarchical Vision Transformers, components and loops, organ boundaries, medical image analysis, connected components
备注：
点击查看摘要
Abstract:Medical images contain topological patterns, such as connected components and loops, at scales ranging from small lesions to organ boundaries. Although hierarchical Vision Transformers have advanced medical image analysis, they do not explicitly incorporate topology throughout their multiscale representations. We propose Topology-Reinforced Swin Transformer (TRiST), a framework that integrates topological information into feature construction, refinement, and attention. First, a Hierarchical Multi-Scale Topology Representation algorithm computes 2D persistent homology (H0 and H1) independently at four native Swin stages, producing descriptors aligned with each stage's token grid rather than downsampling fine-scale topology. Second, a Band-Aware H0/H1 Residual Refinement module uses gated residual networks to process short-, medium-, and long-persistence information separately. Third, a Persistence-Band Progressive Attention Bias converts stage-specific descriptors into learned key-saliency scores that directly modify shifted-window attention logits. We instantiate TRiST as Topo-SwinV2-B for classification and Topo-Swin-UNet for segmentation, preserving the underlying Swin-based backbones. Experiments on five medical image datasets show consistent improvements over Swin-based baselines and competitive performance relative to existing topology-augmented methods.
112. 【2611.07417】MessyNav: Zero-Shot Navigation via Manipulation in Messy Environments
链接：https://arxiv.org/abs/2611.07417
作者：Kenneth Llontop,Cherie Ho,Dylan Zhou,Anuva Banwasi,Priya Sundaresan,Carlota Parés-Morlans,Jeannette Bohg
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：chairs and toys, requiring robots, blocked by everyday, manipulating obstacles, obstacles to clear
备注： CoRL 2026
点击查看摘要
Abstract:Real-world environments are messy, with paths often blocked by everyday objects like chairs and toys, requiring robots to perform interactive navigation by manipulating obstacles to clear a path. Existing methods rely on extensive simulation-based learning or per-scene instructions specifying which objects to avoid or manipulate. They struggle to generalize across novel objects, diverse environments, and varied contexts such as a cart of fragile glassware that should be avoided while an empty one can be pushed. We formalize this problem as open-world interactive navigation and present MessyNav, a zero-shot framework based on vision-language models (VLMs). At its core, MessyNav performs explicit VLM-based affordance reasoning before task planning to decide whether to swipe, pick up, or avoid an object and produce a high-level plan. Evaluated on a mobile manipulator across real-world indoor and outdoor environments, MessyNav improves success rate by 27 percentage points (pp) over the strongest baseline in real-robot trials and achieves statistically significant gains in a larger-scale offline evaluation, without task-specific training.
113. 【2611.07411】Kinematic Hypothesis Context: Embodiment-Conditioned Learned Video Coding for Bandwidth-Limited Robot Policy Uplinks
链接：https://arxiv.org/abs/2611.07411
作者：Yuze Lu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Robots increasingly run, increasingly run large, policies on remote, remote servers, uplink the bottleneck
备注： 15 pages, 12 figures. Preprint; supplementary material and code to be released upon formal publication
点击查看摘要
Abstract:Robots increasingly run large vision-language-action policies on remote servers, making the camera uplink the bottleneck. Existing video codecs spend bits on content the receiver could predict: the robot's own motion. We introduce the kinematic hypothesis context, a zero-rate conditioning signal that both ends build from joint states, the robot model and the camera calibration. Ego-motion homographies, per-link robot reprojections, an end-effector plane and a background memory warp the previous reconstruction into hypotheses that condition a learned video codec. We prove that history-only and global-pose conditioning with a limited receptive field cannot access this information under large motion, and that coding gains become task gains at the policy's success cliff. On LIBERO, the context saves 23.9% bit rate over a capacity-matched history-conditioned codec and 40-56% over x264, x265 and SVT-AV1, and needs 23.2% fewer bits than DCVC-RT at equal policy action deviation; trained to lower rates, it matches DCVC-RT in PSNR. In closed loop at equal rate, OpenVLA-OFT success nearly doubles from 22.8% to 43.1% at 6 kbps (72.6% with lower-rate training, 23.6 points above DCVC-RT), pi_0.5 success rises from 55.5% to 77.4%, and the gain grows under packet loss. The context transfers across three codec hosts and to real robot data.
114. 【2611.07408】PSGAgent: Enhancing MLLMs' Dynamic Visual Perception for Panoptic Scene Graph Generation via Agentic Reasoning
链接：https://arxiv.org/abs/2611.07408
作者：Qingyun Liu,Yuankun Liu,Jiaye Feng,Jie Huang,Zonghong Dai,Haochen Li,Jingkun Wang,Weiping Li,Tong Mo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Panoptic Scene Graph, Scene Graph generation, Graph generation, Large Language Models, Multimodal Large Language
备注： Accepted by ACM Multimedia 2026. 10 pages, 8 figures
点击查看摘要
Abstract:Panoptic Scene Graph generation (PSG) requires holistic yet fine-grained reasoning over complex relations among objects. However, current Multimodal Large Language Models (MLLMs) applied to PSG suffer from a perception bottleneck: they function as static observers limited by fixed-resolution views. As a result, models often overlook critical relations involving small or peripheral objects and struggle to differentiate ambiguous predicates in complex scenes. To address these limitations, we propose PSGAgent, an agentic framework that enhances visual perception for PSG through a think-act-observe loop. PSGAgent allows MLLMs to dynamically refine their visual perception using two tools: a Region Zoom-In Tool for local exploration of small or boundary relations and a Visual Highlight Tool for relation-focused segmentation that filters out irrelevant contextual noise. To optimize decision-making, we construct a two-stage training pipeline. First, we create a high-quality, error-aware Multimodal Chain-of-Thought (M-CoT) dataset that provides robust supervision for cold-start learning. Then, we design a novel hierarchical reward mechanism integrated with Group Sequence Policy Optimization (GSPO) to enable strategic and adaptive tool usage. Extensive experiments on the PSG benchmark show that PSGAgent achieves SOTA performance, demonstrating strong capability in both holistic and fine-grained scene understanding.
115. 【2611.07398】FreePath: Neural Mean Free Path for Image Dehazing
链接：https://arxiv.org/abs/2611.07398
作者：Rongrong Gao,Jingxuan Feng,Wenyu Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Single image dehazing, requires recovering scene, recovering scene radiance, Single image, dehazing requires recovering
备注：
点击查看摘要
Abstract:Single image dehazing requires recovering scene radiance from visual responses that are weakened and veiled by participating media. Existing methods either invert explicit scattering variables, which can be unstable under complex scenes, or learn direct restoration mappings, which often discard the physical organization of haze formation. We present \emph{FreePath}, a neural mean free path framework for image dehazing. Instead of estimating atmospheric parameters, FreePath represents dehazing as feature space path state restoration, inspired by the expected distance a visual response can propagate before interacting with haze. Within a residual encoder and decoder, the Mean Free Path Residual Block learns path and collision fields to guide haze constrained correction, while FreePath State Conservation Integration preserves restored path states during deep feature aggregation. Experiments on paired CDD-11 haze images and real RTTS scenes show that FreePath consistently improves full reference fidelity, no reference perceptual quality, and visual faithfulness over representative dehazing baselines.
116. 【2611.07397】Vis2State: Visual Reasoning through Executable State Abstractions
链接：https://arxiv.org/abs/2611.07397
作者：Sheng Jin,Wentao Liu,Chen Qian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：task-specific rules, visual puzzles requires, requires both accurate, accurate interpretation, evidence and reliable
备注：
点击查看摘要
Abstract:Solving visual puzzles requires both accurate interpretation of visual evidence and reliable computation under task-specific rules. Embedding visual assumptions and task constraints directly in solving code makes the represented problem difficult to inspect and revise independently. We introduce Vis2State, a training-free agentic framework that abstracts visual puzzles into explicit, revisable problem states linking visual inspection and execution. Visual inspection guides state construction and refinement, while generated programs solve the represented problem. The model constructs both the state and the program without predefined puzzle schemas or solving procedures. Inspection and execution feedback allow it to revise the problem representation and solving procedure independently. Vis2State achieves the state-of-the-art performance on four benchmarks. Cross-model evaluation further demonstrates consistent gains. Ablations, error analyses, and fixed-program state interventions further support the effectiveness of the state-centered design. The code will be made publicly available to facilitate future research.
117. 【2611.07392】WeLM-Image: A Unified Image Generation Model towards Visual Intelligence
链接：https://arxiv.org/abs/2611.07392
作者：Canmiao Fu,Chen Li,Guohui Zhang,Hao Lu,Hongyang Wei,Huadong Wu,Huaisong Zhang,Hubery Yin,Liyuan Cui,Qixin Yan,Tong Shao,Xiaoqiang Zhou,Xinhang Leng,Ying Zhang,Zhenhai Liu,Zhipeng Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：unified image foundation, integrates multimodal understanding, image foundation model, multi-reference synthesis, integrates multimodal
备注：
点击查看摘要
Abstract:We present \textbf{WeLM-Image}, a unified image foundation model that integrates multimodal understanding into text-to-image generation, instruction-guided editing, and multi-reference synthesis. Designed for single-GPU deployment in WeChat's large-scale consumer applications, the model processes text, reference images, and target latents as one interleaved sequence. A Mixture-of-Transformers (MoT) backbone combines shared attention with independent understanding and generation parameters to limit optimization interference. Equipping each path with Mixture-of-Experts (MoE) modules provides sparse capacity, with 31.7B stored parameters and approximately 5.4B generation parameters activated per target latent token. A generation-oriented data engine combines a knowledge-grounded visual vocabulary with large-scale visual clustering to balance semantic coverage and editing tasks, while training-time evaluation guides iterative data refinement. Bilingual annotations and verified editing supervision support progressive training up to native 1.5K resolution. We optimize generation and editing separately with rubric- and checklist-based rewards, then consolidate the specialized policies through noise-aware on-policy distillation. In the reported overall comparisons, the 1536-resolution model ranks first among the evaluated open-source models on PRISM-Bench, Qwen-Image-Bench, and UnicBench. MeanFlow-based few-step distillation yields WeLM-Image-Turbo, which generates a $1024\times1024$ image in 4.98\,s on a single NVIDIA H20 GPU using eight guidance-free steps.
118. 【2611.07384】FFMT: Frequency-Factorized Multi-Rate Tokenization for Music-to-Dance Generation
链接：https://arxiv.org/abs/2611.07384
作者：Qirong Guo,Ruijie Li,Zeyan Li,Sicheng Shu,Guanzhi Ding,Weihang Ding
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV)
关键词：Dance motion combines, combines slowly varying, slowly varying body, varying body configurations, rapid local movements
备注：
点击查看摘要
Abstract:Dance motion combines slowly varying body configurations with rapid local movements. We investigate how explicit temporal-frequency decomposition can guide the temporal resolution and codebook capacity of discrete motion representations. We introduce frequency-factorized motion tokenization (FFMT), which separates root-relative motion into a low-frequency choreographic scaffold and a complementary high-frequency residual. FFMT uses a lower token rate and a smaller codebook for the low-frequency component, and a higher token rate and a larger codebook for the high-frequency residual. This representation further induces a plan-then-articulate autoregressive factorization: low-frequency tokens establish coarse choreography, while high-frequency tokens realize local motion details conditioned on the generated plan and music. Experiments on AIST++ and FineDance show strong distributional fidelity while preserving realistic diversity and music--motion synchronization. Ablations consistently support frequency factorization, asymmetric temporal allocation, and low-to-high conditioning.
119. 【2611.07354】MIKU: Material Invariance and Knowledge Unification for PBR Generation
链接：https://arxiv.org/abs/2611.07354
作者：Yajie Bao,Jiaye Fu,Youtian Lin,Shuang Wu,Jiachen Qian,Feihu Zhang,Xun Cao,Yao Yao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：High-quality material generation, High-quality material, physically based rendering, remains challenging, challenging because datasets
备注： The Project Page is: [this https URL](https://github.com/DreamTechAI/MIKU) . The Paper is published in SIGGRAPH Asia 2026 (TOG)
点击查看摘要
Abstract:High-quality material generation for physically based rendering (PBR) remains challenging because datasets and synthesis pipelines lack standardized representations. Differences in material definitions, rendering conventions, and parameterizations lead to unstable and physically implausible results. We propose MIKU, a unified framework for standardized PBR asset representation and physically consistent material generation across diverse 3D content domains. Its core is a unified processing pipeline that standardizes the workflow from data preprocessing to final texture synthesis, maintaining consistent geometry and texture representations. A normalization scheme harmonizes heterogeneous material parameterizations in a common representation space, enabling robust cross-dataset training and inference. Building on this formulation, we train a novel physically aware diffusion model for PBR texture generation within a two-stage multi-view synthesis framework. First, geometry-aware albedo generation synthesizes multi-view albedo maps under explicit geometric guidance to ensure cross-view appearance consistency. Second, metallic-roughness generation uses the diffusion model to predict physically plausible roughness and metallic maps conditioned on the generated albedo and unified representation. Trained end-to-end on standardized data, the model learns to generate materials that respect category-level material priors and semantic part boundaries. By decoupling representation standardization from appearance synthesis, MIKU substantially improves material generation stability and physical consistency. Extensive experiments demonstrate state-of-the-art texture quality and semantic consistency across object parts, advancing automated material generation for 3D content creation.
120. 【2611.07329】Where Do Reported Long-Video QA Gains Come From? A Controlled Audit of Frame Selection, Evidence Injection, and Expert Routing
链接：https://arxiv.org/abs/2611.07329
作者：Shih-Yao Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Long-video question answering, answering model, Long-video question, vision-language model, model
备注：
点击查看摘要
Abstract:Long-video question answering is usually studied as frame selection: which few frames should a vision-language model see? We introduce VideoRouteAudit, a controlled audit that separates this choice from two alternatives, injecting non-visual evidence and routing to another answering model. It holds the backbone, frame budget, decoding, prompt and grader fixed while varying one decision at a time. On the full Video-MME long bucket (n=900, K=8), no tested selector significantly improves over uniform sampling. The largest selection-only estimate is +1.9 pt (95% CI [-1.2,+5.0]) and our cascade is +1.2 pt [-1.7,+4.1]; all are equivalent to uniform within +/-5 pt. The same contrasts are unstable at the n=200 subset scale commonly used: three of four are up to 3.8x larger, one reverses sign, and resampled 200-item subsets reverse the full-bucket effect's sign in 35.8% of draws. The audit also corrects our own first results. The anomaly-domain "+ASR" arms injected no text, so the pooled +4.7 pt gain was selection plus a development prefix. With transcripts, ASR lowers XD-Violence accuracy by 10.0 pt when appended after the question and not at all when placed before it, and lowers UCF-Crime by 13.0 pt either way; on Video-MME, placing it first adds about 4 pt (7 on Qwen2-VL) to uniform sampling and to the cascade alike (post hoc, unadjusted). Swapping the answering model gives the largest contrast (+15.1 pt on MUSIC-AVQA, +33.3 pt on its worst type), but the same audio-visual expert with its soundtrack silenced keeps 92% of the gain (69% with a mismatched soundtrack), so the contrast is mostly a model swap. Code, per-item predictions and scripts that recompute every statistic are available at this https URL.
121. 【2611.07301】ArtiVidRM: Verifiable Artifact-as-Rubric Reward Modeling for Explicit Quality Articulation in Video Generation
链接：https://arxiv.org/abs/2611.07301
作者：Caorui Li,Yangguang Ji,Shuxia Lin,Yu Chen,YiCheng Xiao,Yongliang Wu,Zhenxiang Jiang,Licheng Tang,Deng Li,Zhuxuanzi Wang,Jiahao Sun,Chonghan Liu,Lirian Su,Jay Wu,Xu Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：success depends heavily, success depends, depends heavily, heavily on reliable, reliable reward models
备注：
点击查看摘要
Abstract:Reinforcement learning has become an effective approach for improving video generation, but its success depends heavily on reliable reward models. Existing methods either map videos directly to opaque scalar scores or generate free-form rationales that are not explicitly optimized as the basis of the final judgment. We propose ArtiVidRM, a verifiable, artifact-as-rubrics video reward model that follows an observe-then-score paradigm. It first identifies visible generation artifacts and organizes them into a structured artifact list, then uses these artifacts as explicit rubrics for quality assessment. This intermediate representation grounds each score in concrete video-level evidence, making the reward more interpretable and informative for optimization. We further introduce a multi-reward reinforcement learning strategy to jointly optimize artifact prediction and quality assessment. The reward decomposes into complementary objectives that evaluate artifact prediction quality, including semantic coverage and prediction efficiency, together with a pairwise preference objective that supervises quality ranking through score differences. By jointly optimizing the intermediate artifact representation and the downstream preference prediction, the model learns to produce informative artifact lists while improving the accuracy of video quality assessment. Experiments show that ArtiVidRM achieves state-of-the-art performance on video preference benchmarks, provides effective signals for video diffusion optimization, and enables artifact-guided refinement of closed-source video generators.
122. 【2611.07294】Householder Motion Embedding: Noise Modulation for Motion-Controllable Video Generation
链接：https://arxiv.org/abs/2611.07294
作者：Tao Jun Lin,Jinhong Ni,Ruyi Zha,Yifu Wang,Xibin Song,Pan Ji,Hongdong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved remarkable success, guidance remains challenging, explicit user guidance, user guidance remains, precise motion control
备注： NeurIPS 2026
点击查看摘要
Abstract:Diffusion models for video generation have achieved remarkable success, yet precise motion control under explicit user guidance remains challenging. Recent noise-warping methods introduce temporal correlations by warping the noise according to the user-provided motion signal. However, standard spatial warping generally disrupts the noise's i.i.d. Gaussian structure, requiring distribution correction, such as Jacobian-based correction, but at a substantial computational overhead. We propose Householder Motion Embedding (HME), which encodes the motion signal into the noise through a sequence of Householder reflections that together form an orthogonal transformation applied to each location's channel vector. HME exactly preserves the spatial Gaussian structure within each frame while introducing cross-frame correlations that promote temporally consistent video. HME is agnostic to the network architecture and integrates directly into standard video diffusion fine-tuning pipelines. Experiments on different scenarios show that HME matches or outperforms the state of the art, while achieving a 2.7x speedup over noise warping. These results demonstrate that channel-space Householder transformations offer a principled and efficient alternative to noise warping for motion-controllable video generation.
123. 【2611.07188】MammoSeek: A Mammography Agent with selective zooming for grounded reports
链接：https://arxiv.org/abs/2611.07188
作者：Haoyan Ding,Qian Wang,Lixia Wang,Debiao Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：selectively magnifying suspicious, magnifying suspicious regions, Radiologists read, read a screening, screening mammogram
备注： 5 pages, 2 figures
点击查看摘要
Abstract:Radiologists read a screening mammogram by first forming a global impression of the four views and then selectively magnifying suspicious regions before assigning a BI-RADS assessment. MLLMs, in contrast, see the whole image at a fixed, reduced resolution, which makes sub-millimeter calcifications invisible, and they perform close to chance on mammography. Therefore, we present MammoSeek, a mammography agent that reproduces this reading process. After forming an impression of each breast, the agent performs selective zooming: it decides by itself which detector candidates deserve a closer look and inspects only those on full-resolution views. Guided by a BI-RADS assessment skill, it then assigns a category and generates a localized, lexicon-structured report for each breast; its assessment is combined with image-model scores in a decision layer to decide recall. On an internal (EMBED) and an external (VinDr-Mammo) dataset, \ours reaches exam-level AUCs of 0.824 and 0.818, far above other MLLMs, mammography agent and CNN classifiers. Selective zooming also outperforms both no zooming and forced zooming in localization, structured-report F1 and recall decisions at low cost.
124. 【2611.07176】VINO: Revisiting 3D Representation Learning with Volume Transformers
链接：https://arxiv.org/abs/2611.07176
作者：Adrian Kruse,Kadir Yilmaz,Daan de Geus,Francis Engelmann,Bastian Leibe
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved comparable success, vision foundation models, Self-supervised learning, downstream tasks, comparable success
备注： Project page at: [this http URL](http://vision.rwth-aachen.de/VINO)
点击查看摘要
Abstract:Self-supervised learning has given rise to vision foundation models that learn general-purpose image representations transferable across downstream tasks, yet representation learning for 3D scenes has not achieved comparable success. Motivated by this, we identify key limitations of current 3D representation learning approaches and revisit their core design choices. We first replace the commonly used hierarchical PTv3 backbone with the Volume Transformer, a ViT-like architecture for 3D scenes. We then redesign two core objectives of modern approaches built around student-teacher networks: matching representations across views and predicting masked content from visible context. For the first objective, we separate the roles of teacher and student: the teacher provides clean, consistent targets while the student learns invariance to stronger perturbations. For the second objective, we prevent the student from accessing the masked geometry and instead require it to infer missing representations from visible context only. Finally, we redesign 2D-to-3D knowledge distillation, replacing direct regression of view-dependent image features with view-consistent supervision. Together, these changes form VINO, a framework that learns semantic representations of 3D scenes without labels. VINO substantially improves dense linear probing across indoor and outdoor benchmarks and transfers strongly to out-of-domain settings.
125. 【2611.07148】Perceptual Distortion for Overfitted Video Coding: Sliced Matching in Space, Error Alignment in Time
链接：https://arxiv.org/abs/2611.07148
作者：Tianyi Yang,Ge Gao,Fan Zhang,David Bull
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent works, fixed bitrate, works in neural, increasingly been trading, trading off perceptual
备注： 5 pages, 4 figures; submitted to IEEE ISCAS
点击查看摘要
Abstract:Recent works in neural video coding have increasingly been trading off perceptual quality against reconstruction fidelity at a fixed bitrate. Wasserstein Distortion (WD) offers a principled approach to balancing these objectives by relaxing spatial correspondences in feature matching, enabling lightweight overfitted image codecs to compete with computationally intensive generative decoders. Extending vanilla WD to video, however, presents two challenges: its independent Gaussian approximation limits the expressiveness of feature distribution matching, while unconstrained texture resampling across frames introduces temporal inconsistencies. We address these challenges by distinguishing between the correspondences that can be relaxed and those that must be preserved. Spatially, we introduce a local sliced Wasserstein distortion (SWD) that matches empirical feature distributions through one-dimensional optimal transport, capturing cross-channel dependencies without enforcing exact spatial alignment. Temporally, we employ a novel flow residual that constrains coding errors along motion trajectories, preserving temporal consistency without imposing additional reconstruction fidelity constraints. Evaluated on UVG and HEVC Class B with the overfitted codec COOL-CHIC, our framework achieves BD-rate reductions of 9.2% in DISTS and 3.0% in LPIPS relative to frame-wise WD, averaged over test sequences, while lowering tOF by 10.2% at matched rate.
126. 【2611.07132】A Proxy-Based Method for Measuring Racial Disparities in~Text-to-Image~Generators
链接：https://arxiv.org/abs/2611.07132
作者：Nia Mucher,Ngan Pham,Jason Chin,Aaron Brown,David Evans
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：ground-truth demographic benchmarks, present an automated, bias against ground-truth, Large Turbo, Stable Diffusion
备注：
点击查看摘要
Abstract:We present an automated method for auditing text-to-image generators for representational bias against ground-truth demographic benchmarks. Our approach adapts the racial proxy variables used in U.S. antidiscrimination law to provide a fine-grained comparative analysis of variations in racial representation in generated images. We classify each generated image by race and then compare the model's distribution to publicly available demographic benchmark data to identify patterns of over- and under-representation. We also measure skin tone using CIELAB values and calculate cosine similarity amongst groups of images in order to capture biases that don't show up in demographic comparisons such as differences in image quality across races and skin tones. We report on experiments testing three models (Imagen 4 Fast, Stable Diffusion 3.5 Large Turbo, and Flux Schnell) using three categories of proxies (geographic, occupational, and surname) and 50 variants within each category. We find notable variation across the models as well as by proxy category. For example, Imagen 4 Fast overrepresents white classified images more than the other models tested and produces images with lighter, more homogeneous skin tones. Imagen 4 Fast also had the largest representational disparity for Black demographics among surname and geographical prompts. Stable Diffusion 3.5 Large Turbo produces results that overall diverge most from census data but yield the most diverse range of skin tones. Our method yields a generalizable and legally-grounded auditing tool that surfaces detailed information about model outputs without relying on implicit normative definitions of fairness.
127. 【2611.07081】Wide View Synthesis from Overlapping Perspective Cameras in Autonomous Driving
链接：https://arxiv.org/abs/2611.07081
作者：Kaixuan Zhang,Zhipeng Xiong,Minxian Li,Mingwu Ren,Xiatian Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：provide broad visual, broad visual coverage, spatially separated observations, systems are widely, Gaussian Splatting
备注：
点击查看摘要
Abstract:Multi-perspective-camera systems are widely adopted since they provide broad visual coverage for autonomous driving, motivating the synthesis of a unified wide view from spatially separated observations. In this work, we formulate wide view synthesis (WVS), which aims to synthesize a geometrically consistent wide view at a specified virtual viewpoint from multiple perspective cameras. Unlike conventional image stitching, WVS requires reasoning about 3D geometry and visibility to handle depth-dependent parallax and occlusions arising from spatially separated camera centers. While vanilla 3D Gaussian Splatting (3DGS) enables high-fidelity view synthesis, its reliance on per-scene optimization limits its applicability to driving scenes. Furthermore, WVS introduces additional challenges, *e.g.*, peripheral stretching under perspective projection and photometric inconsistencies across cameras. To address these challenges, we propose **Wide-View Gaussian Splatting (WV-GS)**, a feed-forward Gaussian-splatting framework that synthesizes wide views without per-scene optimization. Specifically, we introduce Piecewise Perspective Rendering (PPR) to mitigate peripheral stretching through local perspective projections sharing a common camera center, and Spatial Affine Photometric Modeling (SAPM) to account for camera-dependent photometric variations during training. We further introduce **WideDrive**, a synthetic benchmark providing dense ground-truth wide views and adapt a LiDAR-projected sparse-reference protocol to real-world datasets. Extensive experiments on multiple datasets demonstrate the effectiveness of WV-GS for WVS. Dataset and code will be publicly released.
128. 【2611.07063】SD-LoRA: Training-Time Structural Distillation into LoRA for Few-Shot Vision-Language Adaptation
链接：https://arxiv.org/abs/2611.07063
作者：Mohammed Rahman Sherif Khan Mohammad,Ardhendu Behera,Sandip Pradhan,Swagat Kumar,Yonghuai Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：learning fine-grained visual, fine-grained visual distinctions, makes frozen CLIP-like, CLIP-like models attractive, frozen CLIP-like models
备注： Accepted in NeurIPS 2026
点击查看摘要
Abstract:Few-shot adaptation of vision-language models must balance two competing goals: learning fine-grained visual distinctions from very limited supervision and preserving the efficiency that makes frozen CLIP-like models attractive for deployment. Existing lightweight adaptation methods, including prompt tuning, LoRA, and cache-based adapters, typically supervise global image embeddings and therefore underuse token-level structure. Conversely, structure-aware methods exploit local evidence but often introduce additional inference-time computation. We propose SD-LoRA, a structural distillation framework that uses token-level graph reasoning only during training and transfers its effects into a lightweight LoRA-adapted CLIP model. During training, a heterogeneous graph teacher models patch-patch, global-local, and visual-text relations over high-resolution ViT tokens. Rather than retaining this graph at test time, SD-LoRA transfers its structural bias into the shared CLIP-LoRA backbone through implicit distillation and Prototype Predictive Alignment, which aligns graph-conditioned representations with support-derived class prototypes. At inference, the graph teacher is discarded; prediction requires only a single CLIP-LoRA forward pass and a cache-based classifier. Across 11 few-shot benchmarks, SD-LoRA improves over a strong CLIP-LoRA baseline by 2.4/1.8/3.0/2.4/2.0 percentage points in the 1/2/4/8/16-shot settings, respectively, without additional graph computation at test time. Results on base-to-novel generalization, cross-dataset transfer, out-of-distribution robustness, and calibration further show that training-time structural supervision improves both accuracy and transfer reliability. Code is available at this https URL.
129. 【2611.07061】Segment What It Can Draw: Querying a Text-to-Image Generator with Its Own Images for Skin Lesion Segmentation
链接：https://arxiv.org/abs/2611.07061
作者：Hongyu Cao,Guangfu Guo,Jinghan Zhang,Dakshak Keerthi Chandra,Ying Zhang,Kunpeng Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：annotated masks requires, segmentation without annotated, annotated masks, masks requires, Skin lesion segmentation
备注：
点击查看摘要
Abstract:Skin lesion segmentation without annotated masks requires the target to be specified through other cues. Existing approaches rely on dermoscopy-specific rules, annotation-derived model priors, or user-selected regions. A general text-to-image diffusion transformer offers a text interface to the target, but its concept-word attention is unreliable on dermoscopy images: in the model's attention-output space, the word-derived skin-to-lesion direction is poorly aligned with the direction separating real skin from real lesions. We show that the direction derived from generated healthy-skin and lesion images is substantially better aligned. Based on this finding, we propose GENIQ, a training-free method that constructs initial skin and lesion prototypes from generated images and refines them using the most skin-like and lesion-like patches from unlabelled dermoscopy images. It scores test patches along the refined direction and applies a gated threshold to suppress contextual spill-over around small lesions. Without inference-time annotations or additional models, GENIQ achieves Dice scores of 0.85-0.88 on three dermoscopy test sets. It outperforms zero-shot and word-based attention methods on all three sets, and a hand-designed dermoscopy pipeline in Dice and IoU on two.
130. 【2611.07055】Expanding the Quality-Coverage Frontier with Competitive Flow Matching
链接：https://arxiv.org/abs/2611.07055
作者：Wenxuan Peng,Richard Zhang,Haitian Zheng,Jaskirat Singh,Tsai-Shien Chen,Eli Shechtman,Bharath Hariharan,Hadar Averbuch-Elor,Zongze Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Flow matching, generators often face, Flow, quality-coverage tradeoff, Recall point
备注： 40 pages, 24 figures. Project page: [this https URL](https://lilydaytoy.github.io/CFM/)
点击查看摘要
Abstract:Flow matching (FM) generators often face a quality-coverage tradeoff. Inference-time techniques such as classifier-free guidance raise quality, but at the cost of coverage. We hypothesize this limitation stems from a basic property of the objective: an intermediate noisy image could correspond to many clean images, yet the model can only predict a single velocity, at best averaging over the multiple possibilities. To mitigate this, we introduce competition among predictions during training. We achieve this by augmenting the predictor with a randomly drawn low-dimensional conditioning code $z$. For each training example, we sample $K$ values of $z$ to produce $K$ candidate velocities that compete to explain the target, and apply the loss only to the best-matching candidate. This winner-take-all objective allows different modes to shape different predictions, rather than being averaged into a single compromise. Furthermore, this term naturally enables a new form of guidance, auxiliary conditioning scaling, which complements traditional guidance methods. Together, these two guidance mechanisms show that our method substantially improves the quality-coverage frontier. We validate on ImageNet-256, using two different testbeds, SiT and RAEv2. Given less than 3% of the original SiT pretraining compute for post-training, at the 67% Recall point, our method reduces $\mathrm{FD}_{r,6}$ from 19.22 to 5.91. On RAEv2, at the 70% Recall point, it reduces $\mathrm{FD}_{r,6}$ from 16.83 to 3.18.
131. 【2611.07049】Gaussians Can Subtract: Neural Dissolve Fields for Hybrid Scene Rendering
链接：https://arxiv.org/abs/2611.07049
作者：Yiyan Wang,Haohan Liu,Tetsuo Shibuya
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：combines compact textured, compact textured surfaces, rendering combines compact, surfaces with flexible, offering an efficient
备注： Accepted to WACV 2027. 16 pages including supplementary material, 11 figures, 8 tables. Project page: [this https URL](https://ooosn.github.io/gaussians-can-subtract/)
点击查看摘要
Abstract:Hybrid Mesh-Gaussian rendering combines compact textured surfaces with flexible 3D Gaussian primitives, offering an efficient alternative to purely Gaussian scene representations for structured environments. Existing scene-reconstruction hybrids commonly follow an additive formulation, where Gaussian residuals compensate for errors left by the mesh. However, not every Mesh-Gaussian conflict is caused by missing content: residual geometry errors, occlusion mismatch, texture-projection artifacts, and view-dependent appearance can make the same mesh content consistent in one view but inconsistent in another. We therefore formulate hybrid rendering as a multi-view inconsistency problem and present Gaussolve, a subtract-and-refill framework that selectively dissolves inconsistent mesh content before residual Gaussians refill the revealed regions. We introduce a lightweight Neural Dissolve Field, parameterized by scalar spherical-harmonic Gaussians, to learn where and from which viewing directions mesh content should be dissolved. A continuous transmittance fusion rule progressively exposes residual Gaussians behind the dissolved mesh, preserving their reconstruction gradients and avoiding hard visibility discontinuities. Experiments on structured and semi-structured scenes demonstrate higher visual fidelity with fewer Gaussian primitives and faster rendering. Project page: this https URL
132. 【2611.07009】raCE: Trajectory-Aware Concepts for Explainable Video Understanding
链接：https://arxiv.org/abs/2611.07009
作者：Wooil Lee,Junpyo Hong,Jongseo Lee,Tuomas Oikarinen,Tsui-Wei Weng,Jinwoo Choi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Explainable Video Understanding, existing video XAI, Video understanding, explanations can obscure, Video understanding models
备注： Accepted to NeurIPS 2026. Project page: [this https URL](https://leewooil.github.io/TraCE_project_page/)
点击查看摘要
Abstract:Video understanding models often rely on motion, yet their explanations can obscure which motion sources support a prediction. We identify motion-source under-specification as a limitation of existing video XAI: region-centric explanations can be source-ambiguous, while motion vocabularies restricted to single-person pose sequences are source-incomplete. We propose TraCE (Trajectory-Aware Concepts for Explainable Video Understanding), a concept-based framework that discovers source-flexible motion concepts by clustering optical-flow trajectories from training videos. These concepts represent dynamic evidence from people, objects, and interactions, while object and scene concepts account for static context. The resulting typed trajectory/object/scene interface supports class prediction for action recognition and question-conditioned concept matching for video question answering (VQA). We evaluate TraCE across five random seeds on six benchmarks: NTU RGB+D Mutual, Chiral SSv2, UCF-101, KTH, TOMATO, and STAR. Relative to non-interpretable baselines, TraCE maintains competitive task performance, with an average accuracy drop of 1.0 points for action recognition and a nominal gain of 0.4 points for VQA. Motion perturbation and concept-removal tests provide complementary evidence of directional semantic alignment and decision faithfulness, while sample-level interventions illustrate targeted model debugging. Our project page is available at this https URL.
133. 【2611.06993】Batch-Conditioned Semantic Anchors for Robust Transductive Adaptation of Vision--Language Models
链接：https://arxiv.org/abs/2611.06993
作者：Mohammed Rahman Sherif Khan Mohammad,Ardhendu Behera,Sandip Pradhan,Swagat Kumar,Amr Ahmed
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：improves vision-language models, current methods face, adaptation improves vision-language, key trade-off, transductive VLM adaptation
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Transductive adaptation improves vision-language models at test time by refining predictions on an unlabeled batch, but current methods face a key trade-off. Aggressive approaches exploit batch structure but can drift when batches are sparse, have prior shift, or cover little of the label space. Conservative methods better preserve CLIP text semantics, but fixed semantic references can under-adapt even when the batch provides strong corrective evidence. We propose JPTA (Joint Prior and Transport Adaptation), a prior-aware framework that casts transductive VLM adaptation as batch-conditioned semantic reference estimation. Instead of treating CLIP text prototypes as fixed priors or freely replaceable, JPTA views them as semantic references that shift toward image-side batch structure only under calibrated evidence. It estimates batch priors and soft image-side prototypes to form transported semantic references whose impact is scaled by batch reliability. Across standard benchmarks, low effective-class regimes, all-class evaluation, and online streams, JPTA consistently outperforms TransCLIP and StatA, with the largest gains on sparse and prior-shifted batches. Anchor-drift, active-support, and absent-class-mass diagnostics show that JPTA fixes effective-class mismatch without unconstrained transductive drift, indicating that robust transductive VLM adaptation should recalibrate semantic references using reliable batch evidence rather than choose between unrestricted transduction and fixed prototypes. Code is available at this https URL.
134. 【2611.06974】$^2$-Splat: Adaptive Topology Mesh Splatting with Texture Residuals
链接：https://arxiv.org/abs/2611.06974
作者：Zhihao Tang,Youjia Zhang,Mingbo Zhao,Wei Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Triangle-based splatting connects, conventional graphics pipelines, Triangle-based splatting, requires excessive tessellation, preserve appearance details
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Triangle-based splatting connects novel view synthesis with conventional graphics pipelines, but often requires excessive tessellation to preserve appearance details. We present T$^2$-Splat, which decouples topology adaptation from appearance refinement. Safe Restricted Delaunay Triangulation (Safe RDT) initializes mesh connectivity. Dynamic Topology Evolution (DTE) then adapts triangle allocation through edge collapse and vertex split operations. Residual per-face Mip-textures then refine appearance on the fixed mesh using scale-adaptive filtering. Experiments on Mip-NeRF 360, Tanks Temples, and DTU demonstrate competitive results with compact meshes. T$^2$-Splat improves PSNR by 0.71dB over MeshSplatting on Mip-NeRF 360. Additional compression experiments demonstrate flexible control of mesh complexity, supporting face budgets as low as 10% of the original face count. Project page: this https URL.
135. 【2611.06255】Learning Noise Optimization for Reward Alignment in Few-Step Generative Models
链接：https://arxiv.org/abs/2611.06255
作者：Hongeun Kim,Jeongsol Kim,Jong Chul Ye
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：flow-based generative models, alignment for diffusion, stochastic trajectories, Initial noise optimization, flow-based generative
备注：
点击查看摘要
Abstract:Reward alignment for diffusion- and flow-based generative models is often formulated over stochastic trajectories, making it less suitable for few-step deterministic generators. Initial noise optimization provides a trajectory-free alternative, but existing gradient-free methods require costly per-sample search at inference. We introduce LeNO (Learning Noise Optimization), which amortizes reward-guided initial noise optimization into a learned residual transport while keeping the pretrained generator frozen. LeNO learns an anchor-conditioned distribution over noise corrections using Local GRPO and scalar rewards, eliminating iterative test-time optimization. For Gaussian initial noise with norm-preserving projection, we derive a tractable upper bound on the KL divergence between the corrected noise distribution and the original prior, providing a principled regularization objective. We evaluate LeNO on few-step text-to-image and protein structure generation, including expensive black-box designability rewards. Across both domains, LeNO improves target rewards with a single noise correction at inference while largely preserving generation quality and diversity.
136. 【2611.08359】A Theoretical Analysis of a Bilevel Optimization Formulation for Combined Local-Global Optical Flow Models
链接：https://arxiv.org/abs/2611.08359
作者：El Mostafa Kalmoun
类目：Optimization and Control (math.OC); Computer Vision and Pattern Recognition (cs.CV)
关键词：optical flow models, combined local-global, paper analyzes, analyzes a bilevel, bilevel formulation
备注： 31 pages, 5 figures. Submitted to the Journal of Mathematical Imaging and Vision. Python code in the ancillary files
点击查看摘要
Abstract:This paper analyzes a bilevel formulation for learning the regularization parameter of combined local-global (CLG) optical flow models. The lower-level problem computes the flow from a Lucas--Kanade data term and a quadratic or total variation (TV) regularizer, and the upper-level problem selects the parameter that minimizes the squared distance to a ground-truth flow. The setting is finite-dimensional, and a full-rank assumption makes the lower-level solution unique. For the quadratic model we derive sufficient conditions for the existence of an optimal parameter, for every optimal parameter to be positive, and for strict local optimality. For TV regularization an optimal parameter always exists, because the lower-level solution vanishes for large parameters, and we give a sufficient condition for positivity that accounts for the coupling of the two flow components through the local structure tensors. Synthetic examples illustrate the conditions, including cases in which they fail.
137. 【2611.06935】An Evolutionary Hypothesis for White's Illusion: Constant Percentage Correction and Modern Individual Variation
链接：https://arxiv.org/abs/2611.06935
作者：Bekir Tevfik Akgün,Ergun Akleman
类目：Neurons and Cognition (q-bio.NC); Computer Vision and Pattern Recognition (cs.CV)
关键词：striking demonstration, demonstration of context-dependent, context-dependent brightness, White illusion, producing approximately constant
备注： 12 pages and 7 figures. We may later send a shorter version to a conference
点击查看摘要
Abstract:White's illusion is a striking demonstration of context-dependent brightness and lightness perception. In earlier work, we developed a forward translucency-based formula capable of producing approximately constant perceived appearance across varying backgrounds. While validating that formulation, we observed a notable population-level pattern: individuals selected slightly different correction percentages for "constant perception," while the population average remained remarkably stable across experiments. In this paper, we propose an evolutionary hypothesis for this phenomenon. We suggest that a simple constant-percentage correction function could have emerged as an adaptive mechanism for maintaining useful material and reflectance judgments under variable illumination. Under this interpretation, the stability of the population mean may reflect a conserved perceptual mechanism, whereas individual differences may reflect learning, adaptation, or variation around a shared computational response. Using a modification of our previously published forward model, we show that White's illusion can be reproduced by applying a constant-percentage correction to background luminance. The model therefore provides a compact computational account of the observed population-level regularity and motivates a testable evolutionary interpretation of individual variation in contextual lightness judgments.
138. 【2611.06930】Category differences in similarity between fixation density maps and psychological potential fields for sketches
链接：https://arxiv.org/abs/2611.06930
作者：Naoyuki Awano,Yuki Hayashi
类目：Neurons and Cognition (q-bio.NC); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：humans can instantaneously, instantaneously recognize, similarity, AUC, baseline-adjusted AUC
备注：
点击查看摘要
Abstract:When an object comes into view, humans can instantaneously recognize it if known to them. However, assessing how this recognition takes place remains challenging. A few studies using simple sketches have reported varying degrees of image similarity between the fixation density map (FDM), which visualizes eye movements and durations, and the psychological potential field (PPF), which visualizes part of the visual cognition process, depending on the object category. This study reports how the similarity behaves across three categories---animal, non-animal, and meaningless shape---and under rotated presentation, which is known to increase cognitive load during object recognition. The similarity was quantified through area under the curve (AUC) measures, including a baseline-adjusted AUC that isolates the early rise in similarity from stimulus-dependent baseline levels. A variability score was introduced to assess individual differences, and linear mixed models were used to evaluate category and orientation effects. Results indicated that the baseline-adjusted AUC yielded significant differences among all three categories with large effect sizes, whereas the raw AUC did not distinguish between the animal and non-animal categories due to the influence of sketch representation. No significant Category $\times$ Orientation interaction was observed, indicating that rotated presentation did not produce a category-specific effect. The meaningless shape stimuli yielded consistently low similarity and variability scores, clearly separating them from the two meaningful object categories. These results characterize the behavior of the FDM--PPF similarity under free viewing and indicate that baseline adjustment is necessary to separate category-related variation from stimulus-dependent baseline levels.
