本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表,以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新862篇论文,其中:

  • 自然语言处理103篇
  • 信息检索20篇
  • 计算机视觉208篇

自然语言处理

1. 【2611.23229】Ambient LLMs: Data-Efficient Supervised Fine-tuning via Temperature Matching

链接:https://arxiv.org/abs/2611.23229

作者:Giannis Daras,Marios Papachristou,Adam Klivans,Antonio Torralba,Constantinos Daskalakis

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Collecting large-scale, autoregressive language models, high-quality post-training datasets, autoregressive language, introduce Ambient SFT

备注: Work in progress

点击查看摘要

Abstract:Collecting large-scale, diverse, and high-quality post-training datasets for autoregressive language models is challenging. Consequently, Supervised Fine-Tuning (SFT) is typically applied to datasets significantly smaller than those used for pre-training, which leads to overfitting and the catastrophic forgetting of the tails of the data distribution. To prevent this collapse, we introduce Ambient SFT, a principled framework for leveraging imperfect predictions to augment the fine-tuning set. In our method, a "frozen" version of the pre-trained model serves as a noisy teacher that the fine-tuned model must match at a coarse level. In particular, we require that the high-temperature versions of the conditional distributions produced by the post-training model should match the high-temperature versions of the pre-training ones. The temperature hyperparameter controls the level of trust in the pre-trained model, with the limit $T\to \infty$ reverting back to regular SFT and $T=1$ to knowledge distillation. We demonstrate that our approach outperforms standard SFT across domain adaptation, instruction-tuning, and reasoning, leading for up to $21\%$ average relative improvement to standard SFT.

2. 【2611.23218】What Does a Bias Head Measure? Non-Identifiability in Head-Level Bias Attribution

链接:https://arxiv.org/abs/2611.23218

作者:S.M Seefat Alam

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:individual attention heads, localise social bias, large language models, heads measures bias, localise social

备注: 18 pages, 13 tables. Under review at ACL Rolling Review (October 2026 cycle)

点击查看摘要

Abstract:Methods that localise social bias in large language models to individual attention heads and remove it by ablation are validated by their effect on a fairness metric, never by evidence that the statistic selecting the heads measures bias. We audit this on Qwen-2.5-7B-Instruct and Llama-3.1-8B-Instruct. The head map correlates at $\rho = -0.950$ and $-0.768$ with a label-blind response-length map, apparently identifying a surface confound. An intervention that breaks the length-label coupling rejects this reading: with the prompt held fixed, response length explains 1% of the statistic's variance. What does explain it is prompt identity, at 64% of variance, in an ordering that is not monotonic in length. Within any fixed prompt the fairness label, response length and the presence of a protected-group token are collinear at $\phi = 0.95$, partly by definition of the labelling rule, so no observational analysis can attribute the map to any of them, and no method in this family performs an experiment that could. The substantive claims fail independently: bias selectivity is not late-layer-concentrated on either model under either reference reading, and no head set we tested reduces the unfairness rate when ablated. Its complement, scored on the opposite label, reliably destroys refusal behaviour ($p = 2.7\times10^{-5}$), demonstrating that the pipeline detects effects at this scale.

3. 【2611.23197】Structure--Residual Inductive Biases for Language Model Pretraining

链接:https://arxiv.org/abs/2611.23197

作者:Hai Huang,Bartosz Żuk,Rassul Magauin,Jiaxin Huang,Xue Liu

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:behavior and internal, BBC, structure, representation, Bottleneck Concept

备注:

点击查看摘要

Abstract:Next-token prediction is relied upon to learn both predictive behavior and internal representations. We ask whether representation structure itself should be an explicit inductive bias. Motivated by the two-part coding view of Kolmogorov complexity, we study a structure--residual principle in which a representation separates structure from realization detail. We instantiate this principle in two complementary ways. Boundary Bottleneck Concept (BBC) routes information from token segments through boundary carriers while preserving local autoregressive computation. Continuous Concept (CC) regularizes representation geometry and induces a spectral decomposition into low-frequency structure and high-frequency residual. We derive coding bounds for both views and show that multiplicity-corrected boundary attention becomes exact as the within-segment path energy vanishes. Empirically, BBC and CC exhibit strikingly different depth preferences: BBC works best in early layers, whereas CC is most effective in later layers. At 300M training tokens, combining BBC and CC improves NLL by 1.44\% on GPT-2 Medium. These gains persist with training runs up to 20B tokens. Representation diagnostics show that BBC increases the relative predictive importance of boundary states, while CC reduces spectral residual energy. Together, these results suggest that structure--residual biases can improve language-model pretraining beyond next-token prediction. Code: this https URL

4. 【2611.23185】Polarity Composition Hypothesis: Causal Evidence from Negation in NLI

链接:https://arxiv.org/abs/2611.23185

作者:Nhi Hoai Doan,Tatsuya Hiraoka,Munachiso Samuel Nwadike,Kentaro Inui

类目:Computation and Language (cs.CL)

关键词:natural language inference, language models process, Polarity Composition Hypothesis, language inference, natural language

备注: Accepted to EACL 2027 (main conference)

点击查看摘要

Abstract:We investigate how language models process negation in natural language inference (NLI). We propose the \textit{Polarity Composition Hypothesis}, a high-level causal model of this computation. Behavioral evaluations show that language-model predictions largely conform to the proposed hypothesis. Using Distributed Alignment Search, we identify causally effective subspaces aligned with the variables in the polarity-composition hypothesis. These representations transfer across negation forms and partially to a subset of MNLI. We release the dataset and code.

5. 【2611.23158】MoE--LoRA Methods for Multilingual Adaptation: A Systematic Empirical Study

链接:https://arxiv.org/abs/2611.23158

作者:Nikit Srivastava,Joel Dag,René Speck,Axel-Cyrille Ngonga Ngomo

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Routed low-rank adapters, low-rank adapters offer, Routed low-rank, adapters offer, offer a parameter-efficient

备注: To Appear - EACL 2027 (Findings)

点击查看摘要

Abstract:Routed low-rank adapters offer a parameter-efficient means to improve the performance of large language models (LLMs) across tasks. Hence, it is assumed that they can also be used to improve the support of low-resource languages in LLMs, which currently serve English far better than the thousands of other languages spoken worldwide. However, this assumption has never been verified empirically under a shared multilingual evaluation protocol. We address exactly this gap by comparing eight low-rank adaptation (LoRA) methods on a frozen base model using 200 unique languages in more than 9{,}000 evaluation settings. Our results suggest that a reduced-scale search can identify viable configurations of LoRA methods but does not reliably predict their relative performance, as the top-ranking configuration is never best at scale. LoRA reliably improves language-model fit on translation data, consistently degrades reading comprehension, and benefits low-resource languages most. These findings suggest that LoRA methods should be regarded as targeted tools rather than general-purpose means for improving the multilingual capabilities of LLMs.

6. 【2611.23155】xtSphere: Efficient Text-to-Image Generation via Shared Hyperspherical Alignment and Uniformity

链接:https://arxiv.org/abs/2611.23155

作者:Yixia Zhang,Girish A. Koushik,Xilu Wang,Wenwu Wang

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:require multiple inference, multiple inference steps, Recent advances, Sphere Encoder, Sphere Encoder offers

备注: 21 pages, 8 figures

点击查看摘要

Abstract:Recent advances in text-to-image generation have substantially improved image quality, particularly through diffusion-based methods that require multiple inference steps. In contrast, Sphere Encoder offers an efficient generative framework capable of producing images with fewer forward steps. However, extending it to free-form text is nontrivial, because its class-conditioned design lacks cross-modal alignment. To address this challenge, we propose TextSphere, an efficient text-to-image generative framework that extends Sphere Encoder with language conditioning and cross-modal alignment. We incorporate pretrained CLIP text embeddings through adaptive layer normalization (AdaLN) to guide image generation while retaining the original spherical sampling mechanism. To bridge the cross-modal representation gap, we introduce a Spherical Semantic Alignment and Uniformity (SSAU) objective that jointly promotes semantic alignment and representation uniformity on the hypersphere. Experiments on CUB-200-2011, MS-COCO-2014, and Flickr30k demonstrate that TextSphere consistently reduces generation FID (gFID) over the text-conditioned baseline while achieving reconstruction FID (rFID) below 1.0. With only 4 and 6 sampling steps, TextSphere achieves lower gFID than the compared diffusion- and GAN-based models trained from scratch on CUB-200-2011 and MS-COCO-2014, respectively. We further observe that improved reconstruction fidelity does not necessarily yield better generation quality. In addition, we use Partial Least Squares Singular Value Decomposition (PLS-SVD) to analyze cross-modal alignment and modality gap, offering insight into the effectiveness of our approach.

7. 【2611.23142】Mind the Gap: A Deployed Multi-Agent System for Documentation Maintenance

链接:https://arxiv.org/abs/2611.23142

作者:Lorenzo Masoero

类目:oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:deliver software features, unprecedented velocity, enabled teams, technology industry, industry to deliver

备注: Accepted at IAAI-27 (Innovative Applications of AI, co-located with AAAI 2027), Emerging Applications track. 12 pages (6 pages + references and appendix), 2 figures, 6 tables

点击查看摘要

Abstract:The "AI revolution" has enabled teams across the technology industry to deliver software features at unprecedented velocity. While code evolves faster than ever, customer-facing documentation often struggles to stay up to speed. As users increasingly rely on LLM-based agents that consume documentation as their primary interface, the impact of this documentation gap worsens: stale information propagates and is treated as authoritative. Signals for identifying where documentation has fallen behind already exist in abundance, both explicit (e.g., resolved support tickets revealing what documentation lacks) and implicit (e.g., code-documentation discrepancies detectable from automated loops). We deploy a multi-agent system, built around a triage agent we call "TriAgent," that continuously extracts these signals and repairs documentation drift. Over 43 days of shadow-mode operation, our system triaged 499 tickets and surfaced 92 gaps in the documentation. Using a panel of LLM judges from independent model families, 81.1% of TriAgent's verifiable assertions were correct (245 of the 302 assertions the human resolution addresses; majority of three judges); on length-comparable pairs the panel preferred TriAgent's response in 70.5% of pairs and the human engineer's in 23.2% (the rest had no judge majority). Importantly, agent- and human-sourced replies tended to be complementary, with the human often surfacing insights that were either buried within the existing documentation or missing from it entirely; our system turns each such insight into a documentation gap and, after human review, a fix. Repairing a gap measurably improved the agent's later answer: when the agent re-answered the same ticket after the repair, blinded judges preferred the post-repair answer over its own pre-repair answer 71.4% of the time (n=35). A blinded human audit confirms strong alignment on self-improvement.

8. 【2611.23127】he Illusion of Grounding: Do Vision-Language Models Weigh Retrieved Text and Images Like an Ideal Observer?

链接:https://arxiv.org/abs/2611.23127

作者:Basavaraj R M,Harshal Chandel

类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词:Retrieval-augmented vision-language models, Retrieval-augmented vision-language, wrong or noisy, Knowledge Inertia, Visual Genome

备注: 10 pages, 5 figures, 11 tables. Code and data: [this https URL](https://github.com/Basavarajearlybird/GIB-200K) (archived at [this https URL](https://doi.org/10.5281/zenodo.24320174) )

点击查看摘要

Abstract:Retrieval-augmented vision-language models (VLMs) answer from two sources of evidence that can each fail: the retrieved text can be wrong or noisy, and the image can be degraded or contradicted. We introduce GIB-200K, 200,000 image-question items built from COCO and Visual Genome, each expanded into controlled stress conditions: hard-negative retrieval noise (1-20 documents), visual ambiguity (Gaussian and motion blur, low-resource crops) and cross-modal conflict with counterfactual flip pairs. Instead of only measuring degradation, we ask how models combine the two modalities. From ideal Bayesian cue combination we derive a testable prediction that yields formal definitions of Knowledge Inertia (text over-weighted relative to the model's own image evidence) and Sensory Capture (the reverse), and we estimate the weights with a measurement-error-corrected regression whose recovery of known weights we verify. A counterfactual flip decomposition separates modality bias from concept priors, and a Grounding Illusion Score measures how much clean accuracy is not grounded in the image. We evaluate 4 open models on one frozen, seeded evaluation split of 2,000 GIB-200K items. All models are accurate on clean inputs (92.5%-94.2%) but adverse accuracy falls to 41.3%-59.9%. The two LLaVA models over-weight the text (Knowledge Inertia, w_T/w_I = 1.229 and 1.322), whereas InternVL3 favours the image (w_T/w_I = 0.680); between 34.8% and 71.4% of the clean answers that are correct are abandoned when the document lies. A training-free consistency check that compares the answer with and without retrieval trades coverage for accuracy under misleading documents, while falling back to the image fails when the image is heavily degraded. All per-instance outputs, code, and an audit that recomputes every reported open-model number are released.

9. 【2611.23119】Dynamic Task Allocation with Dialogue

链接:https://arxiv.org/abs/2611.23119

作者:Matthew Groholski,Weiwei Gu,Nakul Gopalan

类目:Computation and Language (cs.CL)

关键词:Effective multi-agent collaboration, Effective multi-agent, multi-agent collaboration requires, responsibilities evolve, Effective

备注: 9 pages, 6 figures, Accepted at Human-Robot Dialogue(HRD) Workshop at IROS 2026

点击查看摘要

Abstract:Effective multi-agent collaboration requires agents to adapt task allocation as goals and responsibilities evolve. Prior task-allocation frameworks often assume static goals, full observability, or rely on large language models (LLMs) without explicit, verifiable beliefs about task allocation or intent. These assumptions limit their applicability to real-world collaboration, where agents often lack full information about each other's actions, progress, or local environment. To support dynamic task allocation under partial observability, we introduce a communication-augmented Bayesian task-allocation framework. Our agent uses dialogue to reduce uncertainty about the environment and collaborators, while keeping decisions grounded in explicit probabilistic beliefs. We evaluate our framework in an Overcooked domain extended with dynamically arriving tasks under both full and partial object-space observability. Our communication agent consistently outperforms a vanilla LLM agent in both settings. Additionally, our framework performs comparably to a non-communicating task-allocation baseline under full observability, but substantially outperforms it under partial observability as task complexity increases by an average speed up of 0.585 and completes on average 18 timesteps faster. These results indicate that our agent is more efficient in dynamic task allocation than baselines in partially observable environments, and that communication is important as available information decreases.

10. 【2611.23115】Nunchi: Ears Help Eyes in Multi-Party Conversations

链接:https://arxiv.org/abs/2611.23115

作者:JunYeong Park,Shijing Wang,Seonwook Park,Michael Stengel,Shalini De Mello,Sang-Il Choi,Hyung Jin Chang

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:understanding multi-party conversations, central to understanding, gaze, Identifying, gaze geometry

备注: 10 pages, 5 figures

点击查看摘要

Abstract:Identifying whom a person looks at is central to understanding multi-party conversations, yet gaze geometry alone becomes ambiguous as more people appear. Conversations offer cues that geometry lacks, such as who is speaking and what is said, but no gaze dataset provides them for many multi-party scenes. We introduce SORBET, a benchmark of 3,340 samples from 1,578 clips with synchronized speech, transcripts, and attended person labels, covering more multi-party scenes than existing gaze datasets. Prior gaze models struggle to use these cues, which come in different forms, must be linked to the right person, and can conflict with gaze geometry. We propose Nunchi, a framework that constructs a text prompt from the transcript and the outputs of gaze and speaker models, links every cue to the candidates with shared labels, and lets a vision-language model (VLM) weigh gaze geometry against conversational cues to identify the attended person. Nunchi outperforms the strongest existing method by 4.8 percentage points. On SORBET, conversational cues help whereas additional visual cues do not, and the gains hold across three VLMs, with automatic transcripts, and on two existing datasets.

11. 【2611.23112】Large-scale Neuron Community Discovery Reveals Neuron-Sparse Behaviors in Language Models

链接:https://arxiv.org/abs/2611.23112

作者:Igor Shilov,Thomas Fel,Tal Haklay,Lucius Bushnaq,Owen Lewis

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:language model neurons, language model, groups, neurons, prompts

备注:

点击查看摘要

Abstract:What reusable units of computation can we discover within a language model's neurons? Prior work has shown that individual forward passes can often be sparsified post-hoc to small groups of neurons, but it has been unclear whether these groups form coherent computational entities reused across inputs. We introduce neuron community discovery, an unsupervised method for finding neuron groups that recur across prompts and are causally necessary and sufficient, within the layers they span, for common computations. The method combines gradient-based attribution, a graph connecting neurons that are repeatedly attributed together, and community detection. Applied to Llama-3.1-8B using ten million prompts, it discovers thousands of candidate communities. We evaluate them on held-out prompts through three causal tests: community necessity, sufficiency within a layer subset, and layer necessity. These tests identify groups whose removal disrupts predictions and whose retention preserves predictions despite ablating the remaining MLP neurons in the tested layers. Discovered communities support functions like grammatical agreement, token-probability calibration, fixed phrases, in-context copying, addition, and multiplication. With communities capped at 128 neurons across all layers, 10.3% of held-out prompts have at least one layer's contribution explained on a neuron-sparse basis. Coverage remains 8.7% when requiring at least four layers and 3.3% when requiring at least twelve. These results show that small groups of existing neurons can provide reusable computational components across prompts, and that such groups can be discovered at scale.

12. 【2611.23106】Natural Language Programming: Rethinking Language, Memory, and Cognition in the Era of Generative AI

链接:https://arxiv.org/abs/2611.23106

作者:Giovanni Adorni,Daniele Grosso

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Generative Artificial Intelligence, natural language, Natural Language Processing, Generative Artificial, Natural Language Programming

备注: 11 pages, 1 figure, 2 tables

点击查看摘要

Abstract:Generative Artificial Intelligence is transforming the role of natural language in computational systems. In classical Natural Language Processing (NLP), language was treated as an object of computation: something to analyse, classify, translate, or generate. Large Language Models (LLMs) challenge this perspective, enabling natural language to function increasingly as an executable cognitive medium through which humans structure reasoning, orchestrate problem solving, and regulate hybrid human/AI workflows. This paper introduces Natural Language Programming (NLPg) as a theoretical and epistemological extension of traditional NLP. Rather than focusing on language understanding alone, NLPg conceptualises prompts as dynamic cognitive artefacts that externalise goals, constraints, assumptions, validation criteria, and intermediate reasoning states. Prompting is thus not merely a technical interaction technique, but a form of dialogic cognitive programming operating within distributed human/AI memory architectures. Building on theories of distributed cognition, extended mind, metacognition, and dialogic learning, the paper proposes the notion of Dialogic Working Memory, describing how prompts and conversational states function as temporary external memory structures supporting reasoning continuity and reflective regulation. We further map existing memory architectures (BTMA, SKGE, RMR) onto this framework, illustrating how episodic, semantic, and metacognitive layers support long-horizon conversational coherence. Finally, implications for computational linguistics and AI/mediated knowledge systems are discussed, suggesting a post symbolic and post interface paradigm in which natural language operates simultaneously as communication medium, executable specification, cognitive scaffold, and distributed memory architecture.

Comments:
11 pages, 1 figure, 2 tables

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

MSC classes:
68T50 (Primary), 68T01, 68T30 (Secondary)

ACMclasses:
I.2.7; H.5.2; I.2.0

Cite as:
arXiv:2611.23106 [cs.CL]

(or
arXiv:2611.23106v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2611.23106

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Giovanni Adorni [view email] [v1]
Tue, 17 Nov 2026 17:27:01 UTC (45 KB)

13. 【2611.23093】What's in a Tree ? Hierarchical $n$-gram models as controlled approximators of language

链接:https://arxiv.org/abs/2611.23093

作者:Aritra Das,Francesco Cagnetta,Darshil Doshi,Victor V. Albert,Maissam Barkeshli,Andrey Gromov

类目:Computation and Language (cs.CL); Disordered Systems and Neural Networks (cond-mat.dis-nn); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:proposed as synthetic, synthetic settings, settings for studying, tree-grams, models

备注: 7+13 figures, 10+30 pages

点击查看摘要

Abstract:Hierarchical models have been proposed as synthetic settings for studying language. However, their relevance to realistic language corpora remains underexplored. In this work, we introduce tree-grams, autoregressive generative $n$-gram models that build the conditional probability tensor $p(x_n \mid x_{1:n-1})$ through a hierarchical composition of order-2 and order-3 tensors. $n$ controls the maximal context window, whereas a rank hyperparameter $d$ controls model capacity, yielding an interpretable and systematically scalable family of approximators of language. We show how tree-grams outperform existing $n$-gram baselines, while remaining competitive with deep transformer-based language models. We demonstrate the utility of such controlled approximations by using tree-grams as generative models. In particular, we show that hyperparameter transfer under $\mu$P can be made more robust when narrower models are tuned on simpler data, generated by tree-grams with moderate $n$ and $d$. In addition, we show that entropy and effective range of correlations control performance gap after fine-tuning. This is because tree-grams allow us to explicitly control horizon and capacity. When allowed to route across candidate topologies, we observe emergent sparsity in tree-grams. Such concentrated routing permits pruning upto 95\% of topologies without significant change in performance.

14. 【2611.23074】Runtime Verification of Multiple Natural Language Criteria for Agent Governance

链接:https://arxiv.org/abs/2611.23074

作者:Silviu Pitis,Parand A. Alamdari,Jessica Tang,Toryn Q. Klassen,Sheila A. McIlraith

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:natural language criteria, natural language, agent output, language criteria, governed by hundreds

备注: Accepted at NeurIPS 2026

点击查看摘要

Abstract:AI agents are governed by hundreds of natural language criteria, yet existing verifiers cannot efficiently evaluate an agent's output against a large set of such criteria and report which are satisfied, violated, or inapplicable. We introduce the VFM, a tree-attention verifier that encodes the shared context and target text, and scores N natural language criteria in parallel, returning independent per-criterion ternary verdicts. The VFM is pretrained on CriteriaBank, a corpus of 394K (context, target, criterion, verdict) tuples spanning over 321K distinct criterion strings. A finetuned VFM-4B outperforms GPT-5.4 on a synthetic governance benchmark. On the DynaBench multi-criterion benchmark, it outperforms DynaGuard-4B on trace-level failure detection, and its per-criterion verdicts localize the violated rule and support focused escalation to a larger chain-of-thought judge. We show that CriteriaBank pretraining improves cross-domain transfer, particularly in the low-data regime, while matching a strong direct-finetuning control at full data. On a single H100, VFM-4B evaluates 1,000 criteria against a 4K-token context in under 2s at 11 GB VRAM, making it suitable for runtime verification.

15. 【2611.23068】he Resolution Hypothesis: Agent Evolution's Key Is Identifying Improvements

链接:https://arxiv.org/abs/2611.23068

作者:Yuanhao Zeng,Shaocheng Lan,Ao Lu,Kuang Yan,Heng Lin,Xinang Xu,Yuan Luo,Yueting Wang,Yexin Li,Ruo Shan,Kan Ren

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:proposer writes candidate, proposer writes, Agent evolution, simple loop, evolution

备注: 38 pages, 12 figures, 13 tables. Project page: [this https URL](https://lineshogan.github.io/resolution-hypothesis/)

点击查看摘要

Abstract:Agent evolution follows a simple loop: a proposer writes candidate artifacts (prompts, skills, memories) and selection accepts those that score higher. This loop has shown promise, yet practitioners face a puzzle: methods trade wins across papers, and evolution often fails to bootstrap on certain tasks. We trace this puzzle to the Resolution Hypothesis: agent evolution stalls not because methods fail to propose better artifacts, but because noisy evaluations cannot reliably identify them. Across seven evolution methods and six models (over 10M LLM calls), we find support for the hypothesis at both levels where evaluation scores are used. At the candidate level (choosing artifacts), helpful candidate artifacts exist, but selection is no better than random at telling them from harmful ones, so errors accumulate across rounds. At the method level (ranking methods), typical margins of a few percentage points are smaller than the difference between two independent runs of the same method, so published rankings often rest on luck. Together, these findings indicate that agent evolution is often bottlenecked by reliably identifying improvements. This calls for a shift in how we develop and evaluate self-improving agents, from designing ever more candidate improvement systems to making true improvements detectable and accumulable.

16. 【2611.23045】ForecastGym: A Live, Controlled, and Replayable Benchmark for Forecasting Agents

链接:https://arxiv.org/abs/2611.23045

作者:Yicheng Tao,Yuante Li,Zipei Fan

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:increasingly forecast real-world, forecast real-world events, large language models, agent forecasts depends, Agents built

备注:

点击查看摘要

Abstract:Agents built on large language models (LLMs) increasingly forecast real-world events by searching the Web and reasoning over what they find. How well such an agent forecasts depends on both the retrieved evidence and the model, making control over that evidence essential for evaluation. Live evaluations can mix retrieval with reasoning when each system searches on its own, while retrospective search can leak later information through date filters or today's ranking of historical pages. Comparing models, search sources, and memory strategies requires both fixed evidence and a record of how it evolved before resolution. We introduce ForecastGym, which records what four commercial web search APIs return for open prediction-market questions every two days and replays this frozen evidence offline once outcomes are known, comparing models, memory, and captured search sources under a fixed evidence-acquisition policy. Its first release covers 150 questions, 614 evidence states, one per question and collection time, and 131k search results. Rerunning the same queries after settlement returns results that all but state the outcome for up to 92% of the questions, despite the tested date filters. On the frozen evidence, all tested LLMs trail the market in forecasting accuracy. Our diagnostic analysis suggests that missed public information contributes more to the gap in high-gap states than misreading does. Switching the search API changes a model's Brier score by up to 0.043, more than the spread across models, while persistent notes score similarly to rereading all evidence at half the input tokens. The evidence a forecaster sees can matter as much as the model that reads it.

17. 【2611.23035】Storing the Gemma 4 K=V Cache Once: Exact Global-KV Memory Savings in a Paged Serving Engine with Unchanged Attention Kernels

链接:https://arxiv.org/abs/2611.23035

作者:Kushagra Bainsla

类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

关键词:rotary position encoding, normalized key projection, global attention layers, fixed weight, rotary position

备注: 21 pages, 4 figures, 3 tables

点击查看摘要

Abstract:In the global attention layers of Gemma 4 31B, the value is the normalized key projection, and the key is the value scaled by a fixed weight, with rotary position encoding on one quarter of its dimensions. The Gemma 4 report states that this design reduces the global KV cache by up to 37.5%, but the open serving engines that we checked still store a full key and a full value: 1,024 values per KV head and token. We store one 640-value row instead, exact in real arithmetic, and an unchanged paged attention kernel reads it through two overlapping strided views as its key cache and its value cache. In a vLLM prototype with the 16-bit 31B model, the outputs are bit-identical to an emulation of the same arithmetic on the stock cache, 2 of 432 final answers differ from the stock engine (within its run-to-run noise), and the steady decode KV memory per request falls by a factor of 1.34 to 1.40 at 32K to 64K tokens. On a prefill/decode pair of two A100 GPUs with NIXL transfer and CPU offload, a decode engine with a full 15 GiB pool ran 1.38 times the stock decode tokens per step for 16K-token prompts (repeated to 0.06%) and 1.24 times for 8K-token prompts; a model of the vLLM block pool predicted both ratios to within 1% (the engine was 0.7% to 0.9% higher) and matched the change between them. The eager decode throughput rose by 1.30 and 1.11 times, and on this path the compact engine gave the same output tokens as the emulation for 8 prompts at batch 1. The run-time prototype makes an eager step 4% to 9% slower at equal batch, and the method does not yet stack with an 8-bit KV cache at the default scale.

18. 【2611.23026】PHC: Improving Hyper-Connections with Tensor-Parallel Grouped Updates

链接:https://arxiv.org/abs/2611.23026

作者:Xinying Hu,You Wu,Haoyi Wu,Jianchao Tan,Kefeng Zhang,Yuchen Xie,Kewei Tu

类目:Computation and Language (cs.CL)

关键词:streams, Transformer, expand the residual, parallel streams, TPHC

备注:

点击查看摘要

Abstract:Hyper-Connections (HC) expand the residual stream of a Transformer into $N$ parallel streams, and manifold-constrained HC (mHC) stabilizes them at scale. However, mHC benefits little from more than four streams, partly because each sublayer writes a single output to all streams, limiting how differently they can be updated. In this work, we propose TPHC, which integrates tensor-parallel (TP) shards with HC streams to promote greater independence across streams. Specifically, we route a separate mixture of the residual streams to each TP shard and keep the individual shard outputs separate during write-back, so each stream can receive a different mixture of those outputs. This design makes the residual-stream updates more expressive without adding parameters or FLOPs to the attention or FFN sublayers. With native support for stream sharding under TP, TPHC requires only 9% more training time than mHC on an 8B model when both use four streams. Increasing the number of streams from four to sixteen raises its training time by only 19%. On a 1.1B model trained on 100B tokens, TPHC reduces validation loss by 0.7-1.0% and raises average zero-shot accuracy across six commonsense reasoning benchmarks by 0.3-0.7 percentage points relative to mHC at matched stream counts $N\in\{4,8,16\}$. Our code is available at this https URL.

19. 【2611.22975】Large Language Models Have Not Yet Transformed Science

链接:https://arxiv.org/abs/2611.22975

作者:Ron Bekkerman,Nichole Li,Bahareh Kargar,Mark Somers

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Digital Libraries (cs.DL)

关键词:large language models, impact requires understanding, language models, emergence of large, large language

备注:

点击查看摘要

Abstract:The emergence of large language models (LLMs) in late 2022 has raised questions about the future of science, but assessing their impact requires understanding how scientific practices were already evolving. We analyze 2.5 million full-text papers across five disciplines from 2015 to 2025, tracing trends over a broad spectrum of lexical, structural, epistemological, and social dimensions. Aside from frequency shifts in some words, most pre-2023 trends continued with limited detectable breaks. Among the notable exceptions, growth in computer science coauthor teams accelerated significantly in Asia, while apparent declines in biomedical topic diversity largely reflected standardization in article formats. Our study establishes an empirical foundation for monitoring the health of global science as LLM adoption deepens.

20. 【2611.22949】Can Decision Models Replace LLMs in Real-World Contact Center Classification and Judging Tasks?

链接:https://arxiv.org/abs/2611.22949

作者:Md Tahmid Rahman Laskar,Xue-Yong Fu,Shashi Bhushan TN

类目:Computation and Language (cs.CL)

关键词:assessing agent compliance, Large Language Models, Decision models, generative Large Language, make bounded decisions

备注:

点击查看摘要

Abstract:Contact center systems often need to make bounded decisions, such as identifying a caller's intent, retrieving the knowledge-base article that answers a query, assessing agent compliance, or judging the output of AI models used in production. Decision models return a typed answer and its probability directly, making them a promising cost-effective alternative to generative Large Language Models (LLMs) in such bounded conversational tasks. However, their effectiveness in real-world contact center applications remains unclear. In this paper, we compare nine decision models against thirteen generative LLMs in zero-shot settings across eight contact center use cases: six classification tasks and two judging tasks. Our experiments demonstrate that many decision models can match the performance of frontier LLMs on contact center classification, and API-based closed decision models achieve this at the lowest per-request cost among the API models we evaluate. We further observe that their confident predictions are more accurate, enabling selective routing in real-world production scenarios. Across classification tasks, the main weakness of most decision models is abstention: they rarely choose the no-answer option, which accounts for most of their gap to the strongest LLMs (although Gemini-Decision-1 is the notable exception in this regard). We also find that the judging quality of decision models drops sharply for smaller models, and they are also more prone to position bias. In short, our findings provide practical guidance for selecting decision models based on abstention behavior, confidence, and deployment cost, rather than overall accuracy alone.

21. 【2611.22935】he Shared Word: Evaluating Language Models on Dutch Word Puzzles

链接:https://arxiv.org/abs/2611.22935

作者:Rik van Noord,Maurice Voors

类目:Computation and Language (cs.CL)

关键词:English are translated, LLM benchmarks, Shared Word, Dutch, Dutch word

备注: EACL 2027 (Findings)

点击查看摘要

Abstract:Many LLM benchmarks for languages other than English are translated, multiple-choice, or difficult to score automatically. We introduce The Shared Word (TSW-NL), a Dutch benchmark built around four core principles: it is language-specific, open-vocabulary, human-curated, and deterministically scored. Each puzzle gives three clues that describe different senses or uses of the same Dutch word. The clues are individually ambiguous, requiring the solver to combine evidence across multiple clues. We construct the benchmark from Dutch Wikipedia disambiguation pages, followed by automatic filtering and extensive manual curation. The final dataset contains 222 instances, with three independent human answers per test item. The task is clearly challenging: scores in our human study range from 49.5% to 61.0% and the highest-scoring open-weight model we tested reaches only 39.3%. Many others even score below 20%. At the same time, closed-source models show great progress: GPT-4.1 (April 2025) scores 59.2%, whereas GPT-5.6 Sol with max reasoning scores 88.8%. We believe this task provides a useful addition to Dutch model evaluation, plus a clear recipe that can be applied to construct a similar benchmark for other languages.

22. 【2611.22926】When Do Typed Decision Models Work in Transportation? Evidence from Travel Choice and Traffic Signal Control

链接:https://arxiv.org/abs/2611.22926

作者:Hongyang Zhang,Boyuan Deng,Siyuan Feng,Kai Chen,Junbo Zhang

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:combine natural-language understanding, option-level probability distribution, generating lengthy textual, lengthy textual responses, Typed decision models

备注: 22 pages, 4 figures

点击查看摘要

Abstract:Typed decision models combine natural-language understanding with a structured interface that returns a selected action and an option-level probability distribution without generating lengthy textual responses. Their low inference cost and response latency make them attractive for transportation problems with predefined alternatives. This paper investigates their effectiveness, robustness, and efficiency in two representative transportation tasks: individual travel-mode choice prediction and sequential traffic signal control. We systematically evaluate TypeSafe Jev and GPT-6 Luna Decisions against conventional transportation methods, reinforcement learning algorithms, and four chat-based large language models. Experiments on the Swissmetro dataset show that typed decision models achieve lower prediction accuracy than traditional discrete choice models and the strongest chat-based baseline, while their performance varies substantially with input representation and question framing. In closed-loop traffic signal control experiments, typed decision models demonstrate competitive performance against established controllers in several scenarios, but exhibit performance degradation under more challenging network conditions. Furthermore, the typed models achieve lower inference latency and computational cost than the evaluated chat-based large language models, highlighting their potential for efficient, zero-shot transportation decision-making. Overall, these findings demonstrate both the potential and limitations of typed decision models, emphasizing the importance of input design, task characteristics, and robustness evaluation for their effective application in transportation systems.

23. 【2611.22859】When the tail is earned by its companions: measuring label dependence in long-tailed multi-label classification

链接:https://arxiv.org/abs/2611.22859

作者:Christoffer Löffler

类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词:rare label seldom, label seldom occurs, seldom occurs, classifier can recover, companion-free recall

备注: 27 pages, 3 figures, 13 tables. Submitted to Information Sciences

点击查看摘要

Abstract:A rare label seldom occurs alone, and a classifier can recover it from the frequent labels it co-occurs with, its companions, without having learned the label itself. Existing diagnostics of this need a trained model: none says before training whether a corpus admits the failure, or what the standard aggregate hides. Macro-F1, like any measure built from per-label confusion counts, is unchanged by how a label's recall divides between occurrences with and without a companion. We introduce a within-label estimand of that division, a reading rule under which a fall in dependence counts only if companion-free recall rises, and a statistic of training labels that bounds, before training, how far reported recall can exceed companion-free recall. Across 23 corpora, 7 training objectives and five families of label-correlation mechanisms, companion-free recall falls short on all six corpora where the estimand is defined. Up to 18.4% of the tail true positives macro-F1 credits would vanish at the companion-free rate, within the training-label bound on every corpus. No long-tail objective reduces the dependence, but architecture moves it. Models whose tail score is computed from other labels' predictions are strongly dependent.

24. 【2611.22835】When Passing Checks Do Not Establish Completion: Evidence Interpretation in Coding Agents

链接:https://arxiv.org/abs/2611.22835

作者:Xueping Gao

类目:Computation and Language (cs.CL); Software Engineering (cs.SE)

关键词:discharge checking obligations, Verification procedures, preserve execution facts, checking obligations, procedures in coding

备注: 12 pages; supplementary material included as ancillary files

点击查看摘要

Abstract:Verification procedures in coding agents must preserve execution facts, interpret their scope and discharge checking obligations. We study these responsibilities through qualified repository checks, controlled evidence consumers and executable workflows. A prospective thirteen-task factorial study finds that correct reported facts need not yield the requested finite verdict. Conversely, all 122 delivered labels in a held-out receipt-supply study are correct, while sixteen responses misreport facts and eleven others exceed authorized scope. Production repair supplies successful controls and finite-supported preservation failures. Across 118 repair episodes on 31 tasks, source interventions separate startup reachability from repair and witness production from the claimed operation. Lifetime and resource controls delimit what passing validation establishes. Generated-note comparisons yield local repair differences but can state false explanations; strong ordinary baselines, new tasks and Skill-transfer studies supply no consistent overall advantage. These results characterize evidence interpretation, applicability and fulfilled actions while limiting claims of general diagnostic superiority, Skill deterioration or deployed folding effects.

25. 【2611.22827】Compact and Decodable Electrocardiogram Text for Large Language Models

链接:https://arxiv.org/abs/2611.22827

作者:Elif Dorukbaşı,İlker Türker

类目:Computation and Language (cs.CL)

关键词:lost through compression, twelve-lead electrocardiogram, electrocardiogram is written, information lost, large language model

备注: 9 pages, 5 figures, 5 tables. Preprint of a chapter submitted to "Advances in Artificial Intelligence and Data Science: Methods, Systems, and Applications" (Karabük University Press). Code: [this https URL](https://github.com/ekabullar/-ecg26c-llm)

点击查看摘要

Abstract:When a twelve-lead electrocardiogram is written as text for a large language model, the number of tokens has to be balanced against the information lost through compression. This paper presents a deterministic encoding that writes eight independent leads as amplitude letters and exact time gaps and recovers the remaining four limb leads algebraically. The key points are selected with a cardiac-cycle-dependent tolerance, the amplitudes are parameterized by a 26-letter logarithmic codebook learned from a training set, and a 10-step tolerance schedule keeps all records within a fixed token budget. The encoding was applied to 21,388 records from the public PTB-XL database and evaluated using an exact decode-and-re-encode round trip, waveform reconstruction error, and a paired comparison of convolutional classifiers trained with 5 different seeds on signals from the original and decoded databases. All records were contained in 4,080 tokens (average: 2,866 tokens, 64.3% fewer than a per-sample transcription), and all stored lead strings were exactly reproduced. The average correlation between the decoded and reference signals was 0.982. The macro-averaged area under the receiver operating characteristic curve was 0.9167 for the reference signals and 0.9157 for the decoded signals (paired difference -0.0010; 95% patient-level bootstrap interval, -0.0028 to 0.0007), within the pre-specified non-inferiority margin of -0.010; this is not a confirmatory result, because the test fold had been used during encoder development. The diagnostic content of a compact text can therefore be preserved, while the language model's ability to read the text is yet another matter.

26. 【2611.22778】A Full-Ledger Counterfactual Audit of Adaptive Reasoning

链接:https://arxiv.org/abs/2611.22778

作者:Xiaopeng Chu,Wenzheng Kong,Wei Liu,Wenyi Zhang

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Adaptive reasoning, Adaptive, answer, Counterfactual Value Audit, Abstract

备注: Accepted to EACL 2027 (Main Conference)

点击查看摘要

Abstract:Adaptive reasoning must decide whether to answer now or spend more compute. Predicting that the current answer is wrong does not establish whether further reasoning will improve it. We introduce the Full-Ledger Counterfactual Value Audit (FLCVA), which compares an immediate answer with four fixed-length continuations from the same frozen prefix under one answer procedure and accounts for the cost of every signal used by a policy. On GSM8K and MATH-500, a random 256-token continuation recovers a wrong answer in 26.6% of Qwen3-8B cases and 18.9% of DeepSeek-R1-Distill-Qwen-7B cases, while damaging a correct answer in 1.4% and 1.9%. Correctness labels from independently sampled continuations predict a separate continuation's outcome in both primary models. In offline replay, using these labels to allocate compute improves performance on DeepSeek; the Qwen3 gain remains inconclusive. Under full cost accounting, the tested lightweight, myopic controllers mainly recognize current errors and add little continuation-specific value beyond that shortcut. A Llama-8B replication and action/cost ablations examine the robustness of these findings. FLCVA separates measuring local continuation value, predicting it from observable signals, and using those predictions to allocate computation.

27. 【2611.22777】CrossEnv: Synthesizing Verifiable Cross-Environment Tasks for Long-Horizon Agent Training

链接:https://arxiv.org/abs/2611.22777

作者:Zhengfeng Yu,Tian Lan,Zhijing Wu,Enbo Zhao,Xuannan Liu,Feihu Jiang,Qianghuai Jia,Longyue Wang,Zhao Xu,Weihua Luo,Xian-Ling Mao

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:long-horizon agents, feedback for long-horizon, tasks, Executable synthetic environments, environments

备注: 23 pages

点击查看摘要

Abstract:Executable synthetic environments provide scalable training tasks and verifiable feedback for long-horizon agents. Existing environment synthesis methods primarily generate tasks within individual environments. However, these tasks do not adequately capture real-world interactions across services, where actions in one service depend on information obtained from another. Synthesizing such tasks is challenging because data generated across environments must remain consistent to support executable and verifiable interactions. To address this challenge, we introduce CrossEnv, a framework that uses an entity-tool graph to identify connections between environments and aligns task-specific data to synthesize executable, verifiable cross-environment tasks. We further propose CrossEnv-Curriculum, which progresses from single-environment tool use to coordination across more environments and business domains, before introducing user interaction. Across four external benchmarks, combining cross-environment training data with this curriculum achieves competitive performance with fewer training examples. Further analyses support the benefits of cross-environment data and curriculum training, and provide evidence of transfer to new environment combinations, external tasks less similar to the training data, and longer workflows.

28. 【2611.22766】StitchRAG: Constructing Compact and Evidence-Preserving Contexts for RAG with Diffusion-Based Stitching

链接:https://arxiv.org/abs/2611.22766

作者:Minsang Kim,Junpyo Lim,Heeje Cho,Seungjun Baek

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:large language models, grounding large language, Retrieval-augmented generation, improves factuality, language models

备注:

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) improves factuality by grounding large language models (LLMs) in external evidence. However, long retrieved contexts incur computational overhead and can even hurt performance due to noisy or irrelevant content. We propose \textsc{StitchRAG}, a framework for constructing compact context in RAG. \textsc{StitchRAG} builds a faithful, information-dense context while dynamically compressing the retrieved passages. We adapt the size reduction ratio to each passage by formulating a utility maximization trading-off the retained information and computation costs. We then extract answer candidates and query-related keywords from passages as anchors and collect passage sentences containing anchors under the derived size constraint. Finally, we connect or stitch the collected sentences together using text diffusion to form a coherent and natural context. Experiments on five open-domain QA benchmarks show that \textsc{StitchRAG} consistently outperforms diverse multi-step and compression baselines. Extensive ablations show the effectiveness of dynamic size allocation, anchor preservation, and diffusion-based stitching.

29. 【2611.22708】Cross-cultural Adaptation of Recipes for Low-Resource Languages: A Benchmark and Multilingual Culinary Lexicon for Hausa, Yorùbá, and Igbo

链接:https://arxiv.org/abs/2611.22708

作者:Nuhu Ibrahim,Maryam Abdulazeez,Fatsuma Jauro,Salisu Aliyu,Robert Stevens,Riza Batista-Navarro

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Recent multilingual large, improved machine translation, Recent multilingual, remains underexplored, culturally adaptive recipe

备注: 9 pages

点击查看摘要

Abstract:Recent multilingual large language models (LLMs) have improved machine translation, yet culturally adaptive translation for low-resource languages (LRLs) remains underexplored. This is particularly challenging for recipes, where ingredients, cooking tools, measurements, and procedures may require adaptation to the target cultural context. In this work, we introduce ReciLoReL, a benchmark of 600 expert-translated and culturally adapted recipes across Yorùbá, Hausa, and Igbo (three of the most prominent languages in Nigeria), and ReciLex, a multilingual culinary lexicon containing approximately 15,000 translated entities across ten recipe entity categories, including ingredients, tools, chef actions, state of tools, and durations. We evaluate state-of-the-art multilingual LLMs for English-to-LRL recipe translation under zero-shot and few-shot settings and investigate whether augmenting LLMs with ReciLex improves culturally adaptive recipe translation without requiring large target-language recipe corpora for training or fine-tuning. Beyond conventional reference-based translation evaluation using BLEU, chrF, and TER, we introduce five criteria for evaluating cultural adaptation, adapted from established cross-cultural adaptation methods. Across the selected LLMs and languages, ReciLex improves average BLEU from 13.57 to 14.51 and chrF from 37.89 to 38.74, while reducing TER from 77.14 to 75.12. Human evaluation further shows improvements ranging from 0.11 to 0.36 points across the five cultural adaptation evaluation criteria on a five-point scale. Overall, our work provides new resources, evaluation criteria, and empirical evaluation for studying culturally adaptive recipe translation in low-resource settings.

30. 【2611.22705】Route Optimization under Port Congestion and Carbon Reduction: An NSGA-II Approach

链接:https://arxiv.org/abs/2611.22705

作者:Guanxi Liang,Sanglin Zhao

类目:Computation and Language (cs.CL)

关键词:stringent decarbonization mandates, Maritime shipping simultaneously, increasingly stringent decarbonization, shipping simultaneously faces, decarbonization mandates

备注: 25 pages,7 figures

点击查看摘要

Abstract:Maritime shipping simultaneously faces the dual challenges of escalating port congestion and increasingly stringent decarbonization mandates. Large-scale vessel anchorage at hub ports inflates unit transport costs while generating significant additional \(CO_2\) emissions from idling auxiliary engines. This study develops a multi-objective routing optimization framework that jointly incorporates time, transport, and carbon emission costs under congestion-dependent generalized cost functions. A variational inequality (VI) model is formulated to characterize network equilibrium in vessel route allocation, while the Non-dominated Sorting Genetic Algorithm II (NSGA-II) is deployed to solve the resulting three-objective optimization problem. The model is empirically validated using China's coastal container network (Shanghai as the primary congested port, Ningbo-Zhoushan as the backup alternative), with sensitivity analyses conducted across congestion levels, carbon tax rates, and fuel price differentials. Key findings indicate that: (1) alternative ports effectively hedge congestion when diversion costs fall below waiting costs, with a diversion threshold at approximately 60 vessel calls; (2) a carbon tax of 80/t \(CO_2\) pushes clean fuel adoption above 50%; and (3) fuel prices primarily influence energy-type selection rather than port diversion decisions, confirming that the two decision dimensions operate independently. These findings offer actionable decision support for port authorities, regulators, and shipping operators seeking to balance economic efficiency with environmental sustainability.

31. 【2611.22685】Visibility Graph Representations of Word Embeddings for Text Classification

链接:https://arxiv.org/abs/2611.22685

作者:Elif Dorukbaşı,İlker Türker

类目:Computation and Language (cs.CL)

关键词:Text classifiers depend, Text classifiers, expose the distinctions, distinctions between classes, form the learning

备注:

点击查看摘要

Abstract:Text classifiers depend on representations that expose the distinctions between classes in a form the learning model can use, and a restricted vocabulary changes which representation is most effective. This paper studies natural visibility graphs as an intermediate representation for news topic classification under controlled vocabulary budgets. Word embeddings are averaged into a fixed-length document vector, the vector is read as an ordered numerical series, and its natural visibility graph is passed to a classifier either as an ordered node-degree vector or as an adjacency matrix. On the four-class AG News benchmark, chi-square selection retains 100 to 1,500 words, and the graph inputs are compared with direct embedding-based representations from continuous bag-of-words, skip-gram, GloVe, FastText and BERT. With a fully connected classifier, the degree representation is the most accurate configuration from 700 selected words onward; it reaches its highest accuracy of 91.24% at 1,000 words and exceeds the BERT-based baseline by 0.29 percentage points at 1,500 words. In a separate convolutional comparison, the adjacency input reaches 86.16% at 1,000 words, against 83.12% for the strongest static embedding. The results indicate that visibility-derived features can be competitive once the selected vocabulary provides adequate coverage. We discuss the roles of graph compression, coordinate ordering and classifier choice, and the controls needed to establish the reliability of the small differences observed.

32. 【2611.22665】Contract-Explicit Evaluation: From Auditing Learned Readers to Scoped Certificates

链接:https://arxiv.org/abs/2611.22665

作者:Hao Lu,Weixing Zhu,Ruiyang Li

类目:Computation and Language (cs.CL)

关键词:document-level relation extraction, systems depend jointly, gold version, relation extraction, systems depend

备注: 50 pages, 4 figures. Supplementary material (Online Resource 1, 14 pages) included as ancillary file. Artifact repository: [this https URL](https://github.com/lutttw/contract-explicit-evaluation) . Submitted to Applied Intelligence

点击查看摘要

Abstract:Evaluation readings of document-level relation extraction (DocRE) systems depend jointly on the model and the evaluation contract: gold version, scoring function, threshold. Rankings reverse across contracts, yet no existing method determines which comparisons survive the reversal. We address this gap with contract-explicit evaluation: a preregistered five-step protocol (Declare, Measure, Scope, Certify, Hedge), operationalizing the classical concordance decomposition of Kendall's rank correlation, that scopes certifiable regions and delivers distribution-free census certificates across two ecosystems. In the DocRE audit (44 training runs of one in-house architecture family), the scoring dimension scopes to a census certificate (three flagged instances, Clopper--Pearson upper bound 0.146); the confirmatory record includes registered negatives, and the audit prices its own simplification finding---the calibration dial's entire margin is one withdrawn commit. In an LLM-judge census (17 judges, 49,938 battles), 12.25% of leaderboard comparisons require hedging at the pre-declared split criterion (bound 0.124; panel-robust 0.143), with an exploratory two-tier reading certifying 69% at a bound \le 0.072 and a validity decomposition against released human labels (65% of contested battles are judge error, not ambiguity). The cross-model certificate is withdrawn on real confidence scores; the failure spectrum maps the boundary. The protocol, map, ledger, and per-instance artifacts are released.

33. 【2611.22661】he Between-Round Decision in Autonomous Research: An LLM Controller That Reads the Whole Trajectory

链接:https://arxiv.org/abs/2611.22661

作者:Caoxin Wang,Shengkai Gan,Xiang Hu,Lili Pan

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Executing an idea, step in autonomous, autonomous research, research should rest, Executing

备注: 16 pages, 2 figures

点击查看摘要

Abstract:Executing an idea often changes how promising it looks, so the next step in autonomous research should rest on results, not on proposals. After each round of experiments, the system must decide whether to refine the best solution or start a new direction, which solution to build from, and what goal to set. We call this the between-round decision. Existing systems wrap it in machinery such as rules, scores, search trees, and schedules; where an LLM makes it, what the LLM needs to read is left open. We ask whether an LLM can make this decision from accumulated evidence, without a search structure around it, and how much of that evidence it needs to read. We present BRED (Between-Round Evidence-based Decision), an LLM-based controller that maintains the best verified solution so far (the Champion) and a log of past rounds, and makes one decision per round. On three widely used research-agent benchmark tasks, BRED improves on the task baselines by 4.80% in MAE on ETTh1 (to 0.4172) and by 3.44 and 3.43 points of accuracy on SST-2 (to 95.07%) and CIFAR-100 (to 84.63%), ahead of the published results. When the controller does not read the accumulated evidence, the same loop gains less: with no history it reaches 0.4299 on ETTh1 and 83.71% on CIFAR-100, whereas the full controller's MAE is 2.95% lower and its accuracy 0.92 points higher. On a new task, speech-based depression detection under a leakage-free protocol, it reaches a macro-F1 of 0.6164 on seeds held out from selection, 5.5 points above its baseline and 4.0 above the strongest published system. Code is available at this https URL.

34. 【2611.22619】Understanding Cross-Modal Inconsistency through Representation Subspaces in Omni Models

链接:https://arxiv.org/abs/2611.22619

作者:Seonghyeon Cho,Chanjun Park

类目:Computation and Language (cs.CL)

关键词:unified language backbone, semantically equivalent inputs, Models process audio, Omni Models process, Answer Subspace

备注: Accepted for EACL 2027 Main

点击查看摘要

Abstract:Omni Models process audio, vision, and text within a unified language backbone, yet often produce different answers for semantically equivalent inputs across modalities. Existing representation-level analyses do not distinguish between information that predicts whether disagreement will occur and the representation whose perturbation affects the model's answer. In this paper, we estimate a low-dimensional Answer Subspace from answer-position representations and use it to separate answer-related components from the remaining representation. Across three Omni Models and two multimodal reasoning tasks, information predictive of cross-modal inconsistency lies mainly outside the Answer Subspace, concentrating in a reproducible two-dimensional representation that is not explained by a fixed modality offset. Matched interventions reveal distinct behavioral roles: perturbing the Answer Subspace substantially changes the model's predictions, whereas perturbing the disagreement representation, like a random subspace of the same dimensionality, leaves them almost unchanged. Our key finding is that cross-modal disagreement can be induced by misaligning modality-specific answer representations: perturbing the Answer Subspace for only one modality induces disagreement, whereas applying the same perturbation to both largely preserves agreement. Thus, the representation that predicts disagreement is distinct from the answer-level representation through which disagreement can be induced, showing that linear decodability does not imply behavioral efficacy.

35. 【2611.22583】Evolution Under Fire: Evolving Agent Safety Harnesses with Adaptive Injection Stressors

链接:https://arxiv.org/abs/2611.22583

作者:Yujun Wang,Yilun Liu,Jinhe Bi,Krishna Kanth Nakka,Xuebing Zhou,Hinrich Sch{ü}tze,Yunpu Ma

类目:Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Tool-using language-model agents, Tool-using language-model, untrusted emails, language-model agents, agents must act

备注:

点击查看摘要

Abstract:Tool-using language-model agents must act on information from untrusted emails, webpages, and documents. This creates a central security challenge: malicious instructions and legitimate task directives can arrive through the same interaction channel. Existing defenses are largely hand-designed and static, making further improvements dependent on repeated manual redesign. We introduce Evolution Under Fire, a staged framework that couples safety-harness evolution with adaptive stressor evolution. Utility-constrained, Pareto-scheduled tree search evolves complete executable safety harnesses from execution evidence while keeping the task model, benchmark, tools, and evaluator fixed. Adaptive stressor evolution then discovers utility-preserving attacks that guide a subsequent stage of harness evolution. On AgentDyn with GPT-4o-mini, an evolved harness reduces attack success from 50.4% to 3.0%, improves clean and attacked utility over the initial harness, and offers a stronger security-utility trade-off than reproduced defenses. On Agent-SafetyBench with Qwen2.5-7B-Instruct, harness evolution reduces attack success from 82.6% to 62.0% while retaining helpfulness and runtime validity. Evolved harnesses also transfer without further evolution to Qwen3.5-35B-A3B, reducing attack success from 32.1% to 0.9% while improving attacked-task utility.

36. 【2611.22580】AfriNORM: An Evaluation Benchmark for Normative Reasoning of LLMs Across African Cultures

链接:https://arxiv.org/abs/2611.22580

作者:Ahmad Samuel Gali(1),Tadesse Destaw Belay(2),Idris Abdulmumin(3),Seid Muhie Yimam(4),Shamsuddeen Hassan Muhammad(5 and 6) ((1) Independent Researcher, (2) Instituto Politécnico Nacional, (3) University of Pretoria, (4) University of Hamburg, (5) Bayero University Kano, (6) Imperial College London)

类目:Computation and Language (cs.CL)

关键词:Large language models, Large language, increasingly deployed, Distractor Bias Score, Bias Score

备注: 8 pages, 3 figures, 5 tables

点击查看摘要

Abstract:Large language models (LLMs) are increasingly deployed across various sectors. However, current evaluation benchmarks are insufficient to assess the applicability of these models in local African contexts, as most focus on linguistic fluency (grammar/translation) rather than cultural competence. The few existing benchmarks that measure general knowledge or social conventions do not capture the African deontic modality, i.e., the strict norms and taboos that govern diverse social interactions. In this paper, we introduce AfriNORM, a scenario-based, multiple-choice question dataset designed to measure and diagnose the normative reasoning limitations of LLMs when applied to African sociocultural contexts. We introduce two metrics: a Universal Commonsense Bias Score (UCBS) to quantify commonsense bias in LLM and a Distractor Bias Score (DBS) to quantify an LLM's limited understanding of African cultural norms. We also conduct a case study on the Yorùbá language, identifying confusion gaps in two closed-source LLMs, "Gemini 2.0 Flash" and "GPT-5", and one open-source LLM, "Llama 3.1 8B Instruct" when prompted in English versus Yorùbá. While their accuracy in English is high, their performance in Yorùbá is much lower, attributable to cultural confusion rather than simple bias, indicating that the models exhibit semantic confusion when reasoning about norms in Yorùbá.

37. 【2611.22541】From Perception to Simulation: Unveiling and Empowering Mental Spatial Dynamics in MLLMs

链接:https://arxiv.org/abs/2611.22541

作者:Jiachun Li,Zhuoran Jin,Kang Liu,Jun Zhao

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, understanding for Multimodal

备注: Findings of EMNLP 2026

点击查看摘要

Abstract:Spatial reasoning is a fundamental component of world understanding for Multimodal Large Language Models (MLLMs). While existing research has advanced the perception of spatial relations in static scenes, the domain of dynamic spatial simulation remains relatively unexplored. To bridge this gap, we introduce MentalGrid, a benchmark focused on spatial reasoning tasks that require models to simulate evolving spatial states without intermediate visual feedback. Extensive evaluation on our benchmark reveals a significant deficiency in the spatial simulation capabilities of existing models. Specifically, we find that performance is constrained by perceptual limitations in simple simulation scenarios and hindered by inadequate multi-step reasoning as complexity increases. To address these challenges, we propose a three-stage curriculum learning framework utilizing 16k specialized spatial reasoning samples. This approach yields SpatialWalker, which achieves a 33.8% average improvement over its base model, surpassing proprietary models like Gemini-3-Flash in spatial simulation. Furthermore, SpatialWalker demonstrates robust generalization, maintaining a 4.9% average gain on out-of-domain benchmarks, demonstrating the pivotal role of spatial simulation as a fundamental building block for broader spatial intelligence.

38. 【2611.22539】JET: Just-Enough Exploration Tuning for Efficient Tool-Calling Agents in Repository-Level Question Answering

链接:https://arxiv.org/abs/2611.22539

作者:Yoonho Choi,Taehyeon Han,Seonghyeon Lee

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:repository-level question answering, question answering, gathered information, explores a code, code repository

备注: Preprint. 13 pages, 8 figures, 5 tables

点击查看摘要

Abstract:In repository-level question answering (QA), an agent explores a code repository with tools and should answer a question once enough information is gathered. Nevertheless, we find that LLM agents often continue to invoke tools even after the gathered information is already sufficient to answer. We call this phenomenon over-exploration. Moreover, even though existing methods improve task performance through supervised fine-tuning (SFT) on expert trajectories, SFT also propagates the over-exploration in the trajectories to the agent. To mitigate over-exploration, we propose Just-Enough Exploration Tuning (JET), a fine-tuning method that trains the agent to answer once the gathered information is sufficient. JET truncates each training trajectory at the step where the gathered information becomes sufficient, inserts a rationale that explains why the agent can answer at that step, and fine-tunes the agent with a higher loss weight on the rationale. Experiments on two repository-level QA benchmarks with two open-weight 8B models demonstrate that JET reduces tool calls by 11 to 33% on self-generated trajectories while largely preserving the score. On expert trajectories, JET makes 18 to 28% fewer tool calls than SFT while retaining most of the score gain of SFT. In both cases, JET also lowers the inference cost.

39. 【2611.22525】When Agent Skills Go Stale: Runtime Behavior and Selective Maintenance in Evolving Environments

链接:https://arxiv.org/abs/2611.22525

作者:Ömer Faruk Akgül,Shuli Jiang,Yuting Zhang,Yi Zhang,Xiaohan Fei,Wei Xia,Stefano Soatto

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:guide decisions, decisions and actions, actions on related, past experience, skill

备注:

点击查看摘要

Abstract:Agent skills use past experience and current observations to guide decisions and actions on related tasks. This experience is retained in skill state, whose reuse can amortize inference-time reasoning and environment interaction. When environment changes, parts of this state can become outdated while others remain useful. Across four task settings and two models, we compare skill reuse before and after environment changes. Previously beneficial skills can reduce task performance by over 10 percentage points or increase execution cost by nearly 40% relative to no skill. Task success can also remain unchanged while execution savings decline. These effects depend on which environment-specific details become outdated and the agent's ability to compensate using current observations. We introduce selective maintenance, which replays checks from successful executions without additional model calls. It verifies whether observed differences conflict with skill state, repairs affected content, and validates updates, rebuilding when local repair is insufficient. No description of the change is supplied. Relative to reusing stale state, maintenance improves task accuracy by up to 67pp and reduces execution steps by up to 37%. These results suggest that preserving a skill's inference time value as environments evolve requires selectively maintaining its state.

40. 【2611.22514】MM-ReportBench: A Comprehensive Benchmark for Multimodal Report Generation from Tables

链接:https://arxiv.org/abs/2611.22514

作者:Teng Lin,Nan Tang

类目:Computation and Language (cs.CL)

关键词:integrating fluent narratives, modern vision-language models, reports integrating fluent, policy making, ability to generate

备注:

点击查看摘要

Abstract:The ability to generate multimodal reports integrating fluent narratives with faithful visualizations from tabular data, has become a cornerstone capability for modern vision-language models in practical domains such as finance, healthcare, and policy making. However, existing benchmarks are limited by single-modality focus, simplistic metrics, novelty evaluation, and visualization quality. We address these limitations with MM-ReportBench, a multimodal report evaluation benchmark covering 386 tasks across 185 real-world tables. Each task is paired with an expert-curated reference report featuring standardized chapter structures and verifiable key insight points, constructed through a hybrid pipeline of multimodal reports generation based on Monte Carlo Tree Search and rigorous human quality control. For robust evaluation, we design a dual-judge evaluation framework: Text Judge Model assesses textual quality along structural completeness, grounded insight verification with numerical fact-checking against source tables, and novelty analysis that distinguishes genuine analytical discovery from trivial paraphrasing; Visualization Judge Model evaluates generated visualizations across data fidelity, expressiveness, aesthetics, and technical correctness. They also evaluate cross-modal consistency. Extensive experiments on 20 state-of-the-art models reveal critical weaknesses: even the strongest model achieves only 68.9 overall score, with numerical hallucination affecting 38.5% of reports and genuinely novel insights remaining rare. Our ablation studies further demonstrate that single-judge evaluation consistently inflates scores by 8-12 points compared to dual-judge assessment, confirming that rigorous and reliable benchmarking demands multi-faceted, complementary evaluation probes.

41. 【2611.22511】LMLineage: Content Lineage and Context Governance for LLM Agents

链接:https://arxiv.org/abs/2611.22511

作者:Wei Hou,Jingxin Geng,Xin Chen,Zheqing Jiang

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:model internal weights, internal weights, confined to understanding, model internal, concept-drift micro compaction

备注:

点击查看摘要

Abstract:Interpretability for AI agents should not be confined to understanding the model's internal weights. It must also cover the agent's reasoning and decision-making process over multi-source context. We present LMLineage, an out-of-band system that attributes every output sentence of an agent session to its supporting input spans with calibrated confidences, without requiring white-box access to the model or any additional inference passes. On top of the lineage metadata, we build concept-drift micro compaction: instead of waiting for the context-length limit and summarizing everything, the system detects when previously used input documents have stopped being referenced ("drifted") and surgically compacts only those, preserving user instructions verbatim. We evaluate on a multi-tier corpus: 71 gold annotated sentences from 10 Chinese web-QA cases, plus 90 turns of independently collected multi-turn sessions across three generator models (gpt-4o-mini, qwen3.8-27b, deepseek-v4-flash). Results show that (i) window-level embedding similarity is far better aligned with LLM paraphrasing than whole document or lexical matching; (ii) the greedy-window fast path is both faster and more accurate on average than exhaustive line-matching (a multiple-comparisons bias in the latter inflates web recall at the cost of overall accuracy); (iii) per-turn attribution completes in 1s on a single GPU, remaining stable as context accumulates to 40 turns; and (iv) concept-drift detection is conservative (0% false compaction) with recall bounded by attribution accuracy. We further describe the concept-drift micro compaction design and an interactive incident-tracing/memory-cleaning case study. A companion patent application covers the lineage construction method.

42. 【2611.22499】From syllable representation via gesture generation to articulation: A spiking neural model

链接:https://arxiv.org/abs/2611.22499

作者:Bernd J. Kröger

类目:Computation and Language (cs.CL)

关键词:Speech production requires, Semantic Pointer Architecture, Speech production, Neural Engineering Framework, Pointer Architecture

备注: 47 pages, 9 figures. Submitted to the Journal of Neurolinguistics on 8 November 2026

点击查看摘要

Abstract:Speech production requires a transformation from phonological representations into coordinated vocal-tract movements. This paper presents a spiking neural sensorimotor model within the Neural Engineering Framework and Semantic Pointer Architecture. Each syllable occurrence has a neural oscillator whose evolving phase coordinates its gestures and initiates the next syllable. Phase-dependent commands recruit separate neural populations for vocalic, oral-constriction, velopharyngeal, and glottal actions (gestures). Neural ramp integrators shape the rise and fall of gesture activation. Together with articulatory targets, these trajectories determine the extent and time course of articulatory movements. Opponent neural populations provide control signals to a geometric articulatory model. Thirty reference recordings cover an input corpus of eight lexical words, an alternative realization of one word, a syllable sequence, and isolated syllables. Two additional paired simulation subcorpora of sixty runs each, covering two words and one syllable sequence, assess activation reliability across neural realizations. Adjusting gesture command amplitudes increased successful realizations from 57/60 to 60/60 under the specified criteria, with ramp rate factors held constant. The model demonstrates how neural oscillator and ramp dynamics generate articulatory timing under specified phasing rules. It complements a preceding mental-lexicon model through an ordered syllable interface. Continuous online execution across all components and connection to the acoustic extension remain further integration steps. Accessible code and synchronized visualization support inspection of the neural activation trajectories and resulting vocal-tract movements.

Comments:
47 pages, 9 figures. Submitted to the Journal of Neurolinguistics on 8 November 2026

Subjects:

Computation and Language (cs.CL)

Cite as:
arXiv:2611.22499 [cs.CL]

(or
arXiv:2611.22499v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2611.22499

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>
43. 【2611.22485】Growing Clusters Lower the Bar: Profile Accretion in LLM-Based Incremental Entity Resolution

链接:https://arxiv.org/abs/2611.22485

作者:Huixue Han,Shangzhi Xu,Anqi Xiong,Yu-Chu Tian

类目:Computation and Language (cs.CL); Databases (cs.DB)

关键词:Incremental entity resolution, entity resolution pipelines, Incremental entity, large language model, entity resolution

备注:

点击查看摘要

Abstract:Incremental entity resolution pipelines ask a large language model (LLM) whether a new record belongs to an existing cluster and show it the records already linked. Analyses of matching oracles assume that the answer depends only on the records compared. For the LLM matchers we test, it depends on cluster size, and the model lowers its bar for joining a cluster as the cluster grows. On French procurement suppliers from FOPPA, with SIREN identifiers as ground truth, we hold the new record fixed and vary only the number of verified members shown. Sixteen members instead of one raise the false match rate on similarly named companies by \dfmrMin--\dfmrMax{} percentage points in six open-weight models, while their area under the ROC curve rises by only \aucGainMin--\aucGainMax. In Claude Sonnet~5 and Haiku~5.5 the rise is \clSonD{} and \clHaiD{} points. The shift persists with street addresses, prompt variants and the BatchER and ComEM formats, and one false merge raises acceptance of the intruder's other records in every open model. It does not arise on Czech and Bulgarian TED notices, where one record with its full address already identifies the company. In online linking on confusable blocks, a single threshold set on labelled data raises recall by a factor of \fxRRmin--\fxRRmax{} for five models with no detectable loss of precision and no extra LLM calls.

44. 【2611.22461】Surfacing Disagreement Beats Resolving It: A Gated Ablation Study of Provenance-Weighted Memory for Multi-Agent Debate

链接:https://arxiv.org/abs/2611.22461

作者:Ziaullah Khan,Abdul Rehman Khalid,Shrestha Nischal Lal,Nheng Vanchhay,Md Ariful Islam Mozumder,Hee-Cheol Kim

类目:Multiagent Systems (cs.MA); Computation and Language (cs.CL)

关键词:resolve inconsistency, returns one winning, winning fact, disagreement disappears, Shared memory

备注:

点击查看摘要

Abstract:Shared memory for multi-agent debate is usually built to resolve inconsistency: retrieval returns one winning fact and the disagreement disappears before any agent sees it. We ask whether that is correct. In DebateGraph, four backends share one contract (read/write/snapshot), so five mechanisms from the agent-memory literature can be removed independently under a fixed budget, each gated on a pre-declared threshold. Across 39 runs one survives: preserving contradictions and passing the ranked conflict set to the debate, rather than collapsing it to a winner, improves F1 by +0.340 (95% CI [+0.267, +0.414]) and cuts attack success from 22 to 7 of 122 poisoned items (McNemar exact p=0.0003), at equal cost. Reaching it meant fixing a bottleneck in our harness: conflict sets are built only over retrieved edges, and our pre-declared cap left three quarters of planted contradictions unretrievable, first measuring the mechanism at +0.084. The effect replicates on two retrieval substrates and directionally on HotpotQA documents. No other mechanism survives, and two are worse than inert: once contradictions reach the prompt, a write trust-gate and the router's provenance features each cost accuracy (-0.075 and -0.096 F1). The gate fails structurally: poisoned objects are always entities the graph already contains, against 53% of gold, so groundedness scores the lie above a truthful first mention. We release the harness, attack set, and logs, and argue that silently reconciling memory is the assumption worth abandoning.

45. 【2611.22425】LMMR: Learned Multigranular Memory Retrieval for Small Language Model Agents

链接:https://arxiv.org/abs/2611.22425

作者:Pengfeng Song,Yunkai Zhuang,Liye Shi

类目:Computation and Language (cs.CL)

关键词:language model agents, agents have limited, needed for multi-hop, Small language model, limited space

备注: 18 pages, 11 figures. Code and experimental results: [this https URL](https://github.com/sungkites/LMMR)

点击查看摘要

Abstract:Small language model agents have limited space to read the memory needed for multi-hop questions. Relevant facts are often scattered across records whose surrounding text consumes much of that space. We propose LMMR, a learned multigranular memory retrieval method that selects both the next source and how much of it to read. LMMR links paragraphs and sentence fragments to their original sources and pairs views that supply the same missing support during training. Relevant distractors and repeated information provide contrasting examples. At inference, the reranker scores what each candidate adds to an anchor passage, and a selector chooses the evidence within a token budget. On 22,398 official validation questions from HotpotQA, 2WikiMultihopQA, and MuSiQue, a frozen 2B answer model reaches 61.47, 43.26, and 30.58 F1 under a 400-token budget. The gains over query expansion are 3.06, 2.14, and 4.55 points, while memory input decreases by 23.1-26.9%. LMMR also uses 23.5-27.7% fewer input tokens than a coarse retriever trained on the same questions. Against that retriever followed by LLMLingua-2 at comparable input lengths, F1 gains reach 3.99 points and are significant on HotpotQA and 2WikiMultihopQA after Holm correction. All eight small answer models evaluated on HotpotQA improve over query expansion and MMR in both F1 and exact match.

46. 【2611.22409】SignAligner: Dual-Granularity Span Generation for Sign Language Alignment

链接:https://arxiv.org/abs/2611.22409

作者:Jongbhin Woo,Youngjoon Jang,Joon Son Chung

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:Large sign-language corpora, Large sign-language, sign-language corpora benefit, word spans, spans

备注: 11 pages, 5 figures

点击查看摘要

Abstract:Large sign-language corpora benefit from temporal labels at two scales: subtitle spans for subtitle alignment and word spans for sign spotting. Sign spottings already locate words in time at corpus scale, but training subtitle alignment jointly on subtitle and word spans remains underexplored. We present SignAligner, a prompt-conditioned visual-language span generator that maps a sign-language video and a subtitle-sentence or target-word query to a textual start/end frame interval. It is first trained jointly on subtitle spans and word spans from sign spottings, then refined with overlap-based rewards while retaining auxiliary word examples. On the subtitle test set of the British Broadcasting Corporation-Oxford British Sign Language (BOBSL) corpus, the refined model reaches 66.68 F1@0.50 (F1 with a temporal intersection-over-union threshold of one half), the best among compared systems without external sign-video resources. This overlap-reward refinement outperforms cross-entropy continuation from the same jointly trained model. Joint training with word spans improves subtitle alignment in a pair of our generators matched in code, labels and maximum update budget. The advantage remains after both models of the pair are refined with overlap rewards. For word queries, the refined model follows the queried word, not a fixed position in the video: when the word's sign lies away from the video centre, it is far more accurate than predictions that use position alone. Together, these findings support one shared span generator refined with overlap rewards, aligning subtitles and producing word spans for human review.

47. 【2611.22382】RICoT: Recurrent Interleaved Chain-of-Thought for Page Stream Segmentation

链接:https://arxiv.org/abs/2611.22382

作者:Prashant Khatri,Bhavana Malagavalli,Saiful Haq,Niyati Chhaya

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词:Page Stream Segmentation, Large language models, Large language, Stream Segmentation, splitting a multi-page

备注: 18 pages, 3 figures, 19 tables. Dataset and code to be released

点击查看摘要

Abstract:Large language models (LLMs) have renewed interest in Page Stream Segmentation (PSS), splitting a multi-page file into its constituent documents. Yet published LLM methods still frame the task as boundary classification over one or a few neighboring pages, and commercial document-splitting APIs do not disclose their methods. We reimagine PSS for LLMs as a sequential process over the whole stream and propose RICoT (Recurrent Interleaved Chain-of-Thought), a prompting framework that works through the pages as a reader would: within a sliding window it reasons about each page and commits its boundary decision before moving on, and across windows it carries forward a compact record of what it has read, keeping per-call cost bounded. We also introduce FinancePSS-205, a benchmark of 205 real-world, de-identified financial page streams, to be released publicly. On FinancePSS-205, RICoT matches or outperforms pairwise and windowed prompting with the same backbone for each of three open-weight LLMs; on a TABME test subset, RICoT with GLM-5 reaches document F1 0.847 and boundary F1 0.915, above published zero-shot results. A 2B-parameter student, trained on a larger teacher's decisions with and without the page-level reasoning, performs comparably in both modes and comes within 0.05 document F1 of the strongest prompted model on FinancePSS-205.

48. 【2611.22353】NONSENSE: Non-Semantic Strings Expose Semanticity Gaps in Dense Retrieval

链接:https://arxiv.org/abs/2611.22353

作者:Ankit Gupta

类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词:question answering, modern search, retrieval-augmented generation, retrieval is central, central to modern

备注: Accepted to EACL 2027 (Main Conference). 15 pages

点击查看摘要

Abstract:Dense retrieval is central to modern search, question answering, and retrieval-augmented generation, where high similarity is often treated as evidence of semantic relevance. We examine how far this assumption can be stressed. NONSENSE is a black-box sparse-edit probe that constructs visibly non-semantic strings while forbidding query-term copying, optimizing only the dense similarity between a query and the string. Across five BEIR-style datasets and three popular single-vector retrievers, these strings frequently outscore the retriever's own best judged query-relevant passage (QRP), and often rank first in the full corpus. The result indicates a semanticity gap in the evaluated dense retrievers: nearest-neighbor status can be separated from passage-like meaning. These findings highlight the importance of evaluating dense retrievers not only by whether they retrieve relevant documents, but also by how reliably their similarity scores reflect semantic evidence.

49. 【2611.22342】Bad Apples in the Kitchen: How LLM Teams Detect, Correct, and Calibrate Against Their Misaligned Members

链接:https://arxiv.org/abs/2611.22342

作者:Dongseok Heo,Junghwan Kim,Bongwon Suh

类目:Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词:quietly goes wrong, multi-agent LLM work, LLM work assumes, protects an LLM, multi-agent LLM

备注:

点击查看摘要

Abstract:What protects an LLM team when one teammate quietly goes wrong? Most multi-agent LLM work assumes cooperative partners and inspects chat between turns before acting. Real-time embodied cooperation does not allow this pause: chat runs alongside action, so a teammate whose words stay cooperative while behavior diverges can cause damage faster than the team can name what is happening. We study this case by injecting three theory-grounded misaligned agents into a custom four-player Overcooked environment, each stressing a different joint-action layer (speech-action mismatch, role invasion, and aggregate-progress disruption), and decompose robustness into three sequential gates of detection, correction, and calibration through a 3x4x2 design (n=720 episodes). Nearly all trolls are eventually named, but recovery follows only when attribution and situational diagnosis appear in the same utterance; direct source-attribution prompting improves the hardest case only by degrading the troll-free baseline by 37.5%. Robustness, then, depends less on detection alone than on whether team chat combines attribution with diagnosis in a single utterance, suggesting that sensitivity to misalignment should be targeted rather than uniformly raised.

50. 【2611.22335】Comparing Implicit and Explicit Language Attitudes toward the Dutch multiethnolect Straattaal in Humans and Large Language Models

链接:https://arxiv.org/abs/2611.22335

作者:Hedwig Oldenhof,Laura Rosseel,Anna Wegmann,Dong Nguyen

类目:Computation and Language (cs.CL)

关键词:attributes remains unclear, social attributes remains, remains unclear, Word Association Test, Implicit Association Test

备注:

点击查看摘要

Abstract:While language attitudes have been extensively studied in humans, the extent to which large language models (LLMs) encode similar associations between language varieties and social attributes remains unclear. Contemporary sociolinguistic research distinguishes between explicit attitudes, which stem from deliberative processing, and implicit attitudes, which arise from automatic processing. This study investigates whether LLMs exhibit human-like implicit and explicit language attitudes toward the Dutch multiethnolect Straattaal, particularly its association with migrant communities. We use closely matched designs to assess attitudes in humans and LLMs. For humans, we use an Implicit Association Test (IAT) and an explicit rating task. For LLMs, we use the LLM Word Association Test (LLM WAT) and the same explicit rating task. Human participants strongly associate Straattaal with individuals with a migration background at both implicit and explicit levels. In the LLM WAT, Straattaal is consistently associated with individuals with a migration background, with stronger associations observed in larger and newer models. When presented with the same explicit rating task as human participants, LLMs produce comparable response patterns. Overall, the findings suggest that many LLMs encode language attitudes resembling those observed in humans, however we also highlight important questions about how concepts and measures developed to study human attitudes should be interpreted in LLMs. This highlights the relevance of incorporating sociolinguistic perspectives and language variation into NLP research to better identify and mitigate socially and linguistically embedded biases.

51. 【2611.22312】Zero-Dimensional Attention Topology for Linguistic Acceptability

链接:https://arxiv.org/abs/2611.22312

作者:Saeed AlMarri(Khalifa University)

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:linguistic acceptability classification, Transformer attention provide, acceptability classification, Transformer attention, linguistic acceptability

备注: 10 pages, 4 figures, 4 tables. Code and data are provided as ancillary files

点击查看摘要

Abstract:Topological summaries of Transformer attention provide sentence representations for linguistic acceptability classification. We examine a zero-dimensional persistent-homology ($H_0$) representation that summarizes minimum-spanning-tree merge values from 144 symmetrized BERT attention graphs into 1,440 features. The retrospective evaluation uses 8,517 downstream training sentences and 521 in-domain and 497 out-of-domain CoLA validation sentences after data-integrity filtering. The recorded out-of-domain Matthews correlation coefficients are 0.438 for the topological representation and 0.508 for attention statistics, compared with 0.545 for BERT. Attention-feature results are retained aggregate measurements; BERT predictions are rescored and length controls are refitted from the accompanying records. Analytical results show that the representation retains token-count information and discards a class of directional attention differences. Source resampling of BERT predictions also demonstrates the sensitivity of uncertainty estimates to the sampling unit. The reported results do not demonstrate a predictive advantage for this fixed topological representation over simpler attention summaries. They identify representation properties and evaluation controls relevant to subsequent studies of attention topology.

52. 【2611.22308】VRLLM: Turning LLMs into Powerful Tabular Classifiers

链接:https://arxiv.org/abs/2611.22308

作者:Yingtong Dou,Shubham Jain,Junpeng Wang,Hadi Abdullah,Vineeth Rakesh Mohan,Yuzhong Chen,Liang Wang,Yiwei Cai

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:Large Language Models, Large Language, classification remains unclear, classification performance falls, shown strong performance

备注: Technical Report. WIP

点击查看摘要

Abstract:Large Language Models (LLMs) have shown strong performance on text, but whether pretrained LLMs are effective for large-scale tabular classification remains unclear, as many previous works demonstrate that LLMs' tabular data classification performance falls behind tree-based models or neural architectures designed for tabular data. At Visa Research, we managed to fine-tune a pretrained Llama 3.2 1B LLM on billions of rows of labeled tabular data and make it outperform a wide array of tabular classifiers and even our competitive production deep learning model. For ease of reference, we refer to the model as the Visa Research LLM (VRLLM). In this paper, we share how we achieved this exciting result, covering data preparation, training recipe, ablation studies of design choices and deployment validation. We also benchmark frontier LLMs on the same task and analyze their prediction behavior across model families and generations. Our interpretability experiments suggest that VRLLM learns feature-specific predictive associations, while component ablations indicate that the earliest two FFN layers contribute to the emergence of linearly decodable task information. Our paper provides an engineering recipe and a focused empirical case study on adapting compact LLMs to industrial tabular prediction tasks.

53. 【2611.22270】aching Language Models to Narrow Boolean Patent Searches from Search Feedback

链接:https://arxiv.org/abs/2611.22270

作者:Seiya Kawano,Koji Marusaki,Hirofumi Nonaka,Koichiro Yoshino

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:searchers issue Boolean, issue Boolean queries, Japan Patent Office, Patent prior-art searchers, Boolean queries line

备注: 13 pages, 3 figures, 3 tables. Accepted at NLPIR 2026

点击查看摘要

Abstract:Patent prior-art searchers issue Boolean queries line by line, broadening to find relevant documents and narrowing until candidates can be screened. We distill 38,397 Japan Patent Office search reports into executable expert strategies, re-execute them, and evaluate generated strategies by citation recall and the smallest set containing each citation. Prompted models write valid, high-recall strategies but leave citations in sets too large to screen. We adapt a generator offline from scored rollouts in two forms: strategy-level learning from a screening-aware strategy score, and line-level learning from citation-preserving narrowing credit, which upweights the query lines keeping a found citation in a smaller set. On shared rollouts, line-level credit outperforms strategy-level scores on screening measures; iterated, it cuts the median citation-containing set from 768 to under 50 and places more citations in sets under 100 documents than experts, at lower recall. Strategy-level preference learning reaches near-complete recall; the two forms are complementary.

54. 【2611.22262】OfficePrism: Benchmarking Agents on Single-Domain Operations Across Enterprise Business Functions

链接:https://arxiv.org/abs/2611.22262

作者:Hanfeng Liu,Zhenyu Luo,Dongchao Zhang,Zexi Liu,Zulong Chen,Jinxin Hu,Jia Xu,Zeyi Wen

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Software Engineering (cs.SE)

关键词:making failures hard, Broad workplace scores, Broad workplace, making failures, hard to localize

备注:

点击查看摘要

Abstract:Broad workplace scores can mix competence within one business function with the extra cost of coordinating across functions and systems, making failures hard to localize. OfficePrism evaluates this prerequisite through 420 single-domain enterprise tasks spanning seven business functions under shared, benchmark-defined L1--L3 task-structure levels. Each task runs in a fresh environment combining a shared synthetic organization with one function-specific domain and yped state access. Our pipeline uses grounded records, business rules, and tool schemas to jointly construct a Chinese-language ticket, a hidden executable reference witness, and an expected response, followed by automated filtering and human curation. The same task set is evaluated through full-schema and search-and-dispatch packages. Across 124 model--harness--package configurations, the per-case joint natural-language-and-database pass rate ranges from 22.6% to 76.4%, with a median of 67.9%. L1 is highest in all 124 configurations, and L2 exceeds L3 in 122. Among 50 configurations sharing the same harness and model labels across both packages, search scores higher in 30, ties in one, and scores lower in 19.

55. 【2611.22241】Where Does Hindsight Enter Clinical Agent Benchmarks? An Audit of Simulators and Case Construction

链接:https://arxiv.org/abs/2611.22241

作者:Meilu Zhu,Xiaohan Li,Axiu Mao

类目:Computation and Language (cs.CL)

关键词:unrecorded test results, reads is rewritten, LLM diagnostic agents, agent-facing case text, case text

备注: 8 pages main text, 20 pages in total, 6 figures, 11 tables

点击查看摘要

Abstract:Benchmarks for LLM diagnostic agents are built from retrospective records: the case an agent reads is rewritten from discharge summaries, and unrecorded test results are generated by a simulator that often sees the final diagnosis. HindAudit separates three hindsight channels (the diagnosis given to the simulator, the retrospective context it conditions on, and the agent-facing case text) and measures each with judges trained only on real data. On 27,489 emergency admissions from MIMIC-IV, five registered tests found no leakage into simulated laboratory results: providing the diagnosis to five simulators had a negligible effect, and prompted gatekeepers diluted the diagnostic signal, although exploratory results suggest they can raise agent scores. The largest effect lay in the case text. Against a presentation-time reconstruction from triage records, benchmark-style summaries raised the zero-shot accuracy of four LLMs from 25.4% to 39.7% and discharge histories to 45.3%, and raised six interactive agents' scores while barely changing their ranking. The exploratory gap was reproduced in a registered replication on held-out patients. Masking diagnosis names left it unchanged. Because MIMIC lacks a contemporaneous bedside history, the gap is an upper bound on hindsight. We report all registered outcomes and recommend construction practices.

56. 【2611.22227】SOTA or Luck? The Winner's Curse in LLM Leaderboards

链接:https://arxiv.org/abs/2611.22227

作者:Sikun Xu,Raphael Thomadsen,Dennis J. Zhang,Heng Zhang

类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Methodology (stat.ME); Machine Learning (stat.ML)

关键词:Public LLM leaderboards, LLM leaderboards guide, Public LLM, LLM leaderboards, leaderboards guide model

备注:

点击查看摘要

Abstract:Public LLM leaderboards guide model evaluation and adoption, yet the reported performance of top-ranked models can be systematically overstated. This leaderboard winner's curse arises because ranking noisy benchmark scores rewards sampling luck alongside genuine ability. The same selection effect can distort scores throughout the leaderboard, a phenomenon we call the rank-induced bias. We develop an $m$-out-of-$N$ bootstrap to correct for this bias. It assumes a fixed model pool with independent, identically distributed bounded tasks while allowing arbitrary within-task correlation among models. Under exact population tiers separated by positive gaps, we prove that the bootstrap reduces $\Theta(N^{-1/2})$ ranking bias to expected residual bias $o(N^{-1/2})$. Across 14 benchmarks from 5 benchmark families, the rank-1 adjustments range from approximately 0.09 to 3.86 percentage points. In our SWE-bench Verified snapshot, the tied leaders receive an adjustment of 0.90 percentage points. Such overstatement is large enough to make the apparent winner statistically fragile. Thus, we use the same bootstrap to further quantify the intervals of plausible rank positions for each model and group models into tiers. We establish sufficient conditions for consistent recovery of population tiers. On SWE-bench Verified, this procedure places 13 of 173 models in the leading tier. We combine the score adjustment and rank intervals in the Rank Uncertainty and Leaderboard Evaluation Report (RULER). We validate its finite-sample performance using sample splitting and calibrated simulations, and advocate publishing RULER alongside raw rankings so readers can assess both reported performance and the precision of the ordering. RULER also provides guidance for benchmark design that accounts for selection effects and ranking uncertainty.

57. 【2611.22219】Fine-Grained Japanese Clinical Named Entity Recognition: A Controlled Comparison of BERT and Open-Weight Large Language Models

链接:https://arxiv.org/abs/2611.22219

作者:Feng Han,Ayako Yagahara,Kenji Hirata,Atsushi Yoshida,Kohsuke Kudo

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Generative large language, settings remain uncertain, encoder-based clinical named, Generative large, named entity recognition

备注: 33 pages, 3 figures, 5 tables; includes appendices with supplementary tables and one supplementary figure

点击查看摘要

Abstract:Background: Generative large language models (LLMs) offer an alternative to encoder-based clinical named entity recognition (NER), but their performance on fine-grained Japanese extraction tasks and sensitivity to generation settings remain uncertain. Methods: We compared two fine-tuned BERT-CRF baselines with nine open-weight LLMs on iCorpus, which defines 113 entity categories. The evaluation used 433 sentences from 36 test documents; 1,672 sentences were used for training. LLMs were evaluated using zero-shot prompting with and without JSON Schema constraints and three-seed QLoRA fine-tuning. Fine-tuned models were assessed under different output-token limits, including 900 and larger model-specific limits of 2,600 or 4,096 tokens. Performance was measured using sentence-level label-surface matching with relaxed and exact-surface F1. Results: The highest zero-shot relaxed F1 was 0.337, compared with 0.836-0.841 for the BERT baselines. At the larger output limits, all eight fine-tuned LLMs with at least 13B total parameters exceeded both BERT baselines (relaxed F1, 0.882-0.914; exact-surface F1, 0.840-0.880). Across three-seed means, increasing the output limit improved relaxed F1 by 0.052-0.085, alongside higher recall and fewer length-limited outputs. JSON Schema constraints changed relaxed F1 by -0.014 to +0.008 among seven models outside the two reasoning-oriented configurations, while medical-general model pairs showed no consistent advantage for medical specialization. Conclusions: On this historical Japanese case-report benchmark, task-specific fine-tuning combined with adequate generation capacity was associated with stronger LLM extraction performance. Output-token limits materially affected comparisons with BERT, whereas enforcing output structure alone did not overcome low zero-shot accuracy.

58. 【2611.22203】EGS: A Complementary Safety Framework for Educational LLMs

链接:https://arxiv.org/abs/2611.22203

作者:Zexuan Fei,Zhengnan Guo,Yiming Luo,Kaiyi Huang,Aimin Zhou,Bo Jiang,Fei Tan

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Large Language Models, Large Language, offer strong potential, developmentally inappropriate content, adolescent-facing deployment raises

备注: 20 pages, 8 figures, 8 tables

点击查看摘要

Abstract:Large Language Models (LLMs) offer strong potential for personalized education, but adolescent-facing deployment raises risks of toxic, biased, misleading, or developmentally inappropriate content. We argue that educational safety should move beyond binary refusal: student queries are often ambiguous or curiosity-driven, requiring contextual guidance rather than simple blocking. We introduce the Educational Guardrail System (EGS), a lightweight, model-agnostic runtime framework that complements intrinsic alignment through query moderation, scenario-aware pedagogical guidance, and response moderation. EGS triages inputs by risk level, redirects gray-zone queries with category-specific educational interventions, and audits outputs before delivery. Experiments across general and education-specific benchmarks show that EGS improves moderation performance, refusal quality, and jailbreak robustness across diverse LLMs. These findings suggest that defense-in-depth guardrails can strengthen safety while preserving the pedagogical utility required in educational LLMs. Our code and model weights will be publicly available to support community adoption.

59. 【2611.22191】RISA: Recoverable Sparse Attention for Block-Diffusion Language Models

链接:https://arxiv.org/abs/2611.22191

作者:Xinrui Zhong,Fanjiang Ye,Yuke Wang

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:refine multiple tokens, Block-wise diffusion language, diffusion language models, autoregressive decoding, refine multiple

备注:

点击查看摘要

Abstract:Block-wise diffusion language models (DLMs) refine multiple tokens in parallel, offering an alternative to token-by-token autoregressive decoding. Their long-context inference, however, remains bottlenecked by memory-bound attention: every denoising step repeatedly reads a growing historical key--value (KV) cache. Directly applying sparse attention does not fully solve this problem, because different queries can select different pages, inflating the block's collective read set, while repeated support construction adds overhead and permanent eviction can discard information needed later. We present RISA, a recoverable sparse-attention method with shared read plans for block-wise DLMs. RISA exploits the fact that historical KV remains fixed within a block while queries evolve across denoising steps. Newly generated history is organized into exact priority and recovery tiers; seed queries then build a protected, bounded read plan whose indices are reused across the block while attention is recomputed with fresh queries and current-block KV. This separates history preservation from repeated reading and amortizes sparse-support construction without changing the backbone or decoder. On DreamReasoner-8B, RISA retains comparable task performance. At 32K, the default configuration speeds up attention by $2.67\times$ and fixed-trajectory requests by $1.36\times$ over dense, and attention speedup reaches $5.53\times$ at 128K. Across eight settings on three models, RISA decodes faster than the tested MAGE, QUEST, and LoSA budgets at matched KL.

60. 【2611.22188】From Imperfective Paradox to Moorean Absurdity: Single-Chain Reasoning Lock-In and Multi-Candidate Verbalization Across Aspectual and Pragmatic Ambiguity

链接:https://arxiv.org/abs/2611.22188

作者:An-Sheng Jhang

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Natural language entailment, multiple pragmatic standards, Natural language, event merely occurred, pragmatic standards

备注: 21 pages, 4 figures, 25 tables (single-column arXiv preprint; includes 16,640 Qwen3-8B formal units across 4 preregistered experiments, 1,800 OpenAI format-ablation calls, and 4,240 P16.7 development-slice units across 5 external models)

点击查看摘要

Abstract:Natural language entailment and coherence judgments often depend on whether an event merely occurred, reached a telic culmination, satisfied a plan, or was evaluated under multiple pragmatic standards. We test observable consequences of the single-chain premature lock-in hypothesis across four preregistered, sealed formal experiments on Qwen3-8B-Q8_0 (16,640 formal units, temperature=0.0): 15 of 16 hypothesis slots retain confirmatory status (12 rejecting H0 under within-experiment Holm control at alpha_fam=0.05; E3_H3 demoted to descriptive status). In Experiment 1, Direct-CoT vs. MCU differs by 25.00 pp on telic high-confidence completion (Holm p=1.31239e-05), while NLI-CoT collapses by -91.25 pp on uninterrupted atelic items (Holm p=1.81805e-21). Multi-Candidate Verbalization (MCV) elicits K=5 weighted estimates in one call, separating the prompt from unweighted (MCU) and self-weighted (MCW) readouts. Mandarin (E2) and English (E3) expose an Interruption-Anchored Realis Paradox under NLI-CoT. In Experiment 4, MCU-CF raises perceived coherence on implicit Moorean sentences by 26.64 pp over Direct-CoT (Holm p=0.0006), alongside Direct-CF - Direct-CoT = 29.15 pp and MCU-CoT - Direct-CoT = 17.31 pp. A 1,800-call OpenAI ablation and a stage="dev" P16.7 cross-model extension (4,240 planned/collected units across five external models: 4,222 valid, 18 format-missing, 0 transport-missing; 2% missing per slice; OpenAI gpt-4o-mini at top_logprobs=20 achieves 1,000/1,000 valid units) show that discrete NLI-CoT and scalar Direct-CoT judgments dissociate across models. Confirmatory effects concern observable prompt-and-readout protocols; internal premature lock-in remains a hypothesis. All code, stimuli, preregistered analysis plans, and verification tools are available at this https URL.

61. 【2611.22186】Is 4-Bit Quantization More Than Noise to a Chat Model's Safety Behaviour? Attributing Behavioural Shifts with Matched Perturbations

链接:https://arxiv.org/abs/2611.22186

作者:Ege Kaya(University of British Columbia)

类目:Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词:copies disagree, phones and laptops, Chat models, copies, Chat

备注: 16 pages, 4 figures. Code and labels: [this https URL](https://github.com/egekaya1/qrefusal)

点击查看摘要

Abstract:Chat models on phones and laptops are usually 4-bit copies of the model that was evaluated, and audits of such copies disagree about what quantization does to refusal. A 4-bit build is one of many weight perturbations of the same size, so a change in its behaviour could come from its specific rounding error or from any perturbation that large. In a pre-registered study of three 3-4B chat models, with paired tests, blind human labels and an 8-bit null, we find two 4-bit shifts of opposite sign: with a compliant reply prefilled, Qwen2.5-3B continues into harmful content more often, and on held-out jailbreaks Llama-3.2-3B complies 10.3 points less often. Matched perturbations separate the two. Shuffled and Gaussian versions of the error average close to zero, while scaling the real error, from its mirror image to twice its size, changes behaviour near-linearly. At half the real error, Llama's likelihood is almost unchanged, yet it already complies 5.8 points less often, and this http URL's Q4_K_M, at the same bits per weight, moves neither model. Refusal under 4-bit quantization depends on the specific rounding error, not on bits per weight or likelihood, so each build has to be compared with its original.

62. 【2611.22161】What RL on Expert-Built Tasks Teaches Nemotron 3.5 Super

链接:https://arxiv.org/abs/2611.22161

作者:Sushant Mehta,Edwin Chen

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

关键词:post-train NVIDIA Nemotron, real-world software engineering, NVIDIA Nemotron, expert-built task datasets, enterprise document reasoning

备注: 18 pages, 2 figures, 9 tables

点击查看摘要

Abstract:We post-train NVIDIA's Nemotron 3.5 Super (120B total, 12B active parameters) with reinforcement learning (RL) on five expert-built task datasets, one at a time: real-world software engineering, complex constraints, long-horizon tool use, professional chart understanding and enterprise document reasoning. Each run trains a fresh rank-32 LoRA adapter with CISPO on Tinker, with no supervised stage, and each adapter is compared with the base model on the same tasks, harness and settings. On twelve headline benchmarks, eight built by other groups and four by Surge AI, the gains range from +4.5 points on IFBench to +13.8 on GDP_pdf, which rises from 10.4% to 24.2%; SWE-bench Pro V2 rises from 86.9% to 92.1%, Terminal-Bench 2.1 from 63.9% to 70.3%, MultiChallenge from 58.3% to 66.6%, AutomationBench from 14.8% to 27.5% and Chartography from 39.4% to 50.6%. The document adapter, trained without API tools, also gains +8.0 points on AutomationBench. In attempts read side by side with the base model's on tasks each adapter newly solves, the base model's failures recur in a few modes, and each adapter does more often what the base model missed: the tool-use adapter finds the data and the rules before acting, the coding adapter writes its own test or scratch files on SWE-bench Pro V2, the constraints adapter carries earlier turns into its answers, the chart adapter measures the marks in code, and the document adapter reads AutomationBench's spreadsheets.

63. 【2611.22148】Long-Context Generation Is a Sampling Problem (When You Turn Up the Heat)

链接:https://arxiv.org/abs/2611.22148

作者:Allen G. Roush,Minh Nhat Nguyen,Ravid Shwartz-Ziv,Judah Goldfeder,Sanjay Basu

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Open-weight language models, longer they generate, widely observed, worse the longer, Open-weight language

备注: 10 pages, accepted to the 40th Conference on Neural Information Processing Systems (NeurIPS 2026). Track on Evaluations and Datasets

点击查看摘要

Abstract:Open-weight language models are widely observed to get worse the longer they generate. Often, attempts to fix this involve more training. At high temperature, The sampler, i.e. the rule that picks the next token out of the model's probabilities, decides whether long and agentic generation survives and/or thrives. We test 29 open-weight models from 1B to 122B parameters on ten established benchmarks plus needle retrieval out to one million tokens, covering SWE-bench Verified coding agents, long chain-of-thought reasoning, long-form writing, long structured output and long-context reading. Samplers that keep their pool of candidate tokens small and steady as temperature rises don't lose accuracy. Samplers that let in low-probability tokens fall apart. At temperature 2, coding agents running top-p, top-k or Top-H resolve 0 of 100 GitHub issues, while the same agents running top-nsigma resolve 46 to 62 and win every issue the two samplers disagree on, on three Qwen3.5 models. Over all benchmarks top-nsigma keeps a median 100% of its temperature-1 score where top-p keeps 26%. Counting how many tokens each sampler lets through explains why. In one Llama-3.1-8B story, going from temperature 1 to 2 grows top-p's pool from 4 tokens to 51,845 while top-nsigma stays at 3. Across 133 combinations of sampler setting and temperature, the typical pool size predicts judged quality (Spearman correlation of -0.77), and when we pick the pool at temperature 1 and only apply temperature afterwards, Top-H, min-p and p-less stop collapsing. At the default temperature of 1 most samplers perform about the same, We release all code and data to the public.

64. 【2611.22120】What MoE Routing Controls: Causal Interventions on Expert Trajectories

链接:https://arxiv.org/abs/2611.22120

作者:Mukund Athmaram,Manoj Rao,Liang Ma

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:path, chosen expert paths, expert paths influences, concept, expert

备注:

点击查看摘要

Abstract:In mixture-of-experts (MoE) language models, a token is routed to a sequence of experts across layers. We investigate how forcing tokens onto chosen expert paths influences model behavior. We build a target path from the experts that a concept's or role's tokens most often use, and we add a fixed bias to each target expert's router logit during generation to steer the token toward this expert path. We study two kinds of targets. Format targets concern the form of the output, and concept targets concern its topic. In Qwen3-30B-A3B, we show that steering a format path changes the text the model writes. We also show that steering a concept path shifts the model's next-token probabilities toward the concept, even when the path is built in another language, yet this shift has little effect on the generated text. We investigate why formats reach the text but concepts do not by steering only part of the generation, and find evidence that a format, once started, reinforces itself. We show that the concepts religion and money steer most strongly, and that the effect is concentrated in the middle layers. We attempt to explain why the strength of the effect varies by concept through an analysis of embedding distinctiveness and word frequency.

65. 【2611.22055】Weight-Space Programming Doesn't Need Transformers

链接:https://arxiv.org/abs/2611.22055

作者:Hyunjong Ok,Jaeho Lee

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Standard neural architectures, Standard neural, descent and run, run fast, Standard

备注: Preprint (Work in progress)

点击查看摘要

Abstract:Standard neural architectures such as the Transformer were chosen because they train well with gradient descent and run fast on GPUs. In weight-space programming, a large language model (LLM) writes target weights by hand without gradient-based training, so those reasons no longer apply. Should we keep the Transformer? Given minimal guidance, ten labeled examples, and a sandbox, mainly on multiple-choice questions, we task three frontier LLMs with either generating the weights of a fixed architecture or designing the architecture themselves. When free to design, all three compile plain-text facts into a sparse table queried by a fixed procedure, reaching up to 54.4% test accuracy. An LLM-designed model achieves higher test accuracy than the most accurate released Transformer that the same LLM wrote while using about 1,800x fewer parameters. Without gradients, they choose a table, in which the LLM can state what each weight means and can find and rewrite a wrong one. Each wrong answer points to one row, and removing a row changes about one other answer. From this, we propose an associative-memory-based model up to 17x faster on GPUs than a same-sized Transformer. We also test pretrained weights, other benchmarks, and tasks where models generate answers. Pretrained LLMs remain more accurate; the claim concerns which structure to build when writing weights.

66. 【2611.22045】Beyond Acuity Accuracy: A Multidimensional Framework for Evaluating Patient-Facing Emergency Triage AI Tools

链接:https://arxiv.org/abs/2611.22045

作者:Ruio Heerschap,Henry Foote,Mahmoud Alwakeel,Zhouhan Qian,Jiaqi Wang,Elisabeth Bond,Yang Yang,Jonathan Chong Kai Liew,Matthew A. Bergens,Monique Arnold,Haoyuan Wang,Rui Yang,Kunyu Yu,Nikita R. Paripati,Diana Pimenta,Kyle Naimoli,An-Kwok Ian Wong,Nicoleta Economou-Zavlanos,João Ricardo Vissoci,Nan Liu,Anand Chowdhury,Chuan Hong

类目:Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词:emergency department prioritization, prompted LLM triage, department prioritization, support care-seeking, LLM triage

备注: 82 pages, including 34 pages of supplementary material. 5 figures (4 main figures and 1 supplementary figure)

点击查看摘要

Abstract:Patient-facing AI triage tools may support care-seeking and emergency department prioritization, but require evaluation beyond acuity accuracy alone. We developed SAFE-Triage, a framework integrating human review, automated metrics, LLM-as-judge evaluation, and simulation testing across clinical performance, patient interaction, and clinician-facing summary quality. We applied SAFE-Triage to 40 MIMIC-IV-derived emergency vignettes and a 10,030-case acuity analysis comparing prompted LLM triage (PLT) with rule-augmented prompted LLM triage (rPLT). PLT achieved higher emergency severity index (ESI) accuracy (57.5% vs 42.8%, $P 0.001$), lower undertriage (13.1% vs 29.8%, $P 0.001$), and higher clinician ratings across all domains. rPLT produced shorter and more stable outputs with higher automated readability scores. SAFE-Triage identified trade-offs between acuity accuracy, undertriage risk, communication quality, readability, and summary quality, supporting pre-deployment refinement and ongoing monitoring by showing where triage tools are efficient, need improvement, or need clinician oversight.

67. 【2611.22039】RLDE: A Reinforcement Learning Framework for Interpretable Iterative Document Editing

链接:https://arxiv.org/abs/2611.22039

作者:Nikhil Parkar,M. Marimuthu,Riya Joshi,Karthikeyan N

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:editing typically occurs, long documents remains, human editing typically, single-pass rewrite, flow of long

备注:

点击查看摘要

Abstract:Improving the quality, clarity, and flow of long documents remains a challenging problem in NLP, as human editing typically occurs through iterative refinement rather than a single-pass rewrite. Most existing automated systems act as black-box generators or rely on supervised learning, limiting interpretability and failing to capture the sequential nature of revisions. In this paper, we propose RLDE, an automated end-to-end metric-driven RL framework that formulates document revision as a reference-free MDP problem (unsupervised with respect to paired document-revision targets). Working with a limited action space (NOOP, INSERT, DELETE, REPLACE), RLDE leverages Pointer Networks for dynamic span selection at the token level and sends generative actions to the frozen BART-base model to obtain context-aware suggestions. PPO agents learn to optimize a multi-objective reward function based on readability, perplexity, and grammar metrics with the help of a novel SBERT-based Semantic Preservation Penalty constraint to avoid deletion degeneracy. Evaluations on the BEA-2019 dataset showed statistically significant results (p 0.01) across all metrics, where Flesch Reading Ease increased from 49.8 to 59.4, perplexity decreased from 63.7 to 39.8, while preserving 93% of semantic information. When compared to Chain-of-Thought (CoT) prompt-engineered models like GPT-4 and LLaMA-2, RLDE shows high performance at a very low computational inference cost. Moreover, the quality of edits generated by RLDE has been verified via human evaluations, scoring 4.9/5 for meaning preservation and 4.4/5 for edit quality.

68. 【2611.22033】hinking Harder Doesn't Lead to Better Choices: Reasoning Effort Increases the Confidence but Not the Correctness of LLM Shopping Agents

链接:https://arxiv.org/abs/2611.22033

作者:Adi Krishnamoorthy,X.Y. Han

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); General Economics (econ.GN)

关键词:autonomous shopping agents, multimodal product listings, process multimodal product, consisting of visual, text data

备注:

点击查看摘要

Abstract:Large language models (LLMs) are increasingly deployed as autonomous shopping agents that process multimodal product listings (consisting of visual and text data) and recommend purchases on behalf of consumers. Naturally, one might assume that models with more thinking power would make higher-quality purchasing decisions. To test this belief, we ask two questions about such agents: does asking a model to think harder make it choose better products, and does the confidence it reports tell us the likelihood it may be wrong? We benchmark ten frontier models on three product-choice benchmarks built from WebShop, Amazon's SQID and Wayfair's WANDS platforms to see if LLMs with more thinking power actually make better-quality product purchase decisions. Across all three benchmarks, we found that increasing the thinking effort does not increase decision quality in a statistically meaningful way. The same change in thinking effort raises stated confidence at a statistically significant level, so extra thinking buys confidence rather than correctness. We also measure the calibration of these models (how well their reported confidence percentage matches their true correctness percentage) in these tasks and show that most models are not well-calibrated at every effort level. We also find that errors are strongly shared: when one model errs in a task, several others tend to err on that same task. Furthermore, on tasks where several models all err, a large number of them pick the same wrong product.

69. 【2611.22027】GauntletScore: Auditable Fact-Checking That Matches the Best Published Checkers on LLM-AggreFact

链接:https://arxiv.org/abs/2611.22027

作者:Ernie Hobbs,Jim Hinson

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:strongest published checkers, AI-written text, generated sentence, sentence is supported, source document

备注: 10 pages, 1 figure, 7 tables. Per-claim predictions and scoring script: [this https URL](https://huggingface.co/datasets/Gauntletscore/llm-aggrefact-predictions)

点击查看摘要

Abstract:Checking whether a generated sentence is supported by its source document is a standard safeguard for AI-written text, and the strongest published checkers are single models. We describe GauntletScore, an evidence engine whose few rules and thresholds were set on the benchmark's development split. It puts typed questions to independent readers from different providers and records each answer as a measurement in an evidence ledger. It combines the measurements with a fixed Bayesian rule that counts a contradiction only when two readers agree. On the full LLM-AggreFact test split (29,320 claims across 11 datasets), following the leaderboard's approach, GauntletScore achieves 79.51 balanced accuracy, above every average published on the leaderboard as of 15 November 2026. That places it level with the best of them, nimble-v4-max (79.45 from its published dataset scores; the engine's 95% interval, 78.47 to 80.53, contains it). On the same claims it beats two of its three readers used alone (Readers A and B) by 1.66 and 2.17 points (95% intervals 0.80 to 2.53 and 1.29 to 3.06). Without AggreFact-CNN, described below, the leads are 0.90 and 1.32 and both intervals stay above zero. The engine also records the evidence behind every verdict, which a single model does not. Its largest margin is on full-length news articles checked against multi-sentence summaries (AggreFact-CNN), a format that resembles much regulated writing. There it scores 76.45, the best on the leaderboard, against 70.1 for the next best and 63.9 to 67.8 for the six systems with the highest averages. The test split was run once, on an engine frozen before the first test claim, under a stopping plan committed in advance. We release per-claim predictions and the scoring script.

70. 【2611.22017】SkillBuffBench: Measuring What Agent Skills Contribute across Harnesses, Models, Skill Access Modes and Memory

链接:https://arxiv.org/abs/2611.22017

作者:Gengyue Dong,Ye Wei,Zheng Zhu,Yidong Han,Jiale Miao,Xiaojun Jia,Guanghui Li

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:major agent harness, file-based packages, load on demand, blank slate, packages of procedural

备注: 18 pages, 2 figures, 6 tables. Work in progress: benchmark design and protocol; results to be added in a later version

点击查看摘要

Abstract:Agent Skills, file-based packages of procedural knowledge that a coding agent can discover and load on demand, are now shipped by every major agent harness, yet the evidence for how much they help comes almost entirely from settings in which the right Skill is hand-picked for the task and the agent starts from a blank slate. Neither holds in deployment, where an agent chooses from whatever library happens to be installed and frequently carries memory from earlier work. We present SkillBuffBench, a benchmark and paired evaluation protocol that treats Skill access as a three-level factor (no Skill, a curated Skill, and automatic invocation from an installed library), crosses it with memory (off and on), with four agent harnesses and with multiple models (the state-of-the-art proprietary models from Anthropic, Google and OpenAI, and the state-of-the-art open-weight models from Chinese providers), every model being run under every harness, and evaluates the result on research tasks contributed by domain experts together with the Skills they use, currently in materials science and biology, with the suite extended on a rolling basis. Every run is marked by a deterministic verifier; uncertainty is reported with a paired, task-level bootstrap; and cost, agent rounds and wall-clock time are reported alongside the score rather than folded into it. This version of the paper describes the design of the benchmark, its evaluation protocol and its current tasks and Skills. The evaluation is in progress: results will be added once the runs are complete, and the task suite, results and analysis will continue to be updated on a rolling basis.

71. 【2611.22009】DiagTrace: An Interactive Benchmark for Clinical Decision Making

链接:https://arxiv.org/abs/2611.22009

作者:Yufan Wang,Rui Yang,Yi Lin,Chunhua Weng,Yifan Peng

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Large language models, shown strong performance, medical question answering, Large language, language models

备注: Accepted to Findings of EACL 2027

点击查看摘要

Abstract:Large language models (LLMs) have shown strong performance on medical question answering and diagnostic reasoning benchmarks. However, existing evaluations typically provide all patient information upfront and assess only the final diagnosis or rationale. This setup ignores the need to acquire diagnostic evidence incrementally from incomplete information in real-world diagnosis. To bridge this gap, we introduce DiagTrace, a source-grounded benchmark for evaluating whether LLMs can reconstruct the documented diagnostic trajectory through interactive information seeking. Each benchmark instance is built from a PubMed Central case report and includes an initial presentation, an event bank, a clinical course, and diagnostic references. DiagTrace contains 510 cases across eight specialties, with 225 used to evaluate four LLMs on clinical-course alignment, interaction quality, and efficiency. Results reveal trade-offs in coverage, source-consistent ordering, and turn use.

72. 【2611.21983】Large Language Models as Nonlinear Dynamical Systems: The Three Clocks of Depth, Training, and Generation

链接:https://arxiv.org/abs/2611.21983

作者:Maor Farid

类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Dynamical Systems (math.DS); Chaotic Dynamics (nlin.CD)

关键词:Language models, nonlinear dynamics, Language, dynamical systems, language model side

备注: 52 pages, 19 figures. Code and data: [this https URL](https://github.com/maorfarid1/three-clocks)

点击查看摘要

Abstract:Language models are dynamical systems. A transformer is iterated over its layers, over the steps of its training and over the tokens it generates, and on each of these three clocks it shows behavior that nonlinear dynamics has studied for a century: fixed points, bifurcations, synchronization, chaos and noise-driven escape from potential wells. The two communities rarely meet, so this behavior is often rediscovered under new names. We build a bridge between them. To describe, we condense about 200 papers into the Three-Clock Dictionary, which maps fifteen concepts of nonlinear dynamics onto each clock and marks every correspondence as proved, measured or conjectured, and we show each concept in a mechanical system and in a language model side by side. To explain, we derive reduced-order models: the softmax is a Boltzmann distribution, gradient descent an Euler step on a nonlinear spring, a loss spike a ball thrown out of a stiff valley, attention on the circle a Kuramoto model, and a repetition loop a well that deepens while it is occupied. We then test these explanations on open language models, on a laptop CPU. Escape from repetition loops in GPT-2 and Pythia follows the Arrhenius law with the logit gap as the barrier, and the barrier deepens and then saturates, so the temperature needed to leave a loop falls like $1/\ln N$ with the generation length $N$ and rises with model size. Coherent text lives in a narrow window of temperatures, which a small reasoning model shares at its recommended temperature. Training makes each Pythia layer more expansive, and a small transformer trains at a multi-mode edge of stability. The third step, solving problems of language models, is still ahead: controllers derived from the escape analysis remove loops but do not yet beat the best fixed temperature. We state twelve open problems where nonlinear dynamics could get there.

73. 【2611.21974】Beyond Bitwidth: Deployment-Constrained Mixed-Precision Quantization for Multilingual LLM Inference on NVIDIA Blackwell

链接:https://arxiv.org/abs/2611.21974

作者:Hyojung Han

类目:Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Low-bit LLM quantization, supported GPU kernels, Low-bit LLM, model preserves service-relevant, GPU kernels

备注: 18 pages, 2 figures

点击查看摘要

Abstract:Low-bit LLM quantization is useful only if a model preserves service-relevant accuracy, executes through supported GPU kernels, and meets measured memory and latency limits. We study Qwen3-8B on NVIDIA B200 with vLLM, including INT2/INT3, GPTQ, NVFP4, and mixed-precision configurations. We verify native packed execution and precision on all 144 fused linear modules and evaluate Korean, English, numerical, and reasoning quality under preregistered gates. Packed INT2 and INT3 execute, but all seven tested INT2 grids degenerate on generation. Isolated module-restoration effects are strongly non-additive; Korean and reasoning sensitivity rankings disagree, and a promising INT4/INT8 development candidate fails independent final evaluation. A configuration with 16-bit activations, 98 NVFP4 weight-only modules, 46 INT8 modules, and an INT8 output head passes all gates on the untouched FINAL-81 set (5,168 items): 5.917 GiB of weight-loading memory (limit 5.98), Korean teacher-correct retention 0.904 (gate 0.90), and TPOT ratio 0.939 relative to BF16. It improves paired accuracy over NVFP4 W4A4 by +1.4 percentage points (Bonferroni-adjusted interval [+0.2, +2.6]), compared with +3.4 points on the selection set. This comparison changes both activation precision and INT8 protection; exploratory analyses suggest that the activation change contributes substantially, but the isolated allocation effect is not established. Final checkpoints were not retained, and bitwise rebuild reproducibility remains unverified.

74. 【2611.21969】It's My Turn! Interpretable Methods Reveal Developmental Differences from Mother-Child Conversational Dynamics

链接:https://arxiv.org/abs/2611.21969

作者:A'di Dust,Anura Deshpande,Pat Levitt,Maja Matarić

类目:Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

关键词:Understanding conversational interactions, Understanding conversational, important challenge, computational behavioral modeling, Understanding

备注: 9 pages, 5 figures

点击查看摘要

Abstract:Understanding conversational interactions between mothers and children is an important challenge for computational behavioral modeling. Existing methods use traditional statistical approaches and subjective measures of conversational dynamics, without incorporating temporal or probabilistic modeling. We developed an interpretable computational framework that combines sequence analysis, information-theoretic measures, and Bayesian hierarchical modeling to characterize temporal conversational dynamics in parent-child play. We applied this framework to interactions from 94 mother-child dyads with two-year-old children. Sequence analysis revealed that dyads with lower language development (as defined by scores on the Bayley developmental test) exhibited more heterogeneous conversational organization and fewer serve-and-return exchanges than higher-development dyads, a reciprocal turn-taking pattern in which one partner initiates communication and the other responds. Mutual information analyses suggested differences in conversational predictability between lower- and higher-development dyads, although the bootstrap confidence intervals overlapped. Bayesian hierarchical models estimated temporal trajectories for maternal consecutive turns, child responses following maternal speech, and overlapping responses; HDIs showed that trajectories differed in whether they excluded 0, but there were no statistically credible differences between the Bayley groups. Overall, these results indicate that children with higher developmental scores have more organized and predictable communication styles, with more ``serve-and-return" patterns with their mothers. These results demonstrate that interpretable computational representations of conversational dynamics capture developmental differences beyond simple measures of speech quantity.

75. 【2611.21964】Solver to System: LLM Reasoning Across Representations and Execution in Scientific Simulation

链接:https://arxiv.org/abs/2611.21964

作者:Eliza Berman,Rohan Subramanian,Shreya Jha,Lohit Jagarapu,Romain Lopez,Rajesh Ranganath

类目:Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词:partial differential equations, Simulators based, interpreting PDE solver, remains challenging, large language models

备注: NeurIPS 2026 Workshop: Sim2Science: ML with Imperfect Scientific Models. 23 pages, 14 figures, 9 tables

点击查看摘要

Abstract:Simulators based on partial differential equations (PDEs) are widely used to model physical systems, but generating and interpreting PDE solver code with large language models (LLMs) remains challenging. Scientific simulation code is a useful testbed for LLM scientific reasoning because (1) one system can be represented by code, equations, natural language, and numerical trajectories and (2) code can execute successfully while implementing invalid physics. We introduce Solver2System, a dataset of PDE solvers with multiple representations, controlled corruptions, and lexical perturbations, to evaluate whether LLMs can recover the underlying physical system through (1) cross-representation consistency and (2) static and agentic detection of physical invalidity. Across eight open-weight models, LLMs systematically favor some representations when evidence conflicts, and lexical perturbations to code alter interpretation of other unchanged representations. Execution improves physical-validity judgments, but weaker agents can judge correctly without identifying the causal defect. Thus, LLMs may reach correct judgments despite inconsistent representation reconciliation or causal misdiagnosis.

76. 【2611.21946】Conserved Verdicts, Drifting Commitments: Identifying Harmful Overthinking

链接:https://arxiv.org/abs/2611.21946

作者:Jianghong Zhou,Hao Rong,Chen Lin

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:correct, correct answer, answer, reached a correct, chains

备注: 40 pages

点击查看摘要

Abstract:A reasoning model that has reached a correct answer can lose it by continuing to think. Deciding whether to stop means comparing two probabilities at the same point of a chain: that the answer the model would give if stopped now is correct (its commitment), and that the answer it will finish with is correct (its verdict). We show that the verdict alone, which is what final-correctness probes estimate, cannot make this comparison. As a forecast of a fixed outcome it has no predictable drift, whether continuing helps or hurts. The commitment-verdict gap equals the expected remaining change in answer quality and the accuracy gained by stopping. A second identity splits any accuracy-versus-budget curve into answer change within chains and change in which chains are still running. We measure both on MATH-500. At all 379 points where DeepSeek-R1-Distill-Qwen-1.5B holds a correct answer, selected without regard to how its chain ends, continuing loses 3.6 points on average (95% CI [2.2, 5.2]), and the loss concentrates in a few problems. In six reasoning models from three families, on MATH-500 and OlympiadBench and with budgets up to 16,384 tokens, declining accuracy curves come from which chains remain, while the chains still reasoning keep or improve their answers. An oracle stopping rule gains at most +1.8 and +2.5 points at 1.5B and 7B. The framework says what to measure before building a stopping rule.

77. 【2611.21925】DNeo: Your Parallel Draft Model Needs Better Target Feature Encoding

链接:https://arxiv.org/abs/2611.21925

作者:Jameson Sandler,Shane Bergsma,Mostafa Elhoushi,Bin Claire Zhang,Gavia Gray,Joel Hestness,Nolan Dey,Ferdinando Fioretto

类目:Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Speculative-diffusion decoding, larger target model, undergo parallel verification, tokens pass verification, draft tokens pass

备注:

点击查看摘要

Abstract:Speculative-diffusion decoding uses a small parallel drafter model to generate b draft tokens in one forward pass, which then undergo parallel verification via a larger target model. Faster inference can be achieved when multiple draft tokens pass verification simultaneously. Recent parallel draft architectures (DFlash, DSpark) improve draft quality by conditioning on rich features computed by the target, through a mechanism known as feature encoding. However, standard feature encoding mechanisms have three limitations: (1) they are lossy, applying encoding projections that are destructive to the underlying target feature-space via a discovered effect known as residual mixing, (2) they are memory-less, with no record of previously processed proposals, and (3) they utilize features sampled uniformly from across the target layers, omitting important hidden states. To address these issues, we propose Mixture-of-Features Attention (MoFA), a lightweight feature-encoding approach equipped with a working memory that encodes previously rejected proposals. Leveraging MoFA, rejection memory, and a set of further enhancements, including 2-tap causal convolutions, prefix-only cross-attention, and non-uniform target layer selection, the final architecture, DNeo, achieves 1.3x faster generation speed than SoTA (DFlash-2) without impacting drafter footprint or generation quality. DNeo marks a new state of the art in high quality, fast LLM inference.

78. 【2611.21921】Latent Fact Composition under Next-Token Training

链接:https://arxiv.org/abs/2611.21921

作者:Tianyi Zhang,Feiying Chen

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:latent two-hop reasoning, two-hop reasoning train, Controlled studies, reasoning train transformers, studies of latent

备注: 21 pages, 5 figures, 23 tables

点击查看摘要

Abstract:Controlled studies of latent two-hop reasoning train transformers to predict only the answer, whereas language models are trained to predict every token. We ask whether a model trained on every token learns to answer two-hop questions whose intermediate entity appears in no two-hop training example. We build a synthetic corpus with such questions. On this corpus every term of the loss can be computed exactly. A looped transformer, a standard transformer and DiscoLoop answer almost none of these questions. We therefore introduce the Baton family of looped transformers. They pass the intermediate entity to the second loop as a token embedding. When trained to predict only the answer, two of its three variants answer these questions almost perfectly. We then relate the success and failure of each model to three design conditions. Experiments that change one condition at a time agree with this hypothesis. When Baton is trained on every token, however, its accuracy on these questions rises and then declines. We further split the gradient of the next-token loss into three terms. Removing the two terms that depend on the particular training set raises the peak accuracy but does not remove the decline. The decline arises in the second hop while the model still recalls both facts.

79. 【2611.21891】Call-Efficient ICD-10 Code Prediction via Supervised Candidate Generation and Selective LLM Invocation

链接:https://arxiv.org/abs/2611.21891

作者:Ilia Kopanichuk,Daniil Kartashev,Yuri Bolkonsky,Petr Anokhin,Vladimir Makharev,Iaroslav Bespalov,Dmitry V. Dylov

类目:Computation and Language (cs.CL)

关键词:practical medical text, medical text classification, clinical diagnosis text, Automatic assignment, short clinical diagnosis

备注: 8 pages, 8 figures, 4 tables

点击查看摘要

Abstract:Automatic assignment of ICD-10 codes from short clinical diagnosis text is a practical medical text classification and normalization task. The task is difficult because diagnosis phrases are short and noisy, the ICD-10 label space is hierarchical, and the class distribution is strongly imbalanced. This paper presents a call-efficient ICD-10 code prediction pipeline that combines transformer embeddings, tree-based supervised candidate generation, candidate-level reranking, and a gated LLM assistance. The evaluation uses a leakage-safe validation protocol: model and threshold selection are based on out-of-fold cross-validation predictions, while final reporting is performed on a locked test set with no shared source-file groups. The supervised conditional parent-code candidate generator reaches 74.32% Top-1 accuracy on the locked test set and 93.05% Top-10 candidate coverage. A direct zero-shot GPT-5.6-Sol baseline reaches 81.01% Top-1 accuracy, but requires an invocation of this large model for every diagnosis. The final deployable system, Pre-LLM fusion, reaches 81.24% OOF-CV accuracy and 83.19% locked-test accuracy while calling the LLM for only 31.97% of cases. This improves the locked-test error rate from 25.68% for the supervised parent-code baseline to 16.81%, corresponding to a 34.5% relative error reduction. The results show that the most effective role of the LLM is controlled reranking on uncertain examples rather than unrestricted coding or full-dataset invocation.

80. 【2611.21878】Knowing Which, Not How Much: Language Models Order Party Positions They Cannot Place

链接:https://arxiv.org/abs/2611.21878

作者:Yousef Attia,Jarosław A. Chudziak

类目:Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词:real actors stand, party platform prioritises, Language models, platform prioritises, institution has committed

备注: Accepted at the 40th Pacific Asia Conference on Language, Information and Computation (PACLIC 40)

点击查看摘要

Abstract:Language models are increasingly asked where real actors stand: what a party's platform prioritises, what an institution has committed to. Such judgments are gradable, carrying both an order and a magnitude. Nearly every benchmark that tests them asks about one entity at a time, then reads that score as the model's knowledge of the domain. Order and magnitude, however, need not be acquired together. Text about social entities carries far more comparison than measurement, so a model may hold a dependable ordering with no anchored scale beneath it. We ask whether a model can place a documented social position on a scale or only order the actors it compares, and what that means for how such knowledge is measured. We test this on party positions in Japan and South Korea, where the Comparative Manifesto Project's coded data supplies a rare external answer key. Asked to order four parties, models beat the strongest fixed-answer baseline by more than a factor of two; asked to place one party on the same scale, they fall below it. The ordering survives inside those failed placements, and supplying the coded values lifts placement to near ceiling. Comparative and absolute questions about the same fact therefore measure different things here, and for party issue salience a benchmark built from one cannot speak for the other.

81. 【2611.21852】he Hidden Cost of MoE Diffusion Decoding: Profiling and Fixing the Sampler

链接:https://arxiv.org/abs/2611.21852

作者:Harshit Samrat,Ramakrishna Paramahamsa Kompella

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Masked diffusion language, forward pass runs, Masked diffusion, diffusion language models, forward pass

备注: Accepted to NeurIPS workshop DiffuLM 2026

点击查看摘要

Abstract:Masked diffusion language models (dLLMs) decode by iteratively denoising a full canvas of tokens, so every forward pass runs a per-token sampling and stopping pipeline over the entire canvas-by-vocabulary logits tensor. We profile single-user decoding of a 26B-parameter diffusion Mixture-of-Experts model on a bandwidth-bound edge accelerator (NVIDIA GB10) and report a result that is easy to miss: after weight quantisation, this logits pipeline, not the expert GEMMs, is the single largest consumer of decode time. Unlike autoregressive decoding, where sampling touches one position's logits per committed token, diffusion decoding processes S times as many logit entries per output token, where S is the number of denoising steps. We show this pipeline is largely redundant or fusable and remove it in two lossless tiers: a bit-exact tier whose output is byte-identical to the reference decoder, and an accuracy-parity tier using a fused single-pass entropy kernel and Gumbel-max sampling. Combined with a W4A16 expert kernel, the full stack reaches 2.4-2.7 times end-to-end speedup over bf16 at unchanged benchmark accuracy on GSM8K, HumanEval, and MATH, on a single 273 GB/s device. We confirm the finding on a second, independently built diffusion MoE (LLaDA2.0-mini: pipeline 28.8% of decode, fused W4A16 3.3 times at accuracy parity) and show it disappears on a dense diffusion model (3.6%). The cost is specific to MoE diffusion, where quantisation makes the backbone cheap. Code and quantised weights are released.

82. 【2611.21823】USI: A Citation-Grounded Graph-Based Benchmark

链接:https://arxiv.org/abs/2611.21823

作者:Marzieh Karimi,Mehran Safayani,Alireza Basiri

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:Persian law remains, law remains challenging, Evaluating retrieval-augmented generation, benchmarks lack realism, legal

备注: 28 pages, 11 figures, including appendix

点击查看摘要

Abstract:Evaluating retrieval-augmented generation (RAG) systems in Persian law remains challenging because benchmarks lack realism, grounding, and coverage of legal reasoning. Existing resources are either synthetically generated from statutory texts, lacking natural information needs, or derived from informal legal question--answer sources without explicit linkage to authoritative legal documents, making them unsuitable for rigorous evaluation of grounded legal reasoning. To address this gap, we introduce TUSI-Bench, a structured Persian legal benchmark designed for the evaluation of RAG-based systems. TUSI-Bench is built upon a multi-layered legal knowledge framework containing 7,261 legal articles and integrating codified statutes, legal commentaries, doctrinal writings, and Supreme Court unification rulings. We also construct a legal knowledge graph linking articles and concepts for structure-aware retrieval. Based on this foundation, TUSI-Bench provides two complementary evaluation tasks: (i) TUSI-QA, an open-ended question answering benchmark containing 1,999 questions that requires grounded responses with explicit legal citations, and (ii) TUSI-Bar, a multiple-choice benchmark containing approximately 500 four-option questions derived from Iranian Bar examination questions. Furthermore, we propose a graph-based retrieval baseline that leverages relational structure within the legal knowledge graph. Experimental results demonstrate that incorporating graph-based relations improves retrieval recall by up to 8 percentage points compared to standard baselines, highlighting the importance of structured legal representations for RAG systems. The proposed benchmark provides a standardized resource for evaluating grounded legal reasoning in Persian and enables future research on structured legal intelligence.

83. 【2611.21808】SimAI: Mechanistic User Simulation through Psychological Network Models

链接:https://arxiv.org/abs/2611.21808

作者:Cheng Li,Adhyyan Narang,Jiayi Yuan,John F. Buss,Jina Suh,Devon Sandel-Fernandez,Yulia Tsvetkov,Adam M. Kuczynski,Tim Althoff

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

关键词:potentially harmful, direct experimentation, experimentation is costly, costly or potentially, user

备注: 47 pages

点击查看摘要

Abstract:Realistic user simulation enables the study of human interactions when direct experimentation is costly or potentially harmful. However, existing simulators largely overlook the psychological mechanisms that drive user behavior. We introduce SimAI, a framework for mechanistic user simulation that models how psychological factors interact to shape user responses. To overcome the challenge of supervising open-ended behavior, we propose a graph reconstruction objective that provides graph-level rewards based on how well simulated conversations reflect the underlying psychological relationships. To support this approach, we construct PSYCHE, a dataset of 18,576 profile-network pairs derived from 516 psychotherapy cases. Automatic evaluations show that SimAI achieves greater simulation and behavioral diversity than existing patient simulators while maintaining strong profile alignment. In an interactive study with 30 mental-health professionals and trainees, SimAI receives the highest average ratings for conversational authenticity, realistic help-seeking behavior, and clinical training utility. Beyond simulation quality, SimAI enables realistic clinical training and uncovers safety failures in prolonged AI interactions with vulnerable users. Code is available at this https URL.

84. 【2611.21804】Corrupting Ties: Investigating Robustness to Bias Injection Across Multi-Agent Network Topologies

链接:https://arxiv.org/abs/2611.21804

作者:Cléa Chataigner,Mina Arzaghi,Florian Carichon,Pablo Piantanida,Golnoosh Farnadi

类目:Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词:high-stakes decision-making contexts, decision-making contexts, outcomes in isolation, increasingly deployed, deployed in high-stakes

备注:

点击查看摘要

Abstract:AI systems are increasingly deployed in high-stakes decision-making contexts, where interactions among components can introduce fairness risks that remain undetected when auditing components or collective outcomes in isolation. As LLM-based multi-agent systems become more prevalent, understanding how biased information propagates through agent interactions is essential for assessing their fairness. We introduce a controlled bias injection framework that replaces selected agent responses with predefined biased ones, enabling an intervention-based analysis of how network topology and injection configurations shape system behavior. We propose decision divergence metrics that quantify the effects of these interventions at the agent, network, and system levels, and evaluate five topologies on three binary classification tasks using LLMs from the Qwen and Gemma families. Sequential networks show the greatest divergence, whereas fully connected and mesh networks show less. Injection position also matters: in star networks, injecting the central agent has larger effects than injecting peripheral agents. Models further differ in whether divergence follows the injected bias. These findings highlight the role of network structure in the propagation of biased information and motivate topology-aware auditing of fairness risks in multi-agent systems.

85. 【2611.21707】Bookkeeping Is Not Judgement: EJBench, an Engineering Judgement Benchmark Built from a Conjugate Heat Transfer Design Campaign

链接:https://arxiv.org/abs/2611.21707

作者:James Sadler,Rotimi Alabi,Kotub Uddin

类目:Computational Engineering, Finance, and Science (cs.CE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Unlike engineering benchmarks, engineering judgement, introduce EJBench, design behaves, engineering benchmarks

备注: 23 pages

点击查看摘要

Abstract:We introduce EJBench, a benchmark of engineering judgement: whether a model can predict how a design behaves at new conditions from a few earlier results, and decide on it. Unlike engineering benchmarks that test whether an agent can operate simulation or CAD software, EJBench is software-agnostic and asks what an engineer would conclude without running a simulation. Its tasks come from a conjugate heat transfer design campaign for battery cold plates, in three families: matching unlabelled test results to their operating points, choosing which stored runs to reveal before signing off a design, and ranking new duties by peak cell temperature. Every answer is taken from a converged simulation, not from an LLM judge. The best of ten frontier models, GPT-6 Astra, scores 0.71, and models state almost the same confidence on tasks they get wrong as on tasks they get right. We also post-train Qwen3.5-9B with LoRA and reinforcement learning, rewarded by the share of answer criteria the simulation results confirm; on the held-out test split its score rises from 0.071 to 0.106. We release the train, validation and test splits, the evaluation harness and the leaderboard.

86. 【2611.21705】Disambiguating Moral Circuits and Moral Features in Language Models: Moral content, normative judgment or cue words? Evidence from 14 models

链接:https://arxiv.org/abs/2611.21705

作者:Davide Liga,Liuwen Yu,Matteo Magnini

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:Interpretability methods, Stealing medicine, sparse autoencoder, methods can locate, locate the attention

备注:

点击查看摘要

Abstract:Interpretability methods can locate the attention heads and sparse autoencoder (SAE) features that change the answer a language model gives to a moral prompt, e.g., whether "Stealing medicine for a dying child is morally" continues with "justified" or "wrong". Such a component could respond to moral content, to the judgment of conduct by any norm, or to the word "morally" in the prompt. We built 227 minimal pairs of short phrases, validated by five annotators, whose two versions differ in a moral standard, in another kind of norm (prudence, etiquette, aesthetics or evidence) or in a descriptive quality, and showed them to 14 open-weight models (Llama, Gemma and Qwen, 1B to 14B, base and instruction-tuned), with and without the word "morally". In every model, the heads that change the moral answer belong to an evaluation circuit the models use for every kind of normative judgment we tested: these heads carry the same share of the effect for moral as for other normative pairs (pooled ratio 1.00, 97.5% confidence interval [0.92, 1.07], with the word; 0.90, [0.84, 0.96], without it), and the models need them as much for both. The models need these heads also when nothing in the prompt asks for a judgment, and on 400 scenarios of the ETHICS benchmark, where removing them takes away 37 to 39% of the difference between acceptable and unacceptable scenarios, against 1 to 3% for ten random heads. The SAE features we located respond mostly to the word "morally" rather than to what the phrase is about. The models represent the category of a pair (the standard the annotators assigned to it): it can be read from their hidden states, and, in the eight models we tested, removing the direction that carries it weakens the moral verdict by a few percent, and more than the other verdicts in seven of them. We release the pairs, the ratings, the code, the trained SAE dictionaries and the result files.

87. 【2611.21702】Watermark Evidence under Open-Weight LLM Modification: Exact Bounds for Low-Rank Output Watermarks

链接:https://arxiv.org/abs/2611.21702

作者:Prashant Shekhar,Dumindu Samaraweera,Caroline Howard

类目:Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Open-weight language models, Open-weight language, weights are modified, continue generating, released weights

备注:

点击查看摘要

Abstract:Open-weight language models can continue generating after their released weights are modified, while a watermark verifier still scores outputs against the original base and marked models. We study how such modifications change the evidence available to an OpenStamp-style verifier. At each shared prefix, we represent the modification as a residual in the next-token logits. We derive an exact finite-vocabulary lower bound on the expected log-likelihood-ratio evidence under a residual-span constraint, along with a sharp span-only deviation bound. We also characterize the first-order evidence shift through a covariance term with an explicit second-order remainder, and determine the residual span needed to reach a target evidence level. For sequence-level detection, we derive an exact conditional exponential-moment bound and combine it with a supermartingale argument and a distribution-free order-statistic tolerance bound. This yields a high-confidence upper bound on miss probability after attack selection on calibration data and evaluation on independent certification continuations. In experiments with OpenStamp on Llama-2-7B and Mistral-7B-v0.3, INT8 quantization and 30% pruning retain test true-positive rates of 85.6-94.8%, while 500-step LoRA fine-tuning lowers them to 28.8% and 11.6%. The covariance prediction tracks the measured mean LoRA evidence drift on both models, with no remainder-bound violations across 160,000 test prefixes. Additionally, we observe zero false positives among 500 base-model continuations per model. Through these theoretical and empirical results, the current research provides a better understanding of watermark robustness to model-editing/tuning attacks.

88. 【2611.21669】oken Commitment as a Control Surface for Steering Masked Diffusion Generation

链接:https://arxiv.org/abs/2611.21669

作者:Ambroise Aigueperse,Hugo Buurmeijer,Carmen Amo ALonso,Marco Pavone

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:models repeatedly predict, repeatedly predict provisional, repeatedly predict, sampler decides, predict provisional tokens

备注:

点击查看摘要

Abstract:Masked diffusion models repeatedly predict provisional tokens before a sampler decides which predictions become permanent. Existing inference-time steering methods primarily modify activations, logits, or denoising trajectories, while treating this commitment policy as a fixed decoding detail. We instead study token commitment as a diffusion-specific control surface and separate it into two decisions: which tokens to commit and how many tokens to commit at each step. For the first, we introduce counterfactual target-aware commitment, which ranks unresolved positions by a mixture of model confidence and leave-one-token-out target contribution. For the second, we introduce calibrated adaptive budgets driven by target progress and confidence. Across language and vision-language settings in the LLaDA family, multiple targets, two activation-steering methods, and an unsteered control, both mechanisms yield empirically monotonic target-quality trade-offs in every configuration we evaluate. Adaptive schedules also recover competitive operating points relative to scorer-free stochastic schedules matched in average denoising cost. Because both mechanisms require only a scalar score evaluated on a provisional completion, they apply unchanged when the target is an automatic proxy for task success rather than an output attribute: NLI entailment for dialogue summarization and CLIPScore for captioning, neither of which corresponds to a single reusable steering direction. We reproduce the behavior of both mechanisms on a second masked-diffusion family, Dream-7B, for one control target and one task-success target. These results characterize commitment--which provisional predictions become irreversible, and how rapidly--as an interpretable control surface for steering masked diffusion generation under the conditions we test.

89. 【2611.21653】Evaluating Semantic Insensitivity in Financial Sentiment Analysis: Implications for Sustainable Financial Decision-Making

链接:https://arxiv.org/abs/2611.21653

作者:Gabriela Cioboata,Teodor-Stefan Bildea

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:portfolio management, risk assessment, heavily relying, Financial, Financial sentiment

备注: 17 pages, 1 figure, Presented and accepted for publication at the Symposium "Rethinking Economic Models: Sustainability, Finance, and Accounting in Times of Transformation" (Bucharest, 2026)

点击查看摘要

Abstract:Financial sentiment analysis is critical for automated trading, portfolio management, and risk assessment, heavily relying on models like FinBERT. Despite high benchmark accuracy, these models remain vulnerable to subtle adversarial text modifications, threatening the integrity of algorithmic decision-making. In this paper, we propose Agent-driven Semantic Inversion (ASI), a novel adversarial attack framework targeting financial sentiment models through domain-specific semantic manipulation. Utilizing an LLM-powered multi-agent pipeline, our approach identifies eligible financial news sentences and applies targeted lexical substitutions. We empirically evaluate ASI against FinBERT, one of the most widely deployed financial sentiment models. Our results reveal a striking vulnerability: the attack successfully deceived FinBERT in 90.85% of eligible cases, with the model frequently maintaining its original sentiment prediction despite the fundamental inversion of financial performance indicators. Through qualitative analysis and token-level investigation, we demonstrate that FinBERT critically over-relies on contextual keywords and syntactic patterns rather than true logical comprehension of financial semantics. Our findings highlight the urgent need for logic-aware, robust financial NLP models to ensure the reliability of automated decision-making systems.

90. 【2611.21651】Consistency Is Not Correction: Separating Confidence, Abstention, and Recovery in LLM Agents

链接:https://arxiv.org/abs/2611.21651

作者:Khushal Sethi

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)

关键词:confidence signal, larger model, gate, answer, resamples an answer

备注:

点击查看摘要

Abstract:A controller that resamples an answer, escalates to a larger model, or abstains is usually justified by a confidence signal. Three claims about such a signal do not follow from one another: it ranks answers (discrimination), it supports withholding some of them (selective prediction), and it changes an answer for the better (correction utility). We give an exact decomposition of the third into gated recoveries minus gated harms, which bounds whether a comparison can succeed before it is run: a gate that only replaces a proposal can act only where the base policy was already wrong, so the initial error count caps the discordant pairs any correct gate can produce. When that cap falls below the count a paired test needs, the experiment cannot return a positive result for a working mechanism, nor distinguish one from a gate that never fired. We measure all three targets on two model scales and find the bound binds. In a small-model suite a perturbation-agreement verifier reaches within-policy AUROC 0.990 (95% interval [0.95, 1.00]) while every episode outcome matches single-sample decoding at 4.32 times the call count. In a controlled 840-episode study no verifier replaced the proposal on any of the 60 GSM8K decisions, so that comparison tested nothing; the entire GSM8K gain across six controllers is one task, and it is the task whose identical temperature-zero repeats disagreed, making it the one answer the service does not reproduce. On the diagnostic set the gate could reach four errors while the test needed six, so even a perfect gate had no significant result available. We report two checks that would have caught this before any budget was spent, and show that tie handling in rankings, tied selection cutoffs, and unequal output limits each move a headline number in the same dataset. The binding constraint on this literature is measurement resolution, not the choice of signal.

91. 【2611.21650】From Preference Data to Personalization: Tracing Sycophancy in Large Language Models

链接:https://arxiv.org/abs/2611.21650

作者:Himaghna Bhattacharjee,Yasha Sheynin,Shivam Singhal,Arjun Subramonian,Ankur Samanta,Julian Michael,Smitha Milli,Maximilian Nickel,Claudia Shi

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:experience warrants acknowledgment, large language models, warrants acknowledgment, large language, experience warrants

备注: 66 pages, 19 figures

点击查看摘要

Abstract:Sycophancy in large language models is often measured as agreement with the user, yet agreement can be appropriate when the user's claim is valid, their preference is genuine, or their experience warrants acknowledgment. We study sycophancy as inappropriate agreement: validating a claim, preference, or self-assessment when the context calls for correction, qualification, or resistance. We introduce a validity-aware sycophancy grader and SycoDrift, a persona-targeted evaluation set of 3,298 validity-annotated probes with controlled annotations for user openness and stakes. We use this framework to analyze three sources of agreement pressure: human preference data, automated judge specification, and in-context personalization. First, preference for validating responses in human datasets (Chatbot Arena, HH-RLHF, Community Alignment) is weak and concentrated where agreement is often appropriate. Second, in a selected-value, single-model experiment, emphasized judge rubrics produce consistent but modest increases relative to paired suppressed rubrics, demonstrating a plausible mechanism for training-time amplification. Third, in off-policy evaluations across 14 models, inference-time personalization increases inappropriate agreement, with the largest effect from matched user profiles placed directly before the query.

92. 【2611.21649】Literary Language Mashup: Curating Fictions with Large Language Models

链接:https://arxiv.org/abs/2611.21649

作者:Manzanarez Gerardo Aleman,Monroy Raul,Garcia Flores Jorge,Calvo Hiram

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:GrAImes framework, propose an alternative, alternative approach, fictions by employing, literary

备注:

点击查看摘要

Abstract:In this paper, we propose an alternative approach to human evaluation of literary fictions by employing LLMs themselves as evaluators within the GrAImes framework. We apply this methodology to assess human-written and AI-generated microfictions in Spanish, to five PhD professors in literature and sixteen literary enthusiasts, and to short stories in both Spanish and English. By comparing the evaluations performed by LLMs with those of human judges, we examine the degree of alignment and divergence between both perspectives, thereby assessing the feasibility of LLMs as auxiliary literary evaluators. Our analysis focuses on the alignment of responses from LLMs with those of human evaluators, providing insights into the potential of LLMs in literary assessment. The conducted experiments reveal that while LLMs cannot be regarded as substitutes for human judges in the evaluation of literary microfictions and short stories, with a Krippendorff's alpha reliability coefficient less than 0.66, they can serve as a valuable tool that offers an initial perspective on the editorial quality of the texts in question. Overall, this study contributes to the ongoing discourse on the role of artificial intelligence in literature, underlining both its methodological constraints and its potential as a complementary resource for literary evaluation.

93. 【2611.21648】Can an LLM dream? Testing the overfitted brain hypothesis on an agent with text memory

链接:https://arxiv.org/abs/2611.21648

作者:Eric Zou

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词:dreams distort replayed, distort replayed experience, Claude Opus, proposed that dreams, dreams distort

备注: 13 pages, 7 figures, 2 tables. Code and data: [this https URL](https://github.com/EricJujianZou/llm-dream)

点击查看摘要

Abstract:Hoel (2021) proposed that dreams distort replayed experience so that the brain does not overfit to recent events. We test this hypothesis on an LLM agent (Claude Opus 5.5) that stores what it learns in a text memory and rewrites that memory each night from the day's conversation transcript. The agent goes through ten simulated days of conversation built from LongMemEval. We corrupt 5, 10, 20 or 40 percent of the transcript's turns before each nightly rewrite in one of two ways. Detail corruption changes one or two details in a turn to plausible wrong ones, or replaces the turn with one by the same speaker from an earlier day. Random-text corruption replaces half of the selected turns with a passage of Moby-Dick and inserts Moby-Dick words into the other half. A size limit on the memory, rising from 19,500 to 117,000 tokens over ten nights, set from human free-recall data, forces it to forget. We learned that corruption did not help the agent apply what it learned in earlier conversations to new tasks in any of 30 runs (ten conditions, three different conversation histories). Replacing details in 40 percent of turns lowered recall from 76 to 60 percent. Random text had no consistent effect on recall, with a paired difference of 0 $\pm$ 2 points at 40 percent, because the model recognized it as corrupted and left it out of memory. Replaced details were stored as fact even when another turn held the correct value, and the agent answered 40 percent of those questions correctly, compared with 75 percent without corruption. These results suggest that a pretrained model can separate corrupted text from real events, so a fair test needs a learner that cannot make this separation as easily, such as a model fine-tuned on the corrupted days or an agent whose days take place in an invented world.

94. 【2611.21647】FieldGuide: A Corpus Map for Token-Efficient Agentic Document Exploration

链接:https://arxiv.org/abs/2611.21647

作者:Nick Hagar

类目:Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词:journalists explore large, Generative AI agents, explore large document, large document collections, journalists explore

备注: Presented at Computation + Journalism Symposium 2026

点击查看摘要

Abstract:Generative AI agents can help journalists explore large document collections. But exploratory workflows can require substantial token use and time, especially when the task is broad and the relevant subquestions are not yet known. This paper introduces FieldGuide, an agent-facing corpus map that organizes a document collection into a topic hierarchy and exposes tools for corpus orientation, scoped search, and bounded reading. I evaluate FieldGuide on five journalistic document-exploration tasks using 38 Chicago Police Department public-records documents, comparing it with raw-file access and retrieval-augmented generation. Across the five tasks, FieldGuide used 27% fewer tokens and 41% less elapsed time than raw-file access; relative to RAG, it used 38% fewer tokens and 21% less elapsed time. An accuracy audit identified four minor issues in FieldGuide's responses, comparable to the other conditions. In blind ratings of generated reporting leads, FieldGuide's mean ratings were higher than RAG's and lower than the raw-file condition's. These descriptive results suggest that corpus orientation may reduce runtime token use and elapsed time without severe accuracy failures. They also motivate further study of whether selective access limits broad, cross-document discovery.

95. 【2611.21646】Limite 1B - Violetto: Technical Report

链接:https://arxiv.org/abs/2611.21646

作者:Mario Prignano,Gabriele Cirillo,Alessio Morosini,Luca Cerovaz,Alessandro Bartolocci,Emanuele Rodolà,Giulio Starace,Francesco Pappone

类目:Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:designed for high-throughput, high-throughput mathematical reasoning, present Limite, Violetto, model designed

备注: 36 pages. Model, checkpoints and serving code: [this https URL](https://github.com/paradigma-inc/limite-violetto)

点击查看摘要

Abstract:We present Limite 1B - Violetto, a one-billion-parameter model designed for high-throughput mathematical reasoning. Limite is trained from scratch on 237 billion tokens from a carefully curated, mathematics-centric corpus and supports context lengths of up to 131k tokens. Its architecture and training recipe were developed together to maximize reasoning capability while keeping training and inference costs low. Post-training combines knowledge distillation, targeted supervised fine-tuning, and RLVR on a curated curriculum. Limite achieves 94.01% on AIME 2026 and 74.25% on BeyondAIME, placing it among models many times its size on our evaluation suite. The model is deliberately only lightly instruction-tuned: it is intended primarily as a single-turn mathematical solver and as a fast, parallel component of larger systems, rather than as a general-purpose assistant. We release the model, its base and value checkpoints, and an optimized serving implementation under the Apache 2.0 license.

96. 【2611.21645】Asking What Matters: Disagreement-Guided Ambiguity Detection for Interactive Text-to-SQL

链接:https://arxiv.org/abs/2611.21645

作者:Su Dong,Jiayan Lin,Yujia Liu,Zijin Hong,Qinggang Zhang,Feiran Huang,Xiao Huang

类目:Databases (cs.DB); Computation and Language (cs.CL)

关键词:generate executable SQL, SQL, limited interaction budget, generate executable, Interactive

备注:

点击查看摘要

Abstract:Interactive text-to-SQL requires an LLM agent not only to generate executable SQL, but also to decide which uncertainty to clarify within a limited interaction budget. However, current clarification policies have three limitations: (i) they target surface ambiguity without testing its SQL impact; (ii) they miss ambiguities implicit in schema routes or domain knowledge; and (iii) they spend limited turns on unfocused or redundant questions. These limitations expose a critical challenge: identifying SQL-impacting ambiguity before the intended SQL is known. In this paper, we propose DisGuAD, a Disagreement-Guided Ambiguity Detection framework that specializes clarification selection. DisGuAD treats disagreement among plausible SQL interpretations as direct evidence of which uncertainty matters to the final query. Specifically, it constructs a query-term inventory, elicits contrastive SQL interpretations through complementary probe families, compares their canonical SQL components, and attributes recurring differences to user-facing clarification targets. A lightweight prioritization and dialogue-state mechanism then selects one high-impact unresolved target for clarification. Experiments on BIRD-Interact Lite and Full with two LLM backbones demonstrate consistent improvements in task success and clarification quality. Compared with the original interaction policy, DisGuAD improves normalized Reward by 4.40--8.97 points and raises overall critical-ambiguity coverage from 48.62% to 82.75% and from 45.76% to 85.14%. Its clarification signals further improve two independently designed static text-to-SQL frameworks by up to 13.97 Reward points while keeping their SQL generators fixed. These results demonstrate that disagreement among plausible SQL queries provides actionable evidence for selecting clarification targets that matter to downstream generation.

97. 【2611.21644】MInfoVisQA: A Multilingual Benchmark for Information-Rich Visual Question Answering

链接:https://arxiv.org/abs/2611.21644

作者:Changjiang Jiang,Jiang Zhou,Xinbin Yuan,Fan Zhang,Tao Feng,Zhuohan Xie

类目:Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal large language, maintain consistent understanding, Multimodal large, excel in vision-language, vision-language tasks

备注: Dataset: [this https URL](https://huggingface.co/datasets/arnodjiang/MInfoVisQA) Code: [this https URL](https://github.com/arnodjiang/MInfoVisQA)

点击查看摘要

Abstract:Multimodal large language models (MLLMs) excel in vision-language tasks; yet, whether they maintain consistent understanding of information-rich visuals (InfoVis) when the surface language changes remains unclear. To quantify this capability, we introduce MInfoVisQA, a parallel benchmark with 8,960 QA configurations derived from 128 seed instances across 24 languages. We construct seed-matched, language-parallel visuals and QA pairs by disentangling numerical-structural data from text and programmatically synchronizing translated labels. We evaluate 25 MLLMs under two settings: Language-Aligned QA (LQA, matching visual-text languages) and Cross-Language QA (XQA, fixed QA language with varying visual languages). The results show that aggregate accuracy masks substantial robustness gaps: two models with comparable mean LQA accuracy (80.4\%) exhibit performance spreads of 7.8 and 20.3 percentage points across languages. Moreover, all 25 models score lower with non-English visuals under fixed English QA, underscoring the need for cross-language sensitivity metrics.

98. 【2611.21643】Sleep2Word: Peripheral-to-EEG Translation via Duration-Aware Wordization

链接:https://arxiv.org/abs/2611.21643

作者:Keondo Park,Arthur Delhaye,Younghoon Na,Hyun-Woo Shin,Hyung-Sin Kim

类目:Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

关键词:Estimating full-night electroencephalography, Estimating full-night, extend EEG-informed sleep, full-night electroencephalography, peripheral measurements

备注: 10 pages, 4 figures

点击查看摘要

Abstract:Estimating full-night electroencephalography (EEG) spectrograms from peripheral measurements could extend EEG-informed sleep analysis to recordings acquired without EEG. This task requires compact representations of signals with different temporal structures. We introduce Sleep2Word, a framework for translating respiration, electrocardiography (ECG), or photoplethysmography (PPG) into EEG spectrograms through duration-aware physiological words. Building on context-dependent chunking, Sleep2Word groups physiological embeddings into variable-duration chunks and jointly quantizes their content and duration into modality-specific wordbooks. A block-autoregressive translator then predicts target EEG word identities and occurrence-specific duration refinements within fixed-duration blocks. This design accommodates independent source and target wordbooks, limits temporal drift, and shortens the autoregressive decoding path. Trained on over 20K PSG cases across 9 datasets, Sleep2Word consistently outperforms existing spectrogram generation baselines in EEG spectrogram reconstruction, sleep staging, arousal detection, and survival prediction. Compressing full night sequences by up to 69.7%, the learned words yield a favorable accuracy-compute trade-off. Sleep event analysis further shows that the learned words capture physiologically plausible associations across modalities, suggesting their potential for interpretable cross-modal analysis.

99. 【2611.21641】RAW: Refusal Aversion in the Wild, A Causal Measurement Method for Deployed LLMs

链接:https://arxiv.org/abs/2611.21641

作者:Pavel Kireyev

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); General Economics (econ.GN)

关键词:consumer-facing platforms built, LLMs field hundreds, Deployed LLMs field, field hundreds, hundreds of millions

备注: Accepted to the EMNLP 2026 Industry Track. 26 pages incl. appendices, 8 figures, 11 tables. Code: [this https URL](https://github.com/Pashasan/raw-refusal-aversion-in-the-wild) Data: [this https URL](https://doi.org/10.5281/zenodo.22073974)

点击查看摘要

Abstract:Deployed LLMs field hundreds of millions of conversations a day and refuse a non-trivial fraction of user requests, yet the user-side cost of refusal, whether users disengage and by how much, is unmeasured on any production model: a blind spot for the consumer-facing platforms built on them. A/B-testing refusal is ethically and operationally constrained on frontier-lab products and unavailable to third-party platforms deploying these models through a fixed API. We introduce RAW, a method that uses LLM stochasticity as a natural experiment: at near-identical prompts in any existing log, the same model sometimes refuses and sometimes does not, and that variation identifies the causal user-side effect of refusal. Applying the method to 15 deployed LLMs in LMSYS-Chat-1M and WildChat, with user-clustered inference, we find that for about half of the models we can measure precisely, a refusal costs 3 to 17 pp of subsequent re-engagement; the rest show no distinguishable effect, among them one deployment whose positive point estimate we trace to persistent users retrying the refused request. Our contribution is the measurement method, which runs on any deployed model from logs alone for about \$0.30 per 1,000 conversations. We release labels, moderation scores, prompt embeddings, and pipeline code.

100. 【2611.21639】ClearTalk: Data-Driven Mandarin Articulation Analysis and Personalized Communication Support for Children with Dysarthria

链接:https://arxiv.org/abs/2611.21639

作者:Ben Xiaolu Huang

类目:Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

关键词:difficulty expressing everyday, experience reduced intelligibility, experience reduced, difficulty expressing, expressing everyday

备注: 5 pages, 3 figures, 1 table. Accepted to the IEEE ICDM 2026 Teen Research Track

点击查看摘要

Abstract:Children with dysarthria may experience reduced intelligibility and difficulty expressing everyday needs. ClearTalk is a smartwatch-based system that converts Mandarin speech-recognition differences into interpretable articulatory profiles for personalized practice and staged communication. Target and recognized utterances are aligned at the syllable level, summarized across seven articulatory positions, and ranked by a count-sensitive asymmetric heuristic. For 13 dysarthric speakers from the Mandarin Dysarthria Speech Corpus, system syllable-level accuracy showed a Pearson correlation of 0.908 with expert intelligibility, with an R-squared value of 0.824 and a p-value below 0.001. The system-selected priority targets achieved an 86.7 percent overlap with the consensus of three blinded speech-language pathologists; across 210 target consonants, automated labels achieved 86.7 percent agreement, a Cohen's kappa of 0.76, and a macro-F1 score of 0.81. In a balanced single-session pilot with 15 children, mean pre/post gains were 14.4, 29.4, and 27.7 percentage points for mild, moderate, and severe groups, while communication-round completion rates were 81.3, 66.7, and 48.0 percent. These findings support the feasibility of using interpretable patterns of speech errors to guide wearable articulation practice and communication assistance.

101. 【2611.21622】CrisisBench: an evaluation suite for crisis counseling AI

链接:https://arxiv.org/abs/2611.21622

作者:Akshay Swaminathan,Filip Ramazan,Sharang Phadke,Kevina Wang,Ivan Lopez,Shaked Peleg Azzam,Gloria Ye,Chastin Chung,William Wang,Stephanie Stoll,Ivy Pham,Rebecca Hurwitz,Shreya Shah,Samuel Chuang,Divyanjali Verma,Abhay John,Ehsan Adeli,Nigam H. Shah

类目:Computation and Language (cs.CL)

关键词:mental health systems, understaffed and underfunded, helplines are essential, essential to mental, mental health

备注:

点击查看摘要

Abstract:Background: Crisis helplines are essential to mental health systems but are often understaffed and underfunded. LLMs could support counselors, but existing benchmarks do not capture the escalation, risk assessment, and de-escalation central to crisis conversations, while privacy restrictions limit use of real transcripts. Methods: We present CrisisBench, a privacy-preserving suite for single- and multi-turn crisis counseling evaluation. It includes 1,085 single-turn tasks from 200 de-identified conversations and 1,185 patient LLMs derived from hotline metadata. Patient models and a 23-item LLM judge were calibrated against expert counselors. Results: We evaluated five GPT models plus draft-then-edit and retrieval-augmented generation. All systems underperformed human counselors on excessive empathy and questioning in single-turn evaluation. The rubric achieved human-human Krippendorff's $\alpha$ = 0.51 and LLM-human $\alpha$ = 0.54 (Pearson r = 0.80). In multi-turn evaluation, retrieval-augmented generation scored highest overall (0.961), with all systems within 0.058. Microskills and style/tone were near ceiling, while productivity and safety/risk accounted for most between-system variation. Counselors rated patient LLMs realistic (86%) and useful (92%). Conclusion: CrisisBench enables scalable, privacy-preserving evaluation of crisis counseling. Current systems perform strongly on core structural competencies but still diverge from experts on important response-level failure modes. We release the rubrics, judge prompts, and evaluation tasks.

102. 【2611.21980】Modeling Document and Section Hierarchies in Embedding Space

链接:https://arxiv.org/abs/2611.21980

作者:Kriste Krstovski,Sharyn O'Halloran,Kshitij Chandna

类目:Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:producing coherent topics, topic generation process, models integrate word, integrate word embeddings, topic models integrate

备注:

点击查看摘要

Abstract:Embedded topic models integrate word embeddings into the topic generation process, producing coherent topics and robust performance on large vocabularies. However, each document is represented by a single topic distribution, ignoring its internal structure. Many real world collections, including legal documents, company and government reports, and online discussion forums, exhibit hierarchical organization in which documents consist of multiple sections that often address distinct subtopics. We introduce the Hierarchical Embedded Topic Model (hETM), a structured topic model that couples the topic distribution of a document and those of its sections through a hierarchical prior in the embedding space. We derive an amortized variational inference procedure for hETM and evaluate it on structured collections from each of these domains. Experimental results show that hETM achieves the lowest or near-lowest held-out perplexity among flat and hierarchical topic model baselines, along with comparable or higher topic quality. It also performs strongly on a downstream clustering task, achieving the best clustering performance on most of the collections.

103. 【2611.18330】Marimba: A System One Model for Speech

链接:https://arxiv.org/abs/2611.18330

作者:Solano Amadori

类目:Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

关键词:applications require decisions, Speech applications require, term presence, audio window, applications require

备注: 12 pages, 4 figures, 4 tables. Code: [this https URL](https://github.com/Charcot-AI/marimba-api;) weights: [this https URL](https://huggingface.co/charcot-ai/marimba)

点击查看摘要

Abstract:Speech applications require decisions about term presence, turn completion, and language within an audio window. We present Marimba, an interface for typed speech decisions built on frozen Qwen3-ASR 0.6B features. Lexical questions use zero-shot scoring of ASR transcripts; non-lexical questions use a question-conditioned head and a separate layer-18 turn-end readout. Language identification uses the ASR model's own language scores. On private conversational test sets, decoder AUROC is 0.80-0.92; on public read speech it is 0.92-0.97. Speech Commands four-way accuracy is 0.93; binary lexical ECE is at most 0.08. Personal-information detection, which passes the greedy transcript to a private, curated PII pipeline, reaches item-level F1 0.904 on synthetic Brazilian Portuguese speech (1.000 on reference transcripts). Layer-12 speaker readouts detect speaker change with AUROC 0.966-0.980 on AMI and VoxConverse, above an ECAPA baseline, and count speakers (0, 1, 2, or 3+) more accurately than pyannote 3.1. The turn-end readout reaches AUROC 0.930 versus Smart Turn v3.2 at 0.982 on Smart Turn's own test set. On a subset of ICSI meetings labeled by next speaker, AUROC is 0.716 versus 0.712; the paired confidence interval includes zero.

信息检索

1. 【2611.23005】CARE: Conversational Affective Response Retrieval for Internet Memes

链接:https://arxiv.org/abs/2611.23005

作者:Jiajun Li,Leihan Zhang,Teng Zhang,Le Zhang,Qiang Yan

类目:Information Retrieval (cs.IR)

关键词:online communication, selection in online, contextual meaning, Conversational Affective Response, supports response selection

备注: 26 pages, 5 figures

点击查看摘要

Abstract:Conversational meme retrieval supports response selection in online communication, where relevance depends on both contextual meaning and affective expression. We study this task using two language-specific collections from Douban and Imgflip, containing 98,506 meme records across 5,583 discussion topics. Thread membership supplies weak relevance labels, while likes provide implicit ranking feedback. Automatically extracted sentiment, facial-expression indicators, and cross-modal consistency features support an exploratory analysis of engagement. We propose CARE, a Conversational Affective Response Retrieval framework that combines an emotion-enhanced CLIP retriever with a Jina-based reranker. The retriever incorporates free-form emotion descriptors through gated fusion and learns from multiple positive examples per query. The reranker combines query--image interactions with emotion representations and is trained using engagement-based ranking supervision. Under the reported topic-held-out protocol, CARE achieves Hit@10 of 24.03\% on Douban and 49.33\% on Imgflip, compared with 23.16\% and 41.07\%, respectively, for fine-tuned CLIP. These results support the utility of the complete two-stage system for recovering thread-associated memes. They do not independently establish perceived social resonance or isolate the contribution of affect from reranker training. The study provides a basis for further evaluation of affect-aware retrieval with human relevance judgments and controlled comparisons.

2. 【2611.22859】When the tail is earned by its companions: measuring label dependence in long-tailed multi-label classification

链接:https://arxiv.org/abs/2611.22859

作者:Christoffer Löffler

类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词:rare label seldom, label seldom occurs, seldom occurs, classifier can recover, companion-free recall

备注: 27 pages, 3 figures, 13 tables. Submitted to Information Sciences

点击查看摘要

Abstract:A rare label seldom occurs alone, and a classifier can recover it from the frequent labels it co-occurs with, its companions, without having learned the label itself. Existing diagnostics of this need a trained model: none says before training whether a corpus admits the failure, or what the standard aggregate hides. Macro-F1, like any measure built from per-label confusion counts, is unchanged by how a label's recall divides between occurrences with and without a companion. We introduce a within-label estimand of that division, a reading rule under which a fall in dependence counts only if companion-free recall rises, and a statistic of training labels that bounds, before training, how far reported recall can exceed companion-free recall. Across 23 corpora, 7 training objectives and five families of label-correlation mechanisms, companion-free recall falls short on all six corpora where the estimand is defined. Up to 18.4% of the tail true positives macro-F1 credits would vanish at the companion-free rate, within the training-label bound on every corpus. No long-tail objective reduces the dependence, but architecture moves it. Models whose tail score is computed from other labels' predictions are strongly dependent.

3. 【2611.22846】Music Similarity Learning in Sparse Latin Scenarios

链接:https://arxiv.org/abs/2611.22846

作者:Gabrielly Xavier dos Santos,Lucas Dias Cler,Olga Goussevskaia

类目:Information Retrieval (cs.IR)

关键词:estimates item-item music, propose a lightweight, publicly available metadata, work we propose, estimates item-item

备注:

点击查看摘要

Abstract:In this work we propose a lightweight, interpretable approach that estimates item-item music similarity from publicly available metadata. Our hybrid regression model combines content-based filtering with the classic item-based collaborative filtering. We test generalization via a zero-shot evaluation on Latin American music, a genre for which co-occurrence data is scarce. Accurately predicting similarity for these unseen, sparse pairs shows that our approach is robust to the regional gap affecting many existing systems, without the audio signal processing or the computational budget that deep multimodal approaches would require.

4. 【2611.22838】Better Rankers, Worse Retrievers: The Hidden Cost of RL Post-Training in Generative Recommendation

链接:https://arxiv.org/abs/2611.22838

作者:Yuheng Chen,Fan Zhang,Yixuan Xu,Chao Yang,Yang Xiang,Can Yang

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词:Generative recommenders decode, Generative recommenders, reinforcement learning, supervised fine-tuning, standard practice

备注:

点击查看摘要

Abstract:Generative recommenders decode the semantic ID of a user's next item with a language model, and post-training them with reinforcement learning (RL) after supervised fine-tuning (SFT) has become standard practice. The gains are mostly reported on the first ten results, yet in deployment such models hand hundreds of candidates to a downstream ranker or reward model. We show that RL post-training has a hidden cost: it improves accuracy at the top of the list (hit@K for small K) but, on all five datasets we study, lowers the recall of the candidate list (hit@K for K in the hundreds). The model becomes a better ranker and a worse retriever. Controlled experiments trace the loss to the negative advantages that RL assigns to the candidates it samples, the rollout. The root cause is that only one next item is logged per user, so RL treats every other candidate as wrong. Yet these candidates are the model's most plausible alternatives, and often the next items of other users with similar histories. Penalising them pushes down exactly what similar users choose next, and these items drop out of those users' candidate lists. This diagnosis points directly to a remedy: out-of-rollout anchoring, a single additional loss term that preserves the SFT model's ordering of the items outside the rollout. It keeps the gain at the top and restores recall to the SFT level on all five datasets, and it is effective under other RL configurations as well. To our knowledge, this is the first systematic study of this recall loss: we measure it, identify its cause, and show that, once the cause is known, a simple remedy suffices.

5. 【2611.22788】IntentGR: Enhancing Intent for End-to-End Personalized Generative Retrieval in Search

链接:https://arxiv.org/abs/2611.22788

作者:Gefan Ye,Yanjing Wu,Yinfu Feng,Zhiqiang Wang,Liang Li,Jun Xiao,Rong Xiao,Xiaoyi Zeng

类目:Information Retrieval (cs.IR)

关键词:Personalized generative retrieval, Personalized generative, long-term preference, jointly satisfy, satisfy the user

备注: 11 pages, 3 figures; Accepted by WSDM 2027 Findings

点击查看摘要

Abstract:Personalized generative retrieval in search should jointly satisfy the user's immediate search intent and long-term preference. Recent end-to-end approaches, primarily explored in recommendation, unify item tokenization and sequence generation within a single model, allowing semantic identifiers (SIDs) to be optimized toward the downstream generation objective. However, these methods often treat the query merely as an input feature, without explicitly leveraging it to guide either identifier learning or sequence generation. This leaves intent guidance weak in both the tokenization and the generation stage, causing generated semantic identifiers to drift toward high-frequency token patterns rather than the current search intent. In this work, we find that incorporating additional query-related evidence into the framework of end-to-end generative retrieval is important. Based on this finding, we propose IntentGR, an intent-enhanced end-to-end framework that strengthens query semantics at four complementary stages of the retrieval pipeline. Query-Aware Semantic Behavior Representation (QBR) introduces query-level behavioral evidence as a new input signal; Query-Semantic Alignment (QSA), Long-Tail Query Enrichment (LQE), and Query-conditioned Attention Modulation (QAM) then serve as integration mechanisms at the optimization, training-distribution, and decoding stages to fully exploit this evidence. Experiments on the public AOL4PS benchmark and AE, a large-scale industrial e-commerce dataset, show that IntentGR improves Recall@10 by 8.11% and 11.96% over the strongest baseline, with strong gains on long-tail queries. These results suggest that enriched query-related input evidence, together with effective integration mechanisms, is beneficial for building intent-aware end-to-end generative search systems.

6. 【2611.22756】Learning Cross-Domain Media Similarity from Amazon Reviews

链接:https://arxiv.org/abs/2611.22756

作者:Gabrielly Xavier dos Santos,Lucas Dias Cler,Luciana Fujii Pontello,Olga Goussevskaia

类目:Information Retrieval (cs.IR)

关键词:Collaborative filtering, recommendation algorithms, basic foundation, Collaborative, Abstract

备注:

点击查看摘要

Abstract:Collaborative filtering is a basic foundation of many recommendation algorithms. It works by analyzing a user's history and then suggesting items similar to those in that history. This method typically relies on user data to compute item similarity, data that is widely available to commercial systems but is usually sparse or inaccessible for independent systems and research, especially across multiple media domains. In this work, we propose a method to generalize similarity information between items using supervised learning. As input to our model, we use semantic and temporal features extracted from Amazon product reviews, which are publicly available. As the training target, we use item (product) co-occurrence in the reviewing history of Amazon customers. We evaluate the quality of the predicted similarities across two media domains: books and movies. Experimental results demonstrate the robustness of our methodology, yielding positive outcomes in zero-shot cross-domain transfer tasks. Furthermore, feature attribution analysis reveals a structural shift in how feature groups are utilized across setups: intra-domain models rely heavily on linguistic semantics, whereas cross-domain environments pivot toward behavioral popularity cues. Incorporating even limited target-domain context during training bridges this domain sparsity gap, significantly enhancing framework generalization.

7. 【2611.22509】MIPR: A Benchmark for Reasoning-Intensive Multimodal Intent-to-Product Retrieval with Multi-Category Solutions

链接:https://arxiv.org/abs/2611.22509

作者:Qiang Li,Xuan Lu,Jian Ruan,Manxi Lin,Jiacheng Chen,Wen Shen,Zhihua Wei,Xiaoyu Shen,Dan Ou,Xiangheng Kong,Junjun Zheng

类目:Information Retrieval (cs.IR)

关键词:Real-world e-commerce queries, Real-world e-commerce, express user intent, express user, Real-world

备注: 14 pages, 8 figures

点击查看摘要

Abstract:Real-world e-commerce queries often express user intent without naming a target product, and a single intent may be fulfilled by products from multiple categories. However, existing multimodal retrieval benchmarks typically assume a relatively well-defined target, leaving retrieval for intents with multi-category solutions less explored. To fill this gap, we introduce MIPR, a benchmark for Multimodal Intent-to-Product Retrieval comprising 3,522 multimodal queries and a shared corpus of 30,731 products. MIPR features reasoning-intensive retrieval, multi-category solutions, and fine-grained relevance labels. Experiments show that the best embedding-based retriever achieves 49.23% nDCG@10 on the full query set, and 55.86% solution-category recall@10 on queries with multiple solution categories. Reranking improves these scores to 60.11% and 67.00%, respectively, yet substantial gaps to the candidate-pool oracle remain. These results establish MIPR as a challenging and diagnostic benchmark for evaluating multimodal intent-to-product retrieval. The data and code are publicly available at this https URL.

8. 【2611.22503】From Relevance to Utility: Rubric Alignment in Yuanbao Search

链接:https://arxiv.org/abs/2611.22503

作者:Yu Lu,Lixin Zou,Yangqi Chen,Hui Xu,Qiaolin Xia,Hao Wang,Qianwen Ma,Reed Li,Shuang Zeng,Haijin Liang,Haibo Shi

类目:Information Retrieval (cs.IR)

关键词:downstream LLM reasoning, Agentic search demands, downstream LLM, search engine move, LLM reasoning

备注: 10 pages, 5 figures, 5 tables, accepted at KDD 2027

点击查看摘要

Abstract:Agentic search demands that a search engine move beyond per document relevance ranking to assemble document sets optimized for downstream LLM reasoning. Prior work addresses this either by improving individual pipeline stages in isolation or by applying RL based selection on top of relevance trained upstream modules, leaving the full stack unaligned to utility for reasoning. We propose rubric aligned search, a framework that unifies the traditional search pipeline under a single supervision surface. For each query, we derive a rubric from coarse to fine, specifying weighted positive criteria that the document set must satisfy and negative criteria that it must avoid. From this rubric we derive two training signals. First, a lightweight labeler distills rubric grounded judgments into per document utility labels, which supervise a contrastive dual encoder for retrieval and a multi task ranker trained with four rubric aligned scoring heads. Second, a rubric conditioned evaluator produces a set level reward that drives a dual branch RL selector, combining GRPO with best rollout distillation to resolve credit assignment in subset optimization. Deployed in Yuanbao Search, the pipeline improves end to end answer quality by 8.52% over the online production baseline.

9. 【2611.22410】More Than a Score: Reinforcement Learning with Verbalized Feedback for Generative Recommendation

链接:https://arxiv.org/abs/2611.22410

作者:Zipeng Chen,Xinyu Lin,Yuliang Sun,Sheng Zhang,Zeyu Wang,Xiaowen Shi,Junwei Pan,Chengguo Yin

类目:Information Retrieval (cs.IR)

关键词:Large language models, users' interaction histories, Large language, interaction histories, generated directly

备注: 10 pages, 11 figures and tables

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used for generative recommendation, where recommended items are generated directly from users' interaction histories. To further improve recommendation quality, reinforcement learning (RL) has been applied to align these models with recommendation objectives. However, existing RL methods rely on scalar rewards to implicitly guide exploration. These rewards do not specify which aspects of a candidate conflict with the user's preferences or how the next candidate should differ. To address this gap, we propose VerRec, a verbalized feedback-guided RL framework for generative recommendation. Specifically, a user simulator generates personalized verbalized feedback based on the user's historical preferences and the candidate item profile. The policy uses this feedback to produce refined recommendations. Original and refined candidates form an expanded group and are jointly optimized with group relative policy optimization. The user simulator is only required during training and is removed at inference time. Experiments on three Amazon review datasets with two generative recommendation backbones demonstrate that VerRec improves recommendation accuracy and ranking quality. Further analyses show that verbalized guidance encourages exploration of more diverse candidates and helps the policy discover more rewarding recommendations during training.

10. 【2611.22392】Deal With It: On Better Schedules for Listwise Reranking

链接:https://arxiv.org/abs/2611.22392

作者:Benjamin Clavié,Herumb Shandilya,Hanna Lichtenberg,Aamir Shakir,Makoto P. Kato

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词:Listwise LLM rerankers, Listwise LLM, reliably rank hundreds, rerankers cannot reliably, hundreds of documents

备注:

点击查看摘要

Abstract:Listwise LLM rerankers cannot reliably rank hundreds of documents in a single call, and rely on schedules to orchestrate their calls. Parallel schedules split candidates into groups and advance a fixed quota from each. When a group holds more of the top passages than its quota, some are cut, and expensive repair calls become required. We show that the way candidates are split matters where such a quota can bind, and that, in expected cuts, the best split there deals them round-robin by retriever rank, like cards. Although not conceptually new, dealing has remained unanalyzed. We prove that, under a simple retriever model, no split with equal quotas cuts fewer of the true top ten on average, and that contiguous chunks cut more as the retriever improves. DealRank, the simplest schedule our analysis allows, is on average within 0.1 nDCG@10 points of the best schedules over six LLMs, in two rounds. It is consistently 1.1 to 1.4 times faster than BlitzRank with concurrent first calls up to a thousand candidates. There, it needs three rounds and is eleven times faster than the sliding window. In existing schedules such as BlitzRank, dealing reduces repair calls from 59% of queries to 14%, improving latency with no significant change in quality. Random partitioning appears equivalent at a quota of four, as predicted, but ties results to the seed and trails by 1.3 nDCG@10 points at a quota of one over a dense retriever.

11. 【2611.22382】RICoT: Recurrent Interleaved Chain-of-Thought for Page Stream Segmentation

链接:https://arxiv.org/abs/2611.22382

作者:Prashant Khatri,Bhavana Malagavalli,Saiful Haq,Niyati Chhaya

类目:Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词:Page Stream Segmentation, Large language models, Large language, Stream Segmentation, splitting a multi-page

备注: 18 pages, 3 figures, 19 tables. Dataset and code to be released

点击查看摘要

Abstract:Large language models (LLMs) have renewed interest in Page Stream Segmentation (PSS), splitting a multi-page file into its constituent documents. Yet published LLM methods still frame the task as boundary classification over one or a few neighboring pages, and commercial document-splitting APIs do not disclose their methods. We reimagine PSS for LLMs as a sequential process over the whole stream and propose RICoT (Recurrent Interleaved Chain-of-Thought), a prompting framework that works through the pages as a reader would: within a sliding window it reasons about each page and commits its boundary decision before moving on, and across windows it carries forward a compact record of what it has read, keeping per-call cost bounded. We also introduce FinancePSS-205, a benchmark of 205 real-world, de-identified financial page streams, to be released publicly. On FinancePSS-205, RICoT matches or outperforms pairwise and windowed prompting with the same backbone for each of three open-weight LLMs; on a TABME test subset, RICoT with GLM-5 reaches document F1 0.847 and boundary F1 0.915, above published zero-shot results. A 2B-parameter student, trained on a larger teacher's decisions with and without the page-level reasoning, performs comparably in both modes and comes within 0.05 document F1 of the strongest prompted model on FinancePSS-205.

12. 【2611.22353】NONSENSE: Non-Semantic Strings Expose Semanticity Gaps in Dense Retrieval

链接:https://arxiv.org/abs/2611.22353

作者:Ankit Gupta

类目:Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词:question answering, modern search, retrieval-augmented generation, retrieval is central, central to modern

备注: Accepted to EACL 2027 (Main Conference). 15 pages

点击查看摘要

Abstract:Dense retrieval is central to modern search, question answering, and retrieval-augmented generation, where high similarity is often treated as evidence of semantic relevance. We examine how far this assumption can be stressed. NONSENSE is a black-box sparse-edit probe that constructs visibly non-semantic strings while forbidding query-term copying, optimizing only the dense similarity between a query and the string. Across five BEIR-style datasets and three popular single-vector retrievers, these strings frequently outscore the retriever's own best judged query-relevant passage (QRP), and often rank first in the full corpus. The result indicates a semanticity gap in the evaluated dense retrievers: nearest-neighbor status can be separated from passage-like meaning. These findings highlight the importance of evaluating dense retrievers not only by whether they retrieve relevant documents, but also by how reliably their similarity scores reflect semantic evidence.

13. 【2611.22274】GuardAgent: A Memory-Augmented Agentic Framework for Adaptive Detection of Adversarial Promotions in LLM-Based Recommendation

链接:https://arxiv.org/abs/2611.22274

作者:Shiyi Yang,Xinshu Li,Chen Wang,Xiwei Xu,Liming Zhu,Lina Yao

类目:Information Retrieval (cs.IR); Cryptography and Security (cs.CR)

关键词:traditional recommender systems, textual information typically, information typically serves, textual information, recommender systems

备注: Accepted by WSDM 2027

点击查看摘要

Abstract:In traditional recommender systems (RSs), textual information typically serves as auxiliary signals for representation learning. In contrast, in LLM-based RSs, textual information becomes the primary medium for recommendation generation through semantic understanding and reasoning. This shift fundamentally changes the attack surface, making promotion-driven manipulations more feasible, effective, and harder to detect. However, effectively detecting such attacks remains largely unexplored. To fill this gap, we present the first systematic study on detecting promotion-driven attacks against LLM-based RSs, aiming to safeguard next-generation recommendation platforms. Specifically, we propose GuardAgent, a novel LLM-powered agentic detection framework that operates through a loop of Perception, Action, Reflection and Memory. In contrast to conventional LLM-based detectors that function in a static, one-off, and opaque fashion, GuardAgent continually learns and self-evolves to adapt to unseen threat patterns while generating explainable reasoning traces and outcomes. Extensive experiments on real-world datasets demonstrate that GuardAgent achieves state-of-the-art generalization performance, laying the foundation for robust and trustworthy recommendation in practical settings.

14. 【2611.22270】aching Language Models to Narrow Boolean Patent Searches from Search Feedback

链接:https://arxiv.org/abs/2611.22270

作者:Seiya Kawano,Koji Marusaki,Hirofumi Nonaka,Koichiro Yoshino

类目:Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:searchers issue Boolean, issue Boolean queries, Japan Patent Office, Patent prior-art searchers, Boolean queries line

备注: 13 pages, 3 figures, 3 tables. Accepted at NLPIR 2026

点击查看摘要

Abstract:Patent prior-art searchers issue Boolean queries line by line, broadening to find relevant documents and narrowing until candidates can be screened. We distill 38,397 Japan Patent Office search reports into executable expert strategies, re-execute them, and evaluate generated strategies by citation recall and the smallest set containing each citation. Prompted models write valid, high-recall strategies but leave citations in sets too large to screen. We adapt a generator offline from scored rollouts in two forms: strategy-level learning from a screening-aware strategy score, and line-level learning from citation-preserving narrowing credit, which upweights the query lines keeping a found citation in a smaller set. On shared rollouts, line-level credit outperforms strategy-level scores on screening measures; iterated, it cuts the median citation-containing set from 768 to under 50 and places more citations in sets under 100 documents than experts, at lower recall. Strategy-level preference learning reaches near-complete recall; the two forms are complementary.

15. 【2611.22163】Cluster-Guided Decoding with Trust-Region Constraints for Personalized Recommendation

链接:https://arxiv.org/abs/2611.22163

作者:Gezheng Wen,Chao Shen,Raviteja Anantha,Tan Shen Cliff Chung,Layne C. Price

类目:Information Retrieval (cs.IR)

关键词:recommenders score, catalog separately, Cluster-Guided Generative Reconstruction, explicitly model, semantic region

备注: 5 pages, 2 tables

点击查看摘要

Abstract:Most recommenders score each item in the catalog separately, and do not explicitly model which semantic region of the catalog a recommendation belongs to. Models expressive enough to offer that control are often too slow to run over a full catalog for online inference. In this paper, we present Cluster-Guided Generative Reconstruction (CG2R), which learns a hierarchy of semantic clusters and uses a cluster-level prior to steer item ranking for personalized recommendations. Unlike existing systems that only use clusters to pre-select candidates, CG2R adds the cluster prior directly to the item scoring rule, so that the learned cluster structure shapes the ranking itself. Because the prior is assembled from cluster centroids rather than per-item statistics, it remains defined even for cold-start users when no history is available. Across the three benchmark datasets evaluated, CG2R outperforms classical, neural, and LLM-based baselines in terms of Recall and nDCG, with its performance gains widening as the catalog grows sparser. In addition, CG2R serves recommendations in milliseconds, suggesting potential as low-latency first-stage retrieval.

16. 【2611.22079】SIMQ: A Single Graph-based Index for Multi-Vector Query

链接:https://arxiv.org/abs/2611.22079

作者:Yifan Lu,Jiabao Jin,Xiaoyao Zhong,Peng Cheng,Xiangyu Wang,Haotian Li,Hua Chen,Junqing Chen,Wei Xi,Heng Tao Shen

类目:Information Retrieval (cs.IR); Databases (cs.DB)

关键词:high computational cost, computational cost limits, cost limits scalability, Multi-vector retrieval models, Single graph Index

备注: under ICDE 2027 review, 13 pages

点击查看摘要

Abstract:Multi-vector retrieval models such as ColBERT achieve state-of-the-art effectiveness by representing documents as sets of token-level vectors and scoring via MaxSim, but their high computational cost limits scalability to large corpora. Existing approximate methods face fundamental bottlenecks: centroid interaction matrix approaches require computing a full matrix at every query and rely on GPU-accelerated clustering, while data-oblivious compression methods yield unstable recall that requires repeated compensation. We propose SIMQ (Single graph Index for Multi-vector Query), a framework that bridges single-vector graph indices and multi-vector retrieval through data-aware sampling-based clustering and per-token graph navigation, simultaneously bypassing all aforementioned bottlenecks. SIMQ organizes all token vectors into fine-grained clusters via data-aware sampling, builds a single graph index over cluster centroids independently of PLAID's residual representation, and approximates the MaxSim score through per-token graph search without materializing any interaction matrix or relying on GPU acceleration. We provide theoretical analysis showing that, under a manifold assumption and successful cell retrieval, data-aware partitioning has a smaller expected approximation error than a data-oblivious partition. Building on this foundation, SIMQ+ further introduces count-based scoring and a dynamic candidate set to improve robustness across varying query conditions. Experiments on five benchmarks compare recall, throughput, and construction time against several baselines, primarily on CPU; large-scale PLAID k-means centroids are built on a separate GPU machine. SIMQ has been integrated into VSAG, an Ant Group's open-source vector search library.

17. 【2611.21974】Beyond Bitwidth: Deployment-Constrained Mixed-Precision Quantization for Multilingual LLM Inference on NVIDIA Blackwell

链接:https://arxiv.org/abs/2611.21974

作者:Hyojung Han

类目:Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词:Low-bit LLM quantization, supported GPU kernels, Low-bit LLM, model preserves service-relevant, GPU kernels

备注: 18 pages, 2 figures

点击查看摘要

Abstract:Low-bit LLM quantization is useful only if a model preserves service-relevant accuracy, executes through supported GPU kernels, and meets measured memory and latency limits. We study Qwen3-8B on NVIDIA B200 with vLLM, including INT2/INT3, GPTQ, NVFP4, and mixed-precision configurations. We verify native packed execution and precision on all 144 fused linear modules and evaluate Korean, English, numerical, and reasoning quality under preregistered gates. Packed INT2 and INT3 execute, but all seven tested INT2 grids degenerate on generation. Isolated module-restoration effects are strongly non-additive; Korean and reasoning sensitivity rankings disagree, and a promising INT4/INT8 development candidate fails independent final evaluation. A configuration with 16-bit activations, 98 NVFP4 weight-only modules, 46 INT8 modules, and an INT8 output head passes all gates on the untouched FINAL-81 set (5,168 items): 5.917 GiB of weight-loading memory (limit 5.98), Korean teacher-correct retention 0.904 (gate 0.90), and TPOT ratio 0.939 relative to BF16. It improves paired accuracy over NVFP4 W4A4 by +1.4 percentage points (Bonferroni-adjusted interval [+0.2, +2.6]), compared with +3.4 points on the selection set. This comparison changes both activation precision and INT8 protection; exploratory analyses suggest that the activation change contributes substantially, but the isolated allocation effect is not established. Final checkpoints were not retained, and bitwise rebuild reproducibility remains unverified.

18. 【2611.21825】Urban Representation Learning for Identifying Potential Disparities in Crime Reporting

链接:https://arxiv.org/abs/2611.21825

作者:Jorge Valverde-Rebaza,Carlos Paez De La Cruz,Pedro Pérez-Collado,Daniel Sánchez-Cataño,Eashley Martínez-Vergara

类目:Machine Learning (cs.LG); Computers and Society (cs.CY); Information Retrieval (cs.IR)

关键词:Open crime data, urban safety analysis, Open crime, potentially introducing spatial, introducing spatial distortions

备注: Accepted for publication in International Conference on Artificial Intelligence, Computer, Data Sciences, and Applications (ACDSA 2027)

点击查看摘要

Abstract:Open crime data support urban safety analysis but reflect reported incidents rather than the complete distribution of criminal activity, potentially introducing spatial distortions in downstream analysis. We propose a self-supervised urban representation learning framework for identifying unusual reporting patterns relative to representation-similar peers using only georeferenced crime records. The method constructs complementary hourly, weekly, and static reporting profiles, learns scale-specific representations under geographic self-supervision, and integrates them into a unified latent space. Neighbor Profile Divergence (NPD) is then used to quantify disagreement between each region's reporting profile and those of its retrieved peers. Experiments on more than 1.8 million crime records from Mexico City, aggregated into 1,058 H3 regions, show that the proposed representation achieves a mean Silhouette score of 0.4052, compared with 0.2863 for Hex2Vec. NPD rankings remain highly stable across neighborhood sizes, with Spearman correlations from 0.9720 to 0.9951, while most high-divergence candidates persist across configurations. The retrieved peers also extend substantially beyond immediate geographic neighborhoods, indicating that the learned representation captures structure beyond local spatial proximity. High-divergence regions exhibit spatially organized patterns and, in several cases, differences in incident volume relative to peer expectations. These results support NPD as an internal auditing and prioritization mechanism for identifying regions that warrant further investigation, rather than as direct evidence of underreporting.

19. 【2611.21625】Evaluating AST-Derived Knowledge Graph Retrieval for AIOps Incident Diagnosis in Apache Kafka

链接:https://arxiv.org/abs/2611.21625

作者:Shashank Mishra,Shweta Mishra

类目:oftware Engineering (cs.SE); Information Retrieval (cs.IR)

关键词:Incident diagnosis requires, diagnosis requires retrieving, Incident diagnosis, requires retrieving source-linked, retrieving source-linked operational

备注: 24 pages, 6 tables, 1 figure. Preprint

点击查看摘要

Abstract:Incident diagnosis requires retrieving source-linked operational evidence from large codebases. We evaluate graph-augmented retrieval for Apache Kafka using an abstract-syntax-tree (AST)-derived ownership graph over 1,600 source-linked log records and an audited benchmark of 315 incident-style queries covering 103 unique targets. Vector-only retrieval is a strong baseline at Recall@20 of 0.956, and neither static nor confidence-guided staged AST expansion significantly improves Recall@20 over it. As an external control we evaluate HippoRAG, a published text-derived graph-retrieval system, against its own ColBERTv2 retrieval backbone. Against ColBERTv2-only (Recall@20 0.803), HippoRAG attained 0.308; a post-hoc document-ensemble sensitivity raised Recall@20 to 0.648 but did not eliminate the deficit. Relative to static expansion, staging reduces cross-encoder pair workload and measured reranking time by about 52%. A manually evaluated 100-query downstream study finds no significant root-cause-correctness advantage for AST-derived structural evidence.

20. 【2611.21941】Complexity and precision in quantum associative retrieval

链接:https://arxiv.org/abs/2611.21941

作者:Carlo A. Trugenberger

类目:Quantum Physics (quant-ph); Computational Complexity (cs.CC); Information Retrieval (cs.IR); Neural and Evolutionary Computing (cs.NE)

关键词:exponential complexity advantage, polynomial capacity advantage, brute force approach, neural network implementations, classical brute force

备注:

点击查看摘要

Abstract:We show that efficient and high-precision quantum associative retrieval is possible with an exponential complexity advantage with respect to the classical brute force approach and with a polynomial capacity advantage with respect to classical neural network implementations for any number of patterns scaling polynomially in the number of qubits. Both classical neural and quantum associative memories store the patterns in a Hamiltonian; in the classical case the dynamics is irreversible relaxation toward attractors, in the quantum case it is unitary transformations generating an effective thermal distribution, followed by a measurement.

计算机视觉

1. 【2611.23228】Spool: Low-Latency Streaming Inference for Hybrid Vision-Language Models

链接:https://arxiv.org/abs/2611.23228

作者:Rui Ning,Om Chabra,Hari Balakrishnan

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:visual accessibility agents, robotics require answering, require answering questions, video content promptly, content promptly

备注:

点击查看摘要

Abstract:Applications such as visual accessibility agents and robotics require answering questions about recent video content promptly, over a bounded window of past frames (e.g., the last two minutes). Hybrid vision-language models (VLMs), which interleave attention with linear recurrent layers such as Gated DeltaNet (GDN), are attractive for this setting, but maintaining a sliding window is expensive. The reason is that recurrent layers combine all past frames into a shared state, so expiring old frames normally requires re-running the entire window through the model. We observe that the recurrent update is affine in the state with input-dependent coefficients, so the effect of each frame can be captured as a transformation that composes associatively. We present Spool, a training-free framework that caches per-frame state transformations and composes them efficiently as the window advances, removing expired frames from each recurrent layer's state without replaying frames through the backbone. Removal is exact within each layer; as with key-value eviction in attention, expired frames can retain residual influence through the cached inputs computed by earlier layers. We design a dedicated data structure and GPU kernels to achieve low caching and composition overhead. Across five open-source hybrid VLMs and four video reasoning benchmarks, Spool achieves the lowest p95 time-to-first-token in all 20 model-benchmark tests, reducing it by a geometric mean of $6.6\times$ over the faster of two recent vLLM baselines, while improving accuracy by 2.3 percentage points on average.

2. 【2611.23226】FastFrames: Video Generation at Interactive Latency

链接:https://arxiv.org/abs/2611.23226

作者:Gene Chou,Guandao Yang,Fujun Luan,Lars Mescheder,Wei Dong,Stephan Richter,Vladlen Koltun

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Autoregressive video diffusion, generate frames based, diffusion models generate, video diffusion models, observations and inputs

备注: Project page: [this https URL](https://apple-aiml-research.github.io/ml-fastframes/)

点击查看摘要

Abstract:Autoregressive video diffusion models generate frames based on new observations and inputs, making them a promising medium for interactive visual experiences. However, existing models are orders of magnitude too slow for fluid interaction. This paper introduces FastFrames, a family of fast autoregressive video diffusion models that achieves interactive latency without compromising quality. We profile the inference pipeline of state-of-the-art models and find that operations often treated as fixed implementation details, such as VAE decoding and KV cache updates, in fact account for over half of end-to-end inference latency. We challenge the assumption that these components are indispensable and replace them with lightweight alternatives. Our 1.3B variant runs at 36 ms per frame, or 28 responses per second (RPS), on a single B200 GPU while matching the generation quality of a state-of-the-art model that is nearly 8x slower. Our 14B variant runs at 45 ms per frame, or 22 RPS, on an 8x B200 GPU node and yields significantly better visual quality and realism. We show that FastFrames enables real-time interaction in applications such as camera-conditioned and physics-conditioned video generation.

3. 【2611.23212】EviSlide-MIL: Multi-Query Pooling and Shared Prediction for Class-Incremental Whole-Slide Image Classification

链接:https://arxiv.org/abs/2611.23212

作者:Zhouhan Qian,Sicheng Chen,Chad Wong,Tianyi Zhang,Enhui Chai,Zeyu Liu,Fei Xia

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Histopathological analysis, whole-slide images, plays a critical, weak supervision, extending existing MIL

备注:

点击查看摘要

Abstract:Histopathological analysis of whole-slide images (WSIs) plays a critical role in cancer diagnosis, and multiple instance learning (MIL) is widely adopted for WSI analysis under weak supervision. As new tumor subtypes are introduced, extending existing MIL models requires learning new classes while retaining knowledge of previously learned ones. This presents a class-incremental learning challenge, where models must acquire new classes with limited access to historical training data and recognize all learned classes without task identifiers at inference. A major obstacle is forgetting, as updates to feature aggregation and prediction modules can degrade performance on previously learned classes. To address this challenge, we propose \textbf{EviSlide-MIL}, a class-incremental WSI framework that integrates multiple learnable queries per class with a shared prediction module. The queries aggregate frozen patch features into class-specific representations, while the shared prediction module limits parameter growth across incremental stages. By freezing queries associated with previously learned classes, EviSlide-MIL preserves their attention patterns for identical inputs, while experience replay and knowledge distillation further mitigate forgetting as shared parameters are updated. Experiments on eight tumor subtypes from The Cancer Genome Atlas demonstrate that EviSlide-MIL achieves improved performance and reduced forgetting compared with competing methods across most learning settings, demonstrating its potential for scalable and knowledge-preserving WSI classification. Code and pretrained models will be released.

4. 【2611.23211】Multimodal Masked Diffusion Autoencoder for Modeling Impaired Driving

链接:https://arxiv.org/abs/2611.23211

作者:John Gideon,Anshul Gupta,Megan Applegate-Kenton,Kayli Battel,Todd J Rowell,Patricio Reyes Gomez,Laporsha Dees,Emily Sumner,Avinash Balachandran,Guy Rosman

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)

关键词:Human cognitive state, Human cognitive, cognitive state levels, assist drivers, obtain at scale

备注: Equal contribution: John Gideon and Anshul Gupta. 8 pages, 6 figures. Submitted to CVPR 2027

点击查看摘要

Abstract:Human cognitive state (e.g., distraction, stress), gaze, and behavior interact with the driving environment in subtle ways that AI could use to assist drivers, but ground-truth labels for human cognitive state levels are costly to obtain at scale. We propose a multimodal masked-diffusion autoencoder, ID-MAE, that adds a self-supervised objective to impairment prediction: alongside predicting the impairment label as a masked token, it reconstructs masked gaze and trajectory. To probe the effects of different modalities and types of impairments on model inference, we introduce DIVERT, a driving-simulator dataset containing 103 hours of driving data (n = 109) with ten impairment inductions spanning cognitive, visual, and emotional states, recorded with gaze, vehicle state, and scene video. We demonstrate how ID-MAE affords significant improvements in impairment inference results on both the DIVERT dataset and existing datasets, and enables strong results in additional tasks, such as trajectory and gaze prediction. For location-matched pairs, our model achieves a paired AUC of 0.706 for impairment detection on DIVERT, compared to 0.590 without reconstruction loss, improving over existing baselines. We probe the design space in terms of input modalities, masking scheme, positional encoding, attention mechanism, and decoding. We also investigate the interaction between various impairments in training and inference, demonstrating that visually demanding distractions are separable from cognitive distractions. Code and data will be available upon acceptance.

5. 【2611.23209】Learning Grounded Reasoning from Human Gaze

链接:https://arxiv.org/abs/2611.23209

作者:Gabriel Sarch,Declan Campbell,Nicholas Budny,Kia Ghods,Katerina Fragkiadaki,Jonathan D. Cohen,Brenden M. Lake,Taylor W. Webb

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:task-relevant visual evidence, Human, Human gaze, gaze, driven by systematic

备注:

点击查看摘要

Abstract:Human visual reasoning is driven by systematic exploration and extraction of task-relevant visual evidence. Human gaze provides a window into this process, making gaze a useful source of guidance for visually-grounded reasoning in vision-language models (VLMs). However, human gaze also includes noise and redundancies that may transfer poorly to VLMs. In this work, we investigate how human gaze data can be effectively leveraged to improve visual reasoning in VLMs, while maintaining alignment with human behavior. We collect 7,109 human gaze trials from a diverse and challenging set of visual reasoning tasks, and train grounded reasoning models with different forms of gaze guidance. Across evaluations in chart understanding, visual search, and counting, we find that using human gaze as a prior for grounded reasoning consistently outperforms supervision using the full gaze sequence. Based on these findings, we introduce GGR (Gaze-Guided Reasoner), which achieves greater human alignment and more reliable visual grounding while matching or outperforming leading grounded-reasoning baselines in accuracy. Reinforcement learning further improves task accuracy, gaze alignment, and grounding quality despite using no gaze supervision. Behavioral analyses show that gaze supervised models exhibit more visual exploration before arriving at an answer. Our results suggest that the value of human gaze lies in guiding spatial exploration and shaping reasoning behavior without requiring complete imitation of human behavior.

6. 【2611.23208】Distortion-Free Semantic Watermarks for Black-Box Generative Models

链接:https://arxiv.org/abs/2611.23208

作者:Aviv Yossef,Or Patashnik,Or Zamir

类目:Machine Learning (cs.LG); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

关键词:semantic watermarking algorithm, provably distortion-free semantic, present a provably, distortion-free semantic watermarking, provably distortion-free

备注: Project page: [this https URL](https://avivyossef.github.io/distortion-free-semantic-watermark/) Code: [this https URL](https://github.com/avivyossef/distortion-free-semantic-watermark)

点击查看摘要

Abstract:We present a provably distortion-free semantic watermarking algorithm that requires only black-box sampling access to a generative model and black-box access to a semantic embedding. A watermark is called distortion-free if, averaged over its secret detection key, it leaves the generator's output distribution unchanged; this provides a formal guarantee that watermarking does not reduce output quality. Conventional such watermarks are often brittle to transformations. This is especially problematic for images, where benign operations such as compression, cropping, or resizing change the entire pixel representation. Semantic watermarks therefore require detection to be robust to content-preserving transformations. Previous methods combining these properties rely heavily on specific white-box properties of the underlying model: either to autoregressive text generation or to diffusion-specific access, such as control of the initial noise or diffusion inversion. In contrast, our construction is fully generic: It only interacts with the generative model and the semantic embedding, a function that determines the notion of "preserving content" under which detection should be robust, via sample and query access. We then instantiate this framework for image generation. We characterize the two competing properties required of the semantic embedding: it should remain stable under transformations that preserve an image's content, but should distinguish independent generations from the same prompt. We train an image encoder directly for this tradeoff. The resulting encoder improves separation while maintaining stability over off-the-shelf alternatives and enables strong aggregate detection while remaining robust to various transformations. We demonstrate the effectiveness of our watermark scheme on both open-source and closed models, which is possible only due to restriction to black-box access.

7. 【2611.23206】Reading Scene States: Uncovering Safety Failures in Vision-Language Models

链接:https://arxiv.org/abs/2611.23206

作者:Tongxi Wu,Yuyang Cheng,Jiacheng Xian,Menglin Yang,Kai Chen,Jian Zhang,Yang Gao

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:interpreting visual events, Vision-language models, explicit request, underlying harmful objective, textbf

备注: VLM safety, multimodal jailbreaks, and scene-state reasoning

点击查看摘要

Abstract:Vision-language models (VLMs) can provide harmful assistance by interpreting visual events, even without an explicit request for the underlying harmful objective. We identify this \textbf{scene-state safety vulnerability} and introduce \textbf{SceneSafetyBench}, comprising 375 image--question pairs spanning Initial, Medium, and Ultimate scene states and five visual presentations. Across eight VLMs, scene-state inputs elicit harmful assistance with attack success rates (ASRs) of 45.6--72.3\%. Comparative analysis across three VLMs shows that scene-state inputs most closely resemble QR-related images in their layer-wise safety-related signal profiles, while exhibiting lower average late-layer readouts and distinct signal dynamics during generation. To turn this vulnerability into a systematic attack, we propose \textbf{S3TA}, which translates harmful objectives into scene states, queries image--question pairs independently, and assembles the responses. On seven MM-SafetyBench categories across eight open-weight and commercial VLMs, S3TA achieves a model-average ASR of \textbf{71.2\%, exceeding the strongest baseline by 6.1 percentage points}. Text-side filters and visual moderation provide limited protection. These findings highlight the need to safeguard the assistance models infer through scene-grounded reasoning, beyond screening input content.

8. 【2611.23189】Retrieval-Augmented Correction for Generalist Medical Image Segmentation

链接:https://arxiv.org/abs/2611.23189

作者:Vincenzo Marcianò,Xiaoming Zhang,Michela Antonelli,Sebastien Ourselin,Maria A Zuluaga

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:image-based clinical workflows, quantitative image-based clinical, clinical workflows, human operators, knowledge base

备注: Accepted in Transactions on Machine Learning Research (10/2026). Reviewed on OpenReview: [this https URL](https://openreview.net/forum?id=PeDqE0SQRe)

点击查看摘要

Abstract:Automated segmentation is routinely used as the first step in quantitative image-based clinical workflows, where predicted masks are subsequently reviewed and corrected by human operators. Automated correction of the residual structural errors is currently addressed one anatomy at a time, so the number of trained correctors scales with the number of segmentation targets. We present GRACE, a retrieval-augmented refiner that edits an input mask under context drawn from a shared knowledge base of verified prior cases. The refiner is trained once on a multi-organ corpus spanning compact organs, cavities, branching vessels, and tumour lesions. In the held-out dataset-transfer evaluation, three held-out datasets query a fixed knowledge base built from training data only. A separate leave-one-anatomy-out experiment tests parameter-free index extension: verified cases of an unseen solid organ enter the knowledge base, and the refiner stays frozen. A light shape-aware projection head on a frozen multimodal encoder maps embedding similarity to the shape agreement of the masks, so the knowledge base returns cases that the refiner can use as a shape prior. We evaluate GRACE on 18 public datasets spanning CT, MRI and ultrasound, using nine refinement configurations and seven upstream segmentors that span weak, mid, and strong operating regimes. We report each change with the DSC of its input mask. On the weak tier, the input DSC is 0.386 and GRACE adds up to +0.35 DSC. On a strong segmentor, the input DSC is 0.932 and the mean change is small. Transfer to an imaging modality that is absent from training and from the index is partial and depends on the anatomy, and remains an open research direction. Our results suggest retrieval-conditioned refinement is a practical alternative to anatomy-specific correction models. Code: this https URL

9. 【2611.23187】Any2Building: Unifying Point Clouds and Images for Building Reconstruction via Shared Spatial Queries

链接:https://arxiv.org/abs/2611.23187

作者:Hongye Hou,Zhuoxiao Li,Liu Xiangyu,Tengxi Wang,Jing Ou,Dongli Wu,Shuai Zhang,Tongyan Hua,Wufan Zhao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Abstracting structured buildings, Abstracting structured, Partial point clouds, urban modeling, digital twins

备注:

点击查看摘要

Abstract:Abstracting structured buildings from limited observations is essential for 3D urban modeling and digital twins. Partial point clouds and overhead images of the same building provide incomplete 3D surface measurements and visual cues to its footprint, roof geometry, and rooftop structures, respectively. This motivates a unified framework that aligns geometric and visual cues in 3D and reconstructs buildings from either or both modalities. Building on this connection, we present Any2Building, a unified model for Level of Detail 2 (LoD2) building reconstruction from partial point clouds, overhead images, or both, with optional coarse geometric priors. At its core is an occupancy-grounded shared spatial queries representation that organizes available observations within a common 3D grid. Supervised by complete building surface voxels, these queries connect observational evidence to target geometry, enabling a shared generator to learn structural priors across tasks and providing spatial guidance for recovering missing structure. A trained voxel conditional surface-generation and low-poly remeshing pipeline then converts the predicted structure into compact LoD2 building models. To support this framework, we introduce BuildingWorld-Image, comprising approximately one million paired samples of partial point clouds, overhead images, and LoD2 building models across 18 cities. Experiments on multiple benchmarks demonstrate that Any2Building outperforms existing methods in geometric reconstruction accuracy across unimodal and multimodal point-cloud completion, single-image building generation, and prior-assisted generation, while maintaining detailed and robust recovery when point cloud input modality is degraded.

10. 【2611.23179】Say Less, Hallucinate Less? Diagnosing and Restoring Object Coverage in Preference-Optimized Vision-Language Models

链接:https://arxiv.org/abs/2611.23179

作者:Hansang Lee

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Preference optimization, large vision-language models, reduce object hallucination, large vision-language, base

备注: 18 pages, 6 figures, 19 tables. Main text and appendices

点击查看摘要

Abstract:Preference optimization (PO) is the standard way to reduce object hallucination in large vision-language models. We find that four public PO checkpoints of LLaVA-1.5-7B also lower object coverage. They name fewer object categories, and their lower hallucination rates bring no significant gain in set-level object F1 on CHAIR. We therefore ask how much of the PO gain the base model can reproduce by stopping earlier. A positive end-of-sequence (EOS) logit bias lets the base model reach the recall of each PO model, and this early stopping alone reproduces 58 to 86 percent of the CHAIRi gain of three checkpoints on two disjoint COCO sets. Writing longer does not bring the lost categories back. Under greedy decoding, a negative EOS bias recovers only 2 to 9 percent of the lost CHAIR recall of these checkpoints, and 94 to 96 percent of the added object mentions repeat categories already named. On CHAIR, the base caption of the same image still names about half of the missed object categories. We therefore propose base-guided object-category restoration, which appends high-confidence base-only categories to the PO caption without training. With thresholds fixed on a development set, it brings three checkpoints within one point of the base recall on a held-out COCO set with a lower distinct-object hallucination rate than the base model. Against the recall-matched base stopping curve, its gain holds for RLAIF-V near the base recall and for RLAIF-V and CHAIR-DPO at an intermediate recall. We will release the code of the recall-controlled evaluation.

11. 【2611.23177】Déjà View: A Shared Working-Memory Model for Visual Tasks

链接:https://arxiv.org/abs/2611.23177

作者:Mranmay Shetty,Gabriel Kreiman

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

关键词:remember stimuli, model, images, memory, performance

备注: 6 figures; includes appendices

点击查看摘要

Abstract:A working-memory model must remember stimuli and use its memory flexibly to perform different tasks. Here we introduce a model of working memory for images that combines dynamic activity with temporary associations between image features. We train the model on five tasks, including remembering a sample while other images are presented, categorizing distractor images while remembering the sample, and determining whether an image is new or has been presented before. The same trained model performs all tasks, guided by explicit cues about which response is required. We use this flexible memory model to ask how delay, distraction, and image history affect performance. Delays have little effect on sample-memory performance for the delays we tested, while seeing more images leads to more false alarms even when the target image appeared equally recently in all cases. On the sample-memory-plus-categorization task, the probability of correct responses on all questions decreases as more questions are asked, despite robust sample-memory performance. Finally, the model maintains stable performance across 40 brief trials of each task under the tested conditions. Together, these results demonstrate how a single working-memory system can be flexibly used to perform different tasks, and how its errors depend on both previous images and task demands.

12. 【2611.23161】Attribution Through the Decoder: Prediction-Space Explanations for Structured Outputs

链接:https://arxiv.org/abs/2611.23161

作者:Zaer Bin Zaqy,Brinnae Bent

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Networks that predict, emit raw coordinates, predict angles, quantities directly, raw coordinates

备注: Under review

点击查看摘要

Abstract:Networks that predict angles, gaze directions, and rotations do not output these quantities directly: they emit raw coordinates that a fixed decoder, such as normalization, maps to the final prediction. Attribution methods are usually applied to the raw coordinates, so they can credit inputs for changes the decoder discards, such as rescaling a vector when only its direction matters. The resulting explanation can highlight inputs that have no effect on the prediction. We instead attribute through the decoder differential, which for normalization decoders reduces to a scaled tangent projection. We characterize invariance to output rescaling, show that every fixed smooth scalar target on a sphere has points of zero tangential sensitivity, and show that an endpoint-projected variant of Integrated Gradients can still attribute to scale-only inputs, whereas direct angular Integrated Gradients cannot. On synthetic tasks with analytically known relevance, ambient attribution assigns up to 72% of its mass to an irrelevant region. On MPIIGaze validation data, tangent Grad-CAM produces 44% greater prediction displacement under 10% pixel deletion. On PASCAL3D+ with a 6D rotation decoder, the full differential improves mean deletion displacement by 14.1 degrees over the ambient coordinate sum and by 13.8 degrees over a decoder-invariant scalar. Results for a two-polarity tangent LayerCAM variant are mixed: it exceeds ambient-sum LayerCAM on circular regression but no difference is detected on quaternion pose. These results separate two failure sources, radial contamination and scalarization loss. The approach uses existing attribution methods with decoder-aware targets, although some variants also require changes to attribution aggregation. An invariant attribution can still miss inputs that drive the prediction, so invariance and deletion performance should each be checked.

13. 【2611.23155】xtSphere: Efficient Text-to-Image Generation via Shared Hyperspherical Alignment and Uniformity

链接:https://arxiv.org/abs/2611.23155

作者:Yixia Zhang,Girish A. Koushik,Xilu Wang,Wenwu Wang

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:require multiple inference, multiple inference steps, Recent advances, Sphere Encoder, Sphere Encoder offers

备注: 21 pages, 8 figures

点击查看摘要

Abstract:Recent advances in text-to-image generation have substantially improved image quality, particularly through diffusion-based methods that require multiple inference steps. In contrast, Sphere Encoder offers an efficient generative framework capable of producing images with fewer forward steps. However, extending it to free-form text is nontrivial, because its class-conditioned design lacks cross-modal alignment. To address this challenge, we propose TextSphere, an efficient text-to-image generative framework that extends Sphere Encoder with language conditioning and cross-modal alignment. We incorporate pretrained CLIP text embeddings through adaptive layer normalization (AdaLN) to guide image generation while retaining the original spherical sampling mechanism. To bridge the cross-modal representation gap, we introduce a Spherical Semantic Alignment and Uniformity (SSAU) objective that jointly promotes semantic alignment and representation uniformity on the hypersphere. Experiments on CUB-200-2011, MS-COCO-2014, and Flickr30k demonstrate that TextSphere consistently reduces generation FID (gFID) over the text-conditioned baseline while achieving reconstruction FID (rFID) below 1.0. With only 4 and 6 sampling steps, TextSphere achieves lower gFID than the compared diffusion- and GAN-based models trained from scratch on CUB-200-2011 and MS-COCO-2014, respectively. We further observe that improved reconstruction fidelity does not necessarily yield better generation quality. In addition, we use Partial Least Squares Singular Value Decomposition (PLS-SVD) to analyze cross-modal alignment and modality gap, offering insight into the effectiveness of our approach.

14. 【2611.23153】VIVID: Beyond Static Multi-Image Reasoning with Localized Visual Differences and Textual Entity Dynamics in Video MLLMs

链接:https://arxiv.org/abs/2611.23153

作者:Chengqian Ma,Yuanze Zeng,Hongyu Wang,Mingfeng Lin,YiCheng Xiao,Yu Chen,Pengyu Li,WenHao Wang,Yuexiao Ma,Xiawu Zheng,Fei Chao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:current video multimodal, video multimodal large, dropping intermediate frames, large language models, whole-frame pooling dilutes

备注: 14 pages, 2 figures, 5 tables. Code: [this https URL](https://github.com/step-out/VIVID)

点击查看摘要

Abstract:Video question answering under tight frame budgets requires preserving localized motion and event order, yet current video multimodal large language models (MLLMs) reduce comprehension to static multi-image reasoning by discarding unselected frames and encoding keyframes independently: (1) Spatially, whole-frame pooling dilutes small moving targets into static backgrounds; (2) Temporally, dropping intermediate frames or averaging tokens erases inter-frame motion, confusing direction, speed, and order. We propose VIVID (Visual Inter-frame Variations and Individual Dynamics), which moves beyond static snapshots like human vision: keyframes capture core states while inter-frame Patch Diffs preserve neighboring changes within $K_f$ keyframes. Autonomous Delta-Driven Keyframe Planning (ADKP) selects anchors from a $3\text{ fps}$ pool and feeds surrounding patch differences into Dual-Road Change Memory (DRCM), forming Dynamic Tokens at zero extra anchor tokens alongside a camera-stabilized Active Motion Region of Interest (ROI) and chronological Entity State Chains. Adding $0.22\%$ trainable parameters to a frozen $27\text{B}$ backbone, VIVID-Small ($50$ examples, $\sim 1.5$ GPU hours) beats all eleven baselines in overall accuracy across $8,083$ questions and trails only VIVID-Large ($3,600$ examples), which leads on MotionBench, Video-MME, and TempCompass.

15. 【2611.23144】$π^4$: A Foundation Model for 4D Scene Geometry and Motion

链接:https://arxiv.org/abs/2611.23144

作者:Yifan Wang,Weiguang Zhao,Ni Yang,Haoyu Guo,Junting Dong,Weinan Zhang,Chunhua Shen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:unified foundation model, unified foundation, uncalibrated RGB observations, scene perception, uncalibrated RGB

备注:

点击查看摘要

Abstract:$\pi^4$ is a unified foundation model for 4D scene perception. From diverse, uncalibrated RGB observations in the wild---a single image, an unordered collection, or a video sequence---it recovers dense geometry, camera poses, and metric scale, together with 2D/3D point tracks and moving-object masks for multi-image inputs. It couples a geometry branch with a geometry-conditioned motion branch, which predicts image-space correspondences that are lifted into 3D using reconstructed target-view geometry. Across diverse benchmarks, $\pi^4$ achieves the best overall average rank in geometry evaluation, alongside competitive performance in single- and multiview 2D/3D point tracking and moving-object segmentation. With a shared backbone, the full geometry-and-motion system contains approximately 0.5B parameters---less than half the size of most baselines. It produces joint reconstructions and tracks in one forward pass, including large-scale scenes with thousands of input images despite training with contexts of at most 64 views. We further present the data and training recipe underlying these capabilities, together with empirical studies of key design choices. Code and models are available at this https URL.

16. 【2611.23143】CP4D: A Unified Tool-Center-Point Tracking and Generation Model for Robot Manipulation

链接:https://arxiv.org/abs/2611.23143

作者:Haosong Peng,Xiangyang Liu,Zhengshen Zhang,Yunfeng Fan,Tianyu Qi,Xin Xia,Yufeng Zhan,Wenchao Xu

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:rich visual experience, manipulation videos provide, recovering robot action, Robot manipulation videos, TCP

备注: Project page: [this https URL](https://livioni.github.io/TCP4D/)

点击查看摘要

Abstract:Robot manipulation videos provide a rich visual experience, yet recovering robot action and gripper-state annotations from RGB observations still remains challenging. Using the embodiment-agnostic tool-center-point (TCP) pose as the action space, we present TCP4D, a unified model in which a shared 4D scene representation both tracks observed TCP motion and generates future TCP trajectories. Given a monocular video and initial 2D TCP queries, the tracker directly recovers metric TCP poses in SE(3) and gripper states alongside scene geometry and camera parameters. The generator samples local features from the same 4D representation along the recovered TCP tracks, then combines them with robot observations and language instructions to predict future TCP states. Our new cross-embodiment augmentation pipeline converts existing RGB videos into demonstrations for alternative embodiments by retargeting the recovered motion and synthesizing the corresponding observations, without recorded source-robot states. Experiments show that the tracker achieves absolute trajectory errors of 7.60 and 16.07 mm on DROID and RoboLab and adapts to a new embodiment with only ten demonstrations. The generator achieves 69.19% mean success on RoboTwin and outperforms well-established policy models on two real-world tasks, while joint training on source and augmented demonstrations improves target-robot success by 41.5% over augmented-only training.

17. 【2611.23140】GameRealm: Grounding Visual Learning in Interactive Games

链接:https://arxiv.org/abs/2611.23140

作者:Weiguang Zhao,Yifan Wang,Ni Yang,Yating Wang,Xingyu Miao,Yankai Jiang,Mulin Yu,Tao Lu,Haoyu Guo,Junting Dong,Weinan Zhang,Chunhua Shen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:inconsistent annotation quality, development remains constrained, fragmented training datasets, limited multimodal supervision, inconsistent annotation

备注:

点击查看摘要

Abstract:Visual foundation models are central to physical intelligence, yet their development remains constrained by fragmented training datasets, inconsistent annotation quality, and limited multimodal supervision. To address these challenges, we introduce GameRealm, a large-scale, richly annotated dataset that grounds visual observations in synchronized, game-native supervision. GameRealm encompasses over 120 million RGB frames and 1,000 hours of gameplay footage across all views. Beyond its unprecedented scale, GameRealm provides rich multimodal supervision, including metric depth, camera parameters, synchronized audio, control inputs, and 3D point trajectories. Its diversity further extends to flexible view configurations, spanning single-view, stereo, multi-view, and panoramic recordings. To enable scalable acquisition across diverse game environments, we develop a unified data collection pipeline that combines human-operated interaction with agentic exploration. Extensive experiments across diverse visual learning tasks demonstrate that GameRealm consistently strengthens visual foundation models in both visual generation and geometric learning. These results establish GameRealm as a versatile and valuable data resource, unlocking new opportunities for advancing visual intelligence.

18. 【2611.23127】he Illusion of Grounding: Do Vision-Language Models Weigh Retrieved Text and Images Like an Ideal Observer?

链接:https://arxiv.org/abs/2611.23127

作者:Basavaraj R M,Harshal Chandel

类目:Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词:Retrieval-augmented vision-language models, Retrieval-augmented vision-language, wrong or noisy, Knowledge Inertia, Visual Genome

备注: 10 pages, 5 figures, 11 tables. Code and data: [this https URL](https://github.com/Basavarajearlybird/GIB-200K) (archived at [this https URL](https://doi.org/10.5281/zenodo.24320174) )

点击查看摘要

Abstract:Retrieval-augmented vision-language models (VLMs) answer from two sources of evidence that can each fail: the retrieved text can be wrong or noisy, and the image can be degraded or contradicted. We introduce GIB-200K, 200,000 image-question items built from COCO and Visual Genome, each expanded into controlled stress conditions: hard-negative retrieval noise (1-20 documents), visual ambiguity (Gaussian and motion blur, low-resource crops) and cross-modal conflict with counterfactual flip pairs. Instead of only measuring degradation, we ask how models combine the two modalities. From ideal Bayesian cue combination we derive a testable prediction that yields formal definitions of Knowledge Inertia (text over-weighted relative to the model's own image evidence) and Sensory Capture (the reverse), and we estimate the weights with a measurement-error-corrected regression whose recovery of known weights we verify. A counterfactual flip decomposition separates modality bias from concept priors, and a Grounding Illusion Score measures how much clean accuracy is not grounded in the image. We evaluate 4 open models on one frozen, seeded evaluation split of 2,000 GIB-200K items. All models are accurate on clean inputs (92.5%-94.2%) but adverse accuracy falls to 41.3%-59.9%. The two LLaVA models over-weight the text (Knowledge Inertia, w_T/w_I = 1.229 and 1.322), whereas InternVL3 favours the image (w_T/w_I = 0.680); between 34.8% and 71.4% of the clean answers that are correct are abandoned when the document lies. A training-free consistency check that compares the answer with and without retrieval trades coverage for accuracy under misleading documents, while falling back to the image fails when the image is heavily degraded. All per-instance outputs, code, and an audit that recomputes every reported open-model number are released.

19. 【2611.23115】Nunchi: Ears Help Eyes in Multi-Party Conversations

链接:https://arxiv.org/abs/2611.23115

作者:JunYeong Park,Shijing Wang,Seonwook Park,Michael Stengel,Shalini De Mello,Sang-Il Choi,Hyung Jin Chang

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:understanding multi-party conversations, central to understanding, gaze, Identifying, gaze geometry

备注: 10 pages, 5 figures

点击查看摘要

Abstract:Identifying whom a person looks at is central to understanding multi-party conversations, yet gaze geometry alone becomes ambiguous as more people appear. Conversations offer cues that geometry lacks, such as who is speaking and what is said, but no gaze dataset provides them for many multi-party scenes. We introduce SORBET, a benchmark of 3,340 samples from 1,578 clips with synchronized speech, transcripts, and attended person labels, covering more multi-party scenes than existing gaze datasets. Prior gaze models struggle to use these cues, which come in different forms, must be linked to the right person, and can conflict with gaze geometry. We propose Nunchi, a framework that constructs a text prompt from the transcript and the outputs of gaze and speaker models, links every cue to the candidates with shared labels, and lets a vision-language model (VLM) weigh gaze geometry against conversational cues to identify the attended person. Nunchi outperforms the strongest existing method by 4.8 percentage points. On SORBET, conversational cues help whereas additional visual cues do not, and the gains hold across three VLMs, with automatic transcripts, and on two existing datasets.

20. 【2611.23113】LUTBench: Benchmarking Text-Driven Photographic Look Transfer

链接:https://arxiv.org/abs/2611.23113

作者:Chuanzhi Xu,Boyu Wei,Chengkun Yue,Xuanhua Yin,Yiyang Li,Chupeng Liu,Zihan Deng,Weidong Cai

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:color grading shapes, Photographic color grading, achieve a desired, grading shapes, color grading

备注:

点击查看摘要

Abstract:Photographic color grading shapes the tone and color of a photograph to achieve a desired look. Text-driven photographic look transfer lets users specify these adjustments in natural language, with the goal of reproducing the requested look across photographs while preserving their content. However, prior research on text-driven color grading uses different datasets, text instructions, target definitions, and metrics. These differences make it difficult to compare how faithfully the methods reproduce the same look. To compare methods under a shared protocol, we introduce LUTBench. We collect 91 three-dimensional lookup tables (3D LUTs) and define one photographic look per LUT with a specified input conversion. Applying these looks to 5,000 MIT-Adobe FiveK photographs produces 455,000 input-target image pairs with reproducible target images. For each look, we use templates to turn measured tone and color changes on fixed color samples into candidate clauses. We use training image measurements to verify applicable clauses before composing the text description. The evaluation measures target fidelity, tests sensitivity to predefined input conversions, and separates generalization to unseen looks from reproduction of seen looks on new photographs. Across 16 methods, stronger text alignment does not guarantee target fidelity. However, most supervised variants improve fidelity on both seen and unseen looks.

21. 【2611.23111】Event-Based Dynamic Lip Region Estimation During Speech

链接:https://arxiv.org/abs/2611.23111

作者:Hamze Hammami,Omar Eldardeer,Francesco Rea

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:low power consumption, cameras offer high, offer high temporal, high temporal resolution, Event cameras offer

备注:

点击查看摘要

Abstract:Event cameras offer high temporal resolution and low power consumption, making them promising for speech-related applications. These include automatic lip reading, audiovisual speech analysis, and human-robot interaction, particularly in challenging environments characterized by low illumination or high dynamic range. Event-based lip reading, speaker recognition, and voice activity detection, however, mostly operate on a cropped region of interest (ROI), by hand or by the dataset, and no event-based method supplies that ROI as a spatial region; existing event-based face analysis gives the mouth as landmarks, which presents a mismatch between application and localization. The present work predicts a dense heatmap over the lip region from the full event "frame". Events are encoded as a polarity-separated voxel grid and processed at every location by a two-pathway continuous-time recurrent network (CT-RNN) with learned, log-space bounded time constants acting on the real elapsed time of each bin: a stateless fast pathway and a stateful slow pathway, utilised for refining and anchoring the prediction. The model reaches 69.5% on lips on four unseen speakers and switches target only 2.1 times per second, against 8.9 and 11.0 for convolutional baselines with more parameters. Adding a spatial encoder improves precision but fails on a new face scale. On a real event sensor, trained only on simulated events, the proposed model reaches 58.0% on lips against 43.2% for the CNN, with fewer than half its target switches.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

Cite as:
arXiv:2611.23111 [cs.CV]

(or
arXiv:2611.23111v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2611.23111

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>
22. 【2611.23108】FMT: Lossless Image Compression in a Fixed Number of Parallel Steps

链接:https://arxiv.org/abs/2611.23108

作者:Ammar Ali

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:common classical codecs, make smaller files, files than common, archive and train, lossless codecs make

备注:

点击查看摘要

Abstract:Learned lossless codecs make smaller files than common classical codecs, yet the images we archive and train on still use classical codecs. A main reason is time: a learned codec takes seconds to decode a photo that a classical codec opens in milliseconds, and their faster variants give up most of their gain in size. We argue that much of this time is spent waiting, not computing: the network waits for the values it conditions on, and the arithmetic decoder reads them one at a time. We introduce FMT (Fixed-step Multiscale Tree), a lossless image format whose decoding order and entropy coder are designed together so that neither wait grows with the image. FMT stores an image as a coarse-to-fine tree whose steps hold independent values: a GPU predicts each step at once and decodes it in parallel rANS lanes that carry their states from step to step, so an image of any size decodes in a fixed number of sequential steps. On this tree we build a family of bit-exact codecs, from a rule with no network to large networks, and no codec we ran on the same GPU beats any of them on both size and speed. Without a network, FMT beats NVIDIA's HTJ2K on size and speed; with a large one, it decodes Kodak photos 9 to 61X faster than learned codecs we ran on the same A100, at the same size or smaller.

23. 【2611.23088】Event-Based Person Detection for Maritime UAV Search

链接:https://arxiv.org/abs/2611.23088

作者:Zijie Ning,Patrick Vandewalle

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:requires locating people, search area, water quickly, locating people, Maritime search

备注: Accepted at the 5th Workshop on Maritime Computer Vision (MaCVi), WACV 2027

点击查看摘要

Abstract:Maritime search and rescue requires locating people in the water quickly, motivating the use of UAVs to survey the search area. During flight, camera motion and the longer exposures used in low light can blur small targets and hinder person detection. Event cameras record brightness changes as they occur, reducing the motion blur associated with longer exposure times. We investigate their use for maritime person detection by generating synthetic events using the v2e event simulator from public MOBDrone rescue videos and retaining the existing annotations. We compare the recurrent vision transformer model RVT-T with YOLOv8n and RT-DETR-R18 trained on exposure-matched images. On 843 test samples from held-out recordings, RVT-T achieves 15.63% person AP50:95, compared with 6.89% for YOLOv8n and 9.44% for RT-DETR-R18 under 100 ms synthetic exposure. Increasing exposure times from 50 to 200 ms progressively reduces frame-based detection accuracy, widening the gap to the event model. To evaluate the feasibility of on-board processing, we deploy our detector on a Jetson Orin Nano platform. The RVT-T model retains its accuracy and requires approximately 136 ms and 2.02 J per sample, allowing real-time processing on the UAV.

24. 【2611.23085】ransfer Once, Ask Locally: Compact Audio-Visual Memory for On-Device Question Answering

链接:https://arxiv.org/abs/2611.23085

作者:Qitong Wang,Jihui Jin,Divya Kothandaraman,Vishnu Raj,Christopher Rasmussen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:requires balancing speed, devices requires balancing, user devices requires, Audio-visual question answering, lightweight user devices

备注:

点击查看摘要

Abstract:Audio-visual question answering on lightweight user devices requires balancing speed, memory usage, privacy, and communication. One approach is to run audio-visual encoders on a server and a lightweight language decoder on the user device, keeping questions local while offloading media encoding. However, transferring and processing the full multimodal representation remains costly. We propose a training-free, query-agnostic token pruning framework that constructs a compact, reusable memory before transmission. We define video spatio-temporal blocks and aligned audio windows as players and estimate their importance through Monte Carlo Shapley valuation. We use an embedding coverage objective that combines query-independent utility with cross-modal redundancy calibration and rewards unimodal diversity through marginal coverage gains. We retain the original token embeddings of high-scoring players under a limited token budget and transfer the resulting memory once for reuse across subsequent local questions. Experiments on Video-MME, Daily-Omni, and Video-Holmes using video-SALMONN 2+ (3B) and video-SALMONN 2 Pro (4B) show that our method achieves the best or tied-best QA accuracy among the compared compression methods across all evaluated settings. On Daily-Omni with video-SALMONN 2+ (3B) at 80\% pruning, our method improves accuracy by 12.86--14.62 percentage points over these methods while achieving the lowest device-side LLM prefill and decoding latency, with up to $1.92\times$ decoding speedup at comparable embedding memory usage.

25. 【2611.23078】UnrealEvent: Synthetic Dataset Generation and Annotation for Event-Based Vision

链接:https://arxiv.org/abs/2611.23078

作者:Yentel Schoovaerts,Zijie Ning,Patrick Vandewalle

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:event-based object detection, low power consumption, high temporal resolution, high dynamic range, object detection remains

备注: Accepted at the Workshop on Neuromorphic Vision (NeVi), ECCV 2026

点击查看摘要

Abstract:Event-based cameras provide high temporal resolution, low power consumption, and a high dynamic range, but progress in event-based object detection remains constrained by the scarcity of annotated training data. To solve this issue, this paper introduces the tool UnrealEvent, a synthetic dataset-generation pipeline implemented in Unreal Engine 5.5. The pipeline combines a V2E-inspired event-frame generator with EasySynth semantic-rendering passes, allowing rendered level sequences to be converted into paired event representations and YOLO-format bounding-box annotations without manual labeling. Events are generated from per-pixel log-luminance differences between consecutive frames, with contrast thresholds sampled independently from a normal distribution to emulate the fabrication-induced threshold mismatch of real sensors. Using this pipeline, we provide a synthetic dataset and evaluate YOLOv8 detectors under synthetic, zero-shot real, and real fine-tuning training on eTraM. The results show strong in-domain synthetic performance but a substantial synthetic-to-real gap, especially for pedestrians. Fine-tuning on a small real subset improves real-domain performance, while the remaining gap highlights the importance of asset diversity and sensor calibration.

26. 【2611.23056】RFW-S: Everyday Deformable Objects with Independent Simulation Verification

链接:https://arxiv.org/abs/2611.23056

作者:Jiarui Guo,Saining Zhang,Jiaying Wan,Jiawei Weng,Junhao Chen,Rui Zhang,Yuanbo Lyu,Zhiheng Lee,Peishuo Li,Jingrun Du,Weiqing Xiao,Weiyi Lin,Zenan Meng,Hu Wei,Lin Qu,Zongzheng Zhang,Hao Zhao,Chaojian Li

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:requires diverse deformable, executable physical properties, simulation requires diverse, requires diverse, properties and realistic

备注: 34 pages, 19 figures. Project Page: [this https URL](https://sjijs.github.io/RFW-S_website/)

点击查看摘要

Abstract:Large-scale robotic simulation requires diverse deformable objects with executable physical properties and realistic interaction behaviors. However, existing 3D asset collections primarily emphasize visual diversity, while scalable physical construction and verification remain challenging. We introduce RFW-S, a large-scale dataset of 83,365 simulation-verified assets spanning 485 everyday categories across five structural families: soft solids, cloth sheets, shells, garments, and bags. We develop an automated pipeline integrating reference-guided 3D generation, structure-aware physical modeling, and LLM-assisted parameter estimation and calibration. To ensure physical reliability, we introduce an independent simulation verification framework that evaluates object behaviors under interactions distinct from those used for parameter calibration. Extensive experiments demonstrate the effectiveness of independent verification and characterize deformable responses under different physical configurations. We further evaluate robotic grasping in terms of both task success and object integrity, and demonstrate the physical realism of our simulated objects through sim-to-real replay of fragile-object manipulation. RFW-S provides a scalable foundation for physically grounded simulation and embodied robotic learning.

27. 【2611.23055】FrameRouter: Frame Budget Routing for Long-Video Understanding on Video-MME-v2 and Beyond

链接:https://arxiv.org/abs/2611.23055

作者:Bingjun Luo,Jialin Guo,Siqi Li

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:typically evaluate systems, typically evaluate, query actually demands, evaluate systems, stark variation

备注: Accepted to NeurIPS 2026

点击查看摘要

Abstract:Long-video question answering benchmarks like Video-MME-v2 typically evaluate systems under a uniform frame budget for every question, despite stark variation in the evidence each query actually demands. We analyze this mismatch on Video-MME-v2 and find that different question subsets prefer different frozen frame-budget policies, while uniformly increasing the frame count does not reliably improve all metrics. These findings motivate fixed-mean frame-budget routing, a controlled inference setting in which each question may receive a different frame budget while the average budget matches a uniform reference. We introduce FrameRouter, a training-free test-time framework that combines an evidence-demand router, a budget-constrained allocation rule, and a frozen bank of frame-sampling policies. By controlling how much visual evidence each question receives while leaving the underlying samplers unchanged, FrameRouter is orthogonal to query-aware frame selection. Across Video-MME-v2 and several long-video understanding benchmarks, FrameRouter improves long-video question answering by using the same average visual budget more selectively across questions. Code is available at this https URL.

28. 【2611.23054】ReTouchGS: Ultralight Render-free Aesthetic Color Enhancement and Transfer for 3D Gaussian Splatting

链接:https://arxiv.org/abs/2611.23054

作者:Chuanzhi Xu,Boyu Wei,Chengkun Yue,Xuanhua Yin,Yiyang Li,Haodong Chen,Qiang Qu,Weidong Cai

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)

关键词:Gaussian Splatting, enables photorealistic scene, photorealistic scene reconstruction, color, enables photorealistic

备注:

点击查看摘要

Abstract:3D Gaussian Splatting (3DGS) enables photorealistic scene reconstruction. Existing 3DGS color transfer and interactive editing methods are guided by reference images and user-specified color adjustments. However, in many applications, users simply want aesthetically guided color enhancement that automatically makes the scene more visually appealing while maintaining consistent colors and tones across viewpoints. We present ReTouchGS, to our knowledge the first framework for reference-free aesthetic color enhancement of pretrained 3DGS models. It predicts a scene-level color lookup table (LUT) from the model and its associated camera parameters. ReTouchGS also supports reference-guided color transfer by fitting a scene-level LUT using one edited view of the same scene and its corresponding original render. A shared blend-aware color refinement network with only 44.7K parameters refines an analytic color update to realize either color mapping without rendering. It preserves geometry and delivers standard 3DGS assets in seconds. We also design the ReTouch3D benchmark to support the evaluation of aesthetic color enhancement and reference-guided color transfer across viewpoints. Experiments demonstrate high color accuracy and strong generalization to unseen scenes in both aesthetic color enhancement and reference-guided color transfer.

29. 【2611.23051】Refin3R: Geometry-Guided Refinement for Feed-Forward 3D Reconstruction

链接:https://arxiv.org/abs/2611.23051

作者:Jongmin Lee,Jaeyeong Kim,Seungryong Kim

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:reconstruction models predict, models predict dense, reconstruction models, single pass, models predict

备注:

点击查看摘要

Abstract:Feed-forward 3D reconstruction models predict dense point maps from multiple images in a single pass. Without explicit geometric constraints, however, their predictions are often inconsistent across views and lack fine-grained precision. Recent methods incorporate geometric priors such as camera pose or depth, but use them merely as auxiliary inputs, process each view independently, or refine the geometry only where the priors are available. We present Refin3R, which refines feed-forward point maps with Structure-from-Motion (SfM) points, propagating SfM geometry over the image grid. In its dual-branch architecture, a 2D branch extends SfM geometry beyond its coverage using geometry-aware backbone features, while a 3D branch reasons over the SfM points of all views, capturing multi-view structure that the image grid alone cannot represent. The two branches exchange information bidirectionally to jointly refine each view, yielding dense and accurate point maps. Across ScanNet++, ETH3D, Tanks\Temples, and out-of-domain human and surgical scenes, Refin3R consistently outperforms feed-forward and geometry-guided methods in point map accuracy while running faster than the strongest geometry-guided baseline.

30. 【2611.23048】Wall-to-wall maps of canopy height and aboveground carbon across the Atlantic Forest

链接:https://arxiv.org/abs/2611.23048

作者:Matheus Pinheiro Ferreira,Thiago Carmuega Rabaçal,Giulio Brossi Santoro,Giovanna de Andrade Ferreira,Rodrigo Costa Pinto,Danilo R. A. de Almeida,Paulo Guilherme Molin,Catherine Torres de Almeida,Angélica F. Resende,Vinicius Castro Souza,Marcelo Antonio Pinho Ferreira,Cássio Toledo,Eben North Broadbent,Angelica Almeyda Zambrano,Laura Simões,Juliano van Melis,Ricardo Ribeiro Rodrigues,Pedro H. S. Brancalion

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Brazilian Atlantic Forest, estimate forest carbon, canopy height, canopy height maps, São Paulo

备注: 56 pages, 13 figures, 8 tables, 2 supplementary tables. Submitted to Scientific Data. Maps and code openly available via Zenodo and GitHub

点击查看摘要

Abstract:Global canopy height maps are increasingly used to estimate forest carbon, yet their regional accuracy is rarely tested. We present wall-to-wall maps of canopy height (10~m) and aboveground carbon density (30~m) for the Brazilian Atlantic Forest in 2024. Height was predicted by a deep learning network fusing Sentinel-2 reflectance, Sentinel-1 and ALOS PALSAR backscatter and ALOS elevation, trained on 7{,}179 and tested on 1{,}793 patches (58{,}800~km$^2$) from a statewide airborne LiDAR campaign over São Paulo state, Brazil. On held-out test patches, the root mean square error is 3.05~m at 10~m and 2.58~m at 30~m, and the model was validated at two LiDAR sites outside São Paulo. Over the same pixels, the Meta and World Resources Institute global product has more than twice this error. A power law fitted to 124 inventory plots converted canopy height to above ground carbon density. The remaining forest holds 1{,}944~Tg~C over 28.3~Mha. Global products therefore need local validation before use in carbon accounting.

31. 【2611.23038】When Anchors Shift the Target: Advantage-Gated Adaptation for Diffusion Reinforcement Learning

链接:https://arxiv.org/abs/2611.23038

作者:Pu Cao,Min Zhou,Ying Shu,Tiezheng Ge,Qing Song,Lu Yang

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Forward-process reinforcement learning, reinforcement learning adapts, learning adapts diffusion, Forward-process reinforcement, re-noising rewarded generations

备注: 12 pages, 4 figures, including supplementary material

点击查看摘要

Abstract:Forward-process reinforcement learning adapts diffusion and flow-matching models by re-noising rewarded generations into regression targets. Because negative advantages induce concave updates with unbounded repulsive gradients, existing methods stabilize training using cached predictions from a moving policy copy, yet these anchors also alter what positive feedback teaches the model to fit. We formalize this conflict as anchor coupling: after separating frozen-reference regularizers, affine moving-anchor rules cannot eliminate negative curvature while preserving every positive regression target. We propose Advantage-Gated Adaptation (AGA) to decouple these roles. Positive samples retain standard target fitting, whose self-limiting update vanishes at the observed target independently of the moving anchor. Negative samples instead use the first-order tangent of the concave objective at the moving-policy prediction, preserving the local repulsion direction with a prediction-independent gradient. Within the quadratic-anchor family, these requirements uniquely determine the parameter-free gate $\omega(a)=\max(-a,0)$. Because the moving copy provides local linearization rather than retention, AGA assigns long-horizon behavior preservation to a frozen pretrained reference regularized at its operating classifier-free guidance scale, interpreted through an implicit-reward lens. Across compositional generation, text rendering, and preference alignment, our experiments show that displacing positive targets degrades visual quality and heightens sensitivity to policy-copy schedules, whereas AGA consistently improves the reward--quality trade-off.

32. 【2611.23037】Automated Annotation-Free Synthetic Data Generation for Underwater Litter Detection: A Comparison of Generative Approaches

链接:https://arxiv.org/abs/2611.23037

作者:Amala Mary Vincent,Bart De Schutter

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:strong appearance variations, appearance variations caused, Generative Adversarial Networks, imbalanced training data, caused by turbidity

备注:

点击查看摘要

Abstract:Underwater object detection is often limited by scarce and imbalanced training data and by strong appearance variations caused by turbidity, lighting, and differences between sensors. Existing data augmentation strategies, such as geometric or color augmentation or fully synthetic image generation with Generative Adversarial Networks (GANs), either lack semantic realism, fail to respect scene physics, or require additional annotations. In low-data domains like underwater environmental monitoring, the need for additional annotations is often the core bottleneck. Collecting new footage is hard, but labeling this dataset is even more time-consuming and costly, which limits how quickly a usable dataset can be constructed. We propose a unified fully automated zero-annotation pipeline that inserts class-conditioned trash objects into real underwater frames while preserving the original background context. Starting from sampled bounding boxes, each box is converted into an insertion mask and the object is pasted or generated within it, while the same box coordinates are automatically written as the corresponding annotation. Because labels are derived directly from the sampled boxes, the pipeline generates fully labeled training data for low-data settings without any manual annotation. Within this single pipeline we compare three strategies: copy-paste, Stable Diffusion inpainting, and DALL-E image-conditioned generation. We evaluate bounding-box faithfulness, visual realism, and the impact of the generated samples on downstream detector performance on the SeaClear underwater debris dataset. Results show that DALL-E improves detection performance in four of five domains, with relative gains of up to 96 percent over the real-only baseline.

33. 【2611.23034】M3OPD-Reasoner: An Open Recipe for Post-Training Multimodal Reasoning with Multi-Teacher On-Policy Distillation

链接:https://arxiv.org/abs/2611.23034

作者:Nguyen Quang Trung,Hoang Phan,Shuo Sun,Longyin Zhang,AiTi Aw

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multi-Teacher On-Policy Distillation, On-Policy Distillation Reasoner, On-Policy Distillation, Distillation Reasoner, Multimodal Model Multi-Teacher

备注:

点击查看摘要

Abstract:Multi-Teacher On-Policy Distillation (MOPD) enables a single student to absorb the skills of several domain teachers by learning from its own generated responses. We present Multimodal Model Multi-Teacher On-Policy Distillation Reasoner (M3OPD-Reasoner), a fully open recipe for post-training vision-language models (VLMs) over three reasoning domains: image STEM, image perception, and video. We curate two datasets, M3OPD-SFT-1.35M for supervised fine-tuning (SFT) and M3OPD-RL-193K for reinforcement learning (RL) with verifiable rewards. On these data, we compare post-training recipes that start from Qwen3.5-9B: training one model on the mixed data of all domains (MixSFT and MixRL), and training one teacher per domain with Group Sequence Policy Optimization (GSPO), directly or after an SFT warm-up, and distilling the teachers into one student with MOPD. We evaluate on 21 image STEM, image perception, and video reasoning benchmarks after we decontaminate the training data against them. The comparison establishes MOPD of teachers trained with GSPO directly from Qwen3.5-9B as the best recipe: the student closely matches each teacher on its own domain and is on average above the mixed-training baselines on the same prompts. Since MOPD already merges the domain capabilities that MixRL would otherwise have to learn, its student is a stronger starting point for RL, and we ask whether the same data can carry the model further from there: we add MixRL on top of the MOPD student, on the same prompts and with the same settings, which, to our knowledge, no prior VLM recipe has studied. The same prompts still improve the MOPD student, with no collapse, and give our main model, M3OPD-Reasoner-9B. MOPD and MixRL can therefore work as consecutive stages that get more out of the same data. We release all data, the training code, and the checkpoints of every stage.

34. 【2611.23030】Check Your Blind Spots: Decision-Guided Perception by Probing the Planner with Hypothetical Objects

链接:https://arxiv.org/abs/2611.23030

作者:Hoang Pham Cong,Long D. Nguyen,Ho Viet Duc Luong,Nguyen Tran Minh Nhat,Binh P. Nguyen

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:action, planner, perception error, perception, Decision-Guided Speculative Perception

备注:

点击查看摘要

Abstract:Not every perception error changes the planner's action. Yet adaptive-resolution perception chooses where to spend high-resolution computation from image cues, which can neither reliably point to an object that low resolution missed nor tell which objects matter to the planner. We observe that the planner can say where an object would matter before anything is seen: inserting a hypothetical object at a location tests whether its action would change. Decision-Guided Speculative Perception (DGSP) treats the low-resolution scene and its action as a draft and probes the planner in this way to obtain a decision-sensitivity field, the locations where an unseen object would change the action. Only this field and the support, the detections on which the current action rests, are verified at high resolution, repeatedly until the action is stable. For two planner classes, we prove that DGSP returns exactly the action of whole-frame high-resolution perception if crop detections match whole-frame ones and the crops cover the field, conditions that real images meet approximately. On three driving datasets, it reproduces this action on about 98% of frames with about a quarter of the pixels. At the pixel cost of uniform downscaling, it repairs more of the draft's disagreements with this action, brakes falsely less often, and recovers many more of the decision-relevant objects that the draft misses.

35. 【2611.23025】When a Larger Guidance Scale Repairs Text-to-Video Failures and When It Does Not

链接:https://arxiv.org/abs/2611.23025

作者:Taewon Kang,Matthias Zwicker

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:diffusion model ignores, model ignores part, classifier-free guidance scale, diffusion model, model ignores

备注: 29 pages, 15 figures

点击查看摘要

Abstract:When a text-to-video diffusion model ignores part of a prompt, the usual first fix is to raise the classifier-free guidance scale. This paper is a measurement study of when that fix works. On Mochi, the same increase repairs failures on rare compositions ("a snowy beach") beyond what generating again does, does not repair negations ("a highway with no vehicles"), where it fixes fewer failures than generating again does, and changes nothing for events that must happen late in a clip ("a sandcastle that a wave washes flat"). Which of these happens can be known in advance, from the prompt and one inexpensive score. The score, which we call demand, measures how strongly the denoiser reacts to the part of the prompt that the failed video leaves out, and it is read from the first quarter of denoising, before any video exists. Our main finding is a condition: raising the scale is effective only when the prompt contains no negation and no event tied to a specific time, and when demand is sufficiently high, with recovery clearly higher above a fitted threshold than below it. Published corrections for the three failure types, used as fixed probes, behave as this account predicts. A short decision rule follows: before generating again, a user can tell whether the most common fix is worth trying, and what to use when it is not.

36. 【2611.23007】racking Ethological Behaviors of Broiler Chickens Through Computer Vision (YoloV11) Using an Android Mobile Device

链接:https://arxiv.org/abs/2611.23007

作者:Ryan Davi Oliveira de Meneses,Glauber da Rocha Balthazar

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:ethological behavior classification, climate-controlled poultry houses, study developed, developed and evaluated, classification of broiler

备注:

点击查看摘要

Abstract:This study developed and evaluated a computer vision model for automated ethological behavior classification of broiler chickens in climate-controlled poultry houses. Using publicly available videos preprocessed and manually annotated into three classes (sitting, standing, and feeding), the YOLOv11 model was trained and deployed on an Android application via TFLite conversion. Exploratory analysis ensured dataset consistency and visual quality, while evaluation showed class-dependent performance: higher robustness for static postures (sitting, AP=0.531; precision=100%) and lower accuracy for dynamic behaviors (feeding, AP=0.292; recall=0.20). Tests with unseen images demonstrated significant improvements, achieving accuracies of 98.04% for sitting, 83.33% for standing, and 67.65% for feeding. The model showed effective generalization in real farm environments, supporting its potential for continuous behavioral monitoring, early welfare assessments, and decision-making in precision poultry farming. These findings establish a technical foundation for future mobile-based applications at commercial scale, reinforcing the role of computer vision in automated animal welfare evaluation.

37. 【2611.22996】he Rhythm of Generated Video: Latent Chunking Leaves Periodic Traces in Compressed Bitstreams

链接:https://arxiv.org/abs/2611.22996

作者:Chen Ye Gan,Bryan Zhen Zhang,Gene Wen,Yuxing han

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:detectors analyze decoded, AI-generated video detectors, video detectors analyze, analyze decoded pixels, detectors analyze

备注: Manuscript, 9 pages, Computer vision, AI-generated video detection, compressed-domain analysis, video coding,

点击查看摘要

Abstract:Most AI-generated video detectors analyze decoded pixels and overlook how videos are produced. We show that causal video autoencoders leave an architecture-specific rhythm in compressed bitstreams: their temporal stride concentrates unpredictable content at latent-chunk boundaries, so rate-distortion optimized encoders allocate bits periodically. Without decoding pixels, we observe four-frame pulses in CogVideoX and Wan2.2 and eight-frame pulses in LTX-Video, which are absent from content-matched camera footage. Passing camera footage through a generator's autoencoder alone induces the pulse, supporting its proposed origin. A training-free peak-ratio statistic separates generated from camera video (AUC 0.84-0.94) and persists across tested quantization settings and H.264/H.265 encoding. Frame-size traces also identify four commercial generators, with 89.2%, 84.1%, and 83.0% accuracy under H.264, H.265, and AV1, beating the pixel-based UnivFD baseline (72.7-73.6%). Our results directly link generative architecture to measurable coding demand.

38. 【2611.22995】CAST: Calibrating Correspondences for Training-Free Biomedical In-Context Segmentation

链接:https://arxiv.org/abs/2611.22995

作者:Mingze Jiang,Jiashu Han,Haonan Chen,Zhiyi Li,Yilun Du,Kunzan Liu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:dense expert annotations, acquisition protocols, dense expert, expert annotations, annotations are scarce

备注: 10 pages, 6 figures

点击查看摘要

Abstract:Biomedical image segmentation must keep up with new anatomical structures, subjects, imaging modalities, and acquisition protocols, yet dense expert annotations are scarce and models trained on one cohort often struggle to transfer. In-context segmentation (ICS) offers a way out: a new structure is specified by a few annotated exemplars at inference time. However, reliable correspondence remains challenging in biomedical images, where adjacent structures often share similar appearances, and variations across subjects and imaging conditions further obscure their distinctions. We introduce CAST, a training-free framework built on a frozen DINOv3 backbone to calibrate fine-grained correspondences. Its stability test improves feature reliability at both global and patch-specific levels, while its coherence test assesses whether candidate correspondences are supported by consistent local structural context. Together, these tests enable more reliable correspondence across diverse anatomical structures and imaging conditions. Across eight biomedical benchmarks spanning 2D and 3D segmentation, cross-subject, and cross-modality transfer, CAST outperforms the strongest overall baseline by 12.34 percentage points in Dice and ranks first across all six volumetric settings. The versatility of CAST further opens up opportunities for challenging biomedical applications, including 2D-to-3D segmentation and atlas label transfer.

39. 【2611.22981】SpikWM: Efficient End-to-End Spiking World Modeling for Visual Planning

链接:https://arxiv.org/abs/2611.22981

作者:Shuhan Ye,Hongbin Yu,Chong Wang,Hui Lu,Jiaming He,Yi Yu,Jiangbo Qian,Xudong Jiang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:goals requires predictions, distinguish visual states, Latent World Model, observations and goals, goals requires

备注:

点击查看摘要

Abstract:Goal-conditioned planning with image observations and goals requires predictions that distinguish visual states and action consequences. Spiking neural networks offer sparse computation, but single-step spikes can obscure motion cues and merge actions with different physical outcomes. We propose the Spiking Latent World Model (SpikWM), an end-to-end joint-embedding predictive architecture (JEPA) with one simulation step per image and one neural update per latent position. Spiking Regional Encoding retains spatial cues through regional pooling. Bi-Spike Action Encoding combines positive and negative binary responses, while Causal Membrane Prediction carries subthreshold evidence across the latent history with learned group-wise time constants. The encoder and predictor are trained jointly on reward-free image--action trajectories using next-embedding prediction and SIGReg. With a common planner, SpikWM achieves mean success rates of $88.67\%$, $97.33\%$, $99.33\%$, and $86.67\%$ on Push-T, Two-Room, Reacher, and OGBench-Cube, respectively, outperforming two spiking baselines. Push-T ablations support each module, and controlled replays examine responses to appearance and physical state changes. Under a matched planning budget, SpikWM reduces estimated arithmetic energy by $75.6\%$ relative to LeWM. Code will be released at this https URL.

40. 【2611.22969】Rescaling OLS-Merged Adapters To Improve Personalized Image Generation

链接:https://arxiv.org/abs/2611.22969

作者:Leander Girrbach,Niklas Schweiger,Zeynep Akata

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Merging multiple adapters, reduces deployment costs, Merging multiple, generation model reduces, model reduces deployment

备注:

点击查看摘要

Abstract:Merging multiple adapters into a single image generation model reduces deployment costs while preserving diverse task capabilities or personalization modes. State-of-the-art methods such as RegMean, Mix-of-Show, and Subspace Routing fit the outputs of the merged model to those of the individual adapters using ordinary least squares (OLS). We show that this reconstruction objective systematically shrinks task-specific signals whenever the activation distributions of different tasks overlap, producing a merged adapter that is too weak for downstream use. We derive a decomposition that quantifies this shrinkage and propose rescaling the merged update to restore signal strength. On multi-subject personalization with up to 30 merged adapters, rescaling substantially improves subject fidelity over unscaled baselines. Our approach also improves results on style transfer, concept erasure, image classification, and LLM-based text classification.

41. 【2611.22968】MI-Hyper: Generating Multiple Instance Models for Weight Space Transfer Learning in Histopathology via Mixed Tasks Pretrained HyperNetwork

链接:https://arxiv.org/abs/2611.22968

作者:Xitong Ling,Yousef Kotp,Weiming Chen,Yining Li,Jiawen Li,Minxi Ouyang,Xinyi Guo,Mingxi Fu,Yizhi Wang,Tian Guan,Lianghui Zhu,Yonghong He

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Zero-shot whole-slide image, Zero-shot whole-slide, whole-slide image, updates at deployment, aims to generalize

备注:

点击查看摘要

Abstract:Zero-shot whole-slide image (WSI) prediction aims to generalize to new pathology tasks without parameter updates at deployment. MI-Zero makes these predictions by pooling patch-text similarities. Conditional weight generation, combined with supervision from diverse pathology tasks, offers an alternative: learning to construct predictive rules from task descriptions. We introduce MI-Hyper, a hypernetwork pretrained across mixed tasks to generate the aggregation and classification weights of multiple instance learning (MIL) models. We first train the generator and a shared MIL basis jointly using source labels. We then freeze the basis and refine the generator. The generated task weights are reused across cases. Across 308 tasks from 52 pathology datasets, MI-Hyper improves mean AUC, balanced accuracy and macro-F1 over MI-Zero by 1.85, 1.17 and 0.57 percentage points, respectively. On some molecular prediction tasks, both AUC and balanced accuracy improve by more than 20 points. These results support task-conditioned weight generation as a promising approach to weight-space transfer for long-sequence modeling.

42. 【2611.22967】CodeReel: Accelerating Code-to-Video Agents with Exact Frame Reuse and Blocking-Aware Scheduling

链接:https://arxiv.org/abs/2611.22967

作者:Junyi Shen,Yao Lu

类目:Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

关键词:Coding agents make, Coding agents, videos by writing, writing and refining, refining programs

备注: 19 pages, 8 figures, 14 tables

点击查看摘要

Abstract:Coding agents make videos by writing and refining programs in a build--inspect--edit loop. A finished film costs a median of $2.85 in model calls and 11 minutes, over a third of that time in builds that block the agent. We find that much of this time is avoidable, for two reasons. First, 37.5% of the frames of a session's later films were drawn before, many shifted in time or inside an edited scene. Second, half of the builds stop at a check, where the agent needs only the verdict, but which builds stop is unknown until the checks finish. We present CodeReel, a training-free execution layer behind agents' existing commands. Exact frame reuse keys each frame by its drawing commands, regardless of its position in time, and reuses each frame whose key recurs. Blocking-aware scheduling runs the checks first and starts the render alongside them, at idle priority, unless the session's recent builds make a pass unlikely. Scheduling spends CPU to answer sooner and reuse returns it; exact keys let later versions use frames rendered for a failed one as the agent thinks. We introduce EditLoop, a benchmark of replayable agent sessions whose films are checked against renders from scratch. On it, CodeReel cuts the agent's wait by 36.3% against Rebuild, a warm pipeline with parallel rendering, and by 57.9% against Sequential, today's step-by-step pipeline. On time-shifting edits its reuse renders 43.9%, close to the 43.0% whose pixels are new, while Manim-style caching renders 99.8%. With real agents, the median wait per build is 0.62x Rebuild's in Claude Code, on topics never used in development, and 0.67x in Codex CLI. The gain holds for five models and two frameworks.

43. 【2611.22964】raining-Free Building Change Detection with Example-Induced Discriminants

链接:https://arxiv.org/abs/2611.22964

作者:Zhi Lu,Bin Hong,Zhenming Peng

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:relies on dense, collect across regions, costly to collect, BCD, dense annotations

备注:

点击查看摘要

Abstract:Building change detection (BCD) relies on dense annotations that are costly to collect across regions. A few annotated examples offer a more economical way to specify the target, but change maps provide incomplete building supervision: they label only changed buildings and leave the building-containing date unspecified. Our key observation is that these annotations nevertheless reveal features that recognize buildings in other images, including unchanged ones. We present Linear INduced Discriminants (LIND), a training-free framework that turns regional feature contrasts into a reusable linear building classifier. Using a single frozen vision transformer, it unifies building recognition and temporal comparison in the same feature space. This approach requires neither text prompts nor an auxiliary segmentation model. Only one parameter is tuned on a single validation dataset and then kept fixed across datasets and shot settings. Extensive experiments demonstrate strong detection accuracy, cross-dataset transfer, and efficient inference, with extensions to other semantic classes and broader land-cover changes. Change annotations thus provide a compact visual specification for detection in new scenes. Code: this https URL

44. 【2611.22962】Hierarchical Diffusion Transformer for End-to-End Image Generation

链接:https://arxiv.org/abs/2611.22962

作者:Xiaoyu Wu,Yifei Wang,Weihang Guo,Chen Wei,Lydia E Kavraki,Niloofar Mireshghallah,Steven Wu

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:pretrained visual encoder, separately pretrained visual, plain pixel-space Transformers, Hierarchical Diffusion Transformers, separately pretrained

备注: Under Review

点击查看摘要

Abstract:Pixel-space diffusion learns visual representations and image generation jointly in a single end-to-end training stage, without a separately pretrained visual encoder. However, plain pixel-space Transformers still trail leading two-stage latent diffusion models in generation quality and training efficiency. We hypothesize that part of this gap arises from retaining one token per patch throughout the backbone, which does not explicitly encourage a visual hierarchy that summarizes related content at progressively coarser levels. To address this, we introduce Hierarchical Diffusion Transformers (HiT), which progressively group related tokens and represent each group with a single token. The main Transformer bottleneck processes these compact group tokens, and ungrouping restores features to their original image positions. A compression budget regulates the average compression ratio across the batch, allowing group memberships and counts to vary across images and diffusion timesteps during both training and generation. The model exhibits emergent semantic structure, learning to group coherent objects and object parts without segmentation labels. In text-to-image generation, HiT further learns to group caption words with image patches depicting the same concepts, without region annotations. HiT achieves 1.48 FID on ImageNet $256\times256$ and reaches comparable generation quality to JiT using approximately 40\% of its cumulative training FLOPs. For text-to-image generation, HiT exceeds UniLiP's average score across five benchmarks with roughly $6\times$ fewer denoiser parameters and $3\times$ fewer forward FLOPs. These results suggest that learning a visual hierarchy within the generator breaks down the barrier to stronger image generation without external visual pretraining.

45. 【2611.22956】Is model self-assessment enough for diverse LVLM ensembles?

链接:https://arxiv.org/abs/2611.22956

作者:Michael Smith,Frank P. Ferrie

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Large Vision Language, diverse Large Vision, Vision Language Models, Large Vision, Vision Language

备注:

点击查看摘要

Abstract:Ensembles of diverse Large Vision Language Models have demonstrated performance beyond that of single models across multiple datasets and tasks. However, the necessary aggregation process usually relies on training, parameter fitting, or complex task-specific pipelines. Furthermore, evaluation is limited, making a fair comparison difficult. We create a unified pipeline where we perform candidate response selection: we build an ensemble by selecting the best answer from a set provided by different models. We comprehensively evaluate across 34 different means of confidence estimation, 24 ensemble configurations, 20 datasets, and two prompt specifications. We show that simple training and parameter-free approaches can be sufficient, even for ensembles of different architectures. These simple self-assessment approaches rely solely on each constituent model's confidence, without explicit calibration, yet are able to perform better than said constituent models. They are also competitive with more involved alternatives on standard metrics such as accuracy, including on open-ended problems. However, we also discover that dataset, ensemble composition, and prompt wording are key confounding variables insufficiently explored by prior work that significantly affect ensemble performance, such that the ensemble can perform worse than its best constituent model. These must be optimized for to get the most out of ensembles, at the cost of limiting their generalizability. We recommend that practitioners consider training-free ensembles only if deployment conditions can be precisely characterized, with Best-of-N configurations of strong models being a good starting point.

46. 【2611.22953】Fiberpose: state-of-the-art fiber morphometry and instance segmentation with a distance-transform neural network

链接:https://arxiv.org/abs/2611.22953

作者:Viktor A. Balashov,Daniil S. Antonenko

类目:Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)

关键词:routine task, task in biomedical, biomedical engineering, SEM images, fibrous SEM images

备注:

点击查看摘要

Abstract:Analysis of fibrous structures in SEM images is a routine task in biomedical engineering and materials science. However, most available methods for fiber quantification still rely on classical image binarization followed by simple post-processing. These approaches often produce unreliable results in images with weak boundaries, heterogeneous contrast, and densely packed fibers. Here, we introduce Fiberpose, a framework that reformulates fiber analysis as direct regression of a smooth distance-transform (DT) field, together with a novel set of geometry-based algorithms specifically adapted to this representation. The predicted field directly encodes fiber geometry, while the accompanying algorithms enable instance reconstruction and measurement of diameter and orientation within a unified workflow. The framework is implemented as a standalone Python desktop application and a web tool this https URL. On an independent dataset of fibrous SEM images, Fiberpose achieved state-of-the-art instance-segmentation accuracy in comparison with SAM2 and Cellpose-SAM, and more accurate diameter measurements than DiameterJ, Fibar and GIFT. The method remains effective in dense and weakly contrasted regions and shows qualitative generalization across microscopy modalities not represented in the training data. Fiberpose therefore provides an interpretable geometric representation and an automated pipeline for reproducible quantitative characterization of fibrous materials.

47. 【2611.22925】Code World Model 2.0: Towards Infinite Controllable Video Generation

链接:https://arxiv.org/abs/2611.22925

作者:Ruoyu Wang,Hao Zhong,Yanming Yang,Jiahao Tian,Lin Liu,Biao Gong,Guoshan Lu,Yiding Tian,Chunhua Shen,Zhenzhong Lan,Chi Zhang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Visual proxies decouple, decouple explicit world-state, explicit world-state simulation, offline clip creation, photorealistic video synthesis

备注: Project Page: [this https URL](https://www.inclusion-ai.org/CodeWorldModel/)

点击查看摘要

Abstract:Visual proxies decouple explicit world-state simulation from photorealistic video synthesis, offering a controllable interface for both offline clip creation and real-time interactive streaming. Yet a practical renderer must address two challenges. Upstream proxies vary from coarse layouts to fine articulated geometry depending on the interaction, and streaming inference must operate in a few causal steps without accumulating drift across self-generated history. We present Invoker-Render, pairing a bidirectional creation model with a causal four-step streaming model under a shared conditioning interface over structural proxies, an appearance reference, and language. Trained on an aligned approximately 200-hour multi-granularity corpus, Invoker-Render honors fine geometric constraints when supplied while synthesizing plausible local motion under coarse proxies, enabling runtime selection of input detail. To bridge bidirectional creation and real-time streaming without compounding step compression and rollout drift, we introduce Progressive Forcing (ProForcing). ProForcing first trains a causal predictor and distills it into a four-step renderer using histories derived from training videos. Training then shifts to continuous self-generated rollouts. A pipelined serving stack supports efficient streaming inference. Experiments show versatile control across proxy families, granularities, and camera paths, consistent gains over recent streaming baselines, and stable 30-minute racing rollouts that preserve scene and subject appearance.

48. 【2611.22922】SWIR-cGAN: Synthesizing SWIR Bands Using VNIR Imagery from CBERS and AMAZONIA-1

链接:https://arxiv.org/abs/2611.22922

作者:Alisson Cleiton de Oliveira,Rennan de Freitas Bezerra Marujo,Thales Sehn Körting

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:important research topic, MSI SWIR bands, remote sensing, Spectral band synthesis, important research

备注: Available on: [this https URL](https://ieeexplore.ieee.org/document/11793642) . Early Access

点击查看摘要

Abstract:Spectral band synthesis is an important research topic in remote sensing. The Brazilian satellites CBERS-4, CBERS-4A, and AMAZONIA-1 provide high temporal resolution (1-3 days) visible and near-infrared (VNIR) imagery through the Wide-Field Imager (WFI), but lack short-wave infrared (SWIR) bands. Recent deep learning methods have shown promising results for spectral synthesis, but challenges remain for cross-satellite generalization and spectrally distant bands. This paper presents a conditional Generative Adversarial Network (cGAN) with an attention-enhanced U-net generator and a multi-loss objective to synthesize Sentinel-2/MSI SWIR bands 11 (SWIR-1) and 12 (SWIR-2) from WFI VNIR inputs. Experiments used 4,125 patches for training and cross-validation and 1,026 unseen patches for testing, with hyperparameters optimized using a subset of the training data. On SWIR-1, the model achieved SSIM of 0.900, PSNR of 31.44 dB, and MAE of 0.019 in TOA reflectance. On SWIR-2, it achieved SSIM of 0.917, PSNR of 33.35 dB, and MAE of 0.015. Benchmarking was performed on the test dataset, with each model optimized separately prior to evaluation. SWIR-cGAN outperformed the baselines, particularly for SWIR-2. The ablation study identified the multi-loss as the main performance contributor, while the attention and residual modules provided additional improvements. Our results demonstrate the feasibility of synthesizing SWIR bands from WFI imagery. The SWIR-cGAN is available at this https URL.

49. 【2611.22903】BRepA: Graph-Based B-Rep Pretraining for Unified CAD Understanding and Generation

链接:https://arxiv.org/abs/2611.22903

作者:Dekai Zhu,Zhaiyu Chen,Stefan Gavranovic,Slobodan Ilic

类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词:encodes geometric primitives, enabling efficient shape, models encodes geometric, Boundary representation, enabling efficient

备注:

点击查看摘要

Abstract:Boundary representation (B-Rep) of CAD models encodes geometric primitives and their relations as a graph structure, enabling efficient shape modeling within CAD software. Learning on B-Reps for downstream tasks, such as segmentation and novel shape generation, requires specialized neural network designs. Moreover, performance improvements and accelerated training can be achieved with effective pretraining strategies, which is particularly important for tasks with limited labeled B-Rep data. In this paper, we introduce BRepA, a unified self-supervised pretraining framework that explicitly reconstructs both the geometry and topology of B-Rep objects via graph-based modeling. By learning from large-scale unlabeled CAD data only once, BRepA produces representations that generalize across tasks and significantly enhance both discriminative and generative learning. On segmentation tasks, BRepA demonstrates remarkable data efficiency. For instance, with only 1% labeled samples, BRepA pretraining improves mIoU by 32.52% compared to models trained from scratch. On generative tasks, aligning diffusion model representations with pretrained BRepA features substantially accelerates convergence, achieving nearly 2 times faster training while improving generation quality under the same computational budget, despite the diffusion model being roughly 20 times larger than BRepA. Overall, our results show that geometry- and topology-aware B-Rep pretraining provides a powerful foundation for both understanding and generating CAD structures, serving as a versatile representation backbone for diverse downstream applications. We will release the code to facilitate future research.

50. 【2611.22898】You Only Encode Once: Sub-Pixel-Shifted Frames for Arbitrary-Scale Remote Sensing Super-Resolution with 2D Gaussian Splatting

链接:https://arxiv.org/abs/2611.22898

作者:Canjie Liu,Liuqian Wang,Qi Ming,Wei Lu,Xiaohan Hao,Yuefei Wu,Wentao Chao,Lei Shi

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Arbitrary-scale super-resolution, remains challenging due, limited high-frequency information, images remains challenging, remains challenging

备注:

点击查看摘要

Abstract:Arbitrary-scale super-resolution (ASSR) of remote sensing images remains challenging due to the limited high-frequency information in a single low-resolution (LR) observation. While multi-frame SR can exploit complementary sub-pixel information, existing approaches often require real multi-frame training sequences and repeated feature encoding, increasing data acquisition demands and computational costs. To address these limitations, we propose SPS-GS (Sub-Pixel-Shifted Gaussian Splatting), an encode-once framework that learns from multi-phase LR observations synthesized from individual high-resolution images, without requiring real multi-frame training sequences. Specifically, Phase-Coherent Aliasing Demodulation (PCAD) exploits shift-dependent aliasing through Fourier-based alignment, phase-aware residual fusion, and least-squares aliasing estimation, enabling multi-frame information to be integrated before a single deep encoding pass. Gaussian Projection Alignment (GPA) then iteratively refines Gaussian centers and colors using multi-observation back-projection to promote observation consistency. The refined Gaussians support continuous rendering at arbitrary scales. Extensive experiments on five remote sensing datasets demonstrate strong reconstruction performance against single-image and multi-frame SR baselines, while maintaining competitive inference efficiency at common scales. The code will be publicly released.

51. 【2611.22896】Impact of Pretraining Length, Model Size, and Annotation Budget on Downstream Clinical Tasks of Foundation Models in Radiotherapy

链接:https://arxiv.org/abs/2611.22896

作者:Alejandro Cortina Uribe,Sidsel Højklint Poulsen,Ivan Richter Vogelius,Jens Petersen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:individual treatment responses, offering great potential, monitor individual treatment, radiotherapy CBCT, radiotherapy CBCT scans

备注: 9 pages, 5 figures, 2 tables. Supplementary Material included

点击查看摘要

Abstract:Cone-beam CT (CBCT) scans acquired during radiotherapy capture changes such as tumor shrinkage and radiation-induced tissue changes, offering great potential for foundation models that help monitor individual treatment responses. However, to our knowledge, no large-scale pretrained models for radiotherapy CBCT exist, and evaluating modeling choices is difficult since downstream tasks are not known in advance. We examine how pretraining length, model size, and finetuning strategy relate to downstream clinical performance, and how metrics tracked during pretraining correlate with it. We pretrain vision transformer encoders with masked image modeling on about 150,000 raw 3D radiotherapy CBCT scans, tracking representation quality via validation loss, effective rank, and linear probing. Downstream tasks are classification of feeding tube presence ($n=51,135$ CBCTs, $1,562$ patients) and clinical characteristics (T-, N-stage, sex, age, tumor site; $n=1,278$ patients) in head and neck cancer. We compare low-rank adaptation (LoRA) and full finetuning against no pretraining, varying annotated dataset size. Pretext validation loss was the most consistent predictor of downstream performance; effective rank and linear probing were also associated, but not consistently across model sizes and finetuning methods. LoRA performed comparably to full finetuning while training only 0.5-2.5% of the parameters. Fully finetuned models consistently outperformed models without pretraining across all sizes, with AUROC 0.91-0.97 vs. 0.58-0.85 for feeding tube classification and 0.99-1.00 vs. 0.71-0.97 for sex classification. Model size had only a small, inconsistent effect, suggesting smaller models suffice at lower computational cost. Code and pretrained models (non-commercial license): this https URL

52. 【2611.22894】Wear and Go: Calibration Free Sparse Inertial Motion Capture via Online Sensor Setup Estimation

链接:https://arxiv.org/abs/2611.22894

作者:Yuanshuo Tan,Licheng Zhong

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Sparse inertial motion, capture typically assumes, Sparse inertial, motion capture typically, sensor anatomical identity

备注:

点击查看摘要

Abstract:Sparse inertial motion capture typically assumes that each sensor's anatomical identity and mounting orientation are known. We present MOSAIC (Motion-based Sensor Assignment and Inertial Calibration), a framework that recovers this setup from ordinary motion without a calibration pose. Our central insight is that body pose changes continuously while the sensor setup persists, allowing movements that are individually ambiguous to provide complementary evidence over time. A setup network processes unordered sensor streams with temporal and cross-sensor attention, then accumulates assignment and rotation evidence into a session-level estimate. The recovered setup canonicalizes measurements for frozen pretrained pose estimators, separating sensor configuration from motion reconstruction. For sensors worn at prescribed body sites, evaluation on real inertial recordings with randomized setups shows near-calibrated pose accuracy for bounded offsets and substantial benefits from accumulation under arbitrary orientations. Transfer across pose networks supports setup recovery as a reusable interface between interchangeable sensors and pretrained pose models.

53. 【2611.22884】RoadAnnoter: An AI-Assisted Desktop Tool for Semantic Segmentation Annotation of Road-Scene Images

链接:https://arxiv.org/abs/2611.22884

作者:Nazmul Haque,Arnob Protim Roy

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Accurate semantic segmentation, Accurate semantic, polygon-level annotation remains, labelled dataset development, annotation remains labor-intensive

备注: 33 Pages

点击查看摘要

Abstract:Accurate semantic segmentation of road-scene images is essential for road safety research; however, polygon-level annotation remains labor-intensive and limits labelled dataset development. This study presents RoadAnnoter v1.0, an open-source desktop application integrating six human-in-the-loop annotation modes: manual polygon delineation, SAM Prompt, Smart Select, Edge Fill, pretrained semantic segmentation using Cityscapes-trained SegFormer models, and task-specific segmentation using TinySegNet, a lightweight MobileNetV3-Small-based network trained with accumulated annotator-generated labels. SAM-based modes use promptable segmentation with SAM and MobileSAM, while Edge Fill combines Canny edge detection with colour-similarity-based flood filling in CIELAB colour space. SegFormer generates suggestions for common road-scene categories, whereas TinySegNet supports adaptation to project-specific features through iterative training. All six modes use a shared mask-to-polygon pipeline comprising morphological processing, Gaussian smoothing, contour extraction, and Douglas-Peucker simplification; annotations are exported in YOLO segmentation format. RoadAnnoter was used to annotate Google Street View images from recorded road accident locations in Bangladesh for a vision-language model-based investigation of free-flow speed estimation. Qualitative assessment across representative scenes demonstrated the complementary applicability of the annotation modes to diverse feature geometries. Visual comparison with Roboflow indicated similar qualitative boundary characteristics for principal road-scene regions, although no quantitative accuracy assessment was conducted. RoadAnnoter provides a locally operated framework for developing road-scene segmentation datasets for transportation engineering and road safety research.

54. 【2611.22880】Learning Agent-Centric Vision-Language-Action World Models for Autonomous Driving

链接:https://arxiv.org/abs/2611.22880

作者:Guoqing Wang,Pin Tang,Xiangxuan Ren,Chao Ma

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Recent progress, progress in integrating, significantly advanced, current observations, allowing systems

备注: Accepted by NeurIPS 2026

点击查看摘要

Abstract:Recent progress in integrating vision-language-action (VLA) models with world modeling has significantly advanced end-to-end autonomous driving by allowing systems to reason about imagined futures instead of merely reacting to current observations. However, most world VLA models generate future frames at the pixel level with plenty of dense visual tokens. Although such generated futures can be visually plausible, they preserve many driving-irrelevant appearance details, i.e., only a small portion of the tokens directly encode critical planning-relevant factors, such as agent geometry, motion dynamics, and interactions. This introduces a significant performance bottleneck. An important question thus arises: what world state should a world VLA model reason over to support planning beyond pixel-level prediction? We argue that planning-oriented world modeling should focus on a compact and structured agent-centric latent state that captures the interactions between objects in the driving scene over time. As such, we introduce AgentWorld, an agent-centric VLA world model that uses discrete agent tokens jointly for reasoning and trajectory planning. Each token is dynamically grounded to a surrounding agent associated with its object's state, such as semantic identity, 3D geometry, motion, and interaction context. AgentWorld learns these tokens through three key processes: explicit geometric grounding, reasoning-oriented supervised fine-tuning, and agent-oriented reinforcement learning. Extensive open-loop and closed-loop experiments under diverse driving scenarios show that AgentWorld enhances planning capabilities, fully exploits visual evidence and agent dynamics, and yields interpretable agent-centric world states.

55. 【2611.22879】SlideJev: Order-Stable and Tissue-Grounded Jev Decisions for Whole-Slide Pathology

链接:https://arxiv.org/abs/2611.22879

作者:Lei Wu,Jiashuai Liu,Di Zhang,Chunze Yang,Jiusong Ge,Junbo Lu,Yongqi Liang,Wenjie Zhao,Ni Zhang,Chen Li,Zeyu Gao,Qidong Liu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:visual question answering, question answering, phenotypic questions, Whole-slide visual question, offers a natural-language

备注: 10 pages, 6 figures, 3 tables

点击查看摘要

Abstract:Whole-slide visual question answering (VQA) offers a natural-language interface to pathology, allowing diagnostic and phenotypic questions to be answered directly from tissue slides. However, current vision-language models (VLMs) rely heavily on linguistic priors: their answers are sensitive to the order of the candidate answers, and can be reached through shortcuts that bypass the tissue evidence. To address these challenges, we introduce SlideJev, a framework that separately verifies candidate answers against the slide and learns to ground these judgments in tissue evidence. To connect parallel candidate evaluation with visual evidence learning, we adopt Jev and score each candidate by the difference between support and rejection log-likelihoods from the original language-model head. We compute these scores in parallel using separate prompts with the same format and no option-position labels, then normalize them for answer selection. To ground these scores in tissue evidence, candidate-conditioned reading and comparison guide gated updates to visual tokens across decoder layers. With the backbone frozen, we train these visual modules through the same scores using question-answer and paired-image supervision. Across three whole-slide pathology VQA benchmarks, SlideJev achieves the highest mean overall accuracy and 100% answer consistency across four option orders. Image-control experiments further show that SlideJev achieves the largest average accuracy gains from correct images over mismatched and image-free inputs across the three datasets. Our code is publicly available at this https URL.

56. 【2611.22874】Harnessing Image Diffusion Prior for Photo-Realistic Video Restoration

链接:https://arxiv.org/abs/2611.22874

作者:Fanghua Yu,Hongyu An,Jinfan Hu,Xinqi Lin,Zhiyuan You,Jian Wang,Hongyang Li,Chao Dong,Jinjin Gu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:produce photo-realistic results, remains difficult due, Recent image generation, restoration remains difficult, Recent image

备注: 40th Conference on Neural Information Processing Systems (NeurIPS 2026)

点击查看摘要

Abstract:Recent image generation models produce photo-realistic results with rich details, but transferring their powerful priors to video restoration remains difficult due to temporal inconsistency from stochastic detail synthesis. Existing video restoration methods improve temporal coherence but often sacrifice visual fidelity, leaving a gap between image-level quality and video-level stability. We propose a generative video restoration method that bridges this gap by enabling temporally consistent detail synthesis from image generation priors. Our method combines noise energy rebalancing to suppress structure-disturbing low-frequency stochasticity, motion-aligned noise warping to propagate details along object motion, a self-supervised denoising encoder to mitigate encoder-induced temporal uncertainty, and decoupled temporal attention to model cross-frame dependencies. Together, these components preserve fidelity, enhance fine-grained realism, and maintain temporal consistency. Extensive experiments show that our method substantially outperforms existing video restoration approaches in visual quality, detail richness, and temporal stability.

57. 【2611.22867】LOCUS: Causal Support Windows for Attribute Control in Autoregressive Image Generation

链接:https://arxiv.org/abs/2611.22867

作者:Zijun Huang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Unified autoregressive, image generators struggle, satisfy multiple attribute, multiple attribute constraints, struggle to satisfy

备注:

点击查看摘要

Abstract:Unified autoregressive (AR) image generators struggle to satisfy multiple attribute constraints in a single prompt. Although these attributes are decodable from image-token latents, editing those latents at test time remains difficult. Adding a fixed attribute direction to the prefix can reinforce a requested attribute but rarely overrides a conflicting one, such as turning a car red when the prompt specifies blue. We investigate how the effect of an intervention depends on where it acts in the image-token sequence. We introduce the causal support profile, which measures, for each attribute, how often patching image-token states within a given window flips the rendered attribute. Structural attributes (count and position) are most responsive in early, narrow windows, while appearance attributes (color, size, and material) respond over later, broader windows. A budget-matched comparison of early and middle windows shows that the effect of window location depends on the target attribute, and two-dimensional support maps show that the responsive regions track spatial content. Based on these profiles, we propose LOCUS (Latent Optimization in Causal Support windows), which diagnoses which attribute failed and routes test-time latent optimization to its corresponding support window. With the generator, optimizer, reward, verifier, and token budget held fixed, support-routed windows outperform late windows by 23.6 percentage points in GenEval++ macro accuracy. With the generator frozen, LOCUS raises Janus-Pro's GenEval++ accuracy from 24.6% to 46.8% overall and from 19.5% to 40.5% on multi-attribute tags. On GenEval, LOCUS repairs 48.1% of failed generations in one rollout, compared with 37.4% for prefix optimization, and needs 14% fewer rounds on average to succeed.

58. 【2611.22857】Beyond Co-Generation: Rethinking Jointness in Joint Audio-Video Generation

链接:https://arxiv.org/abs/2611.22857

作者:Jihoo Jung,Ji-Hoon Kim,Suyeon Lee,Gia Thinh Pham,Joon Son Chung

类目:Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

关键词:advance the understanding, genuine audio-visual coordination, Evaluating audio-visual consistency, intrinsic jointness, consistency

备注: Preprint

点击查看摘要

Abstract:Our aim is to advance the understanding of genuine audio-visual coordination in joint text-to-audio-video (T2AV) generation, with particular emphasis on semantic consistency. Evaluating audio-visual consistency in T2AV generation is nontrivial, as detailed text prompts obscure whether such consistency stems from genuine cross-modal coordination or merely from independent text following. To isolate the former, we introduce intrinsic jointness: the ability of audio and video to produce the same realization for details left underspecified by the prompt. Using semantically underspecified prompts (e.g., "musical instrument playing" rather than "electric guitar playing"), we investigate four recent models and reveal their limited intrinsic jointness. To address this limitation, we propose JointREPA, a simple representation alignment-based post-training method to facilitate cross-modal coordination. Since existing benchmarks use semantically detailed prompts, we introduce UNSAIDBench, a benchmark designed to evaluate intrinsic jointness under semantic underspecification. Experiments across two distinct models and three benchmarks, including UNSAIDBench, demonstrate that JointREPA consistently improves semantic consistency.

59. 【2611.22856】Propose Verify: Fast Reflection Symmetry Detection via Harmonic Fields

链接:https://arxiv.org/abs/2611.22856

作者:Yishai Lavi,Shai Avidan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Detecting multiple reflection, approaches computationally expensive, making traditional voting, traditional voting approaches, voting approaches computationally

备注:

点击查看摘要

Abstract:Detecting multiple reflection symmetries in 3D shapes requires aggregating geometric evidence over a large space of candidate planes, making traditional voting approaches computationally expensive. We introduce the Fourier Accelerated Symmetry Transform (FAST), a training-free framework that combines geometric pair voting with efficient spectral computation. Exploiting the fact that global reflection planes pass through the shape centroid, we reduce the search to plane orientations, while geometric consistency filtering and independent witnesses suppress unreliable pair hypotheses. Our key insight is to represent these votes as a signal over plane orientations and efficiently compute a continuous, smoothed symmetry field in the spherical-harmonic domain. Specifically, we exploit the Funk-Hecke theorem, the spherical counterpart of the Fourier convolution theorem for rotationally symmetric kernels, to transform Gaussian smoothing into multiplication of harmonic coefficients. This enables efficient field evaluation, from which symmetry candidates are extracted, refined, and geometrically verified. Across two benchmarks, including a new benchmark of highly symmetric shapes, FAST achieves the highest clean multi-plane detection $F_1$ scores among evaluated methods (0.861 and 0.947), with GPU inference below 4 ms per shape: over $100\times$ faster than the next-fastest evaluated multi-plane GPU baseline. FAST also demonstrates strong robustness to geometric noise and competitive single-plane detection, achieving 94.9% success on clean single-plane shapes.

60. 【2611.22855】CaFe: Causally Faithful Conditional Traffic Scenario Generation

链接:https://arxiv.org/abs/2611.22855

作者:Steven Yu Tung,Shubham Vaijanath Phoolari,Christoph Lauer,Abhinav Valada,Steven Peters

类目:Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:Language-conditioned traffic simulation, Language-conditioned traffic, simulation enables scalable, natural language, enables scalable test

备注:

点击查看摘要

Abstract:Language-conditioned traffic simulation enables scalable test scenarios steered by natural language. The goal is to control selected agents while surrounding traffic reacts to their observed behaviour. For example, a vehicle instructed to cut in late should cause the following vehicle to brake only when the manoeuvre becomes observable. Yet simulators can leak private instructions across agents, causing surrounding vehicles to react before the instructed behaviour becomes observable. Such premature reactions defuse desired events and alter the ensuing closed-loop scenario. Existing benchmarks measure what agents do, not what they could have known, leaving this failure unmeasured. We formalise it as intent leakage and address it through evaluation, data and modelling. Our paired intervention test holds an instructed agent's executed trajectory fixed while varying its private instruction, isolating leakage-induced changes in surrounding agents. We also construct WOMD-PACT, an automatically generated, verifiable dataset of 531,099 WOMD scenes with timed behaviour tags with reaction episodes identified through a counterfactual ghost test and grounded private instructions. Finally, we introduce CaFe, a dual-stream diffusion-forcing simulator fine-tuned in closed loop that restricts inter-agent interactions to public beliefs, preserving legitimate anticipation without leaking private intent. Our evaluation reveals that existing conditioning designs displace 23-83% of nearby uninstructed agents through private-intent leakage, even when the instructed agent's executed motion is held fixed. CaFe eliminates measurable leakage while maintaining comparable WOSAC realism (0.763), demonstrating that causal faithfulness can be enforced without sacrificing measured simulation realism.

61. 【2611.22853】Keeping Parts Honest: Isolated Part Graphs for Faithful Vision Transformer Explanations

链接:https://arxiv.org/abs/2611.22853

作者:Bernard Tomczyk,Gail Collyer-Hoar,Bryan Williams

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Vision Transformers, individual image regions, Transformers, Vision, image

备注: 12 pages, 6 figures, 6 tables. Supplementary material will be added in a later version

点击查看摘要

Abstract:Part and prototype-based explanations for Vision Transformers (ViTs) present a decision as evidence from individual image regions. However, self-attention mixes information across patches, so part-level features absorb context from the whole image and consequently fail to faithfully reflect the decision. We show that existing interpretable ViT classifiers depend heavily on this leakage: when each explained region is encoded in isolation, their accuracy collapses, and retraining them under isolation recovers only part of the lost accuracy. We propose a classifier that represents each image as a graph of isolated parts. Each part is encoded only from its own patches by a ViT whose last blocks are fine-tuned under isolation, preventing evidence leakage from elsewhere in the image. Parts are discovered without annotation and refined hierarchically through their sub-parts, making them more consistent and stable across images than those of competing methods. Each edge is computed from part pairs, and recovers evidence that attention previously shared across the object without affecting the parts. Matching the image graph to a learned prototype graph per class makes the prediction a direct combination of node and edge similarities, each computed only from the patches it is credited to, so every explanation is faithful by construction. Across 11 fine-grained and general-object benchmarks, our method exceeds the accuracy of existing explainable methods that rely on leakage, while providing explanations that reflect what the model actually uses.

62. 【2611.22852】chnical Report of Mobile Manipulator Robot for Industrial Environments

链接:https://arxiv.org/abs/2611.22852

作者:Aria Dadnavi,Matin Jamshidi,Kian Khatibi,Shahriar Karimi Makhsous,Saina Najafi Shabestari,Seyed Sobhan Hosseini Hajibekandeh,Zahra Mahaam,Reyhane Mohasseli,Ghazal Ghoreishi,Amirhossein Gholizadeh Behbahani,Mohammad Hossein Moaiyeri

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)

关键词:Shahid Beheshti University, Intelligent Automation Laboratory, Auriga Robotics' mobile, Automation Laboratory, Department of Electrical

备注: 25 pages, 22 figures, 4 tables. Technical report of Team Auriga's 2025 mobile manipulator (@Work) platform (Robotics and Intelligent Automation Laboratory, Shahid Beheshti University)

点击查看摘要

Abstract:This paper presents the design and implementation of Auriga Robotics' mobile manipulator robot, developed at the Robotics and Intelligent Automation Laboratory, Department of Electrical Engineering, Shahid Beheshti University. Hereafter, this platform is referred to as the @Work Robot. The robot targets industrial tasks, with an emphasis on improving efficiency in repetitive or hazardous work environments. It uses a 4-wheel Mecanum drive for omnidirectional movement and a 5-degree-of-freedom manipulator arm with a 3D-printed gripper for object handling and navigation. The electronics consist of custom PCB boards built around ESP32 microcontrollers, together with an NVIDIA Jetson Orin NX that handles high-level processing and real-time system control. On the software side, Hector SLAM provides mapping and localization, A* handles path planning, and YOLO performs real-time object detection. These modules draw on fused sensor data to deliver robust navigation and reliable collision avoidance. Overall, the system shows effective hardware-software integration, with consistent performance in autonomous navigation, object handling, and task execution in industrial-like settings.

63. 【2611.22829】Kolibri: Color Finds the Place, Refinement Sets the Pose for RGB-D Localization in Colored Point Clouds

链接:https://arxiv.org/abs/2611.22829

作者:Leonel Aguilar,Bartu Tuncay,Christoph Hoelscher

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Point cloud, agent or robot, scanned building, Point cloud registration, building colored point

备注:

点击查看摘要

Abstract:An agent or robot in a scanned building must locate its camera in rooms that no model saw during training. Point cloud registration methods can align each RGB-D frame with the building's colored point cloud, accurately but at a high cost. We observe that geometric refinement brings nearby initial poses to the same final pose, so the learned component only needs to find the place. Kolibri does this with a graph network of 55,712 parameters that describes 10 cm cubes of points, called cells, by their color, local shape and neighbors. With the same refinement, it matches GeDi on 96 unseen ScanNet rooms (81.4% against 80.3% within 5 cm and 5°) and on a held-out test of 10 further rooms, in 82 ms per frame on an RTX 2080 Ti. The saved time allows for search without a room label. In one point cloud of 100 rooms, Kolibri loses 1.3 points against knowing the room, while retrieving the room first loses 56.0. In a hospital emergency department scene from a real scan, it localizes 86.5% of the frames rendered from the scan in 384 ms each, where GeDi needs 91 minutes per frame on cubes of the scan for a similar recall. The method needs colors that agree between the frame and the point cloud. On gray frames and across cameras with different color responses, point cloud registration methods keep the lead.

64. 【2611.22825】A tiny object detection dataset for high-altitude open-water search and rescue

链接:https://arxiv.org/abs/2611.22825

作者:Hui Xu,Chenfei Hou,Henglai Wei,Hao Wang,Yidong Jin,Xiulin Niu,Haoyang Zhang,Hui Zhang,Tianshi Xu

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Large aerial platforms, Large aerial, open water search, search and rescue, aerial platforms

备注:

点击查看摘要

Abstract:Large aerial platforms often operate above 1.5 km to improve the efficiency of open water search and rescue (OW-SAR). However, long imaging distances, wide fields of view, and limited sensor resolution reduce objects to a few pixels, increasing their susceptibility to environmental interference and making detection harder than for conventional small objects. To our knowledge, existing datasets focus on low-altitude scenarios and do not support automatic detection at 1.5-2.0 km. We therefore present TinyWOD, a tiny object detection dataset for high-altitude OW-SAR using lifebuoys as detection targets. It comprises 11,359 manually annotated images and 19,505 annotated instances spanning diverse environments, lighting conditions, water colors, and surface ripples. Compared with existing datasets, TinyWOD contains much smaller objects and a substantially higher proportion of tiny instances; its average equivalent side length (ESL) is 12.7 pixels, with 76.96% of in stances having ESLs below 15 pixels, reflecting actual high-altitude water-rescue imaging conditions. We define APtiny, a tiny object detection metric, and benchmark mainstream and state-of-the-art networks using this and conventional metrics. All evaluated networks effectively detect tiny waterborne objects, demonstrating TinyWOD's reusability and utility. We expect this dataset to support research on tiny object detection in high-altitude OW-SAR.

65. 【2611.22820】Pixel is All You Need

链接:https://arxiv.org/abs/2611.22820

作者:Jie Chu,Haoting Shi,Fucheng Zhang,Jiawei Liu,Junwei Liao,Ying Wen,Muning Wen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:suggesting an ambitious, robot actions, ambitious goal, goal of unifying, Text

备注: 20 pages, 6 figures, 7 tables, including references and appendices

点击查看摘要

Abstract:Text, images, audio, touch, and even robot actions can, in principle, all be rendered onto a single canvas, suggesting an ambitious goal of unifying all modalities within vision. Language provides the natural first test. To subsume it, a visual model must reason directly over text in pixels. Across a wide range of image, video, and unified multimodal generators, however, we find that their visual generation modules cannot perform symbolic reasoning over text on the canvas. They succeed only when an underlying text module or prompt rewriter already supplies the answer, effectively reducing the generator to a mere renderer, a limitation that post-training does little to resolve. To test whether this failure stems from pixels themselves or from current training paradigms, we train a family of purely pixel-space generative models from scratch without any text pathway. With images as their sole input and output, these models read questions, write intermediate steps, and produce answers directly on the canvas. Remarkably, they exhibit hallmark behaviors of large language models. Performance improves predictably with scale following a power law. Writing intermediate steps frame by frame substantially outperforms single-frame answering, echoing chain-of-thought, while reinforcement-learning post-training further strengthens reasoning. Moreover, sharing one canvas allows the same model to reason across modalities, a capability that text-only language models lack. To the best of our knowledge, this is the first systematic study of these phenomena in purely pixel-space generative models free of text tokens.

66. 【2611.22815】Visual Harness Scales General VLMs to Medical Images

链接:https://arxiv.org/abs/2611.22815

作者:Shaowen Wan,Hanqi Jiang,Zihao Wu,Junhao Chen,Weihang You,Ruiyu Yan,Bowen Chen,Tianming Liu,Lin Zhao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:medical visual harness, general VLMs, visual harness, general vision-language models, diverse medical imaging

备注:

点击查看摘要

Abstract:We show that an appropriate visual harness can substantially improve the performance of general vision-language models (VLMs) across diverse medical imaging tasks. We introduce \ours, a medical visual harness that equips general VLMs with interactive visual tools and systematic diagnostic evidence management. With \ours, general VLMs interactively explore medical images and progressively acquire diagnostic evidence, which is preserved in a lossless memory for subsequent retrieval and use. After submitting an initial answer, the VLM receives an assessment of potential omissions and the reliability of identified findings. This assessment guides further image inspection and measurement, followed by answer revision in an iterative agentic loop until sufficient evidence is obtained. Across 11 tasks and four imaging modalities, \ours improves performance on all tasks with Qwen3.8-27B, with notable gains in spleen measurement (63.3\% to 98.3\%), renal search (57.5\% to 71.2\%), and pulmonary nodule detection (0.0\% to 28.2\%). High-capability API-based VLMs achieve even higher performance with \ours. For example, GPT-6.1 Sol improves pulmonary nodule detection from 10.8\% to 69.2\% with \ours, demonstrating the complementary benefits of stronger model capabilities and an effective medical visual harness. Our results highlight the potential of visual harnesses as a new paradigm for scaling general VLMs to medical imaging tasks.

67. 【2611.22790】NexSight: Verifiable Tasks for Fine-Grained Agentic Long-Video Understanding

链接:https://arxiv.org/abs/2611.22790

作者:Tianci Xie,Li Chen,Pinxue Guo,Rui Zheng

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:order events unfold, Fine-grained questions, events unfold, order events, Fine-grained

备注: 25 pages, including references and supplementary material

点击查看摘要

Abstract:Fine-grained questions about long videos ask how many times an action occurs, in what order events unfold, or exactly when a state changes. Answering them can require finding brief moments scattered across hours of footage. Agentic models that decide when and where to look promise to find these moments, yet this ability is hard both to measure and to learn. Sparse supporting evidence may establish that an action occurred without establishing its total count; verifying timeline-wide claims requires checking for missed occurrences and double counting. Answer-only supervision, in turn, does not explicitly supervise the search for evidence. We present NexSight, which builds verifiable tasks to both evaluate and train agentic long-video understanding. Its agentic pipeline, SightForge, accepts a task only if a verifier blind to the draft answer can reconstruct it from evidence densely reacquired from the raw video and counterexample checks fail to refute it. This yields SightLine, 310 evidence-traceable tasks from 108 long videos, evaluated through SightLoop, a shared multiscale harness supporting temporal exploration, local inspection, evidence integration, and revisiting while recording returned observations. On disjoint videos, solver trajectories on verified tasks become step-level supervision for observation decisions. The strongest model reaches only 54.52% on SightLine, yet 79.35% when given the annotated evidence. With under 6K examples, Sight-35B nearly doubles its base model's interactive accuracy (21.29% to 42.26%), outperforms the 397B model of its family, begins using explicit spatial inspection after post-training, which its base model never uses, and gains over 8 points on two external long-video benchmarks.

68. 【2611.22769】ForceBody: Force-Paired Parametric Body Motion with Torque Uncertainty

链接:https://arxiv.org/abs/2611.22769

作者:Joonwoo Kwon,Yufei Zhang,Xiaoming Liu,Zijun Cui

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:torques drive human, drive human motion, central to biomechanics, physics-aware animation, reconstruction and generation

备注: Accepted at NeurIPS 2026 Evaluations Datasets Track

点击查看摘要

Abstract:Forces and torques drive human motion, central to biomechanics, robotics, and physics-aware animation, yet they are often absent from learning-based motion pipelines for body reconstruction and generation. Some motion datasets provide force annotations, but the paired motion sequences are incompatible with the parametric body models used in modern learning pipelines. In addition, existing datasets typically obtain joint torques through inverse dynamics, which is inherently sensitive to the quality of the input kinematics; however, they do not quantify the reliability of these torque estimates. We close this gap with ForceBody, the first dataset to bring ground truth force supervision into a parametric body representation, shipped with per-sample torque uncertainty. ForceBody pairs the SKEL body model with ground reaction forces and inverse-dynamics joint torques across 10,386 motion trials (9.7M frames, 26.9 hours) from 140 subjects. Each torque label is paired with a per-frame, per-joint uncertainty annotation obtained by Monte Carlo sampling through the inverse dynamics pipeline. We benchmark six architectures (MLP, Conv1D, LSTM, GRU, Mamba2, Transformer) on ground reaction force and joint torque prediction from SKEL motion. As one example use of the released uncertainty, finetuning a Transformer with per-sample uncertainty weighting reduces the MAE of joint torque estimation by 5%. Code and data are at this https URL.

69. 【2611.22755】aching What to Look For: Privileged Perception Questions for Agentic On-Policy Distillation in Video Captioning

链接:https://arxiv.org/abs/2611.22755

作者:Yifan Xu,Ruopeng Gao,Zhixiao Wang,Jiafu Tang,Yichun Yang,Zihao Wang,Yuanxing Zhang,Limin Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Detailed video captioning, captioning requires comprehensive, Detailed video, video captioning requires, requires comprehensive

备注:

点击查看摘要

Abstract:Detailed video captioning requires comprehensive and faithful descriptions of objects, actions, and temporal events. Fixed-frame sampling, however, can miss brief motions, small objects, and other fine-grained evidence, motivating captioning agents that actively seek relevant moments and inspect local regions. Training such behavior is challenging because, unlike video question answering, generic captioning instructions do not specify what visual evidence should be acquired. We propose Perception-Question On-Policy Distillation (PQ-OPD), which uses training-only Perception Questions (PQs) to guide active video perception. PQs specify what should be inspected without revealing the corresponding answers, encouraging the teacher to explore the video more comprehensively and focus on relevant visual evidence. Along trajectories generated by the student, on-policy distillation transfers this guidance to the student's reasoning, tool calls, and captions; no PQs are required at inference. Across three detailed-captioning and two caption-to-QA benchmarks, PQ-OPD consistently improves the corresponding untrained agents across teacher-student scales and input-frame budgets. Under our evaluation protocol, PQ-OPD achieves the strongest primary-metric results among the compared open-source models on DREAM-1K, CaReBench, ShortVidBench, MotionBench, and VidCapBench-AE. Our ablations, together with analysis of temporal coverage and answer leakage, further indicates that the student internalizes the training-time guidance as a more effective video exploration policy.

70. 【2611.22742】GaussianMamba: Geometric and Relational State Space Scanning of 3D Gaussian Primitives

链接:https://arxiv.org/abs/2611.22742

作者:A. Enes Doruk,Ozgur Erkent

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:occupancy prediction requires, prediction requires representing, requires representing complex, semantic occupancy prediction, representing complex spatial

备注:

点击查看摘要

Abstract:3D semantic occupancy prediction requires representing complex spatial structures and modeling contextual relationships across a scene. 3D Gaussian primitives provide a sparse and adaptive representation of scene geometry and semantics, while Mamba offers efficient sequence modeling for capturing dependencies among primitives. However, Gaussian primitives are irregular and unordered, making sequence construction challenging, as conventional spatial ordering may overlook their anisotropic geometry and feature-semantic relationships. In this paper, we present GaussianMamba, a dual-branch Mamba framework that explicitly incorporates Gaussian-specific geometric and feature-semantic relationships into complementary scanning strategies. The first branch refines a locality-preserving traversal using anisotropic Gaussian support derived from primitive scale and orientation. The second branch reorders spatially organized groups according to feature-semantic affinity and adjusts local features using geometry-weighted semantic differences. The resulting sequences are processed by separate Mamba modules, and their features are fused through a support-aware mechanism that incorporates local feature discrepancies arising from the distinct scanning paths. Experiments on nuScenes-SurroundOcc and SSCBench-KITTI-360 demonstrate consistent improvements over GaussianFormer and GaussianFormer-2 in both IoU and mIoU.

71. 【2611.22736】RefCloth: Transferable Adversarial Tablecloths for Vision-Language-Action Models

链接:https://arxiv.org/abs/2611.22736

作者:Shaozhen Liu,Zhiwei Li,Jiayang Sun,Shuangjun Du,Yi Zhong,Shenrui Ma,Yaozu Liu,Qi Li,Zhenan Sun

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:policies rely continuously, existing visual attacks, visual attacks typically, attacks typically hijack, typically hijack sensor

备注:

点击查看摘要

Abstract:Closed-loop vision-language-action (VLA) policies rely continuously on multi-view cameras, yet existing visual attacks typically hijack sensor streams with 2D patches or alter target object meshes that require retraining when manipulation objects change. We introduce RefCloth, a framework that optimizes one persistent adversarial tablecloth on a frozen source policy and deploys it zero-shot across unseen tasks and target models without modifying task objects or cameras. Throughout manipulation, static third-person and moving wrist views observe this shared world-bound texture under evolving occlusions. To generalize across shifting surface views while bridging the gap between differentiable and native renderers, RefCloth combines bounded texture parameterization with shared surface UV transformations and a same-path clean reference that removes static rendering offsets at initialization. Across four LIBERO suites in native simulation, one frozen texture transfers from OpenVLA-OFT to $\pi_0$ and $\pi_{0.5}$, reducing success relative to an unoptimized cloth by 62.50 and 43.75 percentage points on average and far exceeding amplitude- and variation-matched random controls. Dual-view audits and target closed-loop camera interventions show that moving wrist exposure drives over twice the standalone drop of the main view with strong synergy, while ablations confirm the roles of UV diversification and path calibration.

72. 【2611.22733】Evolve in Panorama, Render in View: Panoramic World State Evolution for Video World Models

链接:https://arxiv.org/abs/2611.22733

作者:Longtao Jiang,Mingfei Han,Jianmin Bao,Tingjun Dai,Jinjie Wei,Zhiran Zhang,Xin Tao,Zhihui Li,Salman Khan,Xiaojun Chang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Panoramic Evolver, video diffusion model, panoramic video models, panoramic video, panoramic video diffusion

备注:

点击查看摘要

Abstract:Video world models should maintain a world that keeps evolving as the viewpoint changes. Yet when the camera turns away and returns, current models often freeze the unobserved scene, lose objects, or change their appearance, because content outside the view has no representation that keeps changing. We present PanoEvo, which uses a Panoramic Evolver to evolve the world state in the latent space of a panoramic video diffusion model, where every viewing direction is present at every time step, so the scene evolves whether or not it is observed. Existing panoramic video models are not trained to evolve a scene from a single image or the objects within it, so we build PanoEvo-Data, an event-centric dataset from real 360° videos, and train the Panoramic Evolver coarse-to-fine as an image-to-panoramic-video model. Since each view covers only a small part of the low-resolution panorama, directly projected views are blurry and often show low-quality details or structural errors. A Perspective Renderer, built on a perspective video diffusion model, reads this state via latent-space projection and direction-restricted cross-attention to render sharp, high-quality views. PanoEvo achieves the best overall score among 23 publicly evaluated models on WRBench and the highest total score on STEVO-Bench. Code, models, and data will be released.

73. 【2611.22728】LoopZip: Visual Token Compression for Efficient Looped Vision-Language Models

链接:https://arxiv.org/abs/2611.22728

作者:Weizhong Huang,Zhicheng Liu,Yan Zhang,Fei Chao,Xiawu Zheng,Liujuan Cao

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:approaching larger models', larger models' capabilities, stacking independent layers, deepen computation, approaching larger

备注: 11 pages, 10 figures

点击查看摘要

Abstract:Looped vision-language models (VLMs) deepen computation by reusing shared layers, approaching larger models' capabilities with fewer parameters and easing the storage and deployment burden of stacking independent layers. However, repeatedly processing long visual sequences still incurs substantial compute and GPU memory costs. Visual token compression reduces these costs by shortening sequences. Existing methods mainly select original tokens directly or combine selection with aggregation. In looped models, the former may overlook changing token importance across calls and discard information needed later; the latter lack joint consideration of output changes across calls, limiting information preservation. We propose LoopZip, a training-free visual token compression algorithm addressing both issues. Visual aggregation builds a compact candidate pool before the looped backbone, and cross-invocation selection averages instruction attention from the first two existing calls of the same shared attention layer to retain tokens needed by both states. Weight-tied value correction then jointly fits shared visual-value adjustments to both pre-selection layer outputs, reducing output deviations across states. To validate LoopZip's effectiveness, we conduct extensive experiments covering two open-source looped VLMs, eleven benchmarks, and three pruning ratios. On LoopVL-1B, LoopZip retains 97.16% of the original model's performance at 50% pruning ratio and exceeds the strongest baseline by 5.36% at 87.5% pruning ratio. Across Hugging Face Transformers, vLLM, and SGLang, LoopVL-1B with LoopZip reduces peak allocated GPU memory by 58.36%-58.98% and achieves 2.01-2.47x end-to-end speedups over the original model.

74. 【2611.22727】SlopeGuard: Towards Generalizable AI-Generated Image Detection via Radial Spectral Slope Guidance

链接:https://arxiv.org/abs/2611.22727

作者:Cheng Fu,Yiheng Li,Yang Yang,Wenzheng Liu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:unseen synthesis pipelines, AI-generated image detectors, generator-specific artifacts, hindering generalization, synthesis pipelines

备注:

点击查看摘要

Abstract:AI-generated image detectors often overfit to generator-specific artifacts, hindering generalization to unseen synthesis pipelines. Existing frequency-based methods usually learn high-dimensional spectral patterns that may preserve generator-dependent variations. We explore Radial Spectral Slope, a compact descriptor of global spectral decay that captures transferable spectral trends while suppressing fine-grained variations. Our analysis shows that real and generated images exhibit systematic but generator-dependent slope differences, indicating that slope provides useful forensic evidence but is insufficient as a standalone decision criterion. This motivates combining spectral slope with semantic representations for more robust detection. Based on this insight, we propose SlopeGuard, which couples slope-aware data processing with slope guided feature learning to construct informative patch-based views, integrate Radial Spectral Slope with semantic features, and adapt prior preservation according to spectral atypicality. Extensive experiments demonstrate that SlopeGuard achieves state-of-the-art mean accuracies of 97.5% on AIGCDetectBench, 97.8% on GenImage, and 85.1% on AIGIBench, while maintaining competitive performance under blur, cropping, JPEG compression, and additive noise.

75. 【2611.22724】ConserveEdit: Source-Anchored Transactions for Drift-Bounded Iterative Image Editing

链接:https://arxiv.org/abs/2611.22724

作者:Shuyang Jiang,Fucheng Deng,Yuchuan Luo,Zhenyu Wu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:produce convincing local, iterative refinement loop, Instruction-driven image editors, requested region accumulate, editors produce convincing

备注: 28 pages, 15 figures, 16 tables; includes supplementary material

点击查看摘要

Abstract:Instruction-driven image editors produce convincing local edits in one pass, but inside an iterative refinement loop every accepted output becomes the next input, so unintended changes outside the requested region accumulate. We present ConserveEdit, an editor-agnostic controller that treats each refinement step as a transaction against a contract compiled once from the source image. The contract separates what may change (the authorized region of each target, with a bounded halo for shadows and reflections) from what must survive (protected content with explicit tolerances). Candidates from a frozen editor are composed through a source-anchored mask and committed only if target progress, drift on protected content, and image quality pass as separate tests; otherwise the step is rolled back and repaired. For any editor, this keeps every pixel outside the authorized region bit-exact and bounds drift independently of the number of iterations, whereas no fixed scalar trade-off reproduces the separate tests. On all 1053 MagicBrush test edits with a frozen Qwen-Image-Edit, masking is necessary but not sufficient. A direct call already alters the rest of the image (12.1 dB PSNR outside the mask); composed through the source-anchored mask, it stays bit-exact there and its DINO similarity to the ground truth rises from 0.67 to 0.85, matching ConserveEdit, so this gain comes from the mask. Next to automatic masks, however, masked direct editing changes a protected face or text on 48% of turns, and masked scalar selection avoids this mostly by abstaining (23% constrained success). Because its drift test names the violated entity, ConserveEdit shrinks the support instead (2% violations, 53% constrained success); in a simulator with known ground truth it raises constrained success from 55.0% to 61.8%. Automatic grounding remains the main bottleneck. Code and logs will be released.

76. 【2611.22722】Practice in Text, Act in Pixels: Correcting Where Perception Fails

链接:https://arxiv.org/abs/2611.22722

作者:Zhongling Xu,Hairong Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:GUI agents, reader, vision-language screen reader, screenshots, GUI

备注: 25 pages, 8 figures, 19 tables. Code: [this https URL](https://github.com/Carlxuzhl/practice-in-text) ; aligned reader: [this https URL](https://huggingface.co/xuzhl/practice-in-text-aligned-reader)

点击查看摘要

Abstract:GUI agents can learn cheaply from a text view of an interface and act on screenshots through a vision-language screen reader. Yet on a simulated mobile platform with a low-cost reader, policies that complete most tasks in text fail on many of the same tasks on screenshots. We ask where a small budget of real screenshots is best spent to close this gap. We find that the reader's misreads are systematic and recur on the same interface elements. Noise matched to the reader's error rates, a natural sim-to-real remedy, misses this structure, and in a pre-specified comparison it did not beat training the policy directly on screenshots. We therefore correct the misreads at their source with reader alignment, which fine-tunes the reader on screenshots paired with their text views. The reader learns to output each screen's text view, as in text practice, and the policy stays unchanged. Spent on the reader, the screenshot budget gives 80.9% full-task success on new task instances, against 55.6% when spent on training the policy. Given the same labeled screenshots, adapting the reader also beats adapting the policy, and a single aligned reader improves every text-trained policy we tried without retraining any of them.

77. 【2611.22717】PCRG: Training-Free Pruning and Caching of Reference Tokens for Video Generation

链接:https://arxiv.org/abs/2611.22717

作者:Siyuan Wang,Haoran Li,Yi Yue,Tak L. Fung,Quan Chen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:diffusion transformers pack, reference tokens make, diffusion transformers, variational autoencoder, tokens

备注: 11 pages, 5 figures

点击查看摘要

Abstract:Reference-to-video diffusion transformers pack the variational autoencoder (VAE) latents of all references and the generated tokens into one full-attention sequence, in which reference tokens make up about half. Because attention cost grows quadratically with sequence length, these tokens take up an even larger share of the attention computation, yet most of them are static, smooth or irrelevant to the output. To accelerate reference-conditioned generation, we propose pruning and caching of reference tokens for video generation (PCRG), a training-free, plug-and-play method that uses two signals the model already computes to assign each reference token to one of three tiers, namely pruned, cached or kept. The first is a low-level redundancy r from VAE latents, since a token whose latent barely changes over time or across its neighbors adds little new content. The second is a high-level importance g from the vision-language-model (VLM) conditioner, where the attention that the prompt and any first or last frames pay to a token tells whether the output needs to read it. Tokens that are not redundant are kept, and redundant tokens are cached if important and pruned otherwise. Pruned tokens leave the sequence before the first step with all rotary position embedding positions unchanged. Cached tokens have their keys and values computed once and reused, and kept tokens are processed as usual. On MiniMax-H3, already distilled to 8 timesteps and quantized to int8, PCRG is 1.57x faster end to end on our V2V-Bench and 1.49x faster on the public VACE-Benchmark, while the quality of VBench drops by only 0.24% and 0.17%, respectively. PCRG shortens the sequence rather than changing how attention is computed or which steps are run, so it also stacks on step caching and sparse attention. On V2V-Bench it reaches 1.86x with TeaCache, 1.82x with Spark at nearly unchanged fidelity and 2.15x with Veda.

78. 【2611.22709】Know When to Zoom: How Small Is Too Small for Vision-Language Models?

链接:https://arxiv.org/abs/2611.22709

作者:Siddharth Vohra,Min Xu

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Online vision-language models, Online vision-language, Claude, service shrinks, miss small details

备注: Accepted to the SENSE workshop at WACV 2027. 10 pages, 5 figures, 3 tables. Code, data and a plain-language walkthrough: [this https URL](https://siddvoh.com/know-when-to-zoom/)

点击查看摘要

Abstract:Online vision-language models often miss small details in large images, because the service shrinks the image, or rejects it, before the model ever sees it. A car 20 pixels wide in an 8000 by 6000 drone photo reaches Claude about 6 pixels wide, and OpenAI's default rejects the photo outright. We measure how much detail survives for seven models from four vendors, using an eye exam of printed codes and 601 questions about small objects in real photos. The smallest text a model reads half the time grows from 6 pixels or less on a small image to a predicted 10 to 13 pixels on a 7680 by 4320 photo at default settings. Zooming wins much of the detail back. Splitting each photo into up to nine tiles raises accuracy by 11.1 to 14.5 percentage points for Claude and Gemini, and by avoiding rejections it lifts GPT-6.1 Sol from 50.7% to 83.7%. A two-step zoom, in which the model first names the region it needs, matches or beats tiles on Gemini and comes within 2.5 points of them on Claude, with about 40% of their image tokens. When a detail is lost, Claude and Gemini both say they cannot tell about half the time, but they fail differently in the rest: Gemini gives a confident wrong answer in 43% to 48% of these cases, Claude in only 5% to 9%. A check based on detail size, run before the call, misses most of the gain from tiles on Claude and Gemini, but Claude's own reply is a reliable trigger: tiling only after an unsure reply comes within 1.4 points of always tiling with 62% to 70% of the image tokens. We turn these findings into five rules for when an agent should zoom, and release the eye exam, every model answer and code at this https URL.

79. 【2611.22704】Social Signal Bench: Evidence-Weighted Evaluation of Co-occurring Social Signals in Video and Audio

链接:https://arxiv.org/abs/2611.22704

作者:Siddharth Ravi,Anders R. Bargum,Hugo Anselme,Patrizio Cugia di Sant'Orsola,Alberto Cardaci,Flora Kincso Parragi,Vincent Borowiec,Line H. Clemmensen

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Recognizing social signals, Social Signal Bench, Social Signal, hesitation requires interpreting, requires interpreting context-dependent

备注: 25 pages, including appendix

点击查看摘要

Abstract:Recognizing social signals such as interest and hesitation requires interpreting context-dependent behaviors that may co-occur in conversation. Existing affective computing benchmarks rarely evaluate such co-occurring signals, and conventional multi-label F1 overlooks semantic relationships and annotator disagreement. We introduce Social Signal Bench, a 47-hour densely annotated benchmark for the evaluation of social signal recognition and engagement, comprising two datasets: Social Signal Bench Video (25 hours), covering ten social signals in audiovisual recordings, and Social Signal Bench Audio (22 hours), covering six signals in audio-only recordings. Each dataset pairs a public training set of online conversational video, of which 10 hours are expert-annotated and the remainder pseudo-labeled, with a private expert-labeled test set spanning four conversational domains. We also propose Evidence-Weighted F1 (EW-F1), which weights reference labels by annotator evidence and assigns graded credit to semantically related predictions through optimal per-clip matching. Controlled perturbations demonstrate that EW-F1 distinguishes semantically related errors from unrelated ones, unlike conventional F1. Under a shared evaluation protocol, 7B open models post-trained on Social Signal Bench outperform general-purpose frontier models on video and match them on audio.

80. 【2611.22699】ANGO: Real-World Unregistered RGB-Guided Hyperspectral Super-Resolution with Two-Camera Acquisitions

链接:https://arxiv.org/abs/2611.22699

作者:Matteo Kolyszko,Marco Buzzelli,Simone Bianco,Raimondo Schettini

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:high-resolution HSI reference, high-resolution RGB reference, unregistered high-resolution RGB, low-resolution hyperspectral observation, high-resolution HSI

备注: 18 pages, 11 Figures, 10 tables. Submitted to CVPR 2027

点击查看摘要

Abstract:Unregistered hyperspectral image super-resolution aims to recover a high-resolution HSI from a low-resolution hyperspectral observation and an unregistered high-resolution RGB reference. Although recent methods have begun to address the geometric misalignment between the two modalities, their evaluation is still constrained by the lack of a large-scale public benchmark based on real two-camera RGB--HSI acquisitions with a high-resolution HSI reference. To address this gap, we introduce DUET, the first large-scale public dataset for unregistered RGB-guided hyperspectral super-resolution, comprising 403 indoor and outdoor scenes captured with two separate RGB and hyperspectral cameras. We further propose TANGO (Two-camera AligNment with Gated Occlusions), which first compensates for the dominant cross-camera displacement through end-to-end global alignment and then refines the remaining inconsistencies with a coarse-to-fine local feature alignment. A learned gating mechanism further attenuates the RGB guidance where the two views cannot be consistently matched. Experimental results show that TANGO achieves state-of-the-art performance on both DUET and REAL across all evaluated scale factors, outperforming the strongest competitor on DUET by up to 2.29 dB in PSNR while requiring 2.5$\times$ fewer FLOPs. The code and dataset will be available at this https URL

81. 【2611.22686】CascadeJEPA: Enhancing 3D Geometric Representations via Spatially Coupled Cascaded Prediction

链接:https://arxiv.org/abs/2611.22686

作者:Kailai Zhou,Ziqi Chen,Xiaoning Xu,Yuefeng Wu,Zixuan Fu,Zijun Lin,Zhihao Li,Youwei Pang,Xiaoqi Zhao,Xun Cao,Bihan Wen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Joint-Embedding Predictive Architectures, visual representation learning, promising paradigm, predictive visual representation, Joint-Embedding Predictive

备注:

点击查看摘要

Abstract:Joint-Embedding Predictive Architectures (JEPAs) have emerged as a promising paradigm for predictive visual representation learning. However, our analysis of I-JEPA reveals a growing discrepancy between semantic and geometric learning: improved semantic recognition during pretraining is accompanied by degraded 3D geometric representations. We hypothesize that this partly stems from predicting highly abstract latent representations with incomplete spatial context, favoring semantic regularities over fine-grained geometric information. To address this issue, we introduce CascadeJEPA, a spatially coupled cascaded prediction framework that promotes richer patch-level interactions through full-grid context encoding and cross-attention between prediction stages, while largely preserving the original I-JEPA architecture. Extensive experiments demonstrate substantial improvements over I-JEPA across multiple 3D geometric tasks while maintaining strong semantic recognition performance. Furthermore, its advantages extend to future feature forecasting and world model planning, highlighting the potential of enhanced geometric representations to support predictive world modeling.

82. 【2611.22680】Classification of Tissues on MALDI-MSI Image Modality for Pancreatic Cancer Studies

链接:https://arxiv.org/abs/2611.22680

作者:Abubakar Qahir,Jenny Benois-Pineau,Victoria Bourgeais,Fabien Baldacci,Sandrine Dabernat,Nicolas Desbenoit,Mélanie Moreau,Mehdi Boubaddi,Marion Marty

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Mass Spectrometry Imaging, spatially maps molecular, maps molecular distributions, Ionization Mass Spectrometry, Spectrometry Imaging

备注:

点击查看摘要

Abstract:Mass Spectrometry Imaging (MSI) spatially maps molecular distributions in tissue sections. Despite the availability of preprocessing tools for MSI data, building end-to-end workflows suitable for deep learning remains challenging. We have developed a fully automated pipeline for transformation of raw Matrix-Assisted Laser Desorption/Ionization Mass Spectrometry imaging (MALDI-MSI) data into deep-learning-ready image patches for binary pancreatic tissue classification (tumoral vs non-tumoral) and built individual models for recognition of tumoral regions in spectral images. Images resulting from the proposed pipeline and from reference interactive workflow are very close in terms of image quality metric mean squared error (MSE). The proposed pipeline computational time is of 20 min in average compared to a full working day of the reference interactive workflow. The models achieved 0.94 accuracy on high-resolution spectra and a mean accuracy of 0.59 on lower-resolution spectra.

83. 【2611.22673】FVScore: Specification-Driven Neuro-Symbolic Video Evaluation

链接:https://arxiv.org/abs/2611.22673

作者:Do Xuan Long,Long T. Le,Yiwen Song,Min-Yen Kan,Tomas Pfister,Yale Song

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:introduce Faithfulness Video, Faithfulness Video Score, video generation evaluation, specification-driven video generation, introduce Faithfulness

备注: Project page: [this https URL](https://dxlong2000.github.io/FVSCORE/)

点击查看摘要

Abstract:We introduce Faithfulness Video Score (FVSCORE), a neuro-symbolic framework for specification-driven video generation evaluation. Existing evaluators rely on holistic MLLM judgments or vision-language metrics, yet aligning their scores with human judgments and tracing them to specific temporal violations remain open challenges. FVSCORE addresses these limitations by compiling each video into explicit propositions capturing prompt requirements and implicit propositions capturing unstated physical, temporal, and cross-modal constraints. It grounds each proposition using specialized perceptual tools and evaluates the resulting confidence traces with soft temporal operators inspired by Linear Temporal Logic. A Significance-Aware Calibration step then aligns verification with human perception by retaining only perceptually significant violations before producing a timestamp- and evidence-grounded report. We conduct extensive experiments across public and complex multi-event benchmarks with the strongest video models to date, demonstrating that FVSCORE outperforms holistic and agent-based evaluators in human correlation while providing highly accurate and interpretable feedback.

84. 【2611.22669】Beyond the Camera: A Tri-Modal Driving World Model for Future RGB, Thermal, and LiDAR Forecasting in Adverse Weather

链接:https://arxiv.org/abs/2611.22669

作者:Faysal Mehrab Chowdhury,Md. Mahfuzur Rahman,Ahmed Rafi Hasan,Kishor Datta Gupta,Mohd Ariful Haque,Savannah Shannon

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Driving world models, Driving world, model, Driving, LiDAR

备注:

点击查看摘要

Abstract:Driving world models forecast what a vehicle's sensors will record next. Most forecast camera video and some add LiDAR, but thermal cameras, which still see in darkness and some adverse weather, are rarely a forecast target, and to our knowledge no world model forecasts all three sensors. We study joint forecasting of RGB, thermal, and LiDAR on real adverse-weather sequences of the DSERT-RoLL dataset. We post-train a pretrained video world model for each sensor and represent LiDAR as a depth video aligned with the RGB camera, with densification and encoding chosen by what the model's video tokenizer can reconstruct. A tri-sensor model sees all three sensors as one video. We score LiDAR in meters against measured returns and compare against persistence baselines passed through the same tokenizer as the model. With this matching, an apparent loss of the thermal model to persistence in fog disappears. On all 58 validation sequences in six weather conditions, post-trained RGB and thermal forecasts beat compression-matched persistence. Joint training lowers the LiDAR error at 2s by 2.1m at a small cost in camera fidelity, and only the tri-sensor model's LiDAR forecasts beat persistence in mean error. Blanking one sensor degrades the forecasts of the others more in snow than in fog.

85. 【2611.22668】Let Samples Sing in Chorus: Mitigating Spurious Correlations via Cross-view Consensus

链接:https://arxiv.org/abs/2611.22668

作者:Weiwei Li,Junzhuo Liu,Tong Chu,Hengfu Yu,Yinjie Lei,Wen Li

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Deep models, underrepresented groups, rely on spurious, spurious correlations, correlations that fail

备注: Under Review

点击查看摘要

Abstract:Deep models often rely on spurious correlations that fail on underrepresented groups. Existing methods either correct human-specified bias attributes or infer unknown biases from the learned representation space. However, annotated attributes may differ from the shortcuts actually used by a model, while a single representation provides incomplete and potentially noisy evidence. Our key insight is that a bias obscured in one feature space may be clearer in another. In this work, we propose CHORD (Cross-view Harmonic Outlier Reversal for Debiasing), a multi-view framework that allows samples to "sing in chorus" across diverse representation spaces to achieve robust cross-view consensus. CHORD aggregates aggregates within-class partitions in each view, which is a proxy for specifying candidate biases, to debias the target representation and classifier without bias supervision. Experiments on seven benchmarks across vision, language, speech, and medical imaging show consistent improvements in worst-group accuracy. Code and checkpoints are available at this https URL .

86. 【2611.22666】VSpark: Speculative Decoding for Autoregressive Vision-Language-Action Models

链接:https://arxiv.org/abs/2611.22666

作者:Suho Yoo,Youngjoon Jang,Hyebin Cho,Taeyeop Lee,Jaewook Jeong,Joon Son Chung

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:accelerate autoregressive, generate robot actions, VLA decoding lossless, lightweight draft model, draft model proposes

备注: Preprint

点击查看摘要

Abstract:Our aim is to accelerate autoregressive vision-language-action models (VLAs), which generate robot actions one token at a time. Speculative decoding makes this possible: a lightweight draft model proposes several tokens at once, and the VLA verifies them in a single pass, accepting only those that match its own predictions, so decoding remains lossless. The speedup, however, is limited in robot control, where many different tokens encode nearly the same motion and a draft close to the correct action is still rejected. To address this, our approach, VSpark, is built upon three design choices: (i) rollouts collected with calibrated action noise, which expose the draft to a wider range of robot states; (ii) feature alignment, which trains the draft to match the VLA's hidden features rather than its output tokens alone; and (iii) continuation reuse, which keeps the predictions the VLA has already computed along rejected drafts as candidates for the next verification step, instead of discarding them. On four VLAs with different action tokenizers and four manipulation benchmarks, VSpark achieves 1.28x to 2.10x speedup while keeping the VLA's decoding lossless.

87. 【2611.22657】SpatialCast: Reading the 3D World via Cast Shadows

链接:https://arxiv.org/abs/2611.22657

作者:Enhan Li,Jinghao Zhou,Jiaze Zhang,Hongyang Du

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:multimodal large language, understanding scene structure, large language models, multimodal large, large language

备注: 10 pages (main paper), 7 pages (supplementary material), 5 figures and 6 tables in the main paper

点击查看摘要

Abstract:As multimodal large language models (MLLMs) advance toward understanding and interacting with the physical world, spatial reasoning becomes essential for understanding scene structure and anticipating the effects of physical changes. Existing spatial benchmarks have made substantial progress in evaluating spatial relations, memory, and viewpoint reasoning, but less systematically assess how models connect physical scene conditions with visual observations. We introduce SpatialCast, a benchmark that uses cast shadows to evaluate this ability. Cast shadows provide observable evidence of a 3D scene. Their image appearance depends on object geometry and pose, illumination, and viewpoint. We examine this relationship through three complementary tasks that assess scene-projection consistency, predict intervention-induced changes, and infer the physical changes behind visual transitions. The benchmark contains 21,000 synthetic questions with separate scene and geometry test partitions, complemented by 200 SpatialCast-Real questions from 20 photographed scenes. Evaluations show that closed-source MLLMs outperform general-purpose open-weight MLLMs and MLLMs designed for spatial reasoning, which remain near chance on the synthetic benchmark, while even strong closed-source models struggle with shadow-length and light-height judgments. We also use SpatialCast training data for GRPO post-training, improving open-weight MLLM performance on the benchmark. Further evaluations show improvements on several external spatial benchmarks, suggesting transfer of the learned capabilities. These experiments support SpatialCast as a controlled resource for diagnosing spatial reasoning capabilities and studying their learning and generalization.

88. 【2611.22655】Unified Residual Translation for Paired Image Restoration

链接:https://arxiv.org/abs/2611.22655

作者:Joyanta Jyoti Mondal,Mridul Banik,Ibne Farabi Shihab,Md. Shifatul Ahsan Apurba

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:image restoration spans, Paired image restoration, sensor modality, spatial resolution, image restoration

备注: 10 pages, 2 figures

点击查看摘要

Abstract:Paired image restoration spans changes in imaging contrast, sensor modality, and spatial resolution. These settings differ in their input channels and target grids, raising the question of how much of the prediction pipeline must be specialized to each task. We present the Unified Residual Translator (URT), which separates fixed channel and scale mapping from learned residual prediction. A deterministic reference uses channel averaging, replication, or bicubic interpolation to match the target dimensions, while a NAFNet encoder-decoder predicts an additive correction from the complete input. Separately trained instances share the prediction rule, $\ell_1$ objective, and optimizer across MRI contrast synthesis, visible-to-infrared translation, SAR-to-optical translation, and real-camera super-resolution. Across six task and scale settings, URT achieves the highest PSNR and SSIM among the evaluated baselines on IXI, SEN1-2, and RealSR $\times3$ and $\times4$. It reaches 30.774dB on IXI and 13.478dB on SEN1-2, with luminance PSNR of 33.596, 28.742, and 27.342dB at the three RealSR scales. On LLVIP, it ranks second in PSNR and SSIM. A study of four spectral alternatives identifies complementary benefits of fitted references and bandwise residual gains. Together, these results support explicit dimensional alignment and learned residual correction as a common formulation for heterogeneous paired imaging tasks.

89. 【2611.22652】OmniTongue: A Comprehensive MLLM Benchmark for Automated Tongue Diagnosis in Traditional Chinese Medicine

链接:https://arxiv.org/abs/2611.22652

作者:Liuyi Xu,Yun Guo,Shusheng Li,Xuewen Zhang,Yining Qian,An-Yang Lu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal Large Language, Traditional Chinese Medicine, Large Language Models, Multimodal Large, Chinese Medicine

备注: 11 pages, 2 figures, 3 tables

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) have excelled in Western medical imaging, yet their potential in Traditional Chinese Medicine (TCM) tongue diagnosis remains systematically unevaluated. Tongue diagnosis requires sophisticated global and local perception, serving as a rigorous touchstone for assessing the visual understanding depth of MLLMs. However, existing datasets are limited by single dimensions, coarse granularity, and ambiguous labels, hindering the evaluation of authentic clinical capabilities. To bridge this gap, we introduce OmniTongue, the first comprehensive, fine-grained Visual Question Answering benchmark for TCM tongue diagnosis. This benchmark integrates 1,351 expert-validated images and 21,616 instruction pairs. Its core design features 16 clinical dimensions for multidimensional evaluation, region-specific annotations for pathological localization, and 66 fine-grained labels for precise diagnostic representation. Extensive evaluations of existing MLLMs reveal significant performance gaps, demonstrating that medical-specific models lack domain advantages, while universally poor Macro-F1 scores expose a reliance on statistical shortcuts rather than genuine understanding of tongue pathology. These findings not only highlight the current limitations of MLLMs in interpreting regional medical features but also underscore OmniTongue's significance for developing robust automated tongue diagnosis models. The code and dataset will be made publicly available in a future release.

90. 【2611.22650】Must You See Fakes to Catch Fakes? Language Says What to Look For, Real Images What to Ignore

链接:https://arxiv.org/abs/2611.22650

作者:Tianchi Xu,Yuxuan Zhou,Yuheng Zhang,Yanan Guan,Tao Dai,Shu-Tao Xia

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:order to catch, detector, images, generated images, authenticity

备注:

点击查看摘要

Abstract:Must a detector see generated images in order to catch them? Detection of AI-generated images has long faced two problems. The cues a detector learns from the few generators in its training set carry traces specific to those generators and transfer poorly to new ones, which limits generalization. The real and generated training images also differ in format and content, so the detector takes these differences as evidence of authenticity, and its decisions change with factors that have nothing to do with authenticity, which harms robustness as well as generalization. Both problems stem from training on generated images. A detector never trained on them can largely avoid both at the source. Vision foundation models have already learned the concept of "AI-generated" during pretraining, and text can point to it directly. Building on this, we propose SaySee, a training-free detector: Say builds a generation direction from sets of paired descriptions that differ only in authenticity and scores an image by the projection of its embedding onto it, and See uses real images to correct the score offsets caused by format, image type and content. On 24 evaluation sets that span standard benchmarks, in-the-wild data and the latest generators, SaySee reaches a mean AUC of 98.2% with MoE-ViE, 4.2 points above the best existing detector. When format is decoupled from authenticity, it remains the best of all methods. Code will be released.

91. 【2611.22645】REVEAL: Reconstructing Video Amodal Content via Language and Flow Guidance

链接:https://arxiv.org/abs/2611.22645

作者:Minh Tran,Winston Bounsavy,Ngan Le

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:perception enables humans, remarkable cognitive skill, artificial intelligence struggles, Amodal perception enables, perceive entire objects

备注: Accepted to Transactions on Machine Learning Research (TMLR)

点击查看摘要

Abstract:Amodal perception enables humans to perceive entire objects even when parts are occluded, a remarkable cognitive skill that artificial intelligence struggles to replicate. Recent diffusion-based methods have extended amodal completion from images to videos, yet they lack auxiliary priors to guide the reconstruction of heavily occluded content and to maintain temporal consistency over long sequences. We present REVEAL (REconstructing VidEo Amodal content via Language and flow guidance), a unified diffusion-based framework that integrates complementary motion and semantic priors for video amodal completion. A user-provided text query serves a dual role: it drives open-vocabulary video segmentation to obtain visible masks, and it provides semantic guidance for texture reconstruction. For amodal segmentation, we introduce optical flow guidance: by warping visible masks from previous frames to the current frame, the flow-warped mask propagates visible content into occluded regions and approximates the object's current shape, providing a strong shape prior even under simultaneous deformation and occlusion. For texture completion, text guidance constrains the reconstruction of occluded appearance while providing a stable semantic reference that helps maintain visual coherence throughout the reconstruction. We also contribute LAVAT, a new benchmark featuring long video sequences paired with text descriptions, enabling evaluation of text-guided video amodal completion under heavy occlusion. Extensive experiments demonstrate that REVEAL achieves state-of-the-art performance on existing benchmarks while maintaining high-quality temporal consistency over extended sequences. The project page is available at: this https URL.

92. 【2611.22637】OVET-Consensus: Rank-Preserving Counterfactual Event Verification for Video Moment Grounding

链接:https://arxiv.org/abs/2611.22637

作者:Alibay Osmanli,Shaogang Gong

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Modern video moment, moment retrieval systems, video moment retrieval, Modern video, parent-aware temporal expert

备注: 22 pages, 2 figures, 17 tables

点击查看摘要

Abstract:Modern video moment retrieval systems often propose windows that overlap the target event, yet still select the wrong one. We study this scorer bottleneck on QVHighlights with a fixed QD-DETR-derived temporal expert: the parent-aware temporal expert reaches 64.71 R1@0.5, while diagnostic oracles over the same candidate family reach 75.68 R1@0.5 within the parent-reranked pool and 94.97 R1@0.5 over the full 100-candidate evidence pool. We introduce OVET-Consensus, a rank-preserving counterfactual event verification layer that keeps the temporal expert's ranked list as the default and permits only high-confidence rank-1 overrides from a policy calibrated on held-out training videos. The verifier uses parent-aware interval evidence, structured Qwen3-VL event judgments, VideoLLaMA3 pairwise temporal signals, and dense temporal evidence, but never lets those signals freely reorder the top-K list. On QVHighlights validation, OVET-Consensus improves the parent-aware temporal expert from 64.71 to 65.35 R1@0.5 with a positive paired-bootstrap interval, while mAP is largely unchanged, from 42.67 to 42.74; it makes 20 overrides, with 15 helpful corrections and 3 harmful corrections. The results point to a practical constraint on verifier design: semantic compatibility is useful evidence, but temporal grounding still requires deciding where the event starts, changes, and ends inside a visually compatible scene.

93. 【2611.22636】Sub-Meter Canopy Height Synthesis from Sentinel-2 via Anchored Residual Flow

链接:https://arxiv.org/abs/2611.22636

作者:Kiarie Ndegwa,Tony Chang,Andreas Gros,Vincent A. Landau,David D. Diaz,Luke Zachmann,Nathan E. Rutenbeck,Guy C Bayes

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:wildfire fuel mapping, forest carbon accounting, multi-year national cycles, require airborne LiDAR, airborne LiDAR refreshed

备注: 30 pages, including appendices

点击查看摘要

Abstract:Canopy height models (CHMs) - per-pixel maps of vegetation top height - are essential for forest carbon accounting, wildfire fuel mapping, and tree-level ecology, yet sub-meter CHMs require airborne LiDAR refreshed on multi-year national cycles. We produce 0.5 m CHMs from free 10 m Sentinel-2 imagery, a 20$\times$ cross-modal super-resolution task where optical reflectance must predict geometric height it does not directly observe. Motivated by the perception-distortion trade-off, we derive two operating points with shared conditioning. A deterministic regressor (Anchor) targets low distortion; a conditional flow matching model, trained on the Anchor's residual in a learned CHM latent space (AR-flow), targets perceptual fidelity. Trained on 197k LiDAR-paired tiles spanning 69 ecoregions across the contiguous United States and evaluated on 2,530 held-out tiles against eight baselines, the Anchor achieves 2.83 m MAE using only free satellite input. The AR-flow reduces sliced Wasserstein distance from the Anchor's 1.13 to 0.208, at a higher MAE of 3.68 m. Crown-scale statistics improve, but strict individual-tree detection remains weak: generated sub-pixel detail represents plausible structure rather than measured individual trees. Quarterly continental refresh becomes tractable, letting satellite monitoring inform timing and extent for more expensive data acquisitions.

94. 【2611.22608】PlaceTally: A Test-Time Memory Model for Constructing Place Graphs

链接:https://arxiv.org/abs/2611.22608

作者:Alibay Osmanli,Shaogang Gong

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Counting distinct objects, video, Counting distinct, place, distinct objects

备注: 12 pages, 3 figures, 5 tables. Code, data and supplementary material: [this https URL](https://alibayosmanli.github.io/placetally)

点击查看摘要

Abstract:Counting distinct objects in a video is hard when the camera returns to places it has seen. A vision-language model that reads the whole video answers with a few small numbers, and one that reads it in parts counts an object again in every part that shows it. Object trackers need the category before the video is read, or a fixed vocabulary. We observe that a memory for counting does not need to know what it is looking for, only where it has been: objects rarely leave a room between visits, so parts of a video grouped by place share almost no objects, and a place can be recognised before any question is asked. Building on this, we introduce PlaceTally, a question-blind test-time memory model that constructs a place graph for each video. Each video fragment joins the place of its best earlier match or opens a new place, because a strong match is rarely wrong while a true return often matches weakly. A frozen vision-language model counts each place once from at most 128 of its frames, so every read has a bounded input and the memory grows with the number of places; the graph is built 15 times faster than real time. On RevisitCount, our benchmark of real room re-recordings, it scores 62.5% mean relative accuracy on test rooms and 61.2% on held-out rooms, against 51.2% and 44.3% for the same model reading the whole video. It stays level as rooms return more or less often, while a fixed correction of summed visits moves from 38.5% to 61.4%.

95. 【2611.22596】Propose with the Gradient, Accept with the Loss: One Hedged Attack for Pixel-Sparse Robustness

链接:https://arxiv.org/abs/2611.22596

作者:Hon Ming Yan,Chun Pong Lau

类目:Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

关键词:pixel-sparse adversary, sparse random search, random search, Gradient-guided Random Search, search

备注: 22 pages, 13 tables, 4 figures

点击查看摘要

Abstract:A pixel-sparse adversary may change a few pixels of an image to any value. Robustness to such attacks is currently measured with an ensemble, sparse-AutoAttack (sAA), because its members fail in different places: sparse projected gradient descent (sPGD) trusts a first-order model that a full pixel change breaks, and sparse random search (Sparse-RS) ignores the gradient even where it is informative. We show that both attacks are local searches, each a proposal distribution plus an acceptance rule, and ask what such a search can learn from the gradient. A Taylor bound says what to measure, and measurements at the states the search visits give five rules. The sign of the gradient is its most reliable use at a single pixel and sets a new pixel's value. Its ranking of candidate pixels should be followed loosely, and its ranking of the pixels to remove, which is often more reliable, can be followed more closely. A pixel should not be proposed twice before a move is accepted, and acceptance should be decided by the loss alone. These rules define Gradient-guided Random Search (GRS), which runs once and costs one forward and one backward pass per step. On 13 CIFAR-10 configurations and 5 ImageNet models, GRS matches or beats the best single member of sAA and is within one point of sAA itself or stronger on 17 of 18 settings, and it is significantly stronger than sAA on 8. It uses 3 instead of up to 7 forward-pass units, and on CIFAR-10 it runs 3.7 to 5.0 times faster than the members of sAA run in full.

96. 【2611.22592】Distilling World Action Models for Efficient Bimanual Manipulation via Anchored Path Matching

链接:https://arxiv.org/abs/2611.22592

作者:Jialong Liu,Junjie He,Yandu Chen,Bin Zhou,Heng Su,Peijun Tang,Jianan Wang,Changhao Chen

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:World Action Models, jointly generate future, World Action, Action Models, robot actions

备注:

点击查看摘要

Abstract:World Action Models (WAMs) jointly generate future video and robot actions through iterative denoising. Few-step distillation reduces the number of model evaluations, but its coarse updates can move the student away from the teacher's trajectory. We propose Anchored Path Matching (APM), which supervises endpoint and short-transition predictions from states reached by the student. From each state, we continue the teacher to zero noise and use its endpoint and first intermediate state as targets. Modality-routed adapters learn to match both targets from the same starting state. When the two gradients conflict, anchor-priority updates preserve the endpoint gradient and remove the opposing component of the local gradient within each modality. One checkpoint supports 1-, 2-, and 4-step joint generation. The sampling budget can be chosen at deployment without retraining or teacher queries. On RoboTwin 2.0, we train only on Clean demonstrations and evaluate directly on the domain-randomized Random setting. At one step, APM improves closed-loop success over continued base distillation at matched inference budgets by 2.0 percentage points on Clean and 1.4 on Random. Video peak signal-to-noise ratio (PSNR) rises from 30.169 to 32.317 dB, with gains in structural similarity (SSIM) and learned perceptual image patch similarity (LPIPS). On two real-robot tasks, APM improves success over the one-step teacher and reduces control-cycle latency by $21.3\times$ relative to the eight-step this http URL page: this https URL.

97. 【2611.22591】PACT: Plan-Action Consistency Training by Preserving Correct Plans and Repairing Actions in GUI Agents

链接:https://arxiv.org/abs/2611.22591

作者:Zhuohan Cai,Zhangxuan Gu,Runze Li,Beitong Zhou,Ming Wen,Hongbo Yu,Shuheng Shen,Changhua Meng

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:formulate a correct, fails to execute, PACT, execution, action

备注: 21 pages, 11 figures, including supplementary material

点击查看摘要

Abstract:GUI agents can formulate a correct immediate plan in their reasoning yet emit an action that fails to execute it, creating an execution gap. This recurring mismatch undermines reliable task completion, as a single execution error can derail a multi-step workflow. In outcome-supervised reinforcement learning, broadcasting a negative response-level advantage across all generated tokens risks penalizing valid planning together with erroneous execution. To address this credit-assignment conflict, we introduce PACT (Plan-Action Consistency Training), a training framework that combines reference-aligned plan protection and plan-aligned action repair without altering the original scalar action reward. Using annotated reference actions to identify execution gaps, PACT protects the verified plan by masking negative policy-gradient contributions across its token span. Keeping the generated reasoning unchanged as context, it then favors the reference action over the emitted erroneous action through a preference surrogate with stop-gradient pair weights. Compared with the outcome-only baseline, PACT raises AndroidWorld task success from 60.34% to 68.97% (+8.63 pp), while improving rule-based plan-action consistency on AndroidControl High from 83.71% to 89.74% (+6.03 pp). Adapting PACT to desktop agents also improves task success from 40.92% to 44.17% (+3.25 pp) on the full 369-task OSWorld benchmark. Together, these results establish PACT as an effective credit-assignment framework for bridging execution gaps and improving task completion across mobile and desktop GUI environments.

98. 【2611.22577】Semantic-Guided Geometric Decoding for Token-Efficient Visual Grounding

链接:https://arxiv.org/abs/2611.22577

作者:Zhaojie Chen,Junyan Yang,Le Yang,Qi Dang,Yucheng Huang,Qianyi Che,Zhaoqiang Chen,Xinqi Zhu,Qiang Zhao

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal large language, Multimodal large, language-conditioned visual perception, provide a unified, unified interface

备注: 10 pages, 4 figures, 5 tables

点击查看摘要

Abstract:Multimodal large language models (MLLMs) provide a unified interface for language-conditioned visual perception. In pixel-to-sequence grounding, autoregressive coordinate generation requires multiple sequential decoding steps per box, increasing inference cost with the number of instances. Pixel-to-embedding methods reduce this overhead but lack explicit spatial encoding when using a shared special token. We introduce SemGeo, a token-efficient visual grounding framework that represents each instance with a single grid token for coarse localization. A geometric decoder reuses visual features and hidden states to recover precise discrete box coordinates in parallel. To train proposal generation and box localization together, we introduce Gaussian soft labels that encode coordinate distances during supervised fine-tuning (SFT). Reinforcement post-training further combines box-set rewards with coordinate supervision on model-generated proposals. This stage trains the language model and geometric decoder on their own predictions to mitigate the mismatch between teacher-forced training and inference. Across eight benchmarks spanning object detection, referring object detection, and document layout grounding, SemGeo achieves the highest F1@mIou among compared MLLMs on six benchmarks. It also delivers $2.07\times$ and $1.25\times$ the mean box-generation throughput of representative grounding baselines under vLLM and Transformers, respectively, while achieving higher accuracy in both comparisons.

99. 【2611.22565】MillBill: A Machining Agent with Geometric Feedback

链接:https://arxiv.org/abs/2611.22565

作者:Gennadii Savrasov,Artem Slavin,Soslan Kabisov,Andrey Kuznetsov,Anton Konushin,Dmitrii Zhemchuzhnikov

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:Turning a CAD, CAD model, requires both process, process knowledge, Turning

备注: 18 pages, 8 figures. Code: [this https URL](https://github.com/kulibinai/millbill)

点击查看摘要

Abstract:Turning a CAD model into a machining program requires both process knowledge and geometric precision. Language models can generate such workflows by writing geometry and toolpath code for each part, but this makes numerical execution part of the model's task. We introduce MillBill, an agent that separates machining decisions from their geometric execution and verification. Given a boundary-representation part, stock, and material, a locally hosted, mid-sized open model proposes operations and cutting parameters for indexed three-axis machining. A geometric harness generates toolpaths, simulates material removal, and returns feedback for plan refinement. Setup planning accounts for what the available cutters can physically reach, rather than visibility alone. We evaluate the resulting programs by the fraction of the target surface area within the specified tolerance after simulated machining. With Qwen3.8-27B, MillBill outperforms frontier-model approaches that construct their own geometry and toolpath workflows on the evaluated machining tasks. Code: this https URL

100. 【2611.22564】Lost in Read-out: Locating the Image Quality Gap in Vision-Language Models with a Closed-Form Edit

链接:https://arxiv.org/abs/2611.22564

作者:Zhuangzi Li,Shilv Cai,Jian Jin,Zhiyi Pan,Haihong Xiao,Weisi Lin

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:image quality assessors, zero-shot image quality, Vision-language models, zero-shot image, agree only moderately

备注:

点击查看摘要

Abstract:Vision-language models (VLMs) are widely used as zero-shot image quality assessors, yet their good-vs-poor answers agree only moderately with human opinion. We ask whether these models fail to see quality or fail to say it. Layer-wise probes on five VLMs point to the second: quality is linearly decodable from the vision encoder and still from the last language layer, far better than the answer reveals, and about a hundred labels recover most of it. The loss lies mainly in the final read-out, which partly reads something else: relative to human opinion, it over-rewards colorfulness and under-rewards sharpness on all five models. We test this by intervention: if the read-out is at fault, a closed-form edit of a single last-layer neuron, fitted to many prompts at once, should close the gap and no more. Both hold. Under prompts never used for fitting, the edit recovers 86--100\% of what a ridge head on the last-layer state, fitted under the same prompts, finds beyond the answer on KonIQ. Where that gap is small, it gains little, too little for our transfer criterion on the two largest models; where the head itself is below the answer, it lowers the score; and it works only when written from the middle of the language model on. Unlike unconstrained fine-tuning, the edit leaves perception question answering intact. It does not carry over to yes-or-no or rating questions, and it reverses the good--poor contrast after sentiment-laden sentences. Code will be made available.

101. 【2611.22563】CADMAGEDDON: High-Fidelity CAD Reconstruction with Local Inference

链接:https://arxiv.org/abs/2611.22563

作者:Oleg Pavlov,Nikita Gavrilov,Soslan Kabisov,Gennadii Savrasov,Andrey Kuznetsov,Anton Konushin,Dmitrii Zhemchuzhnikov

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:external services, proprietary parts, unwilling to share, share with external, CAD practitioners

备注: 13 pages, 4 figures, 4 tables. Code: [this https URL](https://github.com/kulibinai/cadmageddon)

点击查看摘要

Abstract:CAD practitioners often work with proprietary parts that they are unwilling to share with external services. For individuals and small companies, bringing this work in-house also requires computational resources they can afford. We introduce CADMAGEDDON, an open-source agent that reconstructs editable CAD from meshes and can run locally on single-GPU systems and current-generation laptops. The method decomposes this complex task into a chain of simple visual decisions about what to construct and what to correct. Geometric tools support precise construction, allowing the agent to focus on visual reasoning. Using the mid-sized Qwen3.8-27B model, CADMAGEDDON outperforms prior approaches, including systems based on frontier models, in reconstruction quality on all the main benchmarks. CADMAGEDDON integrates with FreeCAD, bringing its reconstructions into practitioners' existing CAD workflows. Code: this https URL

102. 【2611.22561】Plausible Videos Can Lead to Poor Decisions: Diagnosing and CURE-ing World Models for Planning

链接:https://arxiv.org/abs/2611.22561

作者:Raphael C. Kim,Michele Santacatterina,Jingsen Zhu,Ramin Zabih

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Action-conditioned world models, Action-conditioned world, world model, produce poor decisions, makes plausible

备注:

点击查看摘要

Abstract:Action-conditioned world models are increasingly used as world models for planning, yet a world model that makes plausible, realistic-looking videos that are consistent with the training data can produce poor decisions. We address two key questions: (1) when can we trust a world model for planning, and (2) what should we do when we cannot? We introduce CURE (Certify, Upweight, Rollout, Explore), a certificate-guided technique that assesses whether a world model can be trusted for planning and determines what to do next: whether to upweight the training data to debias the model; roll out more samples at test time; or explore by collecting new data where support (how well the training data cover the planner's decisions) is missing. We deploy CURE across multiple domains, spanning simulated physics based on PhyWorld, MuJoCo arm control, and Language-Table pushing in simulation and on real videos. The decisions our certificate trusts have lower regret than those it does not (e.g., 0.06 vs. 0.38 on Language-Table sim and 0.07 vs. 0.38 on MuJoCo contact), whereas video perceptual quality does not identify good decisions. By focusing on decision quality rather than perceptual quality, CURE lowers regret over the best pessimistic decision rule by 10-25% across support levels, and over world-action models, search and policy learning by 41-64%, given the same data.

103. 【2611.22556】Strong Fused Performance Can Mask Branch Collapse in a Dual-View Heart-Sound Classifier: A Three-Part Diagnostic Protocol

链接:https://arxiv.org/abs/2611.22556

作者:Safayet Khan,Hasan Zohirul Islam,Md. Tauhid Bin Iqbal

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:branch, Fusion models, practice that assumes, Fusion, fused score

备注:

点击查看摘要

Abstract:Fusion models are usually judged by their fused score, a practice that assumes that every branch has learned something useful. We show that this assumption can fail silently in dual-view heart-sound classification. In AudioFuse, which fuses a spectrogram transformer with a waveform CNN, the spectrogram branch is unused despite strong fused performance when both branches are trained from scratch. We introduce a three-part diagnostic for branch collapse: whether deleting a branch changes the fused score, whether a linear probe on its features beats an untrained copy of the same branch, and whether the branch can learn its view when trained alone. Deleting the branch has negligible effect, and probing its features shows little improvement over an identically initialised, untrained copy. Yet the same architecture trained alone exceeds 0.9 AUC, so its view is learnable, while the jointly trained model is near chance when it must rely on this branch. Update statistics and an initialisation experiment point to an early optimisation imbalance. Moving a strong artificial label cue from one input to the other can switch which branch the model relies on, even though the branch architectures stay the same. We observe branch collapse on PhysioNet, but the full diagnostic is not met on ICBHI or CirCor. Fused performance alone therefore cannot establish that every branch learned a meaningful representation, and we recommend reporting branch deletion and an untrained-control probe alongside it.

104. 【2611.22551】Fast Training-Free Low-Light Video Enhancement with a Frozen Image Diffusion Prior

链接:https://arxiv.org/abs/2611.22551

作者:Hon Ming Yam,Chun Pong Lau

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:low-light training data, Pretrained image diffusion, enhance low-light video, Pretrained image, training data

备注: 15 pages, 12 tables, 4 figures

点击查看摘要

Abstract:Pretrained image diffusion models can enhance low-light video without low-light training data and without retraining for a new camera. ZVRD, the only published training-free method for low-light video, is too slow to use: our implementation needs over a minute per $256 \times 256$ frame. We present a causal, training-free pipeline that adds two temporal components to a frozen MR. Illuminate image prior. Temporal input fusion recursively averages motion-compensated low-light frames before diffusion inversion. Late-start offset propagation runs the full sampling trajectory only on key frames. Each non-key frame inverts the low-noise part of its own trajectory and adds an enhancement offset warped from the latest key frame. At ZVRD's own resolution the pipeline is $261\times$ faster than ZVRD and scores better on all five metrics we report. On 13 held-out SDSD clips at $1280 \times 720$, it improves on framewise eight-step processing by 0.55 dB in PSNR and 0.034 in LPIPS and halves the warping error, in 10% less time. Measurements inside the model show why, and a linear-Gaussian model of inversion explains them. Fusion removes frame-to-frame noise before inversion amplifies it. A flow error perturbs the transported offset ten times less than it perturbs a transported state. The perceptual gain does not transfer to low resolution: at $346 \times 260$, LPIPS is worse by 0.028. At 0.65 frames per second, the pipeline is an offline method.

105. 【2611.22543】JointGV: Structure-Aware Correction of Visual World Models with Parallel Graph Dynamics for Long-Horizon Modeling

链接:https://arxiv.org/abs/2611.22543

作者:Tian Lyu,Yichen Jiang,Ziyuan Cheng,Yunda Yan,Xiangyu Pan,Junjie Jiang,Jialin Yu,Boyu Ning,Pietro Liò,Fan Mo

类目:Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:predict future visual, models predict future, future visual states, visual states conditioned, spatial relations limit

备注:

点击查看摘要

Abstract:Visual world models predict future visual states conditioned on actions, but recursive errors in entity poses and spatial relations limit their long-horizon prediction for robot planning and control. We ask whether a separately predicted relational state can correct this drift without restructuring the visual model. This is challenging because graph nodes and visual states share neither elements nor a feature space. We propose Joint Graph--Visual Dynamics Correction (JointGV), a plug-in based on a cross-granularity dynamics hypothesis: despite their different representations, graph-node and visual-state changes describe the same physical transition. JointGV rolls out a task-conditioned scene graph alongside the visual world model, couples their predicted changes, and combines the resulting graph-motion context with graph-predicted node positions to compute a bounded residual. Graph-learning and correction gradients do not propagate into the original visual dynamics. We attach JointGV to DINO-WM (spatial tokens) and DreamerV3 (a global latent state), evaluating both on DMC Cheetah Run and Walker Walk across three seeds and extending the evaluation to contact-rich manipulation with DMC Finger Turn Hard. Across 32-step rollouts, JointGV improves structural and visual-prediction accuracy, reducing joint-position error by 11--28\%. For spatial tokens, learned graph--visual change coupling gives lower error than broadcasting the same mean graph-motion context to every token, particularly when non-adjacent parts appear close together in the image. On real-robot inverted-pendulum sequences, JointGV reduces DINO-WM's 32-step pole-angle error from $12.56^\circ$ to $6.69^\circ$ and improves DreamerV3 and LeWorldModel as well. In simulated inverted-pendulum control, an actor trained with JointGV-corrected rollouts completes 46 of 50 episodes, compared with none using the original rollouts.

106. 【2611.22541】From Perception to Simulation: Unveiling and Empowering Mental Spatial Dynamics in MLLMs

链接:https://arxiv.org/abs/2611.22541

作者:Jiachun Li,Zhuoran Jin,Kang Liu,Jun Zhao

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词:Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, understanding for Multimodal

备注: Findings of EMNLP 2026

点击查看摘要

Abstract:Spatial reasoning is a fundamental component of world understanding for Multimodal Large Language Models (MLLMs). While existing research has advanced the perception of spatial relations in static scenes, the domain of dynamic spatial simulation remains relatively unexplored. To bridge this gap, we introduce MentalGrid, a benchmark focused on spatial reasoning tasks that require models to simulate evolving spatial states without intermediate visual feedback. Extensive evaluation on our benchmark reveals a significant deficiency in the spatial simulation capabilities of existing models. Specifically, we find that performance is constrained by perceptual limitations in simple simulation scenarios and hindered by inadequate multi-step reasoning as complexity increases. To address these challenges, we propose a three-stage curriculum learning framework utilizing 16k specialized spatial reasoning samples. This approach yields SpatialWalker, which achieves a 33.8% average improvement over its base model, surpassing proprietary models like Gemini-3-Flash in spatial simulation. Furthermore, SpatialWalker demonstrates robust generalization, maintaining a 4.9% average gain on out-of-domain benchmarks, demonstrating the pivotal role of spatial simulation as a fundamental building block for broader spatial intelligence.

107. 【2611.22512】ATS: Anti-Aliased Triangle Splatting with Exact Per-Primitive Integrals

链接:https://arxiv.org/abs/2611.22512

作者:Brent Zoomers,Joni Vanherck,Leander Winters,Jeroen Put,Lode Jorissen,Nick Michiels

类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词:Splatting represents scenes, Triangle Splatting represents, Triangle Splatting, Triangle Splatting window, Splatting represents

备注: 17 pages, 7 figures, 9 tables

点击查看摘要

Abstract:Triangle Splatting represents scenes using semi-transparent triangles, but it evaluates each triangle at the pixel center and culls any triangle with an inradius smaller than one pixel. The former causes severe aliasing, while the latter culls most of the scene at lower resolutions. We show that the integral of the Triangle Splatting window over a pixel admits an exact closed-form solution. The angle bisectors split the triangle into three sub-triangles, in each of which the window is a power of the distance to one edge. Each piece therefore has a closed-form antiderivative, and Green's theorem reduces the integral and its gradients to one term per side of the sub-triangle clipped against the pixel. The integral over the whole triangle, which we show has a closed form, then allows conservative culling, removing only triangles that cannot meet the renderer's alpha cutoff at any pixel. This exact formulation anti-aliases existing models without retraining, exhibits less temporal aliasing than 2x2 supersampling, and enables multi-scale training, matching or outperforming supersampled training at reduced resolutions.

108. 【2611.22508】Reliability-Driven Feature Correction for Hyperspectral and LiDAR Classification

链接:https://arxiv.org/abs/2611.22508

作者:Lianming Zhang,Xiaolu Wang,Qiya Song,Jinyang Liu,Renwei Dian,Xudong Kang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Hyperspectral image, LiDAR data provide, data provide complementary, provide complementary spectral, LiDAR data

备注:

点击查看摘要

Abstract:Hyperspectral image (HSI) and LiDAR data provide complementary spectral and elevation information for land-cover classification. However, the spatially varying class-discriminative reliability of modality features is rarely modeled explicitly, allowing weak or ambiguous features to adversely affect cross-modal interaction and fusion. To address this issue, we propose ReDF, a reliability-driven framework that quantifies the reliability of each modality's features at each spatial location through the strength of class-related evidence they provide, and uses it to guide feature correction and fusion. Specifically, a Reliability-Guided Feature Correction module introduces a class prototype bank for each modality and converts feature-prototype similarities into class evidence for reliability estimation. The estimated reliabilities are used to construct a reliability-weighted shared representation and to guide bidirectional cross-modal feature correction based on neighborhood agreement, refining modality features with weak class evidence through information from the other modality. Building on these outputs, a Reliability-Guided Feature Reweighting module conditions a low-rank modulation on the estimated reliabilities and the cross-modal disagreement, and applies it to the corrected modality-specific descriptors to adaptively rescale each modality's contribution to the fused representation used for final classification. Experiments on three public HSI-LiDAR datasets show higher mean overall accuracy and Kappa than the compared methods.

109. 【2611.22506】EfficientVPR: Toward Efficient Visual Place Recognition via Scene-Aware Prompt Tuning and Adaptive Feature Enhancement

链接:https://arxiv.org/abs/2611.22506

作者:Wenjing Tang,Chuanguang Yang,Zhulin An,Libo Huang,Yongjun Xu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:handling extreme environmental, extreme environmental variations, Visual place recognition, faces critical challenges, place recognition

备注: 18 pages, 11 figures, accepted at CVPR 2026

点击查看摘要

Abstract:Visual place recognition (VPR) faces critical challenges in handling extreme environmental variations while meeting the computational constraints of practical applications. Current methods predominantly address these challenges by either scaling up model capacity or employing computationally intensive reranking stages, creating a significant efficiency bottleneck. To overcome this limitation, we propose EfficientVPR, a lightweight one-stage framework that achieves speed-accuracy trade-offs through two key innovations: i) a scene-aware visual prompt tuning method which adapts pretrained features with less parameters while dynamically adjusting to sample-specific characteristics, and ii) an instance-dependent key local feature enhancement module that further reinforces discriminative regions. Comprehensive evaluations on Pitts250k, MSLS, Eynsham, AmsterTime and SVOX demonstrate that our method establishes a new SOTA for DINOv2-small models by outperforming all same-scale competitors, and delivers a $73\times$ speedup with 60\% lower-dimensional features while maintaining competitive (within 2.5% average R@1 gap) against the SOTA DINOv2-large-based two-stage method. Our code will be available at this https URL.

110. 【2611.22504】Efficient Self-Supervised Adaptation of 3D Abdominal Vision-Language Model for Institution-Specific HCC Classification via Full Fine-Tuning and PEFT

链接:https://arxiv.org/abs/2611.22504

作者:Febryan Putra Kartika,Cheng-Yu Ma,Ying-Jia Lin,Chi-Tung Cheng,Kuan-Fu Chen

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:capture cross-modal relationships, medical VLM, Medical vision-language models, tasks remains underexplored, HCC classification

备注: 25 pages, 12 figures, 7 tables, including appendices. Corrected author revision of the MIDL 2026 paper. Revised preprocessing yields lower HCC classification performance; the main findings on temperature initialization and better VerSe performance retention with PEFT remain supported

点击查看摘要

Abstract:Medical vision-language models (VLMs) capture cross-modal relationships between image and text, yet their adaptation to institution-specific clinical tasks remains underexplored. In this study, we fine-tuned a pretrained 3D medical VLM for hepatocellular carcinoma (HCC) classification using paired abdominal CT scans and radiology reports from a different institution with acquisition characteristics that differ from the model's original pretraining corpus. We compared two adaptation strategies: full fine-tuning and parameter-efficient fine-tuning (PEFT), motivated by the common use of PEFT to reduce computational cost and enable adaptation under limited-data constraints. Both approaches achieve strong downstream HCC classification performance despite the cross-institutional domain shift, with PEFT reaching an AUC of 0.79 and F1 of 0.70, and full fine-tuning achieving an AUC of 0.82 and F1 of 0.71. Although these results remain below the performance reported by supervised HCC classification approaches, our method achieves improvements over the pretrained model through CT-report contrastive learning without requiring lesion-level annotations or HCC classification labels as training targets. Full fine-tuning converges rapidly but overfits within a few epochs, whereas PEFT (ConvLoRA for the image encoder and LoRA for the text encoder) attains comparable performance while updating approximately 1% of the model parameters, although requiring more training steps. We also examine the role of contrastive temperature, observing that temperature initialization significantly affects classification performance. This study demonstrates that a 3D medical VLM can be efficiently adapted to institution-specific HCC classification using self-supervised CT-report contrastive learning, while highlighting the practical trade-offs between full fine-tuning and parameter-efficient fine-tuning.

111. 【2611.22495】Motion-Aware Reward Modeling for Instruction-Guided Video Editing

链接:https://arxiv.org/abs/2611.22495

作者:Li Li,Xiangbo Gao,Bo Ni,Samyadeep Basu,Viet Dac Lai,Jing Shi,Seunghyun Yoon,Gang Wu,Yu Wang,Thien Huu Nguyen,Tyler Derr,Franck Dernoncourt,Zhengzhong Tu,Yue Zhao

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:favor temporal consistency, favor temporal, temporal consistency, motion, Reward

备注:

点击查看摘要

Abstract:Reward models for instruction-guided video editing can favor temporal consistency at the expense of motion. We study this failure, termed \emph{motion collapse}, using controlled motion-suppression variants of real edits. On VE-Bench, the evaluated composite reward prefers a motion-suppressed candidate in $97\%$ of cases. Learned video rewards and a VLM judge also struggle with mild suppression, while latent optimization and reward-guided fine-tuning exploit this weakness to increase reward as motion declines. A linear probe of our base reward backbone performs near chance on mild suppression, motivating an explicit inter-frame dynamics input. We propose a motion-aware reward model that combines an RGB frame-difference stream with preference training against motion-suppressed and fabricated-motion negatives. A distillation anchor preserves alignment with human quality judgments. On the VE-Bench motion ladder, our model reduces the rate of selecting motion-suppressed candidates to $0\%$ while achieving a Spearman correlation of $0.57$ with human quality ratings. It also detects unseen suppression variants and preserves motion during reward-guided fine-tuning on two editing pipelines. These results support explicitly modeling motion in rewards for video editing.

112. 【2611.22494】Fast and Strong Image Protection against Diffusion Personalization

链接:https://arxiv.org/abs/2611.22494

作者:Jiwon Park,Jihye Kang,Namhyuk Ahn

类目:Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)

关键词:handful of photographs, reproduce a person, Personalized, PDM, protective diffusion model

备注:

点击查看摘要

Abstract:Personalized text-to-image diffusion models can reproduce a person from a handful of photographs. Image protection perturbs each image before publication so that fine-tuning on it fails, but it optimizes every perturbation from scratch, so its cost grows with the number of images. We present the protective diffusion model (PDM), which is trained once and samples the perturbation of a new image over many denoising steps. PDM distills an iterative teacher and is then post-trained with the target residual projection (TRP) loss as a reward, a stronger objective than existing ones. PDM outperforms nine baselines on faces and artworks and nearly matches its teacher at a tenth of the cost.

113. 【2611.22482】LeViT-UNet++: Towards Balanced Fine-Grained Details and Context for Efficient Medical Image Segmentation

链接:https://arxiv.org/abs/2611.22482

作者:Guoping Xu,Jinling Zhu,Liuyue Li

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

关键词:real-time image-guided intervention, clinical applications requiring, applications requiring fast, global context modeling, radiation therapy

备注: 24 pages, 5 figure

点击查看摘要

Abstract:Efficient medical image segmentation is essential for clinical applications requiring fast and accurate delineation, such as surgical navigation, radiation therapy, and real-time image-guided intervention. Despite substantial advances in convolutional neural networks and Transformers, attaining high accuracy under limited computational resources remains difficult, because reducing model complexity often sacrifices fine-grained structural details and global context modeling, yielding an unfavorable accuracy-efficiency trade-off. To address this, we propose LeViT-UNet++, an efficient encoder-decoder architecture that better balances local detail preservation and global context modeling. Specifically, we introduce a Haar Wavelet Multi-Scale Downsampling (HWMD) module that decomposes feature representations into low- and high-frequency components to extract multi-scale structural information, thereby mitigating detail loss during downsampling. We further develop a depthwise convolution-based decoder that integrates multi-scale global representations from Transformer blocks with local spatial features, enabling progressive feature refinement while reducing computational overhead. Evaluated on four benchmarks (Synapse, ACDC, LA2018, and MSD Heart) under both 2D and 3D settings, LeViT-UNet++ achieves competitive accuracy with a compact parameter footprint and fast inference. On Synapse, for instance, it attains a DSC of 76.57% with only 8.025M parameters and 241.72 FPS, confirming a favorable accuracy-efficiency balance. These results demonstrate the effectiveness of combining wavelet-based multi-scale feature extraction with lightweight local-global feature fusion for efficient medical segmentation. The source code is available at this https URL.

114. 【2611.22472】Disagree to Prune: Reallocating Visual Tokens Where a Small VLM Dissents

链接:https://arxiv.org/abs/2611.22472

作者:Yanchao Li,Jiaqing Xie,Ben Gao,Yusu Zhang,Beilun Wang,Yanbo Wang,Xiaohua Xu,Zhongyu Huang,Tianfan Fu,Nanqing Dong

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:large vision-language models, Visual token pruning, small VLM, token pruning speeds, tokens

备注: 45 pages, 8 in the main text. Code and data: [this https URL](https://github.com/LiZaiyuan0619/PRUDENT)

点击查看摘要

Abstract:Visual token pruning speeds up large vision-language models (VLMs) by keeping only a part of their visual tokens. Most existing methods improve the ranking of the tokens and then answer every question once with the same budget. With strong rankings, pruning hurts only a few questions, and signals computed on the kept tokens see little of what it removed. We find that, on most of these questions, a small VLM given the full image disagrees with the pruned answer, since it still sees the missing evidence. We propose PRUDENT, which first answers with about half the budget and spends the saved tokens on re-answering the disagreeing questions at twice the budget. We show when such re-answering pays and why the small VLM should read the full image. On 18 benchmarks, PRUDENT outperforms eight existing pruning methods at the same average budget of visual tokens. Its lead widens as the budget tightens, and holds across five InternVL sizes. PRUDENT also has the highest average in two more model families. The disagreement of the small VLM flags most pruning failures of all eight methods, and re-answering on it also improves the two strongest with their own rankings. Other checkers give similar gains, and the extra tokens go where the first pass hurts the answer. These results suggest that identifying which pruned answers are trustworthy provides an additional lever for visual token pruning beyond the ranking of tokens. Code and data are available at this https URL.

115. 【2611.22464】MAVE: Reconstructing Editable 3D Blockouts from Film Shots

链接:https://arxiv.org/abs/2611.22464

作者:Yifan Chang,Jian Yang,Jiangnan Shao,Xiaofeng Wang,Zhaoxin Fan,Renjing Xu,Ming Lu,Xingang Wang,Zheng Zhu

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:blockouts support previsualization, provide structural conditions, support previsualization, previsualization and provide, provide structural

备注: [this https URL](https://github.com/yfChang-cv/MAVE)

点击查看摘要

Abstract:Animated 3D blockouts support previsualization and provide structural conditions for video generation, but manually reconstructing them from reference videos is costly. This limits both their use by creators and the production of paired training data. We introduce MAVEBench, a benchmark of 50 film shots and 416 keyframes for evaluating camera motion, spatial layout, and character blocking. We propose MAVE, a video-to-blockout framework combining Metric observation, Agentic modeling, and evidence-based VErification. It first recovers cameras, human motion, and geometric evidence in a shared metric coordinate system. An agent then constructs an editable environment under constraints from these observations, while programmatic checks report inconsistencies to guide refinement. The outputs are editable Blender scenes and frame-aligned blockout videos. On MAVEBench, MAVE improves overall scores by 27.5-41.1 points across three agents over their corresponding vanilla baselines. With DeepSeek-1017, it achieves a score of 73.2 at an average API cost of only USD 0.054 per shot, outperforming the strongest vanilla baseline while reducing total reconstruction time by 53%. We also construct MAVEData-3K, a dataset of 3,000 blockout-video pairs for model training, and will release it publicly. Creators can change viewpoints and character paths, then render the edited scenes to condition video generation. Code is available at this https URL.

116. 【2611.22458】Sample-Aligned Decoders for Latent Generative Models

链接:https://arxiv.org/abs/2611.22458

作者:Yu Lei,Yi Li,Hongcheng Gao,Yipeng Wei,Liang Li,Li Su,Qingming Huang

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:generated latents, latents, reconstruct encoder latents, decoding generated latents, generative models synthesize

备注: Project page: [this https URL](https://torpedo2003.github.io/SAD/)

点击查看摘要

Abstract:Latent generative models synthesize images by decoding generated latents, yet their decoder is trained only to reconstruct encoder latents and never sees the latents it decodes at test time, so the residual errors of the generator are rendered directly into the final image. Existing remedies retrain the generator, add cost at every sampling step, or make the decoder robust to perturbed real latents, assuming that generator errors resemble such perturbations. We find that they do not. Generated latents lie on the encoder latent manifold as closely as real ones, yet follow a different distribution. The decoder should therefore be adapted to the distribution of generated latents, which raises two challenges: (1) unpaired supervision, since a generated latent has no ground-truth image, and (2) latent-space drift, since a decoder freed from paired targets forgets the latent space it must decode. We propose Sample-Aligned Decoders (SAD), a post-training framework that fine-tunes only the decoder of a frozen generator at no inference cost. Generated-Sample Distribution Alignment matches decoded generated latents to unpaired real images in a frozen foundation-model feature space, and Encoder Anchor Preservation keeps the decoder close to the original one on encoder latents. Our analysis shows that the alignment is effective only on generated latents, where it corrects each sample in proportion to how much more often the generator produces such latents than the encoder; on encoder latents it can only work against the anchor. SAD improves four state-of-the-art ImageNet generators across three tokenizers, e.g., FID-50K from 1.15 to 0.98 for REPA-E, complements discriminator guidance, and extends to text-to-image generation. Our code and models are available at this https URL.

117. 【2611.22450】MedImgAnnotator: batch wise medical image annotation and preprocessing tool

链接:https://arxiv.org/abs/2611.22450

作者:Ewunate Assaye Kassaw(1 and 2),Amit Mehndiratta(1 and 3 and 4 and 5),Peush Sahni(6),Anup Singh(1 and 3 and 4) ((1) Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India, (2) Department of Biomedical Engineering, University of Gondar, Gondar, Ethiopia, (3) Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi, New Delhi, India, (4) Department of Biomedical Engineering, All India Institute of Medical Science, New Delhi, India, (5) Faculty of Medicine and Health, University of New South Wales (UNSW), Sydney, Australia, (6) Max Centre for Liver and Biliary Sciences, Max Super-specialty Hospital, Saket, New Delhi, India)

类目:Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

关键词:developing deep learning, deep learning models, learning models demands, active annotation time, annotation time

备注:

点击查看摘要

Abstract:The curation of large cohort datasets for developing deep learning models demands annotating or editing over the AI-predicted labels. However, openly available annotation tools are time-consuming, as they involve complex navigational steps and do not support batch processing. This study aimed to develop a simple, fast, semiautomated batch-annotation tool named MedImgAnnotator. The tool was created by integrating editing tools, image mask pair matching logic, preprocessing functions, object detection tool, and a plugin management system. Its performance was evaluated in terms of active annotation time and ease of use by the developer and 12 users using open-source MR and CT scans. Additionally, the tool had been used by the MICCAI 2026 CARE Challenge liver segmentation best performance winner to annotate liver masks from 6412 MRI volumes. The evaluation results showed that MedImgAnnotator reduced active annotation time from 206.5+/-32.87 (average active annotation time of openly available tools) seconds to 59 seconds. The Wilcoxon signed-rank test of 12 users evaluation results recorded P values of 0.032 and 0.008 for the active annotation time and higher ease of use rating metrics, respectively, indicating that the current tool significantly reduces annotation time and enhances ease of use. Moreover, the tool utilization for annotating different regions of interest from different modality scans and body regions shows its usability across modalities and areas of interest. MedImgAnnotator, which significantly reduces active annotation time for large imaging cohorts, is available as an executable file and as a Python script. Access link: this https URL

118. 【2611.22446】As Student Rollouts Continue, Visual Backdoors Keep Growing

链接:https://arxiv.org/abs/2611.22446

作者:Zane Fu,Yanzhao Zheng,Jinze Liu,Ziting Qin,Qianshan Wei,Jihuai Zhu,Yipeng Yu,Baohua Dong,Hangcheng Zhu,Ruohui Huang

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Conventional knowledge distillation, Conventional knowledge, OPD, Conventional, backdoor propagation

备注:

点击查看摘要

Abstract:Conventional knowledge distillation can facilitate the propagation of backdoors from teacher models to student models. However, how this risk manifests in On-Policy Distillation (OPD) remains insufficiently studied. OPD has recently emerged as an important post-training paradigm for Vision-Language Models (VLMs). Unlike traditional offline distillation, OPD does not require teacher-generated responses. Instead, it uses the teacher's probability distributions to supervise response trajectories generated online by the student. Since the initial student model typically generates benign responses and receives no explicit supervision from malicious target responses, OPD appears to offer some inherent resistance to backdoor propagation. In this paper, we challenge this intuition and reveal a more subtle risk of visual backdoor propagation in OPD. Through experiments across multiple model families and datasets, together with theoretical analysis, we identify three main findings. First, unlike the relatively gradual propagation observed in traditional offline distillation, backdoors rarely emerge in OPD at low poisoning ratios. However, the attack success rate rapidly approaches 100% once a critical threshold is exceeded. Second, backdoor propagation does not depend on explicit malicious responses. Instead, it is driven by the continuous accumulation of anomalous probability mass assigned by the teacher. Finally, based on these findings, we propose a novel trigger design that enables visual backdoor propagation with zero explicit trigger injection. These findings further reveal an overlooked mechanism of backdoor propagation in OPD and highlight its potential security risks.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

Cite as:
arXiv:2611.22446 [cs.CV]

(or
arXiv:2611.22446v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2611.22446

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>
119. 【2611.22439】Where Demand Meets Supply: Spatial Elastic Consensus for Low-Bandwidth Collaborative Perception

链接:https://arxiv.org/abs/2611.22439

作者:Linshan Yan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:range make ego-only, limited sensor range, sensor range make, Occlusions and limited, make ego-only

备注: 10 pages

点击查看摘要

Abstract:Occlusions and limited sensor range make ego-only 3D perception insufficient for safe driving. Collaborative perception addresses this by enabling connected vehicles to share complementary observations, yet it remains constrained by tight vehicular communication budgets. While spatial selection is more flexible than fixed-rate feature compression, existing selectors remain largely sender-driven and waste scarce bandwidth on ego-visible targets. Furthermore, applying convolutions after masking spreads isolated tokens into their neighborhoods, silently violating low-bandwidth constraints. To address this, we propose Spatial Elastic Consensus (SEC), a bandwidth-adaptive framework centered on bilateral demand-supply consensus. Instead of unilateral token selection, the ego vehicle formulates a content-aware demand prior while each collaborator evaluates its local supply. This single-round consensus allocates the token budget to critical ego-missed evidence rather than ego-visible redundancy, without transmitting dense maps. To guarantee exact budget compliance, an anti-dilation refine-before-mask pipeline refines features prior to discrete token selection, preventing receptive-field leakage. A lightweight deformable sampler then aggregates these sparse messages with learned local offsets, compensating for the spatial context lost to token selection and mitigating inter-agent pose drift. Evaluated at a stringent 64KiB budget, SEC consistently achieves the best AP@0.7 on the simulated OPV2V and V2XSet datasets and the real-world DAIR-V2X dataset. These results demonstrate that combining bilateral consensus with budget-exact transmission is key to efficient low-bandwidth collaborative perception.

120. 【2611.22429】When Neural Collapse Fails to Route: Routing Drift in Continual Learning

链接:https://arxiv.org/abs/2611.22429

作者:Nicolas Larue

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:strong task-local decision, task-local decision boundaries, learn strong task-local, Progressive neural-collapse classifiers, global Class-IL decision

备注: Accepted at BMVC 2026. 36 pages, including supplementary material

点击查看摘要

Abstract:Progressive neural-collapse classifiers can learn strong task-local decision boundaries while failing the global Class-IL decision. We identify the failure as routing drift: under an expanding equiangular tight frame (ETF) classifier, a held-out sample can remain separable within its true task block, yet receive its largest global score from another block. This produces high Task-IL accuracy but low Class-IL accuracy, and small replay buffers can mask the problem because stored samples are optimized repeatedly and often remain well routed. We formalize route accuracy directly from the global class argmax and use it to separate within-task discrimination from cross-task score comparability. This decomposition suggests a classifier-level correction: preserve the global ETF frame, but add class-local reliability evidence when transported class measures deviate from the neural-collapse ideal. We develop Reliability-Calibrated Routing (RCR), a lightweight post-hoc classifier that composes standardized ETF alignment with radial plausibility around transported, NC-shrunk class representatives. Across three datasets and two fixed replay-buffer budgets, this NC-consistent correction gives the best Class-IL FAA on five of six settings and reduces Class-IL forgetting on all six. The largest gains occur in harder routing regimes: up to $+6.75$ FAA over the reported reference, and up to $+8.03$ FAA and $+8.62$ final route accuracy in paired evaluations, while preserving Task-IL performance. These results position routing drift as a measurable failure mode of ETF-based continual learning and show that reliability-calibrated class evidence can repair part of the lost global routing without retraining the representation. Code and evaluation artifacts are available at this https URL.

121. 【2611.22427】Do Diffusion Models Learn to Generalize Basic Visual Skills?

链接:https://arxiv.org/abs/2611.22427

作者:Amish Sethi,Boya Zeng,Wenhao Chai,Zhuang Liu

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:generate high-quality images, Fréchet Inception Distance, models generate high-quality, Diffusion models generate, Visual Generative Lab

备注: NeurIPS 2026. Project page: [this https URL](https://amishsethi.github.io/visual-generative-lab/)

点击查看摘要

Abstract:Diffusion models generate high-quality images, but how well they generalize is hard to measure. Current evaluations rely on human preference and prompt-following benchmarks for text-to-image models and on distribution-level metrics such as Fréchet Inception Distance (FID) and Inception Score (IS) for class-conditional models, but these cannot tell whether models learn basic visual skills or largely match training patterns. To address this gap, we introduce the Visual Generative Lab (VGL), a controlled experimental framework for studying how diffusion models learn and generalize basic visual skills, including size, position, rotation, count, color, shape, and their compositions. By generating synthetic training data for each skill from explicit rules, VGL allows precise measurement of generalization with task-specific, rule-based metrics. Training models from scratch on these data reveals three patterns in this controlled setting: (1) with our default design, extrapolation is limited: size and position degrade within a few pixels of the training range, count reaches only about 50% accuracy on out-of-range counts, and rotation extrapolation accuracy varies widely across seeds; (2) for compositional generalization, the number of distinct basic visual skill combinations matters more than dataset size; (3) skills mostly fail independently, except position. Code and data-generation scripts: this https URL.

122. 【2611.22418】CutAgent: Creative-Gene-Driven Planning and Experience-Guided Self-Refinement for High-CTR E-commerce Advertising Video Creation

链接:https://arxiv.org/abs/2611.22418

作者:Xuyue Huang,Guanbo Huang,Jiasong Feng,Run Ling,Ao Ma,Xi Zhao,Yaoyu Li,Jie Gao,Ke Cao,Wei Feng,Zhanjie Zhang,Hao Wang,Jinghe Hu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:advertising video creation, textbf, E-commerce advertising video, requires both high-level, video creation requires

备注:

点击查看摘要

Abstract:E-commerce advertising video creation requires both high-level creative planning and reliable multi-modal production. However, existing methods often map product attributes directly to scripts or editing decisions without explicitly modeling advertising strategies, narrative structures, and production styles. They also have limited ability to reuse past production failures. To address these limitations, we propose $\textbf{CutAgent}$, a dual-agent framework that formulates advertising video creation as a Plan--Execute--Self-Evolve process. CutAgent comprises two collaborative agents, $\textbf{GeneAgent}$ and $\textbf{VideoAgent}$, connected by a structured creative gene that bridges product understanding and video production. GeneAgent maps multi-modal product inputs---textual attributes together with product images---to creative genes that specify narrative units and production rules. To train GeneAgent, we construct $\textbf{CutAgent-70K}$ with approximately 70K samples of product attributes/images, reverse-extracted creative genes, cleaned clip pools, and real-world CTR, and apply high-CTR supervised fine-tuning followed by CTR-guided GRPO. Guided by the generated gene, VideoAgent retrieves category-then-gene failure--correction experiences from a long-term memory as constraints for shot-script planning, then coordinates material retrieval, narration, subtitles, music, and timeline rendering. Independently, a reflection loop diagnoses quality defects, revises deficient production decisions, and writes verified corrections back to memory for later retrieval. Experiments on $\textbf{CutAgent-Eval}$ show that CutAgent outperforms representative baselines in e-commerce advertising video creation, achieving the highest online CTR of $\textbf{2.21\%}$.

123. 【2611.22415】SpatialMind: Adaptive Multi-Level Geometric Fusion for Spatial Reasoning in Multimodal Large Language Models

链接:https://arxiv.org/abs/2611.22415

作者:Shibin Zhao,Hao Tan,Fan Yang,Haixin Wang,Feilong Chen,Yidong Ma,Chaoyang Zhao,Ming Tang,Jinqiao Wang

类目:Computer Vision and Pattern Recognition (cs.CV); Computational Geometry (cs.CG)

关键词:Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, Language Models

备注: Includes supplementary material. Code available at [this https URL](https://github.com/zhaosb-star/SpatialMind)

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) demonstrate promising capabilities in 2D visual understanding, yet remain limited in 3D spatial reasoning. Recent studies explore integrating 3D reconstruction models into MLLMs. However, these approaches either use a single geometric granularity across all tasks or adopt a fixed multi-level fusion scheme, regardless of task-specific reasoning requirements. Through systematic experiments on multi-level geometric fusion, we find that spatial tasks at different cognitive levels (e.g., distance estimation vs. route planning) require geometric representations of different granularities, revealing that fixed fusion cannot accommodate diverse spatial reasoning requirements. To bridge this gap, we propose SpatialMind, a task-adaptive framework for dynamically integrating multi-level geometric representations. SpatialMind employs GeoFus, a multi-layer geometric fusion module built around a gating network jointly conditioned on textual instructions, visual semantics, and geometric representations. This network adaptively modulates the contributions of shallow, intermediate, and deep geometric features across the layers of the LLM decoder. Furthermore, we introduce a negative-entropy regularization loss to mitigate gate collapse. Gate visualizations indicate that GeoFus adapts geometric granularity to task requirements. Experiments demonstrate that SpatialMind achieves competitive performance across spatial benchmarks, attaining a state-of-the-art score of 72.3 on VSI-Bench. The source code is publicly available at this https URL.

124. 【2611.22409】SignAligner: Dual-Granularity Span Generation for Sign Language Alignment

链接:https://arxiv.org/abs/2611.22409

作者:Jongbhin Woo,Youngjoon Jang,Joon Son Chung

类目:Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词:Large sign-language corpora, Large sign-language, sign-language corpora benefit, word spans, spans

备注: 11 pages, 5 figures

点击查看摘要

Abstract:Large sign-language corpora benefit from temporal labels at two scales: subtitle spans for subtitle alignment and word spans for sign spotting. Sign spottings already locate words in time at corpus scale, but training subtitle alignment jointly on subtitle and word spans remains underexplored. We present SignAligner, a prompt-conditioned visual-language span generator that maps a sign-language video and a subtitle-sentence or target-word query to a textual start/end frame interval. It is first trained jointly on subtitle spans and word spans from sign spottings, then refined with overlap-based rewards while retaining auxiliary word examples. On the subtitle test set of the British Broadcasting Corporation-Oxford British Sign Language (BOBSL) corpus, the refined model reaches 66.68 F1@0.50 (F1 with a temporal intersection-over-union threshold of one half), the best among compared systems without external sign-video resources. This overlap-reward refinement outperforms cross-entropy continuation from the same jointly trained model. Joint training with word spans improves subtitle alignment in a pair of our generators matched in code, labels and maximum update budget. The advantage remains after both models of the pair are refined with overlap rewards. For word queries, the refined model follows the queried word, not a fixed position in the video: when the word's sign lies away from the video centre, it is far more accurate than predictions that use position alone. Together, these findings support one shared span generator refined with overlap rewards, aligning subtitles and producing word spans for human review.

125. 【2611.22395】CoBoVLA: Decoupling Language from Action with Discrete Codes for Robust and Interpretable Robot Manipulation

链接:https://arxiv.org/abs/2611.22395

作者:Mehul Arora,Dhruv Agarwal,Ambuj Agrawal

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:LIBERO benchmark, models achieve high, high success rates, benchmark but remain, remain sensitive

备注: 16 pages, 3 figures, 4 tables, and supplemental material included

点击查看摘要

Abstract:Vision-Language-Action (VLA) models achieve high success rates on the LIBERO benchmark but remain sensitive to paraphrasing. Existing VLAs ranging from 0.6B to 7.5B parameters experience a 22-52 point performance drop on LIBERO-Para while SmolVLA exhibits an even larger decline, from 83\% to 8\%. Because most VLAs jointly learn language understanding and action generation, it is difficult to determine whether a failure originates from misunderstanding an instruction or executing it incorrectly. To address these challenges, we introduce CoBoVLA, or CodeBookVLA, a 250M-parameter VLA that decouples language understanding, planning, and control through learned discrete interpretable codes. A text encoder maps the instructions to shared step codes, which a visual planner then converts into action code sequences executed by a language-independent actor. This design improves robustness to instruction paraphrasing while allowing failures to be traced to individual stages. It also enables efficient real-time control on resource-constrained hardware by encoding instructions only once and using compact discrete representations to keep each component lightweight. CoBoVLA achieves 91.4\% success on LIBERO-Goal, compared with 82.8\% for SmolVLA, under a matched protocol, with 17 ms per control step latency. On LIBERO-Para, it achieves 81.1\% across 4,092 unseen paraphrases and 78.5\% on matched episodes, compared with 36.5\% for SmolVLA LoRA fine-tuned on paraphrases. Without two-step demonstrations, CoBoVLA completes 48.8\% of 160 free-form two-step tasks. Finally, success reaches 91\% when instructions are correctly encoded but falls to 27.2\% otherwise, identifying language understanding as the main source of remaining failures. Together, these results demonstrate that decoupling language understanding and control can improve instruction robustness while making VLA failures easier to diagnose.

126. 【2611.22380】Leveraging Segmentation Representations for Efficient Classification: A Self-Configuring Framework Based on nnU-Net

链接:https://arxiv.org/abs/2611.22380

作者:Renjun Cai,Antonio Javier Gallego,Félix Fuentes-Hurtado

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:medical imaging, nnU-Net self-configuring method, nnU-Net workflow, segmentation, nnU-Net self-configuring

备注:

点击查看摘要

Abstract:We propose a self-configuring framework that extends the nnU-Net workflow to both segmentation and classification in 3D medical imaging. Building on nnU-Net's self-configuring method, the framework reuses representations learned by a segmentation model for image-level classification. Its encoder features and predicted segmentation probabilities are used by a lightweight classifier. Two information-sharing strategies are investigated. In the frozen-backbone branch, features are augmented with region-of-interest information, predicted foreground volume, and segmentation confidence. In the adaptation branch, the final encoder stage is partially fine-tuned for classification, with an auxiliary segmentation loss to preserve segmentation-related information. Additional five-fold experiments showed that more complex configurations did not consistently improve classification performance. On the public validation leaderboard, our selected framework achieved an Overall score of 0.8056. In the official FLARE 2026 Task 2 final evaluation, our framework ranked first overall, achieving the highest DSC, NSD, and AUROC across all four testing tasks, including two hidden testing tasks. Local inference measurements also remained below the challenge limits of $60 \mathrm{s}$ per case and $4 \mathrm{GB}$ GPU memory. These results demonstrate the practical value of reusing segmentation representations for classification while maintaining a simple and efficient framework.

127. 【2611.22368】Seeing What Still Holds: How Waiting Control Changes Cooperative Recovery

链接:https://arxiv.org/abs/2611.22368

作者:Kangjie Huang,Yucheng Xin,Xinchun Wang,Dong Liu,Yan Fan,Shuming Liu

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:reverse the ranking, holding, Changing, recovery, visual recovery methods

备注: 8 pages, 3figures

点击查看摘要

Abstract:Changing the holding reference during a fixed-duration wait can reverse the ranking of visual recovery methods. We introduce AuditEmbodied, a paired execution and trajectory evaluation framework that independently varies holding references and waiting duration while keeping recovery executors frozen. A 960-execution factorial on 20 initialization seeds compares CAD-feedback and landmark-based recovery from identical post-wait physical states within each holding and waiting condition. Protected completion requires successful recovery under the declared execution constraints. At a 1 s wait with registered wrist references, their protected completion counts change from 6/40 versus 19/40 under registered holding to 34/40 versus 22/40 under position-only holding. Trajectory analysis localizes the main separation to grasp formation: small observation-time target residuals precede large tracking errors. Joint diagnostics and controlled interventions characterize persistent tracking constraints. On fresh seeds, gradual position reanchoring improves CAD recovery's long-wait completion by 42.5 percentage points and reduces mean complete recovery time by 6.06 s relative to registered holding. Additional evaluations with pretrained policies, handover, and a mass-matched geometry characterize holding-reference sensitivity across executors and physical regimes. These findings establish holding reference as an explicit evaluation condition for comparing visual recovery performance.

128. 【2611.22360】Can Vision-Language Models Truly Understand Images? A Benchmark Beyond Commonsense Bias

链接:https://arxiv.org/abs/2611.22360

作者:Ling Lin,Heng Su,Xiangzeng Liu,Yang Bai,Congcong Zhu,Jingrun Chen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal large language, achieved impressive performance, large language models, large language, achieved impressive

备注: 10 pages

点击查看摘要

Abstract:Multimodal large language models (MLLMs) have achieved impressive performance on a wide range of vision-language tasks. However, it remains unclear whether their predictions are grounded in the visual content itself or are largely driven by statistical co-occurrence patterns and commonsense correlations learned from large-scale image-text corpora. Existing vision-language benchmarks predominantly consist of samples that conform to human commonsense, allowing models to achieve strong performance by exploiting dataset priors rather than genuinely understanding image content. To address this limitation, we present ContraSense, a systematically constructed benchmark for evaluating faithful vision-language understanding. ContraSense consists of carefully curated counter-intuitive image-text pairs that deliberately violate common expectations, substantially reducing the effectiveness of statistical biases and requiring models to rely on visual evidence for reasoning. We conduct comprehensive evaluations on a diverse set of representative open- and closed-source MLLMs. The results reveal a substantial performance gap between current MLLMs and humans: even the strongest closed-source model achieves only about 60\% accuracy, compared with 96.04\% for human participants. These findings demonstrate that current MLLMs still struggle with faithful visual understanding and highlight the need for more robust multimodal reasoning grounded in image content. The ContraSense benchmark is publicly available at this https URL.

129. 【2611.22355】SandBAR: A Band-Asymmetric Architecture for Underwater Image Restoration with Removable Frequency Scaffolding

链接:https://arxiv.org/abs/2611.22355

作者:Yanzi Liu,Haoran Hou,Jiachi Tong,Shen Chen,Shuang Chen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:high-frequency detail loss, local high-frequency detail, turbidity degrade underwater, degrade underwater imagery, complementary frequency tendencies

备注: Accepted to WACV 2027. Camera-ready version. 9 pages, 6 figures

点击查看摘要

Abstract:Light scattering, absorption and turbidity degrade underwater imagery through complementary frequency tendencies: large-scale, channel-dependent appearance distortions and local high-frequency detail loss. This band asymmetry motivates different forms of restoration for global colour and local structure. Our primary contribution is SandBAR, a novel unified band-asymmetric architecture for underwater image restoration. Rather than treating frequency processing as an isolated module, SandBAR organises the restoration pipeline around band asymmetry at the block, encoder and objective levels. Within this architecture, we introduce a novel band-asymmetric sandwich block with a reserved post-attention repair slot and the Split-band Parallel Asymmetric Repair Kernel (SPARK), a novel module that applies channel-aware large-support correction to the low band, which predominantly carries large-scale appearance distortions, and lightweight local refinement to the detail-bearing high band, thereby restoring global colour while preserving fine structure. To deliver the global cast to the depth at which the network represents global structure, a learnable low-frequency guidance path injects a low-pass view of the input into the deep encoder, and a three-scale spatial-frequency objective supervises the same axis throughout the decoder. Building on the reserved post-attention slot, we further introduce Post-attention Scaffold Training (PaST), a novel removable nonlinear scaffolding scheme that trains the permanent SandBAR graph under band-specific capacity and runs it at inference without that capacity. SandBAR reaches 29.89 / 28.92 / 22.77 dB on EUVP / LSUI / UIEB and establishes a new three-domain mean state of the art on the benchmark family, exceeding the strongest published result by approximately 1.0 dB. PaST adds no parameters or FLOPs at inference and preserves matched latency.

130. 【2611.22351】Scaling Laws for Vision-Language Fusion

链接:https://arxiv.org/abs/2611.22351

作者:Seng Pei Liew,Teppei Suzuki,Seiya Tokui

类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词:combining multimodal perception, central foundation models, foundation models combining, emerged as central, central foundation

备注:

点击查看摘要

Abstract:Vision-language models (VLMs) have emerged as central foundation models combining multimodal perception with text comprehension. While VLMs are traditionally built via late fusion by continued pre-training an off-the-shelf language model on multimodal (image-text) data, mixing modalities from the start of pre-training (early fusion) has recently gained traction. However, the fundamental trade-offs between these paradigms remain poorly understood, resulting in expensive and heuristic-driven training recipes. In this paper, we systematically analyze the learning dynamics of these multimodal pre-training processes, showing that validation losses during vision-language fusion can be modeled by separating the base learning trajectory, where different data types contribute at distinct rates, from a distribution shift driven by the competition between modalities. We derive a scaling law that unifiedly describes these dynamics, enabling accurate loss predictions across mixture ratios, training steps, and model sizes. Crucially, our law characterizes the trade-off between early and late fusion: under a fixed data budget, early fusion preserves text performance while late fusion favors vision performance, yielding a trade-off that increasingly tilts toward early fusion as model size scales. Extensive experiments confirm that our scaling law reliably captures multimodal learning dynamics and governs fusion decisions.

131. 【2611.22345】herMark: Instance-Level Watermark Authentication Against Cross-Instance Transplantation

链接:https://arxiv.org/abs/2611.22345

作者:Jin Wei,Rundong Li,Li Ma,Yikai Wang,Ruihao Yang,Jianxiong Wu,Xiaoyuan Duan,Yanbo Wang,Runyu Mao,Chen Fang,Chang Xu,Ping Chen,Jun Dai,Xiaoyan Sun

类目:Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

关键词:Robust watermarking, geometric distortion, decodable after compression, generative editing, watermarking is commonly

备注:

点击查看摘要

Abstract:Robust watermarking is commonly verified by asking whether a hidden payload remains decodable after compression, geometric distortion, or generative editing. Localized and semantic extensions may additionally check whether an expected region or category is still present. These tests establish evidence validity or content consistency, but not whether the evidence still belongs to the particular visual instance registered by its owner. We expose cross-instance transplantation: an attacker extracts or estimates valid watermark evidence from one registered image and transfers it to a different image of the same category. The message can still decode, the expected content can remain present, and the result can look natural, even though the evidence has been reassigned to the wrong instance. To enable instance-level watermark authentication, we introduce TetherMark, a post-hoc watermark that combines two complementary checks. The message check verifies an edit-robust payload, while the relation check uses secret patch-pair selection, a registered response, natural correspondence transport, and enrollment normalization to test consistency with the registered instance. The verifier accepts only when both checks pass. Across 240 test subjects, TetherMark attains 92.08% legitimate true acceptance with 9.17% and 16.25% attack success under WmForger and WMCopier, respectively, yielding the highest instance-binding balanced accuracy under both attacks.

132. 【2611.22343】PURE: A Diagnostic Benchmark for Multi-Granularity Multimodal Identity Matching

链接:https://arxiv.org/abs/2611.22343

作者:Hengyu You,Xintong Wang,Jin Cao,Liang Ding

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:target granularity, answer depends, matching, records denote, Identity matching

备注:

点击查看摘要

Abstract:Identity matching asks whether two records denote the same identity, yet the answer depends on the target granularity. Two records may match at the base level but not at the variant level: they share an underlying design while differing in attributes such as color or size. Final matching accuracy does not separately characterize the capabilities involved. To study this problem, we use e-commerce as a challenging real-world domain. We introduce PURE, a diagnostic benchmark for multi-granularity multimodal identity matching covering four capability dimensions: Perception, Understanding, Reasoning, and Evidence-grounded Judgment. The benchmark comprises 1,457 multiple-choice questions across 14 tasks, derived from real-world matching pairs and verified by two domain experts. Across ten recent MLLMs, overall scores range from 47.1% to 86.0%. Understanding receives the highest mean score and Judgment the lowest, with weaknesses in visual difference localization and variant-level rule judgment. Modality ablations show that models benefit from multimodal evidence but can incorrectly identify conflicts between matching records. In direct matching, most models recognize matching pairs more reliably than non-matching pairs at the base level, whereas the reverse holds at the variant level. PURE therefore reveals what aggregate matching accuracy hides: not only whether models judge a pair correctly, but where they struggle to interpret evidence and apply matching criteria.

133. 【2611.22331】DAP-MR: Degradation-Aware Prompt-Magnitude Routing for Real-World Ultrasound Super-Resolution

链接:https://arxiv.org/abs/2611.22331

作者:Ngoc-Hoang-Lam Le,Thi-An Le,Dinh-Hung Le,Manh-Hung Nguyen,Kai-Lung Hua,Ching-Chun Huang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:relying on semantic, unreliable results, semantic text prompts, designed for natural, lead to unreliable

备注:

点击查看摘要

Abstract:When super-resolution models designed for natural images are used on ultrasound scans, relying on semantic text prompts can lead to unreliable results. The tags these models generate often do not match the actual restoration needs, and specialized medical terms may be misunderstood by general-purpose text encoders. Instead, prompts focused on common image degradations are more directly useful for guiding restoration. However, using a single prompt to describe both the type and severity of image degradation can entangle these factors, making it hard for the model to know how strong the degradation is. To address this limitation, we introduce Degradation-Aware Prompt--Magnitude Routing (DAP-MR). Each degradation type is represented by a dedicated token initialized from the contextualized EOS embedding of a degradation-oriented prompt and subsequently adapted during ultrasound SR training. A separate magnitude router predicts a continuous, input-dependent magnitude that modulates the corresponding token. Thus, language provides a degradation-aware initialization for what should be restored, while magnitude routing supplies an explicit signal for how strongly it should influence restoration. DAP-MR can be added to both one-step and multi-step diffusion super-resolution frameworks without changing their core structures. Our experiments--on synthetic datasets with both in-domain and under anatomical-domain shift, as well as unpaired real-world ultrasound data--show that DAP-MR delivers better restoration quality and generalizes more consistently across different domains.

134. 【2611.22329】M$^3$-Test: Coverage Gaps in Joint-Perturbation Testing of Visual Question Answering

链接:https://arxiv.org/abs/2611.22329

作者:Enhui Wan,Xiaowan Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:visual question answering, image-only and question-only, VQA, question answering, Qwen questions

备注:

点击查看摘要

Abstract:A visual question answering (VQA) model can pass every image-only and question-only test yet fail when the same changes occur together. Standard robustness reports average over conditions and therefore cannot say which accepted requests remain vulnerable. We introduce M3-Test, a coverage audit that aligns each clean input with its single-modality variants and a complete 5x5 family, 4x4 strength joint library, so that any reduced test suite can be replayed on the same requests. Across 2.6 million responses from four vision-language models, joint failures affect 26-29% of the Qwen questions that pass all 40 single-modality tests, although fewer than 0.6% of their joint records fail. Passing the 25 maximum-strength corners does not close this gap: 11-14% of the accepted questions still fail elsewhere in the library. Re-executing the archived failures reproduces about 90% of them, against a 0.3-0.6% flip rate among matched passing controls, and re-checking the most fragile failure records supports 80-89% of them. On the evidence examined, neither execution noise nor grading error can fully account for the gap. The same aligned grids make previous evaluations reusable. On held-out images, a risk order learned from other models discovers about 80% of affected Qwen questions within 25 additional queries, compared with 65-68% for maximum-first and 53-57% for pairwise covering arrays. M3-Test thus turns a passing robustness suite into a request-level account of what remains untested, supporting acceptance, regression review and test allocation.

135. 【2611.22318】Breaking Visual Conventions: Spectrally Coupled Weight Perturbation for Creative Image Generation

链接:https://arxiv.org/abs/2611.22318

作者:Fu Feng,Ruoheng Zhou,Yucheng Xie,Xu Yang,Jing Wang,Xin Geng

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:familiar visual conventions, produce high-quality images, follow familiar visual, produce high-quality, follow familiar

备注:

点击查看摘要

Abstract:Text-to-image (T2I) models often produce high-quality images that follow familiar visual conventions, even in response to open-ended prompts such as ``a creative [CLS]''. Existing methods encourage novelty by exploring semantic conditions or modifying features and guidance during denoising. Pretrained weights offer a complementary source of creative variation, but unstructured perturbations can have little visual effect or degrade image quality. We introduce Coupled Spectral Perturbation (CosPert), a training-free method that targets attention projections in layers identified by a one-time sensitivity analysis. For each projection, CosPert uses a shared random transformation and its transpose to couple updates to the singular-vector factors while perturbing the spectral gains. A common relative budget calibrates the magnitude of weight changes across projections, and a sigmoid schedule concentrates their influence in early denoising and gradually attenuates them during refinement. CosPert provides plug-and-play creativity enhancement at inference time. Once the perturbations are prepared, sampling requires no auxiliary networks or additional model evaluations. On both FLUX.1 and Stable Diffusion 3.5, CosPert enhances visual creativity, producing more varied object structures while preserving category identity. Across 50 object categories, CosPert achieves the highest mean CREward among the evaluated methods while maintaining strong prompt alignment.

136. 【2611.22317】SIDUMN: Self-Supervised Image Denoising Under Symmetric Multiplicative Noise

链接:https://arxiv.org/abs/2611.22317

作者:Nyan Htet Naing,Gyeongha Hwang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Self-supervised denoising, symmetric multiplicative noise, mean-one symmetric multiplicative, symmetric noisier framework, Self-supervised

备注: 10 pages, 4 figures, 2 tables. Submitted to IEEE Signal Processing Letters

点击查看摘要

Abstract:Self-supervised denoising is challenging when the corruption is multiplicative and signal-dependent. In this letter, we propose SIDUMN, a symmetric noisier framework for self-supervised denoising under mean-one symmetric multiplicative noise. Given noisy observations and the noise law, the method samples an independent synthetic noise factor from the same law and constructs two complementary noisier images by applying the factor and its reflection about one. The denoising network is trained to predict one noisier image from the other, and at inference the reconstructions of $K$ such antithetic pairs are averaged. We show that the population target of the training loss is the clean conditional mean minus a multiplicative cross-term. We further prove that, for any trained network, antithetic averaging never increases the expected squared error of a single noisier-input reconstruction. Numerical results validate the theoretical findings and the proposed method.

137. 【2611.22314】Inertial Video World Models

链接:https://arxiv.org/abs/2611.22314

作者:Yuan Gao,Fan Xu,Yu Guo,Yuxu Lu,Zhengru Fang,Hao Wu,Xiaomeng Huang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Video World Model, video world, Inertial Video World, physical world, video world models

备注:

点击查看摘要

Abstract:The physical world has inertia: it evolves from what already exists rather than being recreated at every instant. However, many existing video world models lack an explicit mechanism for inertial state evolution, leaving the continuity of motion and structure implicit in video prediction. During autoregressive rollouts, repeated reconstruction can accumulate errors and destabilize the predicted dynamics. To address this limitation, we introduce InertialWorld, an Inertial Video World Model that makes inertia a structural prior for autoregressive prediction: existing scene evidence is carried across time rather than reconstructed at every step. Central to this formulation is Inertial Memory, which turns memory from passive predictive context into an evolving video state with two complementary views: a dense Eulerian grid preserves scene-aligned evidence, while persistent Lagrangian carriers bind local content to learned canonical coordinates. At each step, the model transports the carrier content according to action-conditioned motion, predicts the complete next video state from the transported carriers and dense grid, and uses a learned gate to combine transported and newly predicted content into the memory for the next step. Extensive experiments across multiple domains, including robot manipulation, 3D game simulation, and open-world navigation, demonstrate that InertialWorld achieves competitive autoregressive prediction performance against strong video world model baselines. Codes link: this https URL

138. 【2611.22304】Cross-Modal StateKV Injection for Communication in Multi-LLM Systems across Temporal Segments

链接:https://arxiv.org/abs/2611.22304

作者:Xiaoqian Zhang,Zhihao Zhang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:multiple multimodal language, multimodal language models, language models requires, understanding with multiple, multiple multimodal

备注: 9 pages, 4 figures, 5 tables. Equal contribution: Xiaoqian Zhang and Zhihao Zhang

点击查看摘要

Abstract:Video understanding with multiple multimodal language models requires a communication interface that can transfer complementary visual observations. Text-based communication is interpretable, but introduces an intermediate generation stage and can omit information relevant to subsequent reasoning. We study Cross-Modal StateKV Injection, a provider--carrier framework that communicates through key--value (KV) states at visual-token positions. Provider models observe complementary video frames; their visual KV states are aligned and projected into the carrier representation space and integrated through gated residual updates. Injection preserves the carrier KV-cache sequence length, while retaining the additional computation required by the providers and the communication module. The reported experiments on MLVU and Video-MME compare carrier-only inference, text-based communication, and StateKV with two provider architectures. Results show modest, task-dependent accuracy gains and lower reported latency than the evaluated text-communication baseline, with some categories remaining unchanged or decreasing. Increasing provider-side frame coverage offers additional gains on selected tasks without extending the carrier cache. These findings motivate further study of visual KV communication under explicitly controlled observation and computation budgets.

139. 【2611.22294】Perception into Imagination: Executable Memory for World Models

链接:https://arxiv.org/abs/2611.22294

作者:Xianyao Li,Ruitong Tian,Rui Min,Fang Xu,Jing Du

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:contact is lost, touched after visibility, visibility or contact, Physical agents, EPM

备注: 18 pages, 6 figures, 15 tables

点击查看摘要

Abstract:Physical agents must use what they previously saw or touched after visibility or contact is lost. Their actions change the implications of these remembered facts. We introduce executable perceptual memory (EPM), a world-model framework that advances explicit perceptual state alongside neural latent dynamics during imagination. Its evolving read-out informs reward prediction, value estimation and policy learning. We align reward inputs with the transitions that produced them and supervise the reward head on open-loop rollouts of recorded actions. On Memory Maze $13\times13$, EPM reaches 30.37 return at 1M interactions, compared with 23.37 when the same evolving read-out informs only policy and value on a common perceptual front end: a gain of 7.00 [3.80, 10.21]. The complete method also improves control on $9\times9$ and in MiniWorld. Probes of remembered, out-of-view arrivals show stronger reward anticipation in both visual implementations. Concentration, tactile recovery and real tactile frames demonstrate complementary roles of remembered facts in imagined-policy training, motion-dependent decisions and sensory-content retention. EPM connects persistent perception to the predicted consequences and learning signals of a world model for Physical AI.

140. 【2611.22287】Decoding Without a Decoder: Direct Pixel Prediction from Diffusion Transformers

链接:https://arxiv.org/abs/2611.22287

作者:Hansheng Chen,Shengqu Cai,Jan Ackermann,Rayhan Zirvi,Gordon Wetzstein,Xinchen Yan,Leonidas Guibas

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:map denoised latents, DWD head, DWD, diffusion models rely, adding complexity

备注: Project page: [this https URL](https://hanshengchen.com/dwd)

点击查看摘要

Abstract:Latent diffusion models rely on a decoder to map denoised latents to pixels, adding complexity and inference cost. We introduce Decoding Without a Decoder (DWD), which lets a finetuned diffusion transformer produce final pixels directly through a linear head. Unlike previous methods, where the denoising output leads to final pixels, DWD separates the two roles: the original denoising head continues to drive sampling, then the new DWD head predicts the pixels at the final step. We extend pretrained latent models with DWD efficiently by finetuning only the last few transformer blocks, training the DWD head with pixel quality losses while anchoring the denoising head to the pretrained model to preserve the sample trajectory. Across latent image and video generators, DWD removes the decoder and reduces inference cost while maintaining or even improving pixel quality. On Wan video generation, it visibly reduces detail distortion and flickering, lowering warping error by 23%. Remarkably, the same separation also improves pixel diffusion models that do not even use a decoder: a final-step DWD head produces substantially better texture detail in text-to-image generation, and improves ImageNet FID from 1.55 to 1.43, a new state of the art among pixel flow models.

141. 【2611.22275】Heave-Ho: Decentralized Long-Horizon Multi-Humanoid Collaboration

链接:https://arxiv.org/abs/2611.22275

作者:Ting-Hsuan Chen,Siheng Zhao,Han Jiang,Qi Pan,Louison Lu,Jiaheng Luo,Henghui Bao,Yiyu Chen,Quan Nguyen,Yue Wang

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:promises to extend, individual robots, extend humanoid capabilities, Collaboration promises, coherent long-horizon planning

备注: 18 pages, 11 figures, 7 tables. Project page: [this https URL](https://heaveho-humanoid.github.io/)

点击查看摘要

Abstract:Collaboration promises to extend humanoid capabilities beyond what individual robots can achieve. However, realizing this potential requires coordinated whole-body interactions, coherent long-horizon planning, and precise synchronization across robots. We introduce Heave-Ho, a decentralized framework for long-horizon collaborative multi-humanoid loco-manipulation. At the low level, we develop a multi-agent post-training framework that adapts a humanoid foundation tracking model to physically coupled interactions between humanoids, enabling coordinated decentralized control from local observations alone. At the high level, we train a vision-language planner and design a speech-based leader-follower coordination mechanism to synchronize decentralized execution without network communication. Trained with two identical humanoids, our system scales to teams of up to ten robots and generalizes to heterogeneous teams without retraining. To benchmark these capabilities, we introduce HH-Bench, comprising 12 tasks involving teams of 2 to 10 humanoids, including heterogeneous teams. Systematic evaluations show that Heave-Ho consistently outperforms baseline methods, while real-world experiments demonstrate robust decentralized collaboration across challenging tasks.

142. 【2611.22273】SARVIA: Fast-Adapting the Strong SAR Foundation Models That Are Already in Your MLLMs

链接:https://arxiv.org/abs/2611.22273

作者:Yuxuan Li,Zichen Tian,Qianru Sun

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Synthetic aperture radar, all-weather Earth observation, Synthetic aperture, all-weather Earth, provide transferable representations

备注:

点击查看摘要

Abstract:Synthetic aperture radar (SAR) foundation models provide transferable representations for diverse perception tasks in all-weather Earth observation. However, their development often relies on costly large-scale SAR pretraining, raising the question of whether such extensive domain-specific pretraining is necessary. We find that modern multimodal large language models (MLLMs) already provide visual encoders that can outperform dedicated SAR foundation models as downstream initializations. This motivates a new paradigm: reuse general visual capabilities and devote domain training to brief specialization. We therefore introduce SARVIA, an adaptive post-pretraining method that specializes modern MLLMs using self-supervised visual questions with computable answers. These questions are constructed from unlabeled observations through general image tasks that capture spatial relations and SAR-specific tasks that exploit native measurements and SAR--optical correspondence. A shared answer-prediction objective jointly trains low-rank adapters across visual and language components, with loss-driven task sampling. We then export the adapted visual encoder as a standalone backbone. With 600 adaptation steps and 2 GPU-hours, SARVIA outperforms the compared foundation models on all six SAR detection and segmentation benchmarks. Compared with dedicated SAR pretraining, SARVIA reduces domain-training costs by orders of magnitude while improving visual transfer across architectures and scales. This new paradigm shifts the emphasis from repeated, costly pretraining to a reusable specialization process that can benefit from advances in open MLLMs. Dataset and code: this https URL.

143. 【2611.22246】Multispectral-Polarization-Infrared Multi-Aperture Camouflaged Vehicle Detection

链接:https://arxiv.org/abs/2611.22246

作者:Shu Wang,Xiong Lin,Yuan Song,Junjie Wang,Feng Huang,Wenxi Liu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:camouflage suppresses discriminative, suppresses discriminative cues, challenging because camouflage, camouflage suppresses, suppresses discriminative

备注: 14 pages, 10 figures

点击查看摘要

Abstract:Camouflaged vehicle detection is challenging because camouflage suppresses discriminative cues across sensing modalities. Existing multimodal methods often require precise pixel-level registration and feature-level fusion, creating a trade-off between accuracy and latency. We propose a spectral-polarization-infrared tri-modal detection framework co-designed with a multi-aperture imaging setup to exploit complementary imaging physics. A consensus-guided decision-level fusion strategy combines cross-modal detections within bounded registration tolerances, reducing dependence on precise alignment while maintaining accuracy and real-time performance. We construct a tri-modal camouflaged vehicle dataset containing infrared, polarization, and spectral data. Experiments show that the proposed method achieves 82.7% mean Average Precision (mAP) with an end-to-end latency of 16 ms, outperforming representative feature-level fusion approaches. On the public MID-1K dataset, the framework generalizes to RGB-Depth-Infrared modalities without architectural modification and improves mAP@0.5 by 5.7% over state-of-the-art methods. These results demonstrate the potential of decision-level consensus fusion and multi-aperture sensing for robust and deployable camouflaged vehicle detection.

144. 【2611.22244】PhyVGGT: Feed-Forward Articulated Object Reconstruction from Monocular Videos

链接:https://arxiv.org/abs/2611.22244

作者:Qi Shao,Zhihao Cao,Shuhao Zhai,Anh Nguyen,Hong Liang,Baoru Huang,Liang Li

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:interactive digital twins, Reconstructing an articulated, digital twins, articulated object, essential for robot

备注: 10 pages, 5 figures, 7 tables. Project page: [this https URL](https://phyvggt.github.io)

点击查看摘要

Abstract:Reconstructing an articulated object with its 3D movable parts, joint parameters and unseen articulation states from an uncalibrated monocular video is essential for robot manipulation and interactive digital twins. Existing per-scene optimisation methods require minutes to hours and external depth or camera poses, whereas feed-forward 3D foundation models reconstruct dense point maps in one pass without segmenting movable parts or inferring joints. Even on these monocular point maps, regressing or fitting continuous joints directly fails on casual videos, since cross-frame attention blurs moving part boundaries in deep layers, underestimates motion along the viewing ray and leaves continuous axes ill-conditioned under small opening angles. To address these challenges, we propose PhyVGGT, a single-pass framework on a frozen 3D foundation model that anchors moving-part matching and closed-form joint estimation to the undistorted geometry of the stationary base. First, our Part and Motion Decoder fuses intermediate per-frame tokens with global tokens and references part queries to a static-base query to segment 3D parts, align point maps on the static base and predict learned Bingham priors. Second, our Kinematic Inference Layer fits an orthogonal Manhattan frame to static surface normals, selects the joint axis in closed form under a Bingham posterior combining pairwise motion scatter with the learned priors, and solves a linear system for the hinge pivot to drive unseen states. Trained solely on synthetic data, PhyVGGT achieves state-of-the-art monocular performance across five benchmarks, outperforming FAMOS and monocular ArtiPoint, surpassing posed RGB-D ArtiPoint in median error, and running in 6.8 s per 48-frame video against hours of per-scene optimisation in Articulat3D. Project page: this https URL.

145. 【2611.22240】Cross3DGS: Unified Vulkan-Based 3D Gaussian Splatting Training from Workstations to Mobile Devices

链接:https://arxiv.org/abs/2611.22240

作者:Hiroyuki Sato,Yusuke Takimoto

类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词:Gaussian Splatting, CUDA workstation, wearable cameras, training, Splatting

备注: Accepted to the WACV 2027 Workshop on Eyes of the Future (EOF). 19 pages including appendix

点击查看摘要

Abstract:Scenes captured with handheld and wearable cameras are still shipped to a CUDA workstation for 3D Gaussian Splatting (3DGS) training. Training on the device that captured them, or on its companion phone or laptop, requires more than translating kernels: GPUs and drivers differ in parallel features, memory limits, and command submission, and these differences decide whether a training schedule executes and returns the correct update. We present Cross3DGS, a cross-vendor, cross-platform Vulkan trainer that keeps one optimizer and chooses its execution schedule per device in two steps: rules on device limits, workload size, and observed driver failures exclude the schedules known not to run correctly, and a fixed preference order selects one of the remaining feasible schedules. The same core completes standard-quality training (30k updates, one million Gaussians) on every configuration we measured, spanning NVIDIA, Intel, Arm, Qualcomm, AMD, and Apple GPUs and including Android devices and an iPhone, whereas the existing portable trainers VkSplat and Brush do not run on some of the mobile GPUs. Averaged over 11 scenes on a workstation, Cross3DGS has higher quality than VkSplat with no significant difference in training time, and Brush reports about three times the training time at comparable quality. The final quality of Cross3DGS is nearly identical across devices. A mobile application turns a handheld capture into a viewable model entirely on the device.

146. 【2611.22235】CoSphere-SLAM: Multi-Agent Panoramic Gaussian Splatting SLAM with Spherical Loop Closure

链接:https://arxiv.org/abs/2611.22235

作者:Qi Shao,Zhihao Cao,Shuhao Zhai,Taoyu Wu,Zhuoxiao Li,Anh Nguyen,Long Hu,Xianzhi Li,Hong Liang,Baoru Huang,Liang Li

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Dense collaborative mapping, Dense collaborative, search and rescue, warehouse automation, single frame

备注: 9 pages, 4 figures, 7 tables. Project website: [this https URL](https://cosphere-slam.github.io)

点击查看摘要

Abstract:Dense collaborative mapping is essential for search and rescue, building inspection, and warehouse automation, where panoramic cameras capture the entire surroundings in a single frame. Unlike pinhole agents that share views only at similar headings, panoramic agents observe overlapping scenes at any 3D orientation, yet searching full rotations also produces mutually consistent false loop closures across distinct symmetric rooms. Moreover, continuous monocular scale drift splits rigidly merged maps at revisited surfaces, while depth noise at short baselines distorts loop translation directions. To address these challenges, we propose CoSphere-SLAM, the first multi-agent Gaussian splatting SLAM framework for panoramic cameras, whose spherical loop closure aligns spherical features over $\mathrm{SO}(3)$ via fast Fourier correlation across arbitrary orientations and rejects symmetric false closures through global $\mathrm{Sim}(3)$ consensus. Building on these closures, directional global optimization solves a per-keyframe $\mathrm{Sim}(3)$ pose graph with log-scale regularization to correct scale drift while separating optical-flow translation directions from depth-based magnitudes. Finally, omnidirectional Gaussian fusion transforms each Gaussian with its keyframe similarity and renders Gaussians at their maximum ray response to jointly refine poses and maps. Experiments on indoor and cross-session multi-agent panoramic benchmarks demonstrate that CoSphere-SLAM achieves state-of-the-art trajectory accuracy and rendering quality among single-agent and multi-agent methods. Project website: this https URL.

147. 【2611.22228】What Does Weight-Space Programming Add to Diffusion Editing? Program Construction versus Score-Guided Refinement

链接:https://arxiv.org/abs/2611.22228

作者:Zitian Gao,Jingyi Xu,Ziqi Han,Chengkai Lei,Ye Liu,Liangliang Shi

类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词:language model construct, model construct executable, construct executable weight, Weight-space programming, executable weight updates

备注: 25 pages, 7 figures, 13 tables

点击查看摘要

Abstract:Weight-space programming (WSP) lets a language model construct executable weight updates for another network. We study diffusion concept editing through an interface in which programs define training contexts, preservation constraints and update directions, while a shared numerical fitter selects their coefficients. We compare generated programs with published editors, a shared-panel hand-written baseline and budget-matched search over conventional edits on 24 TIMED test edits for Stable Diffusion 1.4. The preregistered rewrite pipeline shows no advantage over the strong baseline. In an exploratory comparison, one-shot Astra programs improve fresh-scene VLM joint success, which requires subject presence together with whole-image target matching, by +10.0 points over the shared-panel baseline, while CLIP relative match shows no detectable change. These programs organise adjustable directions around protected text-state subspaces. Probing and rewriting the Astra programs then raises CLIP by +6.2 points while joint success changes by -9.7. On a fixed 144-image sample, five additional evaluators give point estimates in the same directions under whole-image target matching; checks of subject-local change give less decisive differences. Together, these results identify useful behaviour in complete generated programs and show that score-guided revision need not preserve it: program construction and revision should be evaluated as distinct stages of a WSP pipeline.

148. 【2611.22224】RIDENT: Efficient Triple-Task Learning of Dehazing, Depth, and Uncertainty Estimation for Underwater 3-D Robot Visual Perception

链接:https://arxiv.org/abs/2611.22224

作者:Geonmo Yang,Younggun Cho

类目:Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词:inevitable light propagation, low color contrast, color contrast due, light propagation, suffer from blurry

备注: 13 pages. (c) 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

点击查看摘要

Abstract:Underwater visual systems often suffer from blurry textures and low color contrast due to the inevitable light propagation. These issues can significantly degrade the perception of stable robotic operations. In this paper, we introduce a novel learning-based sensing system that tackles the multidimensional vision tasks in underwater; concretely, we deal with image enhancement, depth estimation, and uncertainty for 3-D visual systems. Also, we propose a TRIDENT model in a fast and lightweight manner; TRIDENT consists of three parallelized decoders and one backbone structure for efficient feature sharing. In addition, it is designed to be trained to express complex parameterization. In experimental evaluation on several standard datasets, we demonstrate that TRIDENT significantly outperforms other existing methods on image enhancement and depth estimation. Despite performing three tasks, our model has better efficiency than the others for both memory size and inference time. Finally, our joint learning approach demonstrates robustness in feature matching and seamlessly extends from 2-D to 3-D vision tasks. Supplements are available at this https URL

149. 【2611.22222】ExplicitIR: Explicit Spatial Policy Fields for All-in-One Image Restoration

链接:https://arxiv.org/abs/2611.22222

作者:Dezhi Zhang,Shangrong Yang,Yudong Liang,Wenjian Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:recover clean images, clean images blindly, image restoration aims, aims to recover, blindly from inputs

备注: 13 pages, 10 figures, 4 tables

点击查看摘要

Abstract:All-in-one image restoration aims to recover clean images blindly from inputs with various degradation types and levels using a single model. However, the adaptation policy in most existing methods remains implicitly encoded in feature representations, leaving the restoration decision neither explicitly represented nor independently controllable. Since real-world degradations vary spatially, applying uniform updates across the entire image leads to over-smoothing of clean areas and under-correction of localized degradations. To address these limitations, we present ExplicitIR, which represents the restoration policy as two explicit per-pixel fields: Budget, which determines where and how strongly to update, and Style, which selects between narrow and wide context windows. Specifically, ExplicitIR incorporates a Spatial Policy Estimator (SPE) to predict these fields, explicitly representing the restoration policy and capturing spatially-varying degradations, which are then applied by Policy-Adaptive Decoder Blocks (PADB) through adaptive fusion of narrow- and wide-window responses, enabling independent control and precise local modulation. This design enables spatially-adaptive restoration in a single forward pass, without requiring task labels, prompts, or test-time degradation estimators. Extensive experiments on three-task and five-task benchmarks demonstrate that ExplicitIR achieves performance competitive with the strongest all-in-one baselines.

150. 【2611.22212】Joint-ID: Transformer-based Joint Image Enhancement and Depth Estimation for Underwater Environments

链接:https://arxiv.org/abs/2611.22212

作者:Geonmo Yang,Gilhwan Kang,Juhui Lee,Younggun Cho

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:challenging task due, degrade image quality, limit visibility, underwater images, challenging task

备注: 11 pages. (c) 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

点击查看摘要

Abstract:Underwater imaging is a challenging task due to factors such as scattering, absorption, and turbulence, which degrade image quality and limit visibility. In this paper, we propose a novel approach for enhancing underwater images that leverages the benefits of joint learning for simultaneous image enhancement and depth estimation. We introduce Joint-ID, a transformer-based neural network that can obtain high-perceptual image quality and depth information from raw underwater images. Our approach formulates a multi-modal objective function that addresses invalid depth, lack of sharpness, and image degradation based on color and local texture. We design an end-to-end training pipeline that enables joint restoration and depth estimation in a shared hierarchical feature space. Additionally, we propose a synthetic dataset with various distortions and scene depths for multi-task learning. We evaluate Joint-ID on synthetic and standard datasets, as well as real underwater images with diverse spectra and harsh turbidity, demonstrating its effectiveness for underwater image enhancement and depth estimation. Furthermore, we demonstrate the ability of Joint-ID to perform feature matching and saliency detection for visually guided underwater robots. Our proposed method has the potential to improve the visual perception of underwater environments and benefit applications such as oceanography and underwater robotics. Supplements are available at: this https URL

151. 【2611.22207】ARG-Avatar: Animation-Rendering Guidance for Efficient Feedforward Avatar Reconstruction

链接:https://arxiv.org/abs/2611.22207

作者:Jianjin Xu,Soham Dasgupta,Fernando De la Torre

类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词:Reconstructing animatable, augmented reality, important for applications, gaming and augmented, human avatars

备注:

点击查看摘要

Abstract:Reconstructing animatable 3D human avatars from images is important for applications such as gaming and augmented reality. Feedforward methods make avatar reconstruction accessible by reducing inference time to a few seconds, but recent approaches rely heavily on scaling model capacity, training data, and computation. We ask whether such scaling is necessary. To this end, we introduce ARG-Avatar, an efficient feedforward framework with only 68M trainable parameters that achieves SOTA reconstruction quality. Our key insight is that 3D animation and rendering already provide strong geometric correspondences that existing methods largely attempt to learn from data. In light of this, we design the Foreground Avatar Coordinate RoPE attention (FACRoPE) and Intermediate Token Rendering (ITR) pipeline to guide avatar tokens to attend to their corresponding patches. Experiments across multiple datasets show that ARG-Avatar consistently outperforms prior methods when using two or more input images. Compared with LHM++, ARG-Avatar uses approximately 9$\times$ fewer trainable parameters, 4.8$\times$ fewer training sequences, and 14$\times$ less training compute, while running 6$\times$ faster and achieving a 2.7 dB PSNR improvement on the out-of-distribution NeuMan benchmark.

152. 【2611.22200】MIRAGE: Motion Identity Reduction via Autoregressive Generative Encoding for Privacy-Preserving Skeleton-based Motion Data

链接:https://arxiv.org/abs/2611.22200

作者:Thomas Carr,Xujun Che,Depeng Xu,Shuhan Yuan,Aidong Lu

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Skeleton motion identifies, motion identifies people, movement style, raw coordinate space, identifies people

备注: 14 pages, 3 figures, 12 tables

点击查看摘要

Abstract:Skeleton motion identifies people through body proportions and movement style, and skeleton streams are increasingly passed to third-party analytics that run action classifiers trained on raw data. A prior adversarial anonymizer adds a per-frame residual in the raw coordinate space but sees one frame at a time; motion retargeting needs a target skeleton and complete sequences, which rules out online use. We present MIRAGE, a target-free, causal anonymizer that adds an identity-reducing residual to each incoming frame in the raw coordinate space, computed by attention over past frames. One causal, optionally windowed mask governs every attention in a rotary-position encoder-decoder, and key/value caches let the trained function run frame by frame; on all 56,578 NTU 60 sequences, batched and streaming outputs differ by at most 7.2e-6 m. Reported results use an unbounded window, so per-stream state grows with stream length. We evaluate against a passive adversary that applies raw-trained identity models and an adaptive adversary that trains on the anonymizer's output, treating the adaptive adversary as the headline, on NTU RGB+D 60 over five generator seeds, alongside the per-frame residual anonymizer of Moon et al. trained identically. When consumers retrain on the released data, MIRAGE keeps 83.9% action recognition (raw 89.1%; Moon et al. 88.7%) while a retrained identity classifier reaches 43.4% re-identification (RI) over 40 subjects, against 69.4% for Moon et al. and 75.4% on raw data. The strongest adaptive attacker still reaches 49.3% (chance 2.5%), so MIRAGE reduces identity leakage; it does not anonymize. Against raw-trained (frozen) classifiers, MIRAGE lowers RI below the strongest retargeting baseline (10.36% vs. 22.09%), but frozen action recognition falls to 37.04% (vs. 75.82%), so at full residual scale it is not a drop-in replacement for raw input to existing frozen models.

153. 【2611.22189】SRED: Sparse Regional Evidence Distillation Across Magnifications in Whole-Slide Imaging

链接:https://arxiv.org/abs/2611.22189

作者:Zhiyuan Yang,Jiahao Cheng,Vincent Quoc-Huy Trinh,Mahdi S. Hosseini

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:high-magnification whole-slide image, lower magnification reduces, magnification reduces computation, preserves tissue detail, computational pathology

备注: CVPR 2027 submission

点击查看摘要

Abstract:In computational pathology, high-magnification whole-slide image analysis preserves tissue detail but requires encoding many patches, whereas lower magnification reduces computation by covering a higher field of view per patch while sacrificing detail. Existing cross-magnification distillation matches features that often encode detail unreachable by low-magnification input, sometimes requiring slide-level labels that limit scalability. To address those issues, we introduce Sparse Regional Evidence Distillation (SRED), which transfers regional event occurrences that encode reachable high-level interactions between details without slide-level labels. We use a sparse autoencoder (SAE) to learn an event dictionary from 20x teacher features. Logical OR pooling records whether each event is detected in any spatially aligned patch, retaining both localized and shared evidence within the corresponding 5x region. A pretrained 5x encoder is fine-tuned to predict these regional targets without slide-level labels. Visual analysis identifies dictionary components responsive to recognizable histological patterns, supporting target interpretation. Compared with native 5x features, SRED improves average macro-F1 by 1.1 points across seven classification and grading cohorts and average C-index by 1.7 points across five survival cohorts. Runtime matches native 5x, with an average 11.58x speedup over 20x.

154. 【2611.22180】CueClash: Frontier Vision-Language Models Judge 3-D Relations Close to the Picture Plane

链接:https://arxiv.org/abs/2611.22180

作者:Soham Dan

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)

关键词:VLM, picture, maps, vision-language model, Gemini

备注:

点击查看摘要

Abstract:A vision-language model (VLM) can judge 3-D relations from the picture or from the ground layout. In photographs the two usually agree. We separate them with CueClash, rendered scenes in which the 2-D cue for each of five relations is right on exactly half the statements. The shortcut gap is accuracy when the cue is right minus accuracy when it is wrong. For Claude Opus 5.5, GPT-5.5 and Gemini 3.6 Flash at low reasoning effort it is +18 to +37 percentage points. It is +7 to +29 without two relations whose cue-wrong items are confounded with borderline cases or occlusion. Given ground coordinates and each relation's definition, they answer 99 to 100% correctly. Pixel measurements with camera depths remove most of the gap for objects fitting through openings. The failure lies in the step from the picture to the layout. The maps that the models draw of the scene from above mostly keep the depth order but, like the picture, shorten depth. GPT-5.5's maps stay close to a copy of the picture. Opus 5.5's and Gemini's maps undo about 0.6 of this shortening. Gemini's then shrink all depths by a further uniform factor. Opus 5.5 follows the picture mainly on fits, and its maps correct depth about as much as human observers of real scenes do. The three models also lose accuracy on CV-Bench photographs where a reliable 2-D cue misleads. In two open models the layout information reaches the language model, but their maps lose much of it.

155. 【2611.22169】Not All Evidence Is Admissible: Evidence Governance for Tool-Augmented Medical Agents

链接:https://arxiv.org/abs/2611.22169

作者:Runxun Zhang,Onofrio Antonio Catalano,Jinqiao Wang,Jingwei Wei

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:medical agents treat, tool output, evidence, reasoner, tools return

备注: 11 pages

点击查看摘要

Abstract:Tool-augmented medical agents treat whatever their tools return as evidence. We show that this default is costly: medical tools fail silently, and a frozen reasoner cannot ignore what enters its context, so many cases it would have answered correctly are flipped to wrong once tool outputs are added. We call this evidence hijacking. $\mathcal{V}$-information explains the phenomenon: the reasoner has lost the option to ignore, so a tool output can carry negative usable information, and moving the decision of what to keep outside the reasoner restores that option. The theory further shows that part of any filtering gain comes merely from letting the reasoner see less, and only selection by content lets it see better. Building on this, we recast tool-augmented reasoning as evidence governance, which separates deciding what counts as evidence from the reasoner that answers, and propose context-independent evidence governance (CIEG), the first medical agent framework that rules, after acquisition, on whether each individual tool output may enter as evidence. Every tool output is written as a card that can be checked against the raw input; an independent checker that sees only the input and the cards decides which cards become evidence; and the reasoner answers from the admitted cards alone, with no training anywhere. On medical question answering, fundus glaucoma screening, and chest X-ray pneumonia classification, it achieves the highest accuracy among models of comparable scale, and significantly outperforms state-of-the-art tool-using agents and multi-agent systems built on the same backbone at lower cost.

156. 【2611.22164】HandRSI: Recursive Self-Improvement for Hand Pose Estimation

链接:https://arxiv.org/abs/2611.22164

作者:Zhekai Wang,Luqing Luo,Wenhao Yao,Junjie Lu,Huanan Zhu,Feifei Gao,Yuhua Jiang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:misplace occluded hands, image border, misplace occluded, Egocentric, miss hands

备注: Technical report. 25 pages, 17 figures, 18 tables. Code: [this https URL](https://github.com/GinKenneth/Hand_RSI)

点击查看摘要

Abstract:Egocentric 3D hand pose estimators still miss hands at the image border, misplace occluded hands and jitter. Such failures are usually fixed by hand-written inference refinements and by fine-tuning, two interdependent steps that are tuned separately. We present HandRSI, a recursive self-improvement framework for a hand pose system that consists of a video estimator and its executable inference harness. In each round, coding agents refine the harness, and a change is accepted only if it improves a composite of all ten benchmark metrics on held-out data without significantly regressing any of them. The accepted harness then guides the estimator through selective distillation, which supervises hand presence and temporal consistency on frames without ground truth, while ground truth supervises pose. Since the updated estimator may change which refinements remain useful, the harness is re-validated on it. Starting from the released ACE-Ego-Hand model, five rounds reduce MPJPE-p by 35% on HOT3D and 11% on ARCTIC and roughly halve jitter. On HOT3D, HandRSI's MPJPE-p is 16% lower than that of ACE-Ego-Hand fine-tuned on the same ground truth. Under a unified protocol, it outperforms nine re-run published methods on all ten metrics of both benchmarks. Hypervolume selection on the accuracy-speed front yields Lite, Medium and Heavy systems running at 20.7 to 41.1 FPS. This report gives the full method, every stage of every round and the complete protocol. Code, evaluator, harnesses and weights are public.

157. 【2611.22158】Centroid Spectral Coupling: Implicit Alignment and Representation Diversity in Self-Supervised Learning

链接:https://arxiv.org/abs/2611.22158

作者:M. Hadi Sepanj,Benyamin Ghojogh,Saed Moradi,Paul Fieguth

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

关键词:Self-Supervised Learning, align augmented views, aims to align, align augmented, Centroid Spectral Coupling

备注:

点击查看摘要

Abstract:Self-Supervised Learning (SSL) aims to align augmented views while preserving representation diversity and preventing collapse. Existing non-contrastive methods often address these goals using multiple weighted loss terms. We introduce Centroid Spectral Coupling (CSC), a single-term SSL objective that implicitly couples view alignment, representation diversity, and collapse resistance. CSC constructs centroids from independently normalized augmented-view pairs and applies a ridge-based spectral objective to their uncentered second-moment matrix. Preserving centroid magnitudes encodes view agreement while encouraging balanced representation energy across spectral directions. We establish an exact decomposition into nonnegative alignment and spectral-imbalance components, characterize the geometry of global optima, and derive finite-loss guarantees for alignment and diversity. We also show that complete constant-output collapse is a strict saddle in normalized representation space. Experiments on CIFAR-10, CIFAR-100, and Imagenette show that CSC achieves the highest linear Top-1 accuracy among the evaluated non-contrastive methods on all three benchmarks, and the highest kNN Top-1 accuracy on both CIFAR datasets. A ridge-parameter sensitivity study reveals an empirical alignment--diversity trade-off: increasing $\kappa$ strengthens view alignment but reduces representation effective rank. These results show that a unified spectral objective yields competitive visual representations without explicit contrastive negatives or separately weighted alignment and diversity penalties.

158. 【2611.22152】Unsupervised Multi-modal Medical Image Registration via Invertible Translation

链接:https://arxiv.org/abs/2611.22152

作者:Mengjie Guo,Jinming Duan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:providing comprehensive information, Invertible Neural Network-based, Invertible Neural Network, image-guided therapies, Neural Network-based Registration

备注:

点击查看摘要

Abstract:In medical imaging, the alignment of multi-modal images plays a critical role in providing comprehensive information for image-guided therapies. Despite its importance, multi-modal image registration poses significant challenges due to the complex and often unknown spatial relationships between different image modalities. To address this, we introduce a novel unsupervised translation-based multi-modal registration method, termed Invertible Neural Network-based Registration (INNReg). INNReg consists of an image-to-image translation network that converts multi-modal images into mono-modal counterparts and a registration network that uses the translated mono-modal images to align the multi-modal images. Specifically, to ensure the preservation of geometric consistency after image translation, we introduce an Invertible Neural Network (INN) that leverages a dynamic depthwise convolution-based local attention mechanism. Additionally, we design a novel barrier loss function based on Normalized Mutual Information to impose constraints on the registration network, which enhances the registration accuracy. The superior performance of INNReg is demonstrated through experiments on two public multi-modal medical image datasets, including MRI T1/T2 and MRI/CT pairs. The code is available at this https URL

159. 【2611.22151】EgoHandWAM: Probing the Role of Hand Motion in Egocentric World Action Modeling

链接:https://arxiv.org/abs/2611.22151

作者:Kailin Wang,Haoxiang Jie,Yaoyuan Yan,Zhiyou Heng,Zhaosong Li

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:first-person camera, hand motion, recent hand states, Abstract, hand

备注:

点击查看摘要

Abstract:How much does hand motion tell us about what a first-person camera will see next? EgoHandWAM forecasts three-dimensional wrist and fingertip trajectories and a future visual feature from the current image and recent hand states. We train on 751,065 EgoDex windows using a frozen DINOv2 encoder. On held-out development sessions, the action-only model reduces two-second wrist endpoint error from 60.26 to 56.48~mm relative to a stationary forecast. It still underestimates long reaches. Adding future-feature supervision gives nearly identical trajectory accuracy. With the recorded hand history, the visual head reduces smooth L1 error by 1.32\% relative to copying the current feature. Shuffling histories across sessions erases this gain. In a separate four-task probe, adding recorded future displacements to observed context and future tracking-validity masks reduces visual-feature error by 3.93\%. Masks alone give little improvement. A trajectory predicted from the same observations adds little. On two simulated RoboTwin tasks, substituting aligned human examples for an auxiliary batch of robot examples gives no consistent increase in task success across three training seeds.

160. 【2611.22141】CEVA: Complementary Evidence Verification via Frame-Level Reorganization for Short-Video Fake News Detection

链接:https://arxiv.org/abs/2611.22141

作者:Wenshen Yang,Junfeng Hao,Jing Li,Decheng Liu,Yangkunfei,Shuyu Jiang,Haizhou Wang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:follow unfolding events, unfolding events, public to follow, follow unfolding, Short-video platforms

备注:

点击查看摘要

Abstract:Short-video platforms are now a common way for the public to follow unfolding events. Their rapid, visually persuasive format also makes fake news easier to spread. Unlike text-image posts, short-video news interleaves multiple modalities and changing scenes, making it difficult to identify which frames verify a claim. Existing detectors either pool sampled frames homogeneously or select them by text-frame similarity. Both overlook that aligned frames may repeat a misleading claim, whereas less dominant context may challenge it. We present CEVA (Complementary Evidence Verification Approach), to our knowledge the first short-video fake news detection framework to explicitly organize frames by their evidential roles before multimodal fusion. Its Dual-Branch Complementary Reorganization (DBCR) module separates explicit-alignment frames from candidate complementary-context frames, and cross-modal fusion with bidirectional contrastive regularization operates on the reorganized evidence. On FakeSV and FakeTT, CEVA achieves the best overall results among the compared methods. Under fixed frame budgets and backbones, DBCR outperforms uniform, random, and similarity-based selection and improves two structurally different detectors. Together, these results establish pre-fusion evidence organization as an effective and transferable component of short-video fake news detection.

161. 【2611.22132】DailyBrick: Language-Guided Synthesis of Brick Assembly Instructions

链接:https://arxiv.org/abs/2611.22132

作者:Hang Zhang,Qijian Tian,Yuan Xie,Xuhong Wang,Xin Tan

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词:LEGO models, shape generation, LEGO, LEGO model, LEGO models require

备注:

点击查看摘要

Abstract:Generating a LEGO model from a user request is more than a plausible 3D shape generation. LEGO models require physical support per brick, and each brick should be placed unblocked. Current methods address this issue by training an expert large language model. We reduce the problem of generating extremely long context on all brick connections to that of writing a program that builds LEGO models like a human, considering each intermediate step could be executed. We introduce DailyBrick , a multi-stage agentic system that produces a LEGO model together with a brick-by-brick assembly instruction for human building and robot assembly. We design a multi-stage harness with roles to help LLMs generate more effectively. A versioned construction SDK compiles multi-level decisions, from semantic subparts to individual bricks, into canonical operations. An external Meta-Reviewer agent replays and inspects the generated package, verifies the model and its construction process, identifies failures, traces them to the responsible stage, and routes them to bounded repairs or to editable candidates for later skill or tool updates. Extensive experiments demonstrate that DailyBrick generates LEGO models based on simple user requests better than recent agentic systems, and show its utility in downstream applications such as robot manipulations on model assembly from instructions and brick sets (this https URL).

162. 【2611.22131】LoCaR: Localized Canvas Retrieval With Frozen Vision-Language Model

链接:https://arxiv.org/abs/2611.22131

作者:Rahim Hossain,Dipanwita Saha,Ashirbad Mishra,Xinxin Shu,Svetlana Strunjas,Binbin Li

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:distinguish relevant images, represent small objects, represent small, local attributes, attributes that distinguish

备注: Zero-shot retrieval , Local Retrieval

点击查看摘要

Abstract:Whole image embeddings can under represent small objects and local attributes that distinguish relevant images for localized queries. We present LoCaR, a training free framework for localized text to image retrieval with frozen vision language models. LoCaR constructs and utilizes independent proposals (SAM2) focusing on the object so as to get a more localized representation that independently encodes each region using the frozen visual encoder. We further study paired-support adaptation as an optional residual that uses matched text region exemplars without updating the underlying encoders. We also introduce LOCFG, a Visual Genome derived benchmark designed to evaluate localized retrieval for smaller and more challenging referents. Across several vision language backbones, our results show that improving the region representation itself is the main source of gain.

163. 【2611.22126】xt-Guided Modality Correction for Open-Vocabulary Object Detection

链接:https://arxiv.org/abs/2611.22126

作者:Yu Quan,Dong Zhang,Ping Gong,Peng Huang,JinHui Tang

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:essential for detecting, OVD, Open-vocabulary object detection, Modality Correction Network, cross-modal alignment

备注:

点击查看摘要

Abstract:Open-vocabulary object detection (OVD) is essential for detecting objects beyond the categories seen during training. Establishing vision-language associations is crucial for recognizing unseen categories, while integrating complementary visual features across levels supports detection at different scales. However, existing methods often provide insufficient textual guidance for object regions, rely on limited cross-modal alignment strategies, and underuse complementary features across levels, limiting their ability to detect unseen categories and objects of varying scales. To address these limitations, we propose a Text-Guided Modality Correction Network (TMCNet) that incorporates textual guidance into region feature extraction, cross-modal alignment, and multi-scale decoding to strengthen region-category semantic correspondence and promote complementary feature fusion across levels. First, a text-guided modality encoder incorporates textual semantics into queries to guide regional feature aggregation, reducing semantic ambiguity in object representations. Second, a cross-modal alignment module strengthens the correspondence between region representations and category semantics through interactions between visual and textual features. Finally, a progressive text correction decoder combines a top-down pathway with lateral connections to progressively fuse text-guided deep semantic features with shallow visual features at the corresponding scales, preserving both semantic information and spatial detail for objects of different sizes. Experiments on two public datasets, COCO-OVD and LVIS-OVD, demonstrate that TMCNet achieves strong performance in open-vocabulary object detection using simple text queries as guidance. Extending TMCNet to open-vocabulary segmentation also yields performance gains, demonstrating its cross-task applicability and extensibility.

164. 【2611.22124】FrameSeg3D: Learned Local Frames for Segmenting Small Parts on High-Resolution 3D Scans

链接:https://arxiv.org/abs/2611.22124

作者:Xinwen Zhang,Tongyan Wang,Huawei Lin

类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词:Segmenting small parts, Segmenting small, part, poses three challenges, height and curvature

备注: 31 pages, 6 figures, 16 tables

点击查看摘要

Abstract:Segmenting small parts on high-resolution 3D scans, such as nails on hand scans and teeth on intraoral scans, poses three challenges: 1) each part covers a tiny fraction of the scan, 2) its boundary is only a subtle change of height and curvature, and 3) it faces its own direction. Existing methods fall into two groups, and both fall short. The first group processes the whole scan at once and sees each part too coarsely. Point and mesh networks must shrink the scan to fit in memory, so a small part keeps only a few of its points. Multi-view methods render images of the whole object, so each part fills only a few pixels and a tilted part is seen from the side. The second group first finds each part and then segments it up close. But these methods find the parts with knowledge about one kind of part, for example the shape of the dental arch for teeth. Such knowledge does not carry over to other kinds of parts. We find that accuracy is limited by how a part is seen, from which direction and at what scale, not by how many points land on it. We therefore present FrameSeg3D. It first predicts a local frame for every part, its center and the direction it faces, from a low-resolution view of the whole scan. It then segments the part in views around its frame normal at the scanner's resolution, so covering the whole scan no longer costs resolution. Because every part arrives centered, facing the camera, and at a fixed scale, one segmentation network can serve different kinds of parts and learn from few labeled masks. We test FrameSeg3D on two kinds of parts, nails and teeth. It outperforms state-of-the-art methods on hand scans (mean Dice 0.970 on nails) and on the Teeth3DS+ test fold (per-tooth IoU 96.5), with the most accurate tooth boundaries (boundary IoU 70.5).

165. 【2611.22117】RetiDual-Select: Reliability-Aware Specialist-Generalist Routing for Retinal OCT under Image-Quality Shift

链接:https://arxiv.org/abs/2611.22117

作者:Zihao Han,Philippe De Wilde

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:static ensemble errors, overturn correct decisions, ensemble errors, static ensemble, separating candidate fusion

备注: 4 figures, 4 tables, 42 references. Submitted to the IEEE for possible publication. Main article only; the separate Supplementary Information is not included

点击查看摘要

Abstract:Adaptive fusion can repair a static ensemble's errors, but can also overturn correct decisions. RetiDual-Select combines retinal specialist RETFound with the image encoder of the medical vision-language model MedSigLIP, separating candidate fusion, routing safety and predictive review. Calibrated product-of-experts (PoE) fusion is the static reference, a small gate proposes an alternative for each image, a validation-frozen harm guard decides whether that candidate may replace the reference, and a separate score prioritizes review. Static PoE reached the highest or joint-highest clean accuracy on all three datasets. At a clean 2% accepted-error target the review policy accepted 94.3% of Kermany-4 images at 99.89% selective accuracy, and 92.4% of OCT-C8 at 98.65%. Both branches were correct on 95.0% and 91.8% of clean images; only 4.4% and 6.2% had exactly one correct branch. Across 15 prespecified synthetic conditions, adaptive gains were concentrated in severe contrast reduction, where this routing opportunity widened roughly ninefold; percentile rescaling largely removed the effect, linking it to compressed dynamic range. In post-hoc validation-only analyses, gain was higher when the gate followed the more reliable branch, and a frozen guard cut the worst-condition OCT-C8 loss from 1.39 to 0.36 percentage points. Adaptive routing was useful when image quality created a reliability opportunity and the gate followed it; otherwise the system retained Static PoE or deferred for review. The findings are bounded by the synthetic perturbations evaluated and do not establish robustness to natural acquisition or scanner shift.

166. 【2611.22106】Diagnosing and Correcting Skin-Tone Color Casts in Ultra-Lightweight Photo Retouching Networks

链接:https://arxiv.org/abs/2611.22106

作者:Choulhyouc Lee

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:retouching model removes, Color casts, scene or camera, cast, ultra-lightweight retouching network

备注: Accepted to ACCV 2026. 32 pages including supplementary material

点击查看摘要

Abstract:Color casts are expected to come from the scene or camera, and a retouching model removes them. We report a case where the model leaves one: an ultra-lightweight retouching network renders human skin greener than the original because it under-restores the skin chroma that a degradation removes and, even on clean inputs, adds a small hue shift of its own. A common paired-data-free recipe, synthetic self-supervision (degrade high-quality images, learn to restore them), silently produces this cast while whole-frame PSNR/SSIM stay essentially unchanged. In a representative 6,825-parameter histogram-conditioned network, the cast appears in 52 of 70 portraits under a ground-truth-anchored, white-balance-free protocol. Both a histogram-conditioned and a CNN-conditioned network develop the cast under synthetic self-supervision, yet both are near-neutral in-domain when trained on MIT-Adobe FiveK expert pairs. Image-level objectives miss it: a global-mean green loss worsens the cast (52/70 to 57/70). With zero added parameters, our per-pixel, skin-masked, asymmetric green-excess loss reduces the cast to 1/70 across stratified skin tones (68.1% to 2.2% over the 70,000-image FFHQ corpus; 64.4% to 0.8% on held-out CelebA-HQ photos). In-domain FiveK PSNR/SSIM are unchanged (+0.13 dB, +0.004), at the cost of a small whole-frame CIEDE2000 increase (8.77 to 9.69) and a magenta over-correction where skin is nearly neutral (skin Delta a* -1.5 to +4.4 and CIEDE2000 5.6 to 6.4 on clean inputs): the loss targets the signed green-magenta axis, not total skin-color fidelity. The same loss suppresses the cast across three ultra-light architectures. A whole-frame green metric correlates with skin-region CIEDE2000 at the method level (Spearman rho = 0.89). The final network exports to a 35 KB TFLite model.

167. 【2611.22095】CueSplat: Learning to Schedule Sparse Deformation for Dynamic Gaussian Splatting on Edge Devices

链接:https://arxiv.org/abs/2611.22095

作者:Qingyuan Tang(1),He Zhu(1),Shixuan Sun(1),Anbang Wu(1),Jingwen Leng(1),Minyi Guo(1),Yu Feng(1) ((1) Shanghai Jiaotong University)

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:enables dynamic scene, dynamic scene rendering, enables dynamic, dynamic scene, Gaussian splatting

备注: 10 pages, 6 figures. Main paper only

点击查看摘要

Abstract:Deformation-based 4D Gaussian splatting (4DGS) enables dynamic scene rendering. However, evaluating deformation networks for all Gaussians at every frame is compute-intensive on edge devices. We find that Gaussian trajectories are often locally predictable, yet prediction reliability varies across Gaussians and time. Thus, we propose CueSplat, a post-training framework that exploits local temporal regularity while keeping the pretrained backbone frozen and retaining its Gaussian set. Specifically, CueSplat predicts Gaussian attributes from recent history and uses a lightweight learned router to select exact deformation updates within a scene-specific budget calibrated offline. Selection accounts for prediction reliability and rendering contribution. Selected indices are reused across nearby frames to reduce routing overhead, while selected Gaussians still receive exact updates each frame. To control accumulated prediction error, we use drift signals to schedule three consecutive full-deformation frames that rebuild the prediction history. Evaluated across four mainstream 4DGS algorithms, CueSplat achieves up to $6.74\times$ and $8.15\times$ speedups on Jetson AGX Orin and Orin NX, respectively, with a negligible quality drop (at most $0.16$ dB in dataset-average PSNR).

168. 【2611.22094】When AUC Meets Generative Reconstruction: A Unified Principle for Balanced Visual Representation Learning

链接:https://arxiv.org/abs/2611.22094

作者:Boyu Han,Qianqian Xu,Shilong Bao,Zhiyong Yang,Qingming Huang

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:Multimodal large language, require visual encoders, large language models, constructing semantically disentangled, Multimodal large

备注:

点击查看摘要

Abstract:Multimodal large language models (MLLMs) require visual encoders that extract fine-grained visual features while constructing semantically disentangled and discriminative representations. Conventional methodologies encounter a fundamental trade-off: contrastive learning enhances inter-class discrimination by suppressing intra-class variability, whereas generative reconstruction emphasizes perceptual fidelity but lacks explicit comparative supervision. The naive aggregation of these objectives via composite loss functions often induces optimization conflicts and instability due to gradient interference within the shared latent space. To resolve this, we introduce a unified representation-learning paradigm that reformulates generative reconstruction as a discriminative ranking problem within the generative output manifold. Our approach maintains perceptual reconstruction as a supervisory signal and integrates a ranking-based discriminative constraint by systematically ordering matched and mismatched reconstruction outputs. This formulation embeds discriminative information seamlessly into the generative process, alleviating the risk of loss competition. Specifically, we propose AUC Generative Reconstruction (AUCGR), which optimizes the area under the ROC curve (AUC) by ensuring higher scores for matched pairs than for mismatched pairs, and Partial AUC Generative Reconstruction (pAUCGR), which addresses supervision bias by focusing on mismatched comparisons within reliable feature subspaces. The proposed objectives are designed to be plug-and-play, requiring no architectural modifications to existing generative reconstruction frameworks. Theoretical analysis establishes rigorous connections to AUC/pAUC optimization and provides generalization guarantees. Extensive experiments validate that our method advances both discriminative accuracy and fine-grained perceptual representation.

169. 【2611.22084】When Lower Harm Misleads: Auditing Concept Corrections

链接:https://arxiv.org/abs/2611.22084

作者:Tianyou Lai,Wentao Yue,Hongji Li,Chaoyuan Hao,Qilei Li

类目:Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:BI-RADS descriptor, harm, breast ultrasound, expects the diagnosis, diagnosis to improve

备注:

点击查看摘要

Abstract:An expert who corrects a concept prediction, such as a BI-RADS descriptor in breast ultrasound, expects the diagnosis to improve. Objectives that reduce the harm of such corrections are judged by harm and accuracy, yet harm also falls when a model responds less to every correction or starts from a worse uncorrected prediction, the reference for harm. We propose a correction audit, a reproducible evaluation protocol that separates these explanations: it splits each correction into harm and useful gain on identical events, separates the starting prediction from the correction response, and compares objectives with amplitude baselines matched in source harm. On three breast-ultrasound sources, worst-case correction training, evaluated from the mean-case model's start, lowers harm but gives up more useful gain in all 21 source comparisons pooled over six seeds, raising the corrected negative log-likelihood (NLL); from the same start, selecting between the objectives by harm picks the less helpful model on all three sources. On CUB, a monotonic harm penalty at its reported weight lowers path-level harm in all 80 concept sets while raising the NLL in all 80, almost entirely before any correction. At a fixed start, rescaling both responses to the same source harm reproduces the penalty's mean harm, useful gain and NLL on single-concept corrections within a prespecified margin of 0.0005 nat, although the two responses point in different directions. Lower harm therefore signals better corrections only when it is read together with useful gain, absolute risk and the start it is measured from.

170. 【2611.22080】CRA: Continuous Risk Assessment for Safety-critical Visual Navigation

链接:https://arxiv.org/abs/2611.22080

作者:Lihao Zheng,Ying Wu,Chen Jiang,Randy Freeman

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)

关键词:Traditional safety-critical control, Traditional safety-critical, unsafe regions, rely on predefined, predefined constraints

备注: Project page: [this https URL](https://isaac-restaurant-cra.cra-demos.workers.dev)

点击查看摘要

Abstract:Traditional safety-critical control methods often rely on predefined constraints that separate states into safe and unsafe regions. While recent studies have extended geometric safety toward semantic safety, real-world safety is rarely purely binary. The risk associated with an object or human can vary continuously with its physical properties, like motion, and interaction context; for example, a person carrying a heavy object or a hot object moving at high speed may require a different safety response from an ordinary static obstacle. In this paper, we propose a vision-based continuous risk assessment framework for safety-critical visual navigation. Our method uses RGB and LiDAR observations to estimate four risk factors (kinetic, potential, contact-severity, and thermal) and combines them into a continuous risk score for each assessed object or person. These estimates are integrated into a Poisson safety function with a Laplace guidance field as a safety filter, enabling online monitoring and intervention in open-world robot navigation. We demonstrate the proposed method in a simulated restaurant scene.

171. 【2611.22076】Segmentation-Guided Direct Capacity Estimation of Rooftop Photovoltaics from Aerial Imagery

链接:https://arxiv.org/abs/2611.22076

作者:Guibin Chen,Emma Fan,Yuzhang Lin

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Distribution planners, spatially aggregated, planners need installation-level, installation-level inventories, interconnection records

备注:

点击查看摘要

Abstract:Distribution planners need installation-level inventories of rooftop photovoltaic (PV) capacity, but interconnection records may be incomplete or spatially aggregated. Conventional image-based estimators segment PV arrays, convert the mask to physical area, and multiply by an estimated power density, coupling capacity prediction to mask-derived area. We propose Direct Head, a segmentation-guided architecture that retains U-Net segmentation and soft-mask pooling while directly regressing nonnegative capacity from PV-region features and area descriptors. We evaluate three independent runs on 7,590 French rooftop installations under the original split and a department-based holdout. Relative to a parameter-matched area-density neural model, Direct Head reduces mean absolute error by 8.7% and 12.5%, and symmetric mean absolute percentage error by 14.0% and 20.7%, respectively. Comparisons with conventional estimators, controlled architecture variants, auxiliary-loss ablations, and representative cases show that segmentation provides useful spatial evidence without requiring capacity to be determined by an area-density product.

172. 【2611.22064】Data-Efficient Algal Bloom Segmentation in Freshwater Bodies Using a Three-Stage Transfer Learning Pipeline with Attention-Enhanced Decoding

链接:https://arxiv.org/abs/2611.22064

作者:Albert Ansah Benson,Mingqiang Han,Rahul Harsha Cheppally,Treman Singh Kaloya,Menard Soni,Sudan Baral

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Harmful algal blooms, threaten water quality, blooms threaten water, scarce pixel-level annotations, algal blooms threaten

备注: 10 pages, 5 figures, 6 tables

点击查看摘要

Abstract:Harmful algal blooms threaten water quality and public health, yet automated segmentation of bloom regions in freshwater imagery is limited by scarce pixel-level annotations. We present a transfer-learning pipeline that adapts a Swin Transformer U-Net with SCSE decoder attention from ImageNet-1K to water-body segmentation (RIWA, LaRS) and then to algal blooms, together with a model-assisted annotation protocol that expands the labelled algae corpus from 145 to 655 images. In a single-seed ablation on a 41-image validation split (checkpoint S2-A4 and its variants), corpus expansion is the dominant factor (+11 mIoU points); water-body pretraining helps only on the expanded corpus (+1.1 points over ImageNet initialization); SCSE attention adds 0.3 points; and a learnable positional encoding lowers mIoU by 0.6 points and is omitted. Adding 476 images, 188 of them algae-free, reduces false-positive area on non-water scenes from 22.6% to 4.9%. Against nine baselines on a 256-image test split, a separately trained checkpoint of the same architecture (S2-A13) reaches mIoU 0.919 and the highest algae IoU (0.902); a near-duplicate audit indicates train/test overlap in this split, so these scores are likely optimistic.

173. 【2611.22061】FM-Mamba: An Efficient Native 2D Selective State Space Model with Stability-Aware Discretization

链接:https://arxiv.org/abs/2611.22061

作者:Shengyuan Hu,Yiyong Sun,Weihang Shan,Yongzhe Chang

类目:ystems and Control (eess.SY); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:fixed input-independent factor, breaks spatial adjacency, fuse multiple scans, Mamba-based methods, discrete step unconstrained

备注:

点击查看摘要

Abstract:When applied to two-dimensional features such as images, Mamba-based methods either flatten the feature map into 1D sequences and fuse multiple scans, which breaks spatial adjacency and multiplies computation, or recurse directly on the 2D grid but rescale the recurrence with a fixed input-independent factor and aggregate only the predecessors on a single anti-diagonal, leaving the discrete step unconstrained by 2D stability theory. We propose \textbf{FM-Mamba}, a native 2D selective state space model built on the general Fornasini--Marchesini (FM) model. Its coupled recurrence evolves along both spatial axes; cross-axis coupling induces a discrete diagonal-predecessor term $\tilde A_0$, and two independent input-dependent step sizes $\Delta_1(i,j)$, $\Delta_2(i,j)$ govern propagation along the two axes, so that the coefficients adapt per position and per direction. A normalized ratio $r_k=a_{0,k}/(a_{1,k}a_{2,k})$ yields a closed-form piecewise bound on the two step sizes; when a configuration falls outside the stable interval the steps are projected onto this bound, and the criterion is re-verified per position after training, which suppresses systematic local amplification without global damping. The recurrence is executed by a dual-diagonal wavefront scan: each update gathers information from two anti-diagonals, and the input enters the current state through a single projection, so that neither training nor inference flattens the feature map. Code is available at this https URL

174. 【2611.22052】RiDEx: Reward-Informed Directional Exploration for Diffusion Reinforcement Learning

链接:https://arxiv.org/abs/2611.22052

作者:Song Yan,Chenfeng Wang,Wei Zhai,Xingchen Wang,Tao Zhang,Yawen Shao,Shi Pan,Min Li,Zheng-Jun Zha

类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词:Reward-based diffusion post-training, diffusion post-training updates, post-training updates model, updates model parameters, Reward-based diffusion

备注:

点击查看摘要

Abstract:Reward-based diffusion post-training updates model parameters from task rewards. While existing approaches improve sampling and policy optimization, they still rely largely on isotropic random perturbations in a high-dimensional latent space for exploration. Such variation often spends the perturbation budget on changes with little influence on the target reward, making exploration inefficient. We study where diffusion models should explore and how to learn from that exploration. We introduce Reward-Informed Directional Exploration (RiDEx), which concentrates local exploration in reward-relevant subspaces of the denoising velocity field. Conditional residuals or differentiable reward gradients propose the subspace, and equal-and-opposite perturbations at the same generation state measure its terminal reward response. The reward difference supplies signed local supervision in the explored coordinates, while all generated images contribute to global DiffusionNFT learning. RiDEx thereby couples exploration-space selection with feedback about the changes it produces. On Stable Diffusion 3.5 Medium, RiDEx attains the highest peak rewards among the evaluated methods on four alignment and preference tasks. Its gradient-direction instantiation achieves 15x and 29x target-attainment speedups over DiffusionNFT on HPSv2 and PickScore, measured in H200 GPU hours. Controlled experiments confirm that reward-aligned directions elicit stronger responses at equal perturbation magnitude, and that applying their measured credit improves curve-average reward across all four tasks.

175. 【2611.22028】BATMoS: Budget-Aware Guidance Allocation for Efficient Video Diffusion

链接:https://arxiv.org/abs/2611.22028

作者:Zhixu Du,Kuo Yang,Jingwei Sun,Hai "Helen" Li,Yiran Chen

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:diffusion model inference, model inference budget, inference budget depends, denoising trajectory, video diffusion model

备注:

点击查看摘要

Abstract:The effectiveness of a video diffusion model's inference budget depends on where computation is spent along the denoising trajectory. Across eight equal-budget inference configurations, VBench total scores span 4.80 points, highlighting the importance of explicit allocation design. Our key insight is that guidance evaluations are not equally valuable across diffusion time: retaining the sampling updates while selectively reusing guidance can preserve generation quality with fewer denoiser evaluations. We introduce BATMoS (Budget Aware Temporal Mixture of Strategies), which routes between fresh classifier-free guidance and cached guidance using a single pretrained denoiser. A magnitude-based temporal rule assigns guidance reuse to low-magnitude blocks and reserves fresh guidance for the remaining blocks, with a single integer controlling the computation budget. The resulting schedule requires no additional router training or per-budget threshold search. Evaluated on CogVideoX-2B with 4,720 videos per configuration across all sixteen official VBench dimensions, BATMoS achieves the highest total score among the eight allocation policies and comes within 0.10 points of full classifier-free guidance using 20\% fewer branch evaluations. BATMoS also composes with feature reuse, reducing computation from 80 to 62 effective branch evaluations with a 0.11-point decrease in total score. These findings make temporal guidance allocation a practical mechanism for extracting more generation quality from a fixed inference budget.

176. 【2611.22005】Where Should the Lamp Go? Ambient-Aware Lamp Placement for Portraits

链接:https://arxiv.org/abs/2611.22005

作者:Yuyan Chen

类目:Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词:shape first impressions, important factor, Portraits shape, light, portrait relighting

备注: 15 pages, 12 figures

点击查看摘要

Abstract:Portraits shape first impressions, and lighting is an important factor. Prior work, such as lighting estimation and portrait relighting, edits lighting after capture but does not guide where to place a light before the shot. This leaves an open question: where should a light go to best light a face? Therefore, we propose LightMatch, a preference-grounded inverse lighting framework that disentangles the controllable light from ambient illumination and optimizes its placement. We first learn a Bradley-Terry quality model from pairwise human judgments. A perception head then regresses spherical-harmonic lighting from frozen self-supervised features via cross-attention. Finally, a placement solver isolates the light via spherical-harmonic linearity and optimizes its reachable position. On held-out environments, LightMatch attains 87.8% of the oracle improvement, outperforming the conventional solver that ignores ambient light by a relative 28.4% and the same pipeline with the widely used DPR estimator by a relative 70.5%. It reaches 73.2% on real OLAT faces of unseen identities and, on our real captures, cuts lamp-direction error by 37.7%.

177. 【2611.21996】Beyond Appearance: Where Forest Visual Place Recognition Actually Fails

链接:https://arxiv.org/abs/2611.21996

作者:Blake Matheson,Ben McShanag,Isabella Moffat,Michael Milford,Peyman Moghadam,Dana Kulić,Somayeh Hussaini,Kavindie Katuwandeniya

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Visual place recognition, make distinct places, Visual place, forest environments remains, environments remains challenging

备注: 10 pages, 6 figures, accepted to the Australasian Conference on Robotics and Automation (ACRA)

点击查看摘要

Abstract:Visual place recognition (VPR) in forest environments remains challenging because repetitive vegetation, and changes in illumination, season, and viewpoint can make distinct places appear similar and revisited places appear substantially different. In this paper, we investigate whether temporal, linguistic, structural, and geometric context can improve on an appearance-only descriptor, and what limits each representation when it does not. Using MegaLoc as the appearance-based baseline on the WildCross benchmark, we evaluate score-space and descriptor-space sequence matching, vision-language captions and reranking, scene-graph representations, and depth-derived stem graphs across same-direction revisits, extended routes, and reverse traversals. On a same-direction revisit, both sequence matching strategies reach similar Recall@1 (94.1% vs. 91.5%), but recall at 100% precision rises from 50.9% (single-frame MegaLoc) to 71.6% in score space and falls to 36.5% in descriptor space. The remaining context representations provide no consistent improvement over the appearance-based baseline. Same-place captions show limited place-specific discrimination, reranking is constrained by the initial candidate shortlist, and stem-graph matching remains weak even with LiDAR depth.

178. 【2611.21995】Deciding Without Pointing: A Case Study of Whether a Decision Model Localizes the Anomalies It Detects

链接:https://arxiv.org/abs/2611.21995

作者:Hsiang-Hung Lee

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:probability per option, generating text, answer a typed, per-category image AUROC, backbone

备注: 12 pages, 5 figures, 14 tables. Preprint of the technical part of an MSc thesis (Politecnico di Milano). Code and pre-registrations are held privately until venue submission

点击查看摘要

Abstract:Decision models can answer a typed question about an image with a probability per option, without generating text. In our case study of Clef-flash (post-trained Qwen3.5-9B backbone) on industrial inspection benchmarks, we ask whether it localizes the anomalies it detects. We obtained uneven results with zero-shot detection: per-category image AUROC 0.924 on MVTec AD and 0.668 on MVTec AD 2. On the former, the decision head's routing attention produces 0.391 mean per-image pixel AUROC, and hiding the image tokens from it leaves detection unchanged. The multimodal LLM's backbone attention does point at the defect, however it falls below a center prior when we change question. It falls below chance if we remove textual context in the question, partly due to backbone attention leaving the object, while the head's map hardly changes. The backbone's states carry the location when probed with normal images, on the test-split images, however, the decision depends on the defect region. A larger model, Clef, that comes with a post-trained Qwen3.8-27B backbone, gives no useful map in the decision head either. We found that it's possible to recover anomaly location by asking question specifically on an image region, retraining the head or reading the backbone, but none matches dedicated few-shot localizers.

179. 【2611.21993】DEFTS: Data-Efficient, Training-Free Few-Shot Learning for CLIP in the Text Subspace

链接:https://arxiv.org/abs/2611.21993

作者:Yijin Zeng

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

关键词:Contrastive Language-Image Pre-training, Contrastive Language-Image, Language-Image Pre-training, achieves impressive zero-shot, achieves impressive

备注:

点击查看摘要

Abstract:Contrastive Language-Image Pre-training (CLIP) achieves impressive zero-shot image classification performance by comparing image embeddings against class-specific text embeddings. While recent few-shot methods leverage labeled training samples to improve upon this zero-shot baseline, they often predominantly rely on image embeddings and underutilize the semantic structure of the text embeddings. In this paper, we introduce DEFTS, a data-efficient, training-free few-shot classification method strictly in the text subspace. We first demonstrate empirically that while raw text embeddings can be suboptimal as direct classifiers, the linear subspace they span remains highly discriminative. DEFTS therefore proposes to reduce the image-text modality gap by projecting estimated image prototypes directly into this subspace. Importantly, by expressing these prototypes as linear combinations of text embeddings, DEFTS reduces a high-dimensional estimation problem to the derivation of just a few coefficients. These coefficients are then computed via a Bayesian posterior mean, using a prior naturally centered on the original text embedding coordinates. Extensive experiments across 12 image classification benchmarks demonstrate that DEFTS significantly improves upon existing training-free methods.

180. 【2611.21975】Pathology Randomization for Synthetic Priors and Zero-Shot Detection

链接:https://arxiv.org/abs/2611.21975

作者:Alexandra G. Roberts,Tonmoy Hossain,Mark Olchanyi,Stefan Brandstätter,Jonathan Williams Ramirez,Ana Lawry Aguila,Matthew Rosen,Annabel Sorby-Adams,W. Taylor Kimberly,Juan Eugenio Iglesias

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV)

关键词:Hospital brain imaging, imaging archives hold, brain imaging archives, Hospital brain, prospective studies

备注: 25 pages, 9 figures, 13 tables (8-page main text with appendices). Code: [this https URL](https://github.com/agr78/Pathology-Randomizer)

点击查看摘要

Abstract:Hospital brain imaging archives hold a diverse array of pathology at sample sizes beyond prospective studies, particularly for underrepresented populations and diseases. To unlock uncurated clinical data and scale analysis, methods are needed to detect abnormalities across contrasts and resolutions. Synthetic data has provided robust, contrast-agnostic models for a variety of human neuroimaging tasks in healthy anatomy, but pathology detection and other tasks in clinical settings still require real patient data, contrast-specific models, or disease-specific generators. We propose PathoDraw, a generative model of brain MRI with pathology. A conditional distribution of lesions given the healthy anatomy is drawn into the label map before contrast-agnostic rendering, and a single network estimates healthy anatomy with exact signed intensity deviation of any input scan. The contrast-agnostic 3D UNet learns the healthy labels under the lesion and the signed deviation directly and identifies pathology via robust tissue statistics and learned features, despite no training on real pathology. We show zero-shot detection on public stroke, tumor, and white matter hyperintensity datasets as well as archived clinical data, spanning $T_1$w, FLAIR and $T_2$w at various resolutions under a recent unsupervised anomaly detection benchmark protocol. Our single model exceeds or performs comparably to contrast-specific anomaly detectors trained on real scans and keeps healthy anatomy intact. The same generator trains networks for super-resolution and for registration in the presence of pathology. Our model, robust across acquisition and disease, enables the use of uncurated, archived data for clinical analysis. Our code is available at this https URL.

181. 【2611.21973】How Many Persistent Features Does a Biometric Need? A Law Linking Equal Error Rate to Feature Count and Persistence

链接:https://arxiv.org/abs/2611.21973

作者:Oleg Komogortsev,Mehedi Hasan Raju

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:biometric designer controls, mathrm, biometric designer, designer controls, Phi

备注:

点击查看摘要

Abstract:A biometric designer controls the number of features and their temporal persistence. Earlier empirical work linked the equal error rate (EER) to persistence and to the required number of features by straight lines. We derive the law behind these regularities. For $N$ independent standardized Gaussian features with test-retest correlation $\rho$, scored by cosine similarity, Fisher's $z$-transform turns the genuine and impostor scores into two normals, giving $\mathrm{EER}=\Phi(-\frac{1}{2}\sqrt{N}\,\operatorname{atanh}\rho)$ and, inversely, $N=(2q/\operatorname{atanh}\rho)^2$ with $q=\Phi^{-1}(1-\mathrm{EER})$; intercorrelated features enter through an effective count $N_{\mathrm{eff}}$. The central extension lets persistence vary across comparisons with spread $\tau$ on Fisher's scale: $\mathrm{EER}=\Phi(-m/(\sqrt{\tau^2+v}+\sqrt{v}))$ with $v=1/(N_{\mathrm{eff}}-2)$, which for a normal spread has a floor $\Phi(-m/\tau)$ that no number of features can lower. With no fitted parameter the simple law reproduces published simulations and the EER-ICC line, and predicts the KCC-EER relation of eye-movement embeddings on GazeBase ($R^2=0.88$), though less well on GazeBaseVR ($0.63$). Read from the genuine and impostor scores, the general form matches the EER of eye movements, keystroke dynamics, the ECG and face embeddings over 101 conditions with $R^2=0.98$ and a median error of $0.6$ points, against $0.87$ and $1.9$ points for the simple law. The 61 eye-movement, keystroke and ECG conditions check consistency on the same scores; the 40 face conditions use held-out subjects, with the same accuracy. The product $\tau\sqrt{N_{\mathrm{eff}}-2}$ gives a design rule: adding or decorrelating features pays fully while it is well below one and little once it exceeds about three, where only higher or more uniform persistence helps.

182. 【2611.21955】SCAN: Site-Aware Collaborative Privacy-Preserving Adaptation of Vision-Language Models for Neurological Disease Classification

链接:https://arxiv.org/abs/2611.21955

作者:Nikhil J. Dhinagar,Rishab Pendam,Harmony S. Cen,Sophia I. Thomopoulos,John P. John,Mahir H. Khan,Sook-Lei Liew,Erik Kaestner,Carrie McDonald,Paul M. Thompson

类目:Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

关键词:strengthen diagnostic foundation, diagnostic foundation models, Neurological Disease Classification, Worldwide neuroimaging data, prevent centralizing brain

备注:

点击查看摘要

Abstract:Worldwide neuroimaging data could strengthen diagnostic foundation models, but privacy rules often prevent centralizing brain MRI scans. We present SCAN, a site-aware collaborative adaptation framework for Neurological Disease Classification that lets new sites adapt a 3D medical vision-language model (VLM) without retraining or sharing patient scans. Each site keeps exact class prototypes for local prediction and can share privacy-protected class summaries: norm-bounded sums and counts perturbed once with calibrated noise. Using 7,641 scans from 67 sites across 12 countries, covering Alzheimer's disease (AD), stroke, epilepsy and controls, we assess local adaptation, cross-site benefits, and effects on existing sites. At seven unseen sites, the frozen VLM's zero-shot AUCs were 0.833-0.945 for AD and stroke. Training-free local prototypes improved epilepsy AUC at three sites from 0.598/0.625/0.508 to 0.684/0.729/0.762 and AD AUC at one site from 0.833 to 0.863, nearly matching a classifier trained at each site (mean AUC 0.757 vs. 0.759). With differential privacy ($\epsilon$ = 4), new sites contributed without materially reducing accuracy at existing sites (AUC change $\leq$0.2%), although gains from sharing were limited, and membership attacks performed near chance. SCAN offers hospitals a worldwide framework to adapt and share brain MRI VLMs without exchanging scans or retraining.

183. 【2611.21945】Benchmarking Deep Learning Models for Wheelchair Configuration Classification in Accessible Automated Vehicle Applications

链接:https://arxiv.org/abs/2611.21945

作者:Samir Ahmed,Shaaz Saleem,Devin Dhami,Wesley Maia,Angel Martinez-Sanchez,Parthib Roy,Jannatul Ferdous Srabonee,Ahmed Sabbir Arif,Ross Greer

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO)

关键词:Making automated vehicles, vulnerable road users, including wheelchair users, accessible requires consideration, Making automated

备注:

点击查看摘要

Abstract:Making automated vehicles accessible requires consideration of vulnerable road users, including wheelchair users. To offer a more tailored experience that supports independence for this group, vehicle design needs to accommodate the wide range of wheelchair configurations. However, wheelchairs are individualized, varying in frame geometry, propulsion, and visual appearance. Moreover, occupants or accessories may obscure visual cues. Existing mobility-aid datasets only label the presence of a wheelchair, rather than describing its specific configuration. To fill this gap, this paper introduces the Wheelchair Configuration Image Dataset (WCID), comprising 467 face-blurred images across 192 capture groups solely for evaluation. Each image is annotated with (i) a two-class label of manual or powered, (ii) a chair subtype, (iii) occupancy, viewpoint, setting, lighting, occlusion, propulsion, and control, with a 273-image validation split and 194-image test split. Three convolutional neural network backbones and a frozen vision-language probe are trained on an external image dataset and evaluated on WCID to measure cross-dataset generalization, while also testing robustness using Gaussian blur. Convolutional models do well on clean images, but performance drops under strong blur, leaving a gap before deployment. Code, split assignments, labels, trained weights, and the face-blurred images is available at: this https URL

184. 【2611.21940】Does the Model Use What It Cites? Counterfactual Tests of Grounded Reasoning Chains in Small Video-Language Models

链接:https://arxiv.org/abs/2611.21940

作者:Jugal Gajjar,Kamalasankari Subramaniakuppusamy

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词:cited, model looked, CLEVRER, NExT-QA chains, answers

备注: 24 pages, 4 figures, 27 tables. Code: [this https URL](https://github.com/JugalGajjar/CausalSight)

点击查看摘要

Abstract:A grounded reasoning chain cites a frame span and a box for every step, so a reader can check where the model looked. Whether the answer depends on the cited region is a different question. We test it by intervention: the regions a model cited in its own chain are blacked out, and the share of correct answers that flip is compared with blacking out boxes of the same size elsewhere on the same frames. The paired difference, the cite gap, needs no annotation. We apply it to 2-3B video-language models trained on exact CLEVRER chains and on pseudo-labelled NExT-QA chains. With the same weights, the cite gap is 0.089 on CLEVRER and 0.003 on NExT-QA. Pooled over models, masking the cited boxes flips 2.2 times as many correct answers as the control on CLEVRER and 1.1 times as many on NExT-QA, also among the answers that depend on the video at all, while the boxes pass a grounding check on both. Masking the cited entity on every frame, instead of the cited box, flips 1.9 times as many answers as its control. The NExT-QA chains were supervised to cite two frames of entities that stay visible on most frames, so this outcome is what the supervision predicts; the point is that the usual check on grounded chains cannot see it. A citation can be verifiable and relevant without the answer depending on it, and a test of grounded reasoning should remove what a chain names, not only where it points.

185. 【2611.21938】HubEgo-100K: In-the-Wild Egocentric Video of Skilled Work for Robot Learning

链接:https://arxiv.org/abs/2611.21938

作者:Javad Amirian,Armin Kiani,Loïc Schaeffer,Tim Sprecher,Mohamed Taha,Karthik Yadati

类目:Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:imitation generalize poorly, Robot policies trained, policies trained, trained by imitation, imitation generalize

备注: 22 pages, 18 figures, 7 tables. Dataset: [this https URL](https://huggingface.co/datasets/HubLabs/HubEgo-100K)

点击查看摘要

Abstract:Robot policies trained by imitation generalize poorly outside the environments and objects seen in training. Published data-scaling studies find that generalization grows with the diversity of training environments and objects rather than with more demonstrations per environment. Robot data is costly to collect across many environments, whereas egocentric human video can be recorded in the wild at scale; existing egocentric video, however, mostly shows daily-life activity and contains little skilled work in real workplaces. We present HubEgo-100K, a dataset built for diversity. This version of the paper covers the first release, v1.0: 10,124 hours of 1080p egocentric video with synchronized 100 Hz inertial (IMU) data from one head-mounted phone camera. In v1.0, 12,227 contributors record their own unscripted work in 15,548 environments (each one contributor's own setting of one type, such as their kitchen or workshop) across 11 setting types, 30 work categories, 56 task types and 35 action families, with 83% of hours in workplace settings. The release comprises 72,754 episodes with machine-generated action and language annotations, in LeRobot and MCAP formats under CC BY 4.0. We measure diversity along each axis, show that inside v1.0, with episodes in random order, new contributors and words keep appearing, and relate the measurements to published evidence on six data properties tied to policy performance, including hand visibility and inertial sensing. We also document collection, curation, privacy measures and data format, and provide a datasheet. Later versions of this paper will add benchmarks and cover further releases toward 100,000 hours.

186. 【2611.21924】GridDriver: On-Board BEV-Based Language Planning and Reasoning

链接:https://arxiv.org/abs/2611.21924

作者:Katharina Winter,William Engel,Zain A. Alishammat,Fabian B. Flohr

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:enable language-interactive driving, conditioned large language, large language models, deployment requires efficient, alongside autoregressive language

备注:

点击查看摘要

Abstract:Bird's-Eye-View (BEV)-conditioned large language models (LLMs) enable language-interactive driving, but onboard deployment requires efficient perception and continuous planning alongside autoregressive language generation. We present GridDriver, an efficient BEV-conditioned LLM framework combining trajectory prediction, structured driving indicators, natural-language navigation, driving explanations, and scene question answering. Lightweight spatio-temporal BEV perception and spatially structured tokens provide scene context to a shared LLM, while frame-wise scheduling interleaves trajectory prediction with asynchronous language generation. GridDriver achieves competitive performance on public benchmarks, reaching 87.9% PDMS on NAVSIM and 57.6% accuracy on nuScenes-QA with a shared planning and QA checkpoint. Spatial representation analyses demonstrate improved geometric information retention and trajectory prediction compared with Q-Former compression. The system achieves 32.7 ms standalone planning latency and 9.4 plans/s in an onboard ROS 2 pipeline. We further evaluate planning on our own data recordings and demonstrate open-loop onboard operation on a research vehicle. Across public benchmarks and real-world evaluations, we identify strengths and limitations of the BEV-based approach.

187. 【2611.21923】Wrong Input, Wrong Threshold: Re-evaluating Adversarial Facial Privacy

链接:https://arxiv.org/abs/2611.21923

作者:Tunahan Parlayıcı,Erchan Aptoula,Yücel Saygın

类目:Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

关键词:black-box recognition models, Published face-privacy methods, recognition models, face-privacy methods report, black-box recognition

备注: 10 pages main text and 15 pages supplementary material. Submitted to IEEE Transactions on Information Forensics and Security. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

点击查看摘要

Abstract:Published face-privacy methods report protection above 90% against black-box recognition models. That number comes from an evaluation protocol with two independent defects, reported in a measure that cannot size either one. The input is wrong: methods published since 2022 feed the network the whole photograph, or a detector's box, where deployed systems detect, align to a landmark template and crop. Re-scoring the same files through a realistic front end costs a standard transfer attack 56% of its dodging protection and a budget-allocating attack 7%, with no image regenerated. The measure is wrong: that loss is a difference of success rates, so it saturates, moving by 8.2x over a budget sweep while the effect beneath it moves by 1.34x. We therefore report the paired cosine shift, in which both thresholds cancel algebraically, so the input defect holds without committing to a calibration. Measured that way it is 2.2x and 10.7x larger on three unseen recognizers, and at matched budget it reverses the L-infinity transfer ranking: the one surveyed method that aligns at evaluation gains 0.18 where MI-FGSM loses 0.05. The cause is a resampling mismatch, not perturbation lost outside the crop; optimising through a differentiable alignment operator largely removes it, adding +24 to +58 points on unseen recognizers and a commercial system, with a residual on one of them. The thresholds are wrong: the four constants inherited since 2021 hold the false-accept rate near its nominal 1% on aligned crops but admit 2.3-5.4% on whole images, with an opposite-signed bias across dodging and impersonation, the two tasks reported side by side. Differentiable alignment and gallery scoring are not new: the first generation of this literature used both, and we show what dropping them cost.

188. 【2611.21907】REEL: Brain-Guided Video Generation and Selection by Reranking Encoder Embeddings with Linear Decoding from fMRI data

链接:https://arxiv.org/abs/2611.21907

作者:Fabrizio Spera,Tommaso Boccato,Moein Khajehnejad,Nicola Toschi,Matteo Ferrante

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:magnetic resonance imaging, powerful artificial intelligence, functional magnetic resonance, made remarkable progress, large-scale public datasets

备注:

点击查看摘要

Abstract:Visual brain decoding from functional magnetic resonance imaging (fMRI) data has made remarkable progress in recent years, driven by increasingly powerful artificial intelligence (AI) models and the growing availability of large-scale public datasets. However, despite the impressive advances achieved in static image decoding, the reconstruction of videos from fMRI signals remains challenging due to the temporal mismatch between rapidly changing video stimuli and the slow dynamics of the blood-oxygen-level-dependent (BOLD) response. We evaluate a Bayesian-inspired proposal-and-rerank strategy on CC2017 and the BOLD Moments Dataset (BMD), using a linear semantic decoder, a pretrained video generator, and three neural encoding streams with ridge readouts and learned pooling in two streams. We refer to this framework as REEL (Reranking Encoder Embeddings with Linear decoding). Compared with a single generated candidate, reranking increases mean Video 50-way accuracy from 0.2359 to 0.2434 across three CC2017 participants and from 0.3653 to 0.3920 across ten BMD participants. These findings suggest an alternative and conceptually simpler strategy for improving video brain decoding, highlighting the potential of our approach as a complementary direction to increasingly complex pipelines.

189. 【2611.21892】mporal Pseudo-RGB Encoding for Label-Free Detection of VEEV Infection in Human Brain Endothelial Cells

链接:https://arxiv.org/abs/2611.21892

作者:Zhengjie Zhu,Stephanie Valdez Trefry,Hao Lu,Abbas Alili,Yongxin Guo,Aarthi Narayanan,Metin Nafi Gurcan

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Label-free detection, pathogen surveillance, detection of viral, central to antiviral, antiviral screening

备注: 20 pages. Supplementary material is included as an ancillary file

点击查看摘要

Abstract:Label-free detection of viral infection is central to antiviral screening and pathogen surveillance. Most deep-learning methods analyze individual frames and do not model temporal progression. We evaluate temporal pseudo-RGB encoding, which stacks three time-offset brightfield frames ($t{-}6$ h, $t{-}3$ h, $t$) as the red, green, and blue channels of a single image so that morphological change becomes color and an ImageNet-pretrained convolutional neural network (CNN) can be trained on infection trajectories without architectural modification. In human brain microvascular endothelial cells (HBMVEC) infected with Venezuelan equine encephalitis virus (VEEV) TC-83, a multi-task network predicts infected-versus-mock status and time post-infection in one forward pass. Across three experimental runs under leave-one-row-out cross-validation, with all 36 wells scored out of fold, the encoding reaches 91.6% accuracy against 87.4% for the single-frame model (paired difference $+4.2$ percentage points, 95% CI $[+2.5, +6.1]$; sign-flip $p = 3\times10^{-5}$; well-level inference, conditional on three runs). At the late-phase endpoint (40-48 h), where floating cells and debris can make conventional brightfield images difficult to interpret, the advantage widens to $+23.9$ points (95% CI $[+19.2, +28.9]$). Time post-infection is recovered on the fixed row split with MAE = 1.31 h ($R^2 = 0.975$). Among the temporal models tested the encoding has the highest mean accuracy, at a fraction of the cost of the recurrent and 3D convolutional alternatives, though only its margin over the single-frame model is resolved; the tested ViT-B/16 backbone showed no corresponding gain, so the finding is limited to convolutional backbones and this virus-cell system.

190. 【2611.21890】Domain-Tuned Diffusion Super-Resolution for 4K Facial Asset Maps

链接:https://arxiv.org/abs/2611.21890

作者:Elly Akhoundi,Mathieu Lamarre,Thibault Goyallon,Patrick Anderson,Étienne Danvoye

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)

关键词:Physically based facial, generative pipelines commonly, Physically based, pipelines commonly produce, facial assets require

备注: Accepted to SIGGRAPH Asia 2026 Technical Communications. 4 pages

点击查看摘要

Abstract:Physically based facial assets require 4K albedo and displacement maps for cinematic close-ups, yet generative pipelines commonly produce them at only 1K. Naively applying photographic super-resolution is a poor fit: facial UV maps have domain-specific statistics, and displacement is a scalar height field whose errors directly distort geometry. We present a domain-tuned diffusion upscaler for 4x (1024 to 4096) facial asset super-resolution. Starting from a bilinearly upsampled map, we adapt a frozen SDXL backbone per modality with lightweight LoRA modules, while a Tile ControlNet preserves input structure as the diffusion prior restores pore- and wrinkle-scale detail. On held-out maps, our method produces sharper, more faithful detail than bilinear and off-the-shelf GAN and diffusion super-resolvers, reducing albedo LPIPS from 0.21 to 0.08 while avoiding misplaced or excessive displacement relief. These results show that lightweight domain adaptation can produce render-ready 4K facial asset maps without a custom super-resolution architecture.

191. 【2611.21867】FaceRiff: Data-Efficient Unified Text-to-3D Face Asset Synthesis via Geometric Conditioning

链接:https://arxiv.org/abs/2611.21867

作者:Elly Akhoundi,Mathieu Lamarre,Thibault Goyallon,Patrick Anderson,Étienne Danvoye

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR)

关键词:photorealistic digital-human rendering, High-resolution facial datasets, consistent UV-mapped geometry, physically based displacement, High-resolution facial

备注: Accepted to SIGGRAPH Asia 2026 Conference Papers. 11 pages, 11 figures, 2 tables

点击查看摘要

Abstract:High-resolution facial datasets with consistent UV-mapped geometry, albedo, and physically based displacement are scarce, yet such assets are essential for photorealistic digital-human rendering. Existing 3D face generation methods are often slow, single-modality, or require large specialized datasets. Meanwhile, large image diffusion models encode strong facial priors but do not natively produce lighting-independent textures, pore-scale displacement, or UV-aligned geometry. We present FaceRiff, a unified, data- and parameter-efficient framework for generating complete 3D face assets (mesh, albedo, and displacement) directly from text in a shared UV space. FaceRiff adapts a pretrained SDXL backbone with task-specific LoRA adapters and uses UV normal maps as geometric conditioning: per-instance normals guide albedo and displacement synthesis, while a dataset-mean normal provides a canonical spatial anchor for mesh generation. Using only 2,049 scans from approximately 350 identities and training on a single GPU, FaceRiff updates less than 3% of the backbone parameters per task and produces render-ready 3D face assets without per-instance optimization. Compared with FaceG2E and DreamFace, FaceRiff produces greater per-prompt diversity while preserving prompt alignment and fixed-topology UV consistency, and additionally generates lighting-independent albedo suitable for PBR relighting and pore-scale displacement absent from prior text-driven baselines. A blind study with 45 industry professionals shows that FaceRiff achieves substantially higher perceived realism than DreamFace, approaching that of real captures. Overall, FaceRiff demonstrates that pretrained diffusion priors can be adapted to unified 3D face asset synthesis under limited data.

192. 【2611.21865】PromptPack: Training-Free Augmentation of Diffusion Editors for Intent-Aligned Spatial and Semantic Control

链接:https://arxiv.org/abs/2611.21865

作者:Sophia Zalewski,Mustafa Munir,Enting Liu,Anjul Patney,David Dynerman

类目:Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词:image-editing tasks require, tasks require confining, user-designated source content, preserving user-designated source, intended spatial regions

备注: 32 pages, 21 figures, including supplementary material

点击查看摘要

Abstract:Many image-editing tasks require confining changes to intended spatial regions while exactly preserving user-designated source content. Instruction-driven editing pipelines often leave such user-intent underspecified, while inpainting editors condition generation on explicitly defined edit support but not on the spatial assignment of individual edit concepts. PromptPack addresses both limitations by equipping diffusion editors with two explicit 'Edit Guides': an edit-role partition that labels each pixel as 'Keep,' 'Permit,' or 'Modify' to specify where edits may occur, and a regional-prompt assignment that maps spatial regions to text prompts to specify which concepts apply where. These guides may be manually specified or, for source-object edits, automatically derived from a text-grounded SAM 3 mask. Without retraining, PromptPack injects independently embedded regional prompts into the editor's fixed-length text sequence and uses the Edit Guides to spatially mask attention, gate flow updates, and restore protected source pixels. We integrate PromptPack into FlowEdit FLUX, FlowEdit SD3, and FLUX Kontext and demonstrate improved requested-concept placement and protected-content preservation across all three integrations on PIE-Bench++. In a pairwise user study, PromptPack achieves an 87% preference rate over FlowEdit FLUX, establishing PromptPack as a practical, training-free interface for intent-aligned diffusion editing.

193. 【2611.21851】AR-WAM: efficient streaming world-action modeling for autonomous driving

链接:https://arxiv.org/abs/2611.21851

作者:Baiting Luo,Shatadal Mishra,Ahmadreza Moradipari,Nejib Ammar

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)

关键词:Autonomous driving requires, driving requires anticipating, Autonomous driving, requires anticipating, evolve while responding

备注:

点击查看摘要

Abstract:Autonomous driving requires anticipating how traffic will evolve while responding quickly to new observations. Video foundation models offer the first ability, but repeated history encoding and iterative video generation make them costly to use for driving. We present AR-WAM, an efficient streaming world-action model that combines autoregressive temporal modeling with single-pass future conditioning. Because its video backbone is causal, AR-WAM updates its visual context incrementally, reusing past computation and conditioning future prediction on observed motion. We further hypothesize that future features computed from recent observations can improve generalization in dynamic traffic without iterative video generation. AR-WAM therefore obtains these features in one forward pass and uses them to condition trajectory generation, and reinforcement learning then improves the policy through direct optimization of driving rewards. With a single front camera, AR-WAM achieves 91.5 PDMS after supervised training and 94.0 after reinforcement learning on NAVSIM-v1, outperforming the compared strong end-to-end world-action models. In a dynamic setting of continuous driving, supervised AR-WAM keeps its visual history across decisions and outperforms strong world-action baselines.

194. 【2611.21846】Can a World Model Predict a Deepfake Video? A Consistency Margin Prior for Deepfake Detection

链接:https://arxiv.org/abs/2611.21846

作者:Pradip Gupta,Shubham Mandloi,Ravi Kumar Satzoda,Sujeeth Bharadwaj,Yassine Benajiba,Dan Roth

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Deepfake detectors, drops when tested, predictive video model, Deepfake, Latent Consistency Head

备注: 20 pages, 4 figures, 5 tables

点击查看摘要

Abstract:Deepfake detectors often perform well on the dataset they are trained on, but their performance drops when tested on videos from different datasets. In this paper, we study whether a predictive video model can provide a signal that generalizes better across datasets. Instead of relying only on generator-specific artifacts, as many existing detectors do, we use a model trained to predict natural video and measure the difference between what it predicts and what it observes in a video. Using V-JEPA 2.1, we keep the encoder frozen and adapt the predictor using rank-16 LoRA. We define the difference between the predictor output and the frozen encoder target as the prediction residual. We hypothesize that manipulated clips produce, on average, larger prediction residuals than authentic clips, and use this as our consistency-margin prior. We process these residuals using a lightweight Latent Consistency Head (LCH), which separates residual magnitude from direction for training and classification. To test whether the direction of the consistency margin affects cross-dataset generalization, we compare standard and reversed margin objectives while keeping the remaining training setup fixed. We match the two settings on FF++ validation performance before evaluating them on unseen data. The reversed-margin setting exhibits a larger cross dataset generalization gap on average, providing evidence that the direction of the consistency margin affects cross-dataset transfer. Our complete model adds only 8.25M trainable parameters, which is 2.47% of the total 334M parameters. Trained only on FF++, it achieves an AUC of 90.5 on Celeb-DFv2 and performs well across several other cross-dataset benchmarks. Our ablations show that separating residual magnitude from direction, reducing dataset-specific variation, and using a low-rank projection improve cross-dataset generalization in our experiments.

195. 【2611.21839】VisHead-Spec: Head-Routed Visual Attention for Multimodal Speculative Decoding

链接:https://arxiv.org/abs/2611.21839

作者:Xin Guo,Arushi Rai,Xiang Zhou,Qiang Zhang,Siyu Lin,Xiangjun Fan,Lizhu Zhang

类目:Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词:Speculative decoding accelerates, accelerates vision-language models, decoding accelerates vision-language, target model outputs, draft model

备注:

点击查看摘要

Abstract:Speculative decoding accelerates vision-language models(VLMs) while preserving the target model's outputs, but its speedup diminishes under high concurrency serving as the system becomes more compute bounded as the batch size increases. This problem is pronounced for multimodal speculative decoding as the long range of the image tokens in the prompt can significantly increase the computational cost during draft token prediction. The block-diffusion drafters (e.g. DFlash, DSpark) can effectively speed up the draft model efficiency by predicting multiple draft tokens in one forward pass, but their speedup for VLMs under high concurrency is still modest (9%). In order to understand this gap, we examine the information flow between different modalities from target model to draft model and identify the sparsity pattern of visual attention between the target and draft models: only small set of key-value heads in the draft model need direct visual feature attention in the context and only visual features from top level layers in the target model need to be attended in the context. We therefore propose VisHead-Spec, which selects a small, fixed set of key-value (KV) heads to attend to all image features from top level layers in the target model and restricts the remaining heads to text features. On Qwen3-VL-8B and MMSpec, VisHead-Spec-8 lets 8 of the drafter's 40 KV heads read the image while keeping accepted length within 0.3% of the block-diffusion draft model baseline (i.e. DSpark). At batch size 64, its throughput gain over autoregressive decoding increases to 16.0%, compared with 9.5% for DSpark; at batch size 1, its speedup remains comparable to DSpark.

196. 【2611.21816】Rethinking Perceptual Similarity for Remote Sensing: Multi-Layer Attention Scoring and Human Preference Benchmarking

链接:https://arxiv.org/abs/2611.21816

作者:Eli Underwood,Marc Bosch,Neil Joshi,Jeffrey Wen,Myron Brown

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:natural images transfer, images transfer poorly, remain visually plausible, Perceptual similarity metrics, Remote Sensing Perceptual

备注: Accepted to the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027). 9 pages

点击查看摘要

Abstract:Perceptual similarity metrics for natural images transfer poorly to remote sensing (RS), where severe geospatial and semantic failures can remain visually plausible while still being decisively wrong for downstream use. To address this, we develop a novel human-aligned perceptual quality metric for generated RS imagery and evaluate it across several generation tasks. We first conduct a controlled perturbation study where we progressively increase the severity of common synthetic perturbations. Using the layer-wise Aligned Attention Score (AAS) responses in RemoteCLIP, we find that different RS artifacts are best captured at different depths. Based on these findings, we introduce Remote Sensing Perceptual Distance (RSPD), a pairwise metric that averages seven independently calibrated layer distances without tuning on human-preference labels. To evaluate our metric on realistic RS generation tasks, we construct a blind, reference-conditioned two-alternative forced-choice (2AFC) benchmark with five 300-triplet subsets spanning synthetic artifacts, airborne and spaceborne super-resolution, SAR-to-optical translation, and timeseries controls. We also construct a 300-triplet ordered misregistration benchmark with deterministic labels. Using the same RemoteCLIP checkpoint, RSPD substantially outperforms simple cosine distance with the final global embedding and is competitive with the strongest generic baselines across the realistic RS generation tasks.

197. 【2611.21812】Sketch, Don't Paint: Allocating Test-Time Compute in Generative Visual Reasoning

链接:https://arxiv.org/abs/2611.21812

作者:Sheng Lu,Guangpin Tao,Tong Lu,Ying Tai

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal models increasingly, video solutions frame, sketching maze paths, models increasingly reason, solutions frame

备注: 11 pages, 5 figures, 3 tables

点击查看摘要

Abstract:Multimodal models increasingly reason by synthesizing pixels, sketching maze paths within interleaved chains of thought or rolling out video solutions frame by frame. Each visual thought runs the full diffusion schedule inherited from photorealistic synthesis, so iterative denoising dominates inference cost. We study how to allocate test-time compute along two axes: when to render visual thoughts rather than thinking in text or answering directly, and how many denoising steps each thought requires. Controlled interventions that vary only how the thought is rendered uncover three regimes. Causal thoughts carry the plan and become legible early: an 8-step sketch nearly matches a 50-step render in accuracy, commits to the same plan as often as two independent full renders agree, and in video models mostly fails by stalling short of the goal, so the rollout abstains. Decorative thoughts can be omitted without loss, whereas harmful thoughts lower accuracy. Because the regime depends on both model and task, always drawing is suboptimal. Across 14 model-benchmark pairs of three interleaved reasoners, answering directly, without any thinking, wins 9 pairs, and choosing among direct, text-only, and visual tiers from ten labeled examples per pair raises mean accuracy from 60.7% (always drawing) to 65.1%. Where drawing pays, we propose sketch-and-vote, which samples 8-step sketches (a step count chosen without labels) from independent noises until one answer reaches three votes. With this one setting, sketch-and-vote beats full rendering with fewer denoising steps on an image reasoner and two video reasoners, by 8.6 points on VSP spatial planning and by 9.6 and 22.1 points on mazes.

198. 【2611.21802】Data-Driven Variable-Length Compression of 3D Representations

链接:https://arxiv.org/abs/2611.21802

作者:Yvette Y. Lin,Sai Karthikey Pentapati,Sarvesh Sundaram,Guandao Yang,Sara Fridovich-Keil

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:leverage dataset-level statistics, fixed compression ratio, Compressing, leverage dataset-level, dataset-level statistics

备注:

点击查看摘要

Abstract:Compressing 3D shapes is important for the efficiency of many applications, yet existing methods either cannot leverage dataset-level statistics or use a fixed compression ratio for all shapes. We propose a learned variable-length compression method that exploits structure across a training dataset while adapting compressed representation size to individual shape complexity using only fast feed-forward inference. Our method operates on general latent representations and improves rate-distortion for both meshes and signed distance fields. Code is available at this https URL.

199. 【2611.21782】Every Camera Grows Up: Camera-Height Regression in Interactive Video World Models

链接:https://arxiv.org/abs/2611.21782

作者:Sheng Lu,Guangpin Tao,Tong Lu,Ying Tai

类目:Computer Vision and Pattern Recognition (cs.CV)

关键词:Interactive video world, world models serve, embodied agents, action trajectory, Interactive video

备注:

点击查看摘要

Abstract:Interactive video world models serve as simulators for embodied agents: from a starting image and an action trajectory, they generate the views the agent would see. The starting image fixes how high the camera is, for example 0.15 m for a floor robot or 2.2 m for an overhead camera, and a faithful simulator must keep this height as the camera moves. We show that six recent open-weight models fail to do so: as motion replaces the starting view with generated content, they move the camera toward human eye level, a failure we call camera-height regression. Our benchmark, EyeHeight, pairs six rendered elevations (0.15 m to 2.2 m) and four calibrated real-world rig heights with scale-free multi-view height estimation. All six models lose their initial height during a $180^\circ$ turn-and-walk rollout: initialized at 0.15 m, only 0-20% of clips end within $1.3\times$ of the starting height as inferred viewpoints converge to human heights of 1.1 m to 1.5 m, whereas ground-truth renders remain within a few percent. In Matrix-Game models, homography-tracked floor motion stays consistent with constant elevation during rotation even as newly outpainted room geometry yields a higher reconstructed viewpoint. Regression grows with rotation angle, begins while the start frame remains in context, and largely reverses in SANA-WM when a $360^\circ$ turn restores the initial view. We trace this pull to human-centric video priors in which floor-level views are nearly absent: in SANA-WM, textual height cues and dense floor-disparity maps do not prevent it, whereas classifier-free text guidance during the first half of denoising strengthens it. Combining unguided sampling with height-balanced fine-tuning recovers more retention but costs 5 MUSIQ points, a loss fixed during those same early steps. Viewpoint drift alone shifts the paths predicted by visual navigation policies.

200. 【2611.21706】Video recordings and play behaviour annotations of group-housed dairy calves on two Dutch farms

链接:https://arxiv.org/abs/2611.21706

作者:Haiyu Yang,Heidi Lesscher,Enhong Liu,Miel Hostens

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:individual behaviour annotations, dairy calves, annotations is scarce, indicator of positive, dairy farm

备注:

点击查看摘要

Abstract:Play is used as an indicator of positive welfare in dairy calves, but openly available video of group-housed calves with individual behaviour annotations is scarce. We describe video from four camera deployments of about one week each in group pens of dairy calves on two farms in the Netherlands: a research and teaching dairy farm (2024 and 2025) and a commercial dairy farm (2024). The recordings comprise 1,173 video files spanning 651 h. For eight observation days, trained observers coded calf behaviour continuously in Noldus The Observer XT with an 18-item ethogram of play and other behaviours, covering 104 h of video, 90 h of which have every calf in the pen coded. The release also contains 1.1 million decoded frames from seven annotated sessions, a per-frame timestamp read by optical character recognition from the camera clock burned into each frame, per-calf segmentation tracks and per-calf frame-level play labels. The data support studies of calf behaviour and welfare and the development and evaluation of automated behaviour recognition.

201. 【2611.21690】EgoLink: Egocentric Language-Vision Interactive Network Knowledge Challenge Summary

链接:https://arxiv.org/abs/2611.21690

作者:Renhe Sun,Yueying Feng,Bohan Yu,Tong Niu,Yunqi Liu,Zitong Wang,Haolin He,Kexin Shi,Hualei Wang,Qiuqiang Kong,Chang Yao,Yuge Huang,Weiqiang Wang,Jingyuan Chen,Jian Liu

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:ACM Multimedia, Challenge at ACM, linking first-person perception, intelligence linking first-person, EgoLink Challenge

备注: Published in ACM Multimedia 2026 (MM '26)

点击查看摘要

Abstract:The EgoLink Challenge at ACM Multimedia 2026 benchmarks egocentric multimodal intelligence linking first-person perception, social reasoning, and interactive action. Unlike benchmarks centered on visible objects and activities, EgoLink evaluates whether models can interpret emotional and social cues, resolve visually grounded references, and convert user requests into verified tool-mediated actions. Its two tracks cover social reasoning in egocentric video and interactive agents that complete service tasks through dialogue, tool use, and closed-loop execution. Together, they test whether perception, reasoning, and decision-making remain coupled under both offline question answering and state-changing interaction. We highlight a multi-stage Track 1 data pipeline for multiple-choice question (MCQ) generation, chain-of-thought generation, automatic quality grading, and video-contribution filtering. We summarize the task design, evaluation metrics, rules, leaderboards, and representative solutions. The benchmark combines objective answer scoring with process- and result-based evaluation, enabling analysis of both final correctness and execution quality. The best Track 1 system achieved 0.9263 accuracy, while the best Track 2 system achieved 0.844 joint success and 0.916 micro accuracy. Participant reports reveal a shared principle: strong systems make intermediate evidence explicit through candidate verification, option-robust reasoning, scenario-aware planning, tool canonicalization, and state-aware correction before answering or acting. These findings highlight the importance of process verification and evidence-grounded reasoning for reliable egocentric multimodal intelligence.

202. 【2611.21680】Edge-Adaptive Hiera-Seg Model for Building-Integrated Photovoltaic Power Forecasting

链接:https://arxiv.org/abs/2611.21680

作者:Na Yu

类目:Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:reliability jointly affect, device reliability jointly, affect power generation, integrated photovoltaic power, jointly affect power

备注: 13 pages, 7 figures, 1 table

点击查看摘要

Abstract:Building integrated photovoltaic power forecasting is challenging because facade orientation, rooftop geometry, nearby buildings, vegetation, cloud movement, module temperature, inverter status and edge device reliability jointly affect power generation. This paper proposes an edge-adaptive HieraSeg model for short term BIPV power forecasting with multi-orientation visual-irradiance fusion. RGB facade images, optional thermal cues, irradiance measurements, module temperature, facade orientation, rooftop masks, shading labels, sky condition, historical power and edge device state are aligned into synchronous forecasting windows. HieraSeg extracts hierarchical regions from facade, rooftop, sky, shadow and background images, while the edge-adaptive module changes feature weights under missing frames, latency shifts and local shading changes. The segmentation branch identifies occluded module areas and separates facade, rooftop, sky and background evidence before the forecasting head estimates future BIPV output. Experiments are designed on a simulated multibuilding BIPV dataset with unseen building and unseen orientation tests. The model reports predicted power, confidence interval, dominant evidence, occlusion contribution, orientation contribution and energy-management review priority. This output is intended to show whether the forecast is driven by irradiance change, visible shading, orientation response, stale edge information or recent power history. The framework supports local forecasting at edge controllers with limited communication delay and computing resources, linking visual occlusion, irradiance dynamics and power history to traceable forecasting results for building energy management, microgrid scheduling and BIPV operation planning.

203. 【2611.21655】Depth-Aware Activation Steering via Attention Residuals

链接:https://arxiv.org/abs/2611.21655

作者:Shilong Zhao(Independent Researcher)

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:modulate LLM behavior, LLM behavior, modulate LLM, typically inject vectors, existing methods typically

备注:

点击查看摘要

Abstract:Activation steering is a simple, training-free way to modulate LLM behavior, yet existing methods typically inject vectors at a single layer and lack mechanisms for depth-aware propagation or internal verification. We combine two recent ideas - Attention Residuals (AttnRes) providing learnable cross-layer pathways, and Jacobian-lens (J-space) concept readout - into a lightweight depth-aware steering pipeline. On two small open models (Qwen3-0.6B and Qwen3.5-0.8B), distributing a persona vector according to AttnRes-style depth weights yields stronger internal alignment (deeper-layer concept cosine and rank, p0.0001) and stronger behavioral shifts than single-layer injection. The effect is sign-specific: reverse vectors invert all six metrics, random directions degrade alignment (p0.0001), and a short LoRA fine-tune erases the imprint. Injection rewires attention strictly downstream of the injection point (upstream JS = 0.00000). Three practical findings follow. First, a layer-wise geometric decomposition of cosine readouts: at the injection layer 123% of the increase is arithmetic, while 5-11 layers downstream 100% is dynamical. Second, an intensity window: effects are monotone over 0.3-0.7, then generation collapses (617 to 306 to 25 chars). Third, metric discipline: keyword-rule metrics fail LLM-judge validation (kappa = 0.09), and two rule-based conclusions were retracted. Training the depth weights on a steering objective (200 steps, frozen backbone) raises final alignment 10x on held-out prompts. Cross-persona vectors retain 96-99% of the effect: specificity holds against random, not semantic, directions. We contribute a practical, low-overhead depth-aware steering method with a careful evaluation protocol. Code and data are released.

204. 【2611.21644】MInfoVisQA: A Multilingual Benchmark for Information-Rich Visual Question Answering

链接:https://arxiv.org/abs/2611.21644

作者:Changjiang Jiang,Jiang Zhou,Xinbin Yuan,Fan Zhang,Tao Feng,Zhuohan Xie

类目:Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词:Multimodal large language, maintain consistent understanding, Multimodal large, excel in vision-language, vision-language tasks

备注: Dataset: [this https URL](https://huggingface.co/datasets/arnodjiang/MInfoVisQA) Code: [this https URL](https://github.com/arnodjiang/MInfoVisQA)

点击查看摘要

Abstract:Multimodal large language models (MLLMs) excel in vision-language tasks; yet, whether they maintain consistent understanding of information-rich visuals (InfoVis) when the surface language changes remains unclear. To quantify this capability, we introduce MInfoVisQA, a parallel benchmark with 8,960 QA configurations derived from 128 seed instances across 24 languages. We construct seed-matched, language-parallel visuals and QA pairs by disentangling numerical-structural data from text and programmatically synchronizing translated labels. We evaluate 25 MLLMs under two settings: Language-Aligned QA (LQA, matching visual-text languages) and Cross-Language QA (XQA, fixed QA language with varying visual languages). The results show that aggregate accuracy masks substantial robustness gaps: two models with comparable mean LQA accuracy (80.4\%) exhibit performance spreads of 7.8 and 20.3 percentage points across languages. Moreover, all 25 models score lower with non-English visuals under fixed English QA, underscoring the need for cross-language sensitivity metrics.

205. 【1702.07189】Analyzing Learned Convnet Features with Dirichlet Process Gaussian Mixture Models

链接:https://arxiv.org/abs/1702.07189

作者:David Malmgren-Hansen,Allan Aasbjerg Nielsen,Rasmus Engholm

类目:Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词:Convolutional Neural Networks, Convolutional Neural, Neural Networks, achieved good results, computer vision tasks

备注: Presented at NIPS 2016 Workshop: Practical Bayesian Nonparametrics

点击查看摘要

Abstract:Convolutional Neural Networks (Convnets) have achieved good results in a range of computer vision tasks the recent years. Though given a lot of attention, visualizing the learned representations to interpret Convnets, still remains a challenging task. The high dimensionality of internal representations and the high abstractions of deep layers are the main challenges when visualizing Convnet functionality. We present in this paper a technique based on clustering internal Convnet representations with a Dirichlet Process Gaussian Mixture Model, for visualization of learned representations in Convnets. Our method copes with the high dimensionality of a Convnet by clustering representations across all nodes of each layer. We will discuss how this application is useful when considering transfer learning, i.e.\ transferring a model trained on one dataset to solve a task on a different one.

206. 【2611.23042】Uncovering the Invisible in Routine Radiology: Cross-Modal Detection of MRI-Verified Soft-Tissue Pathologies from CBCT via Physics-Guided 3D Self-Supervised Learning

链接:https://arxiv.org/abs/2611.23042

作者:Evgeny Alves Limarenko

类目:Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词:Routine X-ray modalities, cone-beam computed tomography, high-contrast mineralized tissues, human visual perception, abnormalities buried beneath

备注:

点击查看摘要

Abstract:Routine X-ray modalities like cone-beam computed tomography (CBCT) are optimized for high-contrast mineralized tissues, leaving soft-tissue abnormalities buried beneath photon noise and below human visual perception. Thus, detecting non-calcified pathologies requires secondary magnetic resonance imaging (MRI). We demonstrate that sub-visual radiographic signatures of soft-tissue pathology are physically preserved within routine CBCT scans and can be extracted for opportunistic screening using a targeted, physics-guided deep learning pipeline, even under extreme paired-data scarcity. Using the temporomandibular joint (TMJ) as a model system (N = 212 paired CBCT-MRI joints), we address the severe overfitting of high-capacity 3D networks through a two-stage framework. First, we employ a frozen full-grid 3D masked autoencoder (BertsWin) pre-trained on 6,550 unlabeled CBCT volumes via the GradientConductor (GCond) optimizer and an anatomy-aware objective (PhysLoss) redirecting gradient flow into the [-300, 300] HU soft-tissue window. Second, automated localization of the condylar zenith drives a deterministic 3D cropping that eliminates 81% of background osseous variance. Evaluated via a patient-isolated 3x10-fold stratified cross-validation protocol, a statistically robust sub-visual signal for MRI-verified synovial effusion (ROC AUC = 0.793) emerges exclusively from representations pre-trained with the PhysLoss and GCond regime. Crucially, only this setup captures true 3D anatomical chirality (p 0.001) and high intra-patient structural consistency (0.791) over inter-patient noise; conversely, identical architectures pre-trained with standard L2 loss or unmasked variance decomposition (MVC) collapse to random guessing. These findings establish a generalizable paradigm for repurposing routine, low-contrast radiographic scans into opportunistic screening tools for occult soft-tissue disease.

207. 【2611.22951】A high-dimensional spatial-physical coupling operator for generalizable super-resolution of three-dimensional turbulent flows

链接:https://arxiv.org/abs/2611.22951

作者:Zengyuan Zuo,Junjun Jiang,Fei Mu,Xubo Wang,Xianming Liu

类目:Fluid Dynamics (physics.flu-dyn); Computer Vision and Pattern Recognition (cs.CV)

关键词:requires simultaneously capturing, distinct physical quantities, flows requires simultaneously, simultaneously capturing multi-scale, velocity components

备注:

点击查看摘要

Abstract:Accurate representation of turbulent flows requires simultaneously capturing multi-scale spatial structures and the complex, nonlinear coupling between distinct physical quantities (\textit{e.g.}, velocity components and density). In practice, however, turbulent data are often constrained by low spatial resolution due to hardware limitations and computational costs. While current data-driven super-resolution methods have shown promise by learning mappings via convolutional neural networks (CNNs), they typically treat physical variables as independent channels. This simplified approach neglects intrinsic cross-variable correlations, causing models to struggle with high-fidelity reconstruction, particularly under extremely sparse conditions or in out-of-distribution regimes. To bridge this gap, we propose an architecture-agnostic spatial-physical coupling operator that extends the standard convolution into a joint spatial-variable dimension. Unlike conventional linear channel mixing, our framework constructs a unified spatial-physical representation within CNNs to explicitly capture local inter-variable interactions. By lifting features into a higher-dimensional manifold, this operator significantly enhances the model's representation capacity. Experiments demonstrate that this approach enables strong reconstruction performance and zero-shot generalization, offering a physics-aware inductive bias for super-resolution of three-dimensional turbulence. More broadly, this work suggests that high-dimensional operators offer a promising avenue for modeling intricate multi-scale turbulent flows.

208. 【2611.22440】he shape of individual differences in judgment: shared axes, personal weights, and when their spread crosses the consensus

链接:https://arxiv.org/abs/2611.22440

作者:Hiroshi Higashi

类目:Neurons and Cognition (q-bio.NC); Computer Vision and Pattern Recognition (cs.CV)

关键词:photographs and jokes, judge faces, predict people unseen, People, Abstract

备注:

点击查看摘要

Abstract:People differ in how they judge faces, artworks, photographs and jokes. Previous work measured the size of these differences; we ask what shape they take. We wrote three candidate shapes as nested generative models (same-sign reweighting of shared dimensions, a linear transform that allows reversal, and stimulus-specific offsets) and compared how well they predict people unseen in training, using ten public datasets (about 20,000 raters). The models recovered a person's judgment space from 10-20 judgments and predicted judgments of unseen stimuli. For faces, reweighting was sufficient, and weights opposing the population were not statistically detected. For artworks, weights spread continuously along the shared abstract-figurative direction, and 28 percent of raters fell on the opposite side from the population. This tail was much smaller when a different rater sample judged the same artworks. Individual differences thus differ in shape as well as size, and the shape depends on domain and raters.